2022-02-02T13:20:55.111 INFO:root:teuthology version: 1.1.0-0f634dc1 2022-02-02T13:20:55.113 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} --name pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi/6655341 -- /home/teuthworker/archive/pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi/6655341/orig.config.yaml 2022-02-02T13:20:55.168 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-02-02T13:20:55.239 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi/6655341 branch: wip-pdonnell-testing-20220202.034923 description: fs:upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '6655341' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific v16.2.4 ' name: pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20220202.034923 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b0d76d45e4cb48de326cfbdc43296681162f672c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b0d76d45e4cb48de326cfbdc43296681162f672c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20220202.034923 sha1: b0d76d45e4cb48de326cfbdc43296681162f672c owner: scheduled_pdonnell@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 sha1: b0d76d45e4cb48de326cfbdc43296681162f672c sleep_before_teardown: 0 suite: fs:upgrade suite_branch: wip-pdonnell-testing-20220202.034923 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_b0d76d45e4cb48de326cfbdc43296681162f672c/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b0d76d45e4cb48de326cfbdc43296681162f672c targets: smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDccHpJNJVbru+aFzZAM+DFBn6FKamT/U+TifH/+aLfdN/VyD4heB6EHsHAd+Z2KLqsPm6JXXimSVDK9AMIgPTJR9SY7Dc+KK4tnnLA9iX5Y3XUlHggPzKY9JhPu20HOjy3xlWAfMZ7qdmOcCsveuvGmpx911URjGiqGl/MZkCrUYH2x/jmjj/WKY/iJawXLccbBBTSuRgLXM6BQlWJ70gOY4keT5cJSuBf8IWOsPRf/9MS+v/adXSqSb3E4d0MuyriRDeIfOSPHRSxbjelqlr0r+uk9DW+rmqYJAt2umh+d/wSCmwaA3UgvveBiCnK0Ip3XSX/K1Ta8Cj88RSsgkFVyX9FngbjhpMW4n1JALm0zCBjpkL2/q45HInA2FOUWw71Ub7EZYsXtuVbfUdycR/PUQXNqrrWJEfTCTHCO9vcJzoN/AKOfCLoRSVSlHll4Yxl7mGp0l/JN3DaoDn/C13TjNbtGjxJzwfYk5SoMnYEqy52dWdn7z0+e+g6uljeDA0= smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6R8EjaEkrWAqyYSxWUQlbVNoQClG8dtOExjv0tMBspJDT+KxVpd16tGtokhXHyLgqey0US5wemCGg8Qu13fPsU2DPcfvNwbTku+mjx0AVrhc4WewxrR/vY5TN3zf18+uxjK1LzgcHkdSh+TZaGRXkW9iIPSgAQnG29BLu36v+udKLRo/Atr44HliJvNwGxq9eMdMRisYNhUsMWHrymmcSR8yHnY/XmYJt3km+y4RNDa/33b3QwWb09CoeP8/6geO4YBWaDV5PqfvwEOW65BKb942hfKDCIhpfIzcXq7YYtdMCpXzENuPOU9u/3a/8eSnQStDdVjw+30J8I0iIsMYJ0llLnrZ/hxD8idLvDOzoUBBYgsp5Ejm7N9kCxsJ+y9xvC+DZA08RUVgz63fDbQvTI2YvSSQ5KOCFxRsgtr+qW6COHHIURr2Eu2Gh/r6I0g7dsgiNaSGMq+JkHplf0mbUQ5PKYe5YpQhOPUWpyM7UtgsKpTX2hhM6uqgBvYF96tc= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - pexec: clients: - sudo modprobe -r ceph - sudo modprobe ceph disable_send_metrics=on - install: exclude_packages: - ceph-volume tag: v16.2.4 - print: '**** done install task...' - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - print: '**** done starting v16.2.4' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - ceph --format=json mds versions | jq -e ". | add == 4" - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology_branch: master teuthology_sha1: 0f634dc1c0a64a93646e6d007882c69b3e1663e0 timestamp: 2022-02-02_13:05:04 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20261 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2022-02-02T13:20:55.239 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_b0d76d45e4cb48de326cfbdc43296681162f672c/qa; will attempt to use it 2022-02-02T13:20:55.240 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_b0d76d45e4cb48de326cfbdc43296681162f672c/qa/tasks 2022-02-02T13:20:55.240 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-02-02T13:20:55.242 INFO:teuthology.task.internal:Checking packages... 2022-02-02T13:20:55.262 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b0d76d45e4cb48de326cfbdc43296681162f672c' 2022-02-02T13:20:55.262 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-02-02T13:20:55.263 INFO:teuthology.packaging:ref: None 2022-02-02T13:20:55.263 INFO:teuthology.packaging:tag: None 2022-02-02T13:20:55.264 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20220202.034923 2022-02-02T13:20:55.264 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:20:55.264 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20220202.034923 2022-02-02T13:20:55.474 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-10509.gb0d76d45 2022-02-02T13:20:55.475 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-02-02T13:20:55.485 INFO:teuthology.task.internal:no buildpackages task found 2022-02-02T13:20:55.485 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-02-02T13:20:55.539 INFO:teuthology.task.internal:Saving configuration 2022-02-02T13:20:55.582 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-02-02T13:20:55.592 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-02-02T13:20:55.621 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi/6655341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-02-02 13:16:25.007464', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP+9kQi+Wd7V/sIBmapEpkQzV8jSFnzVg+Y7hN9qsGdmwQTwiFYo2I1SjWO5GoLKlDcw0yLPzOsCV5GS29gSDyY='} 2022-02-02T13:20:55.642 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-02-02_13:05:04-fs:upgrade-wip-pdonnell-testing-20220202.034923-distro-default-smithi/6655341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-02-02 13:16:25.006169', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIbrgRbwFidgv6s/7X6Ll7ueuHyYGFDXPAfxsRaurz1fT4p1vJk4YtUNk+aSCSRLQ58V886q4fBrVQ7CJd+HFLc='} 2022-02-02T13:20:55.643 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-02-02T13:20:55.653 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2022-02-02T13:20:55.653 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2022-02-02T13:20:55.654 INFO:teuthology.run_tasks:Running task console_log... 2022-02-02T13:20:55.794 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3e536e3c80>, signals=[15]) 2022-02-02T13:20:55.796 INFO:teuthology.run_tasks:Running task internal.connect... 2022-02-02T13:20:55.807 INFO:teuthology.task.internal:Opening connections... 2022-02-02T13:20:55.807 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:20:55.810 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:20:55.880 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2022-02-02T13:20:55.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:20:55.953 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-02-02T13:20:55.966 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2022-02-02T13:20:55.987 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2022-02-02T13:20:55.988 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2022-02-02T13:20:56.047 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="CentOS Stream" 2022-02-02T13:20:56.047 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8" 2022-02-02T13:20:56.047 INFO:teuthology.orchestra.run.smithi033.stdout:ID="centos" 2022-02-02T13:20:56.048 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="rhel fedora" 2022-02-02T13:20:56.048 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8" 2022-02-02T13:20:56.048 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2022-02-02T13:20:56.048 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-02T13:20:56.049 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2022-02-02T13:20:56.049 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-02T13:20:56.049 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://centos.org/" 2022-02-02T13:20:56.049 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-02T13:20:56.049 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-02T13:20:56.050 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-02T13:20:56.051 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-02-02T13:20:56.081 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2022-02-02T13:20:56.102 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2022-02-02T13:20:56.103 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2022-02-02T13:20:56.161 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2022-02-02T13:20:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8" 2022-02-02T13:20:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2022-02-02T13:20:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2022-02-02T13:20:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8" 2022-02-02T13:20:56.163 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2022-02-02T13:20:56.163 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 8" 2022-02-02T13:20:56.163 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2022-02-02T13:20:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-02-02T13:20:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2022-02-02T13:20:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-02-02T13:20:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-02-02T13:20:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-02-02T13:20:56.165 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-02-02T13:20:56.181 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-02-02T13:20:56.198 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-02-02T13:20:56.257 INFO:teuthology.task.internal:Checking for old test directory... 2022-02-02T13:20:56.257 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2022-02-02T13:20:56.262 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2022-02-02T13:20:56.283 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-02-02T13:20:56.325 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-02-02T13:20:56.326 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2022-02-02T13:20:56.330 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2022-02-02T13:20:56.360 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-02-02T13:20:56.424 INFO:teuthology.run_tasks:Running task kernel... 2022-02-02T13:20:56.443 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-02-02T13:20:56.444 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-02-02T13:20:56.444 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2022-02-02T13:20:56.445 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2022-02-02T13:20:56.465 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-348.2.1.el8_5.x86_64 2022-02-02T13:20:56.465 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-348.2.1.el8_5.x86_64 2022-02-02T13:20:56.466 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-348.2.1.el8_5.x86_64 2022-02-02T13:20:56.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2022-02-02T13:20:56.467 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-348.2.1.el8_5.x86_64 2022-02-02T13:20:56.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2022-02-02T13:20:57.506 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:20:57.507 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:20:57.540 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:20:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:20:59.286 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - AppStream 33 MB/s | 19 MB 00:00 2022-02-02T13:20:59.385 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - AppStream 30 MB/s | 19 MB 00:00 2022-02-02T13:21:03.378 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Base 36 MB/s | 18 MB 00:00 2022-02-02T13:21:03.460 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Base 35 MB/s | 18 MB 00:00 2022-02-02T13:21:06.277 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Extras 153 kB/s | 17 kB 00:00 2022-02-02T13:21:06.326 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Extras 146 kB/s | 17 kB 00:00 2022-02-02T13:21:06.754 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - PowerTools 11 MB/s | 4.0 MB 00:00 2022-02-02T13:21:09.967 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-02-02T13:21:11.430 INFO:teuthology.orchestra.run.smithi037.stdout:Apache Arrow 138 kB/s | 184 kB 00:01 2022-02-02T13:21:13.903 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - PowerTools 547 kB/s | 4.0 MB 00:07 2022-02-02T13:21:14.913 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 11 MB 00:03 2022-02-02T13:21:17.201 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2022-02-02T13:21:17.800 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 391 kB/s | 24 kB 00:00 2022-02-02T13:21:18.309 INFO:teuthology.orchestra.run.smithi033.stdout:Apache Arrow 191 kB/s | 184 kB 00:00 2022-02-02T13:21:20.211 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 6.3 MB/s | 11 MB 00:01 2022-02-02T13:21:20.443 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-348.2.1.el8_5.x86_64 is already installed. 2022-02-02T13:21:20.444 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2022-02-02T13:21:20.563 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:21:20.564 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:21:20.564 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:21:20.564 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:21:20.565 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:21:20.565 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 4.18.0-358.el8 CentOS-Base 7.5 M 2022-02-02T13:21:20.565 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:21:20.565 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 4.18.0-358.el8 CentOS-Base 38 M 2022-02-02T13:21:20.565 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 4.18.0-358.el8 CentOS-Base 31 M 2022-02-02T13:21:20.566 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:20.567 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:21:20.567 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:21:20.567 INFO:teuthology.orchestra.run.smithi037.stdout:Install 3 Packages 2022-02-02T13:21:20.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:20.568 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 77 M 2022-02-02T13:21:20.569 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 91 M 2022-02-02T13:21:20.569 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:21:20.807 INFO:teuthology.orchestra.run.smithi037.stdout:(1/3): kernel-4.18.0-358.el8.x86_64.rpm 31 MB/s | 7.5 MB 00:00 2022-02-02T13:21:21.632 INFO:teuthology.orchestra.run.smithi037.stdout:(2/3): kernel-core-4.18.0-358.el8.x86_64.rpm 36 MB/s | 38 MB 00:01 2022-02-02T13:21:21.990 INFO:teuthology.orchestra.run.smithi037.stdout:(3/3): kernel-modules-4.18.0-358.el8.x86_64.rpm 21 MB/s | 31 MB 00:01 2022-02-02T13:21:21.993 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:21:21.993 INFO:teuthology.orchestra.run.smithi037.stdout:Total 54 MB/s | 77 MB 00:01 2022-02-02T13:21:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:21:22.977 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:21:22.977 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:21:23.069 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 421 kB/s | 24 kB 00:00 2022-02-02T13:21:24.297 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:21:24.310 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:21:25.691 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-348.2.1.el8_5.x86_64 is already installed. 2022-02-02T13:21:25.692 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2022-02-02T13:21:25.813 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:21:25.814 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:21:25.814 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:21:25.815 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:21:25.815 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:21:25.815 INFO:teuthology.orchestra.run.smithi033.stdout: kernel x86_64 4.18.0-358.el8 CentOS-Base 7.5 M 2022-02-02T13:21:25.815 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:21:25.816 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-core x86_64 4.18.0-358.el8 CentOS-Base 38 M 2022-02-02T13:21:25.816 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules x86_64 4.18.0-358.el8 CentOS-Base 31 M 2022-02-02T13:21:25.816 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:21:25.816 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:21:25.816 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:21:25.817 INFO:teuthology.orchestra.run.smithi033.stdout:Install 3 Packages 2022-02-02T13:21:25.817 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:21:25.818 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 77 M 2022-02-02T13:21:25.818 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 91 M 2022-02-02T13:21:25.818 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:21:26.454 INFO:teuthology.orchestra.run.smithi033.stdout:(1/3): kernel-4.18.0-358.el8.x86_64.rpm 12 MB/s | 7.5 MB 00:00 2022-02-02T13:21:26.838 INFO:teuthology.orchestra.run.smithi033.stdout:(2/3): kernel-core-4.18.0-358.el8.x86_64.rpm 38 MB/s | 38 MB 00:01 2022-02-02T13:21:26.912 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:21:27.229 INFO:teuthology.orchestra.run.smithi033.stdout:(3/3): kernel-modules-4.18.0-358.el8.x86_64.rpm 22 MB/s | 31 MB 00:01 2022-02-02T13:21:27.232 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:21:27.233 INFO:teuthology.orchestra.run.smithi033.stdout:Total 54 MB/s | 77 MB 00:01 2022-02-02T13:21:27.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:21:27.841 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:21:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:21:28.217 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:21:29.551 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:21:29.556 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:21:31.272 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:21:31.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:21:32.181 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:21:32.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:21:34.972 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:21:35.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:21:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:21:36.765 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:21:40.105 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-modules-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:21:40.348 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:21:58.062 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:21:58.420 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:21:58.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:21:58.420 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:21:59.251 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:21:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:59.252 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:21:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-4.18.0-358.el8.x86_64 kernel-core-4.18.0-358.el8.x86_64 2022-02-02T13:21:59.252 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-4.18.0-358.el8.x86_64 2022-02-02T13:21:59.253 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:59.253 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:21:59.360 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel --last | head -n 1 2022-02-02T13:21:59.530 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 01:21:34 PM UTC 2022-02-02T13:21:59.531 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T13:21:59.532 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-348.2.1.el8_5.x86_64 Expected: 4.18.0-358.el8.x86_64 2022-02-02T13:21:59.532 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-02-02T13:21:59.532 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-02-02T13:21:59.533 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2022-02-02T13:21:59.533 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2022-02-02T13:21:59.533 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel --last | head -n 1 2022-02-02T13:21:59.693 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 01:21:34 PM UTC 2022-02-02T13:21:59.694 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T13:21:59.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2022-02-02T13:21:59.728 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2022-02-02T13:21:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2022-02-02T13:21:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.02 2022-02-02T13:21:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 106.el8 2022-02-02T13:21:59.731 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2022-02-02T13:21:59.732 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Thu 02 Dec 2021 10:09:41 PM UTC 2022-02-02T13:21:59.732 INFO:teuthology.orchestra.run.smithi037.stdout:Group : System Environment/Base 2022-02-02T13:21:59.732 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 9265339 2022-02-02T13:21:59.732 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2022-02-02T13:21:59.733 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-02-02T13:21:59.733 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-02-02T13:21:59.733 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-02-02T13:21:59.733 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : kbuilder.bsys.centos.org 2022-02-02T13:21:59.733 INFO:teuthology.orchestra.run.smithi037.stdout:Relocations : (not relocatable) 2022-02-02T13:21:59.734 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : CentOS BuildSystem 2022-02-02T13:21:59.734 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2022-02-02T13:21:59.734 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2022-02-02T13:21:59.734 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2022-02-02T13:21:59.735 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2022-02-02T13:21:59.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:59.737 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-02-02T13:21:59.737 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2022-02-02T13:21:59.737 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2022-02-02T13:21:59.738 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2022-02-02T13:21:59.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:21:59.739 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2022-02-02T13:21:59.740 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-02-02T13:21:59.740 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 4.18.0-358.el8.x86_64 2022-02-02T13:21:59.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-02-02T13:22:01.185 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2022-02-02T13:22:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:done 2022-02-02T13:22:02.890 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2022-02-02T13:22:02.896 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-core-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:22:02.914 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.oLcPnSJd4b 2022-02-02T13:22:02.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oLcPnSJd4b 2022-02-02T13:22:02.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.oLcPnSJd4b 2022-02-02T13:22:03.134 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.oLcPnSJd4b is 6KB 2022-02-02T13:22:03.184 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.oLcPnSJd4b 2022-02-02T13:22:03.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2022-02-02T13:22:03.259 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: kernel-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:22:03.260 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-4.18.0-358.el8.x86_64 1/3 2022-02-02T13:22:03.261 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-core-4.18.0-358.el8.x86_64 2/3 2022-02-02T13:22:03.271 INFO:teuthology.orchestra.run.smithi037.stdout:54c8b3f95a884696922d0d687e6bf68d-0-rescue.conf 2022-02-02T13:22:03.272 INFO:teuthology.orchestra.run.smithi037.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-240.el8.x86_64.conf 2022-02-02T13:22:03.272 INFO:teuthology.orchestra.run.smithi037.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-348.2.1.el8_5.x86_64.conf 2022-02-02T13:22:03.272 INFO:teuthology.orchestra.run.smithi037.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64.conf 2022-02-02T13:22:03.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64 2022-02-02T13:22:03.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2022-02-02T13:22:03.709 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : kernel-modules-4.18.0-358.el8.x86_64 3/3 2022-02-02T13:22:03.710 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:22:03.711 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:22:03.711 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-4.18.0-358.el8.x86_64 kernel-core-4.18.0-358.el8.x86_64 2022-02-02T13:22:03.711 INFO:teuthology.orchestra.run.smithi033.stdout: kernel-modules-4.18.0-358.el8.x86_64 2022-02-02T13:22:03.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:22:03.712 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:22:03.856 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel --last | head -n 1 2022-02-02T13:22:04.027 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 01:21:40 PM UTC 2022-02-02T13:22:04.029 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T13:22:04.029 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-348.2.1.el8_5.x86_64 Expected: 4.18.0-358.el8.x86_64 2022-02-02T13:22:04.029 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-02-02T13:22:04.029 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-02-02T13:22:04.030 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2022-02-02T13:22:04.030 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2022-02-02T13:22:04.031 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel --last | head -n 1 2022-02-02T13:22:04.192 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-358.el8.x86_64 Wed 02 Feb 2022 01:21:40 PM UTC 2022-02-02T13:22:04.195 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-358.el8.x86_64 2022-02-02T13:22:04.195 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2022-02-02T13:22:04.228 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2022-02-02T13:22:04.229 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2022-02-02T13:22:04.229 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.02 2022-02-02T13:22:04.229 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 106.el8 2022-02-02T13:22:04.229 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2022-02-02T13:22:04.230 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Thu 02 Dec 2021 10:09:41 PM UTC 2022-02-02T13:22:04.230 INFO:teuthology.orchestra.run.smithi033.stdout:Group : System Environment/Base 2022-02-02T13:22:04.230 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 9265339 2022-02-02T13:22:04.230 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2022-02-02T13:22:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-02-02T13:22:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-02-02T13:22:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-02-02T13:22:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : kbuilder.bsys.centos.org 2022-02-02T13:22:04.231 INFO:teuthology.orchestra.run.smithi033.stdout:Relocations : (not relocatable) 2022-02-02T13:22:04.232 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : CentOS BuildSystem 2022-02-02T13:22:04.232 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : CentOS 2022-02-02T13:22:04.232 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2022-02-02T13:22:04.232 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2022-02-02T13:22:04.233 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2022-02-02T13:22:04.233 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:22:04.233 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-02-02T13:22:04.233 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2022-02-02T13:22:04.233 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2022-02-02T13:22:04.234 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2022-02-02T13:22:04.234 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:22:04.234 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2022-02-02T13:22:04.235 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-02-02T13:22:04.235 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 4.18.0-358.el8.x86_64 2022-02-02T13:22:04.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-02-02T13:22:05.743 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2022-02-02T13:22:07.810 INFO:teuthology.orchestra.run.smithi033.stderr:done 2022-02-02T13:22:07.812 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2022-02-02T13:22:07.841 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.PtjCYHrTpf 2022-02-02T13:22:07.841 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.PtjCYHrTpf 2022-02-02T13:22:07.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.PtjCYHrTpf 2022-02-02T13:22:08.076 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.PtjCYHrTpf is 6KB 2022-02-02T13:22:08.128 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.PtjCYHrTpf 2022-02-02T13:22:08.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2022-02-02T13:22:08.217 INFO:teuthology.orchestra.run.smithi033.stdout:54c8b3f95a884696922d0d687e6bf68d-0-rescue.conf 2022-02-02T13:22:08.218 INFO:teuthology.orchestra.run.smithi033.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-240.el8.x86_64.conf 2022-02-02T13:22:08.218 INFO:teuthology.orchestra.run.smithi033.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-348.2.1.el8_5.x86_64.conf 2022-02-02T13:22:08.218 INFO:teuthology.orchestra.run.smithi033.stdout:54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64.conf 2022-02-02T13:22:08.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default 54c8b3f95a884696922d0d687e6bf68d-4.18.0-358.el8.x86_64 2022-02-02T13:22:08.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2022-02-02T13:22:33.470 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2022-02-02T13:22:33.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-02-02T13:22:33.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:22:38.374 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2022-02-02T13:22:38.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-02-02T13:22:38.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:22:51.979 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2022-02-02T13:22:56.842 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2022-02-02T13:23:22.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-02-02T13:23:22.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:23:25.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2022-02-02T13:23:26.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-02-02T13:23:26.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:23:42.782 DEBUG:teuthology.orchestra.run.smithi033:> true 2022-02-02T13:23:43.074 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-02-02T13:23:43.075 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-358.el8.x86_64"... 2022-02-02T13:23:43.075 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2022-02-02T13:23:43.100 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-358.el8.x86_64 2022-02-02T13:23:43.101 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-358.el8.x86_64 vs 4.18.0-358.el8.x86_64 2022-02-02T13:23:43.101 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-02-02T13:23:43.101 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-02-02T13:23:44.102 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2022-02-02T13:23:44.103 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-02-02T13:23:44.220 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2022-02-02T13:23:44.250 DEBUG:teuthology.parallel:result is None 2022-02-02T13:23:55.068 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-02-02T13:23:55.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:23:55.467 DEBUG:teuthology.orchestra.run.smithi037:> true 2022-02-02T13:23:55.726 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-02-02T13:23:55.727 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-358.el8.x86_64"... 2022-02-02T13:23:55.727 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2022-02-02T13:23:55.784 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-358.el8.x86_64 2022-02-02T13:23:55.785 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-358.el8.x86_64 vs 4.18.0-358.el8.x86_64 2022-02-02T13:23:55.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-02-02T13:23:55.785 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-02-02T13:23:56.786 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2022-02-02T13:23:56.786 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-02-02T13:23:56.858 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2022-02-02T13:23:56.870 DEBUG:teuthology.parallel:result is None 2022-02-02T13:23:56.871 INFO:teuthology.run_tasks:Running task internal.base... 2022-02-02T13:23:56.881 INFO:teuthology.task.internal:Creating test directory... 2022-02-02T13:23:56.882 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-02-02T13:23:56.887 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-02-02T13:23:56.906 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-02-02T13:23:56.957 INFO:teuthology.run_tasks:Running task internal.archive... 2022-02-02T13:23:57.068 INFO:teuthology.task.internal:Creating archive directory... 2022-02-02T13:23:57.069 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-02-02T13:23:57.074 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-02-02T13:23:57.108 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-02-02T13:23:57.171 INFO:teuthology.task.internal:Enabling coredump saving... 2022-02-02T13:23:57.171 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-02-02T13:23:57.174 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-02-02T13:23:57.210 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T13:23:57.214 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T13:23:57.227 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T13:23:57.227 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-02-02T13:23:57.228 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-02-02T13:23:57.296 INFO:teuthology.task.internal:Configuring sudo... 2022-02-02T13:23:57.296 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-02-02T13:23:57.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-02-02T13:23:57.330 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-02-02T13:23:57.430 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-02-02T13:23:57.431 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-02-02T13:23:57.434 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-02-02T13:23:57.452 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T13:23:57.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T13:23:57.597 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T13:23:57.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T13:23:57.685 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:23:57.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-02-02T13:23:57.752 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T13:23:57.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-02-02T13:23:57.854 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T13:23:57.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-02-02T13:23:57.985 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:23:57.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-02-02T13:23:58.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2022-02-02T13:23:58.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2022-02-02T13:23:58.125 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-02-02T13:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-02-02T13:23:58.553 INFO:teuthology.run_tasks:Running task internal.timer... 2022-02-02T13:23:58.564 INFO:teuthology.task.internal:Starting timer... 2022-02-02T13:23:58.564 INFO:teuthology.run_tasks:Running task pcp... 2022-02-02T13:23:58.792 INFO:teuthology.run_tasks:Running task selinux... 2022-02-02T13:23:58.909 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-02-02T13:23:58.910 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2022-02-02T13:23:58.985 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: [ OK ] 2022-02-02T13:23:58.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2022-02-02T13:23:59.072 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: [ OK ] 2022-02-02T13:23:59.074 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-02-02T13:23:59.075 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2022-02-02T13:23:59.114 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2022-02-02T13:23:59.114 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2022-02-02T13:23:59.139 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2022-02-02T13:23:59.140 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi037.front.sepia.ceph.com': 'permissive'} 2022-02-02T13:23:59.140 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-02-02T13:23:59.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T13:23:59.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-02-02T13:23:59.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T13:23:59.212 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-02-02T13:23:59.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2022-02-02T13:23:59.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2022-02-02T13:23:59.300 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-02-02T13:23:59.325 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2022-02-02T13:23:59.326 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-02-02T13:29:01.066 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-02-02T13:29:01.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:29:01.180 DEBUG:teuthology.orchestra.run.smithi033:> true 2022-02-02T13:29:01.256 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2022-02-02T13:29:01.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-02-02T13:29:01.329 DEBUG:teuthology.orchestra.run.smithi037:> true 2022-02-02T13:29:01.413 INFO:teuthology.run_tasks:Running task clock... 2022-02-02T13:29:01.424 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-02-02T13:29:01.425 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-02-02T13:29:01.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-02-02T13:29:01.431 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-02-02T13:29:01.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-02-02T13:29:01.473 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-02-02T13:29:01.478 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-02-02T13:29:01.488 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-02-02T13:29:01.504 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-02-02T13:29:01.555 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2022-02-02T13:29:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2022-02-02T13:29:01.580 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2022-02-02T13:29:01.583 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-02-02T13:29:01.592 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2022-02-02T13:29:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-02-02T13:29:01.608 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-02-02T13:29:01.622 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-02-02T13:29:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2022-02-02T13:29:01.671 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-02-02T13:29:01.672 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2022-02-02T13:29:01.672 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.672 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.672 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.673 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2022-02-02T13:29:01.688 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-02-02T13:29:01.688 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2022-02-02T13:29:01.688 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.689 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.689 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.689 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-02-02T13:29:01.690 INFO:teuthology.run_tasks:Running task pexec... 2022-02-02T13:29:01.706 INFO:teuthology.task.pexec:Executing custom commands... 2022-02-02T13:29:01.711 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:29:01.712 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T13:29:01.713 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi037.front.sepia.ceph.com 2022-02-02T13:29:01.713 DEBUG:teuthology.orchestra.run.smithi037:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T13:29:01.939 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:01.940 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:01.962 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:02.338 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 01:27:46 PM UTC. 2022-02-02T13:29:02.349 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 01:27:46 PM UTC. 2022-02-02T13:29:03.406 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:29:03.407 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:03.407 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:29:03.408 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:03.408 INFO:teuthology.orchestra.run.smithi033.stdout:Resetting modules: 2022-02-02T13:29:03.408 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools 2022-02-02T13:29:03.408 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:03.409 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:29:03.409 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:03.409 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:03.416 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:29:03.417 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:03.417 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:29:03.417 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:03.418 INFO:teuthology.orchestra.run.smithi037.stdout:Resetting modules: 2022-02-02T13:29:03.418 INFO:teuthology.orchestra.run.smithi037.stdout: container-tools 2022-02-02T13:29:03.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:03.418 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:29:03.418 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:03.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:03.654 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:29:03.764 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:29:03.908 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:03.909 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:04.013 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:04.013 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:04.300 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:18 ago on Wed 02 Feb 2022 01:27:46 PM UTC. 2022-02-02T13:29:04.402 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:18 ago on Wed 02 Feb 2022 01:27:46 PM UTC. 2022-02-02T13:29:05.382 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:29:05.383 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================== 2022-02-02T13:29:05.383 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:29:05.384 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================== 2022-02-02T13:29:05.384 INFO:teuthology.orchestra.run.smithi037.stdout:Installing group/module packages: 2022-02-02T13:29:05.384 INFO:teuthology.orchestra.run.smithi037.stdout: buildah x86_64 1:1.23.1-2.module_el8.6.0+954+963caf36 CentOS-AppStream 7.9 M 2022-02-02T13:29:05.385 INFO:teuthology.orchestra.run.smithi037.stdout: cockpit-podman noarch 35-1.module_el8.6.0+944+d413f95e CentOS-AppStream 457 k 2022-02-02T13:29:05.385 INFO:teuthology.orchestra.run.smithi037.stdout: crun x86_64 1.2-1.module_el8.6.0+954+963caf36 CentOS-AppStream 193 k 2022-02-02T13:29:05.385 INFO:teuthology.orchestra.run.smithi037.stdout: python3-podman noarch 3.2.1-4.module_el8.6.0+954+963caf36 CentOS-AppStream 148 k 2022-02-02T13:29:05.386 INFO:teuthology.orchestra.run.smithi037.stdout: skopeo x86_64 2:1.5.0-2.module_el8.6.0+954+963caf36 CentOS-AppStream 6.7 M 2022-02-02T13:29:05.386 INFO:teuthology.orchestra.run.smithi037.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-02-02T13:29:05.386 INFO:teuthology.orchestra.run.smithi037.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-02-02T13:29:05.387 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:29:05.387 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-02-02T13:29:05.387 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-02-02T13:29:05.388 INFO:teuthology.orchestra.run.smithi037.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-02-02T13:29:05.388 INFO:teuthology.orchestra.run.smithi037.stdout:Installing module profiles: 2022-02-02T13:29:05.388 INFO:teuthology.orchestra.run.smithi037.stdout: container-tools/common 2022-02-02T13:29:05.388 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:05.389 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling module streams: 2022-02-02T13:29:05.389 INFO:teuthology.orchestra.run.smithi037.stdout: container-tools rhel8 2022-02-02T13:29:05.389 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:05.389 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:29:05.390 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================== 2022-02-02T13:29:05.395 INFO:teuthology.orchestra.run.smithi037.stdout:Install 10 Packages 2022-02-02T13:29:05.396 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:05.396 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 18 M 2022-02-02T13:29:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 64 M 2022-02-02T13:29:05.397 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:29:05.422 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:29:05.424 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2022-02-02T13:29:05.424 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:29:05.425 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2022-02-02T13:29:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:Installing group/module packages: 2022-02-02T13:29:05.426 INFO:teuthology.orchestra.run.smithi033.stdout: buildah x86_64 1:1.23.1-2.module_el8.6.0+954+963caf36 CentOS-AppStream 7.9 M 2022-02-02T13:29:05.427 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman noarch 35-1.module_el8.6.0+944+d413f95e CentOS-AppStream 457 k 2022-02-02T13:29:05.427 INFO:teuthology.orchestra.run.smithi033.stdout: crun x86_64 1.2-1.module_el8.6.0+954+963caf36 CentOS-AppStream 193 k 2022-02-02T13:29:05.428 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman noarch 3.2.1-4.module_el8.6.0+954+963caf36 CentOS-AppStream 148 k 2022-02-02T13:29:05.428 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo x86_64 2:1.5.0-2.module_el8.6.0+954+963caf36 CentOS-AppStream 6.7 M 2022-02-02T13:29:05.429 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-02-02T13:29:05.429 INFO:teuthology.orchestra.run.smithi033.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-02-02T13:29:05.429 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:29:05.429 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-02-02T13:29:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-02-02T13:29:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-02-02T13:29:05.430 INFO:teuthology.orchestra.run.smithi033.stdout:Installing module profiles: 2022-02-02T13:29:05.430 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools/common 2022-02-02T13:29:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:05.431 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling module streams: 2022-02-02T13:29:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools rhel8 2022-02-02T13:29:05.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:05.431 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:29:05.432 INFO:teuthology.orchestra.run.smithi033.stdout:======================================================================================== 2022-02-02T13:29:05.432 INFO:teuthology.orchestra.run.smithi033.stdout:Install 10 Packages 2022-02-02T13:29:05.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:05.433 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 18 M 2022-02-02T13:29:05.433 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 64 M 2022-02-02T13:29:05.433 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:29:05.463 INFO:teuthology.orchestra.run.smithi037.stdout:(1/10): crun-1.2-1.module_el8.6.0+954+963caf36. 2.5 MB/s | 193 kB 00:00 2022-02-02T13:29:05.497 INFO:teuthology.orchestra.run.smithi037.stdout:(2/10): python3-podman-3.2.1-4.module_el8.6.0+9 4.4 MB/s | 148 kB 00:00 2022-02-02T13:29:05.511 INFO:teuthology.orchestra.run.smithi033.stdout:(1/10): crun-1.2-1.module_el8.6.0+954+963caf36. 2.3 MB/s | 193 kB 00:00 2022-02-02T13:29:05.523 INFO:teuthology.orchestra.run.smithi037.stdout:(3/10): cockpit-podman-35-1.module_el8.6.0+944+ 3.3 MB/s | 457 kB 00:00 2022-02-02T13:29:05.545 INFO:teuthology.orchestra.run.smithi033.stdout:(2/10): python3-podman-3.2.1-4.module_el8.6.0+9 4.4 MB/s | 148 kB 00:00 2022-02-02T13:29:05.547 INFO:teuthology.orchestra.run.smithi037.stdout:(4/10): python3-pytoml-0.1.14-5.git7dea353.el8. 494 kB/s | 25 kB 00:00 2022-02-02T13:29:05.572 INFO:teuthology.orchestra.run.smithi037.stdout:(5/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2022-02-02T13:29:05.707 INFO:teuthology.orchestra.run.smithi033.stdout:(3/10): cockpit-podman-35-1.module_el8.6.0+944+ 1.6 MB/s | 457 kB 00:00 2022-02-02T13:29:05.737 INFO:teuthology.orchestra.run.smithi033.stdout:(4/10): python3-pytoml-0.1.14-5.git7dea353.el8. 129 kB/s | 25 kB 00:00 2022-02-02T13:29:05.748 INFO:teuthology.orchestra.run.smithi037.stdout:(6/10): buildah-1.23.1-2.module_el8.6.0+954+963 22 MB/s | 7.9 MB 00:00 2022-02-02T13:29:05.762 INFO:teuthology.orchestra.run.smithi033.stdout:(5/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.7 MB/s | 94 kB 00:00 2022-02-02T13:29:05.773 INFO:teuthology.orchestra.run.smithi037.stdout:(7/10): udica-0.2.6-2.module_el8.6.0+944+d413f9 1.9 MB/s | 48 kB 00:00 2022-02-02T13:29:05.815 INFO:teuthology.orchestra.run.smithi037.stdout:(8/10): toolbox-0.0.99.3-1.module_el8.5.0+877+1 9.3 MB/s | 2.3 MB 00:00 2022-02-02T13:29:05.840 INFO:teuthology.orchestra.run.smithi037.stdout:(9/10): yajl-2.1.0-10.el8.x86_64.rpm 614 kB/s | 41 kB 00:00 2022-02-02T13:29:05.896 INFO:teuthology.orchestra.run.smithi033.stdout:(6/10): buildah-1.23.1-2.module_el8.6.0+954+963 17 MB/s | 7.9 MB 00:00 2022-02-02T13:29:05.938 INFO:teuthology.orchestra.run.smithi033.stdout:(7/10): udica-0.2.6-2.module_el8.6.0+944+d413f9 1.1 MB/s | 48 kB 00:00 2022-02-02T13:29:05.963 INFO:teuthology.orchestra.run.smithi033.stdout:(8/10): yajl-2.1.0-10.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2022-02-02T13:29:05.990 INFO:teuthology.orchestra.run.smithi037.stdout:(10/10): skopeo-1.5.0-2.module_el8.6.0+954+963c 15 MB/s | 6.7 MB 00:00 2022-02-02T13:29:05.993 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:29:05.993 INFO:teuthology.orchestra.run.smithi037.stdout:Total 29 MB/s | 18 MB 00:00 2022-02-02T13:29:06.013 INFO:teuthology.orchestra.run.smithi033.stdout:(9/10): toolbox-0.0.99.3-1.module_el8.5.0+877+1 9.0 MB/s | 2.3 MB 00:00 2022-02-02T13:29:06.150 INFO:teuthology.orchestra.run.smithi033.stdout:(10/10): skopeo-1.5.0-2.module_el8.6.0+954+963c 16 MB/s | 6.7 MB 00:00 2022-02-02T13:29:06.151 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:29:06.151 INFO:teuthology.orchestra.run.smithi033.stdout:Total 25 MB/s | 18 MB 00:00 2022-02-02T13:29:06.196 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:29:06.216 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:29:06.216 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:29:06.351 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:29:06.370 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:29:06.371 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:29:06.424 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:29:06.428 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:29:06.691 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:29:06.694 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:29:06.916 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:29:07.076 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : yajl-2.1.0-10.el8.x86_64 1/10 2022-02-02T13:29:07.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/10 2022-02-02T13:29:07.422 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2022-02-02T13:29:07.437 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:29:07.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T13:29:07.626 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : yajl-2.1.0-10.el8.x86_64 1/10 2022-02-02T13:29:07.767 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 5/10 2022-02-02T13:29:07.770 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 2/10 2022-02-02T13:29:07.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2022-02-02T13:29:08.114 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 6/10 2022-02-02T13:29:08.295 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T13:29:08.433 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 5/10 2022-02-02T13:29:08.808 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 6/10 2022-02-02T13:29:08.871 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 7/10 2022-02-02T13:29:09.017 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 8/10 2022-02-02T13:29:09.611 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 7/10 2022-02-02T13:29:09.784 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 8/10 2022-02-02T13:29:09.845 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 9/10 2022-02-02T13:29:10.003 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T13:29:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T13:29:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 1/10 2022-02-02T13:29:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 2/10 2022-02-02T13:29:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 3/10 2022-02-02T13:29:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T13:29:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/10 2022-02-02T13:29:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/10 2022-02-02T13:29:10.298 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 7/10 2022-02-02T13:29:10.298 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/10 2022-02-02T13:29:10.298 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/10 2022-02-02T13:29:10.655 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 9/10 2022-02-02T13:29:10.848 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/10 2022-02-02T13:29:10.848 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:10.848 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:29:10.849 INFO:teuthology.orchestra.run.smithi037.stdout: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:10.849 INFO:teuthology.orchestra.run.smithi037.stdout: cockpit-podman-35-1.module_el8.6.0+944+d413f95e.noarch 2022-02-02T13:29:10.849 INFO:teuthology.orchestra.run.smithi037.stdout: crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:10.849 INFO:teuthology.orchestra.run.smithi037.stdout: python3-podman-3.2.1-4.module_el8.6.0+954+963caf36.noarch 2022-02-02T13:29:10.850 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-02-02T13:29:10.850 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-02-02T13:29:10.850 INFO:teuthology.orchestra.run.smithi037.stdout: skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:10.851 INFO:teuthology.orchestra.run.smithi037.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-02-02T13:29:10.851 INFO:teuthology.orchestra.run.smithi037.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-02-02T13:29:10.852 INFO:teuthology.orchestra.run.smithi037.stdout: yajl-2.1.0-10.el8.x86_64 2022-02-02T13:29:10.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:10.852 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:29:10.852 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T13:29:10.985 DEBUG:teuthology.parallel:result is None 2022-02-02T13:29:11.169 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 10/10 2022-02-02T13:29:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86 1/10 2022-02-02T13:29:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cockpit-podman-35-1.module_el8.6.0+944+d413f95e.no 2/10 2022-02-02T13:29:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 3/10 2022-02-02T13:29:11.170 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-podman-3.2.1-4.module_el8.6.0+954+963caf36 4/10 2022-02-02T13:29:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/10 2022-02-02T13:29:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/10 2022-02-02T13:29:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_6 7/10 2022-02-02T13:29:11.171 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/10 2022-02-02T13:29:11.172 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/10 2022-02-02T13:29:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/10 2022-02-02T13:29:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:11.729 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:29:11.729 INFO:teuthology.orchestra.run.smithi033.stdout: buildah-1:1.23.1-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman-35-1.module_el8.6.0+944+d413f95e.noarch 2022-02-02T13:29:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: crun-1.2-1.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman-3.2.1-4.module_el8.6.0+954+963caf36.noarch 2022-02-02T13:29:11.730 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-02-02T13:29:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-02-02T13:29:11.731 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo-2:1.5.0-2.module_el8.6.0+954+963caf36.x86_64 2022-02-02T13:29:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-02-02T13:29:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-02-02T13:29:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: yajl-2.1.0-10.el8.x86_64 2022-02-02T13:29:11.735 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:11.736 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:29:11.893 DEBUG:teuthology.parallel:result is None 2022-02-02T13:29:11.895 INFO:teuthology.run_tasks:Running task pexec... 2022-02-02T13:29:11.911 INFO:teuthology.task.pexec:Executing custom commands... 2022-02-02T13:29:11.912 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:29:11.912 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T13:29:11.913 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi037.front.sepia.ceph.com 2022-02-02T13:29:11.913 DEBUG:teuthology.orchestra.run.smithi037:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-02-02T13:29:12.074 DEBUG:teuthology.parallel:result is None 2022-02-02T13:29:12.113 DEBUG:teuthology.parallel:result is None 2022-02-02T13:29:12.114 INFO:teuthology.run_tasks:Running task install... 2022-02-02T13:29:12.125 DEBUG:teuthology.task.install:project ceph 2022-02-02T13:29:12.126 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b0d76d45e4cb48de326cfbdc43296681162f672c'}} 2022-02-02T13:29:12.126 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v16.2.4', 'flavor': 'default', 'sha1': 'b0d76d45e4cb48de326cfbdc43296681162f672c'} 2022-02-02T13:29:12.126 INFO:teuthology.task.install:Using flavor: default 2022-02-02T13:29:12.135 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-02-02T13:29:12.135 INFO:teuthology.task.install:extra packages: [] 2022-02-02T13:29:12.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-02-02T13:29:12.173 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-02-02T13:29:12.174 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:29:12.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-02-02T13:29:12.175 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d76d45e4cb48de326cfbdc43296681162f672c', 'tag': 'v16.2.4', 'wait_for_package': False} 2022-02-02T13:29:12.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-02-02T13:29:12.214 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-02-02T13:29:12.216 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:29:12.216 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b0d76d45e4cb48de326cfbdc43296681162f672c', 'tag': 'v16.2.4', 'wait_for_package': False} 2022-02-02T13:29:12.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-02-02T13:29:12.251 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-02-02T13:29:12.253 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:29:12.253 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:29:12.254 INFO:teuthology.packaging:ref: None 2022-02-02T13:29:12.254 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:29:12.255 INFO:teuthology.packaging:branch: None 2022-02-02T13:29:12.255 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:29:12.287 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:29:12.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:29:12.329 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-02-02T13:29:12.331 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:29:12.332 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:29:12.332 INFO:teuthology.packaging:ref: None 2022-02-02T13:29:12.332 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:29:12.332 INFO:teuthology.packaging:branch: None 2022-02-02T13:29:12.333 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:29:12.362 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:29:12.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:29:12.539 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2022-02-02T13:29:12.539 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2022-02-02T13:29:12.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-02-02T13:29:12.572 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:29:12.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-02-02T13:29:12.575 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/ 2022-02-02T13:29:12.576 INFO:teuthology.task.install.rpm:Package version is 16.2.4-0 2022-02-02T13:29:12.603 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-02-02T13:29:12.604 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:29:12.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-02-02T13:29:12.608 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-02-02T13:29:12.608 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:29:12.608 INFO:teuthology.packaging:ref: None 2022-02-02T13:29:12.609 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:29:12.609 INFO:teuthology.packaging:branch: None 2022-02-02T13:29:12.609 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:29:12.610 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-02-02T13:29:12.633 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2022-02-02T13:29:12.634 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:29:12.634 INFO:teuthology.packaging:ref: None 2022-02-02T13:29:12.634 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:29:12.635 INFO:teuthology.packaging:branch: None 2022-02-02T13:29:12.635 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:29:12.635 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v16.2.4/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-02-02T13:29:12.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-02-02T13:29:12.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-02-02T13:29:12.754 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-02-02T13:29:12.783 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-02-02T13:29:12.819 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2022-02-02T13:29:12.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2022-02-02T13:29:12.849 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2022-02-02T13:29:12.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2022-02-02T13:29:13.048 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.049 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.065 INFO:teuthology.orchestra.run.smithi033.stdout:76 files removed 2022-02-02T13:29:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw 2022-02-02T13:29:13.095 INFO:teuthology.orchestra.run.smithi037.stdout:76 files removed 2022-02-02T13:29:13.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2022-02-02T13:29:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.300 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.301 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:29:13.533 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 929 kB/s | 74 kB 00:00 2022-02-02T13:29:13.559 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 947 kB/s | 74 kB 00:00 2022-02-02T13:29:13.651 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 188 kB/s | 15 kB 00:00 2022-02-02T13:29:13.668 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 210 kB/s | 15 kB 00:00 2022-02-02T13:29:13.752 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2022-02-02T13:29:13.777 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 21 kB/s | 1.7 kB 00:00 2022-02-02T13:29:14.388 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - AppStream 32 MB/s | 19 MB 00:00 2022-02-02T13:29:14.497 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - AppStream 28 MB/s | 19 MB 00:00 2022-02-02T13:29:18.471 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Base 35 MB/s | 18 MB 00:00 2022-02-02T13:29:18.623 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Base 32 MB/s | 18 MB 00:00 2022-02-02T13:29:21.312 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - Extras 163 kB/s | 17 kB 00:00 2022-02-02T13:29:21.546 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - Extras 138 kB/s | 17 kB 00:00 2022-02-02T13:29:21.748 INFO:teuthology.orchestra.run.smithi033.stdout:CentOS-8 - PowerTools 13 MB/s | 4.0 MB 00:00 2022-02-02T13:29:22.023 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-8 - PowerTools 11 MB/s | 4.0 MB 00:00 2022-02-02T13:29:25.223 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-02-02T13:29:25.241 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2022-02-02T13:29:26.373 INFO:teuthology.orchestra.run.smithi037.stdout:Apache Arrow 182 kB/s | 184 kB 00:01 2022-02-02T13:29:26.589 INFO:teuthology.orchestra.run.smithi033.stdout:Apache Arrow 152 kB/s | 184 kB 00:01 2022-02-02T13:29:27.673 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 11 MB 00:01 2022-02-02T13:29:27.914 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 11 MB 00:01 2022-02-02T13:29:30.507 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 398 kB/s | 24 kB 00:00 2022-02-02T13:29:30.740 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 450 kB/s | 24 kB 00:00 2022-02-02T13:29:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:29:33.348 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:33.349 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:29:33.349 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:33.349 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:29:33.349 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2022-02-02T13:29:33.350 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2022-02-02T13:29:33.350 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T13:29:33.350 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2022-02-02T13:29:33.350 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:29:33.351 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2022-02-02T13:29:33.351 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2022-02-02T13:29:33.351 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2022-02-02T13:29:33.351 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs x86_64 71.1-3.el8 CentOS-Base 42 k 2022-02-02T13:29:33.351 INFO:teuthology.orchestra.run.smithi037.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-02-02T13:29:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-02-02T13:29:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-02-02T13:29:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2022-02-02T13:29:33.352 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-02-02T13:29:33.353 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2022-02-02T13:29:33.353 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-02-02T13:29:33.353 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2022-02-02T13:29:33.353 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-02-02T13:29:33.354 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2022-02-02T13:29:33.354 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-02-02T13:29:33.354 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-02-02T13:29:33.354 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs x86_64 71.1-3.el8 CentOS-Base 79 k 2022-02-02T13:29:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2022-02-02T13:29:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2022-02-02T13:29:33.355 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2022-02-02T13:29:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-02-02T13:29:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2022-02-02T13:29:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2022-02-02T13:29:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2022-02-02T13:29:33.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:33.357 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:29:33.357 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:29:33.357 INFO:teuthology.orchestra.run.smithi037.stdout:Install 25 Packages 2022-02-02T13:29:33.358 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2022-02-02T13:29:33.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:29:33.359 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 59 M 2022-02-02T13:29:33.360 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:29:33.603 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:29:33.606 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:33.606 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:29:33.607 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:33.607 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:29:33.607 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:16.2.4-0.el8 ceph 13 M 2022-02-02T13:29:33.607 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2022-02-02T13:29:33.607 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T13:29:33.608 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:16.2.4-0.el8 ceph 4.0 M 2022-02-02T13:29:33.608 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:29:33.608 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:16.2.4-0.el8 ceph 6.0 M 2022-02-02T13:29:33.608 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:16.2.4-0.el8 ceph 24 M 2022-02-02T13:29:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:16.2.4-0.el8 ceph 25 k 2022-02-02T13:29:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: daxctl-libs x86_64 71.1-3.el8 CentOS-Base 42 k 2022-02-02T13:29:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2022-02-02T13:29:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-02-02T13:29:33.610 INFO:teuthology.orchestra.run.smithi033.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2022-02-02T13:29:33.610 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:16.2.4-0.el8 ceph 801 k 2022-02-02T13:29:33.610 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-02-02T13:29:33.610 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj x86_64 1.6.1-1.el8 CentOS-AppStream 145 k 2022-02-02T13:29:33.611 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-02-02T13:29:33.611 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:16.2.4-0.el8 ceph 486 k 2022-02-02T13:29:33.611 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-02-02T13:29:33.612 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:16.2.4-0.el8 ceph 4.1 M 2022-02-02T13:29:33.612 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-02-02T13:29:33.612 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-02-02T13:29:33.612 INFO:teuthology.orchestra.run.smithi033.stdout: ndctl-libs x86_64 71.1-3.el8 CentOS-Base 79 k 2022-02-02T13:29:33.612 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:16.2.4-0.el8 ceph 44 k 2022-02-02T13:29:33.613 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:16.2.4-0.el8 ceph 80 k 2022-02-02T13:29:33.613 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:16.2.4-0.el8 ceph 213 k 2022-02-02T13:29:33.613 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-02-02T13:29:33.613 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:16.2.4-0.el8 ceph 387 k 2022-02-02T13:29:33.614 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:16.2.4-0.el8 ceph 368 k 2022-02-02T13:29:33.614 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:16.2.4-0.el8 ceph 114 k 2022-02-02T13:29:33.614 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:33.614 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:29:33.614 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:29:33.615 INFO:teuthology.orchestra.run.smithi033.stdout:Install 25 Packages 2022-02-02T13:29:33.615 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2022-02-02T13:29:33.615 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:29:33.616 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 59 M 2022-02-02T13:29:33.616 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:29:33.834 INFO:teuthology.orchestra.run.smithi037.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 13 MB/s | 6.0 MB 00:00 2022-02-02T13:29:33.851 INFO:teuthology.orchestra.run.smithi037.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 1.5 MB/s | 25 kB 00:00 2022-02-02T13:29:34.166 INFO:teuthology.orchestra.run.smithi033.stdout:(1/27): ceph-base-16.2.4-0.el8.x86_64.rpm 11 MB/s | 6.0 MB 00:00 2022-02-02T13:29:34.211 INFO:teuthology.orchestra.run.smithi033.stdout:(2/27): ceph-selinux-16.2.4-0.el8.x86_64.rpm 559 kB/s | 25 kB 00:00 2022-02-02T13:29:34.252 INFO:teuthology.orchestra.run.smithi037.stdout:(3/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 14 MB/s | 13 MB 00:00 2022-02-02T13:29:34.284 INFO:teuthology.orchestra.run.smithi037.stdout:(4/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 1.8 MB/s | 801 kB 00:00 2022-02-02T13:29:34.310 INFO:teuthology.orchestra.run.smithi037.stdout:(5/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 8.1 MB/s | 486 kB 00:00 2022-02-02T13:29:34.335 INFO:teuthology.orchestra.run.smithi037.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.7 MB/s | 44 kB 00:00 2022-02-02T13:29:34.360 INFO:teuthology.orchestra.run.smithi037.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2022-02-02T13:29:34.394 INFO:teuthology.orchestra.run.smithi037.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 6.3 MB/s | 213 kB 00:00 2022-02-02T13:29:34.430 INFO:teuthology.orchestra.run.smithi037.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 11 MB/s | 387 kB 00:00 2022-02-02T13:29:34.462 INFO:teuthology.orchestra.run.smithi037.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 11 MB/s | 368 kB 00:00 2022-02-02T13:29:34.483 INFO:teuthology.orchestra.run.smithi033.stdout:(3/27): libcephfs2-16.2.4-0.el8.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2022-02-02T13:29:34.486 INFO:teuthology.orchestra.run.smithi037.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 4.5 MB/s | 114 kB 00:00 2022-02-02T13:29:34.625 INFO:teuthology.orchestra.run.smithi033.stdout:(4/27): ceph-radosgw-16.2.4-0.el8.x86_64.rpm 12 MB/s | 13 MB 00:01 2022-02-02T13:29:34.659 INFO:teuthology.orchestra.run.smithi033.stdout:(5/27): libradosstriper1-16.2.4-0.el8.x86_64.rp 2.7 MB/s | 486 kB 00:00 2022-02-02T13:29:34.692 INFO:teuthology.orchestra.run.smithi033.stdout:(6/27): python3-ceph-argparse-16.2.4-0.el8.x86_ 1.7 MB/s | 44 kB 00:00 2022-02-02T13:29:34.709 INFO:teuthology.orchestra.run.smithi033.stdout:(7/27): python3-ceph-common-16.2.4-0.el8.x86_64 3.1 MB/s | 80 kB 00:00 2022-02-02T13:29:34.729 INFO:teuthology.orchestra.run.smithi037.stdout:(12/27): ceph-common-16.2.4-0.el8.x86_64.rpm 17 MB/s | 24 MB 00:01 2022-02-02T13:29:34.743 INFO:teuthology.orchestra.run.smithi033.stdout:(8/27): python3-cephfs-16.2.4-0.el8.x86_64.rpm 6.3 MB/s | 213 kB 00:00 2022-02-02T13:29:34.785 INFO:teuthology.orchestra.run.smithi033.stdout:(9/27): python3-rados-16.2.4-0.el8.x86_64.rpm 9.1 MB/s | 387 kB 00:00 2022-02-02T13:29:34.803 INFO:teuthology.orchestra.run.smithi037.stdout:(13/27): librgw2-16.2.4-0.el8.x86_64.rpm 7.9 MB/s | 4.1 MB 00:00 2022-02-02T13:29:34.837 INFO:teuthology.orchestra.run.smithi037.stdout:(14/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 414 kB/s | 145 kB 00:00 2022-02-02T13:29:34.843 INFO:teuthology.orchestra.run.smithi033.stdout:(10/27): python3-rbd-16.2.4-0.el8.x86_64.rpm 6.1 MB/s | 368 kB 00:00 2022-02-02T13:29:34.861 INFO:teuthology.orchestra.run.smithi033.stdout:(11/27): python3-rgw-16.2.4-0.el8.x86_64.rpm 6.7 MB/s | 114 kB 00:00 2022-02-02T13:29:34.862 INFO:teuthology.orchestra.run.smithi037.stdout:(15/27): librdkafka-0.11.4-3.el8.x86_64.rpm 2.7 MB/s | 354 kB 00:00 2022-02-02T13:29:34.879 INFO:teuthology.orchestra.run.smithi037.stdout:(16/27): python3-prettytable-0.7.2-14.el8.noarc 1.0 MB/s | 44 kB 00:00 2022-02-02T13:29:34.905 INFO:teuthology.orchestra.run.smithi037.stdout:(17/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2022-02-02T13:29:34.921 INFO:teuthology.orchestra.run.smithi037.stdout:(18/27): daxctl-libs-71.1-3.el8.x86_64.rpm 998 kB/s | 42 kB 00:00 2022-02-02T13:29:34.936 INFO:teuthology.orchestra.run.smithi033.stdout:(12/27): librgw2-16.2.4-0.el8.x86_64.rpm 13 MB/s | 4.1 MB 00:00 2022-02-02T13:29:34.938 INFO:teuthology.orchestra.run.smithi037.stdout:(19/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 798 kB/s | 47 kB 00:00 2022-02-02T13:29:34.955 INFO:teuthology.orchestra.run.smithi037.stdout:(20/27): ndctl-libs-71.1-3.el8.x86_64.rpm 2.3 MB/s | 79 kB 00:00 2022-02-02T13:29:34.969 INFO:teuthology.orchestra.run.smithi033.stdout:(13/27): libpmemobj-1.6.1-1.el8.x86_64.rpm 1.3 MB/s | 145 kB 00:00 2022-02-02T13:29:34.995 INFO:teuthology.orchestra.run.smithi033.stdout:(14/27): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2022-02-02T13:29:35.020 INFO:teuthology.orchestra.run.smithi033.stdout:(15/27): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2022-02-02T13:29:35.045 INFO:teuthology.orchestra.run.smithi033.stdout:(16/27): daxctl-libs-71.1-3.el8.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2022-02-02T13:29:35.079 INFO:teuthology.orchestra.run.smithi033.stdout:(17/27): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2022-02-02T13:29:35.104 INFO:teuthology.orchestra.run.smithi033.stdout:(18/27): librabbitmq-0.9.0-3.el8.x86_64.rpm 797 kB/s | 47 kB 00:00 2022-02-02T13:29:35.105 INFO:teuthology.orchestra.run.smithi037.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 633 kB/s | 116 kB 00:00 2022-02-02T13:29:35.130 INFO:teuthology.orchestra.run.smithi037.stdout:(22/27): leveldb-1.22-1.el8.x86_64.rpm 1.0 MB/s | 181 kB 00:00 2022-02-02T13:29:35.155 INFO:teuthology.orchestra.run.smithi033.stdout:(19/27): ndctl-libs-71.1-3.el8.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2022-02-02T13:29:35.155 INFO:teuthology.orchestra.run.smithi037.stdout:(23/27): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-02-02T13:29:35.173 INFO:teuthology.orchestra.run.smithi037.stdout:(24/27): liboath-2.6.2-3.el8.x86_64.rpm 874 kB/s | 59 kB 00:00 2022-02-02T13:29:35.189 INFO:teuthology.orchestra.run.smithi037.stdout:(25/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2022-02-02T13:29:35.298 INFO:teuthology.orchestra.run.smithi037.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 32 MB/s | 4.0 MB 00:00 2022-02-02T13:29:35.382 INFO:teuthology.orchestra.run.smithi037.stdout:(27/27): librados2-16.2.4-0.el8.x86_64.rpm 17 MB/s | 3.7 MB 00:00 2022-02-02T13:29:35.385 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:29:35.385 INFO:teuthology.orchestra.run.smithi037.stdout:Total 29 MB/s | 59 MB 00:02 2022-02-02T13:29:35.447 INFO:teuthology.orchestra.run.smithi033.stdout:(20/27): ceph-common-16.2.4-0.el8.x86_64.rpm 13 MB/s | 24 MB 00:01 2022-02-02T13:29:35.456 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:29:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:(21/27): fmt-6.2.1-1.el8.x86_64.rpm 296 kB/s | 116 kB 00:00 2022-02-02T13:29:35.507 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:29:35.507 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:29:35.548 INFO:teuthology.orchestra.run.smithi033.stdout:(22/27): gperftools-libs-2.7-9.el8.x86_64.rpm 781 kB/s | 306 kB 00:00 2022-02-02T13:29:35.564 INFO:teuthology.orchestra.run.smithi033.stdout:(23/27): liboath-2.6.2-3.el8.x86_64.rpm 880 kB/s | 59 kB 00:00 2022-02-02T13:29:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:(24/27): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2022-02-02T13:29:35.648 INFO:teuthology.orchestra.run.smithi033.stdout:(25/27): leveldb-1.22-1.el8.x86_64.rpm 901 kB/s | 181 kB 00:00 2022-02-02T13:29:35.757 INFO:teuthology.orchestra.run.smithi033.stdout:(26/27): librbd1-16.2.4-0.el8.x86_64.rpm 26 MB/s | 4.0 MB 00:00 2022-02-02T13:29:35.840 INFO:teuthology.orchestra.run.smithi033.stdout:(27/27): librados2-16.2.4-0.el8.x86_64.rpm 14 MB/s | 3.7 MB 00:00 2022-02-02T13:29:35.845 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:29:35.845 INFO:teuthology.orchestra.run.smithi033.stdout:Total 26 MB/s | 59 MB 00:02 2022-02-02T13:29:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:29:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:29:35.917 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:29:35.967 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:29:35.967 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:29:36.317 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:29:36.320 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:29:36.968 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:29:37.107 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2022-02-02T13:29:37.273 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2022-02-02T13:29:37.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T13:29:37.533 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:29:37.680 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/29 2022-02-02T13:29:37.832 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T13:29:37.896 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/29 2022-02-02T13:29:38.016 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:29:38.023 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T13:29:38.120 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:29:38.361 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T13:29:38.451 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/29 2022-02-02T13:29:38.524 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:29:38.593 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:29:38.622 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:29:38.714 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:29:38.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2022-02-02T13:29:38.866 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T13:29:38.985 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T13:29:39.182 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:29:39.252 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:29:39.308 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T13:29:39.482 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:29:39.600 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/29 2022-02-02T13:29:39.680 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:29:39.898 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T13:29:40.306 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2022-02-02T13:29:40.352 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/29 2022-02-02T13:29:40.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T13:29:40.542 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T13:29:40.543 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:29:40.618 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:29:40.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T13:29:40.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T13:29:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/29 2022-02-02T13:29:40.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T13:29:41.034 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T13:29:41.072 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T13:29:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 11/29 2022-02-02T13:29:41.174 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T13:29:41.296 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T13:29:41.474 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T13:29:41.621 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T13:29:41.647 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T13:29:41.726 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 14/29 2022-02-02T13:29:41.774 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T13:29:41.878 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T13:29:41.905 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T13:29:42.031 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2022-02-02T13:29:42.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2022-02-02T13:29:42.357 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T13:29:42.373 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libpmemobj-1.6.1-1.el8.x86_64 15/29 2022-02-02T13:29:42.432 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T13:29:42.555 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T13:29:42.594 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2022-02-02T13:29:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:16.2.4-0.el8.x86_64 16/29 2022-02-02T13:29:42.791 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2022-02-02T13:29:42.813 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:16.2.4-0.el8.x86_64 17/29 2022-02-02T13:29:42.969 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2022-02-02T13:29:43.074 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2022-02-02T13:29:43.227 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:16.2.4-0.el8.x86_64 18/29 2022-02-02T13:29:43.364 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T13:29:43.417 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:16.2.4-0.el8.x86_64 19/29 2022-02-02T13:29:43.610 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 20/29 2022-02-02T13:29:43.798 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 21/29 2022-02-02T13:29:43.993 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 22/29 2022-02-02T13:29:44.114 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:16.2.4-0.el8.x86_64 23/29 2022-02-02T13:29:46.737 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:46.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:47.666 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:47.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T13:29:48.070 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T13:29:48.164 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:29:48.316 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:48.538 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:49.300 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:16.2.4-0.el8.x86_64 24/29 2022-02-02T13:29:49.580 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T13:29:49.676 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:16.2.4-0.el8.x86_64 25/29 2022-02-02T13:29:49.808 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:30:06.873 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:30:06.873 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2022-02-02T13:30:06.874 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2022-02-02T13:30:06.874 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2022-02-02T13:30:06.874 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2022-02-02T13:30:06.874 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2022-02-02T13:30:06.875 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2022-02-02T13:30:06.875 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2022-02-02T13:30:06.875 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2022-02-02T13:30:06.875 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2022-02-02T13:30:06.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:08.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T13:30:08.297 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T13:30:08.297 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T13:30:08.500 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T13:30:08.500 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:08.598 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:30:08.599 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2022-02-02T13:30:08.599 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2022-02-02T13:30:08.599 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2022-02-02T13:30:08.599 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2022-02-02T13:30:08.599 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2022-02-02T13:30:08.600 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2022-02-02T13:30:08.600 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2022-02-02T13:30:08.600 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2022-02-02T13:30:08.600 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2022-02-02T13:30:08.601 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:09.359 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:09.360 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2022-02-02T13:30:09.360 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2022-02-02T13:30:09.360 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2022-02-02T13:30:09.361 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:30:09.361 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T13:30:09.361 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:30:09.361 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2022-02-02T13:30:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2022-02-02T13:30:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:30:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2022-02-02T13:30:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2022-02-02T13:30:09.362 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T13:30:09.363 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T13:30:09.365 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2022-02-02T13:30:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2022-02-02T13:30:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2022-02-02T13:30:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2022-02-02T13:30:09.366 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 18/29 2022-02-02T13:30:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2022-02-02T13:30:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 20/29 2022-02-02T13:30:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2022-02-02T13:30:09.367 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2022-02-02T13:30:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2022-02-02T13:30:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2022-02-02T13:30:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2022-02-02T13:30:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:30:09.368 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2022-02-02T13:30:09.369 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2022-02-02T13:30:09.968 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T13:30:10.048 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:16.2.4-0.el8.x86_64 27/29 2022-02-02T13:30:10.049 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T13:30:10.262 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 28/29 2022-02-02T13:30:10.262 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:10.360 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:10.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:10.362 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2022-02-02T13:30:10.362 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.362 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:10.362 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.363 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.363 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.364 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.364 INFO:teuthology.orchestra.run.smithi037.stdout: daxctl-libs-71.1-3.el8.x86_64 2022-02-02T13:30:10.364 INFO:teuthology.orchestra.run.smithi037.stdout: fmt-6.2.1-1.el8.x86_64 2022-02-02T13:30:10.364 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-02-02T13:30:10.364 INFO:teuthology.orchestra.run.smithi037.stdout: leveldb-1.22-1.el8.x86_64 2022-02-02T13:30:10.365 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.365 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2022-02-02T13:30:10.365 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.6.1-1.el8.x86_64 2022-02-02T13:30:10.365 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-02-02T13:30:10.366 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.366 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-02-02T13:30:10.366 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.367 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2022-02-02T13:30:10.367 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-02-02T13:30:10.367 INFO:teuthology.orchestra.run.smithi037.stdout: ndctl-libs-71.1-3.el8.x86_64 2022-02-02T13:30:10.367 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.368 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.368 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.369 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-02-02T13:30:10.369 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.369 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.369 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:10.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:10.370 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:10.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2022-02-02T13:30:10.801 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:10.802 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:11.061 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:16.2.4-0.el8.x86_64 1/29 2022-02-02T13:30:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:16.2.4-0.el8.x86_64 2/29 2022-02-02T13:30:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:16.2.4-0.el8.x86_64 3/29 2022-02-02T13:30:11.062 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:16.2.4-0.el8.x86_64 4/29 2022-02-02T13:30:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:16.2.4-0.el8.x86_64 5/29 2022-02-02T13:30:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:16.2.4-0.el8.x86_64 6/29 2022-02-02T13:30:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:16.2.4-0.el8.x86_64 7/29 2022-02-02T13:30:11.063 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:16.2.4-0.el8.x86_64 8/29 2022-02-02T13:30:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:16.2.4-0.el8.x86_64 9/29 2022-02-02T13:30:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:16.2.4-0.el8.x86_64 10/29 2022-02-02T13:30:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:16.2.4-0.el8.x86_64 11/29 2022-02-02T13:30:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:16.2.4-0.el8.x86_64 12/29 2022-02-02T13:30:11.064 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:16.2.4-0.el8.x86_64 13/29 2022-02-02T13:30:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpmemobj-1.6.1-1.el8.x86_64 14/29 2022-02-02T13:30:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 15/29 2022-02-02T13:30:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 16/29 2022-02-02T13:30:11.065 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 17/29 2022-02-02T13:30:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 18/29 2022-02-02T13:30:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 19/29 2022-02-02T13:30:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 20/29 2022-02-02T13:30:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 21/29 2022-02-02T13:30:11.066 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 22/29 2022-02-02T13:30:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : leveldb-1.22-1.el8.x86_64 23/29 2022-02-02T13:30:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 24/29 2022-02-02T13:30:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 25/29 2022-02-02T13:30:11.067 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:16.2.4-0.el8.x86_64 26/29 2022-02-02T13:30:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 27/29 2022-02-02T13:30:11.071 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:16.2.4-0.el8.x86_64 28/29 2022-02-02T13:30:11.197 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:41 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 29/29 2022-02-02T13:30:11.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:11.984 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2022-02-02T13:30:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:16.2.4-0.el8.x86_64 librbd1-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.985 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.985 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: daxctl-libs-71.1-3.el8.x86_64 2022-02-02T13:30:11.986 INFO:teuthology.orchestra.run.smithi033.stdout: fmt-6.2.1-1.el8.x86_64 2022-02-02T13:30:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-02-02T13:30:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: leveldb-1.22-1.el8.x86_64 2022-02-02T13:30:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2022-02-02T13:30:11.987 INFO:teuthology.orchestra.run.smithi033.stdout: libpmemobj-1.6.1-1.el8.x86_64 2022-02-02T13:30:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-02-02T13:30:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-02-02T13:30:11.988 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2022-02-02T13:30:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-02-02T13:30:11.989 INFO:teuthology.orchestra.run.smithi033.stdout: ndctl-libs-71.1-3.el8.x86_64 2022-02-02T13:30:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.990 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-02-02T13:30:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.991 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:11.992 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:11.992 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:12.054 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:12.057 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:12.057 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:30:12.058 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:12.058 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:12.058 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2022-02-02T13:30:12.058 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:30:12.059 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-02-02T13:30:12.059 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2022-02-02T13:30:12.059 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-02-02T13:30:12.059 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-02-02T13:30:12.060 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-02-02T13:30:12.060 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:12.060 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:12.060 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:12.061 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2022-02-02T13:30:12.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:12.062 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 53 M 2022-02-02T13:30:12.062 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 229 M 2022-02-02T13:30:12.062 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:12.113 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 3.1 MB/s | 169 kB 00:00 2022-02-02T13:30:12.146 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): jq-1.6-3.el8.x86_64.rpm 2.3 MB/s | 202 kB 00:00 2022-02-02T13:30:12.180 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.6 MB/s | 323 kB 00:00 2022-02-02T13:30:12.214 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2022-02-02T13:30:12.242 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-test 2022-02-02T13:30:12.372 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 360 kB/s | 69 kB 00:00 2022-02-02T13:30:12.445 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:12.446 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:12.846 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:42 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:13.122 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 49 MB/s | 52 MB 00:01 2022-02-02T13:30:13.126 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:13.126 INFO:teuthology.orchestra.run.smithi037.stdout:Total 49 MB/s | 53 MB 00:01 2022-02-02T13:30:13.164 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:13.188 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:13.505 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:13.508 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:13.690 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:13.691 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:13.691 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:30:13.692 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:13.692 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:16.2.4-0.el8 ceph 52 M 2022-02-02T13:30:13.692 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:30:13.692 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-02-02T13:30:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:16.2.4-0.el8 ceph 169 k 2022-02-02T13:30:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-02-02T13:30:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-02-02T13:30:13.693 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-02-02T13:30:13.694 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:13.694 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:13.694 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:13.695 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2022-02-02T13:30:13.695 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:13.696 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 53 M 2022-02-02T13:30:13.696 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 229 M 2022-02-02T13:30:13.697 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:13.748 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): libcephsqlite-16.2.4-0.el8.x86_64.rpm 3.0 MB/s | 169 kB 00:00 2022-02-02T13:30:13.815 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2022-02-02T13:30:13.849 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.6 MB/s | 323 kB 00:00 2022-02-02T13:30:13.874 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2022-02-02T13:30:13.989 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:14.025 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 394 kB/s | 69 kB 00:00 2022-02-02T13:30:14.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-02-02T13:30:14.451 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-02-02T13:30:14.578 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T13:30:14.661 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T13:30:14.803 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-02-02T13:30:14.842 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): ceph-test-16.2.4-0.el8.x86_64.rpm 45 MB/s | 52 MB 00:01 2022-02-02T13:30:14.844 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:14.845 INFO:teuthology.orchestra.run.smithi033.stdout:Total 46 MB/s | 53 MB 00:01 2022-02-02T13:30:14.884 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:14.907 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:14.907 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:14.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T13:30:15.239 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:15.239 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:15.720 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:30:15.914 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 1/6 2022-02-02T13:30:16.087 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2022-02-02T13:30:16.242 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T13:30:16.313 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2022-02-02T13:30:16.467 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-3.el8.x86_64 4/6 2022-02-02T13:30:16.625 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T13:30:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T13:30:20.327 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T13:30:20.575 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T13:30:20.576 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2022-02-02T13:30:20.576 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2022-02-02T13:30:20.576 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-02-02T13:30:20.577 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-02-02T13:30:20.577 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-02-02T13:30:21.159 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-02-02T13:30:21.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:21.160 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:21.160 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-02-02T13:30:21.160 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2022-02-02T13:30:21.161 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2022-02-02T13:30:21.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:21.161 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:21.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2022-02-02T13:30:21.552 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:21.553 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:21.803 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:16.2.4-0.el8.x86_64 5/6 2022-02-02T13:30:21.959 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:51 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:22.048 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T13:30:22.456 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-test-2:16.2.4-0.el8.x86_64 6/6 2022-02-02T13:30:22.456 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:16.2.4-0.el8.x86_64 1/6 2022-02-02T13:30:22.456 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:16.2.4-0.el8.x86_64 2/6 2022-02-02T13:30:22.457 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-3.el8.x86_64 3/6 2022-02-02T13:30:22.457 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2022-02-02T13:30:22.457 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2022-02-02T13:30:22.778 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:22.782 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:22.782 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:30:22.783 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:22.783 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:22.783 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2022-02-02T13:30:22.783 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:30:22.783 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2022-02-02T13:30:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2022-02-02T13:30:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2022-02-02T13:30:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2022-02-02T13:30:22.784 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2022-02-02T13:30:22.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-02-02T13:30:22.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-02-02T13:30:22.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-02-02T13:30:22.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-02-02T13:30:22.785 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-02-02T13:30:22.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-02-02T13:30:22.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-02-02T13:30:22.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-02-02T13:30:22.786 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-02-02T13:30:22.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-02-02T13:30:22.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-02-02T13:30:22.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-02-02T13:30:22.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-02-02T13:30:22.787 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-02-02T13:30:22.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-02-02T13:30:22.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-02-02T13:30:22.788 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-02-02T13:30:22.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-02-02T13:30:22.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-02-02T13:30:22.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-02-02T13:30:22.789 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-02-02T13:30:22.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-02-02T13:30:22.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-02-02T13:30:22.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-02-02T13:30:22.790 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-02-02T13:30:22.791 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-02-02T13:30:22.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:22.792 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:22.792 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:22.792 INFO:teuthology.orchestra.run.smithi037.stdout:Install 32 Packages 2022-02-02T13:30:22.793 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:22.793 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 31 M 2022-02-02T13:30:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 111 M 2022-02-02T13:30:22.794 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:22.842 INFO:teuthology.orchestra.run.smithi037.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 125 kB/s | 6.3 kB 00:00 2022-02-02T13:30:22.915 INFO:teuthology.orchestra.run.smithi037.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2022-02-02T13:30:22.965 INFO:teuthology.orchestra.run.smithi037.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2022-02-02T13:30:22.997 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 6/6 2022-02-02T13:30:22.997 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:22.998 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:22.998 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:16.2.4-0.el8.x86_64 jq-1.6-3.el8.x86_64 2022-02-02T13:30:22.998 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:16.2.4-0.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2022-02-02T13:30:22.998 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2022-02-02T13:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:22.999 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:23.001 INFO:teuthology.orchestra.run.smithi037.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 6.5 MB/s | 220 kB 00:00 2022-02-02T13:30:23.057 INFO:teuthology.orchestra.run.smithi037.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-02-02T13:30:23.083 INFO:teuthology.orchestra.run.smithi037.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-02-02T13:30:23.099 INFO:teuthology.orchestra.run.smithi037.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 6.2 MB/s | 103 kB 00:00 2022-02-02T13:30:23.126 INFO:teuthology.orchestra.run.smithi037.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-02-02T13:30:23.158 INFO:teuthology.orchestra.run.smithi037.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2022-02-02T13:30:23.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph 2022-02-02T13:30:23.227 INFO:teuthology.orchestra.run.smithi037.stdout:(10/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 13 MB/s | 5.0 MB 00:00 2022-02-02T13:30:23.259 INFO:teuthology.orchestra.run.smithi037.stdout:(11/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2022-02-02T13:30:23.292 INFO:teuthology.orchestra.run.smithi037.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 3.3 MB/s | 109 kB 00:00 2022-02-02T13:30:23.393 INFO:teuthology.orchestra.run.smithi037.stdout:(13/32): python3-cryptography-3.2.1-5.el8.x86_6 3.3 MB/s | 559 kB 00:00 2022-02-02T13:30:23.404 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:23.405 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:23.610 INFO:teuthology.orchestra.run.smithi037.stdout:(14/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 26 MB/s | 18 MB 00:00 2022-02-02T13:30:23.626 INFO:teuthology.orchestra.run.smithi037.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 131 kB/s | 44 kB 00:00 2022-02-02T13:30:23.809 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:53 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:23.902 INFO:teuthology.orchestra.run.smithi037.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 364 kB/s | 185 kB 00:00 2022-02-02T13:30:23.927 INFO:teuthology.orchestra.run.smithi037.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 544 kB/s | 173 kB 00:00 2022-02-02T13:30:23.955 INFO:teuthology.orchestra.run.smithi037.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2022-02-02T13:30:23.977 INFO:teuthology.orchestra.run.smithi037.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 350 kB/s | 18 kB 00:00 2022-02-02T13:30:24.003 INFO:teuthology.orchestra.run.smithi037.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 968 kB/s | 49 kB 00:00 2022-02-02T13:30:24.047 INFO:teuthology.orchestra.run.smithi037.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 920 kB/s | 384 kB 00:00 2022-02-02T13:30:24.071 INFO:teuthology.orchestra.run.smithi037.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 636 kB/s | 59 kB 00:00 2022-02-02T13:30:24.113 INFO:teuthology.orchestra.run.smithi037.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 232 kB/s | 16 kB 00:00 2022-02-02T13:30:24.151 INFO:teuthology.orchestra.run.smithi037.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 249 kB/s | 19 kB 00:00 2022-02-02T13:30:24.188 INFO:teuthology.orchestra.run.smithi037.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 318 kB/s | 24 kB 00:00 2022-02-02T13:30:24.221 INFO:teuthology.orchestra.run.smithi037.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2022-02-02T13:30:24.247 INFO:teuthology.orchestra.run.smithi037.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 469 kB/s | 27 kB 00:00 2022-02-02T13:30:24.272 INFO:teuthology.orchestra.run.smithi037.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2022-02-02T13:30:24.355 INFO:teuthology.orchestra.run.smithi037.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.8 MB/s | 241 kB 00:00 2022-02-02T13:30:24.381 INFO:teuthology.orchestra.run.smithi037.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 788 kB/s | 85 kB 00:00 2022-02-02T13:30:24.406 INFO:teuthology.orchestra.run.smithi037.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 457 kB/s | 23 kB 00:00 2022-02-02T13:30:24.440 INFO:teuthology.orchestra.run.smithi037.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.3 MB/s | 251 kB 00:00 2022-02-02T13:30:24.444 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:24.444 INFO:teuthology.orchestra.run.smithi037.stdout:Total 19 MB/s | 31 MB 00:01 2022-02-02T13:30:24.536 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:24.578 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:24.578 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:24.622 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:24.626 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:24.626 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:30:24.626 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:24.627 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:24.627 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:16.2.4-0.el8 ceph 6.3 k 2022-02-02T13:30:24.627 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:30:24.627 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:16.2.4-0.el8 ceph 2.4 M 2022-02-02T13:30:24.628 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:16.2.4-0.el8 ceph 1.6 M 2022-02-02T13:30:24.628 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:16.2.4-0.el8 ceph-noarch 220 k 2022-02-02T13:30:24.628 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:16.2.4-0.el8 ceph 5.0 M 2022-02-02T13:30:24.628 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:16.2.4-0.el8 ceph 18 M 2022-02-02T13:30:24.629 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-02-02T13:30:24.629 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-02-02T13:30:24.629 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-02-02T13:30:24.629 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-02-02T13:30:24.629 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-02-02T13:30:24.630 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-02-02T13:30:24.630 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-02-02T13:30:24.630 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-02-02T13:30:24.630 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-02-02T13:30:24.631 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-02-02T13:30:24.631 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-02-02T13:30:24.631 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-02-02T13:30:24.632 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-02-02T13:30:24.632 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-02-02T13:30:24.632 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-02-02T13:30:24.633 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-02-02T13:30:24.633 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-02-02T13:30:24.633 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-02-02T13:30:24.633 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-02-02T13:30:24.634 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-02-02T13:30:24.634 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-02-02T13:30:24.634 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-02-02T13:30:24.634 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-02-02T13:30:24.634 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-02-02T13:30:24.635 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-02-02T13:30:24.635 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-02-02T13:30:24.635 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:24.635 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:24.636 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:24.636 INFO:teuthology.orchestra.run.smithi033.stdout:Install 32 Packages 2022-02-02T13:30:24.636 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:24.637 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 31 M 2022-02-02T13:30:24.637 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 111 M 2022-02-02T13:30:24.637 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:24.685 INFO:teuthology.orchestra.run.smithi033.stdout:(1/32): ceph-16.2.4-0.el8.x86_64.rpm 120 kB/s | 6.3 kB 00:00 2022-02-02T13:30:24.752 INFO:teuthology.orchestra.run.smithi033.stdout:(2/32): ceph-mgr-16.2.4-0.el8.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2022-02-02T13:30:24.819 INFO:teuthology.orchestra.run.smithi033.stdout:(3/32): ceph-mds-16.2.4-0.el8.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2022-02-02T13:30:24.844 INFO:teuthology.orchestra.run.smithi033.stdout:(4/32): ceph-mgr-modules-core-16.2.4-0.el8.noar 8.6 MB/s | 220 kB 00:00 2022-02-02T13:30:24.872 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:24.875 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:24.912 INFO:teuthology.orchestra.run.smithi033.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-02-02T13:30:24.937 INFO:teuthology.orchestra.run.smithi033.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2022-02-02T13:30:24.962 INFO:teuthology.orchestra.run.smithi033.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2022-02-02T13:30:24.987 INFO:teuthology.orchestra.run.smithi033.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2022-02-02T13:30:25.021 INFO:teuthology.orchestra.run.smithi033.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2022-02-02T13:30:25.055 INFO:teuthology.orchestra.run.smithi033.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 237 kB 00:00 2022-02-02T13:30:25.130 INFO:teuthology.orchestra.run.smithi033.stdout:(11/32): ceph-mon-16.2.4-0.el8.x86_64.rpm 11 MB/s | 5.0 MB 00:00 2022-02-02T13:30:25.155 INFO:teuthology.orchestra.run.smithi033.stdout:(12/32): python3-cryptography-3.2.1-5.el8.x86_6 5.4 MB/s | 559 kB 00:00 2022-02-02T13:30:25.180 INFO:teuthology.orchestra.run.smithi033.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2022-02-02T13:30:25.298 INFO:teuthology.orchestra.run.smithi033.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 307 kB/s | 44 kB 00:00 2022-02-02T13:30:25.481 INFO:teuthology.orchestra.run.smithi033.stdout:(15/32): ceph-osd-16.2.4-0.el8.x86_64.rpm 25 MB/s | 18 MB 00:00 2022-02-02T13:30:25.506 INFO:teuthology.orchestra.run.smithi033.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 569 kB/s | 185 kB 00:00 2022-02-02T13:30:25.555 INFO:teuthology.orchestra.run.smithi033.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 671 kB/s | 173 kB 00:00 2022-02-02T13:30:25.582 INFO:teuthology.orchestra.run.smithi033.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2022-02-02T13:30:25.607 INFO:teuthology.orchestra.run.smithi033.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 338 kB/s | 18 kB 00:00 2022-02-02T13:30:25.633 INFO:teuthology.orchestra.run.smithi033.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 967 kB/s | 49 kB 00:00 2022-02-02T13:30:25.658 INFO:teuthology.orchestra.run.smithi033.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2022-02-02T13:30:25.717 INFO:teuthology.orchestra.run.smithi033.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2022-02-02T13:30:25.775 INFO:teuthology.orchestra.run.smithi033.stdout:(23/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.3 MB/s | 384 kB 00:00 2022-02-02T13:30:25.801 INFO:teuthology.orchestra.run.smithi033.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 224 kB/s | 19 kB 00:00 2022-02-02T13:30:25.826 INFO:teuthology.orchestra.run.smithi033.stdout:(25/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2022-02-02T13:30:25.851 INFO:teuthology.orchestra.run.smithi033.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 316 kB/s | 24 kB 00:00 2022-02-02T13:30:26.018 INFO:teuthology.orchestra.run.smithi033.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 134 kB/s | 29 kB 00:00 2022-02-02T13:30:26.043 INFO:teuthology.orchestra.run.smithi033.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 127 kB/s | 27 kB 00:00 2022-02-02T13:30:26.069 INFO:teuthology.orchestra.run.smithi033.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.1 MB/s | 241 kB 00:00 2022-02-02T13:30:26.079 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:26.094 INFO:teuthology.orchestra.run.smithi033.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2022-02-02T13:30:26.121 INFO:teuthology.orchestra.run.smithi033.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 457 kB/s | 23 kB 00:00 2022-02-02T13:30:26.144 INFO:teuthology.orchestra.run.smithi033.stdout:(32/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.9 MB/s | 251 kB 00:00 2022-02-02T13:30:26.148 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:26.148 INFO:teuthology.orchestra.run.smithi033.stdout:Total 20 MB/s | 31 MB 00:01 2022-02-02T13:30:26.243 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:26.270 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-02-02T13:30:26.284 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:26.284 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:26.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-02-02T13:30:26.601 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:26.605 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:26.652 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-02-02T13:30:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-02-02T13:30:27.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-02-02T13:30:27.222 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-02-02T13:30:27.355 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-02-02T13:30:27.483 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-02-02T13:30:27.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-02-02T13:30:27.807 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:30:27.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-02-02T13:30:28.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2022-02-02T13:30:28.172 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-02-02T13:30:28.240 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2022-02-02T13:30:28.368 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-02-02T13:30:28.449 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2022-02-02T13:30:28.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-02-02T13:30:28.713 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2022-02-02T13:30:28.847 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2022-02-02T13:30:28.905 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-02-02T13:30:29.009 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2022-02-02T13:30:29.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-02-02T13:30:29.143 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2022-02-02T13:30:29.289 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-02-02T13:30:29.313 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2022-02-02T13:30:29.511 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2022-02-02T13:30:29.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T13:30:29.711 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2022-02-02T13:30:29.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-02-02T13:30:29.933 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2022-02-02T13:30:30.024 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-02-02T13:30:30.141 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2022-02-02T13:30:30.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-02-02T13:30:30.373 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-02-02T13:30:30.589 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-02-02T13:30:30.660 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2022-02-02T13:30:30.789 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-02-02T13:30:30.919 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2022-02-02T13:30:30.990 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-02-02T13:30:31.064 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2022-02-02T13:30:31.303 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2022-02-02T13:30:31.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-02-02T13:30:31.652 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T13:30:31.687 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-02-02T13:30:31.912 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2022-02-02T13:30:32.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2022-02-02T13:30:32.114 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2022-02-02T13:30:32.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T13:30:32.319 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2022-02-02T13:30:32.479 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2022-02-02T13:30:32.732 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2022-02-02T13:30:32.978 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2022-02-02T13:30:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2022-02-02T13:30:33.642 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2022-02-02T13:30:33.858 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T13:30:33.921 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2022-02-02T13:30:34.068 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T13:30:34.437 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 27/32 2022-02-02T13:30:34.529 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T13:30:34.647 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T13:30:34.743 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T13:30:34.978 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T13:30:35.143 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T13:30:35.160 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T13:30:35.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T13:30:35.380 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T13:30:35.381 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0 2147483647' to '-net/ipv4/ping_group_range', ignoring: No such file or directory 2022-02-02T13:30:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:35.675 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2022-02-02T13:30:35.676 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2022-02-02T13:30:35.676 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2022-02-02T13:30:35.676 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2022-02-02T13:30:35.677 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2022-02-02T13:30:35.677 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2022-02-02T13:30:35.677 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-02-02T13:30:35.678 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-02-02T13:30:35.678 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-02-02T13:30:35.678 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-02-02T13:30:35.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-02-02T13:30:35.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-02-02T13:30:35.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-02-02T13:30:35.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-02-02T13:30:35.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-02-02T13:30:35.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-02-02T13:30:35.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T13:30:35.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-02-02T13:30:35.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-02-02T13:30:35.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-02-02T13:30:35.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-02-02T13:30:35.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-02-02T13:30:35.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-02-02T13:30:35.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-02-02T13:30:35.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-02-02T13:30:35.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-02-02T13:30:35.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-02-02T13:30:35.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-02-02T13:30:35.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-02-02T13:30:35.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-02-02T13:30:35.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-02-02T13:30:36.272 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:16.2.4-0.el8.x86_64 28/32 2022-02-02T13:30:36.467 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T13:30:36.596 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-02-02T13:30:36.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:36.597 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:36.597 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:36.597 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:36.598 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:36.598 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2022-02-02T13:30:36.598 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:36.598 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:36.599 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-02-02T13:30:36.599 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-02-02T13:30:36.599 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-02-02T13:30:36.599 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-02-02T13:30:36.599 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-02-02T13:30:36.600 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-02-02T13:30:36.600 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2022-02-02T13:30:36.600 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-02-02T13:30:36.600 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-02-02T13:30:36.601 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2022-02-02T13:30:36.601 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-02-02T13:30:36.601 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-02-02T13:30:36.601 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-02-02T13:30:36.602 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2022-02-02T13:30:36.602 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-02-02T13:30:36.603 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2022-02-02T13:30:36.603 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2022-02-02T13:30:36.603 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-02-02T13:30:36.603 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-02-02T13:30:36.603 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-02-02T13:30:36.604 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-02-02T13:30:36.604 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-02-02T13:30:36.604 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-02-02T13:30:36.605 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-02-02T13:30:36.605 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-02-02T13:30:36.605 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-02-02T13:30:36.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:36.606 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:36.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2022-02-02T13:30:36.924 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:16.2.4-0.el8.x86_64 29/32 2022-02-02T13:30:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:37.130 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T13:30:37.366 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:16.2.4-0.el8.x86_64 30/32 2022-02-02T13:30:37.425 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:07 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:37.580 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T13:30:37.598 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:16.2.4-0.el8.x86_64 31/32 2022-02-02T13:30:37.713 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T13:30:37.791 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-2:16.2.4-0.el8.x86_64 32/32 2022-02-02T13:30:37.791 INFO:teuthology.orchestra.run.smithi033.stdout:Couldn't write '0 2147483647' to '-net/ipv4/ping_group_range', ignoring: No such file or directory 2022-02-02T13:30:37.792 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:38.118 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:16.2.4-0.el8.x86_64 1/32 2022-02-02T13:30:38.119 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:16.2.4-0.el8.x86_64 2/32 2022-02-02T13:30:38.119 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:16.2.4-0.el8.x86_64 3/32 2022-02-02T13:30:38.119 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:16.2.4-0.el8.x86_64 4/32 2022-02-02T13:30:38.119 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:16.2.4-0.el8.x86_64 5/32 2022-02-02T13:30:38.123 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 6/32 2022-02-02T13:30:38.123 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2022-02-02T13:30:38.123 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2022-02-02T13:30:38.124 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2022-02-02T13:30:38.124 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2022-02-02T13:30:38.124 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2022-02-02T13:30:38.124 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2022-02-02T13:30:38.125 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2022-02-02T13:30:38.125 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2022-02-02T13:30:38.125 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2022-02-02T13:30:38.125 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2022-02-02T13:30:38.125 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2022-02-02T13:30:38.126 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2022-02-02T13:30:38.126 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2022-02-02T13:30:38.126 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2022-02-02T13:30:38.129 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2022-02-02T13:30:38.129 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2022-02-02T13:30:38.130 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2022-02-02T13:30:38.131 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2022-02-02T13:30:38.131 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2022-02-02T13:30:38.131 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2022-02-02T13:30:38.131 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2022-02-02T13:30:38.132 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2022-02-02T13:30:38.132 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2022-02-02T13:30:38.132 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2022-02-02T13:30:38.132 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2022-02-02T13:30:38.207 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:30:38.260 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:38.261 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:30:38.261 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:38.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2022-02-02T13:30:38.509 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:38.510 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:38.910 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:08 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:39.493 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2022-02-02T13:30:39.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:39.494 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:39.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:39.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:39.495 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:39.495 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:16.2.4-0.el8.noarch 2022-02-02T13:30:39.495 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:39.496 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:39.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-02-02T13:30:39.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-02-02T13:30:39.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-02-02T13:30:39.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-02-02T13:30:39.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-02-02T13:30:39.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-02-02T13:30:39.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2022-02-02T13:30:39.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-02-02T13:30:39.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-02-02T13:30:39.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-13.el8.noarch 2022-02-02T13:30:39.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-02-02T13:30:39.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-02-02T13:30:39.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-02-02T13:30:39.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2022-02-02T13:30:39.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-02-02T13:30:39.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.14-14.el8.noarch 2022-02-02T13:30:39.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-9.el8.noarch 2022-02-02T13:30:39.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-02-02T13:30:39.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-02-02T13:30:39.501 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-02-02T13:30:39.501 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-02-02T13:30:39.501 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-02-02T13:30:39.502 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-02-02T13:30:39.502 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-02-02T13:30:39.502 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-02-02T13:30:39.503 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-02-02T13:30:39.503 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:39.503 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:39.789 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:39.791 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:39.791 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:30:39.792 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:39.792 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:39.792 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2022-02-02T13:30:39.794 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:39.794 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:39.795 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:39.796 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:30:39.796 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:39.796 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 71 k 2022-02-02T13:30:39.797 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 290 k 2022-02-02T13:30:39.797 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:39.846 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.3 MB/s | 71 kB 00:00 2022-02-02T13:30:39.847 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:39.847 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.2 MB/s | 71 kB 00:00 2022-02-02T13:30:39.848 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:39.854 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:39.855 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:39.856 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:39.859 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:39.902 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:40.062 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-base 2022-02-02T13:30:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:40.661 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:10 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:41.461 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-base-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:30:41.510 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:41.511 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:30:41.512 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:41.594 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install cephadm 2022-02-02T13:30:41.613 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:41.781 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:41.782 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:41.817 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:42.158 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:42.159 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:42.159 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:16.2.4-0.el8.noarch 2022-02-02T13:30:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:42.160 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:42.180 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:12 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:42.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2022-02-02T13:30:42.567 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:42.970 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:12 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:43.032 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:43.033 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:43.033 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:30:43.033 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:43.033 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:43.034 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:16.2.4-0.el8 ceph-noarch 71 k 2022-02-02T13:30:43.034 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:43.034 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:43.034 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:43.035 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:30:43.035 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:43.035 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 71 k 2022-02-02T13:30:43.035 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 290 k 2022-02-02T13:30:43.035 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:43.071 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm-16.2.4-0.el8.noarch.rpm 1.9 MB/s | 71 kB 00:00 2022-02-02T13:30:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:Total 1.8 MB/s | 71 kB 00:00 2022-02-02T13:30:43.073 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:43.080 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:43.080 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:43.082 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:43.187 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:30:43.785 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:43.787 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2022-02-02T13:30:43.788 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:43.788 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:43.788 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2022-02-02T13:30:43.789 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:43.789 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:43.790 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:43.790 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:30:43.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:43.791 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 163 k 2022-02-02T13:30:43.791 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 587 k 2022-02-02T13:30:43.792 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:43.834 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.4 MB/s | 163 kB 00:00 2022-02-02T13:30:43.835 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:43.835 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.3 MB/s | 163 kB 00:00 2022-02-02T13:30:43.835 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:43.847 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:43.847 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:43.897 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:43.900 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:44.012 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:44.166 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:44.564 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:44.768 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:44.925 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:44.925 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:44.925 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:44.926 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:44.926 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:44.926 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:45.009 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:45.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2022-02-02T13:30:45.214 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:45.284 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:45.284 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:45.692 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:15 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:16.2.4-0.el8.noarch 1/1 2022-02-02T13:30:45.702 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:45.702 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:16.2.4-0.el8.noarch 2022-02-02T13:30:45.703 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:45.703 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:46.007 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-immutable-object-cache 2022-02-02T13:30:46.210 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:46.500 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:30:46.551 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:46.552 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:30:46.552 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:46.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2022-02-02T13:30:46.617 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:16 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:47.210 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:17 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:47.485 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:47.487 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:47.487 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repo Size 2022-02-02T13:30:47.487 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:47.487 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:47.488 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:16.2.4-0.el8 ceph 163 k 2022-02-02T13:30:47.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:47.488 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:47.489 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:47.489 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:30:47.489 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:47.489 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 163 k 2022-02-02T13:30:47.490 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 587 k 2022-02-02T13:30:47.490 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:47.535 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-immutable-object-cache-16.2.4-0.el8.x86_64 3.3 MB/s | 163 kB 00:00 2022-02-02T13:30:47.536 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:47.536 INFO:teuthology.orchestra.run.smithi033.stdout:Total 3.2 MB/s | 163 kB 00:00 2022-02-02T13:30:47.537 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:47.549 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:47.549 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:47.599 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:47.601 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:47.713 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:30:47.911 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:48.058 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:48.059 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:48.059 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:30:48.060 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:48.060 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:48.060 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2022-02-02T13:30:48.060 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:30:48.061 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2022-02-02T13:30:48.061 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2022-02-02T13:30:48.061 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-02-02T13:30:48.061 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-02-02T13:30:48.061 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-02-02T13:30:48.062 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:48.062 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:48.062 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:30:48.062 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2022-02-02T13:30:48.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:48.063 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.0 M 2022-02-02T13:30:48.063 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 15 M 2022-02-02T13:30:48.063 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:48.113 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 167 kB/s | 8.9 kB 00:00 2022-02-02T13:30:48.248 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 128 kB/s | 24 kB 00:00 2022-02-02T13:30:48.310 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:48.572 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 5.2 MB/s | 2.7 MB 00:00 2022-02-02T13:30:48.685 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:30:48.686 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:48.686 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:48.686 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:16.2.4-0.el8.x86_64 2022-02-02T13:30:48.686 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:48.686 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:48.864 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 57 kB/s | 43 kB 00:00 2022-02-02T13:30:48.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr 2022-02-02T13:30:49.081 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:49.082 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:49.205 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 35 kB/s | 34 kB 00:00 2022-02-02T13:30:49.488 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:19 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:49.524 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 206 kB/s | 196 kB 00:00 2022-02-02T13:30:49.528 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:49.528 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.0 MB/s | 3.0 MB 00:01 2022-02-02T13:30:49.541 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:49.554 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:49.554 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:49.960 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:49.986 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:50.308 INFO:teuthology.orchestra.run.smithi033.stdout:Package ceph-mgr-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:30:50.358 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:50.359 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:30:50.360 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:50.444 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:50.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-02-02T13:30:50.886 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-02-02T13:30:50.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-dashboard 2022-02-02T13:30:51.068 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-02-02T13:30:51.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2022-02-02T13:30:51.187 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:51.187 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:51.588 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:21 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:52.229 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2022-02-02T13:30:52.432 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:52.433 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:52.433 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:30:52.433 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:52.434 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:52.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:16.2.4-0.el8 ceph-noarch 2.7 M 2022-02-02T13:30:52.434 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:30:52.434 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:16.2.4-0.el8 ceph-noarch 24 k 2022-02-02T13:30:52.435 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:16.2.4-0.el8 ceph-noarch 8.9 k 2022-02-02T13:30:52.435 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-02-02T13:30:52.435 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-02-02T13:30:52.435 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-02-02T13:30:52.436 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:52.436 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:52.436 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:30:52.436 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2022-02-02T13:30:52.436 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:52.437 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 3.0 M 2022-02-02T13:30:52.438 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 15 M 2022-02-02T13:30:52.438 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:52.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:30:52.497 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): ceph-grafana-dashboards-16.2.4-0.el8.noa 393 kB/s | 24 kB 00:00 2022-02-02T13:30:52.522 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): ceph-prometheus-alerts-16.2.4-0.el8.noar 103 kB/s | 8.9 kB 00:00 2022-02-02T13:30:52.597 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): ceph-mgr-dashboard-16.2.4-0.el8.noarch.r 16 MB/s | 2.7 MB 00:00 2022-02-02T13:30:52.623 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 340 kB/s | 43 kB 00:00 2022-02-02T13:30:52.698 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 192 kB/s | 34 kB 00:00 2022-02-02T13:30:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:30:52.737 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2022-02-02T13:30:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2022-02-02T13:30:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2022-02-02T13:30:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-02-02T13:30:52.738 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-02-02T13:30:52.865 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 736 kB/s | 196 kB 00:00 2022-02-02T13:30:52.867 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:52.867 INFO:teuthology.orchestra.run.smithi033.stdout:Total 6.8 MB/s | 3.0 MB 00:00 2022-02-02T13:30:52.879 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:52.889 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:52.890 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:53.024 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:53.027 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-02-02T13:30:53.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:53.097 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:30:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2022-02-02T13:30:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2022-02-02T13:30:53.097 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2022-02-02T13:30:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-02-02T13:30:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-02-02T13:30:53.098 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2022-02-02T13:30:53.099 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:53.099 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:30:53.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2022-02-02T13:30:53.326 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:30:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:53.408 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:53.585 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2022-02-02T13:30:53.809 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:23 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:53.964 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2022-02-02T13:30:54.171 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2022-02-02T13:30:54.293 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 4/6 2022-02-02T13:30:54.672 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:30:54.673 INFO:teuthology.orchestra.run.smithi037.stdout:===================================================================================================== 2022-02-02T13:30:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:30:54.674 INFO:teuthology.orchestra.run.smithi037.stdout:===================================================================================================== 2022-02-02T13:30:54.674 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:30:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2022-02-02T13:30:54.674 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:30:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-02-02T13:30:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-02-02T13:30:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-02-02T13:30:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-02-02T13:30:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-02-02T13:30:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-02-02T13:30:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-02-02T13:30:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:54.676 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:30:54.676 INFO:teuthology.orchestra.run.smithi037.stdout:===================================================================================================== 2022-02-02T13:30:54.677 INFO:teuthology.orchestra.run.smithi037.stdout:Install 8 Packages 2022-02-02T13:30:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:30:54.678 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 37 M 2022-02-02T13:30:54.678 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 210 M 2022-02-02T13:30:54.678 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:30:54.844 INFO:teuthology.orchestra.run.smithi037.stdout:(1/8): openblas-0.3.15-3.el8.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2022-02-02T13:30:54.952 INFO:teuthology.orchestra.run.smithi037.stdout:(2/8): ceph-mgr-diskprediction-local-16.2.4-0.e 31 MB/s | 8.6 MB 00:00 2022-02-02T13:30:55.027 INFO:teuthology.orchestra.run.smithi037.stdout:(3/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 20 MB/s | 3.7 MB 00:00 2022-02-02T13:30:55.079 INFO:teuthology.orchestra.run.smithi037.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.8 MB/s | 225 kB 00:00 2022-02-02T13:30:55.178 INFO:teuthology.orchestra.run.smithi037.stdout:(5/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 9.7 MB/s | 4.9 MB 00:00 2022-02-02T13:30:55.203 INFO:teuthology.orchestra.run.smithi037.stdout:(6/8): libgfortran-8.5.0-10.el8.x86_64.rpm 5.0 MB/s | 643 kB 00:00 2022-02-02T13:30:55.228 INFO:teuthology.orchestra.run.smithi037.stdout:(7/8): libquadmath-8.5.0-10.el8.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2022-02-02T13:30:55.387 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 5/6 2022-02-02T13:30:55.446 INFO:teuthology.orchestra.run.smithi037.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 33 MB/s | 14 MB 00:00 2022-02-02T13:30:55.449 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:55.449 INFO:teuthology.orchestra.run.smithi037.stdout:Total 47 MB/s | 37 MB 00:00 2022-02-02T13:30:55.677 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:30:55.692 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:30:55.712 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:30:55.713 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:30:55.970 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:30:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 1/6 2022-02-02T13:30:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2/6 2022-02-02T13:30:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 3/6 2022-02-02T13:30:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2022-02-02T13:30:55.971 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2022-02-02T13:30:56.046 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:30:56.049 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:30:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2022-02-02T13:30:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:56.340 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:30:56.340 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:16.2.4-0.el8.noarch 2022-02-02T13:30:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:16.2.4-0.el8.noarch 2022-02-02T13:30:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:16.2.4-0.el8.noarch 2022-02-02T13:30:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-02-02T13:30:56.341 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-02-02T13:30:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2022-02-02T13:30:56.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:56.342 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:30:56.484 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-diskprediction-local 2022-02-02T13:30:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:30:56.672 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:56.672 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:30:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T13:30:56.888 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T13:30:57.014 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T13:30:57.072 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:27 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:30:57.630 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T13:30:57.781 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:30:57.929 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:30:57.931 INFO:teuthology.orchestra.run.smithi033.stdout:===================================================================================================== 2022-02-02T13:30:57.931 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:30:57.931 INFO:teuthology.orchestra.run.smithi033.stdout:===================================================================================================== 2022-02-02T13:30:57.931 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:30:57.932 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.4-0.el8 ceph-noarch 8.6 M 2022-02-02T13:30:57.932 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:30:57.932 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-02-02T13:30:57.932 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-02-02T13:30:57.933 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-02-02T13:30:57.933 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-02-02T13:30:57.933 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-02-02T13:30:57.933 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-02-02T13:30:57.934 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-02-02T13:30:57.934 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:57.934 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:30:57.934 INFO:teuthology.orchestra.run.smithi033.stdout:===================================================================================================== 2022-02-02T13:30:57.935 INFO:teuthology.orchestra.run.smithi033.stdout:Install 8 Packages 2022-02-02T13:30:57.935 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:30:57.936 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 37 M 2022-02-02T13:30:57.936 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 210 M 2022-02-02T13:30:57.936 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:30:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.4-0.e 39 MB/s | 8.6 MB 00:00 2022-02-02T13:30:58.230 INFO:teuthology.orchestra.run.smithi033.stdout:(2/8): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2022-02-02T13:30:58.262 INFO:teuthology.orchestra.run.smithi033.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 7.8 MB/s | 225 kB 00:00 2022-02-02T13:30:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:(4/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2022-02-02T13:30:58.379 INFO:teuthology.orchestra.run.smithi033.stdout:(5/8): libgfortran-8.5.0-10.el8.x86_64.rpm 13 MB/s | 643 kB 00:00 2022-02-02T13:30:58.429 INFO:teuthology.orchestra.run.smithi033.stdout:(6/8): libquadmath-8.5.0-10.el8.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2022-02-02T13:30:58.434 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:30:58.546 INFO:teuthology.orchestra.run.smithi033.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 9.5 MB/s | 3.7 MB 00:00 2022-02-02T13:30:58.608 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T13:30:58.805 INFO:teuthology.orchestra.run.smithi033.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 25 MB/s | 14 MB 00:00 2022-02-02T13:30:58.808 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:30:58.808 INFO:teuthology.orchestra.run.smithi033.stdout:Total 42 MB/s | 37 MB 00:00 2022-02-02T13:30:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:30:59.070 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:30:59.071 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:30:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T13:30:59.400 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:30:59.403 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:30:59.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T13:30:59.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T13:30:59.997 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:00.179 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T13:31:00.322 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 1/8 2022-02-02T13:31:00.484 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T13:31:01.133 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 2/8 2022-02-02T13:31:01.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:31:01.737 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T13:31:01.952 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:31:02.167 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T13:31:02.883 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 4/8 2022-02-02T13:31:03.133 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-02-02T13:31:03.242 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T13:31:03.313 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T13:31:03.534 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T13:31:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T13:31:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2022-02-02T13:31:03.618 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-02-02T13:31:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:31:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-02-02T13:31:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T13:31:03.619 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-02-02T13:31:03.620 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 7/8 2022-02-02T13:31:03.998 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 8/8 2022-02-02T13:31:03.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:03.999 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:03.999 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2022-02-02T13:31:04.000 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-02-02T13:31:04.000 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-02-02T13:31:04.000 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.15-3.el8.x86_64 2022-02-02T13:31:04.000 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-02-02T13:31:04.000 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-02-02T13:31:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-02-02T13:31:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-02-02T13:31:04.001 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:04.001 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:04.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2022-02-02T13:31:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:04.690 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:34 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:05.419 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2022-02-02T13:31:05.548 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:05.550 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:05.551 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:31:05.551 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:05.552 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:05.552 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2022-02-02T13:31:05.553 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:31:05.553 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-02-02T13:31:05.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-02-02T13:31:05.554 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-02-02T13:31:05.555 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-02-02T13:31:05.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-02-02T13:31:05.556 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-02-02T13:31:05.557 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-02-02T13:31:05.557 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-02-02T13:31:05.557 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-02-02T13:31:05.558 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-02-02T13:31:05.558 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-02-02T13:31:05.558 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-02-02T13:31:05.559 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2022-02-02T13:31:05.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:05.561 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 1.9 M 2022-02-02T13:31:05.561 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 24 M 2022-02-02T13:31:05.561 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:05.882 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 82 kB/s | 27 kB 00:00 2022-02-02T13:31:06.203 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 41 kB/s | 27 kB 00:00 2022-02-02T13:31:06.397 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 24 kB/s | 20 kB 00:00 2022-02-02T13:31:06.421 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 4.6 MB/s | 110 kB 00:00 2022-02-02T13:31:06.446 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.1 MB/s | 155 kB 00:00 2022-02-02T13:31:06.483 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 215 kB/s | 126 kB 00:00 2022-02-02T13:31:06.500 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-requests-oauthlib-1.0.0-1.el8.n 636 kB/s | 43 kB 00:00 2022-02-02T13:31:06.572 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-cachetools-3.1.1-4.el8.noarch.r 263 kB/s | 33 kB 00:00 2022-02-02T13:31:06.589 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2022-02-02T13:31:06.622 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 607 kB/s | 81 kB 00:00 2022-02-02T13:31:06.664 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 819 kB/s | 61 kB 00:00 2022-02-02T13:31:06.681 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.0 MB/s | 61 kB 00:00 2022-02-02T13:31:06.780 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2022-02-02T13:31:06.806 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 5.0 MB/s | 1.2 MB 00:00 2022-02-02T13:31:06.809 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:06.810 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.5 MB/s | 1.9 MB 00:01 2022-02-02T13:31:06.877 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:06.895 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:06.895 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:06.958 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T13:31:06.982 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:06.985 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:07.299 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 8/8 2022-02-02T13:31:07.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 1/8 2022-02-02T13:31:07.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 2/8 2022-02-02T13:31:07.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 3/8 2022-02-02T13:31:07.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2022-02-02T13:31:07.300 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2022-02-02T13:31:07.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2022-02-02T13:31:07.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 7/8 2022-02-02T13:31:07.532 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:07.777 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-02-02T13:31:07.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-02-02T13:31:08.158 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-02-02T13:31:08.324 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 8/8 2022-02-02T13:31:08.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:08.324 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:16.2.4-0.el8.noarch 2022-02-02T13:31:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-02-02T13:31:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-02-02T13:31:08.325 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.15-3.el8.x86_64 2022-02-02T13:31:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-02-02T13:31:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-02-02T13:31:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-02-02T13:31:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-02-02T13:31:08.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:08.327 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:08.337 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-02-02T13:31:08.446 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-rook 2022-02-02T13:31:08.536 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-02-02T13:31:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:08.745 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-02-02T13:31:09.023 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-02-02T13:31:09.041 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:39 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:09.231 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-02-02T13:31:09.888 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:09.890 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:09.890 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:31:09.890 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:09.891 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:09.891 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:16.2.4-0.el8 ceph-noarch 27 k 2022-02-02T13:31:09.891 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:31:09.891 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-02-02T13:31:09.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-02-02T13:31:09.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-02-02T13:31:09.892 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-02-02T13:31:09.893 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-02-02T13:31:09.893 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-02-02T13:31:09.893 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-02-02T13:31:09.893 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-02-02T13:31:09.894 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-02-02T13:31:09.894 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-02-02T13:31:09.894 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-02-02T13:31:09.894 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-02-02T13:31:09.894 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:09.895 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:09.895 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:09.895 INFO:teuthology.orchestra.run.smithi033.stdout:Install 13 Packages 2022-02-02T13:31:09.896 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:09.896 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 1.9 M 2022-02-02T13:31:09.897 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 24 M 2022-02-02T13:31:09.897 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:09.946 INFO:teuthology.orchestra.run.smithi033.stdout:(1/13): ceph-mgr-rook-16.2.4-0.el8.noarch.rpm 517 kB/s | 27 kB 00:00 2022-02-02T13:31:09.979 INFO:teuthology.orchestra.run.smithi033.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 311 kB/s | 27 kB 00:00 2022-02-02T13:31:10.005 INFO:teuthology.orchestra.run.smithi033.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 180 kB/s | 20 kB 00:00 2022-02-02T13:31:10.030 INFO:teuthology.orchestra.run.smithi033.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 4.4 MB/s | 110 kB 00:00 2022-02-02T13:31:10.055 INFO:teuthology.orchestra.run.smithi033.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.1 MB/s | 155 kB 00:00 2022-02-02T13:31:10.080 INFO:teuthology.orchestra.run.smithi033.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 848 kB/s | 43 kB 00:00 2022-02-02T13:31:10.106 INFO:teuthology.orchestra.run.smithi033.stdout:(7/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 796 kB/s | 126 kB 00:00 2022-02-02T13:31:10.198 INFO:teuthology.orchestra.run.smithi033.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2022-02-02T13:31:10.224 INFO:teuthology.orchestra.run.smithi033.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 197 kB/s | 33 kB 00:00 2022-02-02T13:31:10.241 INFO:teuthology.orchestra.run.smithi033.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 606 kB/s | 81 kB 00:00 2022-02-02T13:31:10.290 INFO:teuthology.orchestra.run.smithi033.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 1.2 MB/s | 61 kB 00:00 2022-02-02T13:31:10.316 INFO:teuthology.orchestra.run.smithi033.stdout:(12/13): python3-rsa-4.8-1.el8.noarch.rpm 667 kB/s | 61 kB 00:00 2022-02-02T13:31:10.321 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-02-02T13:31:10.492 INFO:teuthology.orchestra.run.smithi033.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.0 MB/s | 1.2 MB 00:00 2022-02-02T13:31:10.494 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:10.494 INFO:teuthology.orchestra.run.smithi033.stdout:Total 3.2 MB/s | 1.9 MB 00:00 2022-02-02T13:31:10.557 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:10.574 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:10.574 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:10.586 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-02-02T13:31:10.659 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:10.662 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:10.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-02-02T13:31:10.977 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-02-02T13:31:11.121 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T13:31:11.209 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:11.413 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T13:31:11.413 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2022-02-02T13:31:11.413 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-02-02T13:31:11.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-02-02T13:31:11.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-02-02T13:31:11.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-02-02T13:31:11.414 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-02-02T13:31:11.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-02-02T13:31:11.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-02-02T13:31:11.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-02-02T13:31:11.415 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-02-02T13:31:11.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-02-02T13:31:11.416 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-02-02T13:31:11.421 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2022-02-02T13:31:11.635 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2022-02-02T13:31:11.870 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2022-02-02T13:31:12.056 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2022-02-02T13:31:12.131 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-02-02T13:31:12.132 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:12.132 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:12.132 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2022-02-02T13:31:12.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-02-02T13:31:12.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-02-02T13:31:12.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-02-02T13:31:12.133 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-02-02T13:31:12.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-02-02T13:31:12.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-02-02T13:31:12.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-02-02T13:31:12.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-02-02T13:31:12.134 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-02-02T13:31:12.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-02-02T13:31:12.135 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.8-1.el8.noarch 2022-02-02T13:31:12.136 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-02-02T13:31:12.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:12.136 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:12.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2022-02-02T13:31:12.275 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2022-02-02T13:31:12.402 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:12.403 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:12.484 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2022-02-02T13:31:12.772 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2022-02-02T13:31:12.807 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:42 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:13.031 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2022-02-02T13:31:13.649 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:13.650 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:13.651 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2022-02-02T13:31:13.651 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:13.651 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:13.652 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2022-02-02T13:31:13.653 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:31:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-02-02T13:31:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-02-02T13:31:13.653 INFO:teuthology.orchestra.run.smithi037.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-02-02T13:31:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-02-02T13:31:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-02-02T13:31:13.654 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:13.654 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:13.654 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:13.655 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2022-02-02T13:31:13.655 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:13.656 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 5.8 M 2022-02-02T13:31:13.656 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 24 M 2022-02-02T13:31:13.656 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:13.706 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.7 MB/s | 89 kB 00:00 2022-02-02T13:31:13.741 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.1 MB/s | 538 kB 00:00 2022-02-02T13:31:13.856 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2022-02-02T13:31:13.883 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 121 kB/s | 21 kB 00:00 2022-02-02T13:31:14.082 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 217 kB/s | 49 kB 00:00 2022-02-02T13:31:14.172 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2022-02-02T13:31:14.190 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 789 kB/s | 355 kB 00:00 2022-02-02T13:31:14.192 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:14.192 INFO:teuthology.orchestra.run.smithi037.stdout:Total 11 MB/s | 5.8 MB 00:00 2022-02-02T13:31:14.248 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:14.260 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:14.260 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:14.367 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:14.370 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:14.422 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2022-02-02T13:31:14.623 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2022-02-02T13:31:14.649 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:14.854 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2022-02-02T13:31:14.900 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2022-02-02T13:31:15.007 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T13:31:15.150 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2022-02-02T13:31:15.301 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.4-0.el8.noarch 13/13 2022-02-02T13:31:15.301 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:16.2.4-0.el8.noarch 1/13 2022-02-02T13:31:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2022-02-02T13:31:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2022-02-02T13:31:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2022-02-02T13:31:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2022-02-02T13:31:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2022-02-02T13:31:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2022-02-02T13:31:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2022-02-02T13:31:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2022-02-02T13:31:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2022-02-02T13:31:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2022-02-02T13:31:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2022-02-02T13:31:15.747 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2022-02-02T13:31:15.747 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:15.747 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:15.748 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:16.2.4-0.el8.noarch 2022-02-02T13:31:15.748 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-02-02T13:31:15.748 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-02-02T13:31:15.748 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-02-02T13:31:15.748 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-02-02T13:31:15.749 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-02-02T13:31:15.749 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-02-02T13:31:15.749 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-02-02T13:31:15.749 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-02-02T13:31:15.750 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-02-02T13:31:15.750 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-02-02T13:31:15.750 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.8-1.el8.noarch 2022-02-02T13:31:15.750 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-02-02T13:31:15.750 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:15.751 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:15.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-mgr-cephadm 2022-02-02T13:31:16.062 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:16.063 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:16.091 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2022-02-02T13:31:16.440 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2022-02-02T13:31:16.467 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:46 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:16.689 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2022-02-02T13:31:16.820 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:31:17.088 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:31:17.089 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2022-02-02T13:31:17.089 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2022-02-02T13:31:17.090 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2022-02-02T13:31:17.090 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2022-02-02T13:31:17.090 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2022-02-02T13:31:17.328 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:17.329 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:17.340 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2022-02-02T13:31:17.340 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:17.341 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:16.2.4-0.el8 ceph-noarch 89 k 2022-02-02T13:31:17.341 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:31:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2022-02-02T13:31:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-02-02T13:31:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2022-02-02T13:31:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-02-02T13:31:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2022-02-02T13:31:17.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:17.343 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:17.343 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:17.343 INFO:teuthology.orchestra.run.smithi033.stdout:Install 6 Packages 2022-02-02T13:31:17.343 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:17.344 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 5.8 M 2022-02-02T13:31:17.344 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 24 M 2022-02-02T13:31:17.344 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:17.382 INFO:teuthology.orchestra.run.smithi033.stdout:(1/6): ceph-mgr-cephadm-16.2.4-0.el8.noarch.rpm 1.7 MB/s | 89 kB 00:00 2022-02-02T13:31:17.433 INFO:teuthology.orchestra.run.smithi033.stdout:(2/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 5.2 MB/s | 538 kB 00:00 2022-02-02T13:31:17.558 INFO:teuthology.orchestra.run.smithi033.stdout:(3/6): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2022-02-02T13:31:17.583 INFO:teuthology.orchestra.run.smithi033.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 106 kB/s | 21 kB 00:00 2022-02-02T13:31:17.633 INFO:teuthology.orchestra.run.smithi033.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 651 kB/s | 49 kB 00:00 2022-02-02T13:31:17.667 INFO:teuthology.orchestra.run.smithi033.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.5 MB/s | 355 kB 00:00 2022-02-02T13:31:17.668 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:17.668 INFO:teuthology.orchestra.run.smithi033.stdout:Total 17 MB/s | 5.8 MB 00:00 2022-02-02T13:31:17.721 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2022-02-02T13:31:17.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:17.721 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:17.722 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2022-02-02T13:31:17.722 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2022-02-02T13:31:17.722 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2022-02-02T13:31:17.722 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:17.723 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:17.723 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:17.733 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:17.733 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:17.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2022-02-02T13:31:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:18.066 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:18.120 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:18.386 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2022-02-02T13:31:18.479 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:48 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:18.653 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2022-02-02T13:31:19.339 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:19.341 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:19.341 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:19.341 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:19.342 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2022-02-02T13:31:19.342 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2022-02-02T13:31:19.342 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-02-02T13:31:19.343 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:19.343 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:19.343 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:19.343 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2022-02-02T13:31:19.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:19.344 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 967 k 2022-02-02T13:31:19.344 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 3.2 M 2022-02-02T13:31:19.344 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:19.407 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 13 MB/s | 885 kB 00:00 2022-02-02T13:31:19.432 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 916 kB/s | 82 kB 00:00 2022-02-02T13:31:19.433 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:19.434 INFO:teuthology.orchestra.run.smithi037.stdout:Total 10 MB/s | 967 kB 00:00 2022-02-02T13:31:19.447 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:19.467 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:19.467 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:19.553 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:19.556 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:19.629 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2022-02-02T13:31:19.728 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:19.978 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2022-02-02T13:31:20.027 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2022-02-02T13:31:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T13:31:20.405 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2022-02-02T13:31:20.533 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T13:31:20.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2022-02-02T13:31:20.599 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:31:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 6/6 2022-02-02T13:31:20.880 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:16.2.4-0.el8.noarch 1/6 2022-02-02T13:31:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2022-02-02T13:31:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2022-02-02T13:31:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2022-02-02T13:31:20.881 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2022-02-02T13:31:20.885 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2022-02-02T13:31:20.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:20.886 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:20.886 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2022-02-02T13:31:20.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:20.887 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:21.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2022-02-02T13:31:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2022-02-02T13:31:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:21.380 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:21.380 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:16.2.4-0.el8.noarch python3-apipkg-1.5-6.el8.noarch 2022-02-02T13:31:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-7.el8.noarch python3-execnet-1.7.1-1.el8.noarch 2022-02-02T13:31:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-3.el8.noarch python3-remoto-1.2.1-1.el8.noarch 2022-02-02T13:31:21.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:21.381 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:21.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-fuse 2022-02-02T13:31:21.630 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:51 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:21.795 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:21.796 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:22.204 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:52 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:22.480 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:22.480 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2022-02-02T13:31:22.481 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:31:22.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 131 k 2022-02-02T13:31:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 439 k 2022-02-02T13:31:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:22.528 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 2.7 MB/s | 131 kB 00:00 2022-02-02T13:31:22.529 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:22.529 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.7 MB/s | 131 kB 00:00 2022-02-02T13:31:22.529 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:22.535 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:22.536 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:22.707 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:22.870 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:23.041 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:23.042 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:23.042 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:23.042 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:23.042 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:16.2.4-0.el8 ceph 885 k 2022-02-02T13:31:23.043 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2022-02-02T13:31:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-02-02T13:31:23.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:23.044 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:23.044 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:23.044 INFO:teuthology.orchestra.run.smithi033.stdout:Install 2 Packages 2022-02-02T13:31:23.044 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:23.045 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 967 k 2022-02-02T13:31:23.045 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 3.2 M 2022-02-02T13:31:23.046 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:23.126 INFO:teuthology.orchestra.run.smithi033.stdout:(1/2): ceph-fuse-16.2.4-0.el8.x86_64.rpm 11 MB/s | 885 kB 00:00 2022-02-02T13:31:23.130 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:23.142 INFO:teuthology.orchestra.run.smithi033.stdout:(2/2): fuse-2.9.7-12.el8.x86_64.rpm 837 kB/s | 82 kB 00:00 2022-02-02T13:31:23.143 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:23.145 INFO:teuthology.orchestra.run.smithi033.stdout:Total 9.3 MB/s | 967 kB 00:00 2022-02-02T13:31:23.155 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:23.179 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:23.179 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:23.263 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:23.267 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:23.435 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:23.506 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:23.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:23.506 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:23.507 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:23.507 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:23.507 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:23.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2022-02-02T13:31:23.703 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2022-02-02T13:31:23.847 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:23.848 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:24.064 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T13:31:24.254 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:54 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-fuse-2:16.2.4-0.el8.x86_64 2/2 2022-02-02T13:31:24.458 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:16.2.4-0.el8.x86_64 1/2 2022-02-02T13:31:25.054 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2022-02-02T13:31:25.055 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:25.055 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:25.055 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:16.2.4-0.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2022-02-02T13:31:25.055 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:25.056 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:25.071 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:25.118 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:25.119 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:25.120 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:25.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2022-02-02T13:31:25.246 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados-devel 2022-02-02T13:31:25.369 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:25.370 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:25.437 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:25.438 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:25.786 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:55 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:25.847 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:55 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:26.616 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:26.617 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:26.617 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:26.617 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:26.618 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:26.618 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2022-02-02T13:31:26.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:26.618 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:26.619 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:26.619 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:31:26.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:26.620 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 24 k 2022-02-02T13:31:26.620 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 94 k 2022-02-02T13:31:26.621 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 501 kB/s | 24 kB 00:00 2022-02-02T13:31:26.667 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:Total 489 kB/s | 24 kB 00:00 2022-02-02T13:31:26.668 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:26.672 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:26.672 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:26.674 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:26.678 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:26.693 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:26.694 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:26.695 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:26.695 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:26.695 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:16.2.4-0.el8 ceph 131 k 2022-02-02T13:31:26.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:26.696 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:26.697 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:26.697 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:31:26.697 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:26.697 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 131 k 2022-02-02T13:31:26.697 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 439 k 2022-02-02T13:31:26.698 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:26.724 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:26.739 INFO:teuthology.orchestra.run.smithi033.stdout:librados-devel-16.2.4-0.el8.x86_64.rpm 3.0 MB/s | 131 kB 00:00 2022-02-02T13:31:26.739 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:26.740 INFO:teuthology.orchestra.run.smithi033.stdout:Total 2.9 MB/s | 131 kB 00:00 2022-02-02T13:31:26.740 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:26.746 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:26.746 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:26.799 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:26.803 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:26.909 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:26.933 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:27.121 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:27.155 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:27.392 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:27.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:27.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:27.488 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:27.488 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:27.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:27.489 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:27.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2022-02-02T13:31:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:27.762 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:27.763 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:27.763 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:27.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs2 2022-02-02T13:31:28.153 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:28.154 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:28.154 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:58 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:28.565 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:58 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:28.952 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:29.004 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:29.005 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:29.005 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:29.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2022-02-02T13:31:29.281 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:29.342 INFO:teuthology.orchestra.run.smithi033.stdout:Package libcephfs2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:29.389 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:29.393 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:29.393 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:29.464 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install libcephfs-devel 2022-02-02T13:31:29.652 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:29.652 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:29.688 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:59 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:30.059 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:00 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:30.481 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:30.527 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:30.529 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:30.529 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:30.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2022-02-02T13:31:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:30.777 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:30.924 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:30.925 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:30.926 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:30.926 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:30.926 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:30.926 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:16.2.4-0.el8 ceph 24 k 2022-02-02T13:31:30.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:30.927 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:30.927 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:30.927 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:31:30.928 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:30.928 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 24 k 2022-02-02T13:31:30.928 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 94 k 2022-02-02T13:31:30.928 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:30.976 INFO:teuthology.orchestra.run.smithi033.stdout:libcephfs-devel-16.2.4-0.el8.x86_64.rpm 489 kB/s | 24 kB 00:00 2022-02-02T13:31:30.977 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:30.977 INFO:teuthology.orchestra.run.smithi033.stdout:Total 478 kB/s | 24 kB 00:00 2022-02-02T13:31:30.977 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:30.981 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:30.982 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:30.984 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:30.987 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:31.035 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:31.182 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:01 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:31.228 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:31.470 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:31.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:31.846 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:31.847 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:31.847 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:31.847 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:31.847 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:31.943 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librados2 2022-02-02T13:31:32.005 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:32.054 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:32.055 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:32.055 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:32.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2022-02-02T13:31:32.131 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:32.131 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:32.537 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:02 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:32.710 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:02 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:33.349 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:33.398 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:33.399 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:33.399 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:33.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install librbd1 2022-02-02T13:31:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:33.573 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:33.575 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:33.575 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:33.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2022-02-02T13:31:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:33.824 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:33.824 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:34.064 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:04 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:34.236 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:04 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:34.870 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:34.918 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:34.919 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:34.920 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:34.986 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rados 2022-02-02T13:31:35.067 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:35.117 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:35.118 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:35.118 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:35.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2022-02-02T13:31:35.175 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:35.176 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:35.364 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:35.583 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:05 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:35.771 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:05 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:36.369 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rados-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:36.418 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:36.419 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:36.419 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:36.563 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:36.615 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:36.616 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2022-02-02T13:31:36.616 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:36.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2022-02-02T13:31:36.875 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rgw 2022-02-02T13:31:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:37.064 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:37.414 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:07 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:37.469 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:07 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:38.242 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:38.243 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:38.244 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:38.244 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:38.244 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:38.244 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2022-02-02T13:31:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:38.245 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:38.245 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:38.245 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:31:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:38.246 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 89 k 2022-02-02T13:31:38.246 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 298 k 2022-02-02T13:31:38.246 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:38.281 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rgw-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.9 MB/s | 89 kB 00:00 2022-02-02T13:31:38.289 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.9 MB/s | 89 kB 00:00 2022-02-02T13:31:38.290 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:38.301 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:38.301 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:38.330 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:38.333 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:38.333 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:38.354 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:38.357 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:38.403 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-cephfs 2022-02-02T13:31:38.462 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:38.592 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:38.593 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:38.635 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:38.887 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:38.995 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:08 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:39.263 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:39.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:39.264 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:39.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:39.264 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:39.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2022-02-02T13:31:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:39.606 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:39.766 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-cephfs-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:39.814 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:39.815 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:39.816 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:39.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install python3-rbd 2022-02-02T13:31:40.015 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:10 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:40.079 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:40.079 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:40.486 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:10 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:40.827 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:40.828 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:40.828 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:40.828 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:40.829 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:40.829 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T13:31:40.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:40.829 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:40.830 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:40.830 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:31:40.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:40.831 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.7 M 2022-02-02T13:31:40.831 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 18 M 2022-02-02T13:31:40.831 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:40.945 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 32 MB/s | 3.7 MB 00:00 2022-02-02T13:31:40.946 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:40.946 INFO:teuthology.orchestra.run.smithi037.stdout:Total 31 MB/s | 3.7 MB 00:00 2022-02-02T13:31:40.947 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:40.959 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:40.960 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:41.028 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:41.031 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:41.307 INFO:teuthology.orchestra.run.smithi033.stdout:Package python3-rbd-2:16.2.4-0.el8.x86_64 is already installed. 2022-02-02T13:31:41.354 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:41.355 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2022-02-02T13:31:41.355 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:41.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-fuse 2022-02-02T13:31:41.548 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:41.617 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:41.617 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:41.713 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:42.018 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:12 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:42.115 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:42.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:42.461 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:42.466 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:42.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2022-02-02T13:31:42.831 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:42.832 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:42.833 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:42.833 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:42.833 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:16.2.4-0.el8 ceph 89 k 2022-02-02T13:31:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:42.834 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:42.834 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:42.834 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:31:42.834 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:42.835 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 89 k 2022-02-02T13:31:42.835 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 298 k 2022-02-02T13:31:42.835 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:42.883 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-fuse-16.2.4-0.el8.x86_64.rpm 1.8 MB/s | 89 kB 00:00 2022-02-02T13:31:42.883 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:42.883 INFO:teuthology.orchestra.run.smithi033.stdout:Total 1.7 MB/s | 89 kB 00:00 2022-02-02T13:31:42.884 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:42.894 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:42.894 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:42.947 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:42.950 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:43.065 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:43.246 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:13 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:43.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:43.567 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:43.918 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:43.919 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:43.919 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:43.919 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:44.088 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2022-02-02T13:31:44.089 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:44.089 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:44.089 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:44.090 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2022-02-02T13:31:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2022-02-02T13:31:44.090 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:44.090 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2022-02-02T13:31:44.091 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2022-02-02T13:31:44.091 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2022-02-02T13:31:44.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:44.091 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 173 k 2022-02-02T13:31:44.092 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 649 k 2022-02-02T13:31:44.092 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2022-02-02T13:31:44.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-mirror 2022-02-02T13:31:44.141 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2022-02-02T13:31:44.141 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:44.142 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.3 MB/s | 173 kB 00:00 2022-02-02T13:31:44.142 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2022-02-02T13:31:44.152 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2022-02-02T13:31:44.153 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2022-02-02T13:31:44.205 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2022-02-02T13:31:44.208 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2022-02-02T13:31:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:44.322 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2022-02-02T13:31:44.483 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:44.707 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:14 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:44.755 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:45.146 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:45.146 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:45.146 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2022-02-02T13:31:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:45.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:31:45.147 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2022-02-02T13:31:45.289 DEBUG:teuthology.parallel:result is None 2022-02-02T13:31:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:45.589 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:45.589 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:45.590 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:16.2.4-0.el8 ceph 3.7 M 2022-02-02T13:31:45.590 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:45.591 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:45.591 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:45.591 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:31:45.591 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:45.592 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 3.7 M 2022-02-02T13:31:45.592 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 18 M 2022-02-02T13:31:45.592 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:45.693 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-mirror-16.2.4-0.el8.x86_64.rpm 36 MB/s | 3.7 MB 00:00 2022-02-02T13:31:45.694 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:45.694 INFO:teuthology.orchestra.run.smithi033.stdout:Total 36 MB/s | 3.7 MB 00:00 2022-02-02T13:31:45.695 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:45.708 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:45.708 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:45.776 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:45.779 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:46.511 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:46.914 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:47.846 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:47.846 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:47.847 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:47.847 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:48.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install rbd-nbd 2022-02-02T13:31:48.222 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:48.223 INFO:teuthology.orchestra.run.smithi033.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-02-02T13:31:48.626 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:02:18 ago on Wed 02 Feb 2022 01:29:30 PM UTC. 2022-02-02T13:31:49.490 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2022-02-02T13:31:49.491 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:49.491 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2022-02-02T13:31:49.492 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:49.492 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2022-02-02T13:31:49.492 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:16.2.4-0.el8 ceph 173 k 2022-02-02T13:31:49.492 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:49.492 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2022-02-02T13:31:49.493 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2022-02-02T13:31:49.493 INFO:teuthology.orchestra.run.smithi033.stdout:Install 1 Package 2022-02-02T13:31:49.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:49.493 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 173 k 2022-02-02T13:31:49.494 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 649 k 2022-02-02T13:31:49.494 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2022-02-02T13:31:49.533 INFO:teuthology.orchestra.run.smithi033.stdout:rbd-nbd-16.2.4-0.el8.x86_64.rpm 4.2 MB/s | 173 kB 00:00 2022-02-02T13:31:49.534 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2022-02-02T13:31:49.534 INFO:teuthology.orchestra.run.smithi033.stdout:Total 4.0 MB/s | 173 kB 00:00 2022-02-02T13:31:49.534 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2022-02-02T13:31:49.546 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2022-02-02T13:31:49.546 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2022-02-02T13:31:49.599 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2022-02-02T13:31:49.602 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2022-02-02T13:31:49.717 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2022-02-02T13:31:49.883 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:50.514 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:16.2.4-0.el8.x86_64 1/1 2022-02-02T13:31:50.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:50.514 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2022-02-02T13:31:50.515 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:16.2.4-0.el8.x86_64 2022-02-02T13:31:50.515 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:31:50.515 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2022-02-02T13:31:50.807 DEBUG:teuthology.parallel:result is None 2022-02-02T13:31:50.807 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2022-02-02T13:31:50.844 INFO:teuthology.orchestra.run.smithi033.stdout:CentOSStream 2022-02-02T13:31:50.845 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:31:50.846 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:31:50.846 INFO:teuthology.packaging:ref: None 2022-02-02T13:31:50.846 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:31:50.847 INFO:teuthology.packaging:branch: None 2022-02-02T13:31:50.847 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:31:50.883 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:31:50.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:31:51.140 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-02-02T13:31:51.163 INFO:teuthology.orchestra.run.smithi033.stdout:16.2.4-0.el8 2022-02-02T13:31:51.164 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2022-02-02T13:31:51.165 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2022-02-02T13:31:51.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo lsb_release -is 2022-02-02T13:31:51.209 INFO:teuthology.orchestra.run.smithi037.stdout:CentOSStream 2022-02-02T13:31:51.211 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-02-02T13:31:51.212 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2022-02-02T13:31:51.212 INFO:teuthology.packaging:ref: None 2022-02-02T13:31:51.213 INFO:teuthology.packaging:tag: v16.2.4 2022-02-02T13:31:51.213 INFO:teuthology.packaging:branch: None 2022-02-02T13:31:51.214 INFO:teuthology.packaging:sha1: b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:31:51.246 DEBUG:teuthology.repo_utils:git ls-remote git://git.ceph.com/ceph-ci v16.2.4^{} -> 3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:31:51.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=3cbe25cde3cfa028984618ad32de9edc4c1eaed0 2022-02-02T13:31:51.480 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-02-02T13:31:51.507 INFO:teuthology.orchestra.run.smithi037.stdout:16.2.4-0.el8 2022-02-02T13:31:51.508 INFO:teuthology.packaging:The installed version of ceph is 16.2.4-0.el8 2022-02-02T13:31:51.508 INFO:teuthology.task.install:The correct ceph version 16.2.4-0 is installed. 2022-02-02T13:31:51.509 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-02-02T13:31:51.509 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:31:51.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-02-02T13:31:51.538 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:31:51.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-02-02T13:31:51.578 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-02-02T13:31:51.578 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:31:51.579 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2022-02-02T13:31:51.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-02-02T13:31:51.679 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:31:51.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2022-02-02T13:31:51.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-02-02T13:31:51.779 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-02-02T13:31:51.780 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:31:51.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2022-02-02T13:31:51.808 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-02-02T13:31:51.875 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:31:51.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2022-02-02T13:31:51.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-02-02T13:31:51.977 INFO:teuthology.run_tasks:Running task print... 2022-02-02T13:31:51.988 INFO:teuthology.task.print:**** done install task... 2022-02-02T13:31:51.989 INFO:teuthology.run_tasks:Running task cephadm... 2022-02-02T13:31:52.123 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b0d76d45e4cb48de326cfbdc43296681162f672c'} 2022-02-02T13:31:52.124 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2022-02-02T13:31:52.125 INFO:tasks.cephadm:Cluster fsid is 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:31:52.125 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2022-02-02T13:31:52.126 INFO:tasks.cephadm:No mon roles; fabricating mons 2022-02-02T13:31:52.126 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi033': '172.21.15.33', 'mon.smithi037': '172.21.15.37'} 2022-02-02T13:31:52.126 INFO:tasks.cephadm:Normalizing hostnames... 2022-02-02T13:31:52.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2022-02-02T13:31:52.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2022-02-02T13:31:52.188 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2022-02-02T13:31:52.189 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.295 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 2 13:31 /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.296 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Feb 2 13:31 /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.397 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.416 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-02-02T13:31:52.453 INFO:tasks.cephadm:Pulling image docker.io/ceph/ceph:v16.2.4 on all hosts... 2022-02-02T13:31:52.454 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 pull 2022-02-02T13:31:52.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 pull 2022-02-02T13:31:54.086 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T13:31:54.424 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T13:32:08.857 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2022-02-02T13:32:08.857 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)", 2022-02-02T13:32:08.857 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", 2022-02-02T13:32:08.858 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2022-02-02T13:32:08.858 INFO:teuthology.orchestra.run.smithi037.stdout: "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", 2022-02-02T13:32:08.858 INFO:teuthology.orchestra.run.smithi037.stdout: "docker.io/ceph/ceph@sha256:70536e31b29a4241999ec4fd13d93e5860a5ffdc5467911e57e6bf04dfe68337" 2022-02-02T13:32:08.858 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2022-02-02T13:32:08.858 INFO:teuthology.orchestra.run.smithi037.stdout:} 2022-02-02T13:32:09.093 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:32:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)", 2022-02-02T13:32:09.093 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", 2022-02-02T13:32:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2022-02-02T13:32:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", 2022-02-02T13:32:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: "docker.io/ceph/ceph@sha256:70536e31b29a4241999ec4fd13d93e5860a5ffdc5467911e57e6bf04dfe68337" 2022-02-02T13:32:09.094 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2022-02-02T13:32:09.095 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:32:09.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2022-02-02T13:32:09.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2022-02-02T13:32:09.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2022-02-02T13:32:09.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2022-02-02T13:32:09.245 INFO:tasks.cephadm:Writing seed config... 2022-02-02T13:32:09.247 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2022-02-02T13:32:09.247 INFO:tasks.cephadm: override: [client] debug client = 20 2022-02-02T13:32:09.251 INFO:tasks.cephadm: override: [client] debug ms = 1 2022-02-02T13:32:09.251 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2022-02-02T13:32:09.251 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2022-02-02T13:32:09.252 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2022-02-02T13:32:09.252 INFO:tasks.cephadm: override: [mds] debug mds = 20 2022-02-02T13:32:09.252 INFO:tasks.cephadm: override: [mds] debug ms = 1 2022-02-02T13:32:09.253 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2022-02-02T13:32:09.253 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2022-02-02T13:32:09.253 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2022-02-02T13:32:09.254 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2022-02-02T13:32:09.254 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2022-02-02T13:32:09.254 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2022-02-02T13:32:09.255 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2022-02-02T13:32:09.255 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2022-02-02T13:32:09.255 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2022-02-02T13:32:09.256 INFO:tasks.cephadm: override: [mon] debug mon = 20 2022-02-02T13:32:09.256 INFO:tasks.cephadm: override: [mon] debug ms = 1 2022-02-02T13:32:09.256 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2022-02-02T13:32:09.257 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2022-02-02T13:32:09.257 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2022-02-02T13:32:09.257 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2022-02-02T13:32:09.258 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2022-02-02T13:32:09.258 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2022-02-02T13:32:09.258 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2022-02-02T13:32:09.258 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2022-02-02T13:32:09.259 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2022-02-02T13:32:09.259 INFO:tasks.cephadm: override: [osd] debug ms = 1 2022-02-02T13:32:09.259 INFO:tasks.cephadm: override: [osd] debug osd = 20 2022-02-02T13:32:09.260 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2022-02-02T13:32:09.260 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2022-02-02T13:32:09.260 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2022-02-02T13:32:09.261 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2022-02-02T13:32:09.261 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2022-02-02T13:32:09.262 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2022-02-02T13:32:09.262 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2022-02-02T13:32:09.263 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:32:09.263 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2022-02-02T13:32:09.286 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7b277774-842c-11ec-8c35-001a4aab830c mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2022-02-02T13:32:09.286 DEBUG:teuthology.orchestra.run.smithi033:mon.smithi033> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service 2022-02-02T13:32:09.328 INFO:tasks.cephadm:Bootstrapping... 2022-02-02T13:32:09.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid 7b277774-842c-11ec-8c35-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.33 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2022-02-02T13:32:09.354 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:-- Logs begin at Wed 2022-02-02 13:23:23 UTC. -- 2022-02-02T13:32:09.527 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T13:32:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 3.4.1-dev 2022-02-02T13:32:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying podman|docker is present... 2022-02-02T13:32:09.669 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T13:32:09.707 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 3.4.1-dev 2022-02-02T13:32:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying lvm2 is present... 2022-02-02T13:32:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying time synchronization is in place... 2022-02-02T13:32:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2022-02-02T13:32:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-02-02T13:32:09.813 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2022-02-02T13:32:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:32:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2022-02-02T13:32:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2022-02-02T13:32:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2022-02-02T13:32:09.831 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2022-02-02T13:32:09.833 INFO:teuthology.orchestra.run.smithi033.stderr:Unit chronyd.service is enabled and running 2022-02-02T13:32:09.833 INFO:teuthology.orchestra.run.smithi033.stderr:Repeating the final host check... 2022-02-02T13:32:09.833 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-02-02T13:32:09.870 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 3.4.1-dev 2022-02-02T13:32:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:podman|docker (/bin/podman) is present 2022-02-02T13:32:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl is present 2022-02-02T13:32:09.971 INFO:teuthology.orchestra.run.smithi033.stderr:lvcreate is present 2022-02-02T13:32:09.972 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2022-02-02T13:32:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-02-02T13:32:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2022-02-02T13:32:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:32:09.982 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2022-02-02T13:32:09.988 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2022-02-02T13:32:09.989 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2022-02-02T13:32:09.994 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2022-02-02T13:32:09.995 INFO:teuthology.orchestra.run.smithi033.stderr:Unit chronyd.service is enabled and running 2022-02-02T13:32:09.995 INFO:teuthology.orchestra.run.smithi033.stderr:Host looks OK 2022-02-02T13:32:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:Cluster fsid: 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:Acquiring lock 139645051754984 on /run/cephadm/7b277774-842c-11ec-8c35-001a4aab830c.lock 2022-02-02T13:32:09.996 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 139645051754984 acquired on /run/cephadm/7b277774-842c-11ec-8c35-001a4aab830c.lock 2022-02-02T13:32:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 3300 ... 2022-02-02T13:32:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 6789 ... 2022-02-02T13:32:09.997 INFO:teuthology.orchestra.run.smithi033.stderr:Base mon IP is 172.21.15.33, final addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2022-02-02T13:32:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip route ls 2022-02-02T13:32:09.998 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2022-02-02T13:32:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2022-02-02T13:32:09.999 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip -6 route ls 2022-02-02T13:32:10.001 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2022-02-02T13:32:10.001 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1785sec hoplimit 64 pref medium 2022-02-02T13:32:10.004 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /sbin/ip -6 addr ls 2022-02-02T13:32:10.004 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2022-02-02T13:32:10.004 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: inet6 ::1/128 scope host 2022-02-02T13:32:10.005 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-02-02T13:32:10.005 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2022-02-02T13:32:10.005 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2022-02-02T13:32:10.005 INFO:teuthology.orchestra.run.smithi033.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-02-02T13:32:10.006 INFO:teuthology.orchestra.run.smithi033.stderr:Mon IP 172.21.15.33 is in CIDR network 172.21.0.0/20 2022-02-02T13:32:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2022-02-02T13:32:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-02-02T13:32:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2022-02-02T13:32:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2022-02-02T13:32:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Getting image source signatures 2022-02-02T13:32:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2022-02-02T13:32:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2022-02-02T13:32:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-02-02T13:32:10.458 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Writing manifest to image destination 2022-02-02T13:32:10.459 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: Storing signatures 2022-02-02T13:32:10.589 INFO:teuthology.orchestra.run.smithi033.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-02-02T13:32:10.653 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2022-02-02T13:32:11.143 INFO:teuthology.orchestra.run.smithi033.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-02-02T13:32:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-02-02T13:32:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:Extracting ceph user uid/gid from container image... 2022-02-02T13:32:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2022-02-02T13:32:11.879 INFO:teuthology.orchestra.run.smithi033.stderr:stat: 167 167 2022-02-02T13:32:12.346 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial keys... 2022-02-02T13:32:12.346 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T13:32:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQDch/phbu2RKRAANxCOcLb9wk1F5i1mEnMAaw== 2022-02-02T13:32:13.192 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T13:32:13.599 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQDdh/phpsrNIhAAZ0fhtv8ijaQ7tdmAFxPuTA== 2022-02-02T13:32:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-02-02T13:32:14.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQDeh/phsgGsExAAFRD93VTS9OWn+WoUgw2Yvw== 2022-02-02T13:32:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial monmap... 2022-02-02T13:32:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmp9us0cifj:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid 7b277774-842c-11ec-8c35-001a4aab830c --addv smithi033 [v2:172.21.15.33:3300,v1:172.21.15.33:6789] /tmp/monmap 2022-02-02T13:32:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2022-02-02T13:32:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:15.094 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-02-02T13:32:15.422 INFO:teuthology.orchestra.run.smithi033.stderr:monmaptool for smithi033 [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2022-02-02T13:32:15.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: set fsid to 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:15.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-02-02T13:32:15.423 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:32:15.423 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mon... 2022-02-02T13:32:15.423 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z -v /tmp/ceph-tmpzi2a6txw:/tmp/keyring:z -v /tmp/ceph-tmp9us0cifj:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi033 --fsid 7b277774-842c-11ec-8c35-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2022-02-02T13:32:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.788+0000 7f68f066e700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T13:32:15.830 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.789+0000 7f68f066e700 1 imported monmap: 2022-02-02T13:32:15.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: epoch 0 2022-02-02T13:32:15.831 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: last_changed 2022-02-02T13:32:15.083743+0000 2022-02-02T13:32:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: created 2022-02-02T13:32:15.083743+0000 2022-02-02T13:32:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2022-02-02T13:32:15.832 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: election_strategy: 1 2022-02-02T13:32:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.smithi033 2022-02-02T13:32:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.789+0000 7f68f066e700 0 /usr/bin/ceph-mon: set fsid to 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:15.833 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T13:32:15.834 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.834 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T13:32:15.834 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Compile date May 13 2021 2022-02-02T13:32:15.835 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: DB SUMMARY 2022-02-02T13:32:15.835 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.835 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 0, files: 2022-02-02T13:32:15.837 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.837 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 2022-02-02T13:32:15.837 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.838 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T13:32:15.838 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.create_if_missing: 1 2022-02-02T13:32:15.838 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T13:32:15.838 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.env: 0x561b30b8d1c0 2022-02-02T13:32:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.fs: Posix File System 2022-02-02T13:32:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.info_log: 0x561b31738ec0 2022-02-02T13:32:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T13:32:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.statistics: (nil) 2022-02-02T13:32:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.use_fsync: 0 2022-02-02T13:32:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T13:32:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T13:32:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T13:32:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T13:32:15.841 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T13:32:15.841 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T13:32:15.841 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T13:32:15.841 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T13:32:15.841 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T13:32:15.842 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T13:32:15.842 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T13:32:15.842 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.db_log_dir: 2022-02-02T13:32:15.843 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2022-02-02T13:32:15.843 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T13:32:15.844 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T13:32:15.844 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T13:32:15.845 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T13:32:15.845 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T13:32:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T13:32:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T13:32:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T13:32:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T13:32:15.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T13:32:15.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.write_buffer_manager: 0x561b3173f530 2022-02-02T13:32:15.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T13:32:15.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T13:32:15.850 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T13:32:15.850 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T13:32:15.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T13:32:15.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T13:32:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T13:32:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T13:32:15.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T13:32:15.854 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.unordered_write: 0 2022-02-02T13:32:15.854 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T13:32:15.854 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T13:32:15.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T13:32:15.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T13:32:15.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.row_cache: None 2022-02-02T13:32:15.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.wal_filter: None 2022-02-02T13:32:15.855 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T13:32:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T13:32:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T13:32:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T13:32:15.856 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T13:32:15.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T13:32:15.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T13:32:15.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T13:32:15.857 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T13:32:15.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T13:32:15.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T13:32:15.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T13:32:15.858 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T13:32:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T13:32:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T13:32:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T13:32:15.859 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T13:32:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T13:32:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T13:32:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T13:32:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T13:32:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.max_open_files: -1 2022-02-02T13:32:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T13:32:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T13:32:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T13:32:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T13:32:15.862 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Compression algorithms supported: 2022-02-02T13:32:15.862 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T13:32:15.862 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kZSTD supported: 0 2022-02-02T13:32:15.863 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T13:32:15.863 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T13:32:15.863 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T13:32:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T13:32:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T13:32:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T13:32:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T13:32:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.790+0000 7f68f066e700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2022-02-02T13:32:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000001 2022-02-02T13:32:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T13:32:15.866 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.866 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T13:32:15.866 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.merge_operator: 2022-02-02T13:32:15.866 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_filter: None 2022-02-02T13:32:15.867 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T13:32:15.867 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T13:32:15.867 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T13:32:15.867 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561b31650120) 2022-02-02T13:32:15.868 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2022-02-02T13:32:15.868 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T13:32:15.868 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T13:32:15.868 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2022-02-02T13:32:15.869 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_type: 0 2022-02-02T13:32:15.869 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2022-02-02T13:32:15.869 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_shortening: 1 2022-02-02T13:32:15.869 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2022-02-02T13:32:15.869 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2022-02-02T13:32:15.870 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: checksum: 1 2022-02-02T13:32:15.870 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2022-02-02T13:32:15.870 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache: 0x561b31686d10 2022-02-02T13:32:15.870 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2022-02-02T13:32:15.871 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_options: 2022-02-02T13:32:15.871 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: capacity : 536870912 2022-02-02T13:32:15.871 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2022-02-02T13:32:15.871 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2022-02-02T13:32:15.871 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2022-02-02T13:32:15.872 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2022-02-02T13:32:15.872 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2022-02-02T13:32:15.872 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size: 4096 2022-02-02T13:32:15.872 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2022-02-02T13:32:15.873 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2022-02-02T13:32:15.873 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2022-02-02T13:32:15.873 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2022-02-02T13:32:15.873 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: partition_filters: 0 2022-02-02T13:32:15.873 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2022-02-02T13:32:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T13:32:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2022-02-02T13:32:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: verify_compression: 0 2022-02-02T13:32:15.874 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2022-02-02T13:32:15.875 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: format_version: 2 2022-02-02T13:32:15.875 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2022-02-02T13:32:15.875 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_align: 0 2022-02-02T13:32:15.875 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.875 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T13:32:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T13:32:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression: NoCompression 2022-02-02T13:32:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T13:32:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T13:32:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T13:32:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.num_levels: 7 2022-02-02T13:32:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T13:32:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T13:32:15.877 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T13:32:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T13:32:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T13:32:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T13:32:15.878 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T13:32:15.879 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:32:15.879 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T13:32:15.879 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T13:32:15.879 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T13:32:15.879 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T13:32:15.880 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T13:32:15.880 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:32:15.880 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T13:32:15.880 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T13:32:15.881 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T13:32:15.881 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T13:32:15.881 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T13:32:15.881 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T13:32:15.881 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T13:32:15.882 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T13:32:15.882 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T13:32:15.882 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T13:32:15.882 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T13:32:15.882 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T13:32:15.883 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T13:32:15.883 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T13:32:15.883 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T13:32:15.883 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T13:32:15.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T13:32:15.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T13:32:15.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T13:32:15.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T13:32:15.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T13:32:15.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T13:32:15.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T13:32:15.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T13:32:15.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T13:32:15.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T13:32:15.886 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T13:32:15.886 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T13:32:15.886 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T13:32:15.886 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T13:32:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T13:32:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T13:32:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T13:32:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T13:32:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T13:32:15.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T13:32:15.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T13:32:15.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T13:32:15.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T13:32:15.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T13:32:15.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T13:32:15.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T13:32:15.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T13:32:15.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T13:32:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T13:32:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.ttl: 2592000 2022-02-02T13:32:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T13:32:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T13:32:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.791+0000 7f68f066e700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-02-02T13:32:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.793+0000 7f68f066e700 4 rocksdb: DB pointer 0x561b3174b800 2022-02-02T13:32:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.793+0000 7f68d9507700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T13:32:15.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.793+0000 7f68d9507700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T13:32:15.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2022-02-02T13:32:15.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:15.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T13:32:15.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T13:32:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:32:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T13:32:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T13:32:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:32:15.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T13:32:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:15.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:32:15.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:32:15.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T13:32:15.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:15.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:15.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:15.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:15.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:15.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:32:15.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:32:15.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:32:15.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:15.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:15.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:32:15.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:32:15.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T13:32:15.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:15.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:15.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:32:15.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:32:15.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-02-02T13:32:15.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:15.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:15.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:15.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:15.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:15.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:32:15.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:32:15.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:32:15.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:15.902 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:15.902 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:32:15.902 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.902 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:32:15.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2022-02-02T13:32:15.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.795+0000 7f68f066e700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2022-02-02T13:32:15.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.795+0000 7f68f066e700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2022-02-02T13:32:15.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2022-02-02T13:32:15.795+0000 7f68f066e700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi033 for mon.smithi033 2022-02-02T13:32:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:create mon.smithi033 on 2022-02-02T13:32:16.168 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:16.173 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl disable ceph.target 2022-02-02T13:32:16.180 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2022-02-02T13:32:16.268 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph.target 2022-02-02T13:32:16.276 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2022-02-02T13:32:16.359 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph.target 2022-02-02T13:32:16.366 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7b277774-842c-11ec-8c35-001a4aab830c.target 2022-02-02T13:32:16.371 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target. 2022-02-02T13:32:16.372 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target. 2022-02-02T13:32:16.456 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c.target 2022-02-02T13:32:16.468 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2022-02-02T13:32:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033 2022-02-02T13:32:16.575 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033 2022-02-02T13:32:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service: Unit ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service not loaded. 2022-02-02T13:32:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033 2022-02-02T13:32:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target.wants/ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service → /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c@.service. 2022-02-02T13:32:16.673 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033 2022-02-02T13:32:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:16 smithi033 systemd[1]: Starting Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:32:17.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:16 smithi033 podman[31267]: 2022-02-02T13:32:17.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:17 smithi033 bash[31189]: 9cd8d7000d770f283f65c24718d47a4ec282b2fcc12818eb1c36142ae3166136 2022-02-02T13:32:17.160 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:17 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.154799+0000 mon.smithi033 (mon.0) 0 : [INF] mkfs 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:17.160 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:17 smithi033 conmon[31306]: cluster 2022-02-02T13 2022-02-02T13:32:17.160 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:17 smithi033 conmon[31306]: :32:17.149431+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2022-02-02T13:32:17.206 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T13:32:17.214 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2022-02-02T13:32:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T13:32:17.221 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:32:17.222 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2022-02-02T13:32:17.223 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2022-02-02T13:32:17.223 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-02-02T13:32:17.224 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon to start... 2022-02-02T13:32:17.224 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon... 2022-02-02T13:32:17.224 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2022-02-02T13:32:17.449 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:17 smithi033 systemd[1]: Started Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:32:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2cdc8700 1 Processor -- start 2022-02-02T13:32:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2cdc8700 1 -- start start 2022-02-02T13:32:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2cdc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2cdc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280fb390 con 0x7f2c280faa80 2022-02-02T13:32:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55394/0 (socket says 172.21.15.33:55394) 2022-02-02T13:32:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.714+0000 7f2c2659c700 1 -- 172.21.15.33:0/2408097056 learned_addr learned my addr 172.21.15.33:0/2408097056 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.715+0000 7f2c2659c700 1 -- 172.21.15.33:0/2408097056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280fb4d0 con 0x7f2c280faa80 2022-02-02T13:32:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.715+0000 7f2c2659c700 1 --2- 172.21.15.33:0/2408097056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2c1800b870 tx=0x7f2c18006f70).ready entity=mon.0 client_cookie=28ddec025fec2d71 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.715+0000 7f2c2559a700 1 -- 172.21.15.33:0/2408097056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c1800da20 con 0x7f2c280faa80 2022-02-02T13:32:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.715+0000 7f2c2559a700 1 -- 172.21.15.33:0/2408097056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1800db80 con 0x7f2c280faa80 2022-02-02T13:32:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.715+0000 7f2c2559a700 1 -- 172.21.15.33:0/2408097056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c1800de50 con 0x7f2c280faa80 2022-02-02T13:32:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/2408097056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 msgr2=0x7f2c280faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 --2- 172.21.15.33:0/2408097056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f2c1800b870 tx=0x7f2c18006f70).stop 2022-02-02T13:32:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/2408097056 shutdown_connections 2022-02-02T13:32:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 --2- 172.21.15.33:0/2408097056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c280faea0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/2408097056 >> 172.21.15.33:0/2408097056 conn(0x7f2c280f6260 msgr2=0x7f2c280f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/2408097056 shutdown_connections 2022-02-02T13:32:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/2408097056 wait complete. 2022-02-02T13:32:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.716+0000 7f2c2cdc8700 1 Processor -- start 2022-02-02T13:32:17.725 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2cdc8700 1 -- start start 2022-02-02T13:32:17.725 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2cdc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:17.725 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2cdc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2810c810 con 0x7f2c280faa80 2022-02-02T13:32:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55396/0 (socket says 172.21.15.33:55396) 2022-02-02T13:32:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2659c700 1 -- 172.21.15.33:0/1163315823 learned_addr learned my addr 172.21.15.33:0/1163315823 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2659c700 1 -- 172.21.15.33:0/1163315823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1800b480 con 0x7f2c280faa80 2022-02-02T13:32:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.717+0000 7f2c2659c700 1 --2- 172.21.15.33:0/1163315823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2c18006c70 tx=0x7f2c18006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c18019450 con 0x7f2c280faa80 2022-02-02T13:32:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c180195b0 con 0x7f2c280faa80 2022-02-02T13:32:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2810ca10 con 0x7f2c280faa80 2022-02-02T13:32:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2c18019880 con 0x7f2c280faa80 2022-02-02T13:32:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2810cea0 con 0x7f2c280faa80 2022-02-02T13:32:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f2c1802a070 con 0x7f2c280faa80 2022-02-02T13:32:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.718+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2c18023640 con 0x7f2c280faa80 2022-02-02T13:32:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.719+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28045ad0 con 0x7f2c280faa80 2022-02-02T13:32:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.721+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f2c180429c0 con 0x7f2c280faa80 2022-02-02T13:32:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.845+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f2c280fbdc0 con 0x7f2c280faa80 2022-02-02T13:32:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.845+0000 7f2c1effd700 1 -- 172.21.15.33:0/1163315823 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f2c18031070 con 0x7f2c280faa80 2022-02-02T13:32:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: cluster: 2022-02-02T13:32:17.848 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: id: 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: health: HEALTH_OK 2022-02-02T13:32:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: services: 2022-02-02T13:32:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi033 (age 0.693292s) 2022-02-02T13:32:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr: no daemons active 2022-02-02T13:32:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2022-02-02T13:32:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: data: 2022-02-02T13:32:17.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2022-02-02T13:32:17.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2022-02-02T13:32:17.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2022-02-02T13:32:17.851 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pgs: 2022-02-02T13:32:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.846+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 msgr2=0x7f2c2810c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.846+0000 7f2c2cdc8700 1 --2- 172.21.15.33:0/1163315823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f2c18006c70 tx=0x7f2c18006f70).stop 2022-02-02T13:32:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.846+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 shutdown_connections 2022-02-02T13:32:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.846+0000 7f2c2cdc8700 1 --2- 172.21.15.33:0/1163315823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c280faa80 0x7f2c2810c320 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.846+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 >> 172.21.15.33:0/1163315823 conn(0x7f2c280f6260 msgr2=0x7f2c280f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.847+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 shutdown_connections 2022-02-02T13:32:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:17.847+0000 7f2c2cdc8700 1 -- 172.21.15.33:0/1163315823 wait complete. 2022-02-02T13:32:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:mon is available 2022-02-02T13:32:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:Assimilating anything we can from ceph.conf... 2022-02-02T13:32:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi033/config 2022-02-02T13:32:18.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.153403+0000 mon.smithi033 (mon.0) 2 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2022-02-02T13:32:18.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.153807+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2022-02-02T13:32:18.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.156613+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] fsmap 2022-02-02T13:32:18.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.159545+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-02-02T13:32:18.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: cluster 2022-02-02T13:32:17.159943+0000 mon.smithi033 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2022-02-02T13:32:18.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: audit 2022-02-02T13:32:17.846664+0000 mon.smithi033 (mon.0) 7 2022-02-02T13:32:18.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:18 smithi033 conmon[31306]: : audit [DBG] from='client.? 172.21.15.33:0/1163315823' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2022-02-02T13:32:18.766 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.758+0000 7f00424ee700 1 Processor -- start 2022-02-02T13:32:18.767 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.758+0000 7f00424ee700 1 -- start start 2022-02-02T13:32:18.767 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.758+0000 7f00424ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:18.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.758+0000 7f00424ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0fc4a0 con 0x7f003c06fb40 2022-02-02T13:32:18.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f00414ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:18.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f00414ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55398/0 (socket says 172.21.15.33:55398) 2022-02-02T13:32:18.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f00414ec700 1 -- 172.21.15.33:0/1356491942 learned_addr learned my addr 172.21.15.33:0/1356491942 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:18.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f00414ec700 1 -- 172.21.15.33:0/1356491942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c100fa0 con 0x7f003c06fb40 2022-02-02T13:32:18.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f00414ec700 1 --2- 172.21.15.33:0/1356491942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f002c00b5f0 tx=0x7f002c006ee0).ready entity=mon.0 client_cookie=c5c26e5ca8b09794 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:18.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f002bfff700 1 -- 172.21.15.33:0/1356491942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f002c00d600 con 0x7f003c06fb40 2022-02-02T13:32:18.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f002bfff700 1 -- 172.21.15.33:0/1356491942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00d760 con 0x7f003c06fb40 2022-02-02T13:32:18.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.759+0000 7f002bfff700 1 -- 172.21.15.33:0/1356491942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f002c00da30 con 0x7f003c06fb40 2022-02-02T13:32:18.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 -- 172.21.15.33:0/1356491942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 msgr2=0x7f003c100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:18.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 --2- 172.21.15.33:0/1356491942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f002c00b5f0 tx=0x7f002c006ee0).stop 2022-02-02T13:32:18.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 -- 172.21.15.33:0/1356491942 shutdown_connections 2022-02-02T13:32:18.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 --2- 172.21.15.33:0/1356491942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c100ab0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:18.774 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 -- 172.21.15.33:0/1356491942 >> 172.21.15.33:0/1356491942 conn(0x7f003c0f6110 msgr2=0x7f003c0f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:18.774 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 -- 172.21.15.33:0/1356491942 shutdown_connections 2022-02-02T13:32:18.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.760+0000 7f00424ee700 1 -- 172.21.15.33:0/1356491942 wait complete. 2022-02-02T13:32:18.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00424ee700 1 Processor -- start 2022-02-02T13:32:18.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00424ee700 1 -- start start 2022-02-02T13:32:18.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00424ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:18.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00424ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c10c6d0 con 0x7f003c06fb40 2022-02-02T13:32:18.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00414ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:18.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00414ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55400/0 (socket says 172.21.15.33:55400) 2022-02-02T13:32:18.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.761+0000 7f00414ec700 1 -- 172.21.15.33:0/2339529731 learned_addr learned my addr 172.21.15.33:0/2339529731 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:18.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f00414ec700 1 -- 172.21.15.33:0/2339529731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c00b200 con 0x7f003c06fb40 2022-02-02T13:32:18.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f00414ec700 1 --2- 172.21.15.33:0/2339529731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f002c006c70 tx=0x7f002c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:18.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f002c011b40 con 0x7f003c06fb40 2022-02-02T13:32:18.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c011ca0 con 0x7f003c06fb40 2022-02-02T13:32:18.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c10c8d0 con 0x7f003c06fb40 2022-02-02T13:32:18.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f002c01d430 con 0x7f003c06fb40 2022-02-02T13:32:18.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.762+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c10cd60 con 0x7f003c06fb40 2022-02-02T13:32:18.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.763+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f002c00f070 con 0x7f003c06fb40 2022-02-02T13:32:18.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.763+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f002c01dbc0 con 0x7f003c06fb40 2022-02-02T13:32:18.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.764+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c045ad0 con 0x7f003c06fb40 2022-02-02T13:32:18.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.766+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f002c016070 con 0x7f003c06fb40 2022-02-02T13:32:18.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.886+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f003c101190 con 0x7f003c06fb40 2022-02-02T13:32:18.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.889+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f002c01d590 con 0x7f003c06fb40 2022-02-02T13:32:18.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.889+0000 7f0029ffb700 1 -- 172.21.15.33:0/2339529731 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+489 (secure 0 0 0) 0x7f002c036020 con 0x7f003c06fb40 2022-02-02T13:32:18.891 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [global] 2022-02-02T13:32:18.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: fsid = 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:18.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: log_to_journald = false 2022-02-02T13:32:18.892 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2022-02-02T13:32:18.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2022-02-02T13:32:18.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2022-02-02T13:32:18.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2022-02-02T13:32:18.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2022-02-02T13:32:18.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [mgr] 2022-02-02T13:32:18.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2022-02-02T13:32:18.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [osd] 2022-02-02T13:32:18.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2022-02-02T13:32:18.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2022-02-02T13:32:18.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2022-02-02T13:32:18.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2022-02-02T13:32:18.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2022-02-02T13:32:18.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2022-02-02T13:32:18.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 msgr2=0x7f003c10c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:18.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 --2- 172.21.15.33:0/2339529731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f002c006c70 tx=0x7f002c016000).stop 2022-02-02T13:32:18.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 shutdown_connections 2022-02-02T13:32:18.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 --2- 172.21.15.33:0/2339529731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c06fb40 0x7f003c10c1e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:18.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 >> 172.21.15.33:0/2339529731 conn(0x7f003c0f6110 msgr2=0x7f003c0f7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:18.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 shutdown_connections 2022-02-02T13:32:18.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:18.891+0000 7f00424ee700 1 -- 172.21.15.33:0/2339529731 wait complete. 2022-02-02T13:32:19.301 INFO:teuthology.orchestra.run.smithi033.stderr:Generating new minimal ceph.conf... 2022-02-02T13:32:19.302 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033:/var/lib/ceph/mon/ceph-smithi033:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi033/config 2022-02-02T13:32:19.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:19 smithi033 conmon[31306]: audit 2022-02-02T13:32:18.887038+0000 mon.smithi033 (mon.0) 8 : audit [INF] from='client.? 172.21.15.33:0/2339529731' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-02-02T13:32:19.457 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:19 smithi033 conmon[31306]: audit 2022-02-02T13:32:18.890221+0000 mon.smithi033 (mon.0) 9 : audit [INF] from='client.? 172.21.15.33:0/2339529731' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-02-02T13:32:19.794 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.793+0000 7f1178ad5700 1 Processor -- start 2022-02-02T13:32:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.793+0000 7f1178ad5700 1 -- start start 2022-02-02T13:32:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f1178ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f1178ad5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740fecd0 con 0x7f117406fbc0 2022-02-02T13:32:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f117259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f117259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55402/0 (socket says 172.21.15.33:55402) 2022-02-02T13:32:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f117259c700 1 -- 172.21.15.33:0/3963835926 learned_addr learned my addr 172.21.15.33:0/3963835926 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f117259c700 1 -- 172.21.15.33:0/3963835926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740fee10 con 0x7f117406fbc0 2022-02-02T13:32:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.794+0000 7f117259c700 1 --2- 172.21.15.33:0/3963835926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f115c00b5f0 tx=0x7f115c006ee0).ready entity=mon.0 client_cookie=eae870205894cdfd server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f117159a700 1 -- 172.21.15.33:0/3963835926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f115c00d600 con 0x7f117406fbc0 2022-02-02T13:32:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f117159a700 1 -- 172.21.15.33:0/3963835926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f115c00dbb0 con 0x7f117406fbc0 2022-02-02T13:32:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f117159a700 1 -- 172.21.15.33:0/3963835926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f115c011bb0 con 0x7f117406fbc0 2022-02-02T13:32:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f1178ad5700 1 -- 172.21.15.33:0/3963835926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 msgr2=0x7f11740fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f1178ad5700 1 --2- 172.21.15.33:0/3963835926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f115c00b5f0 tx=0x7f115c006ee0).stop 2022-02-02T13:32:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f1178ad5700 1 -- 172.21.15.33:0/3963835926 shutdown_connections 2022-02-02T13:32:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f1178ad5700 1 --2- 172.21.15.33:0/3963835926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fe7e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.795+0000 7f1178ad5700 1 -- 172.21.15.33:0/3963835926 >> 172.21.15.33:0/3963835926 conn(0x7f11740f6260 msgr2=0x7f11740f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 -- 172.21.15.33:0/3963835926 shutdown_connections 2022-02-02T13:32:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 -- 172.21.15.33:0/3963835926 wait complete. 2022-02-02T13:32:19.802 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 Processor -- start 2022-02-02T13:32:19.802 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 -- start start 2022-02-02T13:32:19.802 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f1178ad5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11740fa6e0 con 0x7f117406fbc0 2022-02-02T13:32:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.796+0000 7f117259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f117259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55404/0 (socket says 172.21.15.33:55404) 2022-02-02T13:32:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f117259c700 1 -- 172.21.15.33:0/668569285 learned_addr learned my addr 172.21.15.33:0/668569285 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f117259c700 1 -- 172.21.15.33:0/668569285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c00b200 con 0x7f117406fbc0 2022-02-02T13:32:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f117259c700 1 --2- 172.21.15.33:0/668569285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f115c00db50 tx=0x7f115c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f115c01b570 con 0x7f117406fbc0 2022-02-02T13:32:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f115c01bb20 con 0x7f117406fbc0 2022-02-02T13:32:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11740fa880 con 0x7f117406fbc0 2022-02-02T13:32:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f115c01a850 con 0x7f117406fbc0 2022-02-02T13:32:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11740fad10 con 0x7f117406fbc0 2022-02-02T13:32:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.797+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f115c00f070 con 0x7f117406fbc0 2022-02-02T13:32:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.798+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f115c025bb0 con 0x7f117406fbc0 2022-02-02T13:32:19.806 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.799+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174045ad0 con 0x7f117406fbc0 2022-02-02T13:32:19.806 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.801+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f115c016070 con 0x7f117406fbc0 2022-02-02T13:32:19.920 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.921+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f1174104800 con 0x7f117406fbc0 2022-02-02T13:32:19.921 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.921+0000 7f116affd700 1 -- 172.21.15.33:0/668569285 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f115c025dc0 con 0x7f117406fbc0 2022-02-02T13:32:19.922 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 msgr2=0x7f11740fc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:19.922 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 --2- 172.21.15.33:0/668569285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f115c00db50 tx=0x7f115c006ee0).stop 2022-02-02T13:32:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 shutdown_connections 2022-02-02T13:32:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 --2- 172.21.15.33:0/668569285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f117406fbc0 0x7f11740fc260 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 >> 172.21.15.33:0/668569285 conn(0x7f11740f6260 msgr2=0x7f11740f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.922+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 shutdown_connections 2022-02-02T13:32:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:19.923+0000 7f1178ad5700 1 -- 172.21.15.33:0/668569285 wait complete. 2022-02-02T13:32:20.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:20 smithi033 conmon[31306]: audit 2022-02-02T13:32:19.922493+0000 mon.smithi033 2022-02-02T13:32:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:20 smithi033 conmon[31306]: (mon.0) 10 : audit [DBG] from='client.? 172.21.15.33:0/668569285' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:32:20.741 INFO:teuthology.orchestra.run.smithi033.stderr:Restarting the monitor... 2022-02-02T13:32:20.742 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl restart ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033 2022-02-02T13:32:21.163 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:20 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:32:21.163 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:20 smithi033 conmon[31306]: debug 2022-02-02T13:32:20.870+0000 7f46b1599700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T13:32:21.163 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:20 smithi033 conmon[31306]: debug 2022-02-02T13:32:20.870+0000 7f46b1599700 -1 mon.smithi033@0(leader) e1 *** Got Signal Terminated *** 2022-02-02T13:32:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 podman[31785]: ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon.smithi033 2022-02-02T13:32:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service: Succeeded. 2022-02-02T13:32:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:32:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 systemd[1]: Starting Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:32:21.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 podman[31957]: 2022-02-02T13:32:21.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.722+0000 7f1ef5356700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T13:32:21.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.722+0000 7f1ef5356700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-02-02T13:32:21.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.722+0000 7f1ef5356700 0 pidfile_write: ignore empty --pid-file 2022-02-02T13:32:21.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 bash[31879]: 3b0c5dd3211a40b902f0a98381b050ddc5ab552e3e6ab8d47fe215afc1a9bbdf 2022-02-02T13:32:21.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 0 load: jerasure load: lrc load: isa 2022-02-02T13:32:21.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T13:32:21.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T13:32:21.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Compile date May 13 2021 2022-02-02T13:32:21.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: DB SUMMARY 2022-02-02T13:32:21.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: CURRENT file: CURRENT 2022-02-02T13:32:21.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: IDENTITY file: IDENTITY 2022-02-02T13:32:21.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2022-02-02T13:32:21.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000004.sst 2022-02-02T13:32:21.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000006.log size: 97373 ; 2022-02-02T13:32:21.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T13:32:21.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.create_if_missing: 0 2022-02-02T13:32:21.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T13:32:21.787 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.env: 0x55ff07f5c1c0 2022-02-02T13:32:21.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.fs: Posix File System 2022-02-02T13:32:21.788 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.info_log: 0x55ff09765960 2022-02-02T13:32:21.789 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T13:32:21.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.statistics: (nil) 2022-02-02T13:32:21.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.use_fsync: 0 2022-02-02T13:32:21.790 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T13:32:21.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T13:32:21.791 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T13:32:21.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T13:32:21.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T13:32:21.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T13:32:21.793 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T13:32:21.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T13:32:21.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.794 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T13:32:21.795 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T13:32:21.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T13:32:21.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.db_log_dir: 2022-02-02T13:32:21.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2022-02-02T13:32:21.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T13:32:21.798 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T13:32:21.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T13:32:21.799 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T13:32:21.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T13:32:21.800 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T13:32:21.801 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T13:32:21.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T13:32:21.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T13:32:21.802 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T13:32:21.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.write_buffer_manager: 0x55ff0a3da030 2022-02-02T13:32:21.803 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T13:32:21.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T13:32:21.804 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T13:32:21.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T13:32:21.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T13:32:21.805 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T13:32:21.806 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T13:32:21.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T13:32:21.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T13:32:21.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.unordered_write: 0 2022-02-02T13:32:21.808 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T13:32:21.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T13:32:21.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.810 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T13:32:21.810 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T13:32:21.811 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.row_cache: None 2022-02-02T13:32:21.811 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.wal_filter: None 2022-02-02T13:32:21.812 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T13:32:21.812 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T13:32:21.813 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T13:32:21.813 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T13:32:21.813 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.814 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T13:32:21.814 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T13:32:21.815 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T13:32:21.815 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T13:32:21.816 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T13:32:21.816 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T13:32:21.817 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T13:32:21.818 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.818 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T13:32:21.819 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T13:32:21.819 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T13:32:21.820 INFO:teuthology.orchestra.run.smithi033.stderr:Setting mon public_network to 172.21.0.0/20 2022-02-02T13:32:21.821 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.727+0000 7f1ef5356700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T13:32:21.822 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T13:32:21.822 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T13:32:21.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T13:32:21.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T13:32:21.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.824 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T13:32:21.824 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T13:32:21.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_open_files: -1 2022-02-02T13:32:21.825 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T13:32:21.826 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T13:32:21.826 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T13:32:21.826 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T13:32:21.827 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Compression algorithms supported: 2022-02-02T13:32:21.828 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.828 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T13:32:21.829 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kZSTD supported: 0 2022-02-02T13:32:21.830 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T13:32:21.830 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T13:32:21.830 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T13:32:21.831 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T13:32:21.831 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T13:32:21.832 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T13:32:21.832 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T13:32:21.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000005 2022-02-02T13:32:21.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T13:32:21.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T13:32:21.836 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2022-02-02T13:32:21.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.merge_operator: 2022-02-02T13:32:21.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_filter: None 2022-02-02T13:32:21.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T13:32:21.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T13:32:21.841 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T13:32:21.841 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.842 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff0967c128) 2022-02-02T13:32:21.842 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cache_index_and_filter_blocks: 1 2022-02-02T13:32:21.843 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T13:32:21.843 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T13:32:21.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: pin_top_level_index_and_filter: 1 2022-02-02T13:32:21.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: index_type: 0 2022-02-02T13:32:21.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: data_block_index_type: 0 2022-02-02T13:32:21.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: index_shortening: 1 2022-02-02T13:32:21.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: data_block_hash_table_util_ratio: 0.750000 2022-02-02T13:32:21.846 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: hash_index_allow_collision: 1 2022-02-02T13:32:21.846 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: checksum: 1 2022-02-02T13:32:21.847 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: no_block_cache: 0 2022-02-02T13:32:21.847 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_cache: 0x55ff096b2f10 2022-02-02T13:32:21.848 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_cache_name: BinnedLRUCache 2022-02-02T13:32:21.848 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_cache_options: 2022-02-02T13:32:21.849 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: capacity : 536870912 2022-02-02T13:32:21.850 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: num_shard_bits : 4 2022-02-02T13:32:21.850 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: strict_capacity_limit : 0 2022-02-02T13:32:21.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: high_pri_pool_ratio: 0.000 2022-02-02T13:32:21.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_cache_compressed: (nil) 2022-02-02T13:32:21.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: persistent_cache: (nil) 2022-02-02T13:32:21.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_size: 4096 2022-02-02T13:32:21.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_size_deviation: 10 2022-02-02T13:32:21.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_restart_interval: 16 2022-02-02T13:32:21.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: index_block_restart_interval: 1 2022-02-02T13:32:21.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: metadata_block_size: 4096 2022-02-02T13:32:21.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: partition_filters: 0 2022-02-02T13:32:21.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: use_delta_encoding: 1 2022-02-02T13:32:21.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T13:32:21.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: whole_key_filtering: 1 2022-02-02T13:32:21.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: verify_compression: 0 2022-02-02T13:32:21.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: read_amp_bytes_per_bit: 0 2022-02-02T13:32:21.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: format_version: 2 2022-02-02T13:32:21.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: enable_index_compression: 1 2022-02-02T13:32:21.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: block_align: 0 2022-02-02T13:32:21.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T13:32:21.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T13:32:21.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression: NoCompression 2022-02-02T13:32:21.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T13:32:21.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T13:32:21.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T13:32:21.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.num_levels: 7 2022-02-02T13:32:21.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T13:32:21.857 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T13:32:21.857 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T13:32:21.857 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T13:32:21.858 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T13:32:21.858 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T13:32:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T13:32:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:32:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T13:32:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T13:32:21.859 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T13:32:21.860 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T13:32:21.860 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T13:32:21.860 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:32:21.860 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T13:32:21.861 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T13:32:21.861 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T13:32:21.861 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T13:32:21.862 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T13:32:21.862 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T13:32:21.862 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T13:32:21.862 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T13:32:21.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T13:32:21.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T13:32:21.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T13:32:21.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T13:32:21.864 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T13:32:21.864 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T13:32:21.864 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T13:32:21.864 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T13:32:21.864 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T13:32:21.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T13:32:21.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T13:32:21.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T13:32:21.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T13:32:21.866 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.866 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T13:32:21.866 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T13:32:21.866 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T13:32:21.866 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T13:32:21.867 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T13:32:21.867 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T13:32:21.867 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T13:32:21.867 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T13:32:21.868 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T13:32:21.868 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T13:32:21.868 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T13:32:21.868 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T13:32:21.868 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T13:32:21.869 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T13:32:21.869 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T13:32:21.869 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T13:32:21.869 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T13:32:21.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T13:32:21.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T13:32:21.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T13:32:21.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T13:32:21.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T13:32:21.871 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T13:32:21.871 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T13:32:21.871 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.ttl: 2592000 2022-02-02T13:32:21.872 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.728+0000 7f1ef5356700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T13:32:21.872 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.729+0000 7f1ef5356700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T13:32:21.872 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.872 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.729+0000 7f1ef5356700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2022-02-02T13:32:21.872 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.873 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.729+0000 7f1ef5356700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808741730022, "job": 1, "event": "recovery_started", "log_files": [6]} 2022-02-02T13:32:21.873 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.873 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.729+0000 7f1ef5356700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2022-02-02T13:32:21.873 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.729+0000 7f1ef5356700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T13:32:21.874 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.730+0000 7f1ef5356700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808741731408, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 93043, "table_properties": {"data_size": 91143, "index_size": 377, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12317, "raw_average_key_size": 49, "raw_value_size": 84299, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 250, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643808741, "oldest_key_time": 3, "file_creation_time": 0}} 2022-02-02T13:32:21.874 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.730+0000 7f1ef5356700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2022-02-02T13:32:21.874 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.874 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.731+0000 7f1ef5356700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808741731973, "job": 1, "event": "recovery_finished"} 2022-02-02T13:32:21.875 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.732+0000 7f1ef5356700 4 rocksdb: DB pointer 0x55ff09777800 2022-02-02T13:32:21.875 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.732+0000 7f1edc16e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T13:32:21.875 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.732+0000 7f1edc16e700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T13:32:21.875 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** DB Stats ** 2022-02-02T13:32:21.875 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:21.876 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T13:32:21.876 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T13:32:21.876 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:32:21.876 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T13:32:21.877 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T13:32:21.877 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:32:21.877 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.877 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** Compaction Stats [default] ** 2022-02-02T13:32:21.877 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:21.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:21.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: L0 2/0 92.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Sum 2/0 92.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.878 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.879 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.879 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** Compaction Stats [default] ** 2022-02-02T13:32:21.879 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:21.879 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:21.880 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.880 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:21.880 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:21.880 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:21.880 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:32:21.881 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:32:21.881 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:32:21.881 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Cumulative compaction: 0.00 GB write, 21.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:21.881 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Interval compaction: 0.00 GB write, 21.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:21.881 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:32:21.882 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.882 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:32:21.882 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.882 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** Compaction Stats [default] ** 2022-02-02T13:32:21.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:21.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:21.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: L0 2/0 92.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Sum 2/0 92.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.883 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:32:21.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** Compaction Stats [default] ** 2022-02-02T13:32:21.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:32:21.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:32:21.885 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 101.6 0.00 0.00 1 0.001 0 0 2022-02-02T13:32:21.885 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:32:21.885 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:21.885 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:32:21.885 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:32:21.886 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:32:21.886 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:32:21.886 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Cumulative compaction: 0.00 GB write, 21.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:21.886 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:32:21.887 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:32:21.887 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.887 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:32:21.887 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.887 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.733+0000 7f1ef5356700 0 starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:21.888 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.734+0000 7f1ef5356700 1 mon.smithi033@-1(???) e1 preinit fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:21.888 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).mds e1 new map 2022-02-02T13:32:21.888 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.888 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).mds e1 print_map 2022-02-02T13:32:21.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: e1 2022-02-02T13:32:21.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:32:21.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:32:21.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: legacy client fscid: -1 2022-02-02T13:32:21.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.890 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: No filesystems configured 2022-02-02T13:32:21.890 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.890 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2022-02-02T13:32:21.890 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:32:21.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:32:21.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.735+0000 7f1ef5356700 0 mon.smithi033@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:32:21.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: audit 2022-02-02T13:32:21.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T 2022-02-02T13:32:21.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 13:32:19.922493 2022-02-02T13:32:21.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0 2022-02-02T13:32:21.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: ) 10 : audit [DBG] from='client.? 172.21.15.33:0/668569285' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:32:21.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.735+0000 7f1ef5356700 1 mon.smithi033@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2022-02-02T13:32:21.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expand map: {default=false} 2022-02-02T13:32:21.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta from 'false' to 'false' 2022-02-02T13:32:21.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expanded map: {default=false} 2022-02-02T13:32:21.893 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expand map: {default=info} 2022-02-02T13:32:21.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta from 'info' to 'info' 2022-02-02T13:32:21.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expanded map: {default=info} 2022-02-02T13:32:21.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expand map: {default=daemon} 2022-02-02T13:32:21.894 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta from 'daemon' to 'daemon' 2022-02-02T13:32:21.895 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expanded map: {default=daemon} 2022-02-02T13:32:21.895 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expand map: {default=debug} 2022-02-02T13:32:21.895 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta from 'debug' to 'debug' 2022-02-02T13:32:21.895 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: debug 2022-02-02T13:32:21.737+0000 7f1ef5356700 20 expand_channel_meta expanded map: {default=debug} 2022-02-02T13:32:21.895 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 systemd[1]: Started Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:32:22.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cluster 2022-02-02T13:32:21.753481 2022-02-02T13:32:22.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 is new leader, mons smithi033 in quorum (ranks 0) 2022-02-02T13:32:22.040 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cluster 2022-02-02T13:32:21.753522+0000 2022-02-02T13:32:22.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: mon.smithi033 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2022-02-02T13:32:22.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cluster 2022-02-02T 2022-02-02T13:32:22.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 13:32:21.753553+0000 mon.smithi033 (mon 2022-02-02T13:32:22.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: .0) 3 : cluster [DBG] fsmap 2022-02-02T13:32:22.041 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cluster 2022-02 2022-02-02T13:32:22.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: -02T13:32:21.753581+0000 2022-02-02T13:32:22.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: mon.smithi033 (mon.0) 4 : cluster [DBG] 2022-02-02T13:32:22.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: osdmap e1: 0 total, 0 up, 0 in 2022-02-02T13:32:22.042 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: cluster 2022-02-02T13:32:22.043 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: 2022-02-02T13:32:21.753931+0000 2022-02-02T13:32:22.043 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: mon.smithi033 (mon.0) 5 : cluster [DBG] 2022-02-02T13:32:22.043 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:21 smithi033 conmon[31996]: mgrmap e1: no daemons active 2022-02-02T13:32:22.276 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.271+0000 7f02c6f5e700 1 Processor -- start 2022-02-02T13:32:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.271+0000 7f02c6f5e700 1 -- start start 2022-02-02T13:32:22.277 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.271+0000 7f02c6f5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.271+0000 7f02c6f5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c00fb4e0 con 0x7f02c00fab40 2022-02-02T13:32:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02c4cfa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02c4cfa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55406/0 (socket says 172.21.15.33:55406) 2022-02-02T13:32:22.279 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02c4cfa700 1 -- 172.21.15.33:0/2754812892 learned_addr learned my addr 172.21.15.33:0/2754812892 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02c4cfa700 1 -- 172.21.15.33:0/2754812892 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c00fb620 con 0x7f02c00fab40 2022-02-02T13:32:22.280 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02c4cfa700 1 --2- 172.21.15.33:0/2754812892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f02b400b5f0 tx=0x7f02b4006ee0).ready entity=mon.0 client_cookie=33d5ed9ef46fc56e server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02bf7fe700 1 -- 172.21.15.33:0/2754812892 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02b400d600 con 0x7f02c00fab40 2022-02-02T13:32:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02bf7fe700 1 -- 172.21.15.33:0/2754812892 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f02b400dbb0 con 0x7f02c00fab40 2022-02-02T13:32:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.272+0000 7f02bf7fe700 1 -- 172.21.15.33:0/2754812892 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02b4011bb0 con 0x7f02c00fab40 2022-02-02T13:32:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 -- 172.21.15.33:0/2754812892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 msgr2=0x7f02c00faf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 --2- 172.21.15.33:0/2754812892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f02b400b5f0 tx=0x7f02b4006ee0).stop 2022-02-02T13:32:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 -- 172.21.15.33:0/2754812892 shutdown_connections 2022-02-02T13:32:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 --2- 172.21.15.33:0/2754812892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c00faf60 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 -- 172.21.15.33:0/2754812892 >> 172.21.15.33:0/2754812892 conn(0x7f02c00f62a0 msgr2=0x7f02c00f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 -- 172.21.15.33:0/2754812892 shutdown_connections 2022-02-02T13:32:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.273+0000 7f02c6f5e700 1 -- 172.21.15.33:0/2754812892 wait complete. 2022-02-02T13:32:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c6f5e700 1 Processor -- start 2022-02-02T13:32:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c6f5e700 1 -- start start 2022-02-02T13:32:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c6f5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c6f5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c006fc40 con 0x7f02c00fab40 2022-02-02T13:32:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c4cfa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c4cfa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55408/0 (socket says 172.21.15.33:55408) 2022-02-02T13:32:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.274+0000 7f02c4cfa700 1 -- 172.21.15.33:0/624140475 learned_addr learned my addr 172.21.15.33:0/624140475 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02c4cfa700 1 -- 172.21.15.33:0/624140475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b400b200 con 0x7f02c00fab40 2022-02-02T13:32:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02c4cfa700 1 --2- 172.21.15.33:0/624140475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f02b400db50 tx=0x7f02b4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02b401b410 con 0x7f02c00fab40 2022-02-02T13:32:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f02b401b9c0 con 0x7f02c00fab40 2022-02-02T13:32:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c006fe40 con 0x7f02c00fab40 2022-02-02T13:32:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f02b401a6d0 con 0x7f02c00fab40 2022-02-02T13:32:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.275+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c010dd50 con 0x7f02c00fab40 2022-02-02T13:32:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.276+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f02b400f070 con 0x7f02c00fab40 2022-02-02T13:32:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.276+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f02b40257b0 con 0x7f02c00fab40 2022-02-02T13:32:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.276+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c0045ad0 con 0x7f02c00fab40 2022-02-02T13:32:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.279+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f02b4016070 con 0x7f02c00fab40 2022-02-02T13:32:22.397 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.398+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f02c00fc920 con 0x7f02c00fab40 2022-02-02T13:32:22.399 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.400+0000 7f02bd7fa700 1 -- 172.21.15.33:0/624140475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f02b401ae80 con 0x7f02c00fab40 2022-02-02T13:32:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.401+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 msgr2=0x7f02c010d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.401+0000 7f02c6f5e700 1 --2- 172.21.15.33:0/624140475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f02b400db50 tx=0x7f02b4006ee0).stop 2022-02-02T13:32:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.401+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 shutdown_connections 2022-02-02T13:32:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.401+0000 7f02c6f5e700 1 --2- 172.21.15.33:0/624140475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02c00fab40 0x7f02c010d620 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.401+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 >> 172.21.15.33:0/624140475 conn(0x7f02c00f62a0 msgr2=0x7f02c00f7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.402+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 shutdown_connections 2022-02-02T13:32:22.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:22.402+0000 7f02c6f5e700 1 -- 172.21.15.33:0/624140475 wait complete. 2022-02-02T13:32:22.824 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote config to /etc/ceph/ceph.conf 2022-02-02T13:32:22.825 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2022-02-02T13:32:22.825 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mgr... 2022-02-02T13:32:22.825 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying port 9283 ... 2022-02-02T13:32:22.825 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2022-02-02T13:32:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp 2022-02-02T13:32:22.943 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp 2022-02-02T13:32:22.948 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp.service: Unit ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp.service not loaded. 2022-02-02T13:32:22.949 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp 2022-02-02T13:32:22.955 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c.target.wants/ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp.service → /etc/systemd/system/ceph-7b277774-842c-11ec-8c35-001a4aab830c@.service. 2022-02-02T13:32:23.040 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@mgr.smithi033.xvkvzp 2022-02-02T13:32:23.578 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T13:32:23.583 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2022-02-02T13:32:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T13:32:23.591 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:32:23.592 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2022-02-02T13:32:23.592 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2022-02-02T13:32:23.592 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-02-02T13:32:23.593 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T13:32:23.601 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2022-02-02T13:32:23.601 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T13:32:23.607 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:32:23.608 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2022-02-02T13:32:23.608 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2022-02-02T13:32:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr to start... 2022-02-02T13:32:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr... 2022-02-02T13:32:23.609 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T13:32:23.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:23 smithi033 conmon[31996]: audit 2022-02-02T13:32:22.401580+0000 mon.smithi033 ( 2022-02-02T13:32:23.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:23 smithi033 conmon[31996]: mon.0) 6 : audit [INF] from='client.? 172.21.15.33:0/624140475' entity='client.admin' 2022-02-02T13:32:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.161+0000 7ff8186b4700 1 Processor -- start 2022-02-02T13:32:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.161+0000 7ff8186b4700 1 -- start start 2022-02-02T13:32:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.161+0000 7ff8186b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.161+0000 7ff8186b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8100fb3b0 con 0x7ff8100faaa0 2022-02-02T13:32:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff816450700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff816450700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55414/0 (socket says 172.21.15.33:55414) 2022-02-02T13:32:24.165 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff816450700 1 -- 172.21.15.33:0/618426292 learned_addr learned my addr 172.21.15.33:0/618426292 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff816450700 1 -- 172.21.15.33:0/618426292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8100fb4f0 con 0x7ff8100faaa0 2022-02-02T13:32:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff816450700 1 --2- 172.21.15.33:0/618426292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff80000b5f0 tx=0x7ff800006ee0).ready entity=mon.0 client_cookie=fe30d5b7f77ec60f server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff81544e700 1 -- 172.21.15.33:0/618426292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff80000d600 con 0x7ff8100faaa0 2022-02-02T13:32:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff81544e700 1 -- 172.21.15.33:0/618426292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff80000dbb0 con 0x7ff8100faaa0 2022-02-02T13:32:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.162+0000 7ff81544e700 1 -- 172.21.15.33:0/618426292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff800011bb0 con 0x7ff8100faaa0 2022-02-02T13:32:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 -- 172.21.15.33:0/618426292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 msgr2=0x7ff8100faec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 --2- 172.21.15.33:0/618426292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7ff80000b5f0 tx=0x7ff800006ee0).stop 2022-02-02T13:32:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 -- 172.21.15.33:0/618426292 shutdown_connections 2022-02-02T13:32:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 --2- 172.21.15.33:0/618426292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff8100faec0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 -- 172.21.15.33:0/618426292 >> 172.21.15.33:0/618426292 conn(0x7ff8100f62a0 msgr2=0x7ff8100f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:24.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 -- 172.21.15.33:0/618426292 shutdown_connections 2022-02-02T13:32:24.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.163+0000 7ff8186b4700 1 -- 172.21.15.33:0/618426292 wait complete. 2022-02-02T13:32:24.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff8186b4700 1 Processor -- start 2022-02-02T13:32:24.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff8186b4700 1 -- start start 2022-02-02T13:32:24.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff8186b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:24.172 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff8186b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff810108b60 con 0x7ff8100faaa0 2022-02-02T13:32:24.172 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff816450700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:24.172 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff816450700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55416/0 (socket says 172.21.15.33:55416) 2022-02-02T13:32:24.172 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.164+0000 7ff816450700 1 -- 172.21.15.33:0/4004916084 learned_addr learned my addr 172.21.15.33:0/4004916084 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:24.173 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff816450700 1 -- 172.21.15.33:0/4004916084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80000b200 con 0x7ff8100faaa0 2022-02-02T13:32:24.173 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff816450700 1 --2- 172.21.15.33:0/4004916084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff800006c70 tx=0x7ff800006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:24.173 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff80001b570 con 0x7ff8100faaa0 2022-02-02T13:32:24.173 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff80001bb20 con 0x7ff8100faaa0 2022-02-02T13:32:24.173 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff80001a8c0 con 0x7ff8100faaa0 2022-02-02T13:32:24.174 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff810108d60 con 0x7ff8100faaa0 2022-02-02T13:32:24.174 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.165+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8101091f0 con 0x7ff8100faaa0 2022-02-02T13:32:24.174 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.166+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff80000f070 con 0x7ff8100faaa0 2022-02-02T13:32:24.174 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.166+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff800025c40 con 0x7ff8100faaa0 2022-02-02T13:32:24.175 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.166+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff810045ad0 con 0x7ff8100faaa0 2022-02-02T13:32:24.176 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.169+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7ff800016070 con 0x7ff8100faaa0 2022-02-02T13:32:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.295+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff8100fc940 con 0x7ff8100faaa0 2022-02-02T13:32:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.295+0000 7ff7feffd700 1 -- 172.21.15.33:0/4004916084 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7ff800025e50 con 0x7ff8100faaa0 2022-02-02T13:32:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7b277774-842c-11ec-8c35-001a4aab830c", 2022-02-02T13:32:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2022-02-02T13:32:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T13:32:24.310 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T13:32:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T13:32:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T13:32:24.311 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T13:32:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2022-02-02T13:32:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T13:32:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2022-02-02T13:32:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 2, 2022-02-02T13:32:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T13:32:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T13:32:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T13:32:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T13:32:24.314 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T13:32:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T13:32:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T13:32:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T13:32:24.315 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T13:32:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T13:32:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T13:32:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T13:32:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T13:32:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T13:32:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T13:32:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T13:32:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T13:32:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T13:32:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T13:32:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T13:32:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T13:32:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T13:32:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T13:32:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2022-02-02T13:32:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T13:32:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T13:32:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2022-02-02T13:32:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2022-02-02T13:32:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T13:32:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2022-02-02T13:32:17.155162+0000", 2022-02-02T13:32:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:24.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T13:32:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 msgr2=0x7ff810108670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:24.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 --2- 172.21.15.33:0/4004916084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff800006c70 tx=0x7ff800006ee0).stop 2022-02-02T13:32:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 shutdown_connections 2022-02-02T13:32:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 --2- 172.21.15.33:0/4004916084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8100faaa0 0x7ff810108670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 >> 172.21.15.33:0/4004916084 conn(0x7ff8100f62a0 msgr2=0x7ff8100ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 shutdown_connections 2022-02-02T13:32:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:24.297+0000 7ff8186b4700 1 -- 172.21.15.33:0/4004916084 wait complete. 2022-02-02T13:32:24.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:24 smithi033 conmon[31996]: audit 2022-02-02T13:32:24.296377+0000 mon.smithi033 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.33:0/4004916084' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T13:32:24.648 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (1/15)... 2022-02-02T13:32:26.651 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T13:32:27.208 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.204+0000 7f4fa548c700 1 Processor -- start 2022-02-02T13:32:27.209 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.204+0000 7f4fa548c700 1 -- start start 2022-02-02T13:32:27.210 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4fa548c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:27.210 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4fa548c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0072020 con 0x7f4fa0071c00 2022-02-02T13:32:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55418/0 (socket says 172.21.15.33:55418) 2022-02-02T13:32:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4f9effd700 1 -- 172.21.15.33:0/4000407805 learned_addr learned my addr 172.21.15.33:0/4000407805 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.205+0000 7f4f9effd700 1 -- 172.21.15.33:0/4000407805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa0070690 con 0x7f4fa0071c00 2022-02-02T13:32:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4f9effd700 1 --2- 172.21.15.33:0/4000407805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4f9000b5f0 tx=0x7f4f90006ee0).ready entity=mon.0 client_cookie=c455993f0e2ce317 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:27.213 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4f9dffb700 1 -- 172.21.15.33:0/4000407805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f9000d600 con 0x7f4fa0071c00 2022-02-02T13:32:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4f9dffb700 1 -- 172.21.15.33:0/4000407805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f4f9000dbb0 con 0x7f4fa0071c00 2022-02-02T13:32:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4f9dffb700 1 -- 172.21.15.33:0/4000407805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f90011bb0 con 0x7f4fa0071c00 2022-02-02T13:32:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4fa548c700 1 -- 172.21.15.33:0/4000407805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 msgr2=0x7f4fa00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:27.220 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.206+0000 7f4fa548c700 1 --2- 172.21.15.33:0/4000407805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4f9000b5f0 tx=0x7f4f90006ee0).stop 2022-02-02T13:32:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.207+0000 7f4fa548c700 1 -- 172.21.15.33:0/4000407805 shutdown_connections 2022-02-02T13:32:27.221 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.207+0000 7f4fa548c700 1 --2- 172.21.15.33:0/4000407805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa00701a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.207+0000 7f4fa548c700 1 -- 172.21.15.33:0/4000407805 >> 172.21.15.33:0/4000407805 conn(0x7f4fa00f73e0 msgr2=0x7f4fa00f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.207+0000 7f4fa548c700 1 -- 172.21.15.33:0/4000407805 shutdown_connections 2022-02-02T13:32:27.222 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.207+0000 7f4fa548c700 1 -- 172.21.15.33:0/4000407805 wait complete. 2022-02-02T13:32:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4fa548c700 1 Processor -- start 2022-02-02T13:32:27.223 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4fa548c700 1 -- start start 2022-02-02T13:32:27.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4fa548c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:27.224 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4fa548c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa010cff0 con 0x7f4fa0071c00 2022-02-02T13:32:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4f9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55420/0 (socket says 172.21.15.33:55420) 2022-02-02T13:32:27.225 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4f9effd700 1 -- 172.21.15.33:0/304372930 learned_addr learned my addr 172.21.15.33:0/304372930 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.208+0000 7f4f9effd700 1 -- 172.21.15.33:0/304372930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9000b200 con 0x7f4fa0071c00 2022-02-02T13:32:27.226 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4f9effd700 1 --2- 172.21.15.33:0/304372930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4f90006cb0 tx=0x7f4f90006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:27.227 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f9001b410 con 0x7f4fa0071c00 2022-02-02T13:32:27.227 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa010d1f0 con 0x7f4fa0071c00 2022-02-02T13:32:27.228 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa010d680 con 0x7f4fa0071c00 2022-02-02T13:32:27.228 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f4f9001b9c0 con 0x7f4fa0071c00 2022-02-02T13:32:27.229 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f9001a6f0 con 0x7f4fa0071c00 2022-02-02T13:32:27.229 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.209+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f4f9000f070 con 0x7f4fa0071c00 2022-02-02T13:32:27.229 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.210+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f4f90024b70 con 0x7f4fa0071c00 2022-02-02T13:32:27.230 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.210+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f80004fa0 con 0x7f4fa0071c00 2022-02-02T13:32:27.231 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.212+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f4f90016070 con 0x7f4fa0071c00 2022-02-02T13:32:27.338 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.337+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f4f80005940 con 0x7f4fa0071c00 2022-02-02T13:32:27.339 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.337+0000 7f4f877fe700 1 -- 172.21.15.33:0/304372930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f4f9001ade0 con 0x7f4fa0071c00 2022-02-02T13:32:27.339 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.342 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:27.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7b277774-842c-11ec-8c35-001a4aab830c", 2022-02-02T13:32:27.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2022-02-02T13:32:27.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T13:32:27.343 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T13:32:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T13:32:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T13:32:27.350 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T13:32:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2022-02-02T13:32:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T13:32:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2022-02-02T13:32:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 5, 2022-02-02T13:32:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T13:32:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T13:32:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T13:32:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.353 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T13:32:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T13:32:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T13:32:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T13:32:27.354 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T13:32:27.355 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T13:32:27.355 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T13:32:27.355 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.355 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T13:32:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T13:32:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T13:32:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T13:32:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T13:32:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T13:32:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T13:32:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T13:32:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T13:32:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T13:32:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T13:32:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T13:32:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T13:32:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2022-02-02T13:32:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T13:32:27.359 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T13:32:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2022-02-02T13:32:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2022-02-02T13:32:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T13:32:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2022-02-02T13:32:17.155162+0000", 2022-02-02T13:32:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T13:32:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.338+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 msgr2=0x7f4fa010cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.338+0000 7f4fa548c700 1 --2- 172.21.15.33:0/304372930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4f90006cb0 tx=0x7f4f90006ee0).stop 2022-02-02T13:32:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.340+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 shutdown_connections 2022-02-02T13:32:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.340+0000 7f4fa548c700 1 --2- 172.21.15.33:0/304372930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa0071c00 0x7f4fa010cb00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.340+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 >> 172.21.15.33:0/304372930 conn(0x7f4fa00f73e0 msgr2=0x7f4fa00f8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:27.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.340+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 shutdown_connections 2022-02-02T13:32:27.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:27.340+0000 7f4fa548c700 1 -- 172.21.15.33:0/304372930 wait complete. 2022-02-02T13:32:27.699 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (2/15)... 2022-02-02T13:32:27.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:27 smithi033 conmon[31996]: audit 2022-02-02T13:32:27.338165+0000 mon.smithi033 2022-02-02T13:32:27.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:27 smithi033 conmon[31996]: (mon.0) 8 : audit [DBG] from='client.? 172.21.15.33:0/304372930' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T13:32:29.701 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T13:32:29.832 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: cluster 2022-02-02T13:32:29.517885+0000 mon.smithi033 (mon 2022-02-02T13:32:29.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: .0) 9 : cluster [INF] Activating manager daemon smithi033.xvkvzp 2022-02-02T13:32:29.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: cluster 2022-02-02T13:32:29.520653+0000 mon.smithi033 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi033.xvkvzp(active, starting, since 0.0028824s) 2022-02-02T13:32:29.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32:29.521598+0000 mon.smithi033 (mon.0) 11 : audit 2022-02-02T13:32:29.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: [DBG] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:32:29.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32:29.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 2022-02-02T13:32:29.521797+0000 mon.smithi033 (mon.0) 12 : audit [DBG] 2022-02-02T13:32:29.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:32:29.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:32:29.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 13:32:29.521955+0000 mon.smithi033 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:32:29.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32: 2022-02-02T13:32:29.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 29.522103+0000 mon.smithi033 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:32:29.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 2022-02-02T13:32:29.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:32:29.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 02T13:32:29.522409+0000 mon.smithi033 (mon.0) 15 : audit [DBG] 2022-02-02T13:32:29.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:32:29.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: cluster 2022- 2022-02-02T13:32:29.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 02-02T13:32:29.536483+0000 mon.smithi033 (mon.0) 16 : cluster 2022-02-02T13:32:29.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:32:29.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32:29.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 2022-02-02T13:32:29.546200+0000 mon.smithi033 (mon.0) 17 : audit 2022-02-02T13:32:29.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: [INF] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:29.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022 2022-02-02T13:32:29.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: -02-02T13:32:29.550040+0000 mon.smithi033 (mon.0) 18 : audit 2022-02-02T13:32:29.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: [INF] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:32:29.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32:29.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: 2022-02-02T13:32:29.551255+0000 mon.smithi033 (mon.0) 19 : 2022-02-02T13:32:29.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit [INF] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:32:29.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02T13:32:29.556558+0000 2022-02-02T13:32:29.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: mon.smithi033 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:29.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:32:29.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: T13:32:29.558941+0000 mon.smithi033 (mon.0) 21 : audit 2022-02-02T13:32:29.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:29 smithi033 conmon[31996]: [INF] from='mgr.14100 172.21.15.33:0/4134846280' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:30.182 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d821b8700 1 Processor -- start 2022-02-02T13:32:30.188 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d821b8700 1 -- start start 2022-02-02T13:32:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d821b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d821b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c0fc630 con 0x7f7d7c06fb60 2022-02-02T13:32:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:30.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55432/0 (socket says 172.21.15.33:55432) 2022-02-02T13:32:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.181+0000 7f7d7b7fe700 1 -- 172.21.15.33:0/1142110805 learned_addr learned my addr 172.21.15.33:0/1142110805 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d7b7fe700 1 -- 172.21.15.33:0/1142110805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c101130 con 0x7f7d7c06fb60 2022-02-02T13:32:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d7b7fe700 1 --2- 172.21.15.33:0/1142110805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f7d6c00b5f0 tx=0x7f7d6c006ee0).ready entity=mon.0 client_cookie=dee8637b5a186956 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:30.190 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d7a7fc700 1 -- 172.21.15.33:0/1142110805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6c00d600 con 0x7f7d7c06fb60 2022-02-02T13:32:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d7a7fc700 1 -- 172.21.15.33:0/1142110805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f7d6c00dbb0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d7a7fc700 1 -- 172.21.15.33:0/1142110805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6c011bb0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.191 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d821b8700 1 -- 172.21.15.33:0/1142110805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 msgr2=0x7f7d7c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.182+0000 7f7d821b8700 1 --2- 172.21.15.33:0/1142110805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f7d6c00b5f0 tx=0x7f7d6c006ee0).stop 2022-02-02T13:32:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 -- 172.21.15.33:0/1142110805 shutdown_connections 2022-02-02T13:32:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 --2- 172.21.15.33:0/1142110805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c100c40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 -- 172.21.15.33:0/1142110805 >> 172.21.15.33:0/1142110805 conn(0x7f7d7c0f6260 msgr2=0x7f7d7c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:30.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 -- 172.21.15.33:0/1142110805 shutdown_connections 2022-02-02T13:32:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 -- 172.21.15.33:0/1142110805 wait complete. 2022-02-02T13:32:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 Processor -- start 2022-02-02T13:32:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.183+0000 7f7d821b8700 1 -- start start 2022-02-02T13:32:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d821b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d821b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c10cfa0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55434/0 (socket says 172.21.15.33:55434) 2022-02-02T13:32:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d7b7fe700 1 -- 172.21.15.33:0/4282095002 learned_addr learned my addr 172.21.15.33:0/4282095002 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d7b7fe700 1 -- 172.21.15.33:0/4282095002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c00b200 con 0x7f7d7c06fb60 2022-02-02T13:32:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d7b7fe700 1 --2- 172.21.15.33:0/4282095002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7d6c006970 tx=0x7f7d6c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6c01b570 con 0x7f7d7c06fb60 2022-02-02T13:32:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f7d6c01bb20 con 0x7f7d7c06fb60 2022-02-02T13:32:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c10d1a0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.184+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c10d630 con 0x7f7d7c06fb60 2022-02-02T13:32:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.185+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7d6c01a920 con 0x7f7d7c06fb60 2022-02-02T13:32:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.185+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 2) v1 ==== 35959+0+0 (secure 0 0 0) 0x7f7d6c00f070 con 0x7f7d7c06fb60 2022-02-02T13:32:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.186+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7d6c041fe0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.186+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c004fa0 con 0x7f7d7c06fb60 2022-02-02T13:32:30.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.188+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72097 (secure 0 0 0) 0x7f7d6c025460 con 0x7f7d7c06fb60 2022-02-02T13:32:30.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.312+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7d5c005670 con 0x7f7d7c06fb60 2022-02-02T13:32:30.313 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.313+0000 7f7d63fff700 1 -- 172.21.15.33:0/4282095002 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f7d6c023e90 con 0x7f7d7c06fb60 2022-02-02T13:32:30.321 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:30.322 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7b277774-842c-11ec-8c35-001a4aab830c", 2022-02-02T13:32:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2022-02-02T13:32:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T13:32:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T13:32:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T13:32:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T13:32:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T13:32:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2022-02-02T13:32:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T13:32:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2022-02-02T13:32:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 8, 2022-02-02T13:32:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T13:32:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T13:32:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T13:32:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T13:32:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T13:32:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T13:32:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T13:32:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T13:32:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T13:32:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T13:32:30.329 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.329 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T13:32:30.329 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T13:32:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T13:32:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T13:32:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T13:32:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T13:32:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T13:32:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T13:32:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T13:32:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T13:32:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T13:32:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T13:32:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T13:32:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2022-02-02T13:32:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T13:32:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T13:32:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2022-02-02T13:32:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2022-02-02T13:32:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T13:32:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2022-02-02T13:32:17.155162+0000", 2022-02-02T13:32:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T13:32:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 msgr2=0x7f7d7c10cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 --2- 172.21.15.33:0/4282095002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7d6c006970 tx=0x7f7d6c006ee0).stop 2022-02-02T13:32:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 shutdown_connections 2022-02-02T13:32:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 --2- 172.21.15.33:0/4282095002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d7c06fb60 0x7f7d7c10cab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 >> 172.21.15.33:0/4282095002 conn(0x7f7d7c0f6260 msgr2=0x7f7d7c0f7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 shutdown_connections 2022-02-02T13:32:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:30.314+0000 7f7d821b8700 1 -- 172.21.15.33:0/4282095002 wait complete. 2022-02-02T13:32:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (3/15)... 2022-02-02T13:32:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:30 smithi033 conmon[31996]: audit 2022-02-02T13:32:30.313880+0000 mon.smithi033 (mon 2022-02-02T13:32:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:30 smithi033 conmon[31996]: .0) 22 : audit [DBG] from='client.? 172.21.15.33:0/4282095002' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T13:32:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:30 smithi033 conmon[31996]: cluster 2022-02-02T13:32:30.523163+0000 mon.smithi033 (mon.0) 23 : cluster [DBG] mgrmap e3: smithi033.xvkvzp(active, since 1.00539s) 2022-02-02T13:32:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-02-02T13:32:32.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:32 smithi033 conmon[31996]: cluster 2022-02-02T13:32:31.575234+0000 mon.smithi033 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi033.xvkvzp(active, since 2s) 2022-02-02T13:32:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ec6e700 1 Processor -- start 2022-02-02T13:32:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ec6e700 1 -- start start 2022-02-02T13:32:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ec6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ec6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9838072080 con 0x7f9838071c60 2022-02-02T13:32:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ca0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ca0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55444/0 (socket says 172.21.15.33:55444) 2022-02-02T13:32:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.689+0000 7f983ca0a700 1 -- 172.21.15.33:0/3963078655 learned_addr learned my addr 172.21.15.33:0/3963078655 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.690+0000 7f983ca0a700 1 -- 172.21.15.33:0/3963078655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98380706f0 con 0x7f9838071c60 2022-02-02T13:32:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.690+0000 7f983ca0a700 1 --2- 172.21.15.33:0/3963078655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f982c00b5f0 tx=0x7f982c006ee0).ready entity=mon.0 client_cookie=61f8482f5eb69752 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.690+0000 7f98377fe700 1 -- 172.21.15.33:0/3963078655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c00d600 con 0x7f9838071c60 2022-02-02T13:32:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.690+0000 7f98377fe700 1 -- 172.21.15.33:0/3963078655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f982c00dbb0 con 0x7f9838071c60 2022-02-02T13:32:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.690+0000 7f98377fe700 1 -- 172.21.15.33:0/3963078655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c011bb0 con 0x7f9838071c60 2022-02-02T13:32:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 -- 172.21.15.33:0/3963078655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 msgr2=0x7f9838070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3963078655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f982c00b5f0 tx=0x7f982c006ee0).stop 2022-02-02T13:32:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 -- 172.21.15.33:0/3963078655 shutdown_connections 2022-02-02T13:32:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3963078655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f9838070200 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 -- 172.21.15.33:0/3963078655 >> 172.21.15.33:0/3963078655 conn(0x7f98380f73e0 msgr2=0x7f98380f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 -- 172.21.15.33:0/3963078655 shutdown_connections 2022-02-02T13:32:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 -- 172.21.15.33:0/3963078655 wait complete. 2022-02-02T13:32:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.691+0000 7f983ec6e700 1 Processor -- start 2022-02-02T13:32:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ec6e700 1 -- start start 2022-02-02T13:32:35.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ec6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:35.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ec6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983810cfb0 con 0x7f9838071c60 2022-02-02T13:32:35.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ca0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ca0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55446/0 (socket says 172.21.15.33:55446) 2022-02-02T13:32:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ca0a700 1 -- 172.21.15.33:0/3567945507 learned_addr learned my addr 172.21.15.33:0/3567945507 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ca0a700 1 -- 172.21.15.33:0/3567945507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c00b200 con 0x7f9838071c60 2022-02-02T13:32:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.692+0000 7f983ca0a700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f982c006cb0 tx=0x7f982c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:35.781 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.693+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c01b570 con 0x7f9838071c60 2022-02-02T13:32:35.782 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.693+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f982c01bb20 con 0x7f9838071c60 2022-02-02T13:32:35.782 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.693+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983810d1b0 con 0x7f9838071c60 2022-02-02T13:32:35.782 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.693+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f982c01a960 con 0x7f9838071c60 2022-02-02T13:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.693+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983810d640 con 0x7f9838071c60 2022-02-02T13:32:35.783 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7f982c00f070 con 0x7f9838071c60 2022-02-02T13:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f98357fa700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 0x7f981c032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f982c040fe0 con 0x7f9838071c60 2022-02-02T13:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9838045ad0 con 0x7f9838071c60 2022-02-02T13:32:35.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f9837fff700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 0x7f981c032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.694+0000 7f9837fff700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 0x7f981c032210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f98240096a0 tx=0x7f9824006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:35.785 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:35.699+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f982c016070 con 0x7f9838071c60 2022-02-02T13:32:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.101+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9838106ba0 con 0x7f9838071c60 2022-02-02T13:32:36.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.101+0000 7f98357fa700 1 -- 172.21.15.33:0/3567945507 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1230 (secure 0 0 0) 0x7f982c024410 con 0x7f9838071c60 2022-02-02T13:32:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7b277774-842c-11ec-8c35-001a4aab830c", 2022-02-02T13:32:36.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2022-02-02T13:32:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-02-02T13:32:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2022-02-02T13:32:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2022-02-02T13:32:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-02-02T13:32:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2022-02-02T13:32:36.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2022-02-02T13:32:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2022-02-02T13:32:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "smithi033" 2022-02-02T13:32:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 14, 2022-02-02T13:32:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2022-02-02T13:32:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-02-02T13:32:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2022-02-02T13:32:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2022-02-02T13:32:36.116 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:36.116 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2022-02-02T13:32:36.116 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-02-02T13:32:36.116 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-02-02T13:32:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-02-02T13:32:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-02-02T13:32:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-02-02T13:32:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2022-02-02T13:32:36.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-02-02T13:32:36.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-02-02T13:32:36.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2022-02-02T13:32:36.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2022-02-02T13:32:36.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-02-02T13:32:36.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-02-02T13:32:36.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-02-02T13:32:36.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2022-02-02T13:32:36.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2022-02-02T13:32:36.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:36.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2022-02-02T13:32:36.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2022-02-02T13:32:36.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2022-02-02T13:32:36.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2022-02-02T13:32:36.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-02-02T13:32:36.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2022-02-02T13:32:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2022-02-02T13:32:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2022-02-02T13:32:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2022-02-02T13:32:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:36.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2022-02-02T13:32:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2022-02-02T13:32:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2022-02-02T13:32:17.155162+0000", 2022-02-02T13:32:36.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2022-02-02T13:32:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2022-02-02T13:32:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2022-02-02T13:32:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:36.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 msgr2=0x7f981c032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 0x7f981c032210 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f98240096a0 tx=0x7f9824006b40).stop 2022-02-02T13:32:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 msgr2=0x7f983810cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f982c006cb0 tx=0x7f982c006ee0).stop 2022-02-02T13:32:36.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 shutdown_connections 2022-02-02T13:32:36.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f981c02fd50 0x7f981c032210 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:36.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 --2- 172.21.15.33:0/3567945507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9838071c60 0x7f983810cac0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:36.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.103+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 >> 172.21.15.33:0/3567945507 conn(0x7f98380f73e0 msgr2=0x7f98380f8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:36.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.104+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 shutdown_connections 2022-02-02T13:32:36.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:36.104+0000 7f983ec6e700 1 -- 172.21.15.33:0/3567945507 wait complete. 2022-02-02T13:32:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:36 smithi033 conmon[31996]: audit 2022-02-02T13:32:36.102621 2022-02-02T13:32:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:36 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 25 : audit [DBG] from='client.? 172.21.15.33:0/3567945507' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-02-02T13:32:38.297 INFO:teuthology.orchestra.run.smithi033.stderr:mgr is available 2022-02-02T13:32:38.298 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling cephadm module... 2022-02-02T13:32:38.298 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2022-02-02T13:32:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.161+0000 7ffbe36df700 1 Processor -- start 2022-02-02T13:32:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe36df700 1 -- start start 2022-02-02T13:32:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe36df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe36df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0fedc0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55450/0 (socket says 172.21.15.33:55450) 2022-02-02T13:32:40.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe147b700 1 -- 172.21.15.33:0/152691114 learned_addr learned my addr 172.21.15.33:0/152691114 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe147b700 1 -- 172.21.15.33:0/152691114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc0fef00 con 0x7ffbdc06fc20 2022-02-02T13:32:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.162+0000 7ffbe147b700 1 --2- 172.21.15.33:0/152691114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ffbd800b5f0 tx=0x7ffbd8006ee0).ready entity=mon.0 client_cookie=28a8e8caaff3970a server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbcffff700 1 -- 172.21.15.33:0/152691114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd800d600 con 0x7ffbdc06fc20 2022-02-02T13:32:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbcffff700 1 -- 172.21.15.33:0/152691114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ffbd800dbb0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbcffff700 1 -- 172.21.15.33:0/152691114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd8011bb0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 -- 172.21.15.33:0/152691114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 msgr2=0x7ffbdc0fe840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 --2- 172.21.15.33:0/152691114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ffbd800b5f0 tx=0x7ffbd8006ee0).stop 2022-02-02T13:32:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 -- 172.21.15.33:0/152691114 shutdown_connections 2022-02-02T13:32:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 --2- 172.21.15.33:0/152691114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc0fe840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 -- 172.21.15.33:0/152691114 >> 172.21.15.33:0/152691114 conn(0x7ffbdc0f62a0 msgr2=0x7ffbdc0f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 -- 172.21.15.33:0/152691114 shutdown_connections 2022-02-02T13:32:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.163+0000 7ffbe36df700 1 -- 172.21.15.33:0/152691114 wait complete. 2022-02-02T13:32:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe36df700 1 Processor -- start 2022-02-02T13:32:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe36df700 1 -- start start 2022-02-02T13:32:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe36df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe36df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc10ae00 con 0x7ffbdc06fc20 2022-02-02T13:32:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:40.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55452/0 (socket says 172.21.15.33:55452) 2022-02-02T13:32:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.164+0000 7ffbe147b700 1 -- 172.21.15.33:0/3462306158 learned_addr learned my addr 172.21.15.33:0/3462306158 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbe147b700 1 -- 172.21.15.33:0/3462306158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd800b200 con 0x7ffbdc06fc20 2022-02-02T13:32:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbe147b700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ffbd8003000 tx=0x7ffbd8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:40.241 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd8011e30 con 0x7ffbdc06fc20 2022-02-02T13:32:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ffbd800d9c0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc10b000 con 0x7ffbdc06fc20 2022-02-02T13:32:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffbd801b740 con 0x7ffbdc06fc20 2022-02-02T13:32:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.165+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc10b490 con 0x7ffbdc06fc20 2022-02-02T13:32:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.166+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 36109+0+0 (secure 0 0 0) 0x7ffbd800f070 con 0x7ffbdc06fc20 2022-02-02T13:32:40.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.166+0000 7ffbcdffb700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 0x7ffbc4032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:40.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.166+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffbd8040ee0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.166+0000 7ffbe0c7a700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 0x7ffbc4032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:40.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.166+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc045ad0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.167+0000 7ffbe0c7a700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 0x7ffbc4032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffbd00096a0 tx=0x7ffbd0006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:40.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.171+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ffbd8016070 con 0x7ffbdc06fc20 2022-02-02T13:32:40.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.530+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ffbdc10c9a0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.583+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ffbd8010dd0 con 0x7ffbdc06fc20 2022-02-02T13:32:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.584+0000 7ffbcdffb700 1 -- 172.21.15.33:0/3462306158 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ffbd8019910 con 0x7ffbdc06fc20 2022-02-02T13:32:40.587 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 msgr2=0x7ffbc4032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 0x7ffbc4032270 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ffbd00096a0 tx=0x7ffbd0006b40).stop 2022-02-02T13:32:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 msgr2=0x7ffbdc10a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ffbd8003000 tx=0x7ffbd8006ee0).stop 2022-02-02T13:32:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 shutdown_connections 2022-02-02T13:32:40.589 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7ffbc402fdb0 0x7ffbc4032270 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:40.589 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 --2- 172.21.15.33:0/3462306158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbdc06fc20 0x7ffbdc10a910 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:40.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 >> 172.21.15.33:0/3462306158 conn(0x7ffbdc0f62a0 msgr2=0x7ffbdc0f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:40.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 shutdown_connections 2022-02-02T13:32:40.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:40.586+0000 7ffbe36df700 1 -- 172.21.15.33:0/3462306158 wait complete. 2022-02-02T13:32:40.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:40 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:32:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:40 smithi033 conmon[31996]: 32:40.531979+0000 mon.smithi033 (mon.0) 26 : audit [INF] from='client.? 172.21.15.33:0/3462306158' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2022-02-02T13:32:41.243 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-02-02T13:32:41.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:41 smithi033 conmon[31996]: audit 2022-02-02T13:32: 2022-02-02T13:32:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:41 smithi033 conmon[31996]: 40.585316+0000 mon.smithi033 (mon.0) 27 : audit [INF] from='client.? 172.21.15.33:0/3462306158' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2022-02-02T13:32:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:41 smithi033 conmon[31996]: cluster 2022-02-02T13:32:40.585390+0000 mon.smithi033 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi033.xvkvzp(active, since 11s) 2022-02-02T13:32:41.783 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.781+0000 7f9dbf073700 1 Processor -- start 2022-02-02T13:32:41.783 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.781+0000 7f9dbf073700 1 -- start start 2022-02-02T13:32:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbf073700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbf073700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db80fed10 con 0x7f9db806fb80 2022-02-02T13:32:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbce0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbce0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55466/0 (socket says 172.21.15.33:55466) 2022-02-02T13:32:41.785 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbce0f700 1 -- 172.21.15.33:0/2397912292 learned_addr learned my addr 172.21.15.33:0/2397912292 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:41.785 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbce0f700 1 -- 172.21.15.33:0/2397912292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db80fee50 con 0x7f9db806fb80 2022-02-02T13:32:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9dbce0f700 1 --2- 172.21.15.33:0/2397912292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dac00b5f0 tx=0x7f9dac006ee0).ready entity=mon.0 client_cookie=f97426c38b6d1106 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9db77fe700 1 -- 172.21.15.33:0/2397912292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dac00d600 con 0x7f9db806fb80 2022-02-02T13:32:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.782+0000 7f9db77fe700 1 -- 172.21.15.33:0/2397912292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9dac00dbb0 con 0x7f9db806fb80 2022-02-02T13:32:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9db77fe700 1 -- 172.21.15.33:0/2397912292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dac011be0 con 0x7f9db806fb80 2022-02-02T13:32:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 -- 172.21.15.33:0/2397912292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 msgr2=0x7f9db80fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2397912292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9dac00b5f0 tx=0x7f9dac006ee0).stop 2022-02-02T13:32:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 -- 172.21.15.33:0/2397912292 shutdown_connections 2022-02-02T13:32:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2397912292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db80fe820 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 -- 172.21.15.33:0/2397912292 >> 172.21.15.33:0/2397912292 conn(0x7f9db80f6260 msgr2=0x7f9db80f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:41.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 -- 172.21.15.33:0/2397912292 shutdown_connections 2022-02-02T13:32:41.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.783+0000 7f9dbf073700 1 -- 172.21.15.33:0/2397912292 wait complete. 2022-02-02T13:32:41.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.784+0000 7f9dbf073700 1 Processor -- start 2022-02-02T13:32:41.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.784+0000 7f9dbf073700 1 -- start start 2022-02-02T13:32:41.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.784+0000 7f9dbf073700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:41.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.784+0000 7f9dbf073700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db810d000 con 0x7f9db806fb80 2022-02-02T13:32:41.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbce0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:41.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbce0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55468/0 (socket says 172.21.15.33:55468) 2022-02-02T13:32:41.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbce0f700 1 -- 172.21.15.33:0/2950673219 learned_addr learned my addr 172.21.15.33:0/2950673219 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:41.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbce0f700 1 -- 172.21.15.33:0/2950673219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac00b200 con 0x7f9db806fb80 2022-02-02T13:32:41.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbce0f700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9dac011550 tx=0x7f9dac006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:41.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dac01b570 con 0x7f9db806fb80 2022-02-02T13:32:41.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f9dac01bb20 con 0x7f9db806fb80 2022-02-02T13:32:41.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dac01a920 con 0x7f9db806fb80 2022-02-02T13:32:41.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9db810d200 con 0x7f9db806fb80 2022-02-02T13:32:41.794 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.785+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9db810d690 con 0x7f9db806fb80 2022-02-02T13:32:41.794 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.786+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f9dac00f070 con 0x7f9db806fb80 2022-02-02T13:32:41.794 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.786+0000 7f9db57fa700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 0x7f9d9c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:41.794 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.786+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9dac01b6d0 con 0x7f9db806fb80 2022-02-02T13:32:41.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.786+0000 7f9db7fff700 1 -- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 msgr2=0x7f9d9c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:41.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.786+0000 7f9db7fff700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 0x7f9d9c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:32:41.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.787+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d98004fa0 con 0x7f9db806fb80 2022-02-02T13:32:41.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.791+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9dac010dc0 con 0x7f9db806fb80 2022-02-02T13:32:41.987 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.987+0000 7f9db7fff700 1 -- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 msgr2=0x7f9d9c032270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:41.988 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:41.987+0000 7f9db7fff700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 0x7f9d9c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:32:42.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.182+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9d98005e80 con 0x7f9db806fb80 2022-02-02T13:32:42.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.183+0000 7f9db57fa700 1 -- 172.21.15.33:0/2950673219 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f9dac010360 con 0x7f9db806fb80 2022-02-02T13:32:42.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:42.184 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 5, 2022-02-02T13:32:42.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2022-02-02T13:32:42.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "smithi033.xvkvzp", 2022-02-02T13:32:42.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2022-02-02T13:32:42.185 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 msgr2=0x7f9d9c032270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:32:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 0x7f9d9c032270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:32:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 msgr2=0x7f9db810cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9dac011550 tx=0x7f9dac006ee0).stop 2022-02-02T13:32:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 shutdown_connections 2022-02-02T13:32:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7f9d9c02fdb0 0x7f9d9c032270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:32:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 --2- 172.21.15.33:0/2950673219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9db806fb80 0x7f9db810cb10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 >> 172.21.15.33:0/2950673219 conn(0x7f9db80f6260 msgr2=0x7f9db80fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 shutdown_connections 2022-02-02T13:32:42.190 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:42.185+0000 7f9dbf073700 1 -- 172.21.15.33:0/2950673219 wait complete. 2022-02-02T13:32:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2022-02-02T13:32:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 5... 2022-02-02T13:32:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-02-02T13:32:42.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:42 smithi033 conmon[31996]: audit 2022-02-02T13:32:42. 2022-02-02T13:32:42.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:42 smithi033 conmon[31996]: 183762+0000 mon.smithi033 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.33:0/2950673219' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-02-02T13:32:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.091+0000 7fce90923700 1 Processor -- start 2022-02-02T13:32:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.091+0000 7fce90923700 1 -- start start 2022-02-02T13:32:43.093 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.091+0000 7fce90923700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.091+0000 7fce90923700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c0feb60 con 0x7fce8c06fb80 2022-02-02T13:32:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.091+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55476/0 (socket says 172.21.15.33:55476) 2022-02-02T13:32:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce8ad9d700 1 -- 172.21.15.33:0/1167270352 learned_addr learned my addr 172.21.15.33:0/1167270352 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce8ad9d700 1 -- 172.21.15.33:0/1167270352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c0feca0 con 0x7fce8c06fb80 2022-02-02T13:32:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce8ad9d700 1 --2- 172.21.15.33:0/1167270352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fce7c00b5f0 tx=0x7fce7c006ee0).ready entity=mon.0 client_cookie=249b6a0a9c30af62 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce89d9b700 1 -- 172.21.15.33:0/1167270352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7c00d600 con 0x7fce8c06fb80 2022-02-02T13:32:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce89d9b700 1 -- 172.21.15.33:0/1167270352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fce7c00dbb0 con 0x7fce8c06fb80 2022-02-02T13:32:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.092+0000 7fce89d9b700 1 -- 172.21.15.33:0/1167270352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7c011be0 con 0x7fce8c06fb80 2022-02-02T13:32:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 -- 172.21.15.33:0/1167270352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 msgr2=0x7fce8c0fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 --2- 172.21.15.33:0/1167270352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fce7c00b5f0 tx=0x7fce7c006ee0).stop 2022-02-02T13:32:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 -- 172.21.15.33:0/1167270352 shutdown_connections 2022-02-02T13:32:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 --2- 172.21.15.33:0/1167270352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c0fe670 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 -- 172.21.15.33:0/1167270352 >> 172.21.15.33:0/1167270352 conn(0x7fce8c0f6110 msgr2=0x7fce8c0f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 -- 172.21.15.33:0/1167270352 shutdown_connections 2022-02-02T13:32:43.101 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.093+0000 7fce90923700 1 -- 172.21.15.33:0/1167270352 wait complete. 2022-02-02T13:32:43.101 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce90923700 1 Processor -- start 2022-02-02T13:32:43.101 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce90923700 1 -- start start 2022-02-02T13:32:43.101 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce90923700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce90923700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce8c1089e0 con 0x7fce8c06fb80 2022-02-02T13:32:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce8ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55478/0 (socket says 172.21.15.33:55478) 2022-02-02T13:32:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.094+0000 7fce8ad9d700 1 -- 172.21.15.33:0/2314106942 learned_addr learned my addr 172.21.15.33:0/2314106942 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.095+0000 7fce8ad9d700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c00b200 con 0x7fce8c06fb80 2022-02-02T13:32:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.095+0000 7fce8ad9d700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fce7c00df80 tx=0x7fce7c006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.095+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7c01a580 con 0x7fce8c06fb80 2022-02-02T13:32:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.095+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fce7c01ab30 con 0x7fce8c06fb80 2022-02-02T13:32:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.095+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce7c01ba30 con 0x7fce8c06fb80 2022-02-02T13:32:43.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.096+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce8c108be0 con 0x7fce8c06fb80 2022-02-02T13:32:43.104 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.096+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce8c109070 con 0x7fce8c06fb80 2022-02-02T13:32:43.105 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fce7c00f070 con 0x7fce8c06fb80 2022-02-02T13:32:43.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce737fe700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:43.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce78036d20 con 0x7fce780341a0 2022-02-02T13:32:43.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fce7c040fe0 con 0x7fce8c06fb80 2022-02-02T13:32:43.106 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce8a59c700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:43.107 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.097+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:32:43.298 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.298+0000 7fce8a59c700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:43.299 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.298+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:32:43.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.699+0000 7fce8a59c700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:43.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:43.699+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T13:32:44.501 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:44.500+0000 7fce8a59c700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:44.501 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:44.500+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T13:32:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:46.101+0000 7fce8a59c700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2741123903 2022-02-02T13:32:46.103 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:46.101+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T13:32:46.641 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:46.640+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 6) v1 ==== 35970+0+0 (secure 0 0 0) 0x7fce7c0243f0 con 0x7fce8c06fb80 2022-02-02T13:32:46.642 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:46.641+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 msgr2=0x7fce78036660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:32:46.642 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:46.641+0000 7fce737fe700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:32:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: cluster 2022-02-02T13:32:46.589788+0000 mon.smithi033 2022-02-02T13:32:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: (mon.0) 30 : cluster [INF] Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:32:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: cluster 2022-02-02T13:32:46.590180+0000 mon.smithi033 (mon. 2022-02-02T13:32:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: 0) 31 : cluster [INF] Activating manager daemon smithi033.xvkvzp 2022-02-02T13:32:46.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: cluster 2022-02-02T13:32:46.594343 2022-02-02T13:32:46.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:46 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2022-02-02T13:32:47.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.648+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7fce7c022d50 con 0x7fce8c06fb80 2022-02-02T13:32:47.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.648+0000 7fce737fe700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 0x7fce7803a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:47.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.648+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce78036d20 con 0x7fce78037c50 2022-02-02T13:32:47.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.649+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 0x7fce7803a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:47.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.649+0000 7fce8a59c700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 0x7fce7803a040 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fce80006fd0 tx=0x7fce80006cf0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:47.652 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.650+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fce78036d20 con 0x7fce78037c50 2022-02-02T13:32:47.661 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fce8c059100 con 0x7fce78037c50 2022-02-02T13:32:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce737fe700 1 -- 172.21.15.33:0/2314106942 <== mgr.14116 v2:172.21.15.33:6800/162045619 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fce8c059100 con 0x7fce78037c50 2022-02-02T13:32:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:32:47.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2022-02-02T13:32:47.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2022-02-02T13:32:47.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:32:47.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 msgr2=0x7fce7803a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:47.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 0x7fce7803a040 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fce80006fd0 tx=0x7fce80006cf0).stop 2022-02-02T13:32:47.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 msgr2=0x7fce8c1084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:47.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fce7c00df80 tx=0x7fce7c006ee0).stop 2022-02-02T13:32:47.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.661+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 shutdown_connections 2022-02-02T13:32:47.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce8c06fb80 0x7fce8c1084f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:47.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fce78037c50 0x7fce7803a040 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:47.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 --2- 172.21.15.33:0/2314106942 >> [v2:172.21.15.33:6800/2741123903,v1:172.21.15.33:6801/2741123903] conn(0x7fce780341a0 0x7fce78036660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:32:47.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 >> 172.21.15.33:0/2314106942 conn(0x7fce8c0f6110 msgr2=0x7fce8c0fc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:47.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 shutdown_connections 2022-02-02T13:32:47.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:47.662+0000 7fce90923700 1 -- 172.21.15.33:0/2314106942 wait complete. 2022-02-02T13:32:47.906 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: cluster 2022-02-02T13:32:46.642513+0000 mon.smithi033 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi033.xvkvzp(active, starting, since 0.0523998s) 2022-02-02T13:32:47.906 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.645223+0000 mon.smithi033 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:32:47.906 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.645804+0000 mon.smithi033 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:32:47.907 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.646555+0000 mon.smithi033 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:32:47.907 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.646773+0000 mon.smithi033 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:32:47.907 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.646937+0000 mon.smithi033 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:32:47.907 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: cluster 2022-02-02T13:32:46.660584+0000 mon.smithi033 (mon.0) 39 : cluster [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:32:47.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.676982+0000 mon.smithi033 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:47.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.679776+0000 mon.smithi033 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:47.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.684937+0000 mon.smithi033 (mon.0) 42 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:47.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.808883+0000 mon.smithi033 (mon.0) 43 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:47.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.809634+0000 mon.smithi033 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:32:47.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.811262+0000 2022-02-02T13:32:47.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: mon.smithi033 (mon.0) 45 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:32:47.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.813241+0000 mon.smithi033 ( 2022-02-02T13:32:47.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: mon.0) 46 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:32:47.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:32:47.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: 32:46.825006+0000 mon.smithi033 (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:32:47.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: audit 2022-02-02T13:32:46.826345+0000 mon.smithi033 (mon.0) 48 2022-02-02T13:32:47.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:47 smithi033 conmon[31996]: : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:32:48.141 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 5 is available 2022-02-02T13:32:48.141 INFO:teuthology.orchestra.run.smithi033.stderr:Setting orchestrator backend to cephadm... 2022-02-02T13:32:48.141 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2022-02-02T13:32:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f21454d3700 1 Processor -- start 2022-02-02T13:32:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f21454d3700 1 -- start start 2022-02-02T13:32:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f21454d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f21454d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400fc690 con 0x7f214006fb40 2022-02-02T13:32:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f213effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f213effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55514/0 (socket says 172.21.15.33:55514) 2022-02-02T13:32:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.612+0000 7f213effd700 1 -- 172.21.15.33:0/2505164686 learned_addr learned my addr 172.21.15.33:0/2505164686 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f213effd700 1 -- 172.21.15.33:0/2505164686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2140101190 con 0x7f214006fb40 2022-02-02T13:32:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f213effd700 1 --2- 172.21.15.33:0/2505164686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f213000b5f0 tx=0x7f2130006ee0).ready entity=mon.0 client_cookie=c6c988f1975886b4 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f213dffb700 1 -- 172.21.15.33:0/2505164686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f213000d600 con 0x7f214006fb40 2022-02-02T13:32:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f213dffb700 1 -- 172.21.15.33:0/2505164686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f213000dbb0 con 0x7f214006fb40 2022-02-02T13:32:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f213dffb700 1 -- 172.21.15.33:0/2505164686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2130011bb0 con 0x7f214006fb40 2022-02-02T13:32:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f21454d3700 1 -- 172.21.15.33:0/2505164686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 msgr2=0x7f2140100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.613+0000 7f21454d3700 1 --2- 172.21.15.33:0/2505164686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f213000b5f0 tx=0x7f2130006ee0).stop 2022-02-02T13:32:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 -- 172.21.15.33:0/2505164686 shutdown_connections 2022-02-02T13:32:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 --2- 172.21.15.33:0/2505164686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f2140100ca0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 -- 172.21.15.33:0/2505164686 >> 172.21.15.33:0/2505164686 conn(0x7f21400f62e0 msgr2=0x7f21400f8700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 -- 172.21.15.33:0/2505164686 shutdown_connections 2022-02-02T13:32:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 -- 172.21.15.33:0/2505164686 wait complete. 2022-02-02T13:32:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.614+0000 7f21454d3700 1 Processor -- start 2022-02-02T13:32:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f21454d3700 1 -- start start 2022-02-02T13:32:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f21454d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f21454d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214010d010 con 0x7f214006fb40 2022-02-02T13:32:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f213effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f213effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55516/0 (socket says 172.21.15.33:55516) 2022-02-02T13:32:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f213effd700 1 -- 172.21.15.33:0/1581637788 learned_addr learned my addr 172.21.15.33:0/1581637788 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f213effd700 1 -- 172.21.15.33:0/1581637788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213000b200 con 0x7f214006fb40 2022-02-02T13:32:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.615+0000 7f213effd700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2130006cb0 tx=0x7f2130006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.616+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f213001b410 con 0x7f214006fb40 2022-02-02T13:32:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.616+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214010d210 con 0x7f214006fb40 2022-02-02T13:32:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.616+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f213001b9c0 con 0x7f214006fb40 2022-02-02T13:32:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.616+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f213001a6f0 con 0x7f214006fb40 2022-02-02T13:32:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.616+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214010d6a0 con 0x7f214006fb40 2022-02-02T13:32:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.617+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 7) v1 ==== 36040+0+0 (secure 0 0 0) 0x7f213000f070 con 0x7f214006fb40 2022-02-02T13:32:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.617+0000 7f21277fe700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 0x7f212c032180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.617+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2130040e80 con 0x7f214006fb40 2022-02-02T13:32:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.617+0000 7f213e7fc700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 0x7f212c032180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.617+0000 7f213e7fc700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 0x7f212c032180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f21340096a0 tx=0x7f2134006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.618+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2120004fa0 con 0x7f214006fb40 2022-02-02T13:32:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.622+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2130016020 con 0x7f214006fb40 2022-02-02T13:32:48.649 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.649+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f2130024790 con 0x7f214006fb40 2022-02-02T13:32:48.966 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: audit 2022-02-02T13:32:47.651205+0000 2022-02-02T13:32:48.966 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-02-02T13:32:48.966 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: cluster 2022-02-02T13:32:47 2022-02-02T13:32:48.966 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: .651365+0000 mon.smithi033 (mon.0) 49 : cluster [DBG] mgrmap e7: smithi033.xvkvzp(active, since 1.06125s) 2022-02-02T13:32:48.967 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: audit 2022-02-02T13:32: 2022-02-02T13:32:48.967 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:48 smithi033 conmon[31996]: 47.662191+0000 mgr.smithi033.xvkvzp (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-02-02T13:32:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.965+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2120002a50 con 0x7f212c02fcc0 2022-02-02T13:32:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.971+0000 7f21277fe700 1 -- 172.21.15.33:0/1581637788 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2120002a50 con 0x7f212c02fcc0 2022-02-02T13:32:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.972+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 msgr2=0x7f212c032180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.972+0000 7f21454d3700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 0x7f212c032180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f21340096a0 tx=0x7f2134006b40).stop 2022-02-02T13:32:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 msgr2=0x7f214010cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f2130006cb0 tx=0x7f2130006ee0).stop 2022-02-02T13:32:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 shutdown_connections 2022-02-02T13:32:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f212c02fcc0 0x7f212c032180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 --2- 172.21.15.33:0/1581637788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f214006fb40 0x7f214010cb20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 >> 172.21.15.33:0/1581637788 conn(0x7f21400f62e0 msgr2=0x7f21400f7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:48.976 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 shutdown_connections 2022-02-02T13:32:48.977 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:48.973+0000 7f21454d3700 1 -- 172.21.15.33:0/1581637788 wait complete. 2022-02-02T13:32:49.480 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2022-02-02T13:32:49.945 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: cluster 2022-02-02T13:32:48.650896+0000 mon.smithi033 ( 2022-02-02T13:32:49.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: mon.0) 50 : cluster [DBG] mgrmap e8: smithi033.xvkvzp(active, since 2s) 2022-02-02T13:32:49.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: audit 2022-02-02T13:32:48.967309+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:32:49.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: .14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:49.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:32:49.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: 02T13:32:48.971453+0000 mon.smithi033 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:49.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:32:49.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: -02T13:32:48.975795+0000 2022-02-02T13:32:49.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: mon.smithi033 (mon.0) 52 : audit [DBG] 2022-02-02T13:32:49.948 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:49 smithi033 conmon[31996]: from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:32:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.944+0000 7fc91c029700 1 Processor -- start 2022-02-02T13:32:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.944+0000 7fc91c029700 1 -- start start 2022-02-02T13:32:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc91c029700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc91c029700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140fecd0 con 0x7fc91406fb60 2022-02-02T13:32:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc919dc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc919dc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55520/0 (socket says 172.21.15.33:55520) 2022-02-02T13:32:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc919dc5700 1 -- 172.21.15.33:0/4234857211 learned_addr learned my addr 172.21.15.33:0/4234857211 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc919dc5700 1 -- 172.21.15.33:0/4234857211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9140fee10 con 0x7fc91406fb60 2022-02-02T13:32:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.945+0000 7fc919dc5700 1 --2- 172.21.15.33:0/4234857211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc91000b5f0 tx=0x7fc910006ee0).ready entity=mon.0 client_cookie=d574233c219d4ec8 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.946+0000 7fc918dc3700 1 -- 172.21.15.33:0/4234857211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc91000d600 con 0x7fc91406fb60 2022-02-02T13:32:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.946+0000 7fc918dc3700 1 -- 172.21.15.33:0/4234857211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc91000dbb0 con 0x7fc91406fb60 2022-02-02T13:32:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.946+0000 7fc918dc3700 1 -- 172.21.15.33:0/4234857211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc910011bb0 con 0x7fc91406fb60 2022-02-02T13:32:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- 172.21.15.33:0/4234857211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 msgr2=0x7fc9140fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 --2- 172.21.15.33:0/4234857211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fc91000b5f0 tx=0x7fc910006ee0).stop 2022-02-02T13:32:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- 172.21.15.33:0/4234857211 shutdown_connections 2022-02-02T13:32:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 --2- 172.21.15.33:0/4234857211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fe7e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- 172.21.15.33:0/4234857211 >> 172.21.15.33:0/4234857211 conn(0x7fc9140f6240 msgr2=0x7fc9140f8660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- 172.21.15.33:0/4234857211 shutdown_connections 2022-02-02T13:32:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- 172.21.15.33:0/4234857211 wait complete. 2022-02-02T13:32:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 Processor -- start 2022-02-02T13:32:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.947+0000 7fc91c029700 1 -- start start 2022-02-02T13:32:49.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc91c029700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc91c029700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9140fa6e0 con 0x7fc91406fb60 2022-02-02T13:32:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc919dc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc919dc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55522/0 (socket says 172.21.15.33:55522) 2022-02-02T13:32:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc919dc5700 1 -- 172.21.15.33:0/2219499477 learned_addr learned my addr 172.21.15.33:0/2219499477 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc919dc5700 1 -- 172.21.15.33:0/2219499477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91000b200 con 0x7fc91406fb60 2022-02-02T13:32:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc919dc5700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc91000c010 tx=0x7fc910006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc91001b570 con 0x7fc91406fb60 2022-02-02T13:32:49.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7fc91001bb20 con 0x7fc91406fb60 2022-02-02T13:32:49.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9140fa8e0 con 0x7fc91406fb60 2022-02-02T13:32:49.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc91001a920 con 0x7fc91406fb60 2022-02-02T13:32:49.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.948+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9140fad70 con 0x7fc91406fb60 2022-02-02T13:32:49.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.949+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fc91000f070 con 0x7fc91406fb60 2022-02-02T13:32:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.949+0000 7fc9067fc700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 0x7fc8fc032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.949+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc9100411d0 con 0x7fc91406fb60 2022-02-02T13:32:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.950+0000 7fc9195c4700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 0x7fc8fc032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.950+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc914045ad0 con 0x7fc91406fb60 2022-02-02T13:32:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.950+0000 7fc9195c4700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 0x7fc8fc032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc9080096a0 tx=0x7fc908006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:49.954+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc910016070 con 0x7fc91406fb60 2022-02-02T13:32:50.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.243+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9140ffad0 con 0x7fc8fc02fdb0 2022-02-02T13:32:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.244+0000 7fc9067fc700 1 -- 172.21.15.33:0/2219499477 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fc9140ffad0 con 0x7fc8fc02fdb0 2022-02-02T13:32:50.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: value unchanged 2022-02-02T13:32:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 msgr2=0x7fc8fc032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:50.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 0x7fc8fc032270 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc9080096a0 tx=0x7fc908006b40).stop 2022-02-02T13:32:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 msgr2=0x7fc9140fc1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fc91000c010 tx=0x7fc910006ee0).stop 2022-02-02T13:32:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 shutdown_connections 2022-02-02T13:32:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fc8fc02fdb0 0x7fc8fc032270 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:50.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 --2- 172.21.15.33:0/2219499477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91406fb60 0x7fc9140fc1f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 >> 172.21.15.33:0/2219499477 conn(0x7fc9140f6240 msgr2=0x7fc9140f7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 shutdown_connections 2022-02-02T13:32:50.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:50.246+0000 7fc91c029700 1 -- 172.21.15.33:0/2219499477 wait complete. 2022-02-02T13:32:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:Generating ssh key... 2022-02-02T13:32:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2022-02-02T13:32:50.909 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:50 smithi033 conmon[31996]: audit 2022-02-02T13:32:50.245139+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:32:50.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:50 smithi033 conmon[31996]: .14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:51.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.187+0000 7ff5299eb700 1 Processor -- start 2022-02-02T13:32:51.192 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.187+0000 7ff5299eb700 1 -- start start 2022-02-02T13:32:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.187+0000 7ff5299eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.187+0000 7ff5299eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52406ff20 con 0x7ff52406fb00 2022-02-02T13:32:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55526/0 (socket says 172.21.15.33:55526) 2022-02-02T13:32:51.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff522ffd700 1 -- 172.21.15.33:0/10999348 learned_addr learned my addr 172.21.15.33:0/10999348 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:51.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff522ffd700 1 -- 172.21.15.33:0/10999348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240fec20 con 0x7ff52406fb00 2022-02-02T13:32:51.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff522ffd700 1 --2- 172.21.15.33:0/10999348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff51400b5f0 tx=0x7ff514006ee0).ready entity=mon.0 client_cookie=af796469d77c05d3 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:51.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff521ffb700 1 -- 172.21.15.33:0/10999348 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff51400d600 con 0x7ff52406fb00 2022-02-02T13:32:51.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff521ffb700 1 -- 172.21.15.33:0/10999348 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff51400dbb0 con 0x7ff52406fb00 2022-02-02T13:32:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.188+0000 7ff521ffb700 1 -- 172.21.15.33:0/10999348 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff514011bb0 con 0x7ff52406fb00 2022-02-02T13:32:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 -- 172.21.15.33:0/10999348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 msgr2=0x7ff5240fe730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 --2- 172.21.15.33:0/10999348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7ff51400b5f0 tx=0x7ff514006ee0).stop 2022-02-02T13:32:51.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 -- 172.21.15.33:0/10999348 shutdown_connections 2022-02-02T13:32:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 --2- 172.21.15.33:0/10999348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fe730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 -- 172.21.15.33:0/10999348 >> 172.21.15.33:0/10999348 conn(0x7ff5240f6130 msgr2=0x7ff5240f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 -- 172.21.15.33:0/10999348 shutdown_connections 2022-02-02T13:32:51.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.189+0000 7ff5299eb700 1 -- 172.21.15.33:0/10999348 wait complete. 2022-02-02T13:32:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff5299eb700 1 Processor -- start 2022-02-02T13:32:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff5299eb700 1 -- start start 2022-02-02T13:32:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff5299eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff5299eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240fa630 con 0x7ff52406fb00 2022-02-02T13:32:51.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:51.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55528/0 (socket says 172.21.15.33:55528) 2022-02-02T13:32:51.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff522ffd700 1 -- 172.21.15.33:0/964818194 learned_addr learned my addr 172.21.15.33:0/964818194 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:51.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.190+0000 7ff522ffd700 1 -- 172.21.15.33:0/964818194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51400b200 con 0x7ff52406fb00 2022-02-02T13:32:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff522ffd700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff51400bdc0 tx=0x7ff514006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff51401a6e0 con 0x7ff52406fb00 2022-02-02T13:32:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff51401ac90 con 0x7ff52406fb00 2022-02-02T13:32:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240fa7d0 con 0x7ff52406fb00 2022-02-02T13:32:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5240fac60 con 0x7ff52406fb00 2022-02-02T13:32:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.191+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff51401bae0 con 0x7ff52406fb00 2022-02-02T13:32:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.192+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff51400f070 con 0x7ff52406fb00 2022-02-02T13:32:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.192+0000 7ff50b7fe700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 0x7ff510032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.192+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff514041520 con 0x7ff52406fb00 2022-02-02T13:32:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.192+0000 7ff5227fc700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 0x7ff510032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.192+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff524045ad0 con 0x7ff52406fb00 2022-02-02T13:32:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.193+0000 7ff5227fc700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 0x7ff510032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff5180096a0 tx=0x7ff518006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.197+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff514016070 con 0x7ff52406fb00 2022-02-02T13:32:51.485 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.485+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5240ffa10 con 0x7ff51002fdb0 2022-02-02T13:32:51.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:51 smithi033 conmon[31996]: cephadm 2022-02-02T13:32:51.486650+0000 mgr.smithi033.xvkvzp (mgr.14116 2022-02-02T13:32:51.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:51 smithi033 conmon[31996]: ) 6 : cephadm [INF] Generating ssh key... 2022-02-02T13:32:51.823 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.822+0000 7ff50b7fe700 1 -- 172.21.15.33:0/964818194 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff5240ffa10 con 0x7ff51002fdb0 2022-02-02T13:32:51.825 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 msgr2=0x7ff510032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:51.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 0x7ff510032270 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7ff5180096a0 tx=0x7ff518006b40).stop 2022-02-02T13:32:51.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 msgr2=0x7ff5240fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:51.826 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7ff51400bdc0 tx=0x7ff514006ee0).stop 2022-02-02T13:32:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 shutdown_connections 2022-02-02T13:32:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff51002fdb0 0x7ff510032270 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 --2- 172.21.15.33:0/964818194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff52406fb00 0x7ff5240fc1b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 >> 172.21.15.33:0/964818194 conn(0x7ff5240f6130 msgr2=0x7ff5240f7910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:51.827 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 shutdown_connections 2022-02-02T13:32:51.828 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:51.824+0000 7ff5299eb700 1 -- 172.21.15.33:0/964818194 wait complete. 2022-02-02T13:32:52.157 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2022-02-02T13:32:52.655 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f92d9e700 1 Processor -- start 2022-02-02T13:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f92d9e700 1 -- start start 2022-02-02T13:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f92d9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f92d9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0fb390 con 0x7f4f8c0faa80 2022-02-02T13:32:52.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f90b3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:52.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f90b3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55532/0 (socket says 172.21.15.33:55532) 2022-02-02T13:32:52.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f90b3a700 1 -- 172.21.15.33:0/705047417 learned_addr learned my addr 172.21.15.33:0/705047417 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.654+0000 7f4f90b3a700 1 -- 172.21.15.33:0/705047417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0fb4d0 con 0x7f4f8c0faa80 2022-02-02T13:32:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f90b3a700 1 --2- 172.21.15.33:0/705047417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4f8000b5f0 tx=0x7f4f80006ee0).ready entity=mon.0 client_cookie=89f425ca4feba370 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f8b7fe700 1 -- 172.21.15.33:0/705047417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f8000d600 con 0x7f4f8c0faa80 2022-02-02T13:32:52.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f8b7fe700 1 -- 172.21.15.33:0/705047417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f4f8000dbb0 con 0x7f4f8c0faa80 2022-02-02T13:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f8b7fe700 1 -- 172.21.15.33:0/705047417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f80011bb0 con 0x7f4f8c0faa80 2022-02-02T13:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 -- 172.21.15.33:0/705047417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 msgr2=0x7f4f8c0faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/705047417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f4f8000b5f0 tx=0x7f4f80006ee0).stop 2022-02-02T13:32:52.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 -- 172.21.15.33:0/705047417 shutdown_connections 2022-02-02T13:32:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/705047417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c0faea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 -- 172.21.15.33:0/705047417 >> 172.21.15.33:0/705047417 conn(0x7f4f8c0f6260 msgr2=0x7f4f8c0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 -- 172.21.15.33:0/705047417 shutdown_connections 2022-02-02T13:32:52.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.655+0000 7f4f92d9e700 1 -- 172.21.15.33:0/705047417 wait complete. 2022-02-02T13:32:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f92d9e700 1 Processor -- start 2022-02-02T13:32:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f92d9e700 1 -- start start 2022-02-02T13:32:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f92d9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:52.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f92d9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c108b70 con 0x7f4f8c0faa80 2022-02-02T13:32:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f90b3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f90b3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55534/0 (socket says 172.21.15.33:55534) 2022-02-02T13:32:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.656+0000 7f4f90b3a700 1 -- 172.21.15.33:0/2901209862 learned_addr learned my addr 172.21.15.33:0/2901209862 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:52.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f90b3a700 1 -- 172.21.15.33:0/2901209862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8000b200 con 0x7f4f8c0faa80 2022-02-02T13:32:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f90b3a700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f80006c70 tx=0x7f4f80006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f8001b570 con 0x7f4f8c0faa80 2022-02-02T13:32:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c108d70 con 0x7f4f8c0faa80 2022-02-02T13:32:52.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f4f8001bb20 con 0x7f4f8c0faa80 2022-02-02T13:32:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4f8001a8c0 con 0x7f4f8c0faa80 2022-02-02T13:32:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.657+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c109200 con 0x7f4f8c0faa80 2022-02-02T13:32:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.658+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f4f8000f070 con 0x7f4f8c0faa80 2022-02-02T13:32:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.658+0000 7f4f897fa700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 0x7f4f70034460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:52.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.658+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f4f80041380 con 0x7f4f8c0faa80 2022-02-02T13:32:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.658+0000 7f4f8bfff700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 0x7f4f70034460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.658+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c045ad0 con 0x7f4f8c0faa80 2022-02-02T13:32:52.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.659+0000 7f4f8bfff700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 0x7f4f70034460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4f780096a0 tx=0x7f4f78006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:52.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.663+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4f80016030 con 0x7f4f8c0faa80 2022-02-02T13:32:52.954 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:52 smithi033 conmon[31996]: audit 2022-02-02T13:32:51.820187+0000 mon.smithi033 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:52.954 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:52 smithi033 conmon[31996]: audit 2022-02-02T13:32:51.822714+0000 mon.smithi033 (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:52.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.953+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8c10a7b0 con 0x7f4f70031fa0 2022-02-02T13:32:52.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.954+0000 7f4f897fa700 1 -- 172.21.15.33:0/2901209862 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f4f8c10a7b0 con 0x7f4f70031fa0 2022-02-02T13:32:52.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p8LINHmkq+13EMHIbOxHSvoIzzVR1nWTHS/VdKpuwxUrfDb+2lZAByPmiTG5kSn9hcWZfjpcz0nZNXRkUKKjHdoLlaMUyzPzjKcVnekTc0zPOiZFYA8B/Dky1ZPvWXOp/pPO7UZo/d4WtviKHH19KngXV9E+CZa5Ubrp18zaeDA4TGVEylb1KpBbMvuPfnxVAh8je0Mijul9I8doO4gO+0pCCpr1AszksNBG46OIcVzwQ9ICpF9BD1AiviUzZqDU+uQuWmnQCERHRQxljJBAhrhU+F0z9S4lZZ72+8Ej5t7/Vv2tY5JcR2p803voOBSbSmBTvkAK70rbZOy+Jji2Zi55JraFiYA4jX+LpiFeVvUxoqRgvof2tPYMgvXKvUfG/zvQHwjSbNxVFY2t2GDJ9yLI3a/yxbswkLsmn1bAF97fFlsyx601UpnfV6FVngeaVlBmVGgVOKplJGz1G0TBXsNgd3jty3jMhhPYbgR4ufHeJyQ+b9Aq+hFiiNkl+u0= ceph-7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:32:52.956 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 msgr2=0x7f4f70034460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 0x7f4f70034460 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f4f780096a0 tx=0x7f4f78006b40).stop 2022-02-02T13:32:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 msgr2=0x7f4f8c108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:52.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4f80006c70 tx=0x7f4f80006ee0).stop 2022-02-02T13:32:52.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 shutdown_connections 2022-02-02T13:32:52.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f4f70031fa0 0x7f4f70034460 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:52.958 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 --2- 172.21.15.33:0/2901209862 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f8c0faa80 0x7f4f8c108680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 >> 172.21.15.33:0/2901209862 conn(0x7f4f8c0f6260 msgr2=0x7f4f8c0ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 shutdown_connections 2022-02-02T13:32:52.959 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:52.956+0000 7f4f92d9e700 1 -- 172.21.15.33:0/2901209862 wait complete. 2022-02-02T13:32:53.394 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2022-02-02T13:32:53.394 INFO:teuthology.orchestra.run.smithi033.stderr:Adding key to root@localhost authorized_keys... 2022-02-02T13:32:53.395 INFO:teuthology.orchestra.run.smithi033.stderr:Adding host smithi033... 2022-02-02T13:32:53.396 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi033 172.21.15.33 2022-02-02T13:32:53.902 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:53 smithi033 conmon[31996]: audit 2022-02-02T13:32:52.955021+0000 mgr.smithi033.xvkvzp (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:53.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.901+0000 7f949ad35700 1 Processor -- start 2022-02-02T13:32:53.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.901+0000 7f949ad35700 1 -- start start 2022-02-02T13:32:53.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.901+0000 7f949ad35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:53.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.901+0000 7f949ad35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94940fc700 con 0x7f949406fbe0 2022-02-02T13:32:53.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f9498ad1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:53.904 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f9498ad1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55538/0 (socket says 172.21.15.33:55538) 2022-02-02T13:32:53.905 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f9498ad1700 1 -- 172.21.15.33:0/3071433474 learned_addr learned my addr 172.21.15.33:0/3071433474 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:53.905 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f9498ad1700 1 -- 172.21.15.33:0/3071433474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494101170 con 0x7f949406fbe0 2022-02-02T13:32:53.905 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f9498ad1700 1 --2- 172.21.15.33:0/3071433474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f948800b5f0 tx=0x7f9488006ee0).ready entity=mon.0 client_cookie=dbcb1cf8788cfb46 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:53.906 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f94937fe700 1 -- 172.21.15.33:0/3071433474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f948800d600 con 0x7f949406fbe0 2022-02-02T13:32:53.909 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f94937fe700 1 -- 172.21.15.33:0/3071433474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f948800dbb0 con 0x7f949406fbe0 2022-02-02T13:32:53.909 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.902+0000 7f94937fe700 1 -- 172.21.15.33:0/3071433474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488011bb0 con 0x7f949406fbe0 2022-02-02T13:32:53.909 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 -- 172.21.15.33:0/3071433474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 msgr2=0x7f9494100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 --2- 172.21.15.33:0/3071433474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f948800b5f0 tx=0x7f9488006ee0).stop 2022-02-02T13:32:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 -- 172.21.15.33:0/3071433474 shutdown_connections 2022-02-02T13:32:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 --2- 172.21.15.33:0/3071433474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f9494100c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 -- 172.21.15.33:0/3071433474 >> 172.21.15.33:0/3071433474 conn(0x7f94940f62a0 msgr2=0x7f94940f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:53.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 -- 172.21.15.33:0/3071433474 shutdown_connections 2022-02-02T13:32:53.911 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.903+0000 7f949ad35700 1 -- 172.21.15.33:0/3071433474 wait complete. 2022-02-02T13:32:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f949ad35700 1 Processor -- start 2022-02-02T13:32:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f949ad35700 1 -- start start 2022-02-02T13:32:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f949ad35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:53.912 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f949ad35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f949410d000 con 0x7f949406fbe0 2022-02-02T13:32:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f9498ad1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f9498ad1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55540/0 (socket says 172.21.15.33:55540) 2022-02-02T13:32:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.904+0000 7f9498ad1700 1 -- 172.21.15.33:0/2381282387 learned_addr learned my addr 172.21.15.33:0/2381282387 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f9498ad1700 1 -- 172.21.15.33:0/2381282387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948800b200 con 0x7f949406fbe0 2022-02-02T13:32:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f9498ad1700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9488003000 tx=0x7f9488006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488011e30 con 0x7f949406fbe0 2022-02-02T13:32:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f948800d9c0 con 0x7f949406fbe0 2022-02-02T13:32:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f948801b740 con 0x7f949406fbe0 2022-02-02T13:32:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f949410d200 con 0x7f949406fbe0 2022-02-02T13:32:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.905+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949410d690 con 0x7f949406fbe0 2022-02-02T13:32:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.906+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f948800f070 con 0x7f949406fbe0 2022-02-02T13:32:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.906+0000 7f94917fa700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 0x7f9478032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.906+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f9488040ff0 con 0x7f949406fbe0 2022-02-02T13:32:53.915 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.906+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494045ad0 con 0x7f949406fbe0 2022-02-02T13:32:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.907+0000 7f9493fff700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 0x7f9478032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.908+0000 7f9493fff700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 0x7f9478032210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f94800096a0 tx=0x7f9480006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:53.916 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:53.911+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9488016070 con 0x7f949406fbe0 2022-02-02T13:32:54.240 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.240+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}) v1 -- 0x7f949410def0 con 0x7f947802fd50 2022-02-02T13:32:54.987 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Added host 'smithi033' 2022-02-02T13:32:54.987 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.981+0000 7f94917fa700 1 -- 172.21.15.33:0/2381282387 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f949410def0 con 0x7f947802fd50 2022-02-02T13:32:54.987 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.983+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 msgr2=0x7f9478032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:54.987 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 0x7f9478032210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f94800096a0 tx=0x7f9480006b40).stop 2022-02-02T13:32:54.988 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 msgr2=0x7f949410cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:54.988 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f9488003000 tx=0x7f9488006ee0).stop 2022-02-02T13:32:54.988 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 shutdown_connections 2022-02-02T13:32:54.988 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f947802fd50 0x7f9478032210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:54.989 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 --2- 172.21.15.33:0/2381282387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f949406fbe0 0x7f949410cb10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:54.989 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 >> 172.21.15.33:0/2381282387 conn(0x7f94940f62a0 msgr2=0x7f94940f7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:54.989 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 shutdown_connections 2022-02-02T13:32:54.989 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:54.984+0000 7f949ad35700 1 -- 172.21.15.33:0/2381282387 wait complete. 2022-02-02T13:32:55.196 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:54 smithi033 conmon[31996]: audit 2022-02-02T13:32:54.241968+0000 mgr.smithi033.xvkvzp (mgr.14116) 8 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:55.435 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying mon service with default placement... 2022-02-02T13:32:55.436 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2022-02-02T13:32:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.939+0000 7f6b529a2700 1 Processor -- start 2022-02-02T13:32:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.939+0000 7f6b529a2700 1 -- start start 2022-02-02T13:32:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.939+0000 7f6b529a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.939+0000 7f6b529a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0fb1e0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b519a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b519a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55554/0 (socket says 172.21.15.33:55554) 2022-02-02T13:32:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b519a0700 1 -- 172.21.15.33:0/4037484984 learned_addr learned my addr 172.21.15.33:0/4037484984 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b519a0700 1 -- 172.21.15.33:0/4037484984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c0fb320 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b519a0700 1 --2- 172.21.15.33:0/4037484984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6b4000b5f0 tx=0x7f6b40006ee0).ready entity=mon.0 client_cookie=fef2aa7ddf679a12 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.940+0000 7f6b5099e700 1 -- 172.21.15.33:0/4037484984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b4000d600 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b5099e700 1 -- 172.21.15.33:0/4037484984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f6b4000dbb0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b5099e700 1 -- 172.21.15.33:0/4037484984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b40011bb0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b529a2700 1 -- 172.21.15.33:0/4037484984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 msgr2=0x7f6b4c0facf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b529a2700 1 --2- 172.21.15.33:0/4037484984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f6b4000b5f0 tx=0x7f6b40006ee0).stop 2022-02-02T13:32:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b529a2700 1 -- 172.21.15.33:0/4037484984 shutdown_connections 2022-02-02T13:32:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b529a2700 1 --2- 172.21.15.33:0/4037484984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c0facf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.941+0000 7f6b529a2700 1 -- 172.21.15.33:0/4037484984 >> 172.21.15.33:0/4037484984 conn(0x7f6b4c0f6110 msgr2=0x7f6b4c0f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 -- 172.21.15.33:0/4037484984 shutdown_connections 2022-02-02T13:32:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 -- 172.21.15.33:0/4037484984 wait complete. 2022-02-02T13:32:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 Processor -- start 2022-02-02T13:32:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 -- start start 2022-02-02T13:32:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.942+0000 7f6b529a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c10b200 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b519a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b519a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55556/0 (socket says 172.21.15.33:55556) 2022-02-02T13:32:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b519a0700 1 -- 172.21.15.33:0/58599872 learned_addr learned my addr 172.21.15.33:0/58599872 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b519a0700 1 -- 172.21.15.33:0/58599872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4000b200 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b519a0700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b40003000 tx=0x7f6b40006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b4000d9c0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c06fbe0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7f6b4001a9d0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6b4001b880 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.943+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c10fd00 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.944+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c045ad0 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.945+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f6b4000f070 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.945+0000 7f6b3e7fc700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 0x7f6b34032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.945+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f6b40041130 con 0x7f6b4c0fa8d0 2022-02-02T13:32:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.945+0000 7f6b5119f700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 0x7f6b34032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:55.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.946+0000 7f6b5119f700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 0x7f6b34032210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6b480096a0 tx=0x7f6b48006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:55.955 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:55.949+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6b40010540 con 0x7f6b4c0fa8d0 2022-02-02T13:32:56.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:55 smithi033 conmon[31996]: audit 2022-02-02T13:32:54. 2022-02-02T13:32:56.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:55 smithi033 conmon[31996]: 981277+0000 mon.smithi033 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:56.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:55 smithi033 conmon[31996]: cephadm 2022-02-02T13:32:54.981627+0000 mgr.smithi033.xvkvzp (mgr.14116) 9 : cephadm [INF] Added host smithi033 2022-02-02T13:32:56.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:55 smithi033 conmon[31996]: audit 2022-02-02T13:32:54.981920+0000 mon.smithi033 (mon.0) 56 : audit [DBG] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:32:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.292+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b4c057f10 con 0x7f6b3402fd50 2022-02-02T13:32:56.297 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.296+0000 7f6b3e7fc700 1 -- 172.21.15.33:0/58599872 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6b4c057f10 con 0x7f6b3402fd50 2022-02-02T13:32:56.297 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mon update... 2022-02-02T13:32:56.299 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.298+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 msgr2=0x7f6b34032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:56.300 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.298+0000 7f6b529a2700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 0x7f6b34032210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f6b480096a0 tx=0x7f6b48006b40).stop 2022-02-02T13:32:56.300 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.298+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 msgr2=0x7f6b4c10f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:56.300 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.298+0000 7f6b529a2700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f6b40003000 tx=0x7f6b40006ee0).stop 2022-02-02T13:32:56.300 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 shutdown_connections 2022-02-02T13:32:56.301 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f6b3402fd50 0x7f6b34032210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:56.301 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 --2- 172.21.15.33:0/58599872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b4c0fa8d0 0x7f6b4c10f810 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:56.301 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 >> 172.21.15.33:0/58599872 conn(0x7f6b4c0f6110 msgr2=0x7f6b4c0f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:56.301 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 shutdown_connections 2022-02-02T13:32:56.302 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:56.299+0000 7f6b529a2700 1 -- 172.21.15.33:0/58599872 wait complete. 2022-02-02T13:32:56.686 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying mgr service with default placement... 2022-02-02T13:32:56.686 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2022-02-02T13:32:57.280 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7de6c5700 1 Processor -- start 2022-02-02T13:32:57.280 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7de6c5700 1 -- start start 2022-02-02T13:32:57.280 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7de6c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:57.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7de6c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d80fecd0 con 0x7ff7d806fbc0 2022-02-02T13:32:57.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:57.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55560/0 (socket says 172.21.15.33:55560) 2022-02-02T13:32:57.281 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.273+0000 7ff7d7fff700 1 -- 172.21.15.33:0/737253177 learned_addr learned my addr 172.21.15.33:0/737253177 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:57.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.274+0000 7ff7d7fff700 1 -- 172.21.15.33:0/737253177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d80fee10 con 0x7ff7d806fbc0 2022-02-02T13:32:57.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.274+0000 7ff7d7fff700 1 --2- 172.21.15.33:0/737253177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff7c800b5f0 tx=0x7ff7c8006ee0).ready entity=mon.0 client_cookie=f3c0779072d54d6f server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:57.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.274+0000 7ff7d6ffd700 1 -- 172.21.15.33:0/737253177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7c800d600 con 0x7ff7d806fbc0 2022-02-02T13:32:57.282 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.274+0000 7ff7d6ffd700 1 -- 172.21.15.33:0/737253177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff7c800dbb0 con 0x7ff7d806fbc0 2022-02-02T13:32:57.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.274+0000 7ff7d6ffd700 1 -- 172.21.15.33:0/737253177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7c8011bb0 con 0x7ff7d806fbc0 2022-02-02T13:32:57.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 -- 172.21.15.33:0/737253177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 msgr2=0x7ff7d80fe7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:57.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/737253177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ff7c800b5f0 tx=0x7ff7c8006ee0).stop 2022-02-02T13:32:57.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 -- 172.21.15.33:0/737253177 shutdown_connections 2022-02-02T13:32:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/737253177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d80fe7e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 -- 172.21.15.33:0/737253177 >> 172.21.15.33:0/737253177 conn(0x7ff7d80f6260 msgr2=0x7ff7d80f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 -- 172.21.15.33:0/737253177 shutdown_connections 2022-02-02T13:32:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.275+0000 7ff7de6c5700 1 -- 172.21.15.33:0/737253177 wait complete. 2022-02-02T13:32:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.276+0000 7ff7de6c5700 1 Processor -- start 2022-02-02T13:32:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.276+0000 7ff7de6c5700 1 -- start start 2022-02-02T13:32:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.276+0000 7ff7de6c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:57.285 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.276+0000 7ff7de6c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d810ad80 con 0x7ff7d806fbc0 2022-02-02T13:32:57.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:57.286 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55562/0 (socket says 172.21.15.33:55562) 2022-02-02T13:32:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d7fff700 1 -- 172.21.15.33:0/1172416479 learned_addr learned my addr 172.21.15.33:0/1172416479 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:57.287 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d7fff700 1 -- 172.21.15.33:0/1172416479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c800b200 con 0x7ff7d806fbc0 2022-02-02T13:32:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d7fff700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff7c8006cb0 tx=0x7ff7c8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7c801b570 con 0x7ff7d806fbc0 2022-02-02T13:32:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d810af80 con 0x7ff7d806fbc0 2022-02-02T13:32:57.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 983+0+0 (secure 0 0 0) 0x7ff7c801bb20 con 0x7ff7d806fbc0 2022-02-02T13:32:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff7c801a960 con 0x7ff7d806fbc0 2022-02-02T13:32:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.277+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d810b410 con 0x7ff7d806fbc0 2022-02-02T13:32:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.278+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7ff7c800f070 con 0x7ff7d806fbc0 2022-02-02T13:32:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.278+0000 7ff7d4ff9700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 0x7ff7b8032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.278+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7ff7c8041f50 con 0x7ff7d806fbc0 2022-02-02T13:32:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.279+0000 7ff7d77fe700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 0x7ff7b8032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.279+0000 7ff7d77fe700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 0x7ff7b8032270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff7c00096a0 tx=0x7ff7c0006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:57.290 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.279+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc004fa0 con 0x7ff7d806fbc0 2022-02-02T13:32:57.291 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.284+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff7c8016070 con 0x7ff7d806fbc0 2022-02-02T13:32:57.562 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:57 smithi033 conmon[31996]: audit 2022-02-02T13:32:56.294248+0000 mgr.smithi033.xvkvzp (mgr.14116) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:57.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:57 smithi033 conmon[31996]: cephadm 2022-02-02T13:32:56.295061+0000 mgr.smithi033.xvkvzp (mgr.14116) 11 : cephadm [INF] Saving service mon spec with placement count:5 2022-02-02T13:32:57.563 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:57 smithi033 conmon[31996]: audit 2022-02-02T13:32:56.297406+0000 mon.smithi033 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:57.628 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.627+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7bc000bc0 con 0x7ff7b802fdb0 2022-02-02T13:32:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.631+0000 7ff7d4ff9700 1 -- 172.21.15.33:0/1172416479 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff7bc000bc0 con 0x7ff7b802fdb0 2022-02-02T13:32:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mgr update... 2022-02-02T13:32:57.635 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 msgr2=0x7ff7b8032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:57.635 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 0x7ff7b8032270 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7ff7c00096a0 tx=0x7ff7c0006b40).stop 2022-02-02T13:32:57.636 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 msgr2=0x7ff7d810a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:57.636 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff7c8006cb0 tx=0x7ff7c8006ee0).stop 2022-02-02T13:32:57.636 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 shutdown_connections 2022-02-02T13:32:57.637 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7ff7b802fdb0 0x7ff7b8032270 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:57.637 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 --2- 172.21.15.33:0/1172416479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7d806fbc0 0x7ff7d810a890 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:57.638 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.634+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 >> 172.21.15.33:0/1172416479 conn(0x7ff7d80f6260 msgr2=0x7ff7d80f7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:57.638 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.635+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 shutdown_connections 2022-02-02T13:32:57.638 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:57.635+0000 7ff7de6c5700 1 -- 172.21.15.33:0/1172416479 wait complete. 2022-02-02T13:32:57.974 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying crash service with default placement... 2022-02-02T13:32:57.975 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2022-02-02T13:32:58.440 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b1d36e700 1 Processor -- start 2022-02-02T13:32:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b1d36e700 1 -- start start 2022-02-02T13:32:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b1d36e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b1d36e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b180feb80 con 0x7f2b1806fb60 2022-02-02T13:32:58.442 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55566/0 (socket says 172.21.15.33:55566) 2022-02-02T13:32:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.439+0000 7f2b17fff700 1 -- 172.21.15.33:0/2822546831 learned_addr learned my addr 172.21.15.33:0/2822546831 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.440+0000 7f2b17fff700 1 -- 172.21.15.33:0/2822546831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b180fecc0 con 0x7f2b1806fb60 2022-02-02T13:32:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.440+0000 7f2b17fff700 1 --2- 172.21.15.33:0/2822546831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2b0800b5f0 tx=0x7f2b08006ee0).ready entity=mon.0 client_cookie=7e4b0dcae9c2a778 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.440+0000 7f2b16ffd700 1 -- 172.21.15.33:0/2822546831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b0800d600 con 0x7f2b1806fb60 2022-02-02T13:32:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.440+0000 7f2b16ffd700 1 -- 172.21.15.33:0/2822546831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2b0800dbf0 con 0x7f2b1806fb60 2022-02-02T13:32:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.440+0000 7f2b16ffd700 1 -- 172.21.15.33:0/2822546831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b08011bf0 con 0x7f2b1806fb60 2022-02-02T13:32:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2822546831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 msgr2=0x7f2b180fe690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2822546831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f2b0800b5f0 tx=0x7f2b08006ee0).stop 2022-02-02T13:32:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2822546831 shutdown_connections 2022-02-02T13:32:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2822546831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b180fe690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2822546831 >> 172.21.15.33:0/2822546831 conn(0x7f2b180f6110 msgr2=0x7f2b180f8530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:58.445 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2822546831 shutdown_connections 2022-02-02T13:32:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2822546831 wait complete. 2022-02-02T13:32:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.441+0000 7f2b1d36e700 1 Processor -- start 2022-02-02T13:32:58.446 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b1d36e700 1 -- start start 2022-02-02T13:32:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b1d36e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b1d36e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1810ac70 con 0x7f2b1806fb60 2022-02-02T13:32:58.448 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55568/0 (socket says 172.21.15.33:55568) 2022-02-02T13:32:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b17fff700 1 -- 172.21.15.33:0/2441934485 learned_addr learned my addr 172.21.15.33:0/2441934485 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.442+0000 7f2b17fff700 1 -- 172.21.15.33:0/2441934485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0800b200 con 0x7f2b1806fb60 2022-02-02T13:32:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b17fff700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2b08006800 tx=0x7f2b08006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b0800dec0 con 0x7f2b1806fb60 2022-02-02T13:32:58.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2b0801b8a0 con 0x7f2b1806fb60 2022-02-02T13:32:58.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1810ae70 con 0x7f2b1806fb60 2022-02-02T13:32:58.450 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b0801a7f0 con 0x7f2b1806fb60 2022-02-02T13:32:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.443+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1810b300 con 0x7f2b1806fb60 2022-02-02T13:32:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.444+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b18045ad0 con 0x7f2b1806fb60 2022-02-02T13:32:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.445+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7f2b0802b070 con 0x7f2b1806fb60 2022-02-02T13:32:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.445+0000 7f2b14ff9700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 0x7f2b04032210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:58.451 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.445+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2b08041520 con 0x7f2b1806fb60 2022-02-02T13:32:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.445+0000 7f2b177fe700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 0x7f2b04032210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.445+0000 7f2b177fe700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 0x7f2b04032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2b0c0096a0 tx=0x7f2b0c006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:58.452 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.449+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2b0801bdf0 con 0x7f2b1806fb60 2022-02-02T13:32:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:58 smithi033 conmon[31996]: audit 2022-02-02T13:32:57.629419+0000 mgr.smithi033.xvkvzp (mgr.14116) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:32:58.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:58 smithi033 conmon[31996]: cephadm 2022-02-02T13:32:57.629975+0000 mgr.smithi033.xvkvzp (mgr.14116) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2022-02-02T13:32:58.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:58 smithi033 conmon[31996]: audit 2022-02-02T13:32:57.632294+0000 mon.smithi033 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:58.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:58 smithi033 conmon[31996]: audit 2022-02-02T13:32:57.640102+0000 mon.smithi033 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:58.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:58 smithi033 conmon[31996]: audit 2022-02-02T13:32:58.123550+0000 mon.smithi033 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:32:58.800 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.800+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b1810bb60 con 0x7f2b0402fd50 2022-02-02T13:32:58.804 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.804+0000 7f2b14ff9700 1 -- 172.21.15.33:0/2441934485 <== mgr.14116 v2:172.21.15.33:6800/162045619 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f2b1810bb60 con 0x7f2b0402fd50 2022-02-02T13:32:58.805 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled crash update... 2022-02-02T13:32:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 msgr2=0x7f2b04032210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 0x7f2b04032210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f2b0c0096a0 tx=0x7f2b0c006b40).stop 2022-02-02T13:32:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 msgr2=0x7f2b1810a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2b08006800 tx=0x7f2b08006ee0).stop 2022-02-02T13:32:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 shutdown_connections 2022-02-02T13:32:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f2b0402fd50 0x7f2b04032210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 --2- 172.21.15.33:0/2441934485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b1806fb60 0x7f2b1810a780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 >> 172.21.15.33:0/2441934485 conn(0x7f2b180f6110 msgr2=0x7f2b180f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.806+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 shutdown_connections 2022-02-02T13:32:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:58.807+0000 7f2b1d36e700 1 -- 172.21.15.33:0/2441934485 wait complete. 2022-02-02T13:32:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling mgr prometheus module... 2022-02-02T13:32:59.113 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2022-02-02T13:32:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.882+0000 7fcd8be5d700 1 Processor -- start 2022-02-02T13:32:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.882+0000 7fcd8be5d700 1 -- start start 2022-02-02T13:32:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd8be5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd8be5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840fc510 con 0x7fcd840fbc00 2022-02-02T13:32:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd89bf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd89bf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55572/0 (socket says 172.21.15.33:55572) 2022-02-02T13:32:59.886 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd89bf9700 1 -- 172.21.15.33:0/2362385494 learned_addr learned my addr 172.21.15.33:0/2362385494 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:59.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd89bf9700 1 -- 172.21.15.33:0/2362385494 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840fc650 con 0x7fcd840fbc00 2022-02-02T13:32:59.887 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.883+0000 7fcd89bf9700 1 --2- 172.21.15.33:0/2362385494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcd8000b5f0 tx=0x7fcd80006ee0).ready entity=mon.0 client_cookie=99c087d6772c70c2 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.884+0000 7fcd88bf7700 1 -- 172.21.15.33:0/2362385494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8000d600 con 0x7fcd840fbc00 2022-02-02T13:32:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.884+0000 7fcd88bf7700 1 -- 172.21.15.33:0/2362385494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcd8000dbf0 con 0x7fcd840fbc00 2022-02-02T13:32:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.884+0000 7fcd88bf7700 1 -- 172.21.15.33:0/2362385494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd80011bf0 con 0x7fcd840fbc00 2022-02-02T13:32:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.884+0000 7fcd8be5d700 1 -- 172.21.15.33:0/2362385494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 msgr2=0x7fcd840fc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:32:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.884+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/2362385494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fcd8000b5f0 tx=0x7fcd80006ee0).stop 2022-02-02T13:32:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 -- 172.21.15.33:0/2362385494 shutdown_connections 2022-02-02T13:32:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/2362385494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd840fc020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:32:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 -- 172.21.15.33:0/2362385494 >> 172.21.15.33:0/2362385494 conn(0x7fcd840f7440 msgr2=0x7fcd840f9860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:32:59.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 -- 172.21.15.33:0/2362385494 shutdown_connections 2022-02-02T13:32:59.893 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 -- 172.21.15.33:0/2362385494 wait complete. 2022-02-02T13:32:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 Processor -- start 2022-02-02T13:32:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.885+0000 7fcd8be5d700 1 -- start start 2022-02-02T13:32:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd8be5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:59.894 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd8be5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8406f070 con 0x7fcd840fbc00 2022-02-02T13:32:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd89bf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd89bf9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55574/0 (socket says 172.21.15.33:55574) 2022-02-02T13:32:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd89bf9700 1 -- 172.21.15.33:0/169274898 learned_addr learned my addr 172.21.15.33:0/169274898 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:32:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd89bf9700 1 -- 172.21.15.33:0/169274898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8000b200 con 0x7fcd840fbc00 2022-02-02T13:32:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd89bf9700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcd80011e30 tx=0x7fcd80006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8001b410 con 0x7fcd840fbc00 2022-02-02T13:32:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcd8001ba00 con 0x7fcd840fbc00 2022-02-02T13:32:59.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8406f210 con 0x7fcd840fbc00 2022-02-02T13:32:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.886+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd8001a750 con 0x7fcd840fbc00 2022-02-02T13:32:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.887+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8406f6a0 con 0x7fcd840fbc00 2022-02-02T13:32:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.887+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 36120+0+0 (secure 0 0 0) 0x7fcd8000f070 con 0x7fcd840fbc00 2022-02-02T13:32:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.888+0000 7fcd727fc700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 0x7fcd6c032270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:32:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.888+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fcd80042940 con 0x7fcd840fbc00 2022-02-02T13:32:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.888+0000 7fcd893f8700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 0x7fcd6c032270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:32:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.888+0000 7fcd893f8700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 0x7fcd6c032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fcd740096a0 tx=0x7fcd74006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:32:59.898 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.888+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd84059100 con 0x7fcd840fbc00 2022-02-02T13:32:59.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:32:59.893+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd8001f020 con 0x7fcd840fbc00 2022-02-02T13:33:00.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:59 smithi033 conmon[31996]: audit 2022-02-02T13:32:58 2022-02-02T13:33:00.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:59 smithi033 conmon[31996]: .802161+0000 mgr.smithi033.xvkvzp (mgr.14116) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:00.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:59 smithi033 conmon[31996]: cephadm 2022-02-02T13:32:58.802907+0000 mgr.smithi033.xvkvzp (mgr.14116) 15 : cephadm [INF] Saving service crash spec with placement * 2022-02-02T13:33:00.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:59 smithi033 conmon[31996]: audit 2022-02-02T13:32:58.805058+0000 mon.smithi033 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:00.147 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:32:59 smithi033 conmon[31996]: audit 2022-02-02T13:32:59.743848+0000 mon.smithi033 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.33:0/2391353693' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:00.264 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.263+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "prometheus"} v 0) v1 -- 0x7fcd84045ad0 con 0x7fcd840fbc00 2022-02-02T13:33:00.809 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.808+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7fcd8001bb70 con 0x7fcd840fbc00 2022-02-02T13:33:00.810 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.809+0000 7fcd727fc700 1 -- 172.21.15.33:0/169274898 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "prometheus"}]=0 v9) v1 ==== 89+0+0 (secure 0 0 0) 0x7fcd80023b00 con 0x7fcd840fbc00 2022-02-02T13:33:00.814 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.811+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 msgr2=0x7fcd6c032270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:00.814 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.811+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 0x7fcd6c032270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fcd740096a0 tx=0x7fcd74006b40).stop 2022-02-02T13:33:00.815 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.811+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 msgr2=0x7fcd84070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:00.815 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.811+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fcd80011e30 tx=0x7fcd80006ee0).stop 2022-02-02T13:33:00.815 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 shutdown_connections 2022-02-02T13:33:00.816 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7fcd6c02fdb0 0x7fcd6c032270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:00.816 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 --2- 172.21.15.33:0/169274898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd840fbc00 0x7fcd84070bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:00.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 >> 172.21.15.33:0/169274898 conn(0x7fcd840f7440 msgr2=0x7fcd840f8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:00.817 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 shutdown_connections 2022-02-02T13:33:00.818 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:00.812+0000 7fcd8be5d700 1 -- 172.21.15.33:0/169274898 wait complete. 2022-02-02T13:33:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:00 smithi033 conmon[31996]: audit 2022-02-02T13:33:00.265134+0000 mon.smithi033 (mon.0) 2022-02-02T13:33:00.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:00 smithi033 conmon[31996]: 63 : audit [INF] from='client.? 172.21.15.33:0/169274898' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2022-02-02T13:33:01.252 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying prometheus service with default placement... 2022-02-02T13:33:01.253 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2022-02-02T13:33:01.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.761+0000 7f04b3ebb700 1 Processor -- start 2022-02-02T13:33:01.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.761+0000 7f04b3ebb700 1 -- start start 2022-02-02T13:33:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.761+0000 7f04b3ebb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:01.766 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.761+0000 7f04b3ebb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac0fb390 con 0x7f04ac0faa80 2022-02-02T13:33:01.767 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.761+0000 7f04b1c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b1c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55588/0 (socket says 172.21.15.33:55588) 2022-02-02T13:33:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b1c57700 1 -- 172.21.15.33:0/522685681 learned_addr learned my addr 172.21.15.33:0/522685681 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b1c57700 1 -- 172.21.15.33:0/522685681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac0fb4d0 con 0x7f04ac0faa80 2022-02-02T13:33:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b1c57700 1 --2- 172.21.15.33:0/522685681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f04a800b5f0 tx=0x7f04a8006ee0).ready entity=mon.0 client_cookie=72aac7b389905240 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:01.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b0c55700 1 -- 172.21.15.33:0/522685681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04a800d600 con 0x7f04ac0faa80 2022-02-02T13:33:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b0c55700 1 -- 172.21.15.33:0/522685681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f04a800dbf0 con 0x7f04ac0faa80 2022-02-02T13:33:01.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.762+0000 7f04b0c55700 1 -- 172.21.15.33:0/522685681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04a8011bf0 con 0x7f04ac0faa80 2022-02-02T13:33:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 -- 172.21.15.33:0/522685681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 msgr2=0x7f04ac0faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/522685681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f04a800b5f0 tx=0x7f04a8006ee0).stop 2022-02-02T13:33:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 -- 172.21.15.33:0/522685681 shutdown_connections 2022-02-02T13:33:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/522685681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac0faea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 -- 172.21.15.33:0/522685681 >> 172.21.15.33:0/522685681 conn(0x7f04ac0f6260 msgr2=0x7f04ac0f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 -- 172.21.15.33:0/522685681 shutdown_connections 2022-02-02T13:33:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.763+0000 7f04b3ebb700 1 -- 172.21.15.33:0/522685681 wait complete. 2022-02-02T13:33:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b3ebb700 1 Processor -- start 2022-02-02T13:33:01.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b3ebb700 1 -- start start 2022-02-02T13:33:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b3ebb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b3ebb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac10cf90 con 0x7f04ac0faa80 2022-02-02T13:33:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b1c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b1c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55590/0 (socket says 172.21.15.33:55590) 2022-02-02T13:33:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.764+0000 7f04b1c57700 1 -- 172.21.15.33:0/1905944821 learned_addr learned my addr 172.21.15.33:0/1905944821 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f04b1c57700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a800b200 con 0x7f04ac0faa80 2022-02-02T13:33:01.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f04b1c57700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f04a8011de0 tx=0x7f04a8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:01.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04a801b410 con 0x7f04ac0faa80 2022-02-02T13:33:01.776 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f04a801ba00 con 0x7f04ac0faa80 2022-02-02T13:33:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac10d190 con 0x7f04ac0faa80 2022-02-02T13:33:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04a801a840 con 0x7f04ac0faa80 2022-02-02T13:33:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.765+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac10d620 con 0x7f04ac0faa80 2022-02-02T13:33:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac045ad0 con 0x7f04ac0faa80 2022-02-02T13:33:01.777 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.767+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 36134+0+0 (secure 0 0 0) 0x7f04a802b070 con 0x7f04ac0faa80 2022-02-02T13:33:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.767+0000 7f049a7fc700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:01.778 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.767+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f04a8041780 con 0x7f04ac0faa80 2022-02-02T13:33:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.767+0000 7f04b1456700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/162045619 2022-02-02T13:33:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.767+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:33:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.771+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f04a801bb70 con 0x7f04ac0faa80 2022-02-02T13:33:01.968 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.968+0000 7f04b1456700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/162045619 2022-02-02T13:33:01.969 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:01.968+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:33:02.113 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:01 smithi033 conmon[31996]: audit 2022-02-02T13:33:00.810203+0000 mon.smithi033 (mon.0) 64 : 2022-02-02T13:33:02.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:01 smithi033 conmon[31996]: audit [INF] from='client.? 172.21.15.33:0/169274898' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2022-02-02T13:33:02.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:01 smithi033 conmon[31996]: cluster 2022-02-02T13:33:00.810265+0000 mon.smithi033 (mon.0) 65 : cluster [DBG] mgrmap e9: smithi033.xvkvzp(active, since 14s) 2022-02-02T13:33:02.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:02.113+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f04ac10dee0 con 0x7f049402fe00 2022-02-02T13:33:02.369 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:02.369+0000 7f04b1456700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/162045619 2022-02-02T13:33:02.370 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:02.369+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T13:33:03.170 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:03.170+0000 7f04b1456700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/162045619 2022-02-02T13:33:03.171 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:03.170+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T13:33:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:04.771+0000 7f04b1456700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/162045619 2022-02-02T13:33:04.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:04.771+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T13:33:07.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:07.749+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 10) v1 ==== 35984+0+0 (secure 0 0 0) 0x7f04a800f070 con 0x7f04ac0faa80 2022-02-02T13:33:07.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:07.749+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 msgr2=0x7f04940322c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:33:07.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:07.749+0000 7f049a7fc700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:08.036 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:07 smithi033 conmon[31996]: cluster 2022-02-02T13:33:06.802830+0000 mon.smithi033 (mon.0) 66 : cluster [INF] Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:33:08.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:07 smithi033 conmon[31996]: cluster 2022-02-02T13:33:06.803245+0000 mon.smithi033 (mon.0) 67 : cluster [INF] Activating manager daemon smithi033.xvkvzp 2022-02-02T13:33:08.037 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:07 smithi033 conmon[31996]: cluster 2022-02-02T13:33:06.804921+0000 mon.smithi033 (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2022-02-02T13:33:08.758 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.755+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 11) v1 ==== 36054+0+0 (secure 0 0 0) 0x7f04a803d660 con 0x7f04ac0faa80 2022-02-02T13:33:08.759 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.755+0000 7f049a7fc700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 0x7f0494035fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.755+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 --> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f04ac10dee0 con 0x7f0494033bb0 2022-02-02T13:33:08.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.756+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 0x7f0494035fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:08.761 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.756+0000 7f04b1456700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 0x7f0494035fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f049c006fd0 tx=0x7f049c006d30).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.763+0000 7f049a7fc700 1 -- 172.21.15.33:0/1905944821 <== mgr.14144 v2:172.21.15.33:6800/540968763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f04ac10dee0 con 0x7f0494033bb0 2022-02-02T13:33:08.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled prometheus update... 2022-02-02T13:33:08.768 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 msgr2=0x7f0494035fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:08.769 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 0x7f0494035fa0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f049c006fd0 tx=0x7f049c006d30).stop 2022-02-02T13:33:08.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 msgr2=0x7f04ac10caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:08.770 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f04a8011de0 tx=0x7f04a8006ee0).stop 2022-02-02T13:33:08.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 shutdown_connections 2022-02-02T13:33:08.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04ac0faa80 0x7f04ac10caa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:08.771 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0494033bb0 0x7f0494035fa0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:08.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 --2- 172.21.15.33:0/1905944821 >> [v2:172.21.15.33:6800/162045619,v1:172.21.15.33:6801/162045619] conn(0x7f049402fe00 0x7f04940322c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:08.772 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 >> 172.21.15.33:0/1905944821 conn(0x7f04ac0f6260 msgr2=0x7f04ac06f820 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:08.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 shutdown_connections 2022-02-02T13:33:08.773 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:08.766+0000 7f04b3ebb700 1 -- 172.21.15.33:0/1905944821 wait complete. 2022-02-02T13:33:09.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: cluster 2022-02-02T13:33:07.751749+0000 mon.smithi033 2022-02-02T13:33:09.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: (mon.0) 69 : cluster [DBG] mgrmap e10: smithi033.xvkvzp(active, starting, since 0.948576s) 2022-02-02T13:33:09.030 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.753361+0000 mon.smithi033 (mon.0) 70 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:33:09.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.754212+0000 mon.smithi033 (mon.0) 71 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:33:09.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.755416+0000 mon.smithi033 (mon.0) 72 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:33:09.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.755644+0000 mon.smithi033 (mon.0) 73 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:33:09.031 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.755903+0000 mon.smithi033 (mon.0) 74 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:33:09.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: cluster 2022-02-02T13:33:07.770780+0000 mon.smithi033 (mon.0) 75 : cluster [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:33:09.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.915704+0000 mon.smithi033 (mon.0) 76 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:33:09.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.917410+0000 mon.smithi033 (mon.0) 77 : audit [DBG] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:33:09.032 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.936364+0000 mon.smithi033 (mon.0) 2022-02-02T13:33:09.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: 78 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:33:09.033 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:08 smithi033 conmon[31996]: audit 2022-02-02T13:33:07.945353+0000 mon.smithi033 (mon.0) 79 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:33:09.407 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying grafana service with default placement... 2022-02-02T13:33:09.408 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2022-02-02T13:33:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:09 smithi033 conmon[31996]: cluster 2022-02-02T13:33:08.757948+0000 mon.smithi033 (mon.0) 80 : cluster [DBG] mgrmap e11: smithi033.xvkvzp(active, since 1.95478s) 2022-02-02T13:33:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:09 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:08.759643+0000 mgr.smithi033.xvkvzp (mgr.14144) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2022-02-02T13:33:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:09 smithi033 conmon[31996]: audit 2022-02-02T13:33:08.764236+0000 mon.smithi033 (mon.0) 81 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.006+0000 7f909af4a700 1 Processor -- start 2022-02-02T13:33:10.009 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.006+0000 7f909af4a700 1 -- start start 2022-02-02T13:33:10.013 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f909af4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:10.013 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f909af4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90940fc630 con 0x7f909406fb60 2022-02-02T13:33:10.013 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f9098ce6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:10.013 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f9098ce6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55640/0 (socket says 172.21.15.33:55640) 2022-02-02T13:33:10.014 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f9098ce6700 1 -- 172.21.15.33:0/748177108 learned_addr learned my addr 172.21.15.33:0/748177108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:10.014 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f9098ce6700 1 -- 172.21.15.33:0/748177108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094101130 con 0x7f909406fb60 2022-02-02T13:33:10.014 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.007+0000 7f9098ce6700 1 --2- 172.21.15.33:0/748177108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f908800b5f0 tx=0x7f9088006ee0).ready entity=mon.0 client_cookie=90b9dd7b72129832 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:10.015 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.008+0000 7f90937fe700 1 -- 172.21.15.33:0/748177108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f908800d600 con 0x7f909406fb60 2022-02-02T13:33:10.015 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.008+0000 7f90937fe700 1 -- 172.21.15.33:0/748177108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f908800dbf0 con 0x7f909406fb60 2022-02-02T13:33:10.015 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.008+0000 7f90937fe700 1 -- 172.21.15.33:0/748177108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9088011bf0 con 0x7f909406fb60 2022-02-02T13:33:10.015 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 -- 172.21.15.33:0/748177108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 msgr2=0x7f9094100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:10.016 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 --2- 172.21.15.33:0/748177108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f908800b5f0 tx=0x7f9088006ee0).stop 2022-02-02T13:33:10.016 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 -- 172.21.15.33:0/748177108 shutdown_connections 2022-02-02T13:33:10.016 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 --2- 172.21.15.33:0/748177108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f9094100c40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:10.017 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 -- 172.21.15.33:0/748177108 >> 172.21.15.33:0/748177108 conn(0x7f90940f6260 msgr2=0x7f90940f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 -- 172.21.15.33:0/748177108 shutdown_connections 2022-02-02T13:33:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.009+0000 7f909af4a700 1 -- 172.21.15.33:0/748177108 wait complete. 2022-02-02T13:33:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f909af4a700 1 Processor -- start 2022-02-02T13:33:10.018 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f909af4a700 1 -- start start 2022-02-02T13:33:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f909af4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f909af4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909410d020 con 0x7f909406fb60 2022-02-02T13:33:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f9098ce6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f9098ce6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55642/0 (socket says 172.21.15.33:55642) 2022-02-02T13:33:10.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.010+0000 7f9098ce6700 1 -- 172.21.15.33:0/2002909931 learned_addr learned my addr 172.21.15.33:0/2002909931 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:10.020 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f9098ce6700 1 -- 172.21.15.33:0/2002909931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908800b200 con 0x7f909406fb60 2022-02-02T13:33:10.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f9098ce6700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f908800bdc0 tx=0x7f9088006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:10.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f908801b410 con 0x7f909406fb60 2022-02-02T13:33:10.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f909410d220 con 0x7f909406fb60 2022-02-02T13:33:10.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f908801ba00 con 0x7f909406fb60 2022-02-02T13:33:10.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f908801a6b0 con 0x7f909406fb60 2022-02-02T13:33:10.022 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.011+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f909410d6b0 con 0x7f909406fb60 2022-02-02T13:33:10.022 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.012+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f908802b070 con 0x7f909406fb60 2022-02-02T13:33:10.024 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.012+0000 7f90917fa700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 0x7f9078032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:10.024 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.012+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f9088042570 con 0x7f909406fb60 2022-02-02T13:33:10.025 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.012+0000 7f9093fff700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 0x7f9078032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:10.026 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.013+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9074004fa0 con 0x7f909406fb60 2022-02-02T13:33:10.026 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.013+0000 7f9093fff700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 0x7f9078032320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f90800096a0 tx=0x7f9080006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:10.026 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.017+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9088016020 con 0x7f909406fb60 2022-02-02T13:33:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.368+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 --> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f9074002a50 con 0x7f907802fe60 2022-02-02T13:33:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.373+0000 7f90917fa700 1 -- 172.21.15.33:0/2002909931 <== mgr.14144 v2:172.21.15.33:6800/540968763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f9074002a50 con 0x7f907802fe60 2022-02-02T13:33:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled grafana update... 2022-02-02T13:33:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 msgr2=0x7f9078032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 0x7f9078032320 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f90800096a0 tx=0x7f9080006b40).stop 2022-02-02T13:33:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 msgr2=0x7f909410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f908800bdc0 tx=0x7f9088006ee0).stop 2022-02-02T13:33:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 shutdown_connections 2022-02-02T13:33:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f907802fe60 0x7f9078032320 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 --2- 172.21.15.33:0/2002909931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f909406fb60 0x7f909410cb30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 >> 172.21.15.33:0/2002909931 conn(0x7f90940f6260 msgr2=0x7f90940f7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 shutdown_connections 2022-02-02T13:33:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:10.376+0000 7f909af4a700 1 -- 172.21.15.33:0/2002909931 wait complete. 2022-02-02T13:33:10.846 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying node-exporter service with default placement... 2022-02-02T13:33:10.847 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2022-02-02T13:33:10.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:10 smithi033 conmon[31996]: cluster 2022-02-02T13:33:09.768206+0000 mon.smithi033 (mon.0) 82 : cluster [DBG] mgrmap e12: smithi033.xvkvzp(active, since 2s) 2022-02-02T13:33:10.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:10 smithi033 conmon[31996]: audit 2022-02-02T13:33:09.837954+0000 mon.smithi033 (mon.0) 83 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:10.947 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:10 smithi033 conmon[31996]: audit 2022-02-02T13:33:10.373448+0000 mon.smithi033 (mon.0) 84 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.565+0000 7f1975740700 1 Processor -- start 2022-02-02T13:33:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.565+0000 7f1975740700 1 -- start start 2022-02-02T13:33:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.566+0000 7f1975740700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.566+0000 7f1975740700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700feb60 con 0x7f197006fbc0 2022-02-02T13:33:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.566+0000 7f196effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.566+0000 7f196effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55646/0 (socket says 172.21.15.33:55646) 2022-02-02T13:33:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.566+0000 7f196effd700 1 -- 172.21.15.33:0/1457935354 learned_addr learned my addr 172.21.15.33:0/1457935354 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.567+0000 7f196effd700 1 -- 172.21.15.33:0/1457935354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700feca0 con 0x7f197006fbc0 2022-02-02T13:33:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.567+0000 7f196effd700 1 --2- 172.21.15.33:0/1457935354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f196000b5f0 tx=0x7f1960006ee0).ready entity=mon.0 client_cookie=eb30fc960d6d88be server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.567+0000 7f196e7fc700 1 -- 172.21.15.33:0/1457935354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f196000d600 con 0x7f197006fbc0 2022-02-02T13:33:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.567+0000 7f196e7fc700 1 -- 172.21.15.33:0/1457935354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f196000dbf0 con 0x7f197006fbc0 2022-02-02T13:33:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.567+0000 7f196e7fc700 1 -- 172.21.15.33:0/1457935354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1960011bf0 con 0x7f197006fbc0 2022-02-02T13:33:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 -- 172.21.15.33:0/1457935354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 msgr2=0x7f19700fe670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 --2- 172.21.15.33:0/1457935354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f196000b5f0 tx=0x7f1960006ee0).stop 2022-02-02T13:33:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 -- 172.21.15.33:0/1457935354 shutdown_connections 2022-02-02T13:33:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 --2- 172.21.15.33:0/1457935354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f19700fe670 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 -- 172.21.15.33:0/1457935354 >> 172.21.15.33:0/1457935354 conn(0x7f19700f6130 msgr2=0x7f19700f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 -- 172.21.15.33:0/1457935354 shutdown_connections 2022-02-02T13:33:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.568+0000 7f1975740700 1 -- 172.21.15.33:0/1457935354 wait complete. 2022-02-02T13:33:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f1975740700 1 Processor -- start 2022-02-02T13:33:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f1975740700 1 -- start start 2022-02-02T13:33:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f1975740700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f1975740700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197010ce50 con 0x7f197006fbc0 2022-02-02T13:33:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f196effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f196effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55648/0 (socket says 172.21.15.33:55648) 2022-02-02T13:33:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.569+0000 7f196effd700 1 -- 172.21.15.33:0/2358478056 learned_addr learned my addr 172.21.15.33:0/2358478056 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f196effd700 1 -- 172.21.15.33:0/2358478056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196000b200 con 0x7f197006fbc0 2022-02-02T13:33:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f196effd700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1960006800 tx=0x7f1960006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f196001b410 con 0x7f197006fbc0 2022-02-02T13:33:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f196001ba00 con 0x7f197006fbc0 2022-02-02T13:33:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f197010d050 con 0x7f197006fbc0 2022-02-02T13:33:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.570+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f196001a6e0 con 0x7f197006fbc0 2022-02-02T13:33:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.571+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f196000f070 con 0x7f197006fbc0 2022-02-02T13:33:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.571+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197010d4e0 con 0x7f197006fbc0 2022-02-02T13:33:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.571+0000 7f19677fe700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 0x7f1950032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.571+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f196001bb70 con 0x7f197006fbc0 2022-02-02T13:33:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.571+0000 7f1967fff700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 0x7f1950032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.572+0000 7f1967fff700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 0x7f1950032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f19580096a0 tx=0x7f1958006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.572+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1970045ad0 con 0x7f197006fbc0 2022-02-02T13:33:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.576+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1960016030 con 0x7f197006fbc0 2022-02-02T13:33:11.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:11 smithi033 conmon[31996]: audit 2022-02-02T13:33:10.370466+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:33:11.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:11 smithi033 conmon[31996]: mgr.14144) 3 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:11.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:11 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:10.371047+0000 mgr.smithi033.xvkvzp (mgr.14144) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2022-02-02T13:33:11.924 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.922+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 --> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1970106ba0 con 0x7f195002feb0 2022-02-02T13:33:11.927 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.926+0000 7f19677fe700 1 -- 172.21.15.33:0/2358478056 <== mgr.14144 v2:172.21.15.33:6800/540968763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1970106ba0 con 0x7f195002feb0 2022-02-02T13:33:11.927 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2022-02-02T13:33:11.929 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 msgr2=0x7f1950032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:11.930 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 0x7f1950032370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f19580096a0 tx=0x7f1958006b40).stop 2022-02-02T13:33:11.930 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 msgr2=0x7f197010c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:11.930 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f1960006800 tx=0x7f1960006ee0).stop 2022-02-02T13:33:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 shutdown_connections 2022-02-02T13:33:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f195002feb0 0x7f1950032370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 --2- 172.21.15.33:0/2358478056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f197006fbc0 0x7f197010c960 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 >> 172.21.15.33:0/2358478056 conn(0x7f19700f6130 msgr2=0x7f19700f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.928+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 shutdown_connections 2022-02-02T13:33:11.932 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:11.929+0000 7f1975740700 1 -- 172.21.15.33:0/2358478056 wait complete. 2022-02-02T13:33:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying alertmanager service with default placement... 2022-02-02T13:33:12.287 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2022-02-02T13:33:12.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8f386700 1 Processor -- start 2022-02-02T13:33:12.787 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8f386700 1 -- start start 2022-02-02T13:33:12.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8f386700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:12.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8f386700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880fc4b0 con 0x7f2a880fbba0 2022-02-02T13:33:12.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8d122700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:12.788 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8d122700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55652/0 (socket says 172.21.15.33:55652) 2022-02-02T13:33:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.783+0000 7f2a8d122700 1 -- 172.21.15.33:0/33795303 learned_addr learned my addr 172.21.15.33:0/33795303 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.784+0000 7f2a8d122700 1 -- 172.21.15.33:0/33795303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880fc5f0 con 0x7f2a880fbba0 2022-02-02T13:33:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.784+0000 7f2a8d122700 1 --2- 172.21.15.33:0/33795303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2a8400b5f0 tx=0x7f2a84006ee0).ready entity=mon.0 client_cookie=e699781430d2b074 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.784+0000 7f2a77fff700 1 -- 172.21.15.33:0/33795303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a8400d600 con 0x7f2a880fbba0 2022-02-02T13:33:12.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.784+0000 7f2a77fff700 1 -- 172.21.15.33:0/33795303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2a8400dbf0 con 0x7f2a880fbba0 2022-02-02T13:33:12.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.784+0000 7f2a77fff700 1 -- 172.21.15.33:0/33795303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a84011bf0 con 0x7f2a880fbba0 2022-02-02T13:33:12.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 -- 172.21.15.33:0/33795303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 msgr2=0x7f2a880fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:12.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 --2- 172.21.15.33:0/33795303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f2a8400b5f0 tx=0x7f2a84006ee0).stop 2022-02-02T13:33:12.790 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 -- 172.21.15.33:0/33795303 shutdown_connections 2022-02-02T13:33:12.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 --2- 172.21.15.33:0/33795303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a880fbfc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:12.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 -- 172.21.15.33:0/33795303 >> 172.21.15.33:0/33795303 conn(0x7f2a880f73e0 msgr2=0x7f2a880f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:12.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 -- 172.21.15.33:0/33795303 shutdown_connections 2022-02-02T13:33:12.791 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 -- 172.21.15.33:0/33795303 wait complete. 2022-02-02T13:33:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.785+0000 7f2a8f386700 1 Processor -- start 2022-02-02T13:33:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8f386700 1 -- start start 2022-02-02T13:33:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8f386700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8f386700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8810ae50 con 0x7f2a880fbba0 2022-02-02T13:33:12.792 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8d122700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8d122700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55654/0 (socket says 172.21.15.33:55654) 2022-02-02T13:33:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8d122700 1 -- 172.21.15.33:0/2697111802 learned_addr learned my addr 172.21.15.33:0/2697111802 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:12.793 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8d122700 1 -- 172.21.15.33:0/2697111802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8400b200 con 0x7f2a880fbba0 2022-02-02T13:33:12.795 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.786+0000 7f2a8d122700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2a84011e30 tx=0x7f2a84006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:12.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.787+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a8401b410 con 0x7f2a880fbba0 2022-02-02T13:33:12.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.787+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2a8401ba00 con 0x7f2a880fbba0 2022-02-02T13:33:12.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.787+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8810b050 con 0x7f2a880fbba0 2022-02-02T13:33:12.796 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.787+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2a8401a750 con 0x7f2a880fbba0 2022-02-02T13:33:12.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.787+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8810b4e0 con 0x7f2a880fbba0 2022-02-02T13:33:12.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f2a8402b070 con 0x7f2a880fbba0 2022-02-02T13:33:12.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a75ffb700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 0x7f2a70032370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:12.797 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88045ad0 con 0x7f2a880fbba0 2022-02-02T13:33:12.798 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f2a840415a0 con 0x7f2a880fbba0 2022-02-02T13:33:12.798 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a8c921700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 0x7f2a70032370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:12.798 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.788+0000 7f2a8c921700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 0x7f2a70032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2a780096a0 tx=0x7f2a78006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:12.798 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:12.793+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2a84022b00 con 0x7f2a880fbba0 2022-02-02T13:33:13.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:12 smithi033 conmon[31996]: audit 2022-02-02T13:33:11.924246+0000 mgr.smithi033.xvkvzp (mgr.14144) 5 2022-02-02T13:33:13.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:12 smithi033 conmon[31996]: : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:13.135 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:12 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:11.924977+0000 mgr.smithi033.xvkvzp (mgr.14144) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2022-02-02T13:33:13.136 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:12 smithi033 conmon[31996]: audit 2022-02-02T13:33:11.927269+0000 mon.smithi033 (mon.0) 85 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:13.136 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.134+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 --> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a8810be00 con 0x7f2a7002feb0 2022-02-02T13:33:13.138 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.138+0000 7f2a75ffb700 1 -- 172.21.15.33:0/2697111802 <== mgr.14144 v2:172.21.15.33:6800/540968763 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f2a8810be00 con 0x7f2a7002feb0 2022-02-02T13:33:13.139 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2022-02-02T13:33:13.141 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 msgr2=0x7f2a70032370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 0x7f2a70032370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f2a780096a0 tx=0x7f2a78006b40).stop 2022-02-02T13:33:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 msgr2=0x7f2a8810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f2a84011e30 tx=0x7f2a84006ee0).stop 2022-02-02T13:33:13.142 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 shutdown_connections 2022-02-02T13:33:13.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f2a7002feb0 0x7f2a70032370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:13.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 --2- 172.21.15.33:0/2697111802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a880fbba0 0x7f2a8810a960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:13.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 >> 172.21.15.33:0/2697111802 conn(0x7f2a880f73e0 msgr2=0x7f2a880f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:13.143 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 shutdown_connections 2022-02-02T13:33:13.144 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.140+0000 7f2a8f386700 1 -- 172.21.15.33:0/2697111802 wait complete. 2022-02-02T13:33:13.524 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2022-02-02T13:33:13.995 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.986+0000 7f5a197b0700 1 Processor -- start 2022-02-02T13:33:13.995 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.986+0000 7f5a197b0700 1 -- start start 2022-02-02T13:33:13.996 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a197b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:13.996 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a197b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1406ff20 con 0x7f5a1406fb00 2022-02-02T13:33:13.996 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:13.996 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55658/0 (socket says 172.21.15.33:55658) 2022-02-02T13:33:13.997 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a12ffd700 1 -- 172.21.15.33:0/124575785 learned_addr learned my addr 172.21.15.33:0/124575785 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:13.997 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a12ffd700 1 -- 172.21.15.33:0/124575785 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a140fec20 con 0x7f5a1406fb00 2022-02-02T13:33:13.997 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.987+0000 7f5a12ffd700 1 --2- 172.21.15.33:0/124575785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f59fc00b5f0 tx=0x7f59fc006ee0).ready entity=mon.0 client_cookie=ea9518889aaab3b7 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:13.997 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a11ffb700 1 -- 172.21.15.33:0/124575785 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59fc00d600 con 0x7f5a1406fb00 2022-02-02T13:33:13.998 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a11ffb700 1 -- 172.21.15.33:0/124575785 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f59fc00dbf0 con 0x7f5a1406fb00 2022-02-02T13:33:13.998 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a11ffb700 1 -- 172.21.15.33:0/124575785 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59fc011bf0 con 0x7f5a1406fb00 2022-02-02T13:33:13.998 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 -- 172.21.15.33:0/124575785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 msgr2=0x7f5a140fe730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:13.998 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 --2- 172.21.15.33:0/124575785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f59fc00b5f0 tx=0x7f59fc006ee0).stop 2022-02-02T13:33:13.999 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 -- 172.21.15.33:0/124575785 shutdown_connections 2022-02-02T13:33:13.999 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 --2- 172.21.15.33:0/124575785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fe730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:13.999 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 -- 172.21.15.33:0/124575785 >> 172.21.15.33:0/124575785 conn(0x7f5a140f6130 msgr2=0x7f5a140f8550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:13.999 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 -- 172.21.15.33:0/124575785 shutdown_connections 2022-02-02T13:33:13.999 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.988+0000 7f5a197b0700 1 -- 172.21.15.33:0/124575785 wait complete. 2022-02-02T13:33:14.000 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.989+0000 7f5a197b0700 1 Processor -- start 2022-02-02T13:33:14.000 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.989+0000 7f5a197b0700 1 -- start start 2022-02-02T13:33:14.000 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.989+0000 7f5a197b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:14.000 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.989+0000 7f5a197b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a140fa630 con 0x7f5a1406fb00 2022-02-02T13:33:14.000 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.989+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a12ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55660/0 (socket says 172.21.15.33:55660) 2022-02-02T13:33:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a12ffd700 1 -- 172.21.15.33:0/1254451893 learned_addr learned my addr 172.21.15.33:0/1254451893 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a12ffd700 1 -- 172.21.15.33:0/1254451893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc00b200 con 0x7f5a1406fb00 2022-02-02T13:33:14.001 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a12ffd700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f59fc011e00 tx=0x7f59fc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59fc01b410 con 0x7f5a1406fb00 2022-02-02T13:33:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f59fc01ba00 con 0x7f5a1406fb00 2022-02-02T13:33:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a140fa7d0 con 0x7f5a1406fb00 2022-02-02T13:33:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59fc01a780 con 0x7f5a1406fb00 2022-02-02T13:33:14.002 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.990+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a140fac60 con 0x7f5a1406fb00 2022-02-02T13:33:14.003 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.991+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f59fc02b070 con 0x7f5a1406fb00 2022-02-02T13:33:14.003 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.991+0000 7f5a0b7fe700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 0x7f59f4032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:14.003 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.991+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f59fc0416f0 con 0x7f5a1406fb00 2022-02-02T13:33:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.992+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a14045ad0 con 0x7f5a1406fb00 2022-02-02T13:33:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.992+0000 7f5a127fc700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 0x7f59f4032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:14.004 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.992+0000 7f5a127fc700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 0x7f59f4032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5a040096a0 tx=0x7f5a04006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:14.005 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:13.996+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f59fc01f080 con 0x7f5a1406fb00 2022-02-02T13:33:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:14 smithi033 conmon[31996]: audit 2022-02-02T13:33:13.136172+0000 mgr.smithi033.xvkvzp (mgr.14144) 2022-02-02T13:33:14.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:14 smithi033 conmon[31996]: 7 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:14.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:14 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:13.136746+0000 mgr.smithi033.xvkvzp (mgr.14144) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2022-02-02T13:33:14.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:14 smithi033 conmon[31996]: audit 2022-02-02T13:33:13.139036+0000 mon.smithi033 (mon.0) 86 : audit [INF] from='mgr.14144 172.21.15.33:0/1434607351' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.282+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f5a14104660 con 0x7f5a1406fb00 2022-02-02T13:33:14.288 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.288+0000 7f5a0b7fe700 1 -- 172.21.15.33:0/1254451893 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v9)=0 v9) v1 ==== 142+0+0 (secure 0 0 0) 0x7f59fc016070 con 0x7f5a1406fb00 2022-02-02T13:33:14.291 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 msgr2=0x7f59f4032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:14.291 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 0x7f59f4032320 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5a040096a0 tx=0x7f5a04006b40).stop 2022-02-02T13:33:14.291 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 msgr2=0x7f5a140fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:14.292 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f59fc011e00 tx=0x7f59fc006ee0).stop 2022-02-02T13:33:14.292 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 shutdown_connections 2022-02-02T13:33:14.292 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f59f402fe60 0x7f59f4032320 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 --2- 172.21.15.33:0/1254451893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a1406fb00 0x7f5a140fc1b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 >> 172.21.15.33:0/1254451893 conn(0x7f5a140f6130 msgr2=0x7f5a140f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 shutdown_connections 2022-02-02T13:33:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:14.290+0000 7f5a197b0700 1 -- 172.21.15.33:0/1254451893 wait complete. 2022-02-02T13:33:14.663 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2022-02-02T13:33:15.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.118+0000 7f51bd0dd700 1 Processor -- start 2022-02-02T13:33:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.118+0000 7f51bd0dd700 1 -- start start 2022-02-02T13:33:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.118+0000 7f51bd0dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.118+0000 7f51bd0dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b80fc6e0 con 0x7f51b806fc00 2022-02-02T13:33:15.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.118+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:15.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55664/0 (socket says 172.21.15.33:55664) 2022-02-02T13:33:15.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b6d9d700 1 -- 172.21.15.33:0/1146599774 learned_addr learned my addr 172.21.15.33:0/1146599774 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:15.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b6d9d700 1 -- 172.21.15.33:0/1146599774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b8101150 con 0x7f51b806fc00 2022-02-02T13:33:15.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b6d9d700 1 --2- 172.21.15.33:0/1146599774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f51ac00b5f0 tx=0x7f51ac006ee0).ready entity=mon.0 client_cookie=1c415b7b9cb5447b server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:15.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b5d9b700 1 -- 172.21.15.33:0/1146599774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51ac00d600 con 0x7f51b806fc00 2022-02-02T13:33:15.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b5d9b700 1 -- 172.21.15.33:0/1146599774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f51ac00dbf0 con 0x7f51b806fc00 2022-02-02T13:33:15.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.119+0000 7f51b5d9b700 1 -- 172.21.15.33:0/1146599774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51ac011bf0 con 0x7f51b806fc00 2022-02-02T13:33:15.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 -- 172.21.15.33:0/1146599774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 msgr2=0x7f51b8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:15.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/1146599774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f51ac00b5f0 tx=0x7f51ac006ee0).stop 2022-02-02T13:33:15.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 -- 172.21.15.33:0/1146599774 shutdown_connections 2022-02-02T13:33:15.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/1146599774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b8100c60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:15.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 -- 172.21.15.33:0/1146599774 >> 172.21.15.33:0/1146599774 conn(0x7f51b80f62a0 msgr2=0x7f51b80f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:15.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 -- 172.21.15.33:0/1146599774 shutdown_connections 2022-02-02T13:33:15.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 -- 172.21.15.33:0/1146599774 wait complete. 2022-02-02T13:33:15.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.120+0000 7f51bd0dd700 1 Processor -- start 2022-02-02T13:33:15.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51bd0dd700 1 -- start start 2022-02-02T13:33:15.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51bd0dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:15.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51bd0dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b810d020 con 0x7f51b806fc00 2022-02-02T13:33:15.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:15.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55666/0 (socket says 172.21.15.33:55666) 2022-02-02T13:33:15.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51b6d9d700 1 -- 172.21.15.33:0/2851734697 learned_addr learned my addr 172.21.15.33:0/2851734697 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:15.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51b6d9d700 1 -- 172.21.15.33:0/2851734697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac00b200 con 0x7f51b806fc00 2022-02-02T13:33:15.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f51b6d9d700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f51ac011de0 tx=0x7f51ac006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:15.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.121+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51ac01b410 con 0x7f51b806fc00 2022-02-02T13:33:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.122+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b810d220 con 0x7f51b806fc00 2022-02-02T13:33:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.122+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f51ac01ba00 con 0x7f51b806fc00 2022-02-02T13:33:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.122+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f51ac01a7a0 con 0x7f51b806fc00 2022-02-02T13:33:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.122+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b810d6b0 con 0x7f51b806fc00 2022-02-02T13:33:15.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.123+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f51ac02b070 con 0x7f51b806fc00 2022-02-02T13:33:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.123+0000 7f519f7fe700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 0x7f51a4032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.123+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f51ac041680 con 0x7f51b806fc00 2022-02-02T13:33:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.123+0000 7f51b659c700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 0x7f51a4032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.123+0000 7f51b659c700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 0x7f51a4032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f51a80096a0 tx=0x7f51a8006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:15.131 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.124+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b8045ad0 con 0x7f51b806fc00 2022-02-02T13:33:15.131 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.129+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f51ac01f020 con 0x7f51b806fc00 2022-02-02T13:33:15.413 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:15 smithi033 conmon[31996]: audit 2022-02-02T13:33:14.288937+0000 mon.smithi033 (mon.0) 87 : audit [INF] from='client.? 172.21.15.33:0/1254451893' entity='client.admin' 2022-02-02T13:33:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.411+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f51b8106bb0 con 0x7f51b806fc00 2022-02-02T13:33:15.418 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.416+0000 7f519f7fe700 1 -- 172.21.15.33:0/2851734697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v10)=0 v10) v1 ==== 130+0+0 (secure 0 0 0) 0x7f51ac016070 con 0x7f51b806fc00 2022-02-02T13:33:15.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 msgr2=0x7f51a4032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:15.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 0x7f51a4032320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f51a80096a0 tx=0x7f51a8006b40).stop 2022-02-02T13:33:15.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 msgr2=0x7f51b810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:15.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f51ac011de0 tx=0x7f51ac006ee0).stop 2022-02-02T13:33:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 shutdown_connections 2022-02-02T13:33:15.424 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f51a402fe60 0x7f51a4032320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 --2- 172.21.15.33:0/2851734697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51b806fc00 0x7f51b810cb30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.419+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 >> 172.21.15.33:0/2851734697 conn(0x7f51b80f62a0 msgr2=0x7f51b80f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:15.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.420+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 shutdown_connections 2022-02-02T13:33:15.426 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:15.420+0000 7f51bd0dd700 1 -- 172.21.15.33:0/2851734697 wait complete. 2022-02-02T13:33:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling the dashboard module... 2022-02-02T13:33:15.800 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2022-02-02T13:33:16.253 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80aae91700 1 Processor -- start 2022-02-02T13:33:16.254 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80aae91700 1 -- start start 2022-02-02T13:33:16.254 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80aae91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:16.254 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80aae91700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40fc6e0 con 0x7f80a406fc00 2022-02-02T13:33:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80a8c2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80a8c2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55670/0 (socket says 172.21.15.33:55670) 2022-02-02T13:33:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.251+0000 7f80a8c2d700 1 -- 172.21.15.33:0/964336833 learned_addr learned my addr 172.21.15.33:0/964336833 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.252+0000 7f80a8c2d700 1 -- 172.21.15.33:0/964336833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a4101150 con 0x7f80a406fc00 2022-02-02T13:33:16.256 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.252+0000 7f80a8c2d700 1 --2- 172.21.15.33:0/964336833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f809800b5f0 tx=0x7f8098006ee0).ready entity=mon.0 client_cookie=6613940a066b99d7 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:16.259 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.252+0000 7f80a37fe700 1 -- 172.21.15.33:0/964336833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809800d600 con 0x7f80a406fc00 2022-02-02T13:33:16.260 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.252+0000 7f80a37fe700 1 -- 172.21.15.33:0/964336833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f809800dbf0 con 0x7f80a406fc00 2022-02-02T13:33:16.260 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.252+0000 7f80a37fe700 1 -- 172.21.15.33:0/964336833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8098011bf0 con 0x7f80a406fc00 2022-02-02T13:33:16.260 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 -- 172.21.15.33:0/964336833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 msgr2=0x7f80a4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:16.260 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 --2- 172.21.15.33:0/964336833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f809800b5f0 tx=0x7f8098006ee0).stop 2022-02-02T13:33:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 -- 172.21.15.33:0/964336833 shutdown_connections 2022-02-02T13:33:16.261 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 --2- 172.21.15.33:0/964336833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a4100c60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:16.262 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 -- 172.21.15.33:0/964336833 >> 172.21.15.33:0/964336833 conn(0x7f80a40f62a0 msgr2=0x7f80a40f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:16.262 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 -- 172.21.15.33:0/964336833 shutdown_connections 2022-02-02T13:33:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.253+0000 7f80aae91700 1 -- 172.21.15.33:0/964336833 wait complete. 2022-02-02T13:33:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80aae91700 1 Processor -- start 2022-02-02T13:33:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80aae91700 1 -- start start 2022-02-02T13:33:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80aae91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:16.263 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80aae91700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a410d020 con 0x7f80a406fc00 2022-02-02T13:33:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80a8c2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80a8c2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55672/0 (socket says 172.21.15.33:55672) 2022-02-02T13:33:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.254+0000 7f80a8c2d700 1 -- 172.21.15.33:0/548911775 learned_addr learned my addr 172.21.15.33:0/548911775 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:16.264 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80a8c2d700 1 -- 172.21.15.33:0/548911775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809800b200 con 0x7f80a406fc00 2022-02-02T13:33:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80a8c2d700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8098011e00 tx=0x7f8098006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809801b410 con 0x7f80a406fc00 2022-02-02T13:33:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f809801ba00 con 0x7f80a406fc00 2022-02-02T13:33:16.265 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a410d220 con 0x7f80a406fc00 2022-02-02T13:33:16.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f809801a760 con 0x7f80a406fc00 2022-02-02T13:33:16.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.255+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a410d6b0 con 0x7f80a406fc00 2022-02-02T13:33:16.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.256+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 36195+0+0 (secure 0 0 0) 0x7f809802b070 con 0x7f80a406fc00 2022-02-02T13:33:16.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.256+0000 7f80a17fa700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 0x7f8088032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:16.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.256+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f8098041640 con 0x7f80a406fc00 2022-02-02T13:33:16.267 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.256+0000 7f80a3fff700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 0x7f8088032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:16.267 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.256+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a4045ad0 con 0x7f80a406fc00 2022-02-02T13:33:16.267 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.257+0000 7f80a3fff700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 0x7f8088032320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f80900096a0 tx=0x7f8090006b40).ready entity=mgr.14144 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:16.268 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.261+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f809801f080 con 0x7f80a406fc00 2022-02-02T13:33:16.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:16 smithi033 conmon[31996]: audit 2022-02-02T13:33:15.418641+0000 2022-02-02T13:33:16.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:16 smithi033 conmon[31996]: mon.smithi033 (mon.0) 88 : audit [INF] from='client.? 172.21.15.33:0/2851734697' entity='client.admin' 2022-02-02T13:33:16.623 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:16.620+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f80a40008d0 con 0x7f80a406fc00 2022-02-02T13:33:17.421 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.419+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f809800f070 con 0x7f80a406fc00 2022-02-02T13:33:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.421+0000 7f80a17fa700 1 -- 172.21.15.33:0/548911775 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v13) v1 ==== 88+0+0 (secure 0 0 0) 0x7f809802b6c0 con 0x7f80a406fc00 2022-02-02T13:33:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 msgr2=0x7f8088032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 0x7f8088032320 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f80900096a0 tx=0x7f8090006b40).stop 2022-02-02T13:33:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 msgr2=0x7f80a410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f8098011e00 tx=0x7f8098006ee0).stop 2022-02-02T13:33:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 shutdown_connections 2022-02-02T13:33:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f808802fe60 0x7f8088032320 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 --2- 172.21.15.33:0/548911775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a406fc00 0x7f80a410cb30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 >> 172.21.15.33:0/548911775 conn(0x7f80a40f62a0 msgr2=0x7f80a40f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 shutdown_connections 2022-02-02T13:33:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:17.424+0000 7f80aae91700 1 -- 172.21.15.33:0/548911775 wait complete. 2022-02-02T13:33:17.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:17 smithi033 conmon[31996]: audit 2022-02-02T13:33:16.622584+0000 mon.smithi033 (mon 2022-02-02T13:33:17.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:17 smithi033 conmon[31996]: .0) 89 : audit [INF] from='client.? 172.21.15.33:0/548911775' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2022-02-02T13:33:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-02-02T13:33:18.363 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.359+0000 7f0d4ae20700 1 Processor -- start 2022-02-02T13:33:18.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.359+0000 7f0d4ae20700 1 -- start start 2022-02-02T13:33:18.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d4ae20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:18.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d4ae20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440fb390 con 0x7f0d440faa80 2022-02-02T13:33:18.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d48bbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d48bbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55686/0 (socket says 172.21.15.33:55686) 2022-02-02T13:33:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d48bbc700 1 -- 172.21.15.33:0/108197700 learned_addr learned my addr 172.21.15.33:0/108197700 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d48bbc700 1 -- 172.21.15.33:0/108197700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d440fb4d0 con 0x7f0d440faa80 2022-02-02T13:33:18.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.360+0000 7f0d48bbc700 1 --2- 172.21.15.33:0/108197700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0d3800b5f0 tx=0x7f0d38006ee0).ready entity=mon.0 client_cookie=537409a18079c962 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d437fe700 1 -- 172.21.15.33:0/108197700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d3800d600 con 0x7f0d440faa80 2022-02-02T13:33:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d437fe700 1 -- 172.21.15.33:0/108197700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0d3800dbf0 con 0x7f0d440faa80 2022-02-02T13:33:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d437fe700 1 -- 172.21.15.33:0/108197700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d38011bf0 con 0x7f0d440faa80 2022-02-02T13:33:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 -- 172.21.15.33:0/108197700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 msgr2=0x7f0d440faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:18.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/108197700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f0d3800b5f0 tx=0x7f0d38006ee0).stop 2022-02-02T13:33:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 -- 172.21.15.33:0/108197700 shutdown_connections 2022-02-02T13:33:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/108197700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d440faea0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:18.367 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 -- 172.21.15.33:0/108197700 >> 172.21.15.33:0/108197700 conn(0x7f0d440f6260 msgr2=0x7f0d440f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:18.368 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.361+0000 7f0d4ae20700 1 -- 172.21.15.33:0/108197700 shutdown_connections 2022-02-02T13:33:18.371 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.362+0000 7f0d4ae20700 1 -- 172.21.15.33:0/108197700 wait complete. 2022-02-02T13:33:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.362+0000 7f0d4ae20700 1 Processor -- start 2022-02-02T13:33:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.362+0000 7f0d4ae20700 1 -- start start 2022-02-02T13:33:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d4ae20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:18.372 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d4ae20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d440ff110 con 0x7f0d440faa80 2022-02-02T13:33:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d48bbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d48bbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55688/0 (socket says 172.21.15.33:55688) 2022-02-02T13:33:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d48bbc700 1 -- 172.21.15.33:0/2510008205 learned_addr learned my addr 172.21.15.33:0/2510008205 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:18.373 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.363+0000 7f0d48bbc700 1 -- 172.21.15.33:0/2510008205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3800b200 con 0x7f0d440faa80 2022-02-02T13:33:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d48bbc700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0d38011de0 tx=0x7f0d38006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d3801b410 con 0x7f0d440faa80 2022-02-02T13:33:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0d3801ba00 con 0x7f0d440faa80 2022-02-02T13:33:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d440ff2b0 con 0x7f0d440faa80 2022-02-02T13:33:18.374 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d3801a840 con 0x7f0d440faa80 2022-02-02T13:33:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.364+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d440ff740 con 0x7f0d440faa80 2022-02-02T13:33:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f0d3802b070 con 0x7f0d440faa80 2022-02-02T13:33:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d417fa700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 0x7f0d280323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:18.375 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f0d380425d0 con 0x7f0d440faa80 2022-02-02T13:33:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d43fff700 1 -- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 msgr2=0x7f0d280323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d43fff700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 0x7f0d280323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:33:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.365+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d24004fa0 con 0x7f0d440faa80 2022-02-02T13:33:18.376 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.370+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0d38016070 con 0x7f0d440faa80 2022-02-02T13:33:18.567 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.566+0000 7f0d43fff700 1 -- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 msgr2=0x7f0d280323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:18.568 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.566+0000 7f0d43fff700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 0x7f0d280323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:33:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:18 smithi033 conmon[31996]: audit 2022-02-02T13:33:17.423041+0000 mon.smithi033 (mon.0) 90 : audit [INF] 2022-02-02T13:33:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:18 smithi033 conmon[31996]: from='client.? 172.21.15.33:0/548911775' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2022-02-02T13:33:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:18 smithi033 conmon[31996]: cluster 2022-02-02T13:33:17.423133+0000 mon.smithi033 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi033.xvkvzp(active, since 10s) 2022-02-02T13:33:18.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.744+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0d24005e80 con 0x7f0d440faa80 2022-02-02T13:33:18.747 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.744+0000 7f0d417fa700 1 -- 172.21.15.33:0/2510008205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v13) v1 ==== 56+0+104 (secure 0 0 0) 0x7f0d3801f030 con 0x7f0d440faa80 2022-02-02T13:33:18.748 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:33:18.748 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 13, 2022-02-02T13:33:18.749 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2022-02-02T13:33:18.749 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "smithi033.xvkvzp", 2022-02-02T13:33:18.749 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2022-02-02T13:33:18.749 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:33:18.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 msgr2=0x7f0d280323c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:33:18.751 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 0x7f0d280323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:18.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 msgr2=0x7f0d44100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:18.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f0d38011de0 tx=0x7f0d38006ee0).stop 2022-02-02T13:33:18.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 shutdown_connections 2022-02-02T13:33:18.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f0d2802ff00 0x7f0d280323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:18.752 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 --2- 172.21.15.33:0/2510008205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d440faa80 0x7f0d44100c90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:18.753 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.746+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 >> 172.21.15.33:0/2510008205 conn(0x7f0d440f6260 msgr2=0x7f0d440f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:18.753 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.747+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 shutdown_connections 2022-02-02T13:33:18.753 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:18.747+0000 7f0d4ae20700 1 -- 172.21.15.33:0/2510008205 wait complete. 2022-02-02T13:33:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2022-02-02T13:33:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 13... 2022-02-02T13:33:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-02-02T13:33:19.711 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:19 smithi033 conmon[31996]: audit 2022-02-02T13:33:18.746168+0000 mon.smithi033 2022-02-02T13:33:19.711 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:19 smithi033 conmon[31996]: (mon.0) 92 : audit [DBG] from='client.? 172.21.15.33:0/2510008205' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-02-02T13:33:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f7104f07700 1 Processor -- start 2022-02-02T13:33:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f7104f07700 1 -- start start 2022-02-02T13:33:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f7104f07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f7104f07700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71000fb390 con 0x7f71000faa80 2022-02-02T13:33:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f70fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f70fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55696/0 (socket says 172.21.15.33:55696) 2022-02-02T13:33:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.708+0000 7f70fe59c700 1 -- 172.21.15.33:0/2763631312 learned_addr learned my addr 172.21.15.33:0/2763631312 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.709+0000 7f70fe59c700 1 -- 172.21.15.33:0/2763631312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71000fb4d0 con 0x7f71000faa80 2022-02-02T13:33:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.709+0000 7f70fe59c700 1 --2- 172.21.15.33:0/2763631312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f70f000b5f0 tx=0x7f70f0006ee0).ready entity=mon.0 client_cookie=c00ebab48dcfab2b server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.709+0000 7f70fd59a700 1 -- 172.21.15.33:0/2763631312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f000d600 con 0x7f71000faa80 2022-02-02T13:33:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.709+0000 7f70fd59a700 1 -- 172.21.15.33:0/2763631312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f70f000dbf0 con 0x7f71000faa80 2022-02-02T13:33:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.709+0000 7f70fd59a700 1 -- 172.21.15.33:0/2763631312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f0011bf0 con 0x7f71000faa80 2022-02-02T13:33:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 -- 172.21.15.33:0/2763631312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 msgr2=0x7f71000faea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 --2- 172.21.15.33:0/2763631312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f70f000b5f0 tx=0x7f70f0006ee0).stop 2022-02-02T13:33:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 -- 172.21.15.33:0/2763631312 shutdown_connections 2022-02-02T13:33:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 --2- 172.21.15.33:0/2763631312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f71000faea0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 -- 172.21.15.33:0/2763631312 >> 172.21.15.33:0/2763631312 conn(0x7f71000f6260 msgr2=0x7f71000f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 -- 172.21.15.33:0/2763631312 shutdown_connections 2022-02-02T13:33:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.710+0000 7f7104f07700 1 -- 172.21.15.33:0/2763631312 wait complete. 2022-02-02T13:33:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.711+0000 7f7104f07700 1 Processor -- start 2022-02-02T13:33:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.711+0000 7f7104f07700 1 -- start start 2022-02-02T13:33:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.711+0000 7f7104f07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.711+0000 7f7104f07700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710010ada0 con 0x7f71000faa80 2022-02-02T13:33:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55698/0 (socket says 172.21.15.33:55698) 2022-02-02T13:33:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70fe59c700 1 -- 172.21.15.33:0/1332264183 learned_addr learned my addr 172.21.15.33:0/1332264183 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70fe59c700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f000b200 con 0x7f71000faa80 2022-02-02T13:33:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70fe59c700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f70f0011e30 tx=0x7f70f0006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f001b410 con 0x7f71000faa80 2022-02-02T13:33:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f70f001ba00 con 0x7f71000faa80 2022-02-02T13:33:19.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710010afa0 con 0x7f71000faa80 2022-02-02T13:33:19.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f70f001a7b0 con 0x7f71000faa80 2022-02-02T13:33:19.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.712+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710010b430 con 0x7f71000faa80 2022-02-02T13:33:19.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.713+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f70f002b070 con 0x7f71000faa80 2022-02-02T13:33:19.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.714+0000 7f70eeffd700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:19.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.714+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7100059100 con 0x7f70e402ff00 2022-02-02T13:33:19.723 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.714+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f70f0042660 con 0x7f71000faa80 2022-02-02T13:33:19.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.714+0000 7f70fdd9b700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:19.724 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.714+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:33:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.915+0000 7f70fdd9b700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:19.915+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:33:20.317 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:20.316+0000 7f70fdd9b700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:20.318 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:20.316+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T13:33:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:21.117+0000 7f70fdd9b700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:21.117+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T13:33:22.720 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:22.718+0000 7f70fdd9b700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/540968763 2022-02-02T13:33:22.722 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:22.718+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T13:33:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:23.485+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 14) v1 ==== 35997+0+0 (secure 0 0 0) 0x7f70f000f070 con 0x7f71000faa80 2022-02-02T13:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:23.485+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 msgr2=0x7f70e40323c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:33:23.487 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:23.485+0000 7f70eeffd700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:23 smithi033 conmon[31996]: cluster 2022-02-02T13:33:23.434801+0000 mon.smithi033 (mon.0) 93 : cluster [INF] Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:33:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:23 smithi033 conmon[31996]: cluster 2022-02-02T13:33:23.435198+0000 mon.smithi033 (mon.0) 94 : cluster [INF] Activating manager daemon smithi033.xvkvzp 2022-02-02T13:33:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:23 smithi033 conmon[31996]: cluster 2022-02-02T13:33:23.436951+0000 mon.smithi033 (mon.0) 95 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-02-02T13:33:24.493 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.489+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f70f0017ce0 con 0x7f71000faa80 2022-02-02T13:33:24.494 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.490+0000 7f70eeffd700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 0x7f70e4035d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:24.494 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.490+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7100059100 con 0x7f70e4033970 2022-02-02T13:33:24.494 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.490+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 0x7f70e4035d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:24.494 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.490+0000 7f70fdd9b700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 0x7f70e4035d60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f70f4006fd0 tx=0x7f70f4006d70).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.491+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f7100059100 con 0x7f70e4033970 2022-02-02T13:33:24.503 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.501+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7100045ad0 con 0x7f70e4033970 2022-02-02T13:33:24.503 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f70eeffd700 1 -- 172.21.15.33:0/1332264183 <== mgr.14164 v2:172.21.15.33:6800/2305865803 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f7100045ad0 con 0x7f70e4033970 2022-02-02T13:33:24.503 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2022-02-02T13:33:24.504 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2022-02-02T13:33:24.504 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2022-02-02T13:33:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2022-02-02T13:33:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 msgr2=0x7f70e4035d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 0x7f70e4035d60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f70f4006fd0 tx=0x7f70f4006d70).stop 2022-02-02T13:33:24.506 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 msgr2=0x7f710010a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f70f0011e30 tx=0x7f70f0006ee0).stop 2022-02-02T13:33:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 shutdown_connections 2022-02-02T13:33:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f70e4033970 0x7f70e4035d60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:24.507 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71000faa80 0x7f710010a8b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 --2- 172.21.15.33:0/1332264183 >> [v2:172.21.15.33:6800/540968763,v1:172.21.15.33:6801/540968763] conn(0x7f70e402ff00 0x7f70e40323c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:33:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 >> 172.21.15.33:0/1332264183 conn(0x7f71000f6260 msgr2=0x7f71000f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 shutdown_connections 2022-02-02T13:33:24.508 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:24.502+0000 7f7104f07700 1 -- 172.21.15.33:0/1332264183 wait complete. 2022-02-02T13:33:24.828 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 13 is available 2022-02-02T13:33:24.829 INFO:teuthology.orchestra.run.smithi033.stderr:Generating a dashboard self-signed certificate... 2022-02-02T13:33:24.829 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2022-02-02T13:33:24.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: cluster 2022-02-02T13 2022-02-02T13:33:24.833 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: :33:23.488072+0000 mon.smithi033 (mon.0) 96 : cluster [DBG] mgrmap e14: smithi033.xvkvzp(active, starting, since 0.052953s) 2022-02-02T13:33:24.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.490817+0000 mon.smithi033 (mon.0) 97 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:33:24.834 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.491049+0000 mon.smithi033 (mon.0) 98 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:33:24.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.491248+0000 mon.smithi033 (mon.0) 99 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:33:24.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.491413+0000 mon.smithi033 (mon.0) 100 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:33:24.835 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.491568+0000 mon.smithi033 (mon.0) 101 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:33:24.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: cluster 2022-02-02T13:33:23.505616+0000 mon.smithi033 (mon.0) 102 : cluster [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:33:24.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.640025+0000 mon.smithi033 (mon.0) 103 2022-02-02T13:33:24.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:33:24.837 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:23.641228+0000 mon.smithi033 (mon.0) 104 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:33:24.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022-02-02T13:33:24.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: 2022-02-02T13: 2022-02-02T13:33:24.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: 33:23.667899+0000 mon.smithi033 ( 2022-02-02T13:33:24.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: mon.0) 105 : audit 2022-02-02T13:33:24.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:33:24.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:33:24.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: 02-02T13:33:23 2022-02-02T13:33:24.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: .672880+0000 mon.smithi033 (mon.0 2022-02-02T13:33:24.841 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: ) 106 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:33:24.841 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:24 smithi033 conmon[31996]: 2022-02-02T13:33:25.524 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7ce1c5d700 1 Processor -- start 2022-02-02T13:33:25.525 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7ce1c5d700 1 -- start start 2022-02-02T13:33:25.525 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7ce1c5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:25.525 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7ce1c5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0fc4d0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.526 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:25.526 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55740/0 (socket says 172.21.15.33:55740) 2022-02-02T13:33:25.526 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.520+0000 7f7cdb7fe700 1 -- 172.21.15.33:0/992750589 learned_addr learned my addr 172.21.15.33:0/992750589 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:25.526 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.521+0000 7f7cdb7fe700 1 -- 172.21.15.33:0/992750589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0fc610 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.527 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.521+0000 7f7cdb7fe700 1 --2- 172.21.15.33:0/992750589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ccc00b5f0 tx=0x7f7ccc006ee0).ready entity=mon.0 client_cookie=d88ddeb4b1fc6df1 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:25.527 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.521+0000 7f7cda7fc700 1 -- 172.21.15.33:0/992750589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ccc00d600 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.527 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.521+0000 7f7cda7fc700 1 -- 172.21.15.33:0/992750589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7ccc00dbf0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.521+0000 7f7cda7fc700 1 -- 172.21.15.33:0/992750589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ccc011bf0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/992750589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 msgr2=0x7f7cdc0fbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/992750589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7ccc00b5f0 tx=0x7f7ccc006ee0).stop 2022-02-02T13:33:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/992750589 shutdown_connections 2022-02-02T13:33:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/992750589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc0fbfe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/992750589 >> 172.21.15.33:0/992750589 conn(0x7f7cdc0f73e0 msgr2=0x7f7cdc0f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/992750589 shutdown_connections 2022-02-02T13:33:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/992750589 wait complete. 2022-02-02T13:33:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.522+0000 7f7ce1c5d700 1 Processor -- start 2022-02-02T13:33:25.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7ce1c5d700 1 -- start start 2022-02-02T13:33:25.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7ce1c5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:25.531 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7ce1c5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc06f070 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:25.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55742/0 (socket says 172.21.15.33:55742) 2022-02-02T13:33:25.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7cdb7fe700 1 -- 172.21.15.33:0/2372112129 learned_addr learned my addr 172.21.15.33:0/2372112129 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:25.532 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7cdb7fe700 1 -- 172.21.15.33:0/2372112129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc00b200 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.523+0000 7f7cdb7fe700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7ccc011de0 tx=0x7f7ccc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:25.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.524+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ccc00dec0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.524+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7ccc01b8a0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.533 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.524+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ccc01a760 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.534 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.524+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc06f210 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.534 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.524+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc06f6a0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.534 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.525+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) v1 ==== 36067+0+0 (secure 0 0 0) 0x7f7ccc02b070 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.534 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.525+0000 7f7cc3fff700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 0x7f7cc8032280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:25.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.525+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cdc045ad0 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.525+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7ccc041600 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.526+0000 7f7cdaffd700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 0x7f7cc8032280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:25.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.526+0000 7f7cdaffd700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 0x7f7cc8032280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7cd00096a0 tx=0x7f7cd0006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:25.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.530+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7ccc016080 con 0x7f7cdc0fbbc0 2022-02-02T13:33:25.828 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:25 smithi033 conmon[31996]: audit 2022-02-02T13:33:24.492752+0000 mgr.smithi033.xvkvzp (mgr.14164) 1 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-02-02T13:33:25.828 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:25 smithi033 conmon[31996]: cluster 2022-02-02T13:33:24.493116+0000 mon.smithi033 (mon.0) 107 : cluster [DBG] mgrmap e15: smithi033.xvkvzp(active, since 1.058s) 2022-02-02T13:33:25.829 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:25 smithi033 conmon[31996]: audit 2022-02-02T13:33:24.503831+0000 mgr.smithi033.xvkvzp (mgr.14164) 2 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-02-02T13:33:25.829 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:25 smithi033 conmon[31996]: audit 2022-02-02T13:33:25.392816+0000 mon.smithi033 (mon.0) 108 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.833+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cdc0fda80 con 0x7f7cc802fdc0 2022-02-02T13:33:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.894+0000 7f7cc3fff700 1 -- 172.21.15.33:0/2372112129 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7cdc0fda80 con 0x7f7cc802fdc0 2022-02-02T13:33:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Self-signed certificate created 2022-02-02T13:33:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 msgr2=0x7f7cc8032280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 0x7f7cc8032280 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7cd00096a0 tx=0x7f7cd0006b40).stop 2022-02-02T13:33:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 msgr2=0x7f7cdc070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f7ccc011de0 tx=0x7f7ccc006ee0).stop 2022-02-02T13:33:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 shutdown_connections 2022-02-02T13:33:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cc802fdc0 0x7f7cc8032280 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 --2- 172.21.15.33:0/2372112129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cdc0fbbc0 0x7f7cdc070bf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.896+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 >> 172.21.15.33:0/2372112129 conn(0x7f7cdc0f73e0 msgr2=0x7f7cdc0f8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:25.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.897+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 shutdown_connections 2022-02-02T13:33:25.901 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:25.897+0000 7f7ce1c5d700 1 -- 172.21.15.33:0/2372112129 wait complete. 2022-02-02T13:33:26.716 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial admin user... 2022-02-02T13:33:26.716 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp_uir3csl:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2022-02-02T13:33:27.186 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:26 smithi033 conmon[31996]: audit 2022-02-02T13:33:25 2022-02-02T13:33:27.187 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:26 smithi033 conmon[31996]: .835598+0000 mgr.smithi033.xvkvzp (mgr.14164) 3 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:27.187 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:26 smithi033 conmon[31996]: audit 2022-02-02T13:33:25.892810+0000 mon.smithi033 (mon.0) 109 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:27.187 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:26 smithi033 conmon[31996]: audit 2022-02-02T13:33:25.895927+0000 mon.smithi033 (mon.0) 110 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:27.187 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:26 smithi033 conmon[31996]: cluster 2022-02-02T13:33:26.394435+0000 mon.smithi033 (mon.0) 111 : cluster [DBG] mgrmap e16: smithi033.xvkvzp(active, since 2s) 2022-02-02T13:33:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.185+0000 7f8fc75f7700 1 Processor -- start 2022-02-02T13:33:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.185+0000 7f8fc75f7700 1 -- start start 2022-02-02T13:33:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.185+0000 7f8fc75f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.185+0000 7f8fc75f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc00fb3c0 con 0x7f8fc00faab0 2022-02-02T13:33:27.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8fc5393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:27.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8fc5393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55746/0 (socket says 172.21.15.33:55746) 2022-02-02T13:33:27.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8fc5393700 1 -- 172.21.15.33:0/386987758 learned_addr learned my addr 172.21.15.33:0/386987758 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:27.195 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8fc5393700 1 -- 172.21.15.33:0/386987758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00fb500 con 0x7f8fc00faab0 2022-02-02T13:33:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8fc5393700 1 --2- 172.21.15.33:0/386987758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8fbc00b870 tx=0x7f8fbc006f70).ready entity=mon.0 client_cookie=600bef41df021f server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.186+0000 7f8faffff700 1 -- 172.21.15.33:0/386987758 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fbc00da20 con 0x7f8fc00faab0 2022-02-02T13:33:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8faffff700 1 -- 172.21.15.33:0/386987758 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8fbc010470 con 0x7f8fc00faab0 2022-02-02T13:33:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8faffff700 1 -- 172.21.15.33:0/386987758 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fbc00f5b0 con 0x7f8fc00faab0 2022-02-02T13:33:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8fc75f7700 1 -- 172.21.15.33:0/386987758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 msgr2=0x7f8fc00faed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/386987758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f8fbc00b870 tx=0x7f8fbc006f70).stop 2022-02-02T13:33:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8fc75f7700 1 -- 172.21.15.33:0/386987758 shutdown_connections 2022-02-02T13:33:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/386987758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc00faed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.187+0000 7f8fc75f7700 1 -- 172.21.15.33:0/386987758 >> 172.21.15.33:0/386987758 conn(0x7f8fc00f62f0 msgr2=0x7f8fc00f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.188+0000 7f8fc75f7700 1 -- 172.21.15.33:0/386987758 shutdown_connections 2022-02-02T13:33:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.188+0000 7f8fc75f7700 1 -- 172.21.15.33:0/386987758 wait complete. 2022-02-02T13:33:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.188+0000 7f8fc75f7700 1 Processor -- start 2022-02-02T13:33:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.188+0000 7f8fc75f7700 1 -- start start 2022-02-02T13:33:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc75f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc75f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0108cb0 con 0x7f8fc00faab0 2022-02-02T13:33:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc5393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc5393700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55748/0 (socket says 172.21.15.33:55748) 2022-02-02T13:33:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc5393700 1 -- 172.21.15.33:0/28068319 learned_addr learned my addr 172.21.15.33:0/28068319 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc5393700 1 -- 172.21.15.33:0/28068319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fbc00b480 con 0x7f8fc00faab0 2022-02-02T13:33:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fc5393700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8fbc006800 tx=0x7f8fbc006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fbc00dd20 con 0x7f8fc00faab0 2022-02-02T13:33:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.189+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8fbc00de80 con 0x7f8fc00faab0 2022-02-02T13:33:27.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.190+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8fbc019b20 con 0x7f8fc00faab0 2022-02-02T13:33:27.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.190+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0108eb0 con 0x7f8fc00faab0 2022-02-02T13:33:27.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.190+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc0109340 con 0x7f8fc00faab0 2022-02-02T13:33:27.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f8fbc016030 con 0x7f8fc00faab0 2022-02-02T13:33:27.201 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fadffb700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 0x7f8fa8032410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8fbc0446b0 con 0x7f8fc00faab0 2022-02-02T13:33:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fc4b92700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 0x7f8fa8032410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc0045ad0 con 0x7f8fc00faab0 2022-02-02T13:33:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.191+0000 7f8fc4b92700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 0x7f8fa8032410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8fb00096a0 tx=0x7f8fb0006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.196+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8fbc00f820 con 0x7f8fc00faab0 2022-02-02T13:33:27.512 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.512+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8fc0058f20 con 0x7f8fa802ff50 2022-02-02T13:33:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.757+0000 7f8fadffb700 1 -- 172.21.15.33:0/28068319 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f8fc0058f20 con 0x7f8fa802ff50 2022-02-02T13:33:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$umHZlS6HJB1uuPJcgVE2muklmYvlpZ6005G4vdmHFZ0SKgRp6orfK", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1643808807, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2022-02-02T13:33:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 msgr2=0x7f8fa8032410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 0x7f8fa8032410 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f8fb00096a0 tx=0x7f8fb0006b40).stop 2022-02-02T13:33:27.762 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 msgr2=0x7f8fc01087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8fbc006800 tx=0x7f8fbc006f70).stop 2022-02-02T13:33:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 shutdown_connections 2022-02-02T13:33:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8fa802ff50 0x7f8fa8032410 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 --2- 172.21.15.33:0/28068319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc00faab0 0x7f8fc01087c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:27.763 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 >> 172.21.15.33:0/28068319 conn(0x7f8fc00f62f0 msgr2=0x7f8fc00ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.759+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 shutdown_connections 2022-02-02T13:33:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:27.760+0000 7f8fc75f7700 1 -- 172.21.15.33:0/28068319 wait complete. 2022-02-02T13:33:28.155 INFO:teuthology.orchestra.run.smithi033.stderr:Fetching dashboard port number... 2022-02-02T13:33:28.155 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7b277774-842c-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpe9oajoca:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp3sojkbl7:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2022-02-02T13:33:28.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.682+0000 7f1e1f870700 1 Processor -- start 2022-02-02T13:33:28.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.682+0000 7f1e1f870700 1 -- start start 2022-02-02T13:33:28.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1f870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1f870700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180fed80 con 0x7f1e1806fc60 2022-02-02T13:33:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1d60c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1d60c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55752/0 (socket says 172.21.15.33:55752) 2022-02-02T13:33:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1d60c700 1 -- 172.21.15.33:0/1162416889 learned_addr learned my addr 172.21.15.33:0/1162416889 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:28.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1d60c700 1 -- 172.21.15.33:0/1162416889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e180feec0 con 0x7f1e1806fc60 2022-02-02T13:33:28.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.683+0000 7f1e1d60c700 1 --2- 172.21.15.33:0/1162416889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1e1400b5f0 tx=0x7f1e14006ee0).ready entity=mon.0 client_cookie=f9b2c81eaa19883a server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:28.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e07fff700 1 -- 172.21.15.33:0/1162416889 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1400d600 con 0x7f1e1806fc60 2022-02-02T13:33:28.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e07fff700 1 -- 172.21.15.33:0/1162416889 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1e1400dbf0 con 0x7f1e1806fc60 2022-02-02T13:33:28.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e07fff700 1 -- 172.21.15.33:0/1162416889 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e14011bf0 con 0x7f1e1806fc60 2022-02-02T13:33:28.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e1f870700 1 -- 172.21.15.33:0/1162416889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 msgr2=0x7f1e180fe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:28.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e1f870700 1 --2- 172.21.15.33:0/1162416889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f1e1400b5f0 tx=0x7f1e14006ee0).stop 2022-02-02T13:33:28.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e1f870700 1 -- 172.21.15.33:0/1162416889 shutdown_connections 2022-02-02T13:33:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.684+0000 7f1e1f870700 1 --2- 172.21.15.33:0/1162416889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fe800 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.685+0000 7f1e1f870700 1 -- 172.21.15.33:0/1162416889 >> 172.21.15.33:0/1162416889 conn(0x7f1e180f62a0 msgr2=0x7f1e180f86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.685+0000 7f1e1f870700 1 -- 172.21.15.33:0/1162416889 shutdown_connections 2022-02-02T13:33:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.685+0000 7f1e1f870700 1 -- 172.21.15.33:0/1162416889 wait complete. 2022-02-02T13:33:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.685+0000 7f1e1f870700 1 Processor -- start 2022-02-02T13:33:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.685+0000 7f1e1f870700 1 -- start start 2022-02-02T13:33:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1f870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1f870700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e180fa700 con 0x7f1e1806fc60 2022-02-02T13:33:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1d60c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1d60c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55754/0 (socket says 172.21.15.33:55754) 2022-02-02T13:33:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1d60c700 1 -- 172.21.15.33:0/819780316 learned_addr learned my addr 172.21.15.33:0/819780316 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1d60c700 1 -- 172.21.15.33:0/819780316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1400b200 con 0x7f1e1806fc60 2022-02-02T13:33:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1d60c700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1e1400dfe0 tx=0x7f1e14006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1400da90 con 0x7f1e1806fc60 2022-02-02T13:33:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1e1401b8a0 con 0x7f1e1806fc60 2022-02-02T13:33:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1e1401a710 con 0x7f1e1806fc60 2022-02-02T13:33:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.686+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e180fa8a0 con 0x7f1e1806fc60 2022-02-02T13:33:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.687+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e180fad30 con 0x7f1e1806fc60 2022-02-02T13:33:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.687+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 36208+0+0 (secure 0 0 0) 0x7f1e1400f070 con 0x7f1e1806fc60 2022-02-02T13:33:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.688+0000 7f1e05ffb700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 0x7f1e00032410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.688+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f1e140414d0 con 0x7f1e1806fc60 2022-02-02T13:33:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.688+0000 7f1e1ce0b700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 0x7f1e00032410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.688+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e18059100 con 0x7f1e1806fc60 2022-02-02T13:33:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.688+0000 7f1e1ce0b700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 0x7f1e00032410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1e080096a0 tx=0x7f1e08006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:28.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.692+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1e1401f070 con 0x7f1e1806fc60 2022-02-02T13:33:28.978 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:28 smithi033 conmon[31996]: audit 2022-02-02T13:33:27.513581+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:33:28.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:28 smithi033 conmon[31996]: 14164) 4 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:28.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:28 smithi033 conmon[31996]: audit 2022-02-02T13:33:27.758275+0000 mon.smithi033 (mon.0) 112 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:28.980 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.978+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f1e18045ad0 con 0x7f1e1806fc60 2022-02-02T13:33:28.980 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.978+0000 7f1e05ffb700 1 -- 172.21.15.33:0/819780316 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v10) v1 ==== 112+0+5 (secure 0 0 0) 0x7f1e14016030 con 0x7f1e1806fc60 2022-02-02T13:33:28.980 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 8443 2022-02-02T13:33:28.982 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 msgr2=0x7f1e00032410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:28.982 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 0x7f1e00032410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1e080096a0 tx=0x7f1e08006b40).stop 2022-02-02T13:33:28.982 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 msgr2=0x7f1e180fc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:28.982 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f1e1400dfe0 tx=0x7f1e14006ee0).stop 2022-02-02T13:33:28.983 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 shutdown_connections 2022-02-02T13:33:28.983 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1e0002ff50 0x7f1e00032410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:28.983 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 --2- 172.21.15.33:0/819780316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e1806fc60 0x7f1e180fc280 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:28.983 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 >> 172.21.15.33:0/819780316 conn(0x7f1e180f62a0 msgr2=0x7f1e180f7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:28.983 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 shutdown_connections 2022-02-02T13:33:28.984 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2022-02-02T13:33:28.980+0000 7f1e1f870700 1 -- 172.21.15.33:0/819780316 wait complete. 2022-02-02T13:33:29.392 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled firewalld.service 2022-02-02T13:33:29.400 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: disabled 2022-02-02T13:33:29.401 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active firewalld.service 2022-02-02T13:33:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2022-02-02T13:33:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld.service is not enabled 2022-02-02T13:33:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2022-02-02T13:33:29.411 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph Dashboard is now available at: 2022-02-02T13:33:29.412 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.412 INFO:teuthology.orchestra.run.smithi033.stderr: URL: https://smithi033.front.sepia.ceph.com:8443/ 2022-02-02T13:33:29.412 INFO:teuthology.orchestra.run.smithi033.stderr: User: admin 2022-02-02T13:33:29.412 INFO:teuthology.orchestra.run.smithi033.stderr: Password: jhw6dvsmui 2022-02-02T13:33:29.413 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:You can access the Ceph CLI with: 2022-02-02T13:33:29.415 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.415 INFO:teuthology.orchestra.run.smithi033.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2022-02-02T13:33:29.415 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:Please consider enabling telemetry to help improve Ceph: 2022-02-02T13:33:29.415 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.416 INFO:teuthology.orchestra.run.smithi033.stderr: ceph telemetry on 2022-02-02T13:33:29.416 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.416 INFO:teuthology.orchestra.run.smithi033.stderr:For more information see: 2022-02-02T13:33:29.417 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.417 INFO:teuthology.orchestra.run.smithi033.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2022-02-02T13:33:29.417 INFO:teuthology.orchestra.run.smithi033.stderr: 2022-02-02T13:33:29.417 INFO:teuthology.orchestra.run.smithi033.stderr:Bootstrap complete. 2022-02-02T13:33:29.417 INFO:teuthology.orchestra.run.smithi033.stderr:Releasing lock 139645051754984 on /run/cephadm/7b277774-842c-11ec-8c35-001a4aab830c.lock 2022-02-02T13:33:29.418 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 139645051754984 released on /run/cephadm/7b277774-842c-11ec-8c35-001a4aab830c.lock 2022-02-02T13:33:29.446 INFO:tasks.cephadm:Fetching config... 2022-02-02T13:33:29.447 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:33:29.447 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2022-02-02T13:33:29.505 INFO:tasks.cephadm:Fetching client.admin keyring... 2022-02-02T13:33:29.506 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:33:29.506 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2022-02-02T13:33:29.562 INFO:tasks.cephadm:Fetching mon keyring... 2022-02-02T13:33:29.563 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:33:29.563 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/keyring of=/dev/stdout 2022-02-02T13:33:29.630 INFO:tasks.cephadm:Fetching pub ssh key... 2022-02-02T13:33:29.630 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:33:29.630 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2022-02-02T13:33:29.687 INFO:tasks.cephadm:Installing pub ssh key for root users... 2022-02-02T13:33:29.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p8LINHmkq+13EMHIbOxHSvoIzzVR1nWTHS/VdKpuwxUrfDb+2lZAByPmiTG5kSn9hcWZfjpcz0nZNXRkUKKjHdoLlaMUyzPzjKcVnekTc0zPOiZFYA8B/Dky1ZPvWXOp/pPO7UZo/d4WtviKHH19KngXV9E+CZa5Ubrp18zaeDA4TGVEylb1KpBbMvuPfnxVAh8je0Mijul9I8doO4gO+0pCCpr1AszksNBG46OIcVzwQ9ICpF9BD1AiviUzZqDU+uQuWmnQCERHRQxljJBAhrhU+F0z9S4lZZ72+8Ej5t7/Vv2tY5JcR2p803voOBSbSmBTvkAK70rbZOy+Jji2Zi55JraFiYA4jX+LpiFeVvUxoqRgvof2tPYMgvXKvUfG/zvQHwjSbNxVFY2t2GDJ9yLI3a/yxbswkLsmn1bAF97fFlsyx601UpnfV6FVngeaVlBmVGgVOKplJGz1G0TBXsNgd3jty3jMhhPYbgR4ufHeJyQ+b9Aq+hFiiNkl+u0= ceph-7b277774-842c-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-02-02T13:33:29.768 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p8LINHmkq+13EMHIbOxHSvoIzzVR1nWTHS/VdKpuwxUrfDb+2lZAByPmiTG5kSn9hcWZfjpcz0nZNXRkUKKjHdoLlaMUyzPzjKcVnekTc0zPOiZFYA8B/Dky1ZPvWXOp/pPO7UZo/d4WtviKHH19KngXV9E+CZa5Ubrp18zaeDA4TGVEylb1KpBbMvuPfnxVAh8je0Mijul9I8doO4gO+0pCCpr1AszksNBG46OIcVzwQ9ICpF9BD1AiviUzZqDU+uQuWmnQCERHRQxljJBAhrhU+F0z9S4lZZ72+8Ej5t7/Vv2tY5JcR2p803voOBSbSmBTvkAK70rbZOy+Jji2Zi55JraFiYA4jX+LpiFeVvUxoqRgvof2tPYMgvXKvUfG/zvQHwjSbNxVFY2t2GDJ9yLI3a/yxbswkLsmn1bAF97fFlsyx601UpnfV6FVngeaVlBmVGgVOKplJGz1G0TBXsNgd3jty3jMhhPYbgR4ufHeJyQ+b9Aq+hFiiNkl+u0= ceph-7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:33:29.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p8LINHmkq+13EMHIbOxHSvoIzzVR1nWTHS/VdKpuwxUrfDb+2lZAByPmiTG5kSn9hcWZfjpcz0nZNXRkUKKjHdoLlaMUyzPzjKcVnekTc0zPOiZFYA8B/Dky1ZPvWXOp/pPO7UZo/d4WtviKHH19KngXV9E+CZa5Ubrp18zaeDA4TGVEylb1KpBbMvuPfnxVAh8je0Mijul9I8doO4gO+0pCCpr1AszksNBG46OIcVzwQ9ICpF9BD1AiviUzZqDU+uQuWmnQCERHRQxljJBAhrhU+F0z9S4lZZ72+8Ej5t7/Vv2tY5JcR2p803voOBSbSmBTvkAK70rbZOy+Jji2Zi55JraFiYA4jX+LpiFeVvUxoqRgvof2tPYMgvXKvUfG/zvQHwjSbNxVFY2t2GDJ9yLI3a/yxbswkLsmn1bAF97fFlsyx601UpnfV6FVngeaVlBmVGgVOKplJGz1G0TBXsNgd3jty3jMhhPYbgR4ufHeJyQ+b9Aq+hFiiNkl+u0= ceph-7b277774-842c-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-02-02T13:33:29.830 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4p8LINHmkq+13EMHIbOxHSvoIzzVR1nWTHS/VdKpuwxUrfDb+2lZAByPmiTG5kSn9hcWZfjpcz0nZNXRkUKKjHdoLlaMUyzPzjKcVnekTc0zPOiZFYA8B/Dky1ZPvWXOp/pPO7UZo/d4WtviKHH19KngXV9E+CZa5Ubrp18zaeDA4TGVEylb1KpBbMvuPfnxVAh8je0Mijul9I8doO4gO+0pCCpr1AszksNBG46OIcVzwQ9ICpF9BD1AiviUzZqDU+uQuWmnQCERHRQxljJBAhrhU+F0z9S4lZZ72+8Ej5t7/Vv2tY5JcR2p803voOBSbSmBTvkAK70rbZOy+Jji2Zi55JraFiYA4jX+LpiFeVvUxoqRgvof2tPYMgvXKvUfG/zvQHwjSbNxVFY2t2GDJ9yLI3a/yxbswkLsmn1bAF97fFlsyx601UpnfV6FVngeaVlBmVGgVOKplJGz1G0TBXsNgd3jty3jMhhPYbgR4ufHeJyQ+b9Aq+hFiiNkl+u0= ceph-7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:33:29.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2022-02-02T13:33:29.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:29 smithi033 conmon[31996]: audit 2022-02-02T13:33:28.979233+0000 mon.smithi033 (mon.0) 113 : audit [DBG] from='client.? 172.21.15.33:0/819780316' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2022-02-02T13:33:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:30 smithi033 conmon[31996]: cluster 2022-02-02T13:33:29.760833+0000 mon.smithi033 (mon.0) 2022-02-02T13:33:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:30 smithi033 conmon[31996]: 114 : cluster [DBG] mgrmap e17: smithi033.xvkvzp(active, since 6s) 2022-02-02T13:33:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 -- 172.21.15.33:0/909317323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 msgr2=0x7f87a80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 --2- 172.21.15.33:0/909317323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a80f6930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f879c009fb0 tx=0x7f879c009b30).stop 2022-02-02T13:33:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 -- 172.21.15.33:0/909317323 shutdown_connections 2022-02-02T13:33:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 --2- 172.21.15.33:0/909317323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a80f6930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 -- 172.21.15.33:0/909317323 >> 172.21.15.33:0/909317323 conn(0x7f87a80f1c70 msgr2=0x7f87a80f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:31.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 -- 172.21.15.33:0/909317323 shutdown_connections 2022-02-02T13:33:31.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.844+0000 7f87acc6f700 1 -- 172.21.15.33:0/909317323 wait complete. 2022-02-02T13:33:31.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87acc6f700 1 Processor -- start 2022-02-02T13:33:31.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87acc6f700 1 -- start start 2022-02-02T13:33:31.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87acc6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:31.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87acc6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8069e20 con 0x7f87a80f6510 2022-02-02T13:33:31.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87a659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:31.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87a659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55764/0 (socket says 172.21.15.33:55764) 2022-02-02T13:33:31.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87a659c700 1 -- 172.21.15.33:0/144600331 learned_addr learned my addr 172.21.15.33:0/144600331 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:31.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.845+0000 7f87a659c700 1 -- 172.21.15.33:0/144600331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c005040 con 0x7f87a80f6510 2022-02-02T13:33:31.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f87a659c700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f879c000c00 tx=0x7f879c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:31.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f879c0095f0 con 0x7f87a80f6510 2022-02-02T13:33:31.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a8069fc0 con 0x7f87a80f6510 2022-02-02T13:33:31.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f879c007e50 con 0x7f87a80f6510 2022-02-02T13:33:31.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f879c014e70 con 0x7f87a80f6510 2022-02-02T13:33:31.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.846+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a806a450 con 0x7f87a80f6510 2022-02-02T13:33:31.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f879c01d4e0 con 0x7f87a80f6510 2022-02-02T13:33:31.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8059100 con 0x7f87a80f6510 2022-02-02T13:33:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f8796ffd700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 0x7f8790032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f87a5d9b700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 0x7f8790032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f879c0408a0 con 0x7f87a80f6510 2022-02-02T13:33:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.847+0000 7f87a5d9b700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 0x7f8790032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f87980096a0 tx=0x7f8798006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:31.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:31.852+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f879c01b8b0 con 0x7f87a80f6510 2022-02-02T13:33:32.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.015+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f87a806ac60 con 0x7f87a80f6510 2022-02-02T13:33:32.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.018+0000 7f8796ffd700 1 -- 172.21.15.33:0/144600331 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v11)=0 v11) v1 ==== 125+0+0 (secure 0 0 0) 0x7f879c01b2c0 con 0x7f87a80f6510 2022-02-02T13:33:32.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 msgr2=0x7f8790032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:32.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 0x7f8790032420 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f87980096a0 tx=0x7f8798006b40).stop 2022-02-02T13:33:32.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 msgr2=0x7f87a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:32.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f879c000c00 tx=0x7f879c00b040).stop 2022-02-02T13:33:32.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 shutdown_connections 2022-02-02T13:33:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f879002ff60 0x7f8790032420 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 --2- 172.21.15.33:0/144600331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87a80f6510 0x7f87a806b9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 >> 172.21.15.33:0/144600331 conn(0x7f87a80f1c70 msgr2=0x7f87a80f2760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 shutdown_connections 2022-02-02T13:33:32.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:32.020+0000 7f87acc6f700 1 -- 172.21.15.33:0/144600331 wait complete. 2022-02-02T13:33:32.471 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi037 2022-02-02T13:33:32.471 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:33:32.472 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/etc/ceph/ceph.conf 2022-02-02T13:33:32.492 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:33:32.493 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T13:33:32.552 INFO:tasks.cephadm:Adding host smithi037 to orchestrator... 2022-02-02T13:33:32.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch host add smithi037 2022-02-02T13:33:33.118 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:33 smithi033 conmon[31996]: audit 2022-02-02T13:33:32.019058+0000 mon.smithi033 (mon.0) 115 : audit [INF] from='client.? 172.21.15.33:0/144600331' entity='client.admin' 2022-02-02T13:33:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 -- 172.21.15.33:0/3226349693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 msgr2=0x7f72fc0f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:34.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 --2- 172.21.15.33:0/3226349693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f8f20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f72ec009fb0 tx=0x7f72ec009b30).stop 2022-02-02T13:33:34.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 -- 172.21.15.33:0/3226349693 shutdown_connections 2022-02-02T13:33:34.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 --2- 172.21.15.33:0/3226349693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f8f20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 -- 172.21.15.33:0/3226349693 >> 172.21.15.33:0/3226349693 conn(0x7f72fc0f09a0 msgr2=0x7f72fc0f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.816+0000 7f72fb59e700 1 -- 172.21.15.33:0/3226349693 shutdown_connections 2022-02-02T13:33:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fb59e700 1 -- 172.21.15.33:0/3226349693 wait complete. 2022-02-02T13:33:34.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fb59e700 1 Processor -- start 2022-02-02T13:33:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fb59e700 1 -- start start 2022-02-02T13:33:34.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0f4e20 con 0x7f72fc0601e0 2022-02-02T13:33:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55770/0 (socket says 172.21.15.33:55770) 2022-02-02T13:33:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.817+0000 7f72fa59c700 1 -- 172.21.15.33:0/1679119394 learned_addr learned my addr 172.21.15.33:0/1679119394 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:34.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72fa59c700 1 -- 172.21.15.33:0/1679119394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec005040 con 0x7f72fc0601e0 2022-02-02T13:33:34.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72fa59c700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f72ec0089f0 tx=0x7f72ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72ec009320 con 0x7f72fc0601e0 2022-02-02T13:33:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0f4fc0 con 0x7f72fc0601e0 2022-02-02T13:33:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f72ec013ec0 con 0x7f72fc0601e0 2022-02-02T13:33:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f72ec014d30 con 0x7f72fc0601e0 2022-02-02T13:33:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.818+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc0f5450 con 0x7f72fc0601e0 2022-02-02T13:33:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f72ec014420 con 0x7f72fc0601e0 2022-02-02T13:33:34.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72f2ffd700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 0x7f72e8032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f72ec040fb0 con 0x7f72fc0601e0 2022-02-02T13:33:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72f9d9b700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 0x7f72e8032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc059100 con 0x7f72fc0601e0 2022-02-02T13:33:34.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.819+0000 7f72f9d9b700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 0x7f72e8032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f72e40096a0 tx=0x7f72e4006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:34.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:34.823+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f72ec0095f0 con 0x7f72fc0601e0 2022-02-02T13:33:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.007+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "target": ["mon-mgr", ""]}) v1 -- 0x7f72fc0f5bc0 con 0x7f72e802ff60 2022-02-02T13:33:35.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.757+0000 7f72f2ffd700 1 -- 172.21.15.33:0/1679119394 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f72fc0f5bc0 con 0x7f72e802ff60 2022-02-02T13:33:35.759 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi037' 2022-02-02T13:33:35.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 msgr2=0x7f72e8032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:35.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 0x7f72e8032420 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f72e40096a0 tx=0x7f72e4006b40).stop 2022-02-02T13:33:35.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 msgr2=0x7f72fc0f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:35.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f72ec0089f0 tx=0x7f72ec00b040).stop 2022-02-02T13:33:35.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 shutdown_connections 2022-02-02T13:33:35.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f72e802ff60 0x7f72e8032420 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:35.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 --2- 172.21.15.33:0/1679119394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0601e0 0x7f72fc0f69a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:35.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 >> 172.21.15.33:0/1679119394 conn(0x7f72fc0f09a0 msgr2=0x7f72fc0f1430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:35.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 shutdown_connections 2022-02-02T13:33:35.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:35.759+0000 7f72fb59e700 1 -- 172.21.15.33:0/1679119394 wait complete. 2022-02-02T13:33:36.223 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch host ls --format=json 2022-02-02T13:33:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:36 smithi033 conmon[31996]: audit 2022-02-02T13:33:35.008843+0000 mgr.smithi033.xvkvzp (mgr.14164) 5 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:36 smithi033 conmon[31996]: audit 2022-02-02T13:33:35.170684+0000 mon.smithi033 (mon.0) 116 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:36 smithi033 conmon[31996]: audit 2022-02-02T13:33:35.567662+0000 mon.smithi033 (mon.0) 117 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:36 smithi033 conmon[31996]: audit 2022-02-02T13:33:35.758010+0000 mon.smithi033 (mon.0) 118 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:37 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:35.576262 2022-02-02T13:33:37.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:37 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 6 : cephadm [INF] Deploying daemon alertmanager.smithi033 on smithi033 2022-02-02T13:33:37.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:37 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:35.758353+0000 mgr.smithi033.xvkvzp (mgr.14164) 7 : cephadm [INF] Added host smithi037 2022-02-02T13:33:39.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1489136109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d00f6510 msgr2=0x7f28d00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:39.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1489136109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d00f6510 0x7f28d00f6930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f28c0009fb0 tx=0x7f28c0009b30).stop 2022-02-02T13:33:39.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1489136109 shutdown_connections 2022-02-02T13:33:39.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1489136109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d00f6510 0x7f28d00f6930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:39.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1489136109 >> 172.21.15.33:0/1489136109 conn(0x7f28d00f1c70 msgr2=0x7f28d00f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:39.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1489136109 shutdown_connections 2022-02-02T13:33:39.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.175+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1489136109 wait complete. 2022-02-02T13:33:39.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d7d1c700 1 Processor -- start 2022-02-02T13:33:39.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d7d1c700 1 -- start start 2022-02-02T13:33:39.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d7d1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:39.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d7d1c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d01092c0 con 0x7f28d01089b0 2022-02-02T13:33:39.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d5ab8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:39.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d5ab8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55800/0 (socket says 172.21.15.33:55800) 2022-02-02T13:33:39.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d5ab8700 1 -- 172.21.15.33:0/1835515720 learned_addr learned my addr 172.21.15.33:0/1835515720 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:39.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d5ab8700 1 -- 172.21.15.33:0/1835515720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0005040 con 0x7f28d01089b0 2022-02-02T13:33:39.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.176+0000 7f28d5ab8700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28c00134d0 tx=0x7f28c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:39.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c0013ee0 con 0x7f28d01089b0 2022-02-02T13:33:39.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f28c0013680 con 0x7f28d01089b0 2022-02-02T13:33:39.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d01094c0 con 0x7f28d01089b0 2022-02-02T13:33:39.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f28c001ee90 con 0x7f28d01089b0 2022-02-02T13:33:39.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d010a010 con 0x7f28d01089b0 2022-02-02T13:33:39.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.177+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f28c0025060 con 0x7f28d01089b0 2022-02-02T13:33:39.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.178+0000 7f28c67fc700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 0x7f28bc0323d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:39.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.178+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f28c0041170 con 0x7f28d01089b0 2022-02-02T13:33:39.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.178+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d0059100 con 0x7f28d01089b0 2022-02-02T13:33:39.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.178+0000 7f28d52b7700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 0x7f28bc0323d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:39.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.178+0000 7f28d52b7700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 0x7f28bc0323d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f28cc0096a0 tx=0x7f28cc006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:39.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.182+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f28c0014420 con 0x7f28d01089b0 2022-02-02T13:33:39.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.365+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28d010a780 con 0x7f28bc02ff10 2022-02-02T13:33:39.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.367+0000 7f28c67fc700 1 -- 172.21.15.33:0/1835515720 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+156 (secure 0 0 0) 0x7f28d010a780 con 0x7f28bc02ff10 2022-02-02T13:33:39.367 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:33:39.368 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "smithi037", "hostname": "smithi037", "labels": [], "status": ""}] 2022-02-02T13:33:39.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 msgr2=0x7f28bc0323d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:39.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 0x7f28bc0323d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f28cc0096a0 tx=0x7f28cc006b40).stop 2022-02-02T13:33:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 msgr2=0x7f28d0108dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f28c00134d0 tx=0x7f28c0009b30).stop 2022-02-02T13:33:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 shutdown_connections 2022-02-02T13:33:39.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28bc02ff10 0x7f28bc0323d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 --2- 172.21.15.33:0/1835515720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d01089b0 0x7f28d0108dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 >> 172.21.15.33:0/1835515720 conn(0x7f28d00f1c70 msgr2=0x7f28d00f2780 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 shutdown_connections 2022-02-02T13:33:39.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:39.369+0000 7f28d7d1c700 1 -- 172.21.15.33:0/1835515720 wait complete. 2022-02-02T13:33:39.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:39 smithi033 conmon[31996]: audit 2022-02-02T13:33:39.367517+0000 mgr.smithi033.xvkvzp (mgr.14164) 8 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T13:33:39.857 INFO:tasks.cephadm:Setting crush tunables to default 2022-02-02T13:33:39.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd crush tunables default 2022-02-02T13:33:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.186+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3325183983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 msgr2=0x7f2ee80f88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.186+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3325183983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee80f88d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2ed8009fb0 tx=0x7f2ed8009b30).stop 2022-02-02T13:33:42.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.187+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3325183983 shutdown_connections 2022-02-02T13:33:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.187+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3325183983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee80f88d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.187+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3325183983 >> 172.21.15.33:0/3325183983 conn(0x7f2ee80610d0 msgr2=0x7f2ee80f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.187+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3325183983 shutdown_connections 2022-02-02T13:33:42.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.187+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3325183983 wait complete. 2022-02-02T13:33:42.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2eecb7b700 1 Processor -- start 2022-02-02T13:33:42.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2eecb7b700 1 -- start start 2022-02-02T13:33:42.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2eecb7b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:42.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2eecb7b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee8108b90 con 0x7f2ee80f84b0 2022-02-02T13:33:42.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:42.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2ee77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55806/0 (socket says 172.21.15.33:55806) 2022-02-02T13:33:42.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.188+0000 7f2ee77fe700 1 -- 172.21.15.33:0/3265936825 learned_addr learned my addr 172.21.15.33:0/3265936825 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:33:42.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2ee77fe700 1 -- 172.21.15.33:0/3265936825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8005040 con 0x7f2ee80f84b0 2022-02-02T13:33:42.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2ee77fe700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2ed8009f80 tx=0x7f2ed800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:42.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ed8009320 con 0x7f2ee80f84b0 2022-02-02T13:33:42.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2ed8013680 con 0x7f2ee80f84b0 2022-02-02T13:33:42.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee8108d90 con 0x7f2ee80f84b0 2022-02-02T13:33:42.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ed801eda0 con 0x7f2ee80f84b0 2022-02-02T13:33:42.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.189+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee8109220 con 0x7f2ee80f84b0 2022-02-02T13:33:42.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.190+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f2ed8014420 con 0x7f2ee80f84b0 2022-02-02T13:33:42.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.190+0000 7f2ecffff700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 0x7f2ed0032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:42.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.190+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f2ed8041e10 con 0x7f2ee80f84b0 2022-02-02T13:33:42.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.191+0000 7f2ee6ffd700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 0x7f2ed0032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:42.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.191+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8004fa0 con 0x7f2ee80f84b0 2022-02-02T13:33:42.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.192+0000 7f2ee6ffd700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 0x7f2ed0032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2edc0096a0 tx=0x7f2edc006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:42.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.196+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2ed80682b0 con 0x7f2ee80f84b0 2022-02-02T13:33:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.376+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2ec8005670 con 0x7f2ee80f84b0 2022-02-02T13:33:42.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.756+0000 7f2ecffff700 1 -- 172.21.15.33:0/3265936825 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v5) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2ed801c8f0 con 0x7f2ee80f84b0 2022-02-02T13:33:42.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 msgr2=0x7f2ed0032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 0x7f2ed0032420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f2edc0096a0 tx=0x7f2edc006b40).stop 2022-02-02T13:33:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 msgr2=0x7f2ee81086a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2ed8009f80 tx=0x7f2ed800b040).stop 2022-02-02T13:33:42.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 shutdown_connections 2022-02-02T13:33:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2ed002ff60 0x7f2ed0032420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 --2- 172.21.15.33:0/3265936825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ee80f84b0 0x7f2ee81086a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 >> 172.21.15.33:0/3265936825 conn(0x7f2ee80610d0 msgr2=0x7f2ee80f4740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:42.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 shutdown_connections 2022-02-02T13:33:42.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:33:42.758+0000 7f2eecb7b700 1 -- 172.21.15.33:0/3265936825 wait complete. 2022-02-02T13:33:42.761 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2022-02-02T13:33:42.963 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:42 smithi033 conmon[31996]: audit 2022-02-02T13:33:42.377164+0000 mon.smithi033 (mon.0 2022-02-02T13:33:42.964 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:42 smithi033 conmon[31996]: ) 119 : audit [INF] from='client.? 172.21.15.33:0/3265936825' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-02-02T13:33:43.195 INFO:tasks.cephadm:Adding mon.smithi033 on smithi033 2022-02-02T13:33:43.195 INFO:tasks.cephadm:Adding mon.smithi037 on smithi037 2022-02-02T13:33:43.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch apply mon '2;smithi033:172.21.15.33=smithi033;smithi037:172.21.15.37=smithi037' 2022-02-02T13:33:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: audit 2022-02-02T13:33 2022-02-02T13:33:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: :42.757190+0000 mon.smithi033 (mon.0) 120 : audit [INF] from='client.? 172.21.15.33:0/3265936825' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-02-02T13:33:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: cluster 2022-02-02T13:33:42.757241+0000 mon.smithi033 (mon.0) 121 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-02-02T13:33:43.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: audit 2022-02-02T13:33:42.807477+0000 mon.smithi033 (mon.0) 122 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:43.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: audit 2022-02-02T13:33:42.808780+0000 mon.smithi033 (mon.0) 123 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:33:43.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: audit 2022-02-02T13:33:42.810820+0000 mon.smithi033 (mon.0) 124 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-02-02T13:33:43.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: audit 2022-02-02T13:33:42.811638+0000 mon.smithi033 (mon.0) 125 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:33:43.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:42.812288+0000 mgr.smithi033.xvkvzp (mgr.14164) 9 : cephadm [INF] Deploying daemon crash.smithi033 on smithi033 2022-02-02T13:33:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 -- 172.21.15.37:0/528859393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 msgr2=0x7fb2bc0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:44.825 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 --2- 172.21.15.37:0/528859393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc0f5830 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb2b0009fb0 tx=0x7fb2b0009b30).stop 2022-02-02T13:33:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 -- 172.21.15.37:0/528859393 shutdown_connections 2022-02-02T13:33:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 --2- 172.21.15.37:0/528859393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc0f5830 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 -- 172.21.15.37:0/528859393 >> 172.21.15.37:0/528859393 conn(0x7fb2bc0f0b70 msgr2=0x7fb2bc0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:44.826 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 -- 172.21.15.37:0/528859393 shutdown_connections 2022-02-02T13:33:44.827 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 -- 172.21.15.37:0/528859393 wait complete. 2022-02-02T13:33:44.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.824+0000 7fb2c123d700 1 Processor -- start 2022-02-02T13:33:44.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2c123d700 1 -- start start 2022-02-02T13:33:44.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2c123d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:44.830 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2c123d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc106bf0 con 0x7fb2bc0f5410 2022-02-02T13:33:44.830 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2bad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:44.830 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2bad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39150/0 (socket says 172.21.15.37:39150) 2022-02-02T13:33:44.832 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2bad9d700 1 -- 172.21.15.37:0/266825961 learned_addr learned my addr 172.21.15.37:0/266825961 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:33:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2bad9d700 1 -- 172.21.15.37:0/266825961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0005040 con 0x7fb2bc0f5410 2022-02-02T13:33:44.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2bad9d700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb2b00089f0 tx=0x7fb2b000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b0009320 con 0x7fb2bc0f5410 2022-02-02T13:33:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb2b0013ec0 con 0x7fb2bc0f5410 2022-02-02T13:33:44.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.825+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc106df0 con 0x7fb2bc0f5410 2022-02-02T13:33:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.826+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb2b0014d30 con 0x7fb2bc0f5410 2022-02-02T13:33:44.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.826+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc107280 con 0x7fb2bc0f5410 2022-02-02T13:33:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.826+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fb2b00263a0 con 0x7fb2bc0f5410 2022-02-02T13:33:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.827+0000 7fb2a37fe700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 0x7fb2a4032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:44.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.827+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fb2b0041070 con 0x7fb2bc0f5410 2022-02-02T13:33:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.827+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc045ad0 con 0x7fb2bc0f5410 2022-02-02T13:33:44.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.827+0000 7fb2ba59c700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 0x7fb2a4032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.827+0000 7fb2ba59c700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 0x7fb2a4032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb2ac0096a0 tx=0x7fb2ac006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:44.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:44.831+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb2b0012920 con 0x7fb2bc0f5410 2022-02-02T13:33:44.971 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:44 smithi033 conmon[31996]: cluster 2022-02-02T13:33:43.491756+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:33:44.972 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:44 smithi033 conmon[31996]: 14164) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.018+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi037:172.21.15.37=smithi037", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2bc0f2a80 con 0x7fb2a402ffb0 2022-02-02T13:33:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.026+0000 7fb2a37fe700 1 -- 172.21.15.37:0/266825961 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb2bc0f2a80 con 0x7fb2a402ffb0 2022-02-02T13:33:45.028 INFO:teuthology.orchestra.run.smithi037.stdout:Scheduled mon update... 2022-02-02T13:33:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 msgr2=0x7fb2a4032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 0x7fb2a4032470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7fb2ac0096a0 tx=0x7fb2ac006b40).stop 2022-02-02T13:33:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 msgr2=0x7fb2bc106700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb2b00089f0 tx=0x7fb2b000b040).stop 2022-02-02T13:33:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 shutdown_connections 2022-02-02T13:33:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb2a402ffb0 0x7fb2a4032470 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 --2- 172.21.15.37:0/266825961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2bc0f5410 0x7fb2bc106700 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 >> 172.21.15.37:0/266825961 conn(0x7fb2bc0f0b70 msgr2=0x7fb2bc05fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 shutdown_connections 2022-02-02T13:33:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:45.028+0000 7fb2c123d700 1 -- 172.21.15.37:0/266825961 wait complete. 2022-02-02T13:33:45.371 DEBUG:teuthology.orchestra.run.smithi037:mon.smithi037> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi037.service 2022-02-02T13:33:45.374 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:33:45.375 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:33:45.404 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:-- Logs begin at Wed 2022-02-02 13:23:17 UTC. -- 2022-02-02T13:33:46.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.021349+0000 mgr.smithi033.xvkvzp (mgr.14164) 11 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi033:172.21.15.33=smithi033;smithi037:172.21.15.37=smithi037", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:33:46.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:45.022661+0000 mgr.smithi033.xvkvzp (mgr.14164) 12 : cephadm [INF] Saving service mon spec with placement smithi033:172.21.15.33=smithi033;smithi037:172.21.15.37=smithi037;count:2 2022-02-02T13:33:46.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.027519+0000 mon.smithi033 (mon.0) 126 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:46.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.073848+0000 mon.smithi033 (mon.0) 127 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:46.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.282485+0000 mon.smithi033 (mon.0) 128 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:46.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.287354+0000 mon.smithi033 (mon.0) 129 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:46.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.287789+0000 mon.smithi033 (mon.0) 130 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-02-02T13:33:46.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.288273+0000 mgr.smithi033.xvkvzp (mgr.14164) 13 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-02-02T13:33:46.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: audit 2022-02-02T13:33:45.293375+0000 mon.smithi033 (mon 2022-02-02T13:33:46.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: .0) 131 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:46.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:46.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: 2022-02-02T13:33:45.297064 2022-02-02T13:33:46.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 14 : cephadm 2022-02-02T13:33:46.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:46 smithi033 conmon[31996]: [INF] Deploying daemon grafana.smithi033 on smithi033 2022-02-02T13:33:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.811+0000 7fce167a1700 1 -- 172.21.15.37:0/2683519261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 msgr2=0x7fce100f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.811+0000 7fce167a1700 1 --2- 172.21.15.37:0/2683519261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce100f55c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fce04009fb0 tx=0x7fce04009b30).stop 2022-02-02T13:33:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.811+0000 7fce167a1700 1 -- 172.21.15.37:0/2683519261 shutdown_connections 2022-02-02T13:33:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.811+0000 7fce167a1700 1 --2- 172.21.15.37:0/2683519261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce100f55c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.811+0000 7fce167a1700 1 -- 172.21.15.37:0/2683519261 >> 172.21.15.37:0/2683519261 conn(0x7fce100f09a0 msgr2=0x7fce100f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 -- 172.21.15.37:0/2683519261 shutdown_connections 2022-02-02T13:33:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 -- 172.21.15.37:0/2683519261 wait complete. 2022-02-02T13:33:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 Processor -- start 2022-02-02T13:33:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 -- start start 2022-02-02T13:33:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce167a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce10106970 con 0x7fce100f51a0 2022-02-02T13:33:46.826 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce1579f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce1579f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39156/0 (socket says 172.21.15.37:39156) 2022-02-02T13:33:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.812+0000 7fce1579f700 1 -- 172.21.15.37:0/3296913982 learned_addr learned my addr 172.21.15.37:0/3296913982 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:33:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce1579f700 1 -- 172.21.15.37:0/3296913982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce04005040 con 0x7fce100f51a0 2022-02-02T13:33:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce1579f700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fce04009f80 tx=0x7fce0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce04009320 con 0x7fce100f51a0 2022-02-02T13:33:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce10106b70 con 0x7fce100f51a0 2022-02-02T13:33:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fce04013680 con 0x7fce100f51a0 2022-02-02T13:33:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fce0401eda0 con 0x7fce100f51a0 2022-02-02T13:33:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.813+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce10107000 con 0x7fce100f51a0 2022-02-02T13:33:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.814+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fce04014420 con 0x7fce100f51a0 2022-02-02T13:33:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.814+0000 7fce01ffb700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 0x7fcdfc032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.814+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fce04040ff0 con 0x7fce100f51a0 2022-02-02T13:33:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.814+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce10045ad0 con 0x7fce100f51a0 2022-02-02T13:33:46.830 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.814+0000 7fce14f9e700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 0x7fcdfc032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:46.830 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.815+0000 7fce14f9e700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 0x7fcdfc032420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fce0c0096a0 tx=0x7fce0c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:46.820+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fce0401c910 con 0x7fce100f51a0 2022-02-02T13:33:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.037+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fce10107d40 con 0x7fce100f51a0 2022-02-02T13:33:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.038+0000 7fce01ffb700 1 -- 172.21.15.37:0/3296913982 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fce0401a230 con 0x7fce100f51a0 2022-02-02T13:33:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:33:47.040 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:33:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 msgr2=0x7fcdfc032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 0x7fcdfc032420 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fce0c0096a0 tx=0x7fce0c006b40).stop 2022-02-02T13:33:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 msgr2=0x7fce10106480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fce04009f80 tx=0x7fce0400b040).stop 2022-02-02T13:33:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 shutdown_connections 2022-02-02T13:33:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcdfc02ff60 0x7fcdfc032420 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 --2- 172.21.15.37:0/3296913982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce100f51a0 0x7fce10106480 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 >> 172.21.15.37:0/3296913982 conn(0x7fce100f09a0 msgr2=0x7fce1005fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 shutdown_connections 2022-02-02T13:33:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:47.039+0000 7fce167a1700 1 -- 172.21.15.37:0/3296913982 wait complete. 2022-02-02T13:33:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:33:47.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:47 smithi033 conmon[31996]: cluster 2022-02-02T13:33:45.492004+0000 mgr.smithi033.xvkvzp (mgr.14164) 15 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:47.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:47 smithi033 conmon[31996]: audit 2022-02-02T13:33:47.039338+0000 mon.smithi033 (mon.0) 132 : audit [DBG] from='client.? 172.21.15.37:0/3296913982' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:33:48.646 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:33:48.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:33:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:49 smithi033 conmon[31996]: cluster 2022-02-02T13:33:47.492231+0000 2022-02-02T13:33:49.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:49 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 16 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 -- 172.21.15.37:0/546552522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 msgr2=0x7f05800f90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:50.366 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 --2- 172.21.15.37:0/546552522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05800f90f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0574009fb0 tx=0x7f0574009b30).stop 2022-02-02T13:33:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 -- 172.21.15.37:0/546552522 shutdown_connections 2022-02-02T13:33:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 --2- 172.21.15.37:0/546552522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05800f90f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 -- 172.21.15.37:0/546552522 >> 172.21.15.37:0/546552522 conn(0x7f05800f0b70 msgr2=0x7f05800f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:50.371 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 -- 172.21.15.37:0/546552522 shutdown_connections 2022-02-02T13:33:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 -- 172.21.15.37:0/546552522 wait complete. 2022-02-02T13:33:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.354+0000 7f0587fbc700 1 Processor -- start 2022-02-02T13:33:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0587fbc700 1 -- start start 2022-02-02T13:33:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0587fbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0587fbc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580106bb0 con 0x7f0580060280 2022-02-02T13:33:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0585d58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0585d58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39162/0 (socket says 172.21.15.37:39162) 2022-02-02T13:33:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0585d58700 1 -- 172.21.15.37:0/1691900399 learned_addr learned my addr 172.21.15.37:0/1691900399 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:33:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0585d58700 1 -- 172.21.15.37:0/1691900399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574005040 con 0x7f0580060280 2022-02-02T13:33:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f0585d58700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0574009f80 tx=0x7f057400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.355+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0574009320 con 0x7f0580060280 2022-02-02T13:33:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.356+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580106db0 con 0x7f0580060280 2022-02-02T13:33:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.356+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0574013680 con 0x7f0580060280 2022-02-02T13:33:50.376 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.356+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f057401eda0 con 0x7f0580060280 2022-02-02T13:33:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.356+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580107240 con 0x7f0580060280 2022-02-02T13:33:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.356+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f0574014420 con 0x7f0580060280 2022-02-02T13:33:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.357+0000 7f05727fc700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 0x7f056c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.357+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0580045ad0 con 0x7f0580060280 2022-02-02T13:33:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.357+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f0574040fe0 con 0x7f0580060280 2022-02-02T13:33:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.357+0000 7f0585557700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 0x7f056c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.357+0000 7f0585557700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 0x7f056c032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f057c0096a0 tx=0x7f057c006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.362+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f057401c8f0 con 0x7f0580060280 2022-02-02T13:33:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.581+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f05801080f0 con 0x7f0580060280 2022-02-02T13:33:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.581+0000 7f05727fc700 1 -- 172.21.15.37:0/1691900399 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f057401a230 con 0x7f0580060280 2022-02-02T13:33:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:33:50.583 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:33:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 msgr2=0x7f056c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 0x7f056c032470 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f057c0096a0 tx=0x7f057c006b40).stop 2022-02-02T13:33:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 msgr2=0x7f05801066c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0574009f80 tx=0x7f057400b040).stop 2022-02-02T13:33:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 shutdown_connections 2022-02-02T13:33:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f056c02ffb0 0x7f056c032470 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 --2- 172.21.15.37:0/1691900399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0580060280 0x7f05801066c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 >> 172.21.15.37:0/1691900399 conn(0x7f05800f0b70 msgr2=0x7f05800f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 shutdown_connections 2022-02-02T13:33:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:50.583+0000 7f0587fbc700 1 -- 172.21.15.37:0/1691900399 wait complete. 2022-02-02T13:33:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:33:51.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:51 smithi033 conmon[31996]: cluster 2022-02-02T13:33:49.492468+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:33:51.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:51 smithi033 conmon[31996]: mgr.14164) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:51.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:51 smithi033 conmon[31996]: audit 2022-02-02T13:33:50.582967+0000 mon.smithi033 (mon.0) 133 : audit [DBG] from='client.? 172.21.15.37:0/1691900399' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:33:52.121 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:33:52.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:33:53.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:53 smithi033 conmon[31996]: cluster 2022-02-02T13:33:51.492720+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:33:53.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:53 smithi033 conmon[31996]: .14164) 18 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:53.832 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 -- 172.21.15.37:0/654696698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 msgr2=0x7fcf300f8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:53.832 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/654696698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf300f8fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fcf20009fb0 tx=0x7fcf20009b30).stop 2022-02-02T13:33:53.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 -- 172.21.15.37:0/654696698 shutdown_connections 2022-02-02T13:33:53.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/654696698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf300f8fc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:53.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 -- 172.21.15.37:0/654696698 >> 172.21.15.37:0/654696698 conn(0x7fcf300f09a0 msgr2=0x7fcf300f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:53.833 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 -- 172.21.15.37:0/654696698 shutdown_connections 2022-02-02T13:33:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 -- 172.21.15.37:0/654696698 wait complete. 2022-02-02T13:33:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.827+0000 7fcf34bdb700 1 Processor -- start 2022-02-02T13:33:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf34bdb700 1 -- start start 2022-02-02T13:33:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf34bdb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf34bdb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf301069f0 con 0x7fcf30060140 2022-02-02T13:33:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39168/0 (socket says 172.21.15.37:39168) 2022-02-02T13:33:53.835 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf2f7fe700 1 -- 172.21.15.37:0/2299514279 learned_addr learned my addr 172.21.15.37:0/2299514279 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:33:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf2f7fe700 1 -- 172.21.15.37:0/2299514279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20005040 con 0x7fcf30060140 2022-02-02T13:33:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.828+0000 7fcf2f7fe700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcf200089f0 tx=0x7fcf2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf20009320 con 0x7fcf30060140 2022-02-02T13:33:53.836 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcf20013ec0 con 0x7fcf30060140 2022-02-02T13:33:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30106bf0 con 0x7fcf30060140 2022-02-02T13:33:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcf20014d30 con 0x7fcf30060140 2022-02-02T13:33:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf30107080 con 0x7fcf30060140 2022-02-02T13:33:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.829+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fcf200263a0 con 0x7fcf30060140 2022-02-02T13:33:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.830+0000 7fcf17fff700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 0x7fcf18032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.830+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf30045ad0 con 0x7fcf30060140 2022-02-02T13:33:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.830+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fcf200410a0 con 0x7fcf30060140 2022-02-02T13:33:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.830+0000 7fcf2effd700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 0x7fcf18032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:53.838 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.830+0000 7fcf2effd700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 0x7fcf18032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcf240096a0 tx=0x7fcf24006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:53.839 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:53.835+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcf20012900 con 0x7fcf30060140 2022-02-02T13:33:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.053+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcf30107f30 con 0x7fcf30060140 2022-02-02T13:33:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.053+0000 7fcf17fff700 1 -- 172.21.15.37:0/2299514279 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fcf2002b020 con 0x7fcf30060140 2022-02-02T13:33:54.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:33:54.055 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:33:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 msgr2=0x7fcf18032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 0x7fcf18032420 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fcf240096a0 tx=0x7fcf24006b40).stop 2022-02-02T13:33:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 msgr2=0x7fcf30106500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcf200089f0 tx=0x7fcf2000b040).stop 2022-02-02T13:33:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 shutdown_connections 2022-02-02T13:33:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcf1802ff60 0x7fcf18032420 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 --2- 172.21.15.37:0/2299514279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf30060140 0x7fcf30106500 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 >> 172.21.15.37:0/2299514279 conn(0x7fcf300f09a0 msgr2=0x7fcf300f14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:54.058 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 shutdown_connections 2022-02-02T13:33:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:54.056+0000 7fcf34bdb700 1 -- 172.21.15.37:0/2299514279 wait complete. 2022-02-02T13:33:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:33:54.354 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:54 smithi033 conmon[31996]: audit 2022-02-02T13:33:54.055221+0000 2022-02-02T13:33:54.354 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:54 smithi033 conmon[31996]: mon.smithi033 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.37:0/2299514279' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:33:55.494 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:33:55.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:33:55.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:55 smithi033 conmon[31996]: cluster 2022-02-02T13:33:53.492997+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:33:55.582 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:55 smithi033 conmon[31996]: mgr.14164) 19 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:57.099 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- 172.21.15.37:0/2261430521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 msgr2=0x7fdf340f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:57.099 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 --2- 172.21.15.37:0/2261430521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf340f66c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fdf24009fb0 tx=0x7fdf24009b30).stop 2022-02-02T13:33:57.100 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- 172.21.15.37:0/2261430521 shutdown_connections 2022-02-02T13:33:57.100 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 --2- 172.21.15.37:0/2261430521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf340f66c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- 172.21.15.37:0/2261430521 >> 172.21.15.37:0/2261430521 conn(0x7fdf340f1aa0 msgr2=0x7fdf340f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- 172.21.15.37:0/2261430521 shutdown_connections 2022-02-02T13:33:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- 172.21.15.37:0/2261430521 wait complete. 2022-02-02T13:33:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 Processor -- start 2022-02-02T13:33:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.095+0000 7fdf392a9700 1 -- start start 2022-02-02T13:33:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf392a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf392a9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf34106980 con 0x7fdf340f62a0 2022-02-02T13:33:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39174/0 (socket says 172.21.15.37:39174) 2022-02-02T13:33:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf33fff700 1 -- 172.21.15.37:0/1748032811 learned_addr learned my addr 172.21.15.37:0/1748032811 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:33:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf33fff700 1 -- 172.21.15.37:0/1748032811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf24005040 con 0x7fdf340f62a0 2022-02-02T13:33:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf33fff700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fdf24000c00 tx=0x7fdf2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:57.103 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf240095f0 con 0x7fdf340f62a0 2022-02-02T13:33:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdf24007e50 con 0x7fdf340f62a0 2022-02-02T13:33:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf34106b80 con 0x7fdf340f62a0 2022-02-02T13:33:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf24014e70 con 0x7fdf340f62a0 2022-02-02T13:33:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.096+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf34107010 con 0x7fdf340f62a0 2022-02-02T13:33:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.097+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fdf2401d490 con 0x7fdf340f62a0 2022-02-02T13:33:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.097+0000 7fdf30ff9700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 0x7fdf1c032470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:33:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.097+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf34045ad0 con 0x7fdf340f62a0 2022-02-02T13:33:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.097+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fdf240408a0 con 0x7fdf340f62a0 2022-02-02T13:33:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.098+0000 7fdf337fe700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 0x7fdf1c032470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:33:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.098+0000 7fdf337fe700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 0x7fdf1c032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdf280096a0 tx=0x7fdf28006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:33:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.102+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdf2401b4a0 con 0x7fdf340f62a0 2022-02-02T13:33:57.320 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.320+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdf34107ec0 con 0x7fdf340f62a0 2022-02-02T13:33:57.321 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.321+0000 7fdf30ff9700 1 -- 172.21.15.37:0/1748032811 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fdf2401b2c0 con 0x7fdf340f62a0 2022-02-02T13:33:57.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:33:57.322 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:33:57.323 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 msgr2=0x7fdf1c032470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 0x7fdf1c032470 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fdf280096a0 tx=0x7fdf28006b40).stop 2022-02-02T13:33:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 msgr2=0x7fdf34106490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:33:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fdf24000c00 tx=0x7fdf2400b040).stop 2022-02-02T13:33:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 shutdown_connections 2022-02-02T13:33:57.325 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdf1c02ffb0 0x7fdf1c032470 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:57.325 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 --2- 172.21.15.37:0/1748032811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf340f62a0 0x7fdf34106490 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:33:57.325 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 >> 172.21.15.37:0/1748032811 conn(0x7fdf340f1aa0 msgr2=0x7fdf340f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:33:57.325 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 shutdown_connections 2022-02-02T13:33:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:33:57.323+0000 7fdf392a9700 1 -- 172.21.15.37:0/1748032811 wait complete. 2022-02-02T13:33:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:33:57.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:57 smithi033 conmon[31996]: cluster 2022-02-02T13:33:55.493228+0000 mgr.smithi033.xvkvzp (mgr.14164) 20 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:33:57.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:57 smithi033 conmon[31996]: audit 2022-02-02T13:33:56.262349+0000 mon.smithi033 (mon.0) 135 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:33:57.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:57 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:56.263931+0000 mgr.smithi033.xvkvzp (mgr.14164) 21 : cephadm [INF] Deploying daemon node-exporter.smithi033 on smithi033 2022-02-02T13:33:58.524 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:58 smithi033 conmon[31996]: audit 2022-02-02T13:33:57.321953+0000 mon.smithi033 (mon 2022-02-02T13:33:58.524 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:58 smithi033 conmon[31996]: .0) 136 : audit [DBG] from='client.? 172.21.15.37:0/1748032811' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:33:58.768 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:33:58.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:33:59.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:33:59 smithi033 conmon[31996]: cluster 2022-02-02T13:33:57.493851+0000 mgr.smithi033.xvkvzp (mgr.14164) 22 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:00.345 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.342+0000 7fec5c480700 1 -- 172.21.15.37:0/1165164630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 msgr2=0x7fec540f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:00.345 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.342+0000 7fec5c480700 1 --2- 172.21.15.37:0/1165164630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec540f5830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fec50009fb0 tx=0x7fec50009b30).stop 2022-02-02T13:34:00.345 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 -- 172.21.15.37:0/1165164630 shutdown_connections 2022-02-02T13:34:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 --2- 172.21.15.37:0/1165164630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec540f5830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 -- 172.21.15.37:0/1165164630 >> 172.21.15.37:0/1165164630 conn(0x7fec540f0b70 msgr2=0x7fec540f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 -- 172.21.15.37:0/1165164630 shutdown_connections 2022-02-02T13:34:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 -- 172.21.15.37:0/1165164630 wait complete. 2022-02-02T13:34:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 Processor -- start 2022-02-02T13:34:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 -- start start 2022-02-02T13:34:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.343+0000 7fec5c480700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5c480700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec54060280 con 0x7fec540f5410 2022-02-02T13:34:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5a21c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5a21c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39180/0 (socket says 172.21.15.37:39180) 2022-02-02T13:34:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5a21c700 1 -- 172.21.15.37:0/226244825 learned_addr learned my addr 172.21.15.37:0/226244825 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5a21c700 1 -- 172.21.15.37:0/226244825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50005040 con 0x7fec540f5410 2022-02-02T13:34:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5a21c700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fec500089f0 tx=0x7fec5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec50009320 con 0x7fec540f5410 2022-02-02T13:34:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec54060480 con 0x7fec540f5410 2022-02-02T13:34:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fec50013ec0 con 0x7fec540f5410 2022-02-02T13:34:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.344+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec50014d30 con 0x7fec540f5410 2022-02-02T13:34:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.345+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec54109b00 con 0x7fec540f5410 2022-02-02T13:34:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.345+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec54045ad0 con 0x7fec540f5410 2022-02-02T13:34:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.347+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fec500095f0 con 0x7fec540f5410 2022-02-02T13:34:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.348+0000 7fec46ffd700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 0x7fec40032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.348+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fec50041160 con 0x7fec540f5410 2022-02-02T13:34:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.348+0000 7fec59a1b700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 0x7fec40032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.348+0000 7fec59a1b700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 0x7fec40032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fec480096a0 tx=0x7fec48006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:00.354 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.351+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec50014420 con 0x7fec540f5410 2022-02-02T13:34:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.570+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec5410a320 con 0x7fec540f5410 2022-02-02T13:34:00.573 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.570+0000 7fec46ffd700 1 -- 172.21.15.37:0/226244825 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fec5000f990 con 0x7fec540f5410 2022-02-02T13:34:00.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:00.574 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 msgr2=0x7fec40032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:00.577 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 0x7fec40032420 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fec480096a0 tx=0x7fec48006b40).stop 2022-02-02T13:34:00.578 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 msgr2=0x7fec541093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:00.578 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fec500089f0 tx=0x7fec5000b040).stop 2022-02-02T13:34:00.579 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 shutdown_connections 2022-02-02T13:34:00.579 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4002ff60 0x7fec40032420 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:00.580 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 --2- 172.21.15.37:0/226244825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec540f5410 0x7fec541093d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:00.581 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 >> 172.21.15.37:0/226244825 conn(0x7fec540f0b70 msgr2=0x7fec540f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:00.581 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 shutdown_connections 2022-02-02T13:34:00.582 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:00.572+0000 7fec5c480700 1 -- 172.21.15.37:0/226244825 wait complete. 2022-02-02T13:34:00.584 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:00 smithi033 conmon[31996]: audit 2022-02-02T13:33:59.344655+0000 mon.smithi033 (mon.0) 137 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:00.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:00 smithi033 conmon[31996]: cephadm 2022-02-02T13:33:59.351694+0000 mgr.smithi033.xvkvzp (mgr.14164) 23 : cephadm [INF] Deploying daemon prometheus.smithi033 on smithi033 2022-02-02T13:34:01.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:01 smithi033 conmon[31996]: cluster 2022-02-02T13:33:59.494095+0000 2022-02-02T13:34:01.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:01 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:01.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:01 smithi033 conmon[31996]: audit 2022-02-02T13:34:00.571127+0000 2022-02-02T13:34:01.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:01 smithi033 conmon[31996]: mon.smithi033 (mon.0) 138 : audit [DBG] from='client.? 172.21.15.37:0/226244825' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:02.041 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:02.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/1338844802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 msgr2=0x7f7d080f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/1338844802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080f5830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7cfc009fb0 tx=0x7f7cfc009b30).stop 2022-02-02T13:34:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/1338844802 shutdown_connections 2022-02-02T13:34:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/1338844802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080f5830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/1338844802 >> 172.21.15.37:0/1338844802 conn(0x7f7d080f0b70 msgr2=0x7f7d080f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/1338844802 shutdown_connections 2022-02-02T13:34:03.644 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.641+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/1338844802 wait complete. 2022-02-02T13:34:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0cb7f700 1 Processor -- start 2022-02-02T13:34:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0cb7f700 1 -- start start 2022-02-02T13:34:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0cb7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:03.645 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0cb7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d080fb800 con 0x7f7d080f5410 2022-02-02T13:34:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39186/0 (socket says 172.21.15.37:39186) 2022-02-02T13:34:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0659c700 1 -- 172.21.15.37:0/3640238650 learned_addr learned my addr 172.21.15.37:0/3640238650 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0659c700 1 -- 172.21.15.37:0/3640238650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc005040 con 0x7f7d080f5410 2022-02-02T13:34:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.642+0000 7f7d0659c700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7cfc0089f0 tx=0x7f7cfc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:03.648 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cfc009320 con 0x7f7d080f5410 2022-02-02T13:34:03.649 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d080fb9a0 con 0x7f7d080f5410 2022-02-02T13:34:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7cfc013ec0 con 0x7f7d080f5410 2022-02-02T13:34:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7cfc014d30 con 0x7f7d080f5410 2022-02-02T13:34:03.652 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d080fbe30 con 0x7f7d080f5410 2022-02-02T13:34:03.653 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.643+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f7cfc0263a0 con 0x7f7d080f5410 2022-02-02T13:34:03.654 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.644+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d08059100 con 0x7f7d080f5410 2022-02-02T13:34:03.654 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.644+0000 7f7cf6ffd700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 0x7f7cf0032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:03.654 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.644+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f7cfc0410c0 con 0x7f7d080f5410 2022-02-02T13:34:03.654 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.644+0000 7f7d05d9b700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 0x7f7cf0032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.644+0000 7f7d05d9b700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 0x7f7cf0032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7cf80096a0 tx=0x7f7cf8006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:03.655 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.648+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7cfc026630 con 0x7f7d080f5410 2022-02-02T13:34:03.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:03 smithi033 conmon[31996]: cluster 2022-02-02T13:34:01.494320+0000 mgr.smithi033.xvkvzp (mgr.14164) 25 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:03.865 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.865+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7d080fae90 con 0x7f7d080f5410 2022-02-02T13:34:03.866 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.866+0000 7f7cf6ffd700 1 -- 172.21.15.37:0/3640238650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f7cfc01db70 con 0x7f7d080f5410 2022-02-02T13:34:03.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:03.867 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:03.868 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 msgr2=0x7f7cf0032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 0x7f7cf0032420 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f7cf80096a0 tx=0x7f7cf8006b40).stop 2022-02-02T13:34:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 msgr2=0x7f7d080fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7cfc0089f0 tx=0x7f7cfc00b040).stop 2022-02-02T13:34:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 shutdown_connections 2022-02-02T13:34:03.869 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7cf002ff60 0x7f7cf0032420 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 --2- 172.21.15.37:0/3640238650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d080f5410 0x7f7d080fd380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 >> 172.21.15.37:0/3640238650 conn(0x7f7d080f0b70 msgr2=0x7f7d0805fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 shutdown_connections 2022-02-02T13:34:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:03.867+0000 7f7d0cb7f700 1 -- 172.21.15.37:0/3640238650 wait complete. 2022-02-02T13:34:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:04.657 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:04 smithi033 conmon[31996]: audit 2022-02-02T13:34:03.866491+0000 mon.smithi033 (mon.0) 139 : audit [DBG] from='client.? 172.21.15.37:0/3640238650' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:05.303 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:05.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:05.391 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:05 smithi033 conmon[31996]: cluster 2022-02-02T13:34: 2022-02-02T13:34:05.391 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:05 smithi033 conmon[31996]: 03.494620+0000 mgr.smithi033.xvkvzp (mgr.14164) 26 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 -- 172.21.15.37:0/1856103618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 msgr2=0x7fedd00f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 --2- 172.21.15.37:0/1856103618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd00f5830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fedc0009fb0 tx=0x7fedc0009b30).stop 2022-02-02T13:34:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 -- 172.21.15.37:0/1856103618 shutdown_connections 2022-02-02T13:34:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 --2- 172.21.15.37:0/1856103618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd00f5830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 -- 172.21.15.37:0/1856103618 >> 172.21.15.37:0/1856103618 conn(0x7fedd00f0b70 msgr2=0x7fedd00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 -- 172.21.15.37:0/1856103618 shutdown_connections 2022-02-02T13:34:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.891+0000 7fedd8019700 1 -- 172.21.15.37:0/1856103618 wait complete. 2022-02-02T13:34:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd8019700 1 Processor -- start 2022-02-02T13:34:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd8019700 1 -- start start 2022-02-02T13:34:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd8019700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd8019700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0060240 con 0x7fedd00f5410 2022-02-02T13:34:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd5db5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd5db5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2022-02-02T13:34:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd5db5700 1 -- 172.21.15.37:0/3685057947 learned_addr learned my addr 172.21.15.37:0/3685057947 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd5db5700 1 -- 172.21.15.37:0/3685057947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0005040 con 0x7fedd00f5410 2022-02-02T13:34:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.892+0000 7fedd5db5700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fedc00089f0 tx=0x7fedc000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedc0009320 con 0x7fedd00f5410 2022-02-02T13:34:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd0060440 con 0x7fedd00f5410 2022-02-02T13:34:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fedc0013ec0 con 0x7fedd00f5410 2022-02-02T13:34:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fedc0014d30 con 0x7fedd00f5410 2022-02-02T13:34:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd0109ac0 con 0x7fedd00f5410 2022-02-02T13:34:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fedc00263a0 con 0x7fedd00f5410 2022-02-02T13:34:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.894+0000 7fedc67fc700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 0x7fedbc032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.893+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0045ad0 con 0x7fedd00f5410 2022-02-02T13:34:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.894+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fedc0041380 con 0x7fedd00f5410 2022-02-02T13:34:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.894+0000 7fedd55b4700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 0x7fedbc032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.894+0000 7fedd55b4700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 0x7fedbc032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fedcc0096a0 tx=0x7fedcc006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:06.898+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fedc0012510 con 0x7fedd00f5410 2022-02-02T13:34:07.118 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.118+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fedd00faf80 con 0x7fedd00f5410 2022-02-02T13:34:07.119 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.119+0000 7fedc67fc700 1 -- 172.21.15.37:0/3685057947 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fedc0012330 con 0x7fedd00f5410 2022-02-02T13:34:07.119 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:07.120 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 msgr2=0x7fedbc032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 0x7fedbc032420 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fedcc0096a0 tx=0x7fedcc006b40).stop 2022-02-02T13:34:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 msgr2=0x7fedd0109410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fedc00089f0 tx=0x7fedc000b040).stop 2022-02-02T13:34:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 shutdown_connections 2022-02-02T13:34:07.122 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fedbc02ff60 0x7fedbc032420 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 --2- 172.21.15.37:0/3685057947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd00f5410 0x7fedd0109410 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 >> 172.21.15.37:0/3685057947 conn(0x7fedd00f0b70 msgr2=0x7fedd00f1660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 shutdown_connections 2022-02-02T13:34:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:07.120+0000 7fedd8019700 1 -- 172.21.15.37:0/3685057947 wait complete. 2022-02-02T13:34:07.123 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: cluster 2022-02-02T13:34:05.494964+0000 2022-02-02T13:34:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 27 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: audit 2022-02-02T13:34:07.119365+0000 mon.smithi033 (mon.0) 140 : audit 2022-02-02T13:34:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: [DBG] from='client.? 172.21.15.37:0/3685057947' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:07.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:34:07.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: 02T13:34:07.226727+0000 mon.smithi033 (mon.0) 2022-02-02T13:34:07.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: 141 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:07.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:34:07.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: 13:34:07.227250+0000 mon.smithi033 (mon 2022-02-02T13:34:07.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:07 smithi033 conmon[31996]: .0) 142 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:34:08.560 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:08.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:08.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:08 smithi033 conmon[31996]: cluster 2022-02-02T13:34:07.495287+0000 mgr.smithi033.xvkvzp (mgr.14164) 28 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:08.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:08 smithi033 conmon[31996]: audit 2022-02-02T13:34:07.644877+0000 mon.smithi033 (mon.0) 143 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:08.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:08 smithi033 conmon[31996]: audit 2022-02-02T13:34:08.105598+0000 mon.smithi033 (mon.0) 144 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- 172.21.15.37:0/3880139336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 msgr2=0x7fc62c069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 --2- 172.21.15.37:0/3880139336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c069e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fc61c009fb0 tx=0x7fc61c009b30).stop 2022-02-02T13:34:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- 172.21.15.37:0/3880139336 shutdown_connections 2022-02-02T13:34:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 --2- 172.21.15.37:0/3880139336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c069e60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- 172.21.15.37:0/3880139336 >> 172.21.15.37:0/3880139336 conn(0x7fc62c0f1aa0 msgr2=0x7fc62c0f3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- 172.21.15.37:0/3880139336 shutdown_connections 2022-02-02T13:34:10.570 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- 172.21.15.37:0/3880139336 wait complete. 2022-02-02T13:34:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 Processor -- start 2022-02-02T13:34:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.567+0000 7fc630b30700 1 -- start start 2022-02-02T13:34:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc630b30700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:10.571 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc630b30700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c108c00 con 0x7fc62c06b8c0 2022-02-02T13:34:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc62b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc62b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39198/0 (socket says 172.21.15.37:39198) 2022-02-02T13:34:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc62b7fe700 1 -- 172.21.15.37:0/3353140621 learned_addr learned my addr 172.21.15.37:0/3353140621 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc62b7fe700 1 -- 172.21.15.37:0/3353140621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c005040 con 0x7fc62c06b8c0 2022-02-02T13:34:10.572 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.568+0000 7fc62b7fe700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc61c0089f0 tx=0x7fc61c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc61c009320 con 0x7fc62c06b8c0 2022-02-02T13:34:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c108e00 con 0x7fc62c06b8c0 2022-02-02T13:34:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc61c013ec0 con 0x7fc62c06b8c0 2022-02-02T13:34:10.573 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc61c014d30 con 0x7fc62c06b8c0 2022-02-02T13:34:10.574 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c109290 con 0x7fc62c06b8c0 2022-02-02T13:34:10.575 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fc61c0263a0 con 0x7fc62c06b8c0 2022-02-02T13:34:10.575 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 0x7fc614032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:10.575 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.569+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fc61c040ff0 con 0x7fc62c06b8c0 2022-02-02T13:34:10.576 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.570+0000 7fc62affd700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 0x7fc614032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:10.576 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.570+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c059100 con 0x7fc62c06b8c0 2022-02-02T13:34:10.576 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.570+0000 7fc62affd700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 0x7fc614032420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6200096a0 tx=0x7fc620006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:10.577 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.576+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc61c012920 con 0x7fc62c06b8c0 2022-02-02T13:34:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.797+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc62c045ad0 con 0x7fc62c06b8c0 2022-02-02T13:34:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.797+0000 7fc613fff700 1 -- 172.21.15.37:0/3353140621 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fc61c012330 con 0x7fc62c06b8c0 2022-02-02T13:34:10.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:10.799 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:10.802 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 msgr2=0x7fc614032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:10.802 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 0x7fc614032420 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6200096a0 tx=0x7fc620006b40).stop 2022-02-02T13:34:10.803 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 msgr2=0x7fc62c108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:10.803 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc61c0089f0 tx=0x7fc61c00b040).stop 2022-02-02T13:34:10.804 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 shutdown_connections 2022-02-02T13:34:10.804 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc61402ff60 0x7fc614032420 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:10.805 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 --2- 172.21.15.37:0/3353140621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c06b8c0 0x7fc62c108710 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:10.805 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 >> 172.21.15.37:0/3353140621 conn(0x7fc62c0f1aa0 msgr2=0x7fc62c0f2590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:10.805 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 shutdown_connections 2022-02-02T13:34:10.806 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:10.799+0000 7fc630b30700 1 -- 172.21.15.37:0/3353140621 wait complete. 2022-02-02T13:34:10.806 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:10.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:10 smithi033 conmon[31996]: cluster 2022-02-02T13:34:09.495773+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:34:10.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:10 smithi033 conmon[31996]: .14164) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:11.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:11 smithi033 conmon[31996]: audit 2022-02-02T13:34:10.798078+0000 mon.smithi033 (mon 2022-02-02T13:34:11.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:11 smithi033 conmon[31996]: .0) 145 : audit [DBG] from='client.? 172.21.15.37:0/3353140621' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:11.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:11 smithi033 conmon[31996]: audit 2022-02-02T13:34:11.353208+0000 mon.smithi033 (mon.0) 146 : audit [INF] 2022-02-02T13:34:11.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:11 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:12.360 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:12.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: cluster 2022-02-02T13:34:11.495992+0000 mgr.smithi033.xvkvzp (mgr.14164) 30 : 2022-02-02T13:34:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022-02-02T13:34:11.763126+0000 mon.smithi033 (mon.0) 147 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022-02-02T13:34:11.840179+0000 mon.smithi033 ( 2022-02-02T13:34:13.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: mon.0) 148 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:13.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:13.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 02-02T13:34:11.842521+0000 mon.smithi033 (mon.0 2022-02-02T13:34:13.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: ) 149 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:13.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:13.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 02-02T13:34:11.843621+0000 mon.smithi033 (mon. 2022-02-02T13:34:13.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 0) 150 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:34:13.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:13.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 02-02T13:34:11.845251+0000 mon.smithi033 (mon. 2022-02-02T13:34:13.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 0) 151 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-02-02T13:34:13.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:13.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 02-02T13:34:11.845861+0000 mon.smithi033 (mon.0 2022-02-02T13:34:13.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: ) 152 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:13.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: cephadm 2022 2022-02-02T13:34:13.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: -02-02T13:34:11.846442+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:13.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:12 smithi033 conmon[31996]: 14164) 31 : cephadm [INF] Deploying daemon crash.smithi037 on smithi037 2022-02-02T13:34:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 -- 172.21.15.37:0/347023210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 msgr2=0x7f03380f55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 --2- 172.21.15.37:0/347023210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f03380f55c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f0334009fb0 tx=0x7f0334009b30).stop 2022-02-02T13:34:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 -- 172.21.15.37:0/347023210 shutdown_connections 2022-02-02T13:34:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 --2- 172.21.15.37:0/347023210 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f03380f55c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 -- 172.21.15.37:0/347023210 >> 172.21.15.37:0/347023210 conn(0x7f03380f09a0 msgr2=0x7f03380f2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 -- 172.21.15.37:0/347023210 shutdown_connections 2022-02-02T13:34:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.234+0000 7f033e4e1700 1 -- 172.21.15.37:0/347023210 wait complete. 2022-02-02T13:34:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033e4e1700 1 Processor -- start 2022-02-02T13:34:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033e4e1700 1 -- start start 2022-02-02T13:34:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033e4e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033e4e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0338105880 con 0x7f03380f51a0 2022-02-02T13:34:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033d4df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033d4df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39204/0 (socket says 172.21.15.37:39204) 2022-02-02T13:34:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.235+0000 7f033d4df700 1 -- 172.21.15.37:0/3533897711 learned_addr learned my addr 172.21.15.37:0/3533897711 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f033d4df700 1 -- 172.21.15.37:0/3533897711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0334005040 con 0x7f03380f51a0 2022-02-02T13:34:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f033d4df700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0334009f80 tx=0x7f033400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0334009320 con 0x7f03380f51a0 2022-02-02T13:34:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0334013680 con 0x7f03380f51a0 2022-02-02T13:34:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03381059c0 con 0x7f03380f51a0 2022-02-02T13:34:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f033401eda0 con 0x7f03380f51a0 2022-02-02T13:34:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.236+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0338105e50 con 0x7f03380f51a0 2022-02-02T13:34:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.237+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f0334014420 con 0x7f03380f51a0 2022-02-02T13:34:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.237+0000 7f032dffb700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 0x7f0324032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.237+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f0334040f60 con 0x7f03380f51a0 2022-02-02T13:34:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.237+0000 7f033ccde700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 0x7f0324032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.237+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0338059100 con 0x7f03380f51a0 2022-02-02T13:34:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.238+0000 7f033ccde700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 0x7f0324032420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f03280096a0 tx=0x7f0328006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.242+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f033401c910 con 0x7f03380f51a0 2022-02-02T13:34:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.463+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0338045ad0 con 0x7f03380f51a0 2022-02-02T13:34:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.464+0000 7f032dffb700 1 -- 172.21.15.37:0/3533897711 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7f033401a230 con 0x7f03380f51a0 2022-02-02T13:34:14.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:14.465 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 msgr2=0x7f0324032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 0x7f0324032420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f03280096a0 tx=0x7f0328006b40).stop 2022-02-02T13:34:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 msgr2=0x7f0338105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0334009f80 tx=0x7f033400b040).stop 2022-02-02T13:34:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 shutdown_connections 2022-02-02T13:34:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f032402ff60 0x7f0324032420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:14.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 --2- 172.21.15.37:0/3533897711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03380f51a0 0x7f0338105390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:14.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 >> 172.21.15.37:0/3533897711 conn(0x7f03380f09a0 msgr2=0x7f03380f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:14.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 shutdown_connections 2022-02-02T13:34:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:14.467+0000 7f033e4e1700 1 -- 172.21.15.37:0/3533897711 wait complete. 2022-02-02T13:34:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: cluster 2022-02-02T13:34:13.496325+0000 mgr.smithi033.xvkvzp (mgr.14164) 32 : cluster [DBG] 2022-02-02T13:34:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34:14.464736+0000 mon.smithi033 (mon.0) 153 : audit [DBG] from='client.? 172.21.15.37:0/3533897711' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:15.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34:14.574944+0000 mon.smithi033 (mon.0) 154 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:15.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34 2022-02-02T13:34:15.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: :14.576649+0000 mon.smithi033 (mon.0) 155 : audit [INF] 2022-02-02T13:34:15.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:34:15.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34:14.579395 2022-02-02T13:34:15.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 156 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-02-02T13:34:15.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: 2022-02-02T13:34:15.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34:14.580347+0000 2022-02-02T13:34:15.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: mon.smithi033 (mon.0) 157 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:34:15.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: audit 2022-02-02T13:34: 2022-02-02T13:34:15.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:14 smithi033 conmon[31996]: 14.581522+0000 mon.smithi033 (mon.0) 158 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:15.860 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:15.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:15 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:14.582344+0000 mgr.smithi033.xvkvzp (mgr.14164) 33 : cephadm 2022-02-02T13:34:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:15 smithi033 conmon[31996]: [INF] Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:34:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: cluster 2022-02-02T13:34:15.496634+0000 mgr.smithi033.xvkvzp (mgr.14164) 34 : 2022-02-02T13:34:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:17.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: audit 2022-02-02T13:34:16.693521+0000 mon.smithi033 (mon.0) 159 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:17.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: audit 2022-02-02T13:34:16.695007+0000 mon.smithi033 (mon.0) 160 : audit 2022-02-02T13:34:17.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:34:17.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: audit 2022-02-02T13:34: 2022-02-02T13:34:17.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: 16.696026+0000 mon.smithi033 (mon.0) 161 : audit [DBG] 2022-02-02T13:34:17.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:16 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:17.746 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.743+0000 7fec605b6700 1 -- 172.21.15.37:0/4001032155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 msgr2=0x7fec580f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:17.746 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.743+0000 7fec605b6700 1 --2- 172.21.15.37:0/4001032155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec580f6e30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fec54009fb0 tx=0x7fec54009b30).stop 2022-02-02T13:34:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 -- 172.21.15.37:0/4001032155 shutdown_connections 2022-02-02T13:34:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 --2- 172.21.15.37:0/4001032155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec580f6e30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 -- 172.21.15.37:0/4001032155 >> 172.21.15.37:0/4001032155 conn(0x7fec580f02e0 msgr2=0x7fec580f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 -- 172.21.15.37:0/4001032155 shutdown_connections 2022-02-02T13:34:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 -- 172.21.15.37:0/4001032155 wait complete. 2022-02-02T13:34:17.748 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.744+0000 7fec605b6700 1 Processor -- start 2022-02-02T13:34:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec605b6700 1 -- start start 2022-02-02T13:34:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec605b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:17.749 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec605b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec580f5390 con 0x7fec580f6a10 2022-02-02T13:34:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec5e352700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec5e352700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39214/0 (socket says 172.21.15.37:39214) 2022-02-02T13:34:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec5e352700 1 -- 172.21.15.37:0/649025123 learned_addr learned my addr 172.21.15.37:0/649025123 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:17.750 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.745+0000 7fec5e352700 1 -- 172.21.15.37:0/649025123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54005040 con 0x7fec580f6a10 2022-02-02T13:34:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec5e352700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fec540089f0 tx=0x7fec5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec54009320 con 0x7fec580f6a10 2022-02-02T13:34:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec580f5590 con 0x7fec580f6a10 2022-02-02T13:34:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fec54013ec0 con 0x7fec580f6a10 2022-02-02T13:34:17.751 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec54014d30 con 0x7fec580f6a10 2022-02-02T13:34:17.752 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.746+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec58107890 con 0x7fec580f6a10 2022-02-02T13:34:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7fec540263a0 con 0x7fec580f6a10 2022-02-02T13:34:17.753 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58045ad0 con 0x7fec580f6a10 2022-02-02T13:34:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec4effd700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 0x7fec44032420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fec54040fc0 con 0x7fec580f6a10 2022-02-02T13:34:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec5db51700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 0x7fec44032420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:17.754 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.747+0000 7fec5db51700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 0x7fec44032420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fec480096a0 tx=0x7fec48006b40).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:17.755 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.752+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fec54012510 con 0x7fec580f6a10 2022-02-02T13:34:17.998 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.998+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fec580fae90 con 0x7fec580f6a10 2022-02-02T13:34:17.998 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:17.998+0000 7fec4effd700 1 -- 172.21.15.37:0/649025123 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+690 (secure 0 0 0) 0x7fec54012330 con 0x7fec580f6a10 2022-02-02T13:34:17.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:17.999 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:32:15.083743Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-02-02T13:34:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 msgr2=0x7fec44032420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 0x7fec44032420 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fec480096a0 tx=0x7fec48006b40).stop 2022-02-02T13:34:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 msgr2=0x7fec58107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fec540089f0 tx=0x7fec5400b040).stop 2022-02-02T13:34:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 shutdown_connections 2022-02-02T13:34:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fec4402ff60 0x7fec44032420 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 --2- 172.21.15.37:0/649025123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec580f6a10 0x7fec58107160 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 >> 172.21.15.37:0/649025123 conn(0x7fec580f02e0 msgr2=0x7fec580f0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 shutdown_connections 2022-02-02T13:34:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:18.000+0000 7fec605b6700 1 -- 172.21.15.37:0/649025123 wait complete. 2022-02-02T13:34:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2022-02-02T13:34:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:17 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:16.697076+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:34:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:17 smithi033 conmon[31996]: 35 : cephadm [INF] Deploying daemon mon.smithi037 on smithi037 2022-02-02T13:34:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:18 smithi033 conmon[31996]: cluster 2022-02-02T13:34:17.497033+0000 mgr.smithi033.xvkvzp (mgr.14164) 36 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:18 smithi033 conmon[31996]: 2022-02-02T13:34:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:18 smithi033 conmon[31996]: audit 2022-02-02T13:34:17.999189+0000 mon.smithi033 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.37:0/649025123' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:19.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 systemd[1]: Starting Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:34:19.721 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-02-02T13:34:19.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-02-02T13:34:20.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 podman[35503]: 2022-02-02T13:34:20.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.830+0000 7f3c63be0700 0 set uid:gid to 167:167 (ceph:ceph) 2022-02-02T13:34:20.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.830+0000 7f3c63be0700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-02-02T13:34:20.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.830+0000 7f3c63be0700 0 pidfile_write: ignore empty --pid-file 2022-02-02T13:34:20.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.834+0000 7f3c63be0700 0 load: jerasure load: lrc load: isa 2022-02-02T13:34:20.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: RocksDB version: 6.8.1 2022-02-02T13:34:20.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T13:34:20.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Compile date May 13 2021 2022-02-02T13:34:20.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: DB SUMMARY 2022-02-02T13:34:20.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: CURRENT file: CURRENT 2022-02-02T13:34:20.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: IDENTITY file: IDENTITY 2022-02-02T13:34:20.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2022-02-02T13:34:20.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi037/store.db dir, Total Num: 0, files: 2022-02-02T13:34:20.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi037/store.db: 000003.log size: 511 ; 2022-02-02T13:34:20.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.error_if_exists: 0 2022-02-02T13:34:20.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.create_if_missing: 0 2022-02-02T13:34:20.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.paranoid_checks: 1 2022-02-02T13:34:20.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.env: 0x55708fc611c0 2022-02-02T13:34:20.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.fs: Posix File System 2022-02-02T13:34:20.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.info_log: 0x557091fb3960 2022-02-02T13:34:20.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_file_opening_threads: 16 2022-02-02T13:34:20.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.statistics: (nil) 2022-02-02T13:34:20.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.use_fsync: 0 2022-02-02T13:34:20.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_log_file_size: 0 2022-02-02T13:34:20.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T13:34:20.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T13:34:20.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.keep_log_file_num: 1000 2022-02-02T13:34:20.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.recycle_log_file_num: 0 2022-02-02T13:34:20.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.allow_fallocate: 1 2022-02-02T13:34:20.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.allow_mmap_reads: 0 2022-02-02T13:34:20.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.allow_mmap_writes: 0 2022-02-02T13:34:20.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.use_direct_reads: 0 2022-02-02T13:34:20.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T13:34:20.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.create_missing_column_families: 0 2022-02-02T13:34:20.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.db_log_dir: 2022-02-02T13:34:20.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi037/store.db 2022-02-02T13:34:20.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T13:34:20.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_subcompactions: 1 2022-02-02T13:34:20.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_background_flushes: -1 2022-02-02T13:34:20.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T13:34:20.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T13:34:20.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 bash[35426]: 3146766def98f803e0c11d6a3642fd114229e1532ba85df3851051d80495b26f 2022-02-02T13:34:20.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T13:34:20.056 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T13:34:20.056 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T13:34:20.056 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.advise_random_on_open: 1 2022-02-02T13:34:20.056 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.db_write_buffer_size: 0 2022-02-02T13:34:20.057 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.write_buffer_manager: 0x557092c28030 2022-02-02T13:34:20.057 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T13:34:20.057 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T13:34:20.057 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T13:34:20.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T13:34:20.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.rate_limiter: (nil) 2022-02-02T13:34:20.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T13:34:20.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.059 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.wal_recovery_mode: 2 2022-02-02T13:34:20.059 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.enable_thread_tracking: 0 2022-02-02T13:34:20.059 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.enable_pipelined_write: 0 2022-02-02T13:34:20.059 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.unordered_write: 0 2022-02-02T13:34:20.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T13:34:20.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T13:34:20.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T13:34:20.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T13:34:20.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.row_cache: None 2022-02-02T13:34:20.061 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.wal_filter: None 2022-02-02T13:34:20.061 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T13:34:20.062 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.allow_ingest_behind: 0 2022-02-02T13:34:20.062 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.preserve_deletes: 0 2022-02-02T13:34:20.062 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.two_write_queues: 0 2022-02-02T13:34:20.062 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.manual_wal_flush: 0 2022-02-02T13:34:20.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.atomic_flush: 0 2022-02-02T13:34:20.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T13:34:20.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T13:34:20.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T13:34:20.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.log_readahead_size: 0 2022-02-02T13:34:20.064 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-02-02T13:34:20.064 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.064 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_background_jobs: 2 2022-02-02T13:34:20.064 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_background_compactions: -1 2022-02-02T13:34:20.065 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.065 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T13:34:20.065 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T13:34:20.065 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.065 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T13:34:20.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_total_wal_size: 0 2022-02-02T13:34:20.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T13:34:20.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T13:34:20.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T13:34:20.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T13:34:20.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.max_open_files: -1 2022-02-02T13:34:20.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.bytes_per_sync: 0 2022-02-02T13:34:20.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T13:34:20.068 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.068 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T13:34:20.068 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Options.compaction_readahead_size: 0 2022-02-02T13:34:20.068 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Compression algorithms supported: 2022-02-02T13:34:20.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T13:34:20.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kZSTD supported: 0 2022-02-02T13:34:20.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kXpressCompression supported: 0 2022-02-02T13:34:20.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kLZ4HCCompression supported: 1 2022-02-02T13:34:20.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kLZ4Compression supported: 1 2022-02-02T13:34:20.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kBZip2Compression supported: 0 2022-02-02T13:34:20.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kZlibCompression supported: 1 2022-02-02T13:34:20.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: kSnappyCompression supported: 1 2022-02-02T13:34:20.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T13:34:20.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.835+0000 7f3c63be0700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000001 2022-02-02T13:34:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-02-02T13:34:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T13:34:20.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.merge_operator: 2022-02-02T13:34:20.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_filter: None 2022-02-02T13:34:20.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_filter_factory: None 2022-02-02T13:34:20.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T13:34:20.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T13:34:20.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557091eca128) 2022-02-02T13:34:20.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: cache_index_and_filter_blocks: 1 2022-02-02T13:34:20.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T13:34:20.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T13:34:20.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: pin_top_level_index_and_filter: 1 2022-02-02T13:34:20.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: index_type: 0 2022-02-02T13:34:20.076 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: data_block_index_type: 0 2022-02-02T13:34:20.076 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: index_shortening: 1 2022-02-02T13:34:20.076 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: data_block_hash_table_util_ratio: 0.750000 2022-02-02T13:34:20.076 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: hash_index_allow_collision: 1 2022-02-02T13:34:20.077 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: checksum: 1 2022-02-02T13:34:20.077 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: no_block_cache: 0 2022-02-02T13:34:20.077 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_cache: 0x557091f00f10 2022-02-02T13:34:20.077 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_cache_name: BinnedLRUCache 2022-02-02T13:34:20.077 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_cache_options: 2022-02-02T13:34:20.078 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: capacity : 536870912 2022-02-02T13:34:20.078 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: num_shard_bits : 4 2022-02-02T13:34:20.078 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: strict_capacity_limit : 0 2022-02-02T13:34:20.078 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: high_pri_pool_ratio: 0.000 2022-02-02T13:34:20.078 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_cache_compressed: (nil) 2022-02-02T13:34:20.079 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: persistent_cache: (nil) 2022-02-02T13:34:20.079 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_size: 4096 2022-02-02T13:34:20.079 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_size_deviation: 10 2022-02-02T13:34:20.079 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_restart_interval: 16 2022-02-02T13:34:20.080 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: index_block_restart_interval: 1 2022-02-02T13:34:20.080 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: metadata_block_size: 4096 2022-02-02T13:34:20.080 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: partition_filters: 0 2022-02-02T13:34:20.080 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: use_delta_encoding: 1 2022-02-02T13:34:20.080 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T13:34:20.081 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: whole_key_filtering: 1 2022-02-02T13:34:20.081 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: verify_compression: 0 2022-02-02T13:34:20.081 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: read_amp_bytes_per_bit: 0 2022-02-02T13:34:20.081 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: format_version: 2 2022-02-02T13:34:20.082 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: enable_index_compression: 1 2022-02-02T13:34:20.082 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: block_align: 0 2022-02-02T13:34:20.082 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.083 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.write_buffer_size: 33554432 2022-02-02T13:34:20.083 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_write_buffer_number: 2 2022-02-02T13:34:20.083 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression: NoCompression 2022-02-02T13:34:20.083 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression: Disabled 2022-02-02T13:34:20.084 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.prefix_extractor: nullptr 2022-02-02T13:34:20.084 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T13:34:20.084 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.num_levels: 7 2022-02-02T13:34:20.084 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T13:34:20.084 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T13:34:20.085 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T13:34:20.085 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T13:34:20.085 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T13:34:20.085 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T13:34:20.085 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T13:34:20.086 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:34:20.086 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T13:34:20.086 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T13:34:20.086 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.level: 32767 2022-02-02T13:34:20.087 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.strategy: 0 2022-02-02T13:34:20.087 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T13:34:20.087 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:34:20.087 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compression_opts.enabled: false 2022-02-02T13:34:20.087 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T13:34:20.088 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T13:34:20.088 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T13:34:20.088 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.target_file_size_base: 67108864 2022-02-02T13:34:20.088 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T13:34:20.089 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T13:34:20.089 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.089 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T13:34:20.089 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T13:34:20.089 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T13:34:20.090 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T13:34:20.090 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T13:34:20.090 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T13:34:20.090 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T13:34:20.091 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T13:34:20.091 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T13:34:20.091 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T13:34:20.091 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T13:34:20.091 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.arena_block_size: 4194304 2022-02-02T13:34:20.092 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T13:34:20.092 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T13:34:20.092 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T13:34:20.092 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.disable_auto_compactions: 0 2022-02-02T13:34:20.093 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T13:34:20.093 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T13:34:20.093 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T13:34:20.093 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T13:34:20.093 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T13:34:20.094 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T13:34:20.094 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T13:34:20.094 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T13:34:20.094 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T13:34:20.095 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T13:34:20.095 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.table_properties_collectors: 2022-02-02T13:34:20.095 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.inplace_update_support: 0 2022-02-02T13:34:20.095 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T13:34:20.095 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T13:34:20.096 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T13:34:20.096 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T13:34:20.096 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.bloom_locality: 0 2022-02-02T13:34:20.096 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.max_successive_merges: 0 2022-02-02T13:34:20.097 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T13:34:20.097 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.paranoid_file_checks: 0 2022-02-02T13:34:20.097 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.force_consistency_checks: 0 2022-02-02T13:34:20.097 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.report_bg_io_stats: 0 2022-02-02T13:34:20.097 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.ttl: 2592000 2022-02-02T13:34:20.098 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T13:34:20.098 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T13:34:20.098 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.098 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.836+0000 7f3c63be0700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-02-02T13:34:20.099 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.099 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.837+0000 7f3c63be0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808859837557, "job": 1, "event": "recovery_started", "log_files": [3]} 2022-02-02T13:34:20.099 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.837+0000 7f3c63be0700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2022-02-02T13:34:20.099 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.837+0000 7f3c63be0700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T13:34:20.099 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.101 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.837+0000 7f3c63be0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808859838243, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643808859, "oldest_key_time": 3, "file_creation_time": 0}} 2022-02-02T13:34:20.101 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.837+0000 7f3c63be0700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2022-02-02T13:34:20.101 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.101 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.838+0000 7f3c63be0700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1643808859838783, "job": 1, "event": "recovery_finished"} 2022-02-02T13:34:20.102 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.839+0000 7f3c63be0700 4 rocksdb: DB pointer 0x557091fc5800 2022-02-02T13:34:20.102 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.839+0000 7f3c4a9f8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-02-02T13:34:20.102 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.839+0000 7f3c4a9f8700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-02-02T13:34:20.102 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** DB Stats ** 2022-02-02T13:34:20.103 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:34:20.103 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T13:34:20.103 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T13:34:20.103 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:34:20.104 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T13:34:20.104 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T13:34:20.104 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:34:20.104 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.104 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** Compaction Stats [default] ** 2022-02-02T13:34:20.105 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:34:20.105 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:34:20.105 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.105 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.106 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.106 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.106 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** Compaction Stats [default] ** 2022-02-02T13:34:20.107 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:34:20.107 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:34:20.107 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.107 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:34:20.107 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:34:20.108 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:34:20.108 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:34:20.108 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:34:20.108 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:34:20.108 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Cumulative compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:34:20.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Interval compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:34:20.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:34:20.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:34:20.110 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.110 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** Compaction Stats [default] ** 2022-02-02T13:34:20.110 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:34:20.110 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:34:20.110 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.111 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.111 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:34:20.111 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.111 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** Compaction Stats [default] ** 2022-02-02T13:34:20.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:34:20.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:34:20.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2022-02-02T13:34:20.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:34:20.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Flush(GB): cumulative 0.000, interval 0.000 2022-02-02T13:34:20.113 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:34:20.113 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:34:20.113 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:34:20.114 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:34:20.114 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Cumulative compaction: 0.00 GB write, 0.39 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:34:20.114 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:34:20.114 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:34:20.115 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.115 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:34:20.115 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.115 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.839+0000 7f3c63be0700 0 mon.smithi037 does not exist in monmap, will attempt to join an existing cluster 2022-02-02T13:34:20.115 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.840+0000 7f3c63be0700 0 using public_addr v2:172.21.15.37:0/0 -> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2022-02-02T13:34:20.116 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.840+0000 7f3c63be0700 0 starting mon.smithi037 rank -1 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi037 fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:34:20.116 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.842+0000 7f3c63be0700 1 mon.smithi037@-1(???) e0 preinit fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:34:20.116 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 systemd[1]: Started Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:34:20.116 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).mds e1 new map 2022-02-02T13:34:20.117 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).mds e1 print_map 2022-02-02T13:34:20.117 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: e1 2022-02-02T13:34:20.117 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:34:20.117 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:34:20.117 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: legacy client fscid: -1 2022-02-02T13:34:20.118 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.118 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: No filesystems configured 2022-02-02T13:34:20.118 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.118 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-02-02T13:34:20.118 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-02-02T13:34:20.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-02-02T13:34:20.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-02-02T13:34:20.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-02-02T13:34:20.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-02-02T13:34:20.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.872+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2022-02-02T13:34:20.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.873+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2022-02-02T13:34:20.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.873+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:34:20.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.873+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:34:20.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.873+0000 7f3c4d1fd700 0 mon.smithi037@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-02-02T13:34:20.121 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: cluster 2022-02-02T13:34:20.121 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:17.497033+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:20.121 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: (mgr.14164) 36 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:20.121 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:20.122 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:34:20.122 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: :34:17.999189+0000 mon.smithi033 (mon. 2022-02-02T13:34:20.122 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 0) 162 : audit [DBG] from='client.? 172.21.15.37:0/649025123' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:20.122 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.873+0000 7f3c4d1fd700 1 mon.smithi037@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2022-02-02T13:34:20.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expand map: {default=false} 2022-02-02T13:34:20.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta from 'false' to 'false' 2022-02-02T13:34:20.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expanded map: {default=false} 2022-02-02T13:34:20.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:20.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expand map: {default=info} 2022-02-02T13:34:20.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta from 'info' to 'info' 2022-02-02T13:34:20.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expanded map: {default=info} 2022-02-02T13:34:20.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expand map: {default=daemon} 2022-02-02T13:34:20.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta from 'daemon' to 'daemon' 2022-02-02T13:34:20.125 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expanded map: {default=daemon} 2022-02-02T13:34:20.125 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expand map: {default=debug} 2022-02-02T13:34:20.125 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta from 'debug' to 'debug' 2022-02-02T13:34:20.125 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 20 expand_channel_meta expanded map: {default=debug} 2022-02-02T13:34:20.125 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:19 smithi037 conmon[35544]: debug 2022-02-02T13:34:19.875+0000 7f3c4d1fd700 10 mon.smithi037@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2022-02-02T13:34:24.924 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 -- 172.21.15.37:0/1208504648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec0003250 msgr2=0x7f2ec00056e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:24.925 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/1208504648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec0003250 0x7f2ec00056e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f2ed406af30 tx=0x7f2ed000b040).stop 2022-02-02T13:34:24.925 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 -- 172.21.15.37:0/1208504648 shutdown_connections 2022-02-02T13:34:24.925 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/1208504648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec0003250 0x7f2ec00056e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:24.926 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 -- 172.21.15.37:0/1208504648 >> 172.21.15.37:0/1208504648 conn(0x7f2ed40f1c70 msgr2=0x7f2ed40f4090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:24.926 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 -- 172.21.15.37:0/1208504648 shutdown_connections 2022-02-02T13:34:24.926 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.921+0000 7f2edb2c6700 1 -- 172.21.15.37:0/1208504648 wait complete. 2022-02-02T13:34:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.922+0000 7f2edb2c6700 1 Processor -- start 2022-02-02T13:34:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.922+0000 7f2edb2c6700 1 -- start start 2022-02-02T13:34:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.922+0000 7f2edb2c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:24.927 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.922+0000 7f2edb2c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 0x7f2ed4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2edb2c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4109300 con 0x7f2ed4108da0 2022-02-02T13:34:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2edb2c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed4109440 con 0x7f2ec0003250 2022-02-02T13:34:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed8861700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 0x7f2ed4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:24.928 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34086/0 (socket says 172.21.15.37:34086) 2022-02-02T13:34:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 -- 172.21.15.37:0/2465759220 learned_addr learned my addr 172.21.15.37:0/2465759220 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:34:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 -- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 msgr2=0x7f2ed41088b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2022-02-02T13:34:24.929 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 -- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 msgr2=0x7f2ed41088b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-02-02T13:34:24.930 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2022-02-02T13:34:24.930 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed9062700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:34:24.930 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed8861700 1 -- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 msgr2=0x7f2ed41088b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:34:24.930 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed8861700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed8861700 1 -- 172.21.15.37:0/2465759220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0005040 con 0x7f2ed4108da0 2022-02-02T13:34:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.923+0000 7f2ed8861700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 0x7f2ed4109c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2ec4009390 tx=0x7f2ec4006e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.924+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec40115e0 con 0x7f2ed4108da0 2022-02-02T13:34:24.931 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.924+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2ec4011bd0 con 0x7f2ed4108da0 2022-02-02T13:34:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.924+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed410a2a0 con 0x7f2ed4108da0 2022-02-02T13:34:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.924+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec4010b50 con 0x7f2ed4108da0 2022-02-02T13:34:24.932 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.924+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed410a860 con 0x7f2ed4108da0 2022-02-02T13:34:24.933 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.925+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 36269+0+0 (secure 0 0 0) 0x7f2ec4018030 con 0x7f2ed4108da0 2022-02-02T13:34:24.934 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.925+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed4059100 con 0x7f2ed4108da0 2022-02-02T13:34:24.934 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.926+0000 7f2ec9ffb700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 0x7f2eb80325a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:24.934 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.926+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f2ec403f370 con 0x7f2ed4108da0 2022-02-02T13:34:24.935 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.926+0000 7f2ed9062700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 0x7f2eb80325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:24.935 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.926+0000 7f2ed9062700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 0x7f2eb80325a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2ed000afe0 tx=0x7f2ed0002040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:24.935 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.930+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2ec4018ab0 con 0x7f2ed4108da0 2022-02-02T13:34:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:24.974+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2ec400f070 con 0x7f2ed4108da0 2022-02-02T13:34:25.177 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.177+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2ed4045ad0 con 0x7f2ed4108da0 2022-02-02T13:34:25.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:19.497352+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:25.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mgr.14164) 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:19.882279+0000 mon.smithi033 (mon.0) 164 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:34:25.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:19.882518+0000 mon.smithi033 (mon.0) 165 : cluster [INF] mon.smithi033 calling monitor election 2022-02-02T13:34:25.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:19.896738+0000 mon.smithi033 (mon.0) 166 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:20.878586+0000 mon.smithi033 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:21.497744+0000 mgr.smithi033.xvkvzp (mgr.14164) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:21.878665+0000 mon.smithi033 (mon.0) 168 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:21.880497+0000 mon.smithi037 (mon.1) 1 : cluster [INF] mon.smithi037 calling monitor election 2022-02-02T13:34:25.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:22.766572+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:34:25.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:22.878695+0000 mon.smithi033 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:23.498180+0000 mgr.smithi033.xvkvzp (mgr.14164) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:23.670310+0000 mon.smithi033 (mon.0) 171 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:34:25.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 2022-02-02T13:34:25.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022-02-02T13:34:25.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 2022-02-02T13:34 2022-02-02T13:34:25.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: :23.674986+0000 mon.smithi033 ( 2022-02-02T13:34:25.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mon.0) 172 : audit [INF] 2022-02-02T13:34:25.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:34:25.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:34:25.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 02-02T13:34:23. 2022-02-02T13:34:25.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 879186+0000 mon.smithi033 (mon. 2022-02-02T13:34:25.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 0) 173 : audit [DBG] 2022-02-02T13:34:25.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:25.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.879093+0000 mon.smithi033 (mon 2022-02-02T13:34:25.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 174 : audit [DBG] 2022-02-02T13:34:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.177+0000 7f2ec9ffb700 1 -- 172.21.15.37:0/2465759220 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+964 (secure 0 0 0) 0x7f2ec4016070 con 0x7f2ed4108da0 2022-02-02T13:34:25.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2022-02-02T13:34:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","modified":"2022-02-02T13:34:19.879518Z","created":"2022-02-02T13:32:15.083743Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi033","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-02-02T13:34:25.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.910548+0000 mon.smithi033 (mon 2022-02-02T13:34:25.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 175 : cluster [INF] 2022-02-02T13:34:25.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mon.smithi033 is new leader, mons smithi033,smithi037 in quorum (ranks 0,1) 2022-02-02T13:34:25.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34:24 2022-02-02T13:34:25.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .913657+0000 mon.smithi033 (mon. 2022-02-02T13:34:25.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 0) 176 : cluster [DBG] 2022-02-02T13:34:25.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2022-02-02T13:34:25.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34:24 2022-02-02T13:34:25.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .913723+0000 mon.smithi033 (mon 2022-02-02T13:34:25.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 177 : cluster [DBG] 2022-02-02T13:34:25.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: fsmap 2022-02-02T13:34:25.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.913757+0000 mon.smithi033 (mon 2022-02-02T13:34:25.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 178 : cluster [DBG] 2022-02-02T13:34:25.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: osdmap e5: 0 total, 0 up, 0 in 2022-02-02T13:34:25.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34:24.914006+0000 2022-02-02T13:34:25.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mon.smithi033 (mon.0) 179 2022-02-02T13:34:25.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: : cluster [DBG] mgrmap e17: smithi033.xvkvzp(active, since 61s) 2022-02-02T13:34:25.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022-02-02T13:34:25.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 2022-02-02T13:34 2022-02-02T13:34:25.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: :24.915202+0000 mon.smithi033 ( 2022-02-02T13:34:25.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mon.0) 180 : cluster 2022-02-02T13:34:25.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:34:25.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:25.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34:24 2022-02-02T13:34:25.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .916530+0000 mon.smithi033 (mon. 2022-02-02T13:34:25.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 0) 181 : audit [DBG] 2022-02-02T13:34:25.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:34:25.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:34:25.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34:24 2022-02-02T13:34:25.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .918107+0000 mon.smithi033 (mon.0 2022-02-02T13:34:25.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: ) 182 : cluster [INF] overall HEALTH_OK 2022-02-02T13:34:25.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 2022-02-02T13:34:25.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:25.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.918580+0000 mon.smithi033 (mon 2022-02-02T13:34:25.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 183 : audit 2022-02-02T13:34:25.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: [DBG] from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:34:25.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:25.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.920376+0000 mon.smithi033 (mon 2022-02-02T13:34:25.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: .0) 184 : audit [INF] 2022-02-02T13:34:25.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:25.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:25.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: -02-02T13:34: 2022-02-02T13:34:25.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: 24.920687+0000 mon.smithi033 ( 2022-02-02T13:34:25.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: mon.0) 185 : audit 2022-02-02T13:34:25.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:24 smithi037 conmon[35544]: [DBG] from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:34:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 msgr2=0x7f2eb80325a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 0x7f2eb80325a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f2ed000afe0 tx=0x7f2ed0002040).stop 2022-02-02T13:34:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 msgr2=0x7f2ed4109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 0x7f2ed4109c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2ec4009390 tx=0x7f2ec4006e20).stop 2022-02-02T13:34:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 shutdown_connections 2022-02-02T13:34:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2eb80300e0 0x7f2eb80325a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0003250 0x7f2ed41088b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 --2- 172.21.15.37:0/2465759220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ed4108da0 0x7f2ed4109c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 >> 172.21.15.37:0/2465759220 conn(0x7f2ed40f1c70 msgr2=0x7f2ed40fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 shutdown_connections 2022-02-02T13:34:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:34:25.180+0000 7f2edb2c6700 1 -- 172.21.15.37:0/2465759220 wait complete. 2022-02-02T13:34:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 2 2022-02-02T13:34:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:19.497352+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:34:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:19.882279+0000 mon.smithi033 (mon.0) 164 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:34:25.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:19.882518+0000 mon.smithi033 (mon.0) 165 : cluster [INF] mon.smithi033 calling monitor election 2022-02-02T13:34:25.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:19.896738+0000 mon.smithi033 (mon.0) 166 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:20.878586+0000 mon.smithi033 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:21.497744+0000 mgr.smithi033.xvkvzp (mgr.14164) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:21.878665+0000 mon.smithi033 (mon.0) 168 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:21.880497+0000 mon.smithi037 (mon.1) 1 : cluster [INF] mon.smithi037 calling monitor election 2022-02-02T13:34:25.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:22.766572+0000 mon.smithi033 (mon.0) 169 : audit [DBG] from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:34:25.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:22.878695+0000 mon.smithi033 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:23.498180+0000 mgr.smithi033.xvkvzp (mgr.14164) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:25.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:23.670310+0000 mon.smithi033 (mon.0) 171 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:34:25.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:25.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 02-02T13:34:23.674986+0000 mon.smithi033 (mon.0) 172 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:34:25.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:23.879186+0000 mon.smithi033 (mon.0) 173 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:24.879093+0000 2022-02-02T13:34:25.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: mon.smithi033 (mon.0) 174 : audit [DBG] 2022-02-02T13:34:25.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:25.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:25.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:24.910548+0000 mon.smithi033 2022-02-02T13:34:25.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: (mon.0) 175 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi037 in quorum (ranks 0,1) 2022-02-02T13:34:25.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:25.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:34:25.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: -02-02T13:34:24.913657+0000 mon.smithi033 ( 2022-02-02T13:34:25.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: mon.0) 176 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2022-02-02T13:34:25.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13 2022-02-02T13:34:25.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: :34:24.913723+0000 mon.smithi033 (mon.0) 177 2022-02-02T13:34:25.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: : cluster [DBG] fsmap 2022-02-02T13:34:25.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T 2022-02-02T13:34:25.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 13:34:24.913757+0000 mon.smithi033 (mon. 2022-02-02T13:34:25.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 0) 178 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-02-02T13:34:25.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:34:25.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 02T13:34:24.914006+0000 mon.smithi033 (mon 2022-02-02T13:34:25.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: .0) 179 : cluster [DBG] mgrmap e17: smithi033.xvkvzp(active, since 61s) 2022-02-02T13:34:25.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:34:25.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 02T13:34:24.915202+0000 mon.smithi033 2022-02-02T13:34:25.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: (mon.0) 180 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:34:25.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:25.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34:25.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:24.916530+0000 2022-02-02T13:34:25.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: mon.smithi033 (mon.0) 181 : audit [DBG] 2022-02-02T13:34:25.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:34:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: cluster 2022-02-02T13:34:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:24.918107+0000 mon.smithi033 ( 2022-02-02T13:34:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: mon.0) 182 : cluster [INF] overall HEALTH_OK 2022-02-02T13:34:25.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:34:25.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 02-02T13:34:24.918580+0000 2022-02-02T13:34:25.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: mon.smithi033 (mon.0) 183 : audit [DBG] 2022-02-02T13:34:25.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:34:25.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02-02T13:34 2022-02-02T13:34:25.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: :24.920376+0000 mon.smithi033 (mon.0) 2022-02-02T13:34:25.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 184 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:25.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:34:25.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 02T13:34:24.920687+0000 mon.smithi033 2022-02-02T13:34:25.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: (mon.0) 185 : audit [DBG] from='mgr.? 172.21.15.37:0/2187644096' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:34:25.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:24 smithi033 conmon[31996]: 2022-02-02T13:34:25.468 INFO:tasks.cephadm:Generating final ceph.conf file... 2022-02-02T13:34:25.468 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph config generate-minimal-conf 2022-02-02T13:34:26.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:24.921634+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:26.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: mgr.14164) 40 : cephadm [INF] Deploying daemon node-exporter.smithi037 on smithi037 2022-02-02T13:34:26.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: cluster 2022-02-02T13:34:24.976108+0000 mon.smithi033 (mon.0) 186 : cluster [DBG] mgrmap e18: smithi033.xvkvzp(active, since 61s), standbys: smithi037.npteou 2022-02-02T13:34:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: audit 2022-02-02T13:34:24.976281+0000 mon.smithi033 (mon.0) 187 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:34:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: audit 2022-02-02T13:34:25.178200+0000 mon.smithi033 (mon.0) 188 : audit [DBG] from='client.? 172.21.15.37:0/2465759220' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:25 smithi037 conmon[35544]: audit 2022-02-02T13:34:25.879046+0000 mon.smithi033 (mon.0) 189 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:24.921634+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: mgr.14164) 40 : cephadm [INF] Deploying daemon node-exporter.smithi037 on smithi037 2022-02-02T13:34:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: cluster 2022-02-02T13:34:24.976108+0000 mon.smithi033 (mon.0) 186 : cluster [DBG] mgrmap e18: smithi033.xvkvzp(active, since 61s), standbys: smithi037.npteou 2022-02-02T13:34:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: 2022-02-02T13:34:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: audit 2022-02-02T13:34:24.976281+0000 mon.smithi033 (mon.0) 2022-02-02T13:34:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: 187 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:34:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: audit 2022-02-02T13:34 2022-02-02T13:34:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: :25.178200+0000 mon.smithi033 (mon.0) 2022-02-02T13:34:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: 188 : audit [DBG] from='client.? 172.21.15.37:0/2465759220' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-02-02T13:34:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:34:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: :34:25.879046+0000 mon.smithi033 (mon. 2022-02-02T13:34:26.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:25 smithi033 conmon[31996]: 0) 189 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:34:27.183 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:26 smithi033 conmon[31996]: cluster 2022-02-02T13:34:25.498545+0000 mgr.smithi033.xvkvzp (mgr.14164) 41 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:27.246 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:26 smithi037 conmon[35544]: cluster 2022-02-02T13:34:25.498545+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:34:27.246 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:26 smithi037 conmon[35544]: .14164) 41 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:28 smithi033 conmon[31996]: cluster 2022-02-02T13:34:27.498960+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:28 smithi033 conmon[31996]: 14164) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:28 smithi033 conmon[31996]: audit 2022-02-02T13:34:27.978468+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:28 smithi033 conmon[31996]: audit 2022-02-02T13:34:27.979555+0000 mon.smithi033 (mon.0) 191 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:34:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:28 smithi037 conmon[35544]: cluster 2022-02-02T13:34:27.498960+0000 mgr.smithi033.xvkvzp (mgr.14164) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:28 smithi037 conmon[35544]: audit 2022-02-02T13:34:27.978468+0000 mon.smithi033 (mon.0) 190 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:29.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:28 smithi037 conmon[35544]: audit 2022-02-02T13:34:27.979555+0000 mon.smithi033 (mon.0) 191 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:34:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 -- 172.21.15.33:0/2216859360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 msgr2=0x7fe32c0f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 --2- 172.21.15.33:0/2216859360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c0f5830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fe324009960 tx=0x7fe324004d10).stop 2022-02-02T13:34:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 -- 172.21.15.33:0/2216859360 shutdown_connections 2022-02-02T13:34:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 --2- 172.21.15.33:0/2216859360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c0f5830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 -- 172.21.15.33:0/2216859360 >> 172.21.15.33:0/2216859360 conn(0x7fe32c0f0b70 msgr2=0x7fe32c0f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 -- 172.21.15.33:0/2216859360 shutdown_connections 2022-02-02T13:34:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.121+0000 7fe3343f2700 1 -- 172.21.15.33:0/2216859360 wait complete. 2022-02-02T13:34:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 Processor -- start 2022-02-02T13:34:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 -- start start 2022-02-02T13:34:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 0x7fe32c107d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1073d0 con 0x7fe32c0f5410 2022-02-02T13:34:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe3343f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c107510 con 0x7fe32c106e70 2022-02-02T13:34:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55874/0 (socket says 172.21.15.33:55874) 2022-02-02T13:34:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 -- 172.21.15.33:0/3092898769 learned_addr learned my addr 172.21.15.33:0/3092898769 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:34:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33198d700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 0x7fe32c107d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:30.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 -- 172.21.15.33:0/3092898769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 msgr2=0x7fe32c107d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 0x7fe32c107d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 -- 172.21.15.33:0/3092898769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009640 con 0x7fe32c0f5410 2022-02-02T13:34:30.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33198d700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 0x7fe32c107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:34:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.122+0000 7fe33218e700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe32400b600 tx=0x7fe324004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.123+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe32400e070 con 0x7fe32c0f5410 2022-02-02T13:34:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.123+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe324007dd0 con 0x7fe32c0f5410 2022-02-02T13:34:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.123+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c108310 con 0x7fe32c0f5410 2022-02-02T13:34:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.123+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe324018070 con 0x7fe32c0f5410 2022-02-02T13:34:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.123+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c108870 con 0x7fe32c0f5410 2022-02-02T13:34:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.124+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe324024060 con 0x7fe32c0f5410 2022-02-02T13:34:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.124+0000 7fe32affd700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 0x7fe31405e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.124+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c004fa0 con 0x7fe32c0f5410 2022-02-02T13:34:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.124+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fe3240775f0 con 0x7fe32c0f5410 2022-02-02T13:34:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.124+0000 7fe33198d700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 0x7fe31405e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.125+0000 7fe33198d700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 0x7fe31405e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe32000b890 tx=0x7fe320008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.129+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe32404b300 con 0x7fe32c0f5410 2022-02-02T13:34:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.292+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fe30c005670 con 0x7fe32c0f5410 2022-02-02T13:34:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.293+0000 7fe32affd700 1 -- 172.21.15.33:0/3092898769 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v12) v1 ==== 76+0+223 (secure 0 0 0) 0x7fe32402c0f0 con 0x7fe32c0f5410 2022-02-02T13:34:30.293 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:34:30.294 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2022-02-02T13:34:30.294 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:34:30.294 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] 2022-02-02T13:34:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 msgr2=0x7fe31405e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 0x7fe31405e8b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe32000b890 tx=0x7fe320008040).stop 2022-02-02T13:34:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 msgr2=0x7fe32c106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fe32400b600 tx=0x7fe324004d10).stop 2022-02-02T13:34:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 shutdown_connections 2022-02-02T13:34:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe31405c3f0 0x7fe31405e8b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe32c0f5410 0x7fe32c106980 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 --2- 172.21.15.33:0/3092898769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe32c106e70 0x7fe32c107d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 >> 172.21.15.33:0/3092898769 conn(0x7fe32c0f0b70 msgr2=0x7fe32c05fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.294+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 shutdown_connections 2022-02-02T13:34:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:30.295+0000 7fe3343f2700 1 -- 172.21.15.33:0/3092898769 wait complete. 2022-02-02T13:34:30.923 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2022-02-02T13:34:30.924 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:34:30.924 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2022-02-02T13:34:30.953 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:34:30.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T13:34:31.021 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:34:31.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2022-02-02T13:34:31.060 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:34:31.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-02-02T13:34:31.131 INFO:tasks.cephadm:Deploying OSDs... 2022-02-02T13:34:31.132 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:34:31.132 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2022-02-02T13:34:31.149 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-02-02T13:34:31.150 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-02-02T13:34:31.206 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-02-02T13:34:31.207 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 153189 Links: 1 2022-02-02T13:34:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.209 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-02-02 13:34:06.601183346 +0000 2022-02-02T13:34:31.209 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-02-02 13:28:38.198726078 +0000 2022-02-02T13:34:31.210 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-02-02 13:28:38.198726078 +0000 2022-02-02T13:34:31.210 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-02-02T13:34:31.217 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-02-02T13:34:31.217 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-02-02T13:34:31.218 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000244407 s, 2.1 MB/s 2022-02-02T13:34:31.221 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-02-02T13:34:31.279 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-02-02T13:34:31.279 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.279 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 152499 Links: 1 2022-02-02T13:34:31.280 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.280 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.280 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-02-02 13:34:06.601183346 +0000 2022-02-02T13:34:31.280 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-02-02 13:28:38.549720495 +0000 2022-02-02T13:34:31.280 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-02-02 13:28:38.549720495 +0000 2022-02-02T13:34:31.281 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-02-02T13:34:31.289 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-02-02T13:34:31.289 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-02-02T13:34:31.290 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000240295 s, 2.1 MB/s 2022-02-02T13:34:31.293 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-02-02T13:34:31.349 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-02-02T13:34:31.350 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.350 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 156369 Links: 1 2022-02-02T13:34:31.350 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.350 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.353 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-02-02 13:34:06.601183346 +0000 2022-02-02T13:34:31.353 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-02-02 13:28:38.918714626 +0000 2022-02-02T13:34:31.354 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-02-02 13:28:38.918714626 +0000 2022-02-02T13:34:31.354 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-02-02T13:34:31.359 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-02-02T13:34:31.360 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-02-02T13:34:31.360 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000222115 s, 2.3 MB/s 2022-02-02T13:34:31.362 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-02-02T13:34:31.419 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-02-02T13:34:31.420 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.420 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 155417 Links: 1 2022-02-02T13:34:31.420 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.420 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.421 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2022-02-02 13:34:06.601183346 +0000 2022-02-02T13:34:31.421 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-02-02 13:28:39.288708741 +0000 2022-02-02T13:34:31.421 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-02-02 13:28:39.288708741 +0000 2022-02-02T13:34:31.421 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2022-02-02T13:34:31.428 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:31 smithi033 conmon[31996]: cluster 2022-02-02T13:34:29.499201+0000 mgr.smithi033.xvkvzp (mgr.14164) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:31.428 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:31 smithi033 conmon[31996]: audit 2022-02-02T13:34:30.153477+0000 mon.smithi033 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:31.428 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:31 smithi033 conmon[31996]: audit 2022-02-02T13:34:30.293747+0000 mon.smithi033 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.33:0/3092898769' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:31.430 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2022-02-02T13:34:31.430 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2022-02-02T13:34:31.431 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000167808 s, 3.1 MB/s 2022-02-02T13:34:31.434 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:34:31.434 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2022-02-02T13:34:31.455 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-02-02T13:34:31.456 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-02-02T13:34:31.516 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-02-02T13:34:31.517 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.517 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 157025 Links: 1 2022-02-02T13:34:31.517 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.518 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.518 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2022-02-02 13:34:25.745074675 +0000 2022-02-02T13:34:31.518 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2022-02-02 13:28:38.011048807 +0000 2022-02-02T13:34:31.519 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2022-02-02 13:28:38.011048807 +0000 2022-02-02T13:34:31.519 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2022-02-02T13:34:31.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:31 smithi037 conmon[35544]: cluster 2022-02-02T13:34:29.499201+0000 2022-02-02T13:34:31.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:31 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:31.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:31 smithi037 conmon[35544]: audit 2022-02-02T13:34:30.153477+0000 mon.smithi033 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:31.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:31 smithi037 conmon[35544]: audit 2022-02-02T13:34:30.293747+0000 mon.smithi033 (mon.0) 193 : audit [DBG] from='client.? 172.21.15.33:0/3092898769' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:31.531 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2022-02-02T13:34:31.531 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2022-02-02T13:34:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000241727 s, 2.1 MB/s 2022-02-02T13:34:31.533 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-02-02T13:34:31.591 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-02-02T13:34:31.591 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.592 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 153006 Links: 1 2022-02-02T13:34:31.592 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.593 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.593 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2022-02-02 13:34:25.745074675 +0000 2022-02-02T13:34:31.593 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2022-02-02 13:28:38.362043900 +0000 2022-02-02T13:34:31.594 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2022-02-02 13:28:38.362043900 +0000 2022-02-02T13:34:31.595 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2022-02-02T13:34:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2022-02-02T13:34:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2022-02-02T13:34:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00025431 s, 2.0 MB/s 2022-02-02T13:34:31.607 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-02-02T13:34:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-02-02T13:34:31.665 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.665 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 156058 Links: 1 2022-02-02T13:34:31.666 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.666 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.666 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2022-02-02 13:34:25.745074675 +0000 2022-02-02T13:34:31.667 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2022-02-02 13:28:38.716038951 +0000 2022-02-02T13:34:31.667 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2022-02-02 13:28:38.716038951 +0000 2022-02-02T13:34:31.667 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2022-02-02T13:34:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2022-02-02T13:34:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2022-02-02T13:34:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000204235 s, 2.5 MB/s 2022-02-02T13:34:31.679 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-02-02T13:34:31.736 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-02-02T13:34:31.736 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-02-02T13:34:31.737 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 155337 Links: 1 2022-02-02T13:34:31.737 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:34:31.737 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2022-02-02T13:34:31.737 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2022-02-02 13:34:25.745074675 +0000 2022-02-02T13:34:31.737 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2022-02-02 13:28:39.072033975 +0000 2022-02-02T13:34:31.738 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2022-02-02 13:28:39.072033975 +0000 2022-02-02T13:34:31.738 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2022-02-02T13:34:31.747 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2022-02-02T13:34:31.747 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2022-02-02T13:34:31.748 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.00017873 s, 2.9 MB/s 2022-02-02T13:34:31.752 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2022-02-02T13:34:31.753 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-02-02T13:34:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:33 smithi033 conmon[31996]: cluster 2022-02-02T13:34:31.499433+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:34:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:33 smithi033 conmon[31996]: ) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:33 smithi037 conmon[35544]: cluster 2022-02-02T13:34:31.499433+0000 mgr.smithi033.xvkvzp (mgr.14164) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:34.097 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-02-02T13:34:34.097 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-02-02T13:34:34.098 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2022-02-02T13:34:34.098 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2022-02-02T13:34:34.098 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0150466 s, 697 MB/s 2022-02-02T13:34:34.099 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2022-02-02T13:34:34.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2022-02-02T13:34:35.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: cluster 2022-02-02T13:34:33.499671+0000 mgr.smithi033.xvkvzp (mgr.14164) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:35.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: audit 2022-02-02T13:34:34.338816+0000 mon.smithi033 (mon.0) 194 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:35.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: audit 2022-02-02T13:34:34.341737+0000 mon.smithi033 (mon.0) 195 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:35.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:34.343722+0000 mgr.smithi033.xvkvzp (mgr.14164) 46 : cephadm [INF] Reconfiguring mon.smithi033 (unknown last config time)... 2022-02-02T13:34:35.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: audit 2022-02-02T13:34:34.343926+0000 mon.smithi033 (mon.0) 196 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:34:35.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: audit 2022-02-02T13:34:34.344530+0000 mon.smithi033 (mon.0) 197 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:34:35.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: audit 2022-02-02T13:34:34.345177+0000 mon.smithi033 (mon.0) 198 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:35.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:34.345736 2022-02-02T13:34:35.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:35 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 47 : cephadm [INF] Reconfiguring daemon mon.smithi033 on smithi033 2022-02-02T13:34:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: cluster 2022-02-02T13:34:33.499671+0000 mgr.smithi033.xvkvzp (mgr.14164) 45 2022-02-02T13:34:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: audit 2022-02-02T13:34:34.338816+0000 mon.smithi033 (mon.0) 194 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: audit 2022 2022-02-02T13:34:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: -02-02T13:34:34.341737+0000 mon.smithi033 (mon.0) 195 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:35.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: cephadm 2022-02-02T13:34: 2022-02-02T13:34:35.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: 34.343722+0000 mgr.smithi033.xvkvzp (mgr.14164) 46 : cephadm [INF] Reconfiguring mon.smithi033 (unknown last config time)... 2022-02-02T13:34:35.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: audit 2022-02-02T13:34:34.343926+0000 mon.smithi033 (mon. 2022-02-02T13:34:35.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: 0) 196 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:34:35.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: audit 2022-02-02T13:34:35.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: 2022-02-02T13:34:34.344530+0000 mon.smithi033 (mon.0) 197 : audit [DBG] 2022-02-02T13:34:35.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:34:35.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:34:35.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: 02T13:34:34.345177+0000 mon.smithi033 (mon.0) 198 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:35.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: cephadm 2022-02-02T13 2022-02-02T13:34:35.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: :34:34.345736+0000 mgr.smithi033.xvkvzp (mgr.14164) 47 : cephadm [INF] 2022-02-02T13:34:35.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:35 smithi037 conmon[35544]: Reconfiguring daemon mon.smithi033 on smithi033 2022-02-02T13:34:37.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 -- 172.21.15.33:0/1042956513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f66e0 msgr2=0x7fd5600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:37.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 --2- 172.21.15.33:0/1042956513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f66e0 0x7fd5600f6b00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd550004660 tx=0x7fd550009b30).stop 2022-02-02T13:34:37.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: cluster 2022-02-02T13:34:35.499953+0000 2022-02-02T13:34:37.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 48 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:37.584 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: audit 2022-02-02T13:34:36.958052+0000 mon.smithi033 (mon.0) 199 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:37.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: audit 2022-02-02T13:34:36.959024+0000 mon.smithi033 (mon.0) 200 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:34:37.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: audit 2022-02-02T13:34:36.959839+0000 mon.smithi033 (mon.0) 201 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:34:37.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:37 smithi033 conmon[31996]: audit 2022-02-02T13:34:36.960556+0000 mon.smithi033 (mon.0) 202 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 -- 172.21.15.33:0/1042956513 shutdown_connections 2022-02-02T13:34:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 --2- 172.21.15.33:0/1042956513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f7980 0x7fd5600f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:34:37.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 --2- 172.21.15.33:0/1042956513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f66e0 0x7fd5600f6b00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:37.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 -- 172.21.15.33:0/1042956513 >> 172.21.15.33:0/1042956513 conn(0x7fd5600f1e40 msgr2=0x7fd5600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:37.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 -- 172.21.15.33:0/1042956513 shutdown_connections 2022-02-02T13:34:37.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.582+0000 7fd5651bd700 1 -- 172.21.15.33:0/1042956513 wait complete. 2022-02-02T13:34:37.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 Processor -- start 2022-02-02T13:34:37.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 -- start start 2022-02-02T13:34:37.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f66e0 0x7fd56006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:37.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56006a410 con 0x7fd5600f7980 2022-02-02T13:34:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd5651bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56006a550 con 0x7fd5600f66e0 2022-02-02T13:34:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd55e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd55e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55884/0 (socket says 172.21.15.33:55884) 2022-02-02T13:34:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd55e59c700 1 -- 172.21.15.33:0/992779229 learned_addr learned my addr 172.21.15.33:0/992779229 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:34:37.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.583+0000 7fd55ed9d700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f66e0 0x7fd56006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:37.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd55e59c700 1 -- 172.21.15.33:0/992779229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f66e0 msgr2=0x7fd56006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:37.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd55e59c700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f66e0 0x7fd56006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:37.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd55e59c700 1 -- 172.21.15.33:0/992779229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550005040 con 0x7fd5600f7980 2022-02-02T13:34:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd55e59c700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd54800b410 tx=0x7fd548006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5480125f0 con 0x7fd5600f7980 2022-02-02T13:34:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd54800be30 con 0x7fd5600f7980 2022-02-02T13:34:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56006a830 con 0x7fd5600f7980 2022-02-02T13:34:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd548002a00 con 0x7fd5600f7980 2022-02-02T13:34:37.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.584+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56010efe0 con 0x7fd5600f7980 2022-02-02T13:34:37.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.585+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd560045ad0 con 0x7fd5600f7980 2022-02-02T13:34:37.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.585+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd54800f030 con 0x7fd5600f7980 2022-02-02T13:34:37.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.586+0000 7fd5577fe700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 0x7fd54c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:34:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.586+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fd5480752e0 con 0x7fd5600f7980 2022-02-02T13:34:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.586+0000 7fd55ed9d700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 0x7fd54c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:34:37.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.586+0000 7fd55ed9d700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 0x7fd54c05e760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd56006b730 tx=0x7fd550009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:34:37.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.590+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd548048fd0 con 0x7fd5600f7980 2022-02-02T13:34:37.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:37.780+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5600ff090 con 0x7fd54c05c2a0 2022-02-02T13:34:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: cluster 2022-02-02T13:34:35.499953+0000 mgr.smithi033.xvkvzp (mgr.14164) 48 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: audit 2022-02-02T13:34:36.958052+0000 mon.smithi033 (mon.0) 199 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: audit 2022-02-02T13:34:36.959024+0000 mon.smithi033 ( 2022-02-02T13:34:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: mon.0) 200 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:34:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: audit 2022-02-02T13:34:36.959839+0000 mon.smithi033 (mon. 2022-02-02T13:34:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: 0) 201 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:34:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: audit 2022-02-02T13:34 2022-02-02T13:34:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:37 smithi037 conmon[35544]: :36.960556+0000 mon.smithi033 (mon.0) 202 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:38 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:36.958712+0000 mgr.smithi033.xvkvzp (mgr.14164) 49 : cephadm [INF] Reconfiguring mgr.smithi033.xvkvzp (unknown last config time)... 2022-02-02T13:34:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:38 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:36.961402+0000 mgr.smithi033.xvkvzp (mgr.14164) 50 : cephadm [INF] Reconfiguring daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:34:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:38 smithi033 conmon[31996]: audit 2022-02-02T13:34:37.783040+0000 mon.smithi033 (mon.0) 203 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:34:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:38 smithi033 conmon[31996]: audit 2022-02-02T13:34:37.784715+0000 mon.smithi033 (mon.0) 204 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:34:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:38 smithi033 conmon[31996]: audit 2022-02-02T13:34:37.785299+0000 mon.smithi033 (mon.0) 205 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:38.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:36.958712+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:38.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: (mgr.14164) 49 : cephadm [INF] Reconfiguring mgr.smithi033.xvkvzp (unknown last config time)... 2022-02-02T13:34:38.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:36.961402+0000 mgr.smithi033.xvkvzp (mgr.14164) 50 : 2022-02-02T13:34:38.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: cephadm [INF] Reconfiguring daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:34:38.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: audit 2022-02-02T13:34:37.783040+0000 mon.smithi033 (mon.0) 203 : 2022-02-02T13:34:38.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:34:38.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:34:38.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: 34:37.784715+0000 mon.smithi033 (mon.0) 204 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:34:38.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: audit 2022-02-02T13:34:38.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:38 smithi037 conmon[35544]: 2022-02-02T13:34:37.785299+0000 mon.smithi033 (mon.0) 205 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: cluster 2022-02-02T13:34:37.500187+0000 mgr.smithi033.xvkvzp (mgr.14164) 51 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: audit 2022-02-02T13:34:37.782113+0000 mgr.smithi033.xvkvzp (mgr.14164) 52 : audit [DBG] from='client.14222 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:34:39.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:37.784468+0000 mgr.smithi033.xvkvzp (mgr.14164) 53 : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:34:39.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: audit 2022-02-02T13:34:38.474491+0000 mon.smithi033 (mon.0) 206 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:39.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:38.475101+0000 mgr.smithi033.xvkvzp (mgr.14164) 54 : cephadm [INF] Reconfiguring alertmanager.smithi033 (dependencies changed)... 2022-02-02T13:34:39.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:39 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:38.477730+0000 mgr.smithi033.xvkvzp (mgr.14164) 55 : cephadm [INF] Reconfiguring daemon alertmanager.smithi033 on smithi033 2022-02-02T13:34:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: cluster 2022-02-02T13:34:37.500187+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: (mgr.14164) 51 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: audit 2022-02-02T13:34:37.782113+0000 mgr.smithi033.xvkvzp (mgr.14164) 52 : audit 2022-02-02T13:34:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: [DBG] from='client.14222 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:34:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:37.784468+0000 mgr.smithi033.xvkvzp (mgr.14164) 53 2022-02-02T13:34:39.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:34:39.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: audit 2022-02-02T13:34:38. 2022-02-02T13:34:39.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: 474491+0000 mon.smithi033 (mon.0) 206 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:39.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:38.475101+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:39.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: mgr.14164) 54 : cephadm [INF] Reconfiguring alertmanager.smithi033 (dependencies changed)... 2022-02-02T13:34:39.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:38.477730+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:39.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:39 smithi037 conmon[35544]: mgr.14164) 55 : cephadm [INF] Reconfiguring daemon alertmanager.smithi033 on smithi033 2022-02-02T13:34:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:41 smithi033 conmon[31996]: cluster 2022-02-02T13:34:39.500390+0000 mgr.smithi033.xvkvzp (mgr.14164) 56 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:41 smithi037 conmon[35544]: cluster 2022-02-02T13:34:39.500390+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:41 smithi037 conmon[35544]: mgr.14164) 56 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: cluster 2022-02-02T13:34:41.500695+0000 mgr.smithi033.xvkvzp (mgr.14164) 57 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:42.198429+0000 mon.smithi033 (mon.0) 207 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:42.199048+0000 mgr.smithi033.xvkvzp (mgr.14164) 58 : cephadm [INF] Reconfiguring crash.smithi033 (monmap changed)... 2022-02-02T13:34:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:42.199307+0000 mon.smithi033 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:34:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:42.200030+0000 mon.smithi033 (mon.0) 209 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: cephadm 2022-02-02T 2022-02-02T13:34:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: 13:34:42.200544+0000 mgr.smithi033.xvkvzp (mgr.14164) 59 : cephadm [INF] Reconfiguring daemon crash.smithi033 on smithi033 2022-02-02T13:34:43.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:43.168552+0000 mon.smithi033 (mon.0) 210 : audit [INF] from='client.? 172.21.15.33:0/1043512552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eaa79e13-f217-4edf-af55-0441c3f0542e"}]: dispatch 2022-02-02T13:34:43.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:43.172444+0000 mon.smithi033 (mon.0) 211 : audit [INF] from='client.? 172.21.15.33:0/1043512552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eaa79e13-f217-4edf-af55-0441c3f0542e"}]': finished 2022-02-02T13:34:43.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: cluster 2022-02-02T13:34:43.172495+0000 mon.smithi033 (mon.0) 212 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-02-02T13:34:43.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:43 smithi033 conmon[31996]: audit 2022-02-02T13:34:43.172633+0000 mon.smithi033 (mon.0) 213 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:34:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: cluster 2022-02-02T13:34:41.500695+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:34:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: 57 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34:42.198429+0000 mon.smithi033 (mon.0) 207 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:42.199048+0000 mgr.smithi033.xvkvzp (mgr.14164) 58 : cephadm [INF] Reconfiguring crash.smithi033 (monmap changed)... 2022-02-02T13:34:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34:43.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: 2022-02-02T13:34:42.199307+0000 mon.smithi033 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:34:43.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34: 2022-02-02T13:34:43.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: 42.200030+0000 mon.smithi033 (mon.0) 209 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:43.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:42 2022-02-02T13:34:43.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: .200544+0000 mgr.smithi033.xvkvzp (mgr.14164) 59 : cephadm [INF] Reconfiguring daemon crash.smithi033 on smithi033 2022-02-02T13:34:43.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34:43.168552+0000 mon.smithi033 ( 2022-02-02T13:34:43.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: mon.0) 210 : audit [INF] from='client.? 172.21.15.33:0/1043512552' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eaa79e13-f217-4edf-af55-0441c3f0542e"}]: dispatch 2022-02-02T13:34:43.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34:43.172444+0000 mon.smithi033 (mon 2022-02-02T13:34:43.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: .0) 211 : audit [INF] from='client.? 172.21.15.33:0/1043512552' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eaa79e13-f217-4edf-af55-0441c3f0542e"}]': finished 2022-02-02T13:34:43.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: cluster 2022-02-02T13:34:43.172495+0000 mon.smithi033 2022-02-02T13:34:43.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: (mon.0) 212 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-02-02T13:34:43.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: audit 2022-02-02T13:34: 2022-02-02T13:34:43.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:43 smithi037 conmon[35544]: 43.172633+0000 mon.smithi033 (mon.0) 213 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:34:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:44 smithi033 conmon[31996]: audit 2022-02-02T13:34:43.592126+0000 mon.smithi033 (mon 2022-02-02T13:34:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:44 smithi033 conmon[31996]: .0) 214 : audit [DBG] from='client.? 172.21.15.33:0/554278774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:34:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:44 smithi037 conmon[35544]: audit 2022-02-02T13:34:43.592126+0000 mon.smithi033 2022-02-02T13:34:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:44 smithi037 conmon[35544]: (mon.0) 214 : audit [DBG] from='client.? 172.21.15.33:0/554278774' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:34:45.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:45 smithi033 conmon[31996]: cluster 2022-02-02T13:34:43.500981+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:45.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:45 smithi033 conmon[31996]: 14164) 60 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:45 smithi037 conmon[35544]: cluster 2022-02-02T13:34:43.500981+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:34:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:45 smithi037 conmon[35544]: .14164) 60 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:47 smithi033 conmon[31996]: cluster 2022-02-02T13:34:45.501276+0000 mgr.smithi033.xvkvzp (mgr.14164) 61 2022-02-02T13:34:47.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:47 smithi033 conmon[31996]: : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:47.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:47 smithi037 conmon[35544]: cluster 2022-02-02T13:34:45.501276+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:47.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:47 smithi037 conmon[35544]: 14164) 61 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:49.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:49 smithi033 conmon[31996]: cluster 2022-02-02T13:34:47.501593+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:49.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:49 smithi033 conmon[31996]: (mgr.14164) 62 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:49.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:49 smithi033 conmon[31996]: audit 2022-02-02T13:34:48.398088+0000 mon.smithi033 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:49.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:49 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:48.398623+0000 mgr.smithi033.xvkvzp (mgr.14164) 63 : cephadm [INF] Reconfiguring grafana.smithi033 (dependencies changed)... 2022-02-02T13:34:49.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:49 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:48.402901+0000 mgr.smithi033.xvkvzp (mgr.14164) 64 : cephadm [INF] Reconfiguring daemon grafana.smithi033 on smithi033 2022-02-02T13:34:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: cluster 2022-02-02T13:34:47.501593+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: 14164) 62 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:49.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: audit 2022-02-02T13:34:48.398088+0000 mon.smithi033 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:49.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:48.398623+0000 mgr.smithi033.xvkvzp (mgr.14164) 63 : cephadm [INF] Reconfiguring grafana.smithi033 (dependencies changed)... 2022-02-02T13:34:49.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:48.402901+0000 mgr.smithi033.xvkvzp (mgr.14164) 64 : cephadm [INF] 2022-02-02T13:34:49.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:49 smithi037 conmon[35544]: Reconfiguring daemon grafana.smithi033 on smithi033 2022-02-02T13:34:51.659 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:51 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:34:51.659 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:51 smithi033 conmon[31996]: 34:49.502094+0000 mgr.smithi033.xvkvzp (mgr.14164) 65 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:51 smithi037 conmon[35544]: cluster 2022-02-02T13:34:49.502094+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:34:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:51 smithi037 conmon[35544]: mgr.14164) 65 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:52.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:52 smithi033 conmon[31996]: audit 2022-02-02T13:34:51.471272+0000 mon.smithi033 ( 2022-02-02T13:34:52.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:52 smithi033 conmon[31996]: mon.0) 216 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:52.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:52 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:51.471978+0000 mgr.smithi033.xvkvzp (mgr.14164) 66 : cephadm [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2022-02-02T13:34:52.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:52 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:51.474403+0000 mgr.smithi033.xvkvzp (mgr.14164) 67 : cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2022-02-02T13:34:52.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: audit 2022-02-02T13:34:51.471272+0000 mon.smithi033 (mon. 2022-02-02T13:34:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: 0) 216 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:51.471978+0000 mgr.smithi033.xvkvzp (mgr.14164) 66 : cephadm 2022-02-02T13:34:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: [INF] Reconfiguring prometheus.smithi033 (dependencies changed)... 2022-02-02T13:34:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:51.474403+0000 mgr.smithi033.xvkvzp (mgr.14164) 67 : 2022-02-02T13:34:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:52 smithi037 conmon[35544]: cephadm [INF] Reconfiguring daemon prometheus.smithi033 on smithi033 2022-02-02T13:34:53.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:53 smithi033 conmon[31996]: cluster 2022-02-02T13:34:51.502375+0000 mgr.smithi033.xvkvzp (mgr.14164) 68 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:53.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:53 smithi033 conmon[31996]: audit 2022-02-02T13:34:52.673699+0000 mon.smithi033 (mon.0) 217 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-02-02T13:34:53.481 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:53 smithi033 conmon[31996]: audit 2022-02-02T13:34:52.674425+0000 mon.smithi033 (mon.0) 218 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:53.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: cluster 2022-02-02T13:34:51.502375+0000 2022-02-02T13:34:53.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 68 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:53.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: audit 2022-02-02T13:34:52.673699+0000 mon.smithi033 (mon.0 2022-02-02T13:34:53.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: ) 217 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-02-02T13:34:53.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: audit 2022-02-02T13:34:52.674425+0000 mon.smithi033 (mon.0 2022-02-02T13:34:53.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:53 smithi037 conmon[35544]: ) 218 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:54.610 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:54 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:52.675008 2022-02-02T13:34:54.610 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:54 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 69 : cephadm [INF] Deploying daemon osd.0 on smithi033 2022-02-02T13:34:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:54 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:52.675008+0000 2022-02-02T13:34:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:54 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 69 : cephadm [INF] Deploying daemon osd.0 on smithi033 2022-02-02T13:34:55.585 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:55 smithi033 conmon[31996]: cluster 2022-02-02T13 2022-02-02T13:34:55.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:55 smithi033 conmon[31996]: :34:53.502748+0000 mgr.smithi033.xvkvzp (mgr.14164) 70 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:55 smithi037 conmon[35544]: cluster 2022-02-02T13:34:53.502748+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:55 smithi037 conmon[35544]: (mgr.14164) 70 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:57.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: cluster 2022-02-02T13:34:55.503157+0000 mgr.smithi033.xvkvzp (mgr.14164) 71 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:57.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: audit 2022-02-02T13:34:55.990759+0000 mon.smithi033 (mon.0) 219 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:57.129 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:55.991292+0000 mgr.smithi033.xvkvzp (mgr.14164) 72 : cephadm [INF] Reconfiguring crash.smithi037 (monmap changed)... 2022-02-02T13:34:57.129 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: audit 2022-02-02T13:34:55.991546+0000 mon.smithi033 (mon.0) 220 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:34:57.130 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: audit 2022-02-02T13:34:55.992228+0000 mon.smithi033 (mon.0) 221 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:57.130 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:56 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:55.992730+0000 mgr.smithi033.xvkvzp (mgr.14164) 73 : cephadm [INF] Reconfiguring daemon crash.smithi037 on smithi037 2022-02-02T13:34:57.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: cluster 2022-02-02T13:34:55.503157+0000 mgr.smithi033.xvkvzp (mgr.14164) 71 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:57.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: audit 2022-02-02T13:34:55.990759+0000 mon.smithi033 (mon.0) 219 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:57.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:55.991292+0000 mgr.smithi033.xvkvzp (mgr.14164) 72 : cephadm [INF] Reconfiguring crash.smithi037 (monmap changed)... 2022-02-02T13:34:57.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: audit 2022-02-02T13:34:55.991546+0000 mon.smithi033 (mon.0) 220 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:34:57.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: audit 2022-02-02T13:34:55.992228+0000 mon.smithi033 (mon.0) 221 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:57.262 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:56 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:55.992730+0000 mgr.smithi033.xvkvzp (mgr.14164) 73 : cephadm [INF] Reconfiguring daemon crash.smithi037 on smithi037 2022-02-02T13:34:58.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: audit 2022-02-02T13:34:57.294213+0000 mon.smithi033 (mon 2022-02-02T13:34:58.394 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: .0) 222 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:58.395 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:57.294770+0000 mgr.smithi033.xvkvzp (mgr.14164) 74 : cephadm [INF] 2022-02-02T13:34:58.395 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: Reconfiguring mgr.smithi037.npteou (monmap changed)... 2022-02-02T13:34:58.395 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: audit 2022-02-02T13:34 2022-02-02T13:34:58.395 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: :57.295022+0000 mon.smithi033 (mon.0) 223 : audit 2022-02-02T13:34:58.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:34:58.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: audit 2022-02-02T13:34:57 2022-02-02T13:34:58.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: .295691+0000 mon.smithi033 (mon.0) 224 : 2022-02-02T13:34:58.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:34:58.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: audit 2022-02-02T13:34 2022-02-02T13:34:58.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: :57.296301+0000 mon.smithi033 (mon.0) 2022-02-02T13:34:58.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: 225 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:58.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: cephadm 2022-02-02T13 2022-02-02T13:34:58.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: :34:57.296791+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:34:58.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:58 smithi033 conmon[31996]: 14164) 75 : cephadm [INF] Reconfiguring daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:34:58.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:34:58.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: T13:34:57.294213+0000 mon.smithi033 (mon.0) 222 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:58.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:57.294770+0000 mgr.smithi033.xvkvzp (mgr.14164) 74 : cephadm [INF] Reconfiguring mgr.smithi037.npteou (monmap changed)... 2022-02-02T13:34:58.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: audit 2022-02-02T13:34:57.295022+0000 mon.smithi033 (mon.0) 223 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:34:58.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: audit 2022-02-02T13:34:57.295691+0000 mon.smithi033 (mon.0) 224 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:34:58.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: audit 2022-02-02T13:34:57.296301+0000 mon.smithi033 (mon.0) 225 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:58.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:58 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:57.296791+0000 mgr.smithi033.xvkvzp (mgr.14164) 75 : cephadm [INF] Reconfiguring daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:34:59.157 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2022-02-02T13:34:59.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.155+0000 7fd5577fe700 1 -- 172.21.15.33:0/992779229 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd5600ff090 con 0x7fd54c05c2a0 2022-02-02T13:34:59.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 msgr2=0x7fd54c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:59.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 0x7fd54c05e760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fd56006b730 tx=0x7fd550009b30).stop 2022-02-02T13:34:59.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 msgr2=0x7fd560069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:34:59.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd54800b410 tx=0x7fd548006ef0).stop 2022-02-02T13:34:59.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 shutdown_connections 2022-02-02T13:34:59.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd54c05c2a0 0x7fd54c05e760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:59.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5600f66e0 0x7fd56006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:59.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 --2- 172.21.15.33:0/992779229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5600f7980 0x7fd560069e20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:34:59.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 >> 172.21.15.33:0/992779229 conn(0x7fd5600f1e40 msgr2=0x7fd5600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:34:59.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 shutdown_connections 2022-02-02T13:34:59.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:34:59.158+0000 7fd5651bd700 1 -- 172.21.15.33:0/992779229 wait complete. 2022-02-02T13:34:59.568 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service 2022-02-02T13:34:59.572 INFO:tasks.cephadm:Deploying osd.1 on smithi033 with /dev/vg_nvme/lv_3... 2022-02-02T13:34:59.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-02-02T13:34:59.602 INFO:journalctl@ceph.osd.0.smithi033.stdout:-- Logs begin at Wed 2022-02-02 13:23:23 UTC. -- 2022-02-02T13:34:59.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: cluster 2022-02-02T13:34:57.503450+0000 mgr.smithi033.xvkvzp (mgr.14164) 76 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:58.374932+0000 mon.smithi033 (mon.0) 226 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:58.375362+0000 mgr.smithi033.xvkvzp (mgr.14164) 77 : cephadm [INF] Reconfiguring mon.smithi037 (monmap changed)... 2022-02-02T13:34:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:58.375578+0000 mon.smithi033 (mon.0) 227 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:34:59.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:58.376180+0000 mon.smithi033 (mon.0) 228 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:34:59.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: 2022-02-02T13:34:58.376771+0000 mon.smithi033 (mon.0) 229 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:59.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: cephadm 2022-02-02T13:34:58.377302+0000 mgr.smithi033.xvkvzp (mgr.14164) 78 : cephadm [INF] Reconfiguring daemon mon.smithi037 on smithi037 2022-02-02T13:34:59.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.149994+0000 mon.smithi033 (mon.0) 230 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:34:59 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.155419+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: cluster 2022-02-02T13:34:57.503450+0000 2022-02-02T13:34:59.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 76 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:34:59.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022-02-02T13:34:58.374932+0000 mon.smithi033 (mon.0) 226 : audit 2022-02-02T13:34:59.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: cephadm 2022-02-02T13:34:58.375362+0000 mgr.smithi033.xvkvzp 2022-02-02T13:34:59.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: (mgr.14164) 77 : cephadm [INF] Reconfiguring mon.smithi037 (monmap changed)... 2022-02-02T13:34:59.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: 2022-02-02T13:34:58.375578+0000 mon.smithi033 (mon.0) 227 2022-02-02T13:34:59.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:34:59.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: 2022-02-02T13:34:58.376180+0000 mon.smithi033 (mon.0) 228 : audit 2022-02-02T13:34:59.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:34:59.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:34:59.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: 02-02T13:34:58.376771+0000 mon.smithi033 (mon.0) 229 : audit [DBG] 2022-02-02T13:34:59.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:34:59.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: cephadm 2022-02-02T 2022-02-02T13:34:59.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: 13:34:58.377302+0000 mgr.smithi033.xvkvzp (mgr.14164) 78 : cephadm [INF] Reconfiguring daemon mon.smithi037 on smithi037 2022-02-02T13:34:59.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022-02-02T13:34 2022-02-02T13:34:59.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: :59.149994+0000 mon.smithi033 (mon.0) 230 : audit [INF] 2022-02-02T13:34:59.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:34:59.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: T13:34:59.155419+0000 mon.smithi033 (mon.0) 231 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:34:59.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:34:59 smithi037 conmon[35544]: 2022-02-02T13:35:00.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: cluster 2022-02-02T13:34:59.503660+0000 mgr.smithi033.xvkvzp (mgr.14164) 79 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:00.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.658222+0000 mon.smithi033 (mon.0) 232 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:00.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.660927+0000 mon.smithi033 (mon.0) 233 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T13:35:00.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.661267+0000 mgr.smithi033.xvkvzp (mgr.14164) 80 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T13:35:00.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.662193+0000 mon.smithi033 (mon.0) 234 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2022-02-02T13:35:00.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.662477+0000 mgr.smithi033.xvkvzp (mgr.14164) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2022-02-02T13:35:00.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.666102+0000 mon.smithi033 (mon.0) 235 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:00.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.670328+0000 mon.smithi033 (mon.0) 236 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T13:35:00.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.670705+0000 mgr.smithi033.xvkvzp (mgr.14164) 82 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T13:35:00.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.676107+0000 mon.smithi033 (mon.0) 237 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2022-02-02T13:35:00.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.676471+0000 mgr.smithi033.xvkvzp (mgr.14164) 83 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2022-02-02T13:35:00.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.680519+0000 mon.smithi033 (mon.0) 238 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:00.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.684542+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T13:35:00.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.684936+0000 mgr.smithi033.xvkvzp (mgr.14164) 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T13:35:00.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.690159+0000 mon.smithi033 (mon.0) 240 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2022-02-02T13:35:00.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.690532+0000 mgr.smithi033.xvkvzp (mgr.14164) 85 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2022-02-02T13:35:00.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.694060+0000 mon.smithi033 (mon.0) 241 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:00.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:00 smithi033 conmon[31996]: audit 2022-02-02T13:34:59.696549+0000 mon.smithi033 (mon.0) 242 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:01.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: cluster 2022-02-02T13:34:59.503660+0000 mgr.smithi033.xvkvzp (mgr.14164) 79 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:01.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.658222+0000 mon.smithi033 (mon.0) 232 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:01.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.660927+0000 mon.smithi033 (mon.0) 233 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T13:35:01.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.661267+0000 mgr.smithi033.xvkvzp (mgr.14164) 80 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-02-02T13:35:01.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.662193+0000 mon.smithi033 (mon.0) 234 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2022-02-02T13:35:01.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.662477+0000 mgr.smithi033.xvkvzp (mgr.14164) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2022-02-02T13:35:01.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.666102+0000 mon.smithi033 (mon.0) 235 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:01.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.670328+0000 mon.smithi033 (mon.0) 236 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T13:35:01.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.670705+0000 mgr.smithi033.xvkvzp (mgr.14164) 82 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-02-02T13:35:01.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.676107+0000 mon.smithi033 (mon.0) 237 : audit 2022-02-02T13:35:01.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2022-02-02T13:35:01.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.676471+0000 mgr.smithi033.xvkvzp (mgr.14164) 83 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.33:3000"}]: dispatch 2022-02-02T13:35:01.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34:59.680519+0000 mon.smithi033 (mon 2022-02-02T13:35:01.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: .0) 238 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:01.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34 2022-02-02T13:35:01.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: :59.684542+0000 mon.smithi033 (mon.0) 239 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T13:35:01.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:35:01.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 2022-02-02T13:34:59.684936+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:01.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 84 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-02-02T13:35:01.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:34: 2022-02-02T13:35:01.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 59.690159+0000 mon.smithi033 (mon.0) 240 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2022-02-02T13:35:01.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 2022-02-02T13:35:01.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:01.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: -02-02T13:34:59.690532+0000 mgr.smithi033.xvkvzp (mgr.14164) 85 : audit 2022-02-02T13:35:01.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.33:9095"}]: dispatch 2022-02-02T13:35:01.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:35:01.055 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 2022-02-02T13:34:59.694060+0000 mon.smithi033 (mon.0) 2022-02-02T13:35:01.059 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 241 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:01.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: audit 2022-02-02T13:35:01.060 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: 2022-02-02T13:34:59.696549+0000 mon.smithi033 (mon 2022-02-02T13:35:01.061 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:00 smithi037 conmon[35544]: .0) 242 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:01.871 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-02-02T13:35:01.872 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-02-02T13:35:01.872 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2022-02-02T13:35:01.872 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2022-02-02T13:35:01.872 INFO:teuthology.orchestra.run.smithi033.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116001 s, 904 MB/s 2022-02-02T13:35:01.872 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2022-02-02T13:35:02.426 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2022-02-02T13:35:03.191 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:35:03 smithi033 conmon[50728]: debug 2022-02-02T13:35:03.067+0000 7f79795a9080 -1 osd.0 0 log_to_monitors {default=true} 2022-02-02T13:35:03.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:02 smithi033 conmon[31996]: cluster 2022-02-02T13:35:01.503954+0000 mgr.smithi033.xvkvzp (mgr.14164) 86 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:03.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:02 smithi033 conmon[31996]: audit 2022-02-02T13:35:01.852741+0000 mon.smithi033 (mon.0) 243 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:02 smithi037 conmon[35544]: cluster 2022-02-02T13:35:01.503954+0000 mgr.smithi033.xvkvzp (mgr.14164) 86 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:02 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:35:03.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:02 smithi037 conmon[35544]: 02-02T13:35:01.852741+0000 mon.smithi033 (mon.0) 243 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:03.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:03 smithi033 conmon[31996]: audit 2022-02-02T13:35:03.071377+0000 mon.smithi033 (mon 2022-02-02T13:35:03.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:03 smithi033 conmon[31996]: .0) 244 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T13:35:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:03 smithi037 conmon[35544]: audit 2022-02-02T13:35:03. 2022-02-02T13:35:04.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:03 smithi037 conmon[35544]: 071377+0000 mon.smithi033 (mon.0) 244 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-02-02T13:35:04.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 -- 172.21.15.33:0/1632887247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 msgr2=0x7fc4300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:04.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 --2- 172.21.15.33:0/1632887247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f59e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fc420004660 tx=0x7fc420009b30).stop 2022-02-02T13:35:04.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 -- 172.21.15.33:0/1632887247 shutdown_connections 2022-02-02T13:35:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 --2- 172.21.15.33:0/1632887247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 0x7fc4300f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 --2- 172.21.15.33:0/1632887247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f59e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 -- 172.21.15.33:0/1632887247 >> 172.21.15.33:0/1632887247 conn(0x7fc4300f0de0 msgr2=0x7fc4300f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:04.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.442+0000 7fc435926700 1 -- 172.21.15.33:0/1632887247 shutdown_connections 2022-02-02T13:35:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 -- 172.21.15.33:0/1632887247 wait complete. 2022-02-02T13:35:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 Processor -- start 2022-02-02T13:35:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 -- start start 2022-02-02T13:35:04.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:04.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 0x7fc4300f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:04.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43010abc0 con 0x7fc4300f55c0 2022-02-02T13:35:04.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.443+0000 7fc435926700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43010ad00 con 0x7fc4300f5ed0 2022-02-02T13:35:04.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:04.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55930/0 (socket says 172.21.15.33:55930) 2022-02-02T13:35:04.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 -- 172.21.15.33:0/1860547967 learned_addr learned my addr 172.21.15.33:0/1860547967 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:35:04.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42e7fc700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 0x7fc4300f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:04.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 -- 172.21.15.33:0/1860547967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 msgr2=0x7fc4300f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 0x7fc4300f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 -- 172.21.15.33:0/1860547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc420005040 con 0x7fc4300f55c0 2022-02-02T13:35:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc42effd700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc420009990 tx=0x7fc420009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc420018070 con 0x7fc4300f55c0 2022-02-02T13:35:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc420013410 con 0x7fc4300f55c0 2022-02-02T13:35:04.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4300f8190 con 0x7fc4300f55c0 2022-02-02T13:35:04.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc42001c3c0 con 0x7fc4300f55c0 2022-02-02T13:35:04.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.444+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300f86f0 con 0x7fc4300f55c0 2022-02-02T13:35:04.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.445+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc430045ad0 con 0x7fc4300f55c0 2022-02-02T13:35:04.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.447+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc42001d420 con 0x7fc4300f55c0 2022-02-02T13:35:04.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.447+0000 7fc4177fe700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 0x7fc41805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:04.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.447+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1443+0+0 (secure 0 0 0) 0x7fc420076fd0 con 0x7fc4300f55c0 2022-02-02T13:35:04.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.447+0000 7fc42e7fc700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 0x7fc41805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:04.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.447+0000 7fc42e7fc700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 0x7fc41805e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc4240041d0 tx=0x7fc424009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:04.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.450+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc42004ace0 con 0x7fc4300f55c0 2022-02-02T13:35:04.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:04.641+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4300fad40 con 0x7fc41805c2b0 2022-02-02T13:35:04.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[50728]: debug 2022-02-02T13:35:04.862+0000 7f796fb1a700 -1 osd.0 0 waiting for initial osdmap 2022-02-02T13:35:04.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[50728]: debug 2022-02-02T13:35:04.866+0000 7f7968a8f700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:35:04.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: cluster 2022-02-02T13:35:03.504344+0000 mgr.smithi033.xvkvzp (mgr.14164) 87 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:04.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:03.858207+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T13:35:04.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: cluster 2022-02-02T13:35:03.858261+0000 mon.smithi033 (mon.0) 246 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-02-02T13:35:04.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:03.858366+0000 mon.smithi033 (mon.0) 247 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:04.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:03.858763+0000 mon.smithi033 (mon.0) 248 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:04.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.644162+0000 mon.smithi033 (mon.0) 249 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:04.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.645747+0000 mon.smithi033 (mon.0) 250 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:04.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:04 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.646399+0000 mon.smithi033 (mon.0) 251 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: cluster 2022-02-02T13:35:03.504344+0000 mgr.smithi033.xvkvzp (mgr.14164) 87 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02-02T13:35:03.858207+0000 mon.smithi033 (mon.0) 245 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-02-02T13:35:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:35:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: 02T13:35:03.858261+0000 mon.smithi033 (mon.0) 246 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-02-02T13:35:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:35:05.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: 02T13:35:03.858366+0000 mon.smithi033 (mon.0) 247 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:05.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02-02T13:35:03.858763+0000 2022-02-02T13:35:05.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: mon.smithi033 (mon.0) 248 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:05.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.644162+0000 mon.smithi033 ( 2022-02-02T13:35:05.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: mon.0) 249 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:05.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.645747+0000 mon.smithi033 (mon.0 2022-02-02T13:35:05.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: ) 250 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:05.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.646399+0000 mon.smithi033 (mon. 2022-02-02T13:35:05.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:04 smithi037 conmon[35544]: 0) 251 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:06.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.643346+0000 mgr.smithi033.xvkvzp (mgr.14164) 88 : audit [DBG] from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:06.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:04.645454+0000 mgr.smithi033.xvkvzp (mgr.14164) 89 : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:35:06.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.859779+0000 mon.smithi033 (mon.0) 252 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:06.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: cluster 2022-02-02T13:35:04.859847+0000 mon.smithi033 (mon.0) 253 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-02-02T13:35:06.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:06.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: 02T13:35:04.860442+0000 mon.smithi033 (mon.0) 254 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:06.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:05 smithi033 conmon[31996]: audit 2022-02-02T13:35:04.864521+0000 mon.smithi033 (mon.0) 255 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:06.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.643346+0000 mgr.smithi033.xvkvzp (mgr.14164) 88 : audit [DBG] from='client.14240 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:06.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:04.645454+0000 mgr.smithi033.xvkvzp (mgr.14164) 89 : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:35:06.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.859779+0000 mon.smithi033 (mon.0) 252 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:06.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: cluster 2022-02-02T13:35:04.859847+0000 mon.smithi033 (mon.0) 253 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-02-02T13:35:06.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.860442+0000 mon.smithi033 (mon.0) 254 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:06.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:05 smithi037 conmon[35544]: audit 2022-02-02T13:35:04.864521+0000 mon.smithi033 (mon.0) 255 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: cluster 2022-02-02T13:35:04.086374+0000 osd.0 ( 2022-02-02T13:35:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: cluster 2022-02-02T13:35:04.086487+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: cluster 2022-02-02T13:35:05.504579+0000 mgr.smithi033.xvkvzp (mgr.14164) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: cluster 2022-02-02T13:35:05.864996+0000 mon.smithi033 (mon.0) 256 : cluster [INF] osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] boot 2022-02-02T13:35:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: cluster 2022-02-02T13:35:05.865026+0000 mon.smithi033 (mon.0) 257 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-02-02T13:35:07.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: audit 2022-02-02T13:35:05.865330+0000 mon.smithi033 (mon.0) 258 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:07.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:06 smithi033 conmon[31996]: audit 2022-02-02T13:35:06.384266+0000 mon.smithi033 (mon.0) 259 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: cluster 2022-02-02T13:35:04 2022-02-02T13:35:07.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: .086374+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:07.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: cluster 2022-02-02T13:35:04.086487+0000 osd.0 (osd.0 2022-02-02T13:35:07.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: ) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:07.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: cluster 2022-02-02T13:35:05.504579+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:35:07.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: mgr.14164) 90 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-02-02T13:35:07.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:35:07.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: 02T13:35:05.864996+0000 mon.smithi033 (mon.0) 256 : cluster [INF] osd.0 [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] boot 2022-02-02T13:35:07.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: cluster 2022-02-02T13:35:05.865026+0000 mon.smithi033 ( 2022-02-02T13:35:07.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: mon.0) 257 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-02-02T13:35:07.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: audit 2022-02-02T13:35:05.865330+0000 mon.smithi033 ( 2022-02-02T13:35:07.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: mon.0) 258 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:35:07.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: audit 2022-02-02T13:35:06.384266+0000 mon.smithi033 (mon.0 2022-02-02T13:35:07.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:06 smithi037 conmon[35544]: ) 259 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: cluster 2022-02-02T13:35:06.873349+0000 mon.smithi033 (mon.0) 260 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-02-02T13:35:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: audit 2022-02-02T13:35:07.293749+0000 mon.smithi033 (mon.0) 261 : audit [INF] from='client.? 172.21.15.33:0/4040187684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9"}]: dispatch 2022-02-02T13:35:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: audit 2022-02-02T13:35:07.297880+0000 mon.smithi033 (mon.0) 262 : audit [INF] from='client.? 172.21.15.33:0/4040187684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9"}]': finished 2022-02-02T13:35:07.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: cluster 2022-02-02T13:35:07. 2022-02-02T13:35:07.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: 297935+0000 mon.smithi033 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-02-02T13:35:07.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: audit 2022-02-02T13:35:07.298030+0000 mon.smithi033 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:07.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:07 smithi033 conmon[31996]: audit 2022-02-02T13:35:07.725889+0000 mon.smithi033 (mon.0) 265 : audit [DBG] from='client.? 172.21.15.33:0/307582520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: cluster 2022-02-02T13:35:06.873349+0000 2022-02-02T13:35:08.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: mon.smithi033 (mon.0) 260 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-02-02T13:35:08.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: audit 2022-02-02T13:35:07.293749+0000 mon.smithi033 (mon.0) 261 : audit 2022-02-02T13:35:08.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: [INF] from='client.? 172.21.15.33:0/4040187684' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9"}]: dispatch 2022-02-02T13:35:08.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: audit 2022-02-02T13:35:07.297880+0000 mon.smithi033 (mon.0) 262 : audit [INF] from='client.? 172.21.15.33:0/4040187684' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9"}]': finished 2022-02-02T13:35:08.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: cluster 2022-02-02T13:35:07.297935+0000 mon.smithi033 (mon.0) 263 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-02-02T13:35:08.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: audit 2022-02-02T13:35:07.298030+0000 2022-02-02T13:35:08.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: mon.smithi033 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:08.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: audit 2022-02-02T13:35:07.725889+0000 mon.smithi033 2022-02-02T13:35:08.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:07 smithi037 conmon[35544]: (mon.0) 265 : audit [DBG] from='client.? 172.21.15.33:0/307582520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:09.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:09 smithi033 conmon[31996]: cluster 2022-02-02T13:35:07.504858+0000 mgr.smithi033.xvkvzp (mgr.14164) 91 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:09.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:09 smithi037 conmon[35544]: cluster 2022-02-02T13:35:07.504858 2022-02-02T13:35:09.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:09 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 91 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:11.657 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:11 smithi033 conmon[31996]: cluster 2022-02-02T13:35:09.505151+0000 mgr.smithi033.xvkvzp (mgr.14164) 92 : 2022-02-02T13:35:11.658 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:11 smithi033 conmon[31996]: cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:11.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:11 smithi037 conmon[35544]: cluster 2022-02-02T13:35:09. 2022-02-02T13:35:11.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:11 smithi037 conmon[35544]: 505151+0000 mgr.smithi033.xvkvzp (mgr.14164) 92 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:13.347 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:13 smithi033 conmon[31996]: cluster 2022-02-02T13:35:11.505499+0000 mgr.smithi033.xvkvzp (mgr.14164) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:13 smithi037 conmon[35544]: cluster 2022-02-02T13:35:11.505499+0000 mgr.smithi033.xvkvzp (mgr.14164) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:14.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:13.475069+0000 mgr.smithi033.xvkvzp (mgr.14164) 94 : cephadm [INF] Detected new or changed devices on smithi033 2022-02-02T13:35:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: audit 2022-02-02T13:35:13.479806+0000 mon.smithi033 (mon.0) 266 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: audit 2022-02-02T13:35:13.845733+0000 mon.smithi033 (mon.0) 267 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: audit 2022-02-02T13:35:13.848473+0000 mon.smithi033 (mon.0) 268 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:14.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: audit 2022-02-02T13:35:14.341875+0000 mon.smithi033 (mon.0) 269 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-02-02T13:35:14.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:14 smithi033 conmon[31996]: audit 2022-02-02T13:35:14.342673+0000 mon.smithi033 (mon.0) 270 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:14.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:13.475069+0000 mgr.smithi033.xvkvzp 2022-02-02T13:35:14.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: (mgr.14164) 94 : cephadm [INF] Detected new or changed devices on smithi033 2022-02-02T13:35:14.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: audit 2022-02-02T13:35:13.479806+0000 mon.smithi033 (mon.0) 266 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:14.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: audit 2022-02-02T13:35:13.845733+0000 mon.smithi033 (mon.0) 267 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:14.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: audit 2022-02-02T13:35:13.848473+0000 2022-02-02T13:35:14.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: mon.smithi033 (mon.0) 268 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:14.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: audit 2022-02-02T13:35:14.341875+0000 mon.smithi033 (mon 2022-02-02T13:35:14.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: .0) 269 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-02-02T13:35:14.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:35:14.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: 02-02T13:35:14.342673+0000 mon.smithi033 (mon.0) 270 : audit [DBG] 2022-02-02T13:35:14.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:14 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:15.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:15 smithi033 conmon[31996]: cluster 2022-02-02T13:35:13.505803+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:35:15.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:15 smithi033 conmon[31996]: mgr.14164) 95 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:15.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:15 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:14.343292+0000 mgr.smithi033.xvkvzp (mgr.14164) 96 : cephadm [INF] Deploying daemon osd.1 on smithi033 2022-02-02T13:35:15.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:15 smithi037 conmon[35544]: cluster 2022-02-02T13:35:13.505803+0000 mgr.smithi033.xvkvzp (mgr.14164) 95 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:15.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:15 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:14.343292+0000 mgr.smithi033.xvkvzp (mgr.14164) 96 : cephadm [INF] Deploying daemon osd.1 on smithi033 2022-02-02T13:35:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:17 smithi037 conmon[35544]: cluster 2022-02-02T13:35:15.506062+0000 mgr.smithi033.xvkvzp (mgr.14164) 97 : cluster [DBG] 2022-02-02T13:35:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:17 smithi037 conmon[35544]: pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:17.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:17 smithi037 conmon[35544]: audit 2022-02-02T13:35:16.017482+0000 mon.smithi033 (mon.0) 271 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:17.316 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:17 smithi033 conmon[31996]: cluster 2022-02-02T13:35:15.506062+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:17.316 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:17 smithi033 conmon[31996]: 97 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:17.316 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:17 smithi033 conmon[31996]: audit 2022-02-02T13:35:16.017482+0000 mon.smithi033 (mon.0) 271 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:18.143 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 1 on host 'smithi033' 2022-02-02T13:35:18.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.139+0000 7fc4177fe700 1 -- 172.21.15.33:0/1860547967 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc4300fad40 con 0x7fc41805c2b0 2022-02-02T13:35:18.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 msgr2=0x7fc41805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:18.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 0x7fc41805e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc4240041d0 tx=0x7fc424009040).stop 2022-02-02T13:35:18.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 msgr2=0x7fc4300f97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:18.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fc420009990 tx=0x7fc420009b30).stop 2022-02-02T13:35:18.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 shutdown_connections 2022-02-02T13:35:18.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc41805c2b0 0x7fc41805e770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:18.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4300f55c0 0x7fc4300f97c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:18.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 --2- 172.21.15.33:0/1860547967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4300f5ed0 0x7fc4300f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:18.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 >> 172.21.15.33:0/1860547967 conn(0x7fc4300f0de0 msgr2=0x7fc43005ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:18.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 shutdown_connections 2022-02-02T13:35:18.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:18.141+0000 7fc435926700 1 -- 172.21.15.33:0/1860547967 wait complete. 2022-02-02T13:35:18.798 DEBUG:teuthology.orchestra.run.smithi033:osd.1> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.1.service 2022-02-02T13:35:18.801 INFO:tasks.cephadm:Deploying osd.2 on smithi033 with /dev/vg_nvme/lv_2... 2022-02-02T13:35:18.801 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-02-02T13:35:18.831 INFO:journalctl@ceph.osd.1.smithi033.stdout:-- Logs begin at Wed 2022-02-02 13:23:23 UTC. -- 2022-02-02T13:35:19.469 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:19 smithi033 conmon[31996]: cluster 2022-02-02T13:35:17.506305 2022-02-02T13:35:19.470 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:19 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:19.470 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:19 smithi033 conmon[31996]: audit 2022-02-02T13:35:18.135303+0000 mon.smithi033 (mon.0) 272 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:19.470 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:19 smithi033 conmon[31996]: audit 2022-02-02T13:35:18.139473+0000 mon.smithi033 (mon.0) 273 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:19.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: cluster 2022-02-02T13:35:17.506305+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:35:19.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: ) 98 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:19.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: audit 2022-02-02T13:35:18.135303+0000 mon.smithi033 (mon.0) 272 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:19.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:35:19.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: 02-02T13:35:18.139473+0000 mon.smithi033 (mon. 2022-02-02T13:35:19.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:19 smithi037 conmon[35544]: 0) 273 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:20.936 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-02-02T13:35:20.936 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-02-02T13:35:20.937 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2022-02-02T13:35:20.937 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2022-02-02T13:35:20.937 INFO:teuthology.orchestra.run.smithi033.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125511 s, 835 MB/s 2022-02-02T13:35:20.937 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2022-02-02T13:35:20.968 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:20 smithi033 conmon[31996]: cluster 2022-02-02T13:35:19.506550+0000 mgr.smithi033.xvkvzp (mgr.14164) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:20.968 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:20 smithi033 conmon[31996]: audit 2022-02-02T13:35:19.901916+0000 mon.smithi033 (mon.0) 274 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:21.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:20 smithi037 conmon[35544]: cluster 2022-02-02T13:35:19.506550+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:35:21.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:20 smithi037 conmon[35544]: mgr.14164) 99 : cluster [DBG] pgmap v58: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:21.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:20 smithi037 conmon[35544]: audit 2022-02-02T13:35:19.901916+0000 mon.smithi033 (mon.0) 274 : 2022-02-02T13:35:21.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:20 smithi037 conmon[35544]: audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:21.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2022-02-02T13:35:22.277 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 02 13:35:22 smithi033 conmon[56994]: debug 2022-02-02T13:35:22.055+0000 7f05e591e080 -1 osd.1 0 log_to_monitors {default=true} 2022-02-02T13:35:23.189 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:22 smithi033 conmon[31996]: cluster 2022-02-02T13:35:21.507017+0000 2022-02-02T13:35:23.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:22 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 100 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:23.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:22 smithi033 conmon[31996]: audit 2022-02-02T13:35:22.060579+0000 mon.smithi033 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T13:35:23.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:22 smithi037 conmon[35544]: cluster 2022-02-02T13:35:21.507017+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:23.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:22 smithi037 conmon[35544]: 100 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:23.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:22 smithi037 conmon[35544]: audit 2022-02-02T13:35:22.060579+0000 mon.smithi033 (mon.0) 275 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-02-02T13:35:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 -- 172.21.15.33:0/952117728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 msgr2=0x7fef800fde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 --2- 172.21.15.33:0/952117728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 0x7fef800fde50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fef70004660 tx=0x7fef70009b30).stop 2022-02-02T13:35:23.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 -- 172.21.15.33:0/952117728 shutdown_connections 2022-02-02T13:35:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 --2- 172.21.15.33:0/952117728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 0x7fef800fde50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 --2- 172.21.15.33:0/952117728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef800fb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.667+0000 7fef86e12700 1 -- 172.21.15.33:0/952117728 >> 172.21.15.33:0/952117728 conn(0x7fef800f0b90 msgr2=0x7fef800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:23.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 -- 172.21.15.33:0/952117728 shutdown_connections 2022-02-02T13:35:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 -- 172.21.15.33:0/952117728 wait complete. 2022-02-02T13:35:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 Processor -- start 2022-02-02T13:35:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 -- start start 2022-02-02T13:35:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:23.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 0x7fef80109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef801099c0 con 0x7fef800fba60 2022-02-02T13:35:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef86e12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80109b00 con 0x7fef800602b0 2022-02-02T13:35:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.668+0000 7fef85e10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:23.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:38466/0 (socket says 172.21.15.33:38466) 2022-02-02T13:35:23.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 -- 172.21.15.33:0/165334314 learned_addr learned my addr 172.21.15.33:0/165334314 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:35:23.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 -- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 msgr2=0x7fef80109410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:35:23.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 0x7fef80109410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:35:23.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 -- 172.21.15.33:0/165334314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef70005040 con 0x7fef800602b0 2022-02-02T13:35:23.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef85e10700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fef7c00c530 tx=0x7fef7c007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:23.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7c00f650 con 0x7fef800602b0 2022-02-02T13:35:23.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fef7c00fc40 con 0x7fef800602b0 2022-02-02T13:35:23.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.669+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8010a4a0 con 0x7fef800602b0 2022-02-02T13:35:23.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.670+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8010aa60 con 0x7fef800602b0 2022-02-02T13:35:23.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.670+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef7c012c00 con 0x7fef800602b0 2022-02-02T13:35:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.671+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef68004fa0 con 0x7fef800602b0 2022-02-02T13:35:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.671+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fef7c010070 con 0x7fef800602b0 2022-02-02T13:35:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.671+0000 7fef767fc700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 0x7fef6c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:23.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.672+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1985+0+0 (secure 0 0 0) 0x7fef7c074e90 con 0x7fef800602b0 2022-02-02T13:35:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.672+0000 7fef8560f700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 0x7fef6c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.672+0000 7fef8560f700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 0x7fef6c05e7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef70009f50 tx=0x7fef70009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:23.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.676+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fef7c0452b0 con 0x7fef800602b0 2022-02-02T13:35:23.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:23.881+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fef68000bc0 con 0x7fef6c05c2f0 2022-02-02T13:35:24.242 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[56994]: debug 2022-02-02T13:35:23.924+0000 7f05dbe8f700 -1 osd.1 0 waiting for initial osdmap 2022-02-02T13:35:24.242 INFO:journalctl@ceph.osd.1.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[56994]: debug 2022-02-02T13:35:23.930+0000 7f05d860b700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:35:24.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:22.914597 2022-02-02T13:35:24.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T13:35:24.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: cluster 2022-02-02T13:35:22.914661+0000 mon.smithi033 (mon.0) 277 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-02-02T13:35:24.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:22.914774+0000 mon.smithi033 (mon.0) 278 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:24.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:22.915284+0000 mon.smithi033 (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:24.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.844505+0000 mon.smithi033 (mon.0) 280 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:24.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.849714+0000 mon.smithi033 (mon.0) 281 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:24.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.853481+0000 mon.smithi033 (mon.0) 282 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:24.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:24.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: 2022-02-02T13:35:23.884655+0000 mon.smithi033 (mon.0) 283 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:24.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.886194+0000 mon.smithi033 ( 2022-02-02T13:35:24.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: mon.0) 284 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:24.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:35:24.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:23 smithi033 conmon[31996]: :35:23.886931+0000 mon.smithi033 (mon.0) 285 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:24.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022-02-02T13:35:22.914597+0000 mon.smithi033 (mon.0) 276 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-02-02T13:35:24.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: cluster 2022-02-02T13:35:22.914661+0000 mon.smithi033 (mon.0) 277 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-02-02T13:35:24.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022-02-02T13:35:22.914774+0000 mon.smithi033 (mon.0 2022-02-02T13:35:24.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: ) 278 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:24.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:35:24.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02T13:35:22.915284+0000 2022-02-02T13:35:24.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: mon.smithi033 (mon.0) 279 : 2022-02-02T13:35:24.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:24.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:24.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02-02T13:35:23 2022-02-02T13:35:24.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: .844505+0000 mon.smithi033 (mon.0 2022-02-02T13:35:24.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: ) 280 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:24.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 2022-02-02T13:35:24.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:24.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02-02T13:35: 2022-02-02T13:35:24.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 23.849714+0000 mon.smithi033 (mon 2022-02-02T13:35:24.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: .0) 281 : audit [INF] 2022-02-02T13:35:24.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:24.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:24.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02-02T13:35:23 2022-02-02T13:35:24.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: .853481+0000 mon.smithi033 (mon. 2022-02-02T13:35:24.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 0) 282 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:24.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 2022-02-02T13:35:24.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022-02-02T13:35:24.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 2022-02-02T13:35 2022-02-02T13:35:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: :23.884655+0000 mon.smithi033 ( 2022-02-02T13:35:24.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: mon.0) 283 : audit [DBG] 2022-02-02T13:35:24.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:24.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:24.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02-02T13:35:23 2022-02-02T13:35:24.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: .886194+0000 mon.smithi033 (mon. 2022-02-02T13:35:24.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 0) 284 : audit [INF] 2022-02-02T13:35:24.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:24.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:24.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: -02-02T13:35:23 2022-02-02T13:35:24.325 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: .886931+0000 mon.smithi033 (mon. 2022-02-02T13:35:24.325 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: 0) 285 : audit [DBG] 2022-02-02T13:35:24.325 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:23 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:25.070 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: cluster 2022-02-02T13:35:23.507425+0000 mgr.smithi033.xvkvzp (mgr.14164) 101 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:25.070 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.883778+0000 mgr.smithi033.xvkvzp (mgr.14164) 102 : audit [DBG] from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:25.070 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:23.885967+0000 mgr.smithi033.xvkvzp (mgr.14164) 103 : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:35:25.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.922410+0000 mon.smithi033 (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:25.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: cluster 2022-02-02T13:35:23.922491+0000 mon.smithi033 (mon.0) 287 : cluster [DBG] 2022-02-02T13:35:25.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: osdmap e13: 2 total, 1 up, 2 in 2022-02-02T13:35:25.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.922875+0000 mon.smithi033 (mon.0) 288 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:25.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:24 smithi033 conmon[31996]: audit 2022-02-02T13:35:23.926783+0000 mon.smithi033 (mon.0) 289 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: cluster 2022-02-02T13:35: 2022-02-02T13:35:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: 23.507425+0000 mgr.smithi033.xvkvzp (mgr.14164) 101 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-02-02T13:35:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:35:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: 02T13:35:23.883778+0000 mgr.smithi033.xvkvzp (mgr.14164) 102 : audit [DBG] 2022-02-02T13:35:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: cephadm 2022-02-02T13: 2022-02-02T13:35:25.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: 35:23.885967+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:35:25.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: ) 103 : cephadm [INF] Applying service osd.None on host smithi033... 2022-02-02T13:35:25.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:35:25.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: T13:35:23.922410+0000 mon.smithi033 (mon.0 2022-02-02T13:35:25.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: ) 286 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: cluster 2022-02-02T13:35:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: 2022-02-02T13:35:23. 2022-02-02T13:35:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: 922491+0000 mon.smithi033 (mon.0) 287 : cluster 2022-02-02T13:35:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: [DBG] osdmap e13: 2 total, 1 up, 2 in 2022-02-02T13:35:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:35:25.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: -02T13:35:23.922875+0000 2022-02-02T13:35:25.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: mon.smithi033 (mon.0) 288 : audit [DBG] 2022-02-02T13:35:25.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:25.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:35:25.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: T13:35:23.926783+0000 mon.smithi033 2022-02-02T13:35:25.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: (mon.0) 289 : audit [DBG] 2022-02-02T13:35:25.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:24 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: cluster 2022-02-02T13:35 2022-02-02T13:35:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: :23.086910+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: cluster 2022-02-02T13:35:23. 2022-02-02T13:35:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: 087127+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:35:26.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: -02-02T13:35:24.921297+0000 mon.smithi033 (mon 2022-02-02T13:35:26.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: .0) 290 : cluster [INF] osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] boot 2022-02-02T13:35:26.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:35:26.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: 02T13:35:24.921340+0000 mon.smithi033 (mon.0) 291 : cluster 2022-02-02T13:35:26.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-02-02T13:35:26.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: audit 2022-02-02T13:35:24. 2022-02-02T13:35:26.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: 921772+0000 mon.smithi033 (mon.0) 292 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:26.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:35:26.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: 13:35:24.922267+0000 mon.smithi033 (mon.0) 293 : audit [INF] 2022-02-02T13:35:26.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:35:26.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:35:26.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: 02-02T13:35:24.925506+0000 mon.smithi033 (mon.0) 294 : 2022-02-02T13:35:26.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:25 smithi033 conmon[31996]: audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:35:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: cluster 2022-02-02T13:35:23.086910+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: cluster 2022-02-02T13:35:23.087127+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: cluster 2022-02-02T13:35:24 2022-02-02T13:35:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: .921297+0000 mon.smithi033 (mon.0) 290 : cluster [INF] osd.1 [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] boot 2022-02-02T13:35:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:35:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: 02-02T13:35:24.921340+0000 mon.smithi033 (mon.0) 291 : cluster 2022-02-02T13:35:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-02-02T13:35:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:35:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: 02T13:35:24.921772+0000 mon.smithi033 (mon.0) 292 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:35:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: audit 2022-02-02T13:35 2022-02-02T13:35:26.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: :24.922267+0000 mon.smithi033 (mon.0) 293 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:35:26.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: 2022-02-02T13:35:26.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:35:26.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: 13:35:24.925506+0000 mon.smithi033 (mon.0) 294 : audit 2022-02-02T13:35:26.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:25 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:35:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: cluster 2022-02-02T13:35:25.507811+0000 mgr.smithi033.xvkvzp (mgr.14164) 104 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: cluster 2022-02-02T13:35:25.930487+0000 mon.smithi033 (mon.0) 295 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-02-02T13:35:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit 2022-02-02T13:35:26.125984+0000 mon.smithi033 (mon.0) 296 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit 2022-02-02T13:35:26.193809+0000 mon.smithi033 (mon.0) 297 : audit [INF] from='client.? 172.21.15.33:0/253704430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5"}]: dispatch 2022-02-02T13:35:27.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit 2022-02-02T13:35:26.199531+0000 mon.smithi033 (mon.0) 298 : audit [INF] from='client.? 172.21.15.33:0/253704430' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5"}]': finished 2022-02-02T13:35:27.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: cluster 2022-02-02T13:35:26.199583+0000 mon.smithi033 (mon.0) 299 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-02-02T13:35:27.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit 2022-02-02T13:35:26.199713+0000 mon.smithi033 (mon.0) 300 : 2022-02-02T13:35:27.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:27.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:26 smithi033 conmon[31996]: audit 2022-02-02T13:35:26.652292+0000 mon.smithi033 (mon.0) 301 : audit [DBG] from='client.? 172.21.15.33:0/2051486841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: cluster 2022-02-02T13:35:25.507811+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:35:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: .14164) 104 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:27.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: cluster 2022-02-02T13:35:25.930487+0000 mon.smithi033 (mon.0) 295 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-02-02T13:35:27.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: audit 2022-02-02T13:35:27.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: 2022-02-02T13:35:26.125984+0000 mon.smithi033 (mon.0) 296 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:27.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:35:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: -02T13:35:26.193809+0000 mon.smithi033 (mon.0) 297 : audit [INF] from='client.? 172.21.15.33:0/253704430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5"}]: dispatch 2022-02-02T13:35:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: audit 2022-02-02T13:35:26.199531+0000 mon.smithi033 (mon 2022-02-02T13:35:27.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: .0) 298 : audit [INF] from='client.? 172.21.15.33:0/253704430' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5"}]': finished 2022-02-02T13:35:27.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: cluster 2022-02-02T13:35:27.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: 2022-02-02T13:35:26.199583+0000 mon.smithi033 (mon.0) 299 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-02-02T13:35:27.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:35:27.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: 35:26.199713+0000 mon.smithi033 (mon.0) 300 : audit [DBG] 2022-02-02T13:35:27.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:27.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:35:27.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:26 smithi037 conmon[35544]: :35:26.652292+0000 mon.smithi033 (mon.0) 301 : audit [DBG] from='client.? 172.21.15.33:0/2051486841' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:28 smithi033 conmon[31996]: cluster 2022-02-02T13:35 2022-02-02T13:35:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:28 smithi033 conmon[31996]: :27.508249+0000 mgr.smithi033.xvkvzp (mgr.14164) 105 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:28 smithi037 conmon[35544]: cluster 2022-02-02T13:35:27.508249 2022-02-02T13:35:29.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:28 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 105 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:30 smithi033 conmon[31996]: audit 2022-02-02T13:35:29.136585+0000 2022-02-02T13:35:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:30 smithi033 conmon[31996]: mon.smithi033 (mon.0) 302 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:30 smithi033 conmon[31996]: audit 2022-02-02T13:35:29.140102+0000 mon.smithi033 (mon.0) 303 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:30 smithi037 conmon[35544]: audit 2022-02-02T13:35:29. 2022-02-02T13:35:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:30 smithi037 conmon[35544]: 136585+0000 mon.smithi033 (mon.0) 302 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:30 smithi037 conmon[35544]: audit 2022-02-02T13:35:29.140102+0000 mon.smithi033 2022-02-02T13:35:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:30 smithi037 conmon[35544]: (mon.0) 303 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:31.332 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:31 smithi033 conmon[31996]: cluster 2022-02-02T13:35:29.508678+0000 mgr.smithi033.xvkvzp (mgr.14164) 106 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:31 smithi037 conmon[35544]: cluster 2022-02-02T13:35: 2022-02-02T13:35:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:31 smithi037 conmon[35544]: 29.508678+0000 mgr.smithi033.xvkvzp (mgr.14164) 106 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:33.265 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:33 smithi033 conmon[31996]: cluster 2022-02-02T13:35:31.508976+0000 mgr.smithi033.xvkvzp (mgr.14164) 107 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:33.265 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:33 smithi033 conmon[31996]: audit 2022-02-02T13:35:32.396436+0000 mon.smithi033 (mon.0) 304 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-02-02T13:35:33.266 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:33 smithi033 conmon[31996]: audit 2022-02-02T13:35:32.397095+0000 mon.smithi033 (mon.0) 305 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:33.266 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:33 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:32.397658+0000 mgr.smithi033.xvkvzp (mgr.14164) 108 : cephadm [INF] Deploying daemon osd.2 on smithi033 2022-02-02T13:35:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:33 smithi037 conmon[35544]: cluster 2022-02-02T13:35:31.508976+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:33 smithi037 conmon[35544]: 107 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:33 smithi037 conmon[35544]: audit 2022-02-02T13:35:32.396436+0000 mon.smithi033 (mon.0) 304 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-02-02T13:35:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:33 smithi037 conmon[35544]: audit 2022-02-02T13:35:32.397095+0000 mon.smithi033 (mon.0) 305 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:33 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:32.397658+0000 mgr.smithi033.xvkvzp (mgr.14164) 108 : cephadm [INF] Deploying daemon osd.2 on smithi033 2022-02-02T13:35:35.448 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:35 smithi033 conmon[31996]: cluster 2022-02-02T13:35:33.509375+0000 mgr.smithi033.xvkvzp (mgr.14164) 109 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:35.449 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 2 on host 'smithi033' 2022-02-02T13:35:35.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.446+0000 7fef767fc700 1 -- 172.21.15.33:0/165334314 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fef68000bc0 con 0x7fef6c05c2f0 2022-02-02T13:35:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 msgr2=0x7fef6c05e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 0x7fef6c05e7b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fef70009f50 tx=0x7fef70009b30).stop 2022-02-02T13:35:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 msgr2=0x7fef80108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fef7c00c530 tx=0x7fef7c007e20).stop 2022-02-02T13:35:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 shutdown_connections 2022-02-02T13:35:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef6c05c2f0 0x7fef6c05e7b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef800602b0 0x7fef80108f20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 --2- 172.21.15.33:0/165334314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef800fba60 0x7fef80109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:35:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 >> 172.21.15.33:0/165334314 conn(0x7fef800f0b90 msgr2=0x7fef800f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.450+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 shutdown_connections 2022-02-02T13:35:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:35:35.451+0000 7fef86e12700 1 -- 172.21.15.33:0/165334314 wait complete. 2022-02-02T13:35:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:35 smithi037 conmon[35544]: cluster 2022-02-02T13:35:33 2022-02-02T13:35:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:35 smithi037 conmon[35544]: .509375+0000 mgr.smithi033.xvkvzp (mgr.14164) 109 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:35.880 DEBUG:teuthology.orchestra.run.smithi033:osd.2> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.2.service 2022-02-02T13:35:35.884 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_4... 2022-02-02T13:35:35.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-02-02T13:35:35.915 INFO:journalctl@ceph.osd.2.smithi033.stdout:-- Logs begin at Wed 2022-02-02 13:23:23 UTC. -- 2022-02-02T13:35:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:36 smithi037 conmon[35544]: audit 2022-02-02T13:35:35.434700+0000 2022-02-02T13:35:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:36 smithi037 conmon[35544]: mon.smithi033 (mon.0) 306 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:36.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:36 smithi037 conmon[35544]: audit 2022-02-02T13:35:35.440259+0000 mon.smithi033 (mon.0) 307 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:36.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:36 smithi037 conmon[35544]: audit 2022-02-02T13:35:35.446850+0000 mon.smithi033 (mon.0) 308 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: audit 2022-02-02T13:35:35.434700+0000 2022-02-02T13:35:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: mon.smithi033 (mon.0) 306 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: audit 2022-02-02T13:35:35.440259+0000 mon.smithi033 2022-02-02T13:35:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: (mon.0) 307 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: audit 2022-02-02T13:35: 2022-02-02T13:35:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: 35.446850+0000 mon.smithi033 (mon.0 2022-02-02T13:35:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:36 smithi033 conmon[31996]: ) 308 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:37.620 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-02-02T13:35:37.620 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-02-02T13:35:37.621 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2022-02-02T13:35:37.621 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2022-02-02T13:35:37.621 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0155385 s, 675 MB/s 2022-02-02T13:35:37.621 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2022-02-02T13:35:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:37 smithi033 conmon[31996]: cluster 2022-02-02T13:35:35.509679+0000 mgr.smithi033.xvkvzp (mgr.14164) 110 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:37.772 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:37 smithi037 conmon[35544]: cluster 2022-02-02T13:35:35.509679+0000 mgr.smithi033.xvkvzp (mgr.14164) 110 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:38.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2022-02-02T13:35:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 -- 172.21.15.37:0/1589447875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f55c0 msgr2=0x7efd300f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 --2- 172.21.15.37:0/1589447875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f55c0 0x7efd300f59e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7efd24004660 tx=0x7efd24009b30).stop 2022-02-02T13:35:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 -- 172.21.15.37:0/1589447875 shutdown_connections 2022-02-02T13:35:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 --2- 172.21.15.37:0/1589447875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f6860 0x7efd300f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 --2- 172.21.15.37:0/1589447875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f55c0 0x7efd300f59e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 -- 172.21.15.37:0/1589447875 >> 172.21.15.37:0/1589447875 conn(0x7efd300f0d40 msgr2=0x7efd300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 -- 172.21.15.37:0/1589447875 shutdown_connections 2022-02-02T13:35:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 -- 172.21.15.37:0/1589447875 wait complete. 2022-02-02T13:35:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.585+0000 7efd36eb1700 1 Processor -- start 2022-02-02T13:35:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd36eb1700 1 -- start start 2022-02-02T13:35:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd36eb1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 0x7efd30106fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd36eb1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd36eb1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd30107a40 con 0x7efd300f55c0 2022-02-02T13:35:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd36eb1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd30107b80 con 0x7efd300f6860 2022-02-02T13:35:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd2ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd34c4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 0x7efd30106fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd34c4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 0x7efd30106fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.37:39290/0 (socket says 172.21.15.37:39290) 2022-02-02T13:35:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd34c4d700 1 -- 172.21.15.37:0/2460012693 learned_addr learned my addr 172.21.15.37:0/2460012693 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:35:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd2ffff700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34120/0 (socket says 172.21.15.37:34120) 2022-02-02T13:35:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd2ffff700 1 -- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 msgr2=0x7efd30106fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd2ffff700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 0x7efd30106fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.586+0000 7efd2ffff700 1 -- 172.21.15.37:0/2460012693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd24005040 con 0x7efd300f6860 2022-02-02T13:35:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd2ffff700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7efd1c00c470 tx=0x7efd1c007d60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd1c00f650 con 0x7efd300f6860 2022-02-02T13:35:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7efd1c00ce90 con 0x7efd300f6860 2022-02-02T13:35:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd30108520 con 0x7efd300f6860 2022-02-02T13:35:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd1c012a70 con 0x7efd300f6860 2022-02-02T13:35:39.593 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.587+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd30108ae0 con 0x7efd300f6860 2022-02-02T13:35:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.588+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd30045ad0 con 0x7efd300f6860 2022-02-02T13:35:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.588+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7efd1c010070 con 0x7efd300f6860 2022-02-02T13:35:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.588+0000 7efd2d7fa700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 0x7efd2005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.588+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2417+0+0 (secure 0 0 0) 0x7efd1c074e70 con 0x7efd300f6860 2022-02-02T13:35:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.589+0000 7efd34c4d700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 0x7efd2005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.589+0000 7efd34c4d700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 0x7efd2005e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7efd24013620 tx=0x7efd24009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:39.597 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.593+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7efd1c0452b0 con 0x7efd300f6860 2022-02-02T13:35:39.740 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 02 13:35:39 smithi033 conmon[62819]: debug 2022-02-02T13:35:39.389+0000 7fc9ba4e9080 -1 osd.2 0 log_to_monitors {default=true} 2022-02-02T13:35:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:39 smithi033 conmon[31996]: cluster 2022-02-02T13:35:37. 2022-02-02T13:35:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:39 smithi033 conmon[31996]: 509993+0000 mgr.smithi033.xvkvzp (mgr.14164) 111 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:39.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:39 smithi033 conmon[31996]: audit 2022-02-02T13:35:39.393122+0000 mon.smithi033 (mon.0) 309 : 2022-02-02T13:35:39.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:39 smithi033 conmon[31996]: audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T13:35:39.781 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:39.779+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7efd300faca0 con 0x7efd2005c2b0 2022-02-02T13:35:39.782 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:39 smithi037 conmon[35544]: cluster 2022-02-02T13:35:37.509993+0000 mgr.smithi033.xvkvzp (mgr.14164) 111 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:39.783 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:39 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.393122+0000 mon.smithi033 (mon.0) 309 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-02-02T13:35:40.741 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[62819]: debug 2022-02-02T13:35:40.456+0000 7fc9b0a5a700 -1 osd.2 0 waiting for initial osdmap 2022-02-02T13:35:40.741 INFO:journalctl@ceph.osd.2.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[62819]: debug 2022-02-02T13:35:40.461+0000 7fc9ad1d6700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:35:40.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02-02T13:35 2022-02-02T13:35:40.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: :39.452972+0000 mon.smithi033 (mon.0) 310 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T13:35:40.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: cluster 2022-02-02T13:35:39.453022 2022-02-02T13:35:40.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 311 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-02-02T13:35:40.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:40.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 02T13:35:39.453374+0000 mon.smithi033 (mon 2022-02-02T13:35:40.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: .0) 312 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:40.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02-02T13:35:39. 2022-02-02T13:35:40.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 453648+0000 mon.smithi033 (mon.0) 313 : audit [INF] 2022-02-02T13:35:40.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:40.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02-02T13:35:39.781691+0000 mon.smithi033 (mon. 2022-02-02T13:35:40.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 0) 314 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:40.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:35:40.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 13:35:39.783405+0000 mon.smithi033 (mon. 2022-02-02T13:35:40.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 0) 315 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:40.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit 2022-02-02T13:35: 2022-02-02T13:35:40.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: 39.784158+0000 mon.smithi033 (mon.0) 316 : 2022-02-02T13:35:40.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:40 smithi033 conmon[31996]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:40.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.452972+0000 2022-02-02T13:35:40.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: mon.smithi033 (mon.0) 310 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-02-02T13:35:40.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: cluster 2022-02-02T13:35:39.453022+0000 mon.smithi033 (mon.0) 311 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-02-02T13:35:40.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.453374+0000 mon.smithi033 (mon.0) 312 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:40.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.453648+0000 mon.smithi033 (mon.0) 313 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2022-02-02T13:35:40.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.781691+0000 mon.smithi033 (mon.0) 314 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:40.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: 2022-02-02T13:35:40.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.783405+0000 mon.smithi033 (mon.0) 315 : audit [INF] 2022-02-02T13:35:40.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:40.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:40.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: -02-02T13:35:39.784158+0000 mon.smithi033 (mon.0) 316 2022-02-02T13:35:40.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:40 smithi037 conmon[35544]: : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: cluster 2022-02-02T13:35:39.510245+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:35:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: ) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:39.780844+0000 mgr.smithi033.xvkvzp (mgr.14164) 113 : audit [DBG] from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:41.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:39.783107+0000 mgr.smithi033.xvkvzp (mgr.14164) 114 : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:35:41.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:40.454028+0000 mon.smithi033 (mon.0) 317 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:41.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: cluster 2022-02-02T13:35:40.454095+0000 mon.smithi033 (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-02-02T13:35:41.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:40.454186+0000 mon.smithi033 (mon.0) 319 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:41.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:40.457418+0000 mon.smithi033 (mon.0) 320 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:41.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:40.496187+0000 mon.smithi033 (mon.0) 321 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:41.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:41 smithi033 conmon[31996]: audit 2022-02-02T13:35:41.457169+0000 mon.smithi033 (mon.0) 322 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: cluster 2022-02-02T13:35:39.510245+0000 mgr.smithi033.xvkvzp (mgr.14164) 112 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:39.780844+0000 mgr.smithi033.xvkvzp (mgr.14164) 113 : audit [DBG] from='client.24143 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:39.783107+0000 mgr.smithi033.xvkvzp (mgr.14164) 114 : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:35:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:40.454028+0000 mon.smithi033 (mon.0) 317 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2022-02-02T13:35:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: cluster 2022-02-02T13:35:40. 2022-02-02T13:35:41.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: 454095+0000 mon.smithi033 (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-02-02T13:35:41.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:40.454186+0000 mon.smithi033 (mon.0) 319 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:41.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:40.457418+0000 mon.smithi033 (mon.0) 320 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:41.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:40.496187+0000 mon.smithi033 (mon.0) 321 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:41.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:41 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.457169+0000 mon.smithi033 (mon.0) 322 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:42.843 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: cluster 2022-02-02T13:35:40.381898+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:42.843 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: cluster 2022-02-02T13:35:40.382062+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:42.843 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: cluster 2022-02-02T13:35:41.461422+0000 mon.smithi033 (mon.0) 323 : cluster [INF] osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] boot 2022-02-02T13:35:42.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: cluster 2022-02-02T13:35:41.461450+0000 mon.smithi033 (mon.0) 324 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-02-02T13:35:42.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35:41.461898+0000 mon.smithi033 (mon.0) 325 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:42.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35: 2022-02-02T13:35:42.844 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: 41.745597+0000 mon.smithi037 (mon.1) 2 : audit [INF] from='client.? 172.21.15.37:0/1662468800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]: dispatch 2022-02-02T13:35:42.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35:41.746048+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]: dispatch 2022-02-02T13:35:42.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35:41.750860+0000 mon.smithi033 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]': finished 2022-02-02T13:35:42.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: cluster 2022-02-02T13:35:41.750948+0000 mon.smithi033 (mon.0) 328 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2022-02-02T13:35:42.845 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35:41.751065+0000 mon.smithi033 (mon.0) 329 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:42.846 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: audit 2022-02-02T13:35:42.177437+0000 mon.smithi037 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.37:0/3734802657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:42.846 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:42 smithi033 conmon[31996]: 2022-02-02T13:35:43.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: cluster 2022-02-02T13:35:40.381898+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:43.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: cluster 2022-02-02T13:35:40.382062+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:43.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: cluster 2022-02-02T13:35:41.461422+0000 mon.smithi033 (mon.0) 323 : cluster [INF] osd.2 [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] boot 2022-02-02T13:35:43.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: cluster 2022-02-02T13:35:41.461450+0000 mon.smithi033 (mon.0) 324 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-02-02T13:35:43.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.461898+0000 mon.smithi033 (mon.0) 325 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:35:43.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.745597+0000 mon.smithi037 (mon.1) 2 : audit [INF] from='client.? 172.21.15.37:0/1662468800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]: dispatch 2022-02-02T13:35:43.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.746048+0000 mon.smithi033 (mon.0) 326 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]: dispatch 2022-02-02T13:35:43.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.750860+0000 mon.smithi033 (mon.0) 327 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b9b6adbb-241e-4118-bd0e-81a4270ae5f9"}]': finished 2022-02-02T13:35:43.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: cluster 2022-02-02T13:35:41.750948+0000 mon.smithi033 (mon.0) 328 : cluster [DBG] osdmap e20: 4 total, 3 up, 4 in 2022-02-02T13:35:43.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02-02T13:35:41.751065+0000 mon.smithi033 (mon.0) 329 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:43.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:35:43.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: -02T13:35:42. 2022-02-02T13:35:43.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: 177437+0000 mon.smithi037 (mon.1) 3 : 2022-02-02T13:35:43.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:42 smithi037 conmon[35544]: audit [DBG] from='client.? 172.21.15.37:0/3734802657' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:43 smithi033 conmon[31996]: cluster 2022-02-02T13:35:41.510512+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:43 smithi033 conmon[31996]: 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:43.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:43 smithi033 conmon[31996]: cluster 2022-02-02T13:35:42.811310+0000 mon.smithi033 (mon.0) 330 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-02-02T13:35:43.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:43 smithi033 conmon[31996]: audit 2022-02-02T13:35:42.811439+0000 mon.smithi033 (mon.0) 331 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:44.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: cluster 2022-02-02T13:35:41.510512+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:44.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-02-02T13:35:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: cluster 2022-02-02T13:35:42.811310+0000 mon.smithi033 (mon.0) 330 : cluster 2022-02-02T13:35:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-02-02T13:35:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:35:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: 13:35:42.811439+0000 2022-02-02T13:35:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: mon.smithi033 (mon.0) 331 : audit [DBG] 2022-02-02T13:35:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:43 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: cluster 2022-02-02T13:35:43.510776+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:35:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: ) 116 : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:43.722573+0000 mgr.smithi033.xvkvzp (mgr.14164) 117 : cephadm [INF] Detected new or changed devices on smithi033 2022-02-02T13:35:44.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: audit 2022-02-02T13:35:43.727909+0000 mon.smithi033 (mon.0) 332 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:44.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: audit 2022-02-02T13:35:43.730973+0000 mon.smithi033 (mon.0) 333 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:44.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:44 smithi033 conmon[31996]: audit 2022-02-02T13:35:43.733761+0000 mon.smithi033 (mon.0) 334 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:45.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: cluster 2022-02-02T13:35:43.510776+0000 mgr.smithi033.xvkvzp (mgr.14164) 116 2022-02-02T13:35:45.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: : cluster [DBG] pgmap v80: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:45.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:43.722573+0000 mgr.smithi033.xvkvzp (mgr.14164) 117 : cephadm [INF] Detected new or changed devices on smithi033 2022-02-02T13:35:45.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:45.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: -02-02T13:35:43 2022-02-02T13:35:45.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: .727909+0000 mon.smithi033 (mon.0) 332 2022-02-02T13:35:45.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:45.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: audit 2022-02-02T13:35:45.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: 2022-02-02T13:35 2022-02-02T13:35:45.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: :43.730973+0000 mon.smithi033 (mon.0 2022-02-02T13:35:45.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: ) 333 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:45.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: audit 2022-02-02T13:35:45.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: 2022-02-02T13:35 2022-02-02T13:35:45.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: :43.733761+0000 mon.smithi033 ( 2022-02-02T13:35:45.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: mon.0) 334 : audit [DBG] 2022-02-02T13:35:45.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:44 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:46.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:46 smithi037 conmon[35544]: cluster 2022-02-02T13:35:45.511011+0000 mgr.smithi033.xvkvzp (mgr.14164) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:46 smithi033 conmon[31996]: cluster 2022-02-02T13:35:45.511011+0000 mgr.smithi033.xvkvzp 2022-02-02T13:35:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:46 smithi033 conmon[31996]: (mgr.14164) 118 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:48.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:47 smithi037 conmon[35544]: audit 2022-02-02T13:35:47.798556+0000 mon.smithi033 2022-02-02T13:35:48.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:47 smithi037 conmon[35544]: (mon.0) 335 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-02-02T13:35:48.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:47 smithi037 conmon[35544]: audit 2022-02-02T13:35:47.799253+0000 mon.smithi033 (mon.0) 336 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:47 smithi033 conmon[31996]: audit 2022-02-02T13:35:47.798556+0000 mon.smithi033 (mon.0) 2022-02-02T13:35:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:47 smithi033 conmon[31996]: 335 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-02-02T13:35:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:47 smithi033 conmon[31996]: audit 2022-02-02T13:35:47.799253+0000 mon.smithi033 ( 2022-02-02T13:35:48.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:47 smithi033 conmon[31996]: mon.0) 336 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:48.986 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:48 smithi037 conmon[35544]: cluster 2022-02-02T13:35:47.511420+0000 mgr.smithi033.xvkvzp (mgr.14164) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:48.986 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:48 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:47.799835+0000 mgr.smithi033.xvkvzp (mgr.14164) 120 : cephadm [INF] Deploying daemon osd.3 on smithi037 2022-02-02T13:35:48.987 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:48 smithi037 conmon[35544]: audit 2022-02-02T13:35:48.559005+0000 mon.smithi033 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:48.987 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:48 smithi037 conmon[35544]: audit 2022-02-02T13:35:48.561951+0000 mon.smithi033 (mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: cluster 2022-02-02T13:35:47.511420+0000 mgr.smithi033.xvkvzp (mgr.14164) 119 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:47.799835+0000 mgr.smithi033.xvkvzp (mgr.14164) 120 : cephadm [INF] Deploying daemon osd.3 on smithi037 2022-02-02T13:35:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: audit 2022-02-02T13:35:48.559005 2022-02-02T13:35:49.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:49.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:49.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: 02T13:35:48.561951+0000 mon.smithi033 ( 2022-02-02T13:35:49.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:48 smithi033 conmon[31996]: mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:50.731 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2022-02-02T13:35:50.732 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.728+0000 7efd2d7fa700 1 -- 172.21.15.37:0/2460012693 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7efd300faca0 con 0x7efd2005c2b0 2022-02-02T13:35:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 msgr2=0x7efd2005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 0x7efd2005e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7efd24013620 tx=0x7efd24009b30).stop 2022-02-02T13:35:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 msgr2=0x7efd30107490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7efd1c00c470 tx=0x7efd1c007d60).stop 2022-02-02T13:35:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 shutdown_connections 2022-02-02T13:35:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7efd2005c2b0 0x7efd2005e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd300f55c0 0x7efd30106fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 --2- 172.21.15.37:0/2460012693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd300f6860 0x7efd30107490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 >> 172.21.15.37:0/2460012693 conn(0x7efd300f0d40 msgr2=0x7efd3005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 shutdown_connections 2022-02-02T13:35:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:50.731+0000 7efd36eb1700 1 -- 172.21.15.37:0/2460012693 wait complete. 2022-02-02T13:35:51.067 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.3.service 2022-02-02T13:35:51.070 INFO:tasks.cephadm:Deploying osd.4 on smithi037 with /dev/vg_nvme/lv_3... 2022-02-02T13:35:51.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-02-02T13:35:51.112 INFO:journalctl@ceph.osd.3.smithi037.stdout:-- Logs begin at Wed 2022-02-02 13:23:17 UTC. -- 2022-02-02T13:35:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: cluster 2022-02-02T13:35:49.511943+0000 mgr.smithi033.xvkvzp (mgr.14164) 121 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:51.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: 2022-02-02T13:35:51.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: audit 2022-02-02T13:35:50.717709+0000 mon.smithi033 (mon.0) 339 : 2022-02-02T13:35:51.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:51.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:51.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: 02T13:35:50.722701+0000 2022-02-02T13:35:51.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: mon.smithi033 (mon.0) 340 : audit [INF] 2022-02-02T13:35:51.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:51.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: audit 2022 2022-02-02T13:35:51.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: -02-02T13:35: 2022-02-02T13:35:51.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: 50.729341+0000 mon.smithi033 (mon.0) 2022-02-02T13:35:51.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:51 smithi033 conmon[31996]: 341 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:51.541 INFO:journalctl@ceph.osd.3.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[42092]: debug 2022-02-02T13:35:51.163+0000 7f1a13746080 -1 Falling back to public interface 2022-02-02T13:35:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: cluster 2022-02-02T13:35:49.511943+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:35:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: 14164) 121 : cluster [DBG] pgmap v83: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:51.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: audit 2022-02-02T13:35:50.717709+0000 mon.smithi033 (mon.0) 339 : audit [DBG] 2022-02-02T13:35:51.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:51.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:35:51.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: -02T13:35:50.722701+0000 mon.smithi033 (mon.0) 340 : 2022-02-02T13:35:51.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:51.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:35:51.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: T13:35:50.729341+0000 mon.smithi033 (mon 2022-02-02T13:35:51.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:51 smithi037 conmon[35544]: .0) 341 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:52.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:52 smithi037 conmon[35544]: audit 2022-02-02T13:35:50.731536+0000 mon.smithi033 (mon.0) 342 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-02-02T13:35:52.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:52 smithi037 conmon[35544]: audit 2022-02-02T13:35:51.731431+0000 mon.smithi033 (mon.0) 343 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-02-02T13:35:52.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:52 smithi037 conmon[35544]: cluster 2022-02-02T13:35:51.731500+0000 mon.smithi033 (mon.0) 344 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-02-02T13:35:52.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:52 smithi037 conmon[35544]: audit 2022-02-02T13:35:51.731634+0000 mon.smithi033 (mon.0) 345 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:52.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:52 smithi037 conmon[35544]: audit 2022-02-02T13:35:51.732591+0000 mon.smithi033 (mon.0) 346 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-02-02T13:35:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: audit 2022-02-02T13:35:50.731536+0000 2022-02-02T13:35:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: mon.smithi033 (mon.0) 342 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-02-02T13:35:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: audit 2022-02-02T13:35:51.731431+0000 mon.smithi033 (mon.0) 343 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-02-02T13:35:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: cluster 2022-02-02T13:35:51.731500+0000 mon.smithi033 (mon.0) 344 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-02-02T13:35:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: audit 2022-02-02T13:35:51.731634+0000 mon.smithi033 (mon.0) 345 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:52.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:52.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:52 smithi033 conmon[31996]: 02T13:35:51.732591+0000 mon.smithi033 (mon.0) 346 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-02-02T13:35:53.246 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-02-02T13:35:53.246 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-02-02T13:35:53.247 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2022-02-02T13:35:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2022-02-02T13:35:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120279 s, 872 MB/s 2022-02-02T13:35:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2022-02-02T13:35:53.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: cluster 2022-02-02T13:35:51.512361+0000 mgr.smithi033.xvkvzp (mgr.14164) 122 : cluster 2022-02-02T13:35:53.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: [DBG] pgmap v84: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:53.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: audit 2022-02-02T13:35:52.732593+0000 mon.smithi033 (mon.0) 347 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-02-02T13:35:53.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: cluster 2022-02-02T13:35:52.732701+0000 2022-02-02T13:35:53.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: mon.smithi033 (mon.0) 348 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-02-02T13:35:53.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: audit 2022 2022-02-02T13:35:53.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: -02-02T13:35:52.732857+0000 mon.smithi033 2022-02-02T13:35:53.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:53 smithi033 conmon[31996]: (mon.0) 349 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:53.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:53 smithi037 conmon[35544]: cluster 2022-02-02T13:35:51.512361+0000 mgr.smithi033.xvkvzp (mgr.14164) 122 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:53.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:53 smithi037 conmon[35544]: audit 2022-02-02T13:35:52.732593+0000 mon.smithi033 (mon.0) 347 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-02-02T13:35:53.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:53 smithi037 conmon[35544]: cluster 2022-02-02T13:35:52.732701+0000 mon.smithi033 (mon.0) 348 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-02-02T13:35:53.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:53 smithi037 conmon[35544]: audit 2022-02-02T13:35:52.732857+0000 mon.smithi033 (mon.0) 349 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:53.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2022-02-02T13:35:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: cluster 2022-02-02T13:35:53.512720+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:35:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: .14164) 123 : cluster [DBG] pgmap v87: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: audit 2022-02-02T13:35:53.672833+0000 mon.smithi033 (mon.0) 350 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:54.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: cluster 2022-02-02T13:35:53.737653+0000 2022-02-02T13:35:54.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: mon.smithi033 (mon.0) 351 : cluster [DBG] 2022-02-02T13:35:54.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: osdmap e24: 4 total, 3 up, 4 in 2022-02-02T13:35:54.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:35:54.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: 02-02T13:35:53.737779+0000 mon.smithi033 (mon 2022-02-02T13:35:54.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:54 smithi033 conmon[31996]: .0) 352 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:55.043 INFO:journalctl@ceph.osd.3.smithi037.stdout:Feb 02 13:35:54 smithi037 conmon[42092]: debug 2022-02-02T13:35:54.695+0000 7f1a13746080 -1 osd.3 0 log_to_monitors {default=true} 2022-02-02T13:35:55.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:54 smithi037 conmon[35544]: cluster 2022-02-02T13:35:53.512720+0000 mgr.smithi033.xvkvzp (mgr.14164) 123 : cluster [DBG] pgmap v87: 1 pgs: 1 unknown; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:55.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:54 smithi037 conmon[35544]: audit 2022-02-02T13:35:53.672833+0000 mon.smithi033 (mon.0) 350 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:55.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:54 smithi037 conmon[35544]: cluster 2022-02-02T13:35:53.737653+0000 mon.smithi033 (mon.0) 351 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-02-02T13:35:55.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:54 smithi037 conmon[35544]: audit 2022-02-02T13:35:53.737779+0000 mon.smithi033 (mon.0) 352 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 -- 172.21.15.37:0/2854985499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f66e0 msgr2=0x7f28c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:55.466 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/2854985499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f66e0 0x7f28c40f6b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f28c00099e0 tx=0x7f28c0004d10).stop 2022-02-02T13:35:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 -- 172.21.15.37:0/2854985499 shutdown_connections 2022-02-02T13:35:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/2854985499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f7980 0x7f28c40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/2854985499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f66e0 0x7f28c40f6b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:55.467 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 -- 172.21.15.37:0/2854985499 >> 172.21.15.37:0/2854985499 conn(0x7f28c40f1e40 msgr2=0x7f28c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:35:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 -- 172.21.15.37:0/2854985499 shutdown_connections 2022-02-02T13:35:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.461+0000 7f28cb2d9700 1 -- 172.21.15.37:0/2854985499 wait complete. 2022-02-02T13:35:55.468 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 Processor -- start 2022-02-02T13:35:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 -- start start 2022-02-02T13:35:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f7980 0x7f28c41075c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:55.469 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4107b70 con 0x7f28c40f7980 2022-02-02T13:35:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28cb2d9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c4107cb0 con 0x7f28c40f66e0 2022-02-02T13:35:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28c9075700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28c9075700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34160/0 (socket says 172.21.15.37:34160) 2022-02-02T13:35:55.470 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28c9075700 1 -- 172.21.15.37:0/1073662120 learned_addr learned my addr 172.21.15.37:0/1073662120 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:35:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.462+0000 7f28c8874700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f7980 0x7f28c41075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28c9075700 1 -- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f7980 msgr2=0x7f28c41075c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:35:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28c9075700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f7980 0x7f28c41075c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:35:55.471 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28c9075700 1 -- 172.21.15.37:0/1073662120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0009640 con 0x7f28c40f66e0 2022-02-02T13:35:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28c9075700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f28c000b3b0 tx=0x7f28c0004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28c000e070 con 0x7f28c40f66e0 2022-02-02T13:35:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c41085f0 con 0x7f28c40f66e0 2022-02-02T13:35:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f28c00049b0 con 0x7f28c40f66e0 2022-02-02T13:35:55.472 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28c0018070 con 0x7f28c40f66e0 2022-02-02T13:35:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.463+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c4108b50 con 0x7f28c40f66e0 2022-02-02T13:35:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.464+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c4045ad0 con 0x7f28c40f66e0 2022-02-02T13:35:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.464+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f28c0024060 con 0x7f28c40f66e0 2022-02-02T13:35:55.473 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.465+0000 7f28b9ffb700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 0x7f28b005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:35:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.465+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3228+0+0 (secure 0 0 0) 0x7f28c0076e20 con 0x7f28c40f66e0 2022-02-02T13:35:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.465+0000 7f28c8874700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 0x7f28b005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:35:55.474 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.465+0000 7f28c8874700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 0x7f28b005e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f28b4009fd0 tx=0x7f28b400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:35:55.475 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.469+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f28c004a350 con 0x7f28c40f66e0 2022-02-02T13:35:55.672 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:35:55.671+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c40fefb0 con 0x7f28b005c2b0 2022-02-02T13:35:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:55 smithi037 conmon[35544]: audit 2022-02-02T13:35:54.700952+0000 mon.smithi037 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T13:35:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:55 smithi037 conmon[35544]: audit 2022-02-02T13:35:54.701368+0000 mon.smithi033 (mon.0) 353 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T13:35:55.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:55 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.489043+0000 mon.smithi033 (mon.0) 354 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:55.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: audit 2022-02-02T13:35:54.700952+0000 mon.smithi037 (mon. 2022-02-02T13:35:55.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: 1) 4 : audit [INF] from='osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T13:35:55.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: audit 2022-02-02T13:35:54.701368+0000 mon.smithi033 (mon.0) 353 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-02-02T13:35:55.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: 2022-02-02T13:35:55.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: audit 2022-02-02T13:35:55.489043+0000 mon.smithi033 (mon.0 2022-02-02T13:35:55.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:55 smithi033 conmon[31996]: ) 354 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:56.928 INFO:journalctl@ceph.osd.3.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[42092]: debug 2022-02-02T13:35:56.686+0000 7f1a09cb7700 -1 osd.3 0 waiting for initial osdmap 2022-02-02T13:35:56.928 INFO:journalctl@ceph.osd.3.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[42092]: debug 2022-02-02T13:35:56.693+0000 7f1a05c32700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:35:56.929 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: cluster 2022-02-02T13:35:55.513046+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:35:56.929 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: mgr.14164) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:56.929 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.673679+0000 mgr.smithi033.xvkvzp (mgr.14164) 125 : audit [DBG] from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:56.930 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.674479+0000 mon.smithi033 (mon.0) 355 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:56.930 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: cephadm 2022-02-02T13:35:55.675830+0000 mgr.smithi033.xvkvzp (mgr.14164) 126 : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:35:56.930 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.678713+0000 mon.smithi033 (mon.0) 356 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:56.930 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.679415+0000 mon.smithi033 (mon.0) 357 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:56.930 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.685563+0000 mon.smithi033 (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T13:35:56.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: cluster 2022-02-02T13:35:55.685658+0000 mon.smithi033 (mon.0) 359 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-02-02T13:35:56.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.685760+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:56.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.686689+0000 mon.smithi037 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:35:56.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:56 smithi037 conmon[35544]: audit 2022-02-02T13:35:55.687000+0000 mon.smithi033 (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:35:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: cluster 2022-02-02T13:35:55.513046+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:35:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: mgr.14164) 124 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02-02T13:35:55.673679+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:35:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 125 : audit [DBG] from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:35:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:35:56.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: -02T13:35:55.674479+0000 mon.smithi033 (mon.0) 355 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:35:56.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 2022-02-02T13:35:56.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: cephadm 2022- 2022-02-02T13:35:56.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 02-02T13:35:55.675830+0000 mgr.smithi033.xvkvzp (mgr.14164) 126 : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:35:56.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02-02T13:35:55. 2022-02-02T13:35:56.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 678713+0000 mon.smithi033 (mon.0) 356 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:35:56.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02-02T13:35:55.679415+0000 mon.smithi033 (mon.0 2022-02-02T13:35:56.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: ) 357 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:35:56.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022 2022-02-02T13:35:56.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: -02-02T13:35:55.685563+0000 mon.smithi033 (mon.0) 358 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-02-02T13:35:56.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: cluster 2022-02-02T13:35:55.685658+0000 mon.smithi033 (mon.0) 359 2022-02-02T13:35:56.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-02-02T13:35:56.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:56.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 02T13:35:55.685760+0000 mon.smithi033 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:56.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02-02T13:35:55. 2022-02-02T13:35:56.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: 686689+0000 mon.smithi037 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:35:56.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: audit 2022-02-02T13:35:55.687000+0000 2022-02-02T13:35:56.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:56 smithi033 conmon[31996]: mon.smithi033 (mon.0) 361 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:35:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:56.685135+0000 2022-02-02T13:35:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: mon.smithi033 (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:35:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: cluster 2022-02-02T13:35:56.685246+0000 mon.smithi033 (mon.0) 363 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2022-02-02T13:35:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:56.685483+0000 mon.smithi033 (mon.0) 364 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:56.688461+0000 mon.smithi033 (mon.0) 365 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: cluster 2022-02-02T13:35:56.813212+0000 mon.smithi033 (mon.0) 366 : cluster [INF] osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] boot 2022-02-02T13:35:57.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: cluster 2022-02-02T13:35:56.813285+0000 mon.smithi033 (mon.0) 367 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2022-02-02T13:35:57.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:56.813675+0000 mon.smithi033 (mon 2022-02-02T13:35:57.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: .0) 368 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: cephadm 2022-02-02T 2022-02-02T13:35:57.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 13:35:57.375144+0000 mgr.smithi033.xvkvzp 2022-02-02T13:35:57.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: (mgr.14164) 127 : cephadm 2022-02-02T13:35:57.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: [INF] Detected new or changed devices on smithi037 2022-02-02T13:35:57.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022 2022-02-02T13:35:57.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: -02-02T13:35: 2022-02-02T13:35:57.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 57.380517+0000 mon.smithi033 (mon 2022-02-02T13:35:57.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: .0) 369 : audit [INF] 2022-02-02T13:35:57.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:57.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:57.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 2022-02- 2022-02-02T13:35:57.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 02T13:35:57. 2022-02-02T13:35:57.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 384294+0000 mon.smithi033 (mon.0 2022-02-02T13:35:57.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: ) 370 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:57.798 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 2022-02-02T13:35:57.798 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: audit 2022-02-02T13:35:57.798 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: 2022-02-02T13 2022-02-02T13:35:57.798 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: :35:57.387924+0000 2022-02-02T13:35:57.799 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: mon.smithi033 (mon.0) 371 2022-02-02T13:35:57.799 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:57 smithi037 conmon[35544]: : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:57.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022-02-02T13:35:56.685135+0000 mon.smithi033 2022-02-02T13:35:57.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:35:57.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: cluster 2022-02-02T13:35:56.685246+0000 mon.smithi033 (mon.0) 363 : cluster 2022-02-02T13:35:57.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: [DBG] osdmap e26: 4 total, 3 up, 4 in 2022-02-02T13:35:57.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022 2022-02-02T13:35:57.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: -02-02T13:35:56.685483+0000 mon.smithi033 (mon 2022-02-02T13:35:57.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: .0) 364 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:35:57.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 02T13:35:56.688461+0000 mon.smithi033 2022-02-02T13:35:57.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: (mon.0) 365 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 2022-02-02T13:35:57.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:35:57.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: -02-02T13:35:56.813212+0000 mon.smithi033 ( 2022-02-02T13:35:57.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: mon.0) 366 : cluster [INF] osd.3 [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] boot 2022-02-02T13:35:57.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: cluster 2022-02 2022-02-02T13:35:57.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: -02T13:35:56.813285+0000 2022-02-02T13:35:57.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: mon.smithi033 (mon.0) 367 : cluster [DBG] 2022-02-02T13:35:57.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: osdmap e27: 4 total, 4 up, 4 in 2022-02-02T13:35:57.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022-02-02T13:35:57.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 2022-02-02T13:35:56.813675+0000 mon.smithi033 2022-02-02T13:35:57.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: (mon.0) 368 : audit [DBG] 2022-02-02T13:35:57.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:35:57.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: cephadm 2022-02-02T13:35:57.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 2022-02-02T13:35:57. 2022-02-02T13:35:57.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 375144+0000 mgr.smithi033.xvkvzp (mgr.14164) 127 : cephadm 2022-02-02T13:35:58.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: [INF] Detected new or changed devices on smithi037 2022-02-02T13:35:58.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:35:58.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: :35:57.380517+0000 mon.smithi033 (mon. 2022-02-02T13:35:58.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 0) 369 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:58.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:35:58.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: T13:35:57.384294+0000 mon.smithi033 ( 2022-02-02T13:35:58.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: mon.0) 370 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:35:58.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:35:58.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: 02-02T13:35:57.387924+0000 2022-02-02T13:35:58.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: mon.smithi033 (mon.0) 371 : audit [DBG] 2022-02-02T13:35:58.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:57 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:35:58.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:35:58.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 02T13:35:55.650793+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:58.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster 2022-02-02T13:35:58.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 2022-02-02T13:35:55.650899+0000 osd.3 (osd.3) 2 : 2022-02-02T13:35:58.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:58.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:35:58.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 35:57.513344+0000 mgr.smithi033.xvkvzp (mgr.14164) 128 : cluster [DBG] 2022-02-02T13:35:58.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: pgmap v93: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:58.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster 2022-02-02T 2022-02-02T13:35:58.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 13:35:57.817794+0000 mon.smithi033 2022-02-02T13:35:58.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: (mon.0) 372 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2022-02-02T13:35:58.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 2022-02-02T13:35:58.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:35:58.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: T13:35:58.024193+0000 2022-02-02T13:35:58.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: mon.smithi037 (mon.1) 6 : audit [INF] 2022-02-02T13:35:58.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: from='client.? 172.21.15.37:0/3231779565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]: dispatch 2022-02-02T13:35:58.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:35:58.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 13:35:58.024690+0000 mon.smithi033 2022-02-02T13:35:58.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]: dispatch 2022-02-02T13:35:58.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 2022-02-02T13:35:58.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:35:58.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: 13:35:58.031240+0000 mon.smithi033 2022-02-02T13:35:58.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: (mon.0) 374 : audit [INF] 2022-02-02T13:35:58.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]': finished 2022-02-02T13:35:58.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: cluster 2022-02-02 2022-02-02T13:35:58.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: T13:35:58.031317+0000 2022-02-02T13:35:58.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: mon.smithi033 (mon.0) 375 : cluster [DBG] 2022-02-02T13:35:58.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: osdmap e29: 5 total, 4 up, 5 in 2022-02-02T13:35:58.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:35:58.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: T13:35:58.031439+0000 2022-02-02T13:35:58.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: mon.smithi033 (mon.0) 376 : audit [DBG] 2022-02-02T13:35:58.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:35:58.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:35:59.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: T13:35:58.457340 2022-02-02T13:35:59.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: +0000 mon.smithi037 (mon.1) 7 2022-02-02T13:35:59.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:35:58 smithi033 conmon[31996]: : audit [DBG] from='client.? 172.21.15.37:0/2423469101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:35:59.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: cluster 2022-02-02T13:35:55.650793+0000 osd.3 (osd 2022-02-02T13:35:59.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: .3) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:35:59.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: cluster 2022-02-02T13:35:55.650899+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:35:59.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: cluster 2022-02-02T13:35:57.513344+0000 mgr.smithi033.xvkvzp (mgr.14164) 128 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-02-02T13:35:59.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: cluster 2022-02-02T13:35:57.817794+0000 mon.smithi033 (mon.0) 372 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2022-02-02T13:35:59.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: audit 2022-02-02T13:35:58.024193+0000 mon.smithi037 (mon.1) 6 : audit [INF] from='client.? 172.21.15.37:0/3231779565' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]: dispatch 2022-02-02T13:35:59.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: audit 2022-02-02T13:35:58.024690+0000 mon.smithi033 (mon.0) 373 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]: dispatch 2022-02-02T13:35:59.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: audit 2022-02-02T13:35:58.031240+0000 mon.smithi033 (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5805195f-9663-47d0-8a38-153c13fdf8b7"}]': finished 2022-02-02T13:35:59.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: cluster 2022-02-02T13:35:58.031317+0000 mon.smithi033 (mon.0) 375 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-02-02T13:35:59.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: audit 2022-02-02T13:35:58.031439+0000 mon.smithi033 (mon.0) 376 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:35:59.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:35:58 smithi037 conmon[35544]: audit 2022-02-02T13:35:58.457340+0000 mon.smithi037 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.37:0/2423469101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:36:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:00 smithi033 conmon[31996]: cluster 2022-02-02T13:35:59.513624+0000 mgr.smithi033.xvkvzp (mgr.14164) 129 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:01.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:00 smithi037 conmon[35544]: cluster 2022-02-02T13:35:59.513624+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:36:01.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:00 smithi037 conmon[35544]: 129 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:03 smithi037 conmon[35544]: cluster 2022-02-02T13:36:01.513920+0000 mgr.smithi033.xvkvzp (mgr.14164) 130 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:03 smithi037 conmon[35544]: audit 2022-02-02T13:36:02.131845+0000 mon.smithi033 (mon.0) 377 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:03.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:03 smithi037 conmon[35544]: audit 2022-02-02T13:36:02.136879+0000 mon.smithi033 (mon.0) 378 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:03.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:03 smithi033 conmon[31996]: cluster 2022-02-02T13:36:01.513920+0000 mgr.smithi033.xvkvzp (mgr.14164) 130 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:03.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:03 smithi033 conmon[31996]: audit 2022-02-02T13:36:02.131845+0000 mon.smithi033 (mon.0) 377 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:03.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:03 smithi033 conmon[31996]: audit 2022-02-02T13:36:02.136879+0000 mon.smithi033 (mon.0) 378 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:05.473 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:05 smithi037 conmon[35544]: cluster 2022-02-02T13:36:03.514439+0000 mgr.smithi033.xvkvzp (mgr.14164) 131 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:05.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:05 smithi037 conmon[35544]: audit 2022-02-02T13:36:04.264117+0000 mon.smithi033 (mon.0) 379 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-02-02T13:36:05.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:05 smithi037 conmon[35544]: audit 2022-02-02T13:36:04.265022+0000 mon.smithi033 (mon.0) 380 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:05.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:05 smithi037 conmon[35544]: cephadm 2022-02-02T13:36:04.265751+0000 mgr.smithi033.xvkvzp (mgr.14164) 132 : cephadm [INF] Deploying daemon osd.4 on smithi037 2022-02-02T13:36:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: cluster 2022-02-02T13:36:03.514439+0000 mgr.smithi033.xvkvzp (mgr.14164) 131 2022-02-02T13:36:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: audit 2022-02-02T13:36:04.264117+0000 mon.smithi033 (mon.0) 379 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-02-02T13:36:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:36:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: -02T13:36:04.265022+0000 mon.smithi033 (mon.0) 380 : 2022-02-02T13:36:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: cephadm 2022-02-02T13:36:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: 2022-02-02T13:36:04.265751+0000 2022-02-02T13:36:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 132 : cephadm [INF] Deploying daemon osd.4 on smithi037 2022-02-02T13:36:05.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:05 smithi033 conmon[31996]: 2022-02-02T13:36:07.208 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.205+0000 7f28b9ffb700 1 -- 172.21.15.37:0/1073662120 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f28c40fefb0 con 0x7f28b005c2b0 2022-02-02T13:36:07.209 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 4 on host 'smithi037' 2022-02-02T13:36:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.207+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 msgr2=0x7f28b005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.207+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 0x7f28b005e770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f28b4009fd0 tx=0x7f28b400b040).stop 2022-02-02T13:36:07.210 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.207+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 msgr2=0x7f28c41070d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.207+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f28c000b3b0 tx=0x7f28c0004d10).stop 2022-02-02T13:36:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 shutdown_connections 2022-02-02T13:36:07.211 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f28b005c2b0 0x7f28b005e770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c40f66e0 0x7f28c41070d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 --2- 172.21.15.37:0/1073662120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28c40f7980 0x7f28c41075c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 >> 172.21.15.37:0/1073662120 conn(0x7f28c40f1e40 msgr2=0x7f28c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 shutdown_connections 2022-02-02T13:36:07.212 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:07.208+0000 7f28cb2d9700 1 -- 172.21.15.37:0/1073662120 wait complete. 2022-02-02T13:36:07.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:07 smithi037 conmon[35544]: cluster 2022-02-02T13:36:05.515006+0000 2022-02-02T13:36:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:07 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 133 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:07 smithi033 conmon[31996]: cluster 2022-02-02T 2022-02-02T13:36:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:07 smithi033 conmon[31996]: 13:36:05.515006+0000 mgr.smithi033.xvkvzp (mgr.14164) 133 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:07.508 DEBUG:teuthology.orchestra.run.smithi037:osd.4> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.4.service 2022-02-02T13:36:07.511 INFO:tasks.cephadm:Deploying osd.5 on smithi037 with /dev/vg_nvme/lv_2... 2022-02-02T13:36:07.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-02-02T13:36:07.540 INFO:journalctl@ceph.osd.4.smithi037.stdout:-- Logs begin at Wed 2022-02-02 13:23:17 UTC. -- 2022-02-02T13:36:07.791 INFO:journalctl@ceph.osd.4.smithi037.stdout:Feb 02 13:36:07 smithi037 conmon[46970]: debug 2022-02-02T13:36:07.657+0000 7eff224f8080 -1 Falling back to public interface 2022-02-02T13:36:08.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:08 smithi037 conmon[35544]: audit 2022-02-02T13:36:07.196070+0000 mon.smithi033 (mon.0) 381 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:08.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:08 smithi037 conmon[35544]: audit 2022-02-02T13:36:07.200792+0000 mon.smithi033 (mon.0) 382 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:08.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:08 smithi037 conmon[35544]: audit 2022-02-02T13:36:07.205862+0000 mon.smithi033 (mon.0) 383 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:08 smithi033 conmon[31996]: audit 2022-02-02T13:36:07.196070 2022-02-02T13:36:08.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:08 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 381 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:08.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:08 smithi033 conmon[31996]: audit 2022-02-02T13:36:07.200792+0000 mon.smithi033 (mon.0) 382 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:08.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:08 smithi033 conmon[31996]: audit 2022-02-02T13:36:07.205862+0000 mon.smithi033 (mon.0) 383 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:09 smithi037 conmon[35544]: cluster 2022-02-02T13:36:07.515363+0000 mgr.smithi033.xvkvzp (mgr.14164) 134 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:09.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:09 smithi033 conmon[31996]: cluster 2022-02-02T13:36:07.515363+0000 mgr.smithi033.xvkvzp 2022-02-02T13:36:09.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:09 smithi033 conmon[31996]: (mgr.14164) 134 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:09.525 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-02-02T13:36:09.525 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-02-02T13:36:09.526 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2022-02-02T13:36:09.526 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2022-02-02T13:36:09.527 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011684 s, 897 MB/s 2022-02-02T13:36:09.527 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2022-02-02T13:36:09.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2022-02-02T13:36:11.322 INFO:journalctl@ceph.osd.4.smithi037.stdout:Feb 02 13:36:11 smithi037 conmon[46970]: debug 2022-02-02T13:36:11.188+0000 7eff224f8080 -1 osd.4 0 log_to_monitors {default=true} 2022-02-02T13:36:11.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:11 smithi037 conmon[35544]: cluster 2022-02-02T13:36:09.515855+0000 mgr.smithi033.xvkvzp (mgr.14164) 135 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:11.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:11 smithi037 conmon[35544]: audit 2022-02-02T13:36:10.664332+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:11.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:11 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.193531+0000 mon.smithi037 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T13:36:11.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:11 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.194090+0000 mon.smithi033 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T13:36:11.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:11 smithi033 conmon[31996]: cluster 2022-02-02T13:36:09 2022-02-02T13:36:11.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:11 smithi033 conmon[31996]: .515855+0000 mgr.smithi033.xvkvzp (mgr.14164) 135 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:11.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:11 smithi033 conmon[31996]: audit 2022-02-02T13:36:10.664332+0000 mon.smithi033 (mon.0) 384 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:11.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:11 smithi033 conmon[31996]: audit 2022-02-02T13:36:11.193531+0000 mon.smithi037 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T13:36:11.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:11 smithi033 conmon[31996]: audit 2022-02-02T13:36:11.194090+0000 mon.smithi033 (mon.0) 385 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-02-02T13:36:11.518 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 -- 172.21.15.37:0/2706903728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 msgr2=0x7fc2f40f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/2706903728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f40f5830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc2e4004660 tx=0x7fc2e4009b30).stop 2022-02-02T13:36:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 -- 172.21.15.37:0/2706903728 shutdown_connections 2022-02-02T13:36:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/2706903728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f40f5830 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:11.519 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/2706903728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f40f6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 -- 172.21.15.37:0/2706903728 >> 172.21.15.37:0/2706903728 conn(0x7fc2f40f0320 msgr2=0x7fc2f40f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 -- 172.21.15.37:0/2706903728 shutdown_connections 2022-02-02T13:36:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.516+0000 7fc2fadf5700 1 -- 172.21.15.37:0/2706903728 wait complete. 2022-02-02T13:36:11.520 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 Processor -- start 2022-02-02T13:36:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 -- start start 2022-02-02T13:36:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f4108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f4109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f41099d0 con 0x7fc2f40f6a40 2022-02-02T13:36:11.521 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2fadf5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f4109b10 con 0x7fc2f40f73e0 2022-02-02T13:36:11.522 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2f95f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f4109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:11.522 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2f95f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f4109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34224/0 (socket says 172.21.15.37:34224) 2022-02-02T13:36:11.522 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2f95f2700 1 -- 172.21.15.37:0/1028886740 learned_addr learned my addr 172.21.15.37:0/1028886740 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:36:11.522 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.517+0000 7fc2f9df3700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f4108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2f9df3700 1 -- 172.21.15.37:0/1028886740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 msgr2=0x7fc2f4109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2f9df3700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f4109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2f9df3700 1 -- 172.21.15.37:0/1028886740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4005040 con 0x7fc2f40f6a40 2022-02-02T13:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2f9df3700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f4108f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc2f405f320 tx=0x7fc2f000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f00092e0 con 0x7fc2f40f6a40 2022-02-02T13:36:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f410a4b0 con 0x7fc2f40f6a40 2022-02-02T13:36:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc2f000f040 con 0x7fc2f40f6a40 2022-02-02T13:36:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2f0014750 con 0x7fc2f40f6a40 2022-02-02T13:36:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.518+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f410aa70 con 0x7fc2f40f6a40 2022-02-02T13:36:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.519+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f4045ad0 con 0x7fc2f40f6a40 2022-02-02T13:36:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.520+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc2f001b030 con 0x7fc2f40f6a40 2022-02-02T13:36:11.526 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.520+0000 7fc2ea7fc700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 0x7fc2e005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.520+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3770+0+0 (secure 0 0 0) 0x7fc2f0075720 con 0x7fc2f40f6a40 2022-02-02T13:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.520+0000 7fc2f95f2700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 0x7fc2e005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.521+0000 7fc2f95f2700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 0x7fc2e005e7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc2e4004d80 tx=0x7fc2e4016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.525+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc2f0048a30 con 0x7fc2f40f6a40 2022-02-02T13:36:11.721 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:11.720+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2f40fb2a0 con 0x7fc2e005c300 2022-02-02T13:36:12.791 INFO:journalctl@ceph.osd.4.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[46970]: debug 2022-02-02T13:36:12.672+0000 7eff18a69700 -1 osd.4 0 waiting for initial osdmap 2022-02-02T13:36:12.791 INFO:journalctl@ceph.osd.4.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[46970]: debug 2022-02-02T13:36:12.681+0000 7eff119de700 -1 osd.4 31 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:36:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: cluster 2022-02-02T13:36 2022-02-02T13:36:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: :11.516165+0000 mgr.smithi033.xvkvzp (mgr.14164) 136 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.665838+0000 mon.smithi033 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T13:36:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: cluster 2022-02-02T13:36:11.665945+0000 mon.smithi033 (mon.0) 387 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-02-02T13:36:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.666107+0000 mon.smithi033 (mon.0) 388 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.666431+0000 mon.smithi037 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.666728+0000 mon.smithi033 (mon.0) 389 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:12.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.722543+0000 mgr.smithi033.xvkvzp (mgr.14164) 137 : audit [DBG] from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:36:12.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.723475+0000 mon.smithi033 (mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:36:12.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: cephadm 2022-02-02T13:36:11.725099+0000 mgr.smithi033.xvkvzp (mgr.14164) 138 : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:36:12.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.725355+0000 mon.smithi033 (mon.0) 391 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:36:12.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:11.726057+0000 mon.smithi033 (mon.0) 392 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:12.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:12 smithi037 conmon[35544]: audit 2022-02-02T13:36:12.141265+0000 mon.smithi033 (mon.0) 393 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: cluster 2022-02-02T13:36:11.516165+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:36:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 136 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02-02T13:36:11.665838+0000 mon.smithi033 (mon.0) 386 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-02-02T13:36:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: cluster 2022-02-02T13:36:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 2022-02-02T13:36:11.665945+0000 mon.smithi033 (mon.0) 387 2022-02-02T13:36:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-02-02T13:36:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:36:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: -02T13:36:11.666107+0000 2022-02-02T13:36:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: mon.smithi033 (mon.0) 388 : audit 2022-02-02T13:36:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:36:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 02-02T13:36:11 2022-02-02T13:36:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: .666431+0000 mon.smithi037 (mon.1) 9 2022-02-02T13:36:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: : audit [INF] from='osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 2022-02-02T13:36 2022-02-02T13:36:12.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: :11.666728+0000 mon.smithi033 ( 2022-02-02T13:36:12.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: mon.0) 389 : audit [INF] 2022-02-02T13:36:12.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:12.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 2022-02-02T13:36 2022-02-02T13:36:12.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: :11.722543+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:36:12.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: .14164) 137 : audit [DBG] from='client.14308 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:36:12.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 2022-02-02T13 2022-02-02T13:36:12.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: :36:11.723475+0000 mon.smithi033 ( 2022-02-02T13:36:12.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-02-02T13:36:12.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: cephadm 2022- 2022-02-02T13:36:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 02-02T13:36:11 2022-02-02T13:36:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: .725099+0000 mgr.smithi033.xvkvzp (mgr.14164) 138 2022-02-02T13:36:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: : cephadm [INF] Applying service osd.None on host smithi037... 2022-02-02T13:36:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 2022-02-02T13:36 2022-02-02T13:36:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: :11.725355+0000 mon.smithi033 (mon 2022-02-02T13:36:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: .0) 391 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-02-02T13:36:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:36:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 02-02T13:36: 2022-02-02T13:36:13.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 11.726057+0000 mon.smithi033 (mon.0) 2022-02-02T13:36:13.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 392 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:13.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:36:13.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 02-02T13:36: 2022-02-02T13:36:13.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 12.141265+0000 mon.smithi033 (mon.0) 2022-02-02T13:36:13.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:12 smithi033 conmon[31996]: 393 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:13 smithi037 conmon[35544]: audit 2022-02-02T13:36:12.667621+0000 2022-02-02T13:36:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:13 smithi037 conmon[35544]: mon.smithi033 (mon.0) 394 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:36:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:13 smithi037 conmon[35544]: cluster 2022-02-02T13:36:12.667731+0000 mon.smithi033 (mon.0) 395 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2022-02-02T13:36:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:13 smithi037 conmon[35544]: audit 2022-02-02T13:36:12.668171+0000 mon.smithi033 (mon.0) 396 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:13 smithi037 conmon[35544]: audit 2022-02-02T13:36:12.672313+0000 mon.smithi033 (mon.0) 397 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.667621+0000 mon.smithi033 (mon.0) 394 : audit 2022-02-02T13:36:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:36:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: cluster 2022-02-02T13:36:12.667731+0000 mon.smithi033 (mon.0) 395 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2022-02-02T13:36:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.668171+0000 mon.smithi033 (mon.0) 396 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:13.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: audit 2022-02-02T13:36:12.672313+0000 mon.smithi033 (mon 2022-02-02T13:36:13.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:13 smithi033 conmon[31996]: .0) 397 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:14.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13:36:12.162339+0000 osd.4 ( 2022-02-02T13:36:14.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:36:14.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13:36:12 2022-02-02T13:36:14.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: .162453+0000 osd.4 (osd.4) 2 : cluster [DBG] 2022-02-02T13:36:14.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: purged_snaps scrub ok 2022-02-02T13:36:14.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13:36:14.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36: 2022-02-02T13:36:14.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 13.516607+0000 mgr.smithi033.xvkvzp (mgr.14164) 139 : 2022-02-02T13:36:14.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster [DBG] pgmap v105: 1 pgs: 1 peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:14.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022 2022-02-02T13:36:14.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: -02-02T13:36:13.673253+0000 mon.smithi033 2022-02-02T13:36:14.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: (mon.0) 398 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:14.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:14.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13:36:14.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:13.678781+0000 mon.smithi033 2022-02-02T13:36:14.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: (mon.0) 399 : cluster [INF] osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] boot 2022-02-02T13:36:14.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13:36:14.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:13.678839 2022-02-02T13:36:14.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 400 : cluster [DBG] 2022-02-02T13:36:14.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: osdmap e32: 5 total, 5 up, 5 in 2022-02-02T13:36:14.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:36:14.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 36:13.679216+0000 mon.smithi033 (mon.0) 2022-02-02T13:36:14.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 401 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:14.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cephadm 2022- 2022-02-02T13:36:14.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 02-02T13:36:14.055453+0000 2022-02-02T13:36:14.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 140 : cephadm [INF] Detected new or changed devices on smithi037 2022-02-02T13:36:14.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:14.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:36:14.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 02T13:36:14.060686+0000 mon.smithi033 (mon 2022-02-02T13:36:14.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: .0) 402 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:14.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13:36:14.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13: 2022-02-02T13:36:14.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 36:14.065191+0000 mon.smithi033 (mon.0) 2022-02-02T13:36:15.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 403 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:15.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13:36:15.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36 2022-02-02T13:36:15.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: :14.068984+0000 mon.smithi033 (mon.0) 404 : audit 2022-02-02T13:36:15.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:15.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13:36:15.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:14. 2022-02-02T13:36:15.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 637828+0000 mon.smithi037 (mon.1) 10 : audit 2022-02-02T13:36:15.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: [INF] from='client.? 172.21.15.37:0/294517432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]: dispatch 2022-02-02T13:36:15.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13:36:15.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:14.638514+0000 2022-02-02T13:36:15.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: mon.smithi033 (mon.0) 405 : audit [INF] 2022-02-02T13:36:15.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]: dispatch 2022-02-02T13:36:15.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022-02-02T13:36:15.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:14.642138+0000 2022-02-02T13:36:15.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: mon.smithi033 (mon.0) 406 : audit [INF] 2022-02-02T13:36:15.003 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]': finished 2022-02-02T13:36:15.004 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: cluster 2022-02-02T13 2022-02-02T13:36:15.004 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: :36:14.642191+0000 mon.smithi033 (mon.0) 2022-02-02T13:36:15.004 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 407 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-02-02T13:36:15.004 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: audit 2022 2022-02-02T13:36:15.005 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: -02-02T13:36:14.642297+0000 2022-02-02T13:36:15.005 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: mon.smithi033 (mon.0) 408 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:15.005 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:14 smithi033 conmon[31996]: 2022-02-02T13:36:15.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:12.162339+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:36:15.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:12.162453+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:36:15.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:13.516607+0000 mgr.smithi033.xvkvzp (mgr.14164) 139 : cluster [DBG] pgmap v105: 1 pgs: 1 peering; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-02-02T13:36:15.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:13.673253+0000 mon.smithi033 (mon.0) 398 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:15.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:13.678781+0000 mon.smithi033 (mon.0) 399 : cluster [INF] osd.4 [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] boot 2022-02-02T13:36:15.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:13.678839+0000 mon.smithi033 (mon.0) 400 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2022-02-02T13:36:15.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:13.679216+0000 mon.smithi033 (mon.0) 401 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:36:15.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cephadm 2022-02-02T13:36:14.055453+0000 mgr.smithi033.xvkvzp (mgr.14164) 140 : cephadm [INF] Detected new or changed devices on smithi037 2022-02-02T13:36:15.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.060686+0000 mon.smithi033 (mon.0) 402 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:15.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.065191+0000 mon.smithi033 (mon.0) 403 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:15.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.068984+0000 mon.smithi033 (mon.0) 404 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:15.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.637828+0000 mon.smithi037 (mon.1) 10 : audit [INF] from='client.? 172.21.15.37:0/294517432' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]: dispatch 2022-02-02T13:36:15.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.638514+0000 mon.smithi033 (mon.0) 405 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]: dispatch 2022-02-02T13:36:15.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.642138+0000 mon.smithi033 (mon.0) 406 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ed2843c-5bba-4de8-b85a-1dc22383c429"}]': finished 2022-02-02T13:36:15.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: cluster 2022-02-02T13:36:14.642191+0000 mon.smithi033 (mon.0) 407 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-02-02T13:36:15.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:14 smithi037 conmon[35544]: audit 2022-02-02T13:36:14.642297+0000 mon.smithi033 (mon.0) 408 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:15.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:15 smithi033 conmon[31996]: audit 2022-02-02T13:36:15.069357+0000 2022-02-02T13:36:15.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:15 smithi033 conmon[31996]: mon.smithi037 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.37:0/2701395495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:36:16.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:15 smithi037 conmon[35544]: audit 2022-02-02T13:36:15.069357+0000 mon.smithi037 2022-02-02T13:36:16.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:15 smithi037 conmon[35544]: (mon.1) 11 : audit [DBG] from='client.? 172.21.15.37:0/2701395495' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-02-02T13:36:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:16 smithi033 conmon[31996]: cluster 2022-02-02T13:36:15. 2022-02-02T13:36:16.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:16 smithi033 conmon[31996]: 517005+0000 mgr.smithi033.xvkvzp (mgr.14164) 141 : cluster [DBG] pgmap v108: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:17.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:16 smithi037 conmon[35544]: cluster 2022-02-02T13:36:15.517005+0000 mgr.smithi033.xvkvzp (mgr.14164) 141 : cluster [DBG] pgmap v108: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:18 smithi037 conmon[35544]: cluster 2022-02-02T13:36:17.517337+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:36:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:18 smithi037 conmon[35544]: .14164) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:19.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:18 smithi037 conmon[35544]: audit 2022-02-02T13:36:18.804697+0000 mon.smithi033 (mon.0) 409 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: cluster 2022-02-02T13:36:17 2022-02-02T13:36:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: .517337+0000 mgr.smithi033.xvkvzp (mgr.14164) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:36:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: -02T13:36:18.804697+0000 mon.smithi033 (mon. 2022-02-02T13:36:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: 0) 409 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:18 smithi033 conmon[31996]: 2022-02-02T13:36:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:20 smithi037 conmon[35544]: audit 2022-02-02T13:36:19.176598+0000 mon.smithi033 (mon.0) 410 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:20 smithi033 conmon[31996]: audit 2022-02-02T13:36:19.176598+0000 mon.smithi033 (mon.0) 410 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:20 smithi033 conmon[31996]: 2022-02-02T13:36:21.449 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:21 smithi037 conmon[35544]: cluster 2022-02-02T13:36:19.517814 2022-02-02T13:36:21.449 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:21 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 143 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:21.450 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:21 smithi037 conmon[35544]: audit 2022-02-02T13:36:20.877815+0000 mon.smithi033 (mon.0) 411 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-02-02T13:36:21.450 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:21 smithi037 conmon[35544]: audit 2022-02-02T13:36:20.878864+0000 mon.smithi033 (mon.0) 412 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:21 smithi033 conmon[31996]: cluster 2022-02-02T13:36:19.517814+0000 mgr.smithi033.xvkvzp (mgr.14164) 143 2022-02-02T13:36:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:21 smithi033 conmon[31996]: : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:21 smithi033 conmon[31996]: audit 2022-02-02T13:36:20.877815+0000 mon.smithi033 (mon.0) 411 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-02-02T13:36:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:21 smithi033 conmon[31996]: audit 2022-02-02T13:36:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:21 smithi033 conmon[31996]: 2022-02-02T13:36:20.878864+0000 mon.smithi033 (mon.0) 412 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:36:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:22 smithi033 conmon[31996]: cephadm 2022-02-02T13:36:20.879685+0000 mgr.smithi033.xvkvzp (mgr.14164) 144 : cephadm 2022-02-02T13:36:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:22 smithi033 conmon[31996]: [INF] Deploying daemon osd.5 on smithi037 2022-02-02T13:36:22.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:22 smithi037 conmon[35544]: cephadm 2022-02-02T13:36:20.879685+0000 mgr.smithi033.xvkvzp (mgr.14164) 144 : cephadm [INF] Deploying daemon osd.5 on smithi037 2022-02-02T13:36:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:23 smithi037 conmon[35544]: cluster 2022-02-02T13:36:21.518126 2022-02-02T13:36:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:23 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 145 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:23 smithi033 conmon[31996]: cluster 2022-02-02T13:36:21.518126+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:36:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:23 smithi033 conmon[31996]: 14164) 145 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:23.813 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 5 on host 'smithi037' 2022-02-02T13:36:23.815 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.811+0000 7fc2ea7fc700 1 -- 172.21.15.37:0/1028886740 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc2f40fb2a0 con 0x7fc2e005c300 2022-02-02T13:36:23.815 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 msgr2=0x7fc2e005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:23.815 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 0x7fc2e005e7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fc2e4004d80 tx=0x7fc2e4016040).stop 2022-02-02T13:36:23.815 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 msgr2=0x7fc2f4108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f4108f30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fc2f405f320 tx=0x7fc2f000b040).stop 2022-02-02T13:36:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 shutdown_connections 2022-02-02T13:36:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc2e005c300 0x7fc2e005e7c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:23.816 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2f40f6a40 0x7fc2f4108f30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:23.817 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 --2- 172.21.15.37:0/1028886740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2f40f73e0 0x7fc2f4109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:23.817 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.813+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 >> 172.21.15.37:0/1028886740 conn(0x7fc2f40f0320 msgr2=0x7fc2f40f4720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:23.817 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.814+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 shutdown_connections 2022-02-02T13:36:23.817 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:23.814+0000 7fc2fadf5700 1 -- 172.21.15.37:0/1028886740 wait complete. 2022-02-02T13:36:24.163 DEBUG:teuthology.orchestra.run.smithi037:osd.5> sudo journalctl -f -n 0 -u ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.5.service 2022-02-02T13:36:24.166 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2022-02-02T13:36:24.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T13:36:24.198 INFO:journalctl@ceph.osd.5.smithi037.stdout:-- Logs begin at Wed 2022-02-02 13:23:17 UTC. -- 2022-02-02T13:36:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: audit 2022-02-02T13:36:23.800297+0000 mon.smithi033 (mon.0) 413 : audit [DBG] 2022-02-02T13:36:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: audit 2022-02-02T13:36:23.804906+0000 mon.smithi033 (mon.0) 414 : audit 2022-02-02T13:36:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:36:24.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: 02-02T13:36:23.810769+0000 mon.smithi033 (mon.0) 415 : audit [INF] 2022-02-02T13:36:24.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:24 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:24.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:24 smithi037 conmon[35544]: audit 2022-02-02T13:36:23.800297+0000 mon.smithi033 (mon.0) 413 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:24.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:24 smithi037 conmon[35544]: audit 2022-02-02T13:36:23.804906+0000 mon.smithi033 (mon.0) 414 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:24.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:24 smithi037 conmon[35544]: audit 2022-02-02T13:36:23.810769+0000 mon.smithi033 (mon.0) 415 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:24.542 INFO:journalctl@ceph.osd.5.smithi037.stdout:Feb 02 13:36:24 smithi037 conmon[51871]: debug 2022-02-02T13:36:24.235+0000 7fecb9c1e080 -1 Falling back to public interface 2022-02-02T13:36:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:25 smithi033 conmon[31996]: cluster 2022-02-02T13:36:23.518492+0000 mgr.smithi033.xvkvzp (mgr.14164) 146 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:25.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:25 smithi033 conmon[31996]: audit 2022-02-02T13:36:24.923354+0000 mon.smithi033 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:36:25.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:25 smithi033 conmon[31996]: audit 2022-02-02T13:36:24.926501+0000 mon.smithi033 (mon.0) 417 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:36:25.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:25 smithi037 conmon[35544]: cluster 2022-02-02T13:36:23.518492+0000 mgr.smithi033.xvkvzp (mgr.14164) 146 : 2022-02-02T13:36:25.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:25 smithi037 conmon[35544]: cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:25 smithi037 conmon[35544]: audit 2022-02-02T13:36:24.923354+0000 mon.smithi033 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:36:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:25 smithi037 conmon[35544]: audit 2022-02-02T13:36:24.926501+0000 mon.smithi033 (mon.0) 417 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.859+0000 7ff2932e5700 1 -- 172.21.15.33:0/3536136458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f6860 msgr2=0x7ff28c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.859+0000 7ff2932e5700 1 --2- 172.21.15.33:0/3536136458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f6860 0x7ff28c0f6cc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ff280004660 tx=0x7ff280009b30).stop 2022-02-02T13:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- 172.21.15.33:0/3536136458 shutdown_connections 2022-02-02T13:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 --2- 172.21.15.33:0/3536136458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f6860 0x7ff28c0f6cc0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 --2- 172.21.15.33:0/3536136458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f55c0 0x7ff28c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- 172.21.15.33:0/3536136458 >> 172.21.15.33:0/3536136458 conn(0x7ff28c0f0d40 msgr2=0x7ff28c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- 172.21.15.33:0/3536136458 shutdown_connections 2022-02-02T13:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- 172.21.15.33:0/3536136458 wait complete. 2022-02-02T13:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 Processor -- start 2022-02-02T13:36:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- start start 2022-02-02T13:36:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f55c0 0x7ff28c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0602d0 con 0x7ff28c0f55c0 2022-02-02T13:36:25.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.860+0000 7ff2932e5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c060410 con 0x7ff28c0f6860 2022-02-02T13:36:25.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:25.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:38590/0 (socket says 172.21.15.33:38590) 2022-02-02T13:36:25.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 -- 172.21.15.33:0/727167488 learned_addr learned my addr 172.21.15.33:0/727167488 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:25.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff291081700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f55c0 0x7ff28c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:25.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 -- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f55c0 msgr2=0x7ff28c10bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:25.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f55c0 0x7ff28c10bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:25.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 -- 172.21.15.33:0/727167488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280005040 con 0x7ff28c0f6860 2022-02-02T13:36:25.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff290880700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff280000c00 tx=0x7ff28000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff280019070 con 0x7ff28c0f6860 2022-02-02T13:36:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c10e9b0 con 0x7ff28c0f6860 2022-02-02T13:36:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7ff280007e50 con 0x7ff28c0f6860 2022-02-02T13:36:25.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.861+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff280014cd0 con 0x7ff28c0f6860 2022-02-02T13:36:25.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.862+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c10ed80 con 0x7ff28c0f6860 2022-02-02T13:36:25.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.863+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c045ad0 con 0x7ff28c0f6860 2022-02-02T13:36:25.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.863+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff280025070 con 0x7ff28c0f6860 2022-02-02T13:36:25.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.863+0000 7ff27dffb700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 0x7ff27805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:25.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.863+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7ff280076a00 con 0x7ff28c0f6860 2022-02-02T13:36:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.863+0000 7ff291081700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 0x7ff27805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.864+0000 7ff291081700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 0x7ff27805e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff28c060060 tx=0x7ff28800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:25.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:25.867+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff280049b60 con 0x7ff28c0f6860 2022-02-02T13:36:26.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.026+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff28c027a00 con 0x7ff28c0f6860 2022-02-02T13:36:26.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.026+0000 7ff27dffb700 1 -- 172.21.15.33:0/727167488 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v33) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff28004d180 con 0x7ff28c0f6860 2022-02-02T13:36:26.028 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:26.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 msgr2=0x7ff27805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:26.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 0x7ff27805e770 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff28c060060 tx=0x7ff28800b040).stop 2022-02-02T13:36:26.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 msgr2=0x7ff28c10e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:26.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ff280000c00 tx=0x7ff28000b040).stop 2022-02-02T13:36:26.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 shutdown_connections 2022-02-02T13:36:26.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff27805c2b0 0x7ff27805e770 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:26.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff28c0f55c0 0x7ff28c10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:26.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 --2- 172.21.15.33:0/727167488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff28c0f6860 0x7ff28c10e4c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:26.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 >> 172.21.15.33:0/727167488 conn(0x7ff28c0f0d40 msgr2=0x7ff28c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:26.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 shutdown_connections 2022-02-02T13:36:26.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:26.028+0000 7ff2932e5700 1 -- 172.21.15.33:0/727167488 wait complete. 2022-02-02T13:36:26.420 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"num_osds":6,"num_up_osds":5,"osd_up_since":1643808973,"num_in_osds":6,"osd_in_since":1643808974,"num_remapped_pgs":0} 2022-02-02T13:36:26.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:26 smithi033 conmon[31996]: audit 2022-02-02T13:36:26.028253+0000 mon.smithi037 (mon.1) 12 : audit 2022-02-02T13:36:26.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:26 smithi033 conmon[31996]: [DBG] from='client.? 172.21.15.33:0/727167488' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:26.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:26 smithi037 conmon[35544]: audit 2022-02-02T13:36:26.028253+0000 mon.smithi037 (mon.1 2022-02-02T13:36:26.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:26 smithi037 conmon[35544]: ) 12 : audit [DBG] from='client.? 172.21.15.33:0/727167488' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:27.422 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T13:36:27.739 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:27 smithi037 conmon[35544]: cluster 2022-02-02T13:36:25.518804+0000 mgr.smithi033.xvkvzp (mgr.14164) 147 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:27.740 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:27 smithi037 conmon[35544]: audit 2022-02-02T13:36:26.392419+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:27.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:27 smithi033 conmon[31996]: cluster 2022-02-02T13:36:25.518804+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:36:27.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:27 smithi033 conmon[31996]: ) 147 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:27.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:27 smithi033 conmon[31996]: audit 2022-02-02T13:36:26.392419+0000 mon.smithi033 (mon.0) 418 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:28.041 INFO:journalctl@ceph.osd.5.smithi037.stdout:Feb 02 13:36:27 smithi037 conmon[51871]: debug 2022-02-02T13:36:27.739+0000 7fecb9c1e080 -1 osd.5 0 log_to_monitors {default=true} 2022-02-02T13:36:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:28 smithi033 conmon[31996]: audit 2022-02-02T13:36:27.742854+0000 mon.smithi037 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T13:36:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:28 smithi033 conmon[31996]: audit 2022-02-02T13:36:27.743176+0000 mon.smithi033 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T13:36:28.706 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:28 smithi037 conmon[35544]: audit 2022-02-02T13:36:27. 2022-02-02T13:36:28.706 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:28 smithi037 conmon[35544]: 742854+0000 mon.smithi037 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T13:36:28.707 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:28 smithi037 conmon[35544]: audit 2022-02-02T13:36:27.743176+0000 mon.smithi033 (mon.0) 419 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-02-02T13:36:29.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.125+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/4033661940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 msgr2=0x7f9d680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:29.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.125+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/4033661940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d680f6cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f9d5c004660 tx=0x7f9d5c009b30).stop 2022-02-02T13:36:29.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/4033661940 shutdown_connections 2022-02-02T13:36:29.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/4033661940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d680f6cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/4033661940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 0x7f9d680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/4033661940 >> 172.21.15.33:0/4033661940 conn(0x7f9d680f0d40 msgr2=0x7f9d680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/4033661940 shutdown_connections 2022-02-02T13:36:29.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/4033661940 wait complete. 2022-02-02T13:36:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 Processor -- start 2022-02-02T13:36:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- start start 2022-02-02T13:36:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 0x7f9d68109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:29.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d68060470 con 0x7f9d680f6860 2022-02-02T13:36:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.126+0000 7f9d6f6d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680605b0 con 0x7f9d680f55c0 2022-02-02T13:36:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56116/0 (socket says 172.21.15.33:56116) 2022-02-02T13:36:29.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6d46f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 0x7f9d68109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 -- 172.21.15.33:0/3671891316 learned_addr learned my addr 172.21.15.33:0/3671891316 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 -- 172.21.15.33:0/3671891316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 msgr2=0x7f9d68109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 0x7f9d68109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:29.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 -- 172.21.15.33:0/3671891316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c005040 con 0x7f9d680f6860 2022-02-02T13:36:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6cc6e700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9d5c009990 tx=0x7f9d5c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5c018070 con 0x7f9d680f6860 2022-02-02T13:36:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9d5c013410 con 0x7f9d680f6860 2022-02-02T13:36:29.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6810c7b0 con 0x7f9d680f6860 2022-02-02T13:36:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.127+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5c01c3c0 con 0x7f9d680f6860 2022-02-02T13:36:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.128+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6810cce0 con 0x7f9d680f6860 2022-02-02T13:36:29.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.128+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d68045ad0 con 0x7f9d680f6860 2022-02-02T13:36:29.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.129+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9d5c01d420 con 0x7f9d680f6860 2022-02-02T13:36:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.130+0000 7f9d59ffb700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 0x7f9d5405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.130+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4223+0+0 (secure 0 0 0) 0x7f9d5c0779c0 con 0x7f9d680f6860 2022-02-02T13:36:29.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.130+0000 7f9d6d46f700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 0x7f9d5405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.130+0000 7f9d6d46f700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 0x7f9d5405e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9d68060060 tx=0x7f9d64008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:29.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.133+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9d5c04ac00 con 0x7f9d680f6860 2022-02-02T13:36:29.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.290+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9d68027a00 con 0x7f9d680f6860 2022-02-02T13:36:29.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.290+0000 7f9d59ffb700 1 -- 172.21.15.33:0/3671891316 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) v1 ==== 74+0+130 (secure 0 0 0) 0x7f9d5c04e220 con 0x7f9d680f6860 2022-02-02T13:36:29.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:29.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 msgr2=0x7f9d5405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 0x7f9d5405e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9d68060060 tx=0x7f9d64008040).stop 2022-02-02T13:36:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 msgr2=0x7f9d6810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:29.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f9d5c009990 tx=0x7f9d5c009b30).stop 2022-02-02T13:36:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 shutdown_connections 2022-02-02T13:36:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9d5405c2b0 0x7f9d5405e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d680f55c0 0x7f9d68109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:29.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 --2- 172.21.15.33:0/3671891316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d680f6860 0x7f9d6810c1b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 >> 172.21.15.33:0/3671891316 conn(0x7f9d680f0d40 msgr2=0x7f9d680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 shutdown_connections 2022-02-02T13:36:29.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:29.292+0000 7f9d6f6d3700 1 -- 172.21.15.33:0/3671891316 wait complete. 2022-02-02T13:36:29.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:36:29.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: 36:27.519170+0000 mgr.smithi033.xvkvzp (mgr.14164) 148 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:29.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: audit 2022-02-02T13:36:28.399144+0000 mon.smithi033 (mon.0) 420 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T13:36:29.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: cluster 2022-02-02T13:36:28.399195+0000 mon.smithi033 (mon.0) 421 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-02-02T13:36:29.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: audit 2022-02-02T13:36:28.399319+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:29.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: audit 2022-02-02T13:36:28.402867+0000 mon.smithi037 (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:29.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: audit 2022-02-02T13:36:28.403258+0000 mon.smithi033 (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:29.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:29 smithi033 conmon[31996]: audit 2022-02-02T13:36:29.292475+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='client.? 172.21.15.33:0/3671891316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:29.668 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1643808973,"num_in_osds":6,"osd_in_since":1643808974,"num_remapped_pgs":0} 2022-02-02T13:36:29.791 INFO:journalctl@ceph.osd.5.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[51871]: debug 2022-02-02T13:36:29.405+0000 7fecb018f700 -1 osd.5 0 waiting for initial osdmap 2022-02-02T13:36:29.791 INFO:journalctl@ceph.osd.5.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[51871]: debug 2022-02-02T13:36:29.414+0000 7fecac90b700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2022-02-02T13:36:29.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: cluster 2022-02-02T13:36:27.519170+0000 mgr.smithi033.xvkvzp (mgr.14164) 148 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:29.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: audit 2022-02-02T13:36:28.399144+0000 mon.smithi033 (mon.0) 420 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-02-02T13:36:29.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: cluster 2022-02-02T13:36:28.399195+0000 mon.smithi033 (mon.0) 421 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-02-02T13:36:29.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: audit 2022-02-02T13:36:28.399319+0000 mon.smithi033 (mon.0) 422 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:29.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: audit 2022-02-02T13:36:28.402867+0000 mon.smithi037 (mon.1) 14 : audit [INF] from='osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:29.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: audit 2022-02-02T13:36:28.403258+0000 mon.smithi033 (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2022-02-02T13:36:29.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:29 smithi037 conmon[35544]: audit 2022-02-02T13:36:29.292475+0000 mon.smithi033 (mon.0) 424 : audit [DBG] from='client.? 172.21.15.33:0/3671891316' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:30.670 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-02-02T13:36:30.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:29.400060+0000 mon.smithi033 (mon.0) 425 : audit 2022-02-02T13:36:30.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:36:30.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: cluster 2022-02-02T13:36:29.400142+0000 mon.smithi033 (mon.0) 426 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-02-02T13:36:30.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:29.400471+0000 mon.smithi033 (mon.0) 427 : audit [DBG] 2022-02-02T13:36:30.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:30.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:29.405616+0000 mon.smithi033 2022-02-02T13:36:30.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: (mon.0) 428 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:30.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: cephadm 2022-02 2022-02-02T13:36:30.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: -02T13:36:29.422184+0000 mgr.smithi033.xvkvzp 2022-02-02T13:36:30.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: (mgr.14164) 149 : cephadm [INF] Detected new or changed devices on smithi037 2022-02-02T13:36:30.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:30.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:29.426017+0000 2022-02-02T13:36:30.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: mon.smithi033 (mon.0) 429 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:30.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:30.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:29.797671+0000 mon.smithi033 2022-02-02T13:36:30.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: (mon.0) 430 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:30.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:30.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: 2022-02-02T13:36:29.800840+0000 mon.smithi033 ( 2022-02-02T13:36:30.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: mon.0) 431 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:30.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: audit 2022 2022-02-02T13:36:30.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: -02-02T13:36:29.804999 2022-02-02T13:36:30.710 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 432 : audit 2022-02-02T13:36:30.710 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:30 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:30.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13:36:29.400060+0000 mon.smithi033 (mon.0 2022-02-02T13:36:30.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: ) 425 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2022-02-02T13:36:30.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: cluster 2022-02-02T13:36:29.400142+0000 mon.smithi033 (mon.0) 426 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-02-02T13:36:30.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13:36:29.400471+0000 mon.smithi033 (mon.0) 427 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:30.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13:36:29.405616+0000 mon.smithi033 (mon.0) 428 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:30.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: cephadm 2022-02-02T13:36:29 2022-02-02T13:36:30.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: .422184+0000 mgr.smithi033.xvkvzp (mgr.14164) 149 : cephadm [INF] Detected new or changed devices on smithi037 2022-02-02T13:36:30.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13:36:29.426017+0000 mon.smithi033 (mon.0) 429 : audit 2022-02-02T13:36:30.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:30.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022 2022-02-02T13:36:30.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: -02-02T13:36:29.797671+0000 mon.smithi033 (mon.0) 430 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:30.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:36:30.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: 36:29.800840+0000 mon.smithi033 (mon.0) 431 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:36:30.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:36:30.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:30 smithi037 conmon[35544]: 36:29.804999+0000 mon.smithi033 (mon.0) 432 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:36:31.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: cluster 2022-02-02T13:36:28.775849+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:36:31.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: cluster 2022-02-02T13:36:28.775955+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:36:31.423 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: cluster 2022-02-02T13:36:29.519616+0000 mgr.smithi033.xvkvzp (mgr.14164) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:31.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.404135+0000 mon.smithi033 (mon.0) 433 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:31.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: cluster 2022-02-02T13:36:30.428787+0000 mon.smithi033 (mon.0) 434 : cluster [INF] osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] boot 2022-02-02T13:36:31.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: cluster 2022-02-02T13:36:30.428853+0000 mon.smithi033 (mon.0) 435 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-02-02T13:36:31.424 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: audit 2022-02-02T13:36:30.429286+0000 mon.smithi033 (mon.0 2022-02-02T13:36:31.425 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:31 smithi033 conmon[31996]: ) 436 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: cluster 2022-02-02T13:36:28.775849+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-02-02T13:36:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: cluster 2022-02-02T13:36:28.775955+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-02-02T13:36:31.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: cluster 2022-02-02T13:36:29.519616+0000 2022-02-02T13:36:31.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-02-02T13:36:31.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:36:31.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: 13:36:30.404135+0000 mon.smithi033 (mon 2022-02-02T13:36:31.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: .0) 433 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:31.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:36:31.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: 02-02T13:36:30.428787+0000 2022-02-02T13:36:31.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: mon.smithi033 (mon.0) 434 : cluster [INF] 2022-02-02T13:36:31.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: osd.5 [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] boot 2022-02-02T13:36:31.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:36:31.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: 36:30.428853+0000 mon.smithi033 (mon.0 2022-02-02T13:36:31.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: ) 435 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-02-02T13:36:31.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: audit 2022 2022-02-02T13:36:31.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: -02-02T13:36:30.429286+0000 mon.smithi033 (mon.0) 436 : audit [DBG] 2022-02-02T13:36:31.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:31 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:36:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 -- 172.21.15.33:0/2706059463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f6860 msgr2=0x7f85d00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/2706059463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f6860 0x7f85d00f6cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f85c0004660 tx=0x7f85c0009b30).stop 2022-02-02T13:36:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 -- 172.21.15.33:0/2706059463 shutdown_connections 2022-02-02T13:36:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/2706059463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f6860 0x7f85d00f6cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/2706059463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f55c0 0x7f85d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 -- 172.21.15.33:0/2706059463 >> 172.21.15.33:0/2706059463 conn(0x7f85d00f0d40 msgr2=0x7f85d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 -- 172.21.15.33:0/2706059463 shutdown_connections 2022-02-02T13:36:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.387+0000 7f85d5b1b700 1 -- 172.21.15.33:0/2706059463 wait complete. 2022-02-02T13:36:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 Processor -- start 2022-02-02T13:36:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 -- start start 2022-02-02T13:36:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 0x7f85d010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00602b0 con 0x7f85d00f55c0 2022-02-02T13:36:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85d5b1b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00603f0 con 0x7f85d00f6860 2022-02-02T13:36:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56130/0 (socket says 172.21.15.33:56130) 2022-02-02T13:36:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 -- 172.21.15.33:0/3094476632 learned_addr learned my addr 172.21.15.33:0/3094476632 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85ceffd700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 0x7f85d010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 -- 172.21.15.33:0/3094476632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 msgr2=0x7f85d010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 0x7f85d010e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85cf7fe700 1 -- 172.21.15.33:0/3094476632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0005040 con 0x7f85d00f55c0 2022-02-02T13:36:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.388+0000 7f85ceffd700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 0x7f85d010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:36:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85cf7fe700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f85b800c510 tx=0x7f85b8007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b800f650 con 0x7f85d00f55c0 2022-02-02T13:36:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d010ea70 con 0x7f85d00f55c0 2022-02-02T13:36:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f85b800fc40 con 0x7f85d00f55c0 2022-02-02T13:36:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85b8012c20 con 0x7f85d00f55c0 2022-02-02T13:36:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.389+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d010eef0 con 0x7f85d00f55c0 2022-02-02T13:36:32.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.390+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0045ad0 con 0x7f85d00f55c0 2022-02-02T13:36:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.390+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f85b8010070 con 0x7f85d00f55c0 2022-02-02T13:36:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.391+0000 7f85c7fff700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 0x7f85bc05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.391+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f85b8075590 con 0x7f85d00f55c0 2022-02-02T13:36:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.391+0000 7f85ceffd700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 0x7f85bc05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.391+0000 7f85ceffd700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 0x7f85bc05e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f85c0004e30 tx=0x7f85c0009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.395+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f85b80452b0 con 0x7f85d00f55c0 2022-02-02T13:36:32.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.554+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f85d0027a00 con 0x7f85d00f55c0 2022-02-02T13:36:32.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.555+0000 7f85c7fff700 1 -- 172.21.15.33:0/3094476632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7f85b8017070 con 0x7f85d00f55c0 2022-02-02T13:36:32.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:32.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 msgr2=0x7f85bc05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:32.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 0x7f85bc05e770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f85c0004e30 tx=0x7f85c0009b30).stop 2022-02-02T13:36:32.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 msgr2=0x7f85d010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:32.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f85b800c510 tx=0x7f85b8007df0).stop 2022-02-02T13:36:32.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 shutdown_connections 2022-02-02T13:36:32.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f85bc05c2b0 0x7f85bc05e770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85d00f55c0 0x7f85d010c080 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 --2- 172.21.15.33:0/3094476632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85d00f6860 0x7f85d010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:32.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.556+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 >> 172.21.15.33:0/3094476632 conn(0x7f85d00f0d40 msgr2=0x7f85d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:32.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.557+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 shutdown_connections 2022-02-02T13:36:32.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:32.557+0000 7f85d5b1b700 1 -- 172.21.15.33:0/3094476632 wait complete. 2022-02-02T13:36:32.726 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:32 smithi033 conmon[31996]: cluster 2022-02-02T13:36:31.437892+0000 mon.smithi033 (mon.0) 437 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-02-02T13:36:32.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:32 smithi037 conmon[35544]: cluster 2022-02-02T13:36:31.437892+0000 mon.smithi033 (mon.0) 437 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-02-02T13:36:33.015 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1643808990,"num_in_osds":6,"osd_in_since":1643808974,"num_remapped_pgs":0} 2022-02-02T13:36:33.016 INFO:tasks.cephadm:Setting up client nodes... 2022-02-02T13:36:33.016 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-02-02T13:36:33.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:33 smithi033 conmon[31996]: cluster 2022-02-02T13:36:31.519949+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:36:33.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:33 smithi033 conmon[31996]: mgr.14164) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:33.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:33 smithi033 conmon[31996]: audit 2022-02-02T13:36:32.556965+0000 mon.smithi033 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.33:0/3094476632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:33.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:33 smithi037 conmon[35544]: cluster 2022-02-02T13:36:31.519949+0000 mgr.smithi033.xvkvzp (mgr.14164) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:33.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:33 smithi037 conmon[35544]: audit 2022-02-02T13:36:32.556965+0000 mon.smithi033 (mon.0) 438 : audit [DBG] from='client.? 172.21.15.33:0/3094476632' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-02-02T13:36:34.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 -- 172.21.15.33:0/270818949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f5460 msgr2=0x7fb6480f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:34.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/270818949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f5460 0x7fb6480f5880 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fb63c004660 tx=0x7fb63c009b30).stop 2022-02-02T13:36:34.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 -- 172.21.15.33:0/270818949 shutdown_connections 2022-02-02T13:36:34.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/270818949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f6700 0x7fb6480f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/270818949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f5460 0x7fb6480f5880 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 -- 172.21.15.33:0/270818949 >> 172.21.15.33:0/270818949 conn(0x7fb6480f0bc0 msgr2=0x7fb6480f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 -- 172.21.15.33:0/270818949 shutdown_connections 2022-02-02T13:36:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.769+0000 7fb64d9bd700 1 -- 172.21.15.33:0/270818949 wait complete. 2022-02-02T13:36:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 Processor -- start 2022-02-02T13:36:34.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 -- start start 2022-02-02T13:36:34.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f5460 0x7fb648106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:34.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6481079a0 con 0x7fb6480f6700 2022-02-02T13:36:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.770+0000 7fb64d9bd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648108120 con 0x7fb6480f5460 2022-02-02T13:36:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:34.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56148/0 (socket says 172.21.15.33:56148) 2022-02-02T13:36:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb646ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f5460 0x7fb648106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 -- 172.21.15.33:0/3515840400 learned_addr learned my addr 172.21.15.33:0/3515840400 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:34.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 -- 172.21.15.33:0/3515840400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f5460 msgr2=0x7fb648106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f5460 0x7fb648106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:34.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 -- 172.21.15.33:0/3515840400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c005040 con 0x7fb6480f6700 2022-02-02T13:36:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb6467fc700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb63800b410 tx=0x7fb638006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6380125f0 con 0x7fb6480f6700 2022-02-02T13:36:34.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb63800be30 con 0x7fb6480f6700 2022-02-02T13:36:34.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6481083a0 con 0x7fb6480f6700 2022-02-02T13:36:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb638002a00 con 0x7fb6480f6700 2022-02-02T13:36:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.771+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb648108960 con 0x7fb6480f6700 2022-02-02T13:36:34.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.772+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb648045ad0 con 0x7fb6480f6700 2022-02-02T13:36:34.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.773+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb63800f030 con 0x7fb6480f6700 2022-02-02T13:36:34.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.773+0000 7fb62f7fe700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 0x7fb63005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:34.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.774+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fb638075f40 con 0x7fb6480f6700 2022-02-02T13:36:34.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.775+0000 7fb646ffd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 0x7fb63005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.775+0000 7fb646ffd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 0x7fb63005e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb63c013620 tx=0x7fb63c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:34.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.778+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb638048fe0 con 0x7fb6480f6700 2022-02-02T13:36:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.993+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb64810d360 con 0x7fb6480f6700 2022-02-02T13:36:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.997+0000 7fb62f7fe700 1 -- 172.21.15.33:0/3515840400 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb63804c600 con 0x7fb6480f6700 2022-02-02T13:36:34.998 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2022-02-02T13:36:34.998 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQDiiPphGnJKOxAAv8j9S6Or8cMZwyNolsT50w== 2022-02-02T13:36:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 msgr2=0x7fb63005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:35.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 0x7fb63005e7c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fb63c013620 tx=0x7fb63c009b30).stop 2022-02-02T13:36:35.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 msgr2=0x7fb648107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:35.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb63800b410 tx=0x7fb638006ef0).stop 2022-02-02T13:36:35.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 shutdown_connections 2022-02-02T13:36:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb63005c300 0x7fb63005e7c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6480f5460 0x7fb648106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:35.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 --2- 172.21.15.33:0/3515840400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480f6700 0x7fb648107310 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 >> 172.21.15.33:0/3515840400 conn(0x7fb6480f0bc0 msgr2=0x7fb64805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 shutdown_connections 2022-02-02T13:36:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:34.998+0000 7fb64d9bd700 1 -- 172.21.15.33:0/3515840400 wait complete. 2022-02-02T13:36:35.372 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:36:35.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2022-02-02T13:36:35.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-02-02T13:36:35.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-02-02T13:36:35.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:35 smithi033 conmon[31996]: cluster 2022-02-02T13:36:33.520306+0000 mgr.smithi033.xvkvzp (mgr.14164) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:35 smithi033 conmon[31996]: audit 2022-02-02T13:36:34.994575+0000 mon.smithi033 (mon.0) 439 : audit [INF] from='client.? 172.21.15.33:0/3515840400' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:35 smithi033 conmon[31996]: audit 2022-02-02T13:36:34.997675+0000 mon.smithi033 (mon.0) 440 : audit [INF] from='client.? 172.21.15.33:0/3515840400' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T13:36:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:35 smithi037 conmon[35544]: cluster 2022-02-02T13:36:33.520306+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:36:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:35 smithi037 conmon[35544]: ) 152 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:35 smithi037 conmon[35544]: audit 2022-02-02T13:36:34.994575+0000 mon.smithi033 (mon.0) 439 : audit [INF] from='client.? 172.21.15.33:0/3515840400' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:35.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:35 smithi037 conmon[35544]: audit 2022-02-02T13:36:34.997675+0000 mon.smithi033 (mon.0) 440 : audit [INF] from='client.? 172.21.15.33:0/3515840400' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T13:36:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 -- 172.21.15.37:0/2438591209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f7980 msgr2=0x7f5f2c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/2438591209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c0f7de0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f5f14004660 tx=0x7f5f14009b30).stop 2022-02-02T13:36:36.891 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 -- 172.21.15.37:0/2438591209 shutdown_connections 2022-02-02T13:36:36.892 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/2438591209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c0f7de0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:36.892 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/2438591209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:36.892 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 -- 172.21.15.37:0/2438591209 >> 172.21.15.37:0/2438591209 conn(0x7f5f2c0f1e40 msgr2=0x7f5f2c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:36.892 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 -- 172.21.15.37:0/2438591209 shutdown_connections 2022-02-02T13:36:36.893 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 -- 172.21.15.37:0/2438591209 wait complete. 2022-02-02T13:36:36.895 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.891+0000 7f5f31ae1700 1 Processor -- start 2022-02-02T13:36:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f31ae1700 1 -- start start 2022-02-02T13:36:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f31ae1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f31ae1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:36.896 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f31ae1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c107a20 con 0x7f5f2c0f7980 2022-02-02T13:36:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f31ae1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c107b60 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34344/0 (socket says 172.21.15.37:34344) 2022-02-02T13:36:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 -- 172.21.15.37:0/1813208016 learned_addr learned my addr 172.21.15.37:0/1813208016 (peer_addr_for_me v2:172.21.15.37:0/0) 2022-02-02T13:36:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2affd700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 -- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f7980 msgr2=0x7f5f2c107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:36.898 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.892+0000 7f5f2b7fe700 1 -- 172.21.15.37:0/1813208016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f14005040 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f2b7fe700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5f1c002700 tx=0x7f5f1c009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c0079c0 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c108500 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5f1c00f040 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c014860 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.893+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c108ac0 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.900 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.894+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c045ad0 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.894+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5f1c01b060 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.895+0000 7f5f23fff700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 0x7f5f1805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.895+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f5f1c075a10 con 0x7f5f2c0f66e0 2022-02-02T13:36:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.895+0000 7f5f2affd700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 0x7f5f1805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.895+0000 7f5f2affd700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 0x7f5f1805e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5f14005010 tx=0x7f5f14009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:36.899+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5f1c048a30 con 0x7f5f2c0f66e0 2022-02-02T13:36:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.116+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5f2c0ff020 con 0x7f5f2c0f66e0 2022-02-02T13:36:37.122 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.122+0000 7f5f23fff700 1 -- 172.21.15.37:0/1813208016 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5f1c04c050 con 0x7f5f2c0f66e0 2022-02-02T13:36:37.123 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2022-02-02T13:36:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDliPph/pIABxAAIZjcYbelO84G4Bv/J3w8vA== 2022-02-02T13:36:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 msgr2=0x7f5f1805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 0x7f5f1805e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5f14005010 tx=0x7f5f14009b30).stop 2022-02-02T13:36:37.126 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 msgr2=0x7f5f2c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f5f1c002700 tx=0x7f5f1c009d80).stop 2022-02-02T13:36:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 shutdown_connections 2022-02-02T13:36:37.127 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f1805c2b0 0x7f5f1805e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f2c0f66e0 0x7f5f2c106f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 --2- 172.21.15.37:0/1813208016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f2c0f7980 0x7f5f2c107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 >> 172.21.15.37:0/1813208016 conn(0x7f5f2c0f1e40 msgr2=0x7f5f2c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 shutdown_connections 2022-02-02T13:36:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2022-02-02T13:36:37.124+0000 7f5f31ae1700 1 -- 172.21.15.37:0/1813208016 wait complete. 2022-02-02T13:36:37.457 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:36:37.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2022-02-02T13:36:37.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-02-02T13:36:37.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T13:36:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: cluster 2022-02-02T13:36:35.520683+0000 mgr.smithi033.xvkvzp (mgr.14164) 153 : 2022-02-02T13:36:37.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:37.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: audit 2022-02-02T13:36:37.116841+0000 mon.smithi037 (mon.1) 15 : audit [INF] from='client.? 172.21.15.37:0/1813208016' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:37.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:36:37.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: 13:36:37.117253+0000 mon.smithi033 (mon.0) 441 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:37.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:36:37.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: 02T13:36:37.122765+0000 mon.smithi033 (mon.0) 442 : audit [INF] 2022-02-02T13:36:37.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:37 smithi033 conmon[31996]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T13:36:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:37 smithi037 conmon[35544]: cluster 2022-02-02T13:36:35.520683+0000 mgr.smithi033.xvkvzp (mgr.14164) 153 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:37 smithi037 conmon[35544]: audit 2022-02-02T13:36:37.116841+0000 mon.smithi037 (mon.1) 15 : audit [INF] from='client.? 172.21.15.37:0/1813208016' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:37 smithi037 conmon[35544]: audit 2022-02-02T13:36:37.117253+0000 mon.smithi033 (mon.0) 441 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-02-02T13:36:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:37 smithi037 conmon[35544]: audit 2022-02-02T13:36:37.122765+0000 mon.smithi033 (mon.0) 442 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-02-02T13:36:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 -- 172.21.15.33:0/2937629629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 msgr2=0x7faa400f5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 --2- 172.21.15.33:0/2937629629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa400f5ae0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7faa30004660 tx=0x7faa30009b30).stop 2022-02-02T13:36:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 -- 172.21.15.33:0/2937629629 shutdown_connections 2022-02-02T13:36:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 --2- 172.21.15.33:0/2937629629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa400f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 --2- 172.21.15.33:0/2937629629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa400f5ae0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 -- 172.21.15.33:0/2937629629 >> 172.21.15.33:0/2937629629 conn(0x7faa400f0e20 msgr2=0x7faa400f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 -- 172.21.15.33:0/2937629629 shutdown_connections 2022-02-02T13:36:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.149+0000 7faa45511700 1 -- 172.21.15.33:0/2937629629 wait complete. 2022-02-02T13:36:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 Processor -- start 2022-02-02T13:36:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 -- start start 2022-02-02T13:36:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:39.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa4010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40060810 con 0x7faa400f56c0 2022-02-02T13:36:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa45511700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40060950 con 0x7faa400f6960 2022-02-02T13:36:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:39.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56154/0 (socket says 172.21.15.33:56154) 2022-02-02T13:36:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.150+0000 7faa3effd700 1 -- 172.21.15.33:0/2691000864 learned_addr learned my addr 172.21.15.33:0/2691000864 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3e7fc700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa4010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3effd700 1 -- 172.21.15.33:0/2691000864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 msgr2=0x7faa4010e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3effd700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa4010e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3effd700 1 -- 172.21.15.33:0/2691000864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30005040 con 0x7faa400f56c0 2022-02-02T13:36:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3e7fc700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa4010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:36:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa3effd700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7faa30004e30 tx=0x7faa30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa30018070 con 0x7faa400f56c0 2022-02-02T13:36:39.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7faa30013410 con 0x7faa400f56c0 2022-02-02T13:36:39.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4010ebc0 con 0x7faa400f56c0 2022-02-02T13:36:39.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa4010ef90 con 0x7faa400f56c0 2022-02-02T13:36:39.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.151+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa3001c3c0 con 0x7faa400f56c0 2022-02-02T13:36:39.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.152+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa20004fa0 con 0x7faa400f56c0 2022-02-02T13:36:39.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.153+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7faa3001d420 con 0x7faa400f56c0 2022-02-02T13:36:39.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.153+0000 7faa277fe700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 0x7faa2805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:39.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.153+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7faa300777b0 con 0x7faa400f56c0 2022-02-02T13:36:39.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.153+0000 7faa3e7fc700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 0x7faa2805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:39.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.154+0000 7faa3e7fc700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 0x7faa2805e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faa34009fd0 tx=0x7faa3400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:39.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.157+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faa3004a850 con 0x7faa400f56c0 2022-02-02T13:36:39.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.315+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa20005670 con 0x7faa400f56c0 2022-02-02T13:36:39.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.315+0000 7faa277fe700 1 -- 172.21.15.33:0/2691000864 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10837 (secure 0 0 0) 0x7faa3001d6b0 con 0x7faa400f56c0 2022-02-02T13:36:39.316 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:39.316 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","created":"2022-02-02T13:32:17.154681+0000","modified":"2022-02-02T13:36:31.429885+0000","last_up_change":"2022-02-02T13:36:30.424546+0000","last_in_change":"2022-02-02T13:36:14.639029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T13:35:51.198783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"eaa79e13-f217-4edf-af55-0441c3f0542e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6803","nonce":3011410766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6805","nonce":3011410766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6809","nonce":3011410766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6807","nonce":3011410766}]},"public_addr":"172.21.15.33:6803/3011410766","cluster_addr":"172.21.15.33:6805/3011410766","heartbeat_back_addr":"172.21.15.33:6809/3011410766","heartbeat_front_addr":"172.21.15.33:6807/3011410766","state":["exists","up"]},{"osd":1,"uuid":"3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6811","nonce":610736519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6813","nonce":610736519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6817","nonce":610736519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6815","nonce":610736519}]},"public_addr":"172.21.15.33:6811/610736519","cluster_addr":"172.21.15.33:6813/610736519","heartbeat_back_addr":"172.21.15.33:6817/610736519","heartbeat_front_addr":"172.21.15.33:6815/610736519","state":["exists","up"]},{"osd":2,"uuid":"f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6819","nonce":2877179379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6821","nonce":2877179379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6825","nonce":2877179379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6823","nonce":2877179379}]},"public_addr":"172.21.15.33:6819/2877179379","cluster_addr":"172.21.15.33:6821/2877179379","heartbeat_back_addr":"172.21.15.33:6825/2877179379","heartbeat_front_addr":"172.21.15.33:6823/2877179379","state":["exists","up"]},{"osd":3,"uuid":"b9b6adbb-241e-4118-bd0e-81a4270ae5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6801","nonce":222406804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6803","nonce":222406804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6807","nonce":222406804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6805","nonce":222406804}]},"public_addr":"172.21.15.37:6801/222406804","cluster_addr":"172.21.15.37:6803/222406804","heartbeat_back_addr":"172.21.15.37:6807/222406804","heartbeat_front_addr":"172.21.15.37:6805/222406804","state":["exists","up"]},{"osd":4,"uuid":"5805195f-9663-47d0-8a38-153c13fdf8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6809","nonce":2153304138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6811","nonce":2153304138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6815","nonce":2153304138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6813","nonce":2153304138}]},"public_addr":"172.21.15.37:6809/2153304138","cluster_addr":"172.21.15.37:6811/2153304138","heartbeat_back_addr":"172.21.15.37:6815/2153304138","heartbeat_front_addr":"172.21.15.37:6813/2153304138","state":["exists","up"]},{"osd":5,"uuid":"8ed2843c-5bba-4de8-b85a-1dc22383c429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6817","nonce":2797204966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6819","nonce":2797204966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6823","nonce":2797204966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6821","nonce":2797204966}]},"public_addr":"172.21.15.37:6817/2797204966","cluster_addr":"172.21.15.37:6819/2797204966","heartbeat_back_addr":"172.21.15.37:6823/2797204966","heartbeat_front_addr":"172.21.15.37:6821/2797204966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:04.086489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:23.087132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:40.382065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:55.650901+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:12.162455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:28.775958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2749807665":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/16578411":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/2202031572":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/2474768824":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6800/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/236147922":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/302733905":"2022-02-03T13:32:46.589804+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T13:36:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 msgr2=0x7faa2805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 0x7faa2805e760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7faa34009fd0 tx=0x7faa3400b040).stop 2022-02-02T13:36:39.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 msgr2=0x7faa4010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:39.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7faa30004e30 tx=0x7faa30009b30).stop 2022-02-02T13:36:39.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 shutdown_connections 2022-02-02T13:36:39.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7faa2805c2a0 0x7faa2805e760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa400f56c0 0x7faa4010c1d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 --2- 172.21.15.33:0/2691000864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa400f6960 0x7faa4010e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:39.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 >> 172.21.15.33:0/2691000864 conn(0x7faa400f0e20 msgr2=0x7faa400fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:39.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 shutdown_connections 2022-02-02T13:36:39.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:39.317+0000 7faa45511700 1 -- 172.21.15.33:0/2691000864 wait complete. 2022-02-02T13:36:39.609 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:39 smithi033 conmon[31996]: cluster 2022-02-02T13:36:37.521062+0000 mgr.smithi033.xvkvzp (mgr.14164) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:39.609 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:39 smithi033 conmon[31996]: audit 2022-02-02T13:36:39.316139+0000 mon.smithi033 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.33:0/2691000864' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:39 smithi037 conmon[35544]: cluster 2022-02-02T13:36:37.521062+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:36:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:39 smithi037 conmon[35544]: mgr.14164) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:39 smithi037 conmon[35544]: audit 2022-02-02T13:36:39.316139+0000 mon.smithi033 (mon.0) 443 : audit [DBG] from='client.? 172.21.15.33:0/2691000864' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:39.865 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-02-02T13:35:51.198783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2022-02-02T13:36:39.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2022-02-02T13:36:40.312 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:41.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 -- 172.21.15.33:0/4162755956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f67e0 msgr2=0x7fc1c40f6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:41.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 --2- 172.21.15.33:0/4162755956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f67e0 0x7fc1c40f6c00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fc1b8004660 tx=0x7fc1b8009b30).stop 2022-02-02T13:36:41.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 -- 172.21.15.33:0/4162755956 shutdown_connections 2022-02-02T13:36:41.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 --2- 172.21.15.33:0/4162755956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f7a80 0x7fc1c40f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:41.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 --2- 172.21.15.33:0/4162755956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f67e0 0x7fc1c40f6c00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:41.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 -- 172.21.15.33:0/4162755956 >> 172.21.15.33:0/4162755956 conn(0x7fc1c40f1f80 msgr2=0x7fc1c40f43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:41.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 -- 172.21.15.33:0/4162755956 shutdown_connections 2022-02-02T13:36:41.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.616+0000 7fc1ca248700 1 -- 172.21.15.33:0/4162755956 wait complete. 2022-02-02T13:36:41.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 Processor -- start 2022-02-02T13:36:41.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 -- start start 2022-02-02T13:36:41.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f67e0 0x7fc1c4107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:41.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:41.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4107b20 con 0x7fc1c40f7a80 2022-02-02T13:36:41.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1ca248700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4107c60 con 0x7fc1c40f67e0 2022-02-02T13:36:41.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:41.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56166/0 (socket says 172.21.15.33:56166) 2022-02-02T13:36:41.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 -- 172.21.15.33:0/2856695013 learned_addr learned my addr 172.21.15.33:0/2856695013 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:41.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c37fe700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f67e0 0x7fc1c4107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:41.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 -- 172.21.15.33:0/2856695013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f67e0 msgr2=0x7fc1c4107080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:41.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f67e0 0x7fc1c4107080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:41.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.617+0000 7fc1c2ffd700 1 -- 172.21.15.33:0/2856695013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8005040 con 0x7fc1c40f7a80 2022-02-02T13:36:41.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1c2ffd700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc1b400c530 tx=0x7fc1b4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:41.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b400f650 con 0x7fc1c40f7a80 2022-02-02T13:36:41.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c4108600 con 0x7fc1c40f7a80 2022-02-02T13:36:41.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc1b400fc40 con 0x7fc1c40f7a80 2022-02-02T13:36:41.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1b4012b90 con 0x7fc1c40f7a80 2022-02-02T13:36:41.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.618+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c4108bc0 con 0x7fc1c40f7a80 2022-02-02T13:36:41.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.619+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4004fa0 con 0x7fc1c40f7a80 2022-02-02T13:36:41.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.619+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc1b4010070 con 0x7fc1c40f7a80 2022-02-02T13:36:41.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.619+0000 7fc1abfff700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 0x7fc1ac05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:41.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.620+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fc1b4075770 con 0x7fc1c40f7a80 2022-02-02T13:36:41.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.620+0000 7fc1c37fe700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 0x7fc1ac05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:41.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.620+0000 7fc1c37fe700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 0x7fc1ac05e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc1b8004630 tx=0x7fc1b8009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:41.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.624+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc1b40452b0 con 0x7fc1c40f7a80 2022-02-02T13:36:41.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:41 smithi033 conmon[31996]: cluster 2022-02-02T13:36:39.521449+0000 mgr.smithi033.xvkvzp (mgr.14164) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:41.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.783+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc1a4005bf0 con 0x7fc1c40f7a80 2022-02-02T13:36:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.783+0000 7fc1abfff700 1 -- 172.21.15.33:0/2856695013 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v37) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc1b4048790 con 0x7fc1c40f7a80 2022-02-02T13:36:41.784 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2022-02-02T13:36:41.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 msgr2=0x7fc1ac05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:41.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 0x7fc1ac05e760 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fc1b8004630 tx=0x7fc1b8009b30).stop 2022-02-02T13:36:41.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 msgr2=0x7fc1c4107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:41.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fc1b400c530 tx=0x7fc1b4007e20).stop 2022-02-02T13:36:41.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 shutdown_connections 2022-02-02T13:36:41.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc1ac05c2a0 0x7fc1ac05e760 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0x7fc1b8004630 tx=0x7fc1b8009b30).stop 2022-02-02T13:36:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1c40f67e0 0x7fc1c4107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 --2- 172.21.15.33:0/2856695013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1c40f7a80 0x7fc1c4107570 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:41.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 >> 172.21.15.33:0/2856695013 conn(0x7fc1c40f1f80 msgr2=0x7fc1c40fb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 shutdown_connections 2022-02-02T13:36:41.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:41.785+0000 7fc1ca248700 1 -- 172.21.15.33:0/2856695013 wait complete. 2022-02-02T13:36:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:41 smithi037 conmon[35544]: cluster 2022-02-02T13:36:39.521449+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:36:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:41 smithi037 conmon[35544]: .14164) 155 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:42.127 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-02-02T13:36:42.128 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2022-02-02T13:36:42.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph mgr dump --format=json 2022-02-02T13:36:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:42.711 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:42 smithi033 conmon[31996]: audit 2022-02-02T13:36:41.784133+0000 mon.smithi033 (mon 2022-02-02T13:36:42.711 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:42 smithi033 conmon[31996]: .0) 444 : audit [DBG] from='client.? 172.21.15.33:0/2856695013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T13:36:42.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:42 smithi037 conmon[35544]: audit 2022-02-02T13:36:41.784133+0000 mon.smithi033 (mon 2022-02-02T13:36:42.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:42 smithi037 conmon[35544]: .0) 444 : audit [DBG] from='client.? 172.21.15.33:0/2856695013' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T13:36:43.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:43 smithi033 conmon[31996]: cluster 2022-02-02T13:36:41.521772+0000 mgr.smithi033.xvkvzp (mgr.14164) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:43.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:43 smithi037 conmon[35544]: cluster 2022-02-02T13:36:41.521772 2022-02-02T13:36:43.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:43 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 156 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:43.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- 172.21.15.33:0/377104293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f67b0 msgr2=0x7f31600f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:43.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 --2- 172.21.15.33:0/377104293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f67b0 0x7f31600f6c10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f3154004660 tx=0x7f3154009b30).stop 2022-02-02T13:36:43.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- 172.21.15.33:0/377104293 shutdown_connections 2022-02-02T13:36:43.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 --2- 172.21.15.33:0/377104293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f67b0 0x7f31600f6c10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:43.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 --2- 172.21.15.33:0/377104293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f5510 0x7f31600f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:43.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- 172.21.15.33:0/377104293 >> 172.21.15.33:0/377104293 conn(0x7f31600f0c70 msgr2=0x7f31600f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:43.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- 172.21.15.33:0/377104293 shutdown_connections 2022-02-02T13:36:43.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- 172.21.15.33:0/377104293 wait complete. 2022-02-02T13:36:43.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 Processor -- start 2022-02-02T13:36:43.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.910+0000 7f315f59e700 1 -- start start 2022-02-02T13:36:43.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:43.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f67b0 0x7f3160106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:43.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31601069d0 con 0x7f31600f5510 2022-02-02T13:36:43.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160107140 con 0x7f31600f67b0 2022-02-02T13:36:43.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:43.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56172/0 (socket says 172.21.15.33:56172) 2022-02-02T13:36:43.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 -- 172.21.15.33:0/2579720144 learned_addr learned my addr 172.21.15.33:0/2579720144 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:43.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315dd9b700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f67b0 0x7f3160106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 -- 172.21.15.33:0/2579720144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f67b0 msgr2=0x7f3160106390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f67b0 0x7f3160106390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 -- 172.21.15.33:0/2579720144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154005040 con 0x7f31600f5510 2022-02-02T13:36:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315e59c700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f315000d9a0 tx=0x7f3150006f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315000ea30 con 0x7f31600f5510 2022-02-02T13:36:43.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3150012070 con 0x7f31600f5510 2022-02-02T13:36:43.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160107420 con 0x7f31600f5510 2022-02-02T13:36:43.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150016df0 con 0x7f31600f5510 2022-02-02T13:36:43.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.911+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31601079e0 con 0x7f31600f5510 2022-02-02T13:36:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.912+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3160059100 con 0x7f31600f5510 2022-02-02T13:36:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.913+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f315001e070 con 0x7f31600f5510 2022-02-02T13:36:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.913+0000 7f314effd700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 0x7f314805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.913+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3150077cd0 con 0x7f31600f5510 2022-02-02T13:36:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.913+0000 7f315dd9b700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 0x7f314805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.914+0000 7f315dd9b700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 0x7f314805e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3154005010 tx=0x7f3154009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:43.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:43.917+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f315004ad10 con 0x7f31600f5510 2022-02-02T13:36:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.115+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f31600ff820 con 0x7f31600f5510 2022-02-02T13:36:44.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.118+0000 7f314effd700 1 -- 172.21.15.33:0/2579720144 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+143499 (secure 0 0 0) 0x7f315001c070 con 0x7f31600f5510 2022-02-02T13:36:44.121 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:44.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 msgr2=0x7f314805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 0x7f314805e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f3154005010 tx=0x7f3154009b30).stop 2022-02-02T13:36:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 msgr2=0x7f3160105ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:44.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f315000d9a0 tx=0x7f3150006f50).stop 2022-02-02T13:36:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 shutdown_connections 2022-02-02T13:36:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314805c2b0 0x7f314805e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:44.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31600f5510 0x7f3160105ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 --2- 172.21.15.33:0/2579720144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31600f67b0 0x7f3160106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 >> 172.21.15.33:0/2579720144 conn(0x7f31600f0c70 msgr2=0x7f31600fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 shutdown_connections 2022-02-02T13:36:44.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:44.121+0000 7f315f59e700 1 -- 172.21.15.33:0/2579720144 wait complete. 2022-02-02T13:36:44.578 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:44 smithi033 conmon[31996]: audit 2022-02-02T13:36:44.116677+0000 mon.smithi033 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.33:0/2579720144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-02-02T13:36:44.591 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":18,"active_gid":14164,"active_name":"smithi033.xvkvzp","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2305865803},{"type":"v1","addr":"172.21.15.33:6801","nonce":2305865803}]},"active_addr":"172.21.15.33:6801/2305865803","active_change":"2022-02-02T13:33:23.435105+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14208,"name":"smithi037.npteou","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi033.front.sepia.ceph.com:8443/","prometheus":"http://smithi033.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":751127753}]},{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":2816578802}]}]}} 2022-02-02T13:36:44.596 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2022-02-02T13:36:44.597 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2022-02-02T13:36:44.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T13:36:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:44 smithi037 conmon[35544]: audit 2022-02-02T13:36:44.116677+0000 mon.smithi033 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.33:0/2579720144' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-02-02T13:36:45.044 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:45.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:45 smithi033 conmon[31996]: cluster 2022-02-02T13:36:43.522024+0000 mgr.smithi033.xvkvzp (mgr.14164) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:45.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:45 smithi037 conmon[35544]: cluster 2022-02-02T13:36:43.522024+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:36:45.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:45 smithi037 conmon[35544]: mgr.14164) 157 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 -- 172.21.15.33:0/2730608472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f5510 msgr2=0x7f74280f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 --2- 172.21.15.33:0/2730608472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f5510 0x7f74280f5930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f7418004660 tx=0x7f7418009b30).stop 2022-02-02T13:36:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 -- 172.21.15.33:0/2730608472 shutdown_connections 2022-02-02T13:36:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 --2- 172.21.15.33:0/2730608472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f67b0 0x7f74280f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 --2- 172.21.15.33:0/2730608472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f5510 0x7f74280f5930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 -- 172.21.15.33:0/2730608472 >> 172.21.15.33:0/2730608472 conn(0x7f74280f0c70 msgr2=0x7f74280f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 -- 172.21.15.33:0/2730608472 shutdown_connections 2022-02-02T13:36:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 -- 172.21.15.33:0/2730608472 wait complete. 2022-02-02T13:36:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.233+0000 7f742cc6b700 1 Processor -- start 2022-02-02T13:36:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f742cc6b700 1 -- start start 2022-02-02T13:36:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f742cc6b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f5510 0x7f742810c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f742cc6b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f742cc6b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428060810 con 0x7f74280f67b0 2022-02-02T13:36:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f742cc6b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428060950 con 0x7f74280f5510 2022-02-02T13:36:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56184/0 (socket says 172.21.15.33:56184) 2022-02-02T13:36:46.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 -- 172.21.15.33:0/4262347259 learned_addr learned my addr 172.21.15.33:0/4262347259 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:46.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f74277fe700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f5510 0x7f742810c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:46.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 -- 172.21.15.33:0/4262347259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f5510 msgr2=0x7f742810c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:46.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f5510 0x7f742810c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:46.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.234+0000 7f7426ffd700 1 -- 172.21.15.33:0/4262347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418005040 con 0x7f74280f67b0 2022-02-02T13:36:46.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f7426ffd700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f741000b410 tx=0x7f7410006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:46.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74100125f0 con 0x7f74280f67b0 2022-02-02T13:36:46.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742810e9f0 con 0x7f74280f67b0 2022-02-02T13:36:46.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f741000be30 con 0x7f74280f67b0 2022-02-02T13:36:46.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7410002a00 con 0x7f74280f67b0 2022-02-02T13:36:46.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.235+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742810eed0 con 0x7f74280f67b0 2022-02-02T13:36:46.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.236+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7428045ad0 con 0x7f74280f67b0 2022-02-02T13:36:46.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.236+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f741000f030 con 0x7f74280f67b0 2022-02-02T13:36:46.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.237+0000 7f741ffff700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 0x7f741405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:46.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.237+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f7410075f80 con 0x7f74280f67b0 2022-02-02T13:36:46.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.237+0000 7f74277fe700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 0x7f741405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:46.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.237+0000 7f74277fe700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 0x7f741405e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7418013620 tx=0x7f7418009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:46.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.241+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7410048fa0 con 0x7f74280f67b0 2022-02-02T13:36:46.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.400+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74280fddf0 con 0x7f74280f67b0 2022-02-02T13:36:46.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.401+0000 7f741ffff700 1 -- 172.21.15.33:0/4262347259 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10837 (secure 0 0 0) 0x7f741004c5c0 con 0x7f74280f67b0 2022-02-02T13:36:46.402 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:46.402 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","created":"2022-02-02T13:32:17.154681+0000","modified":"2022-02-02T13:36:31.429885+0000","last_up_change":"2022-02-02T13:36:30.424546+0000","last_in_change":"2022-02-02T13:36:14.639029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T13:35:51.198783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"eaa79e13-f217-4edf-af55-0441c3f0542e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6803","nonce":3011410766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6805","nonce":3011410766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6809","nonce":3011410766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6807","nonce":3011410766}]},"public_addr":"172.21.15.33:6803/3011410766","cluster_addr":"172.21.15.33:6805/3011410766","heartbeat_back_addr":"172.21.15.33:6809/3011410766","heartbeat_front_addr":"172.21.15.33:6807/3011410766","state":["exists","up"]},{"osd":1,"uuid":"3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6811","nonce":610736519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6813","nonce":610736519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6817","nonce":610736519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6815","nonce":610736519}]},"public_addr":"172.21.15.33:6811/610736519","cluster_addr":"172.21.15.33:6813/610736519","heartbeat_back_addr":"172.21.15.33:6817/610736519","heartbeat_front_addr":"172.21.15.33:6815/610736519","state":["exists","up"]},{"osd":2,"uuid":"f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6819","nonce":2877179379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6821","nonce":2877179379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6825","nonce":2877179379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6823","nonce":2877179379}]},"public_addr":"172.21.15.33:6819/2877179379","cluster_addr":"172.21.15.33:6821/2877179379","heartbeat_back_addr":"172.21.15.33:6825/2877179379","heartbeat_front_addr":"172.21.15.33:6823/2877179379","state":["exists","up"]},{"osd":3,"uuid":"b9b6adbb-241e-4118-bd0e-81a4270ae5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6801","nonce":222406804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6803","nonce":222406804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6807","nonce":222406804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6805","nonce":222406804}]},"public_addr":"172.21.15.37:6801/222406804","cluster_addr":"172.21.15.37:6803/222406804","heartbeat_back_addr":"172.21.15.37:6807/222406804","heartbeat_front_addr":"172.21.15.37:6805/222406804","state":["exists","up"]},{"osd":4,"uuid":"5805195f-9663-47d0-8a38-153c13fdf8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6809","nonce":2153304138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6811","nonce":2153304138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6815","nonce":2153304138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6813","nonce":2153304138}]},"public_addr":"172.21.15.37:6809/2153304138","cluster_addr":"172.21.15.37:6811/2153304138","heartbeat_back_addr":"172.21.15.37:6815/2153304138","heartbeat_front_addr":"172.21.15.37:6813/2153304138","state":["exists","up"]},{"osd":5,"uuid":"8ed2843c-5bba-4de8-b85a-1dc22383c429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6817","nonce":2797204966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6819","nonce":2797204966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6823","nonce":2797204966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6821","nonce":2797204966}]},"public_addr":"172.21.15.37:6817/2797204966","cluster_addr":"172.21.15.37:6819/2797204966","heartbeat_back_addr":"172.21.15.37:6823/2797204966","heartbeat_front_addr":"172.21.15.37:6821/2797204966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:04.086489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:23.087132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:40.382065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:55.650901+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:12.162455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:28.775958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2749807665":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/16578411":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/2202031572":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/2474768824":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6800/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/236147922":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/302733905":"2022-02-03T13:32:46.589804+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T13:36:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 msgr2=0x7f741405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 0x7f741405e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f7418013620 tx=0x7f7418009b30).stop 2022-02-02T13:36:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 msgr2=0x7f742810e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:46.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f741000b410 tx=0x7f7410006ef0).stop 2022-02-02T13:36:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 shutdown_connections 2022-02-02T13:36:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f741405c2b0 0x7f741405e770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74280f5510 0x7f742810c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:46.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 --2- 172.21.15.33:0/4262347259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74280f67b0 0x7f742810e500 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 >> 172.21.15.33:0/4262347259 conn(0x7f74280f0c70 msgr2=0x7f74280fa200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 shutdown_connections 2022-02-02T13:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:46.403+0000 7f742cc6b700 1 -- 172.21.15.33:0/4262347259 wait complete. 2022-02-02T13:36:46.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:46 smithi033 conmon[31996]: audit 2022-02-02T13:36:46.402075+0000 mon.smithi033 (mon.0 2022-02-02T13:36:46.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:46 smithi033 conmon[31996]: ) 446 : audit [DBG] from='client.? 172.21.15.33:0/4262347259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:46.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:46 smithi037 conmon[35544]: audit 2022-02-02T13:36:46.402075+0000 mon.smithi033 (mon.0) 446 : audit [DBG] from='client.? 172.21.15.33:0/4262347259' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:46.848 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2022-02-02T13:36:46.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-02-02T13:36:47.297 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:47.719 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:47 smithi033 conmon[31996]: cluster 2022-02-02T13:36:45.522346+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:36:47.720 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:47 smithi033 conmon[31996]: ) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:47 smithi037 conmon[35544]: cluster 2022-02-02T13:36:45.522346+0000 mgr.smithi033.xvkvzp (mgr.14164) 158 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 -- 172.21.15.33:0/3054503896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d0060870 msgr2=0x7f44d00f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/3054503896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d0060870 0x7f44d00f93a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f44c4004660 tx=0x7f44c4009b30).stop 2022-02-02T13:36:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 -- 172.21.15.33:0/3054503896 shutdown_connections 2022-02-02T13:36:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/3054503896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d00f9920 0x7f44d00fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/3054503896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d0060870 0x7f44d00f93a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 -- 172.21.15.33:0/3054503896 >> 172.21.15.33:0/3054503896 conn(0x7f44d00f0e20 msgr2=0x7f44d00f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 -- 172.21.15.33:0/3054503896 shutdown_connections 2022-02-02T13:36:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.566+0000 7f44d6f4d700 1 -- 172.21.15.33:0/3054503896 wait complete. 2022-02-02T13:36:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 Processor -- start 2022-02-02T13:36:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 -- start start 2022-02-02T13:36:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d0060870 0x7f44d0107080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d0107bb0 con 0x7f44d00f9920 2022-02-02T13:36:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d6f4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d0108460 con 0x7f44d0060870 2022-02-02T13:36:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56194/0 (socket says 172.21.15.33:56194) 2022-02-02T13:36:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44cffff700 1 -- 172.21.15.33:0/1942591718 learned_addr learned my addr 172.21.15.33:0/1942591718 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.567+0000 7f44d4ce9700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d0060870 0x7f44d0107080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cffff700 1 -- 172.21.15.33:0/1942591718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d0060870 msgr2=0x7f44d0107080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cffff700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d0060870 0x7f44d0107080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cffff700 1 -- 172.21.15.33:0/1942591718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c4005040 con 0x7f44d00f9920 2022-02-02T13:36:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cffff700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f44bc0093f0 tx=0x7f44bc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44bc013640 con 0x7f44d00f9920 2022-02-02T13:36:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d0108740 con 0x7f44d00f9920 2022-02-02T13:36:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f44bc013c30 con 0x7f44d00f9920 2022-02-02T13:36:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44bc012be0 con 0x7f44d00f9920 2022-02-02T13:36:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.568+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d0108d00 con 0x7f44d00f9920 2022-02-02T13:36:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.569+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d0059100 con 0x7f44d00f9920 2022-02-02T13:36:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.569+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f44bc01a060 con 0x7f44d00f9920 2022-02-02T13:36:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.570+0000 7f44cd7fa700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 0x7f44c005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.570+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f44bc075b40 con 0x7f44d00f9920 2022-02-02T13:36:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.570+0000 7f44d4ce9700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 0x7f44c005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.570+0000 7f44d4ce9700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 0x7f44c005e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44c4005010 tx=0x7f44c4009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.574+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f44bc048b00 con 0x7f44d00f9920 2022-02-02T13:36:48.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.731+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44d00ff020 con 0x7f44d00f9920 2022-02-02T13:36:48.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.731+0000 7f44cd7fa700 1 -- 172.21.15.33:0/1942591718 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+10837 (secure 0 0 0) 0x7f44bc04c120 con 0x7f44d00f9920 2022-02-02T13:36:48.732 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:36:48.733 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":37,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","created":"2022-02-02T13:32:17.154681+0000","modified":"2022-02-02T13:36:31.429885+0000","last_up_change":"2022-02-02T13:36:30.424546+0000","last_in_change":"2022-02-02T13:36:14.639029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T13:35:51.198783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"eaa79e13-f217-4edf-af55-0441c3f0542e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6803","nonce":3011410766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6805","nonce":3011410766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6809","nonce":3011410766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6807","nonce":3011410766}]},"public_addr":"172.21.15.33:6803/3011410766","cluster_addr":"172.21.15.33:6805/3011410766","heartbeat_back_addr":"172.21.15.33:6809/3011410766","heartbeat_front_addr":"172.21.15.33:6807/3011410766","state":["exists","up"]},{"osd":1,"uuid":"3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6811","nonce":610736519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6813","nonce":610736519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6817","nonce":610736519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6815","nonce":610736519}]},"public_addr":"172.21.15.33:6811/610736519","cluster_addr":"172.21.15.33:6813/610736519","heartbeat_back_addr":"172.21.15.33:6817/610736519","heartbeat_front_addr":"172.21.15.33:6815/610736519","state":["exists","up"]},{"osd":2,"uuid":"f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6819","nonce":2877179379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6821","nonce":2877179379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6825","nonce":2877179379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6823","nonce":2877179379}]},"public_addr":"172.21.15.33:6819/2877179379","cluster_addr":"172.21.15.33:6821/2877179379","heartbeat_back_addr":"172.21.15.33:6825/2877179379","heartbeat_front_addr":"172.21.15.33:6823/2877179379","state":["exists","up"]},{"osd":3,"uuid":"b9b6adbb-241e-4118-bd0e-81a4270ae5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6801","nonce":222406804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6803","nonce":222406804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6807","nonce":222406804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6805","nonce":222406804}]},"public_addr":"172.21.15.37:6801/222406804","cluster_addr":"172.21.15.37:6803/222406804","heartbeat_back_addr":"172.21.15.37:6807/222406804","heartbeat_front_addr":"172.21.15.37:6805/222406804","state":["exists","up"]},{"osd":4,"uuid":"5805195f-9663-47d0-8a38-153c13fdf8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6809","nonce":2153304138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6811","nonce":2153304138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6815","nonce":2153304138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6813","nonce":2153304138}]},"public_addr":"172.21.15.37:6809/2153304138","cluster_addr":"172.21.15.37:6811/2153304138","heartbeat_back_addr":"172.21.15.37:6815/2153304138","heartbeat_front_addr":"172.21.15.37:6813/2153304138","state":["exists","up"]},{"osd":5,"uuid":"8ed2843c-5bba-4de8-b85a-1dc22383c429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6817","nonce":2797204966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6819","nonce":2797204966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6823","nonce":2797204966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6821","nonce":2797204966}]},"public_addr":"172.21.15.37:6817/2797204966","cluster_addr":"172.21.15.37:6819/2797204966","heartbeat_back_addr":"172.21.15.37:6823/2797204966","heartbeat_front_addr":"172.21.15.37:6821/2797204966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:04.086489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:23.087132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:40.382065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:55.650901+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:12.162455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:28.775958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2749807665":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/16578411":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/2202031572":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/2474768824":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6800/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/236147922":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/302733905":"2022-02-03T13:32:46.589804+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T13:36:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 msgr2=0x7f44c005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 0x7f44c005e760 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f44c4005010 tx=0x7f44c4009b30).stop 2022-02-02T13:36:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 msgr2=0x7f44d0107570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f44bc0093f0 tx=0x7f44bc006ec0).stop 2022-02-02T13:36:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 shutdown_connections 2022-02-02T13:36:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f44c005c2a0 0x7f44c005e760 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d0060870 0x7f44d0107080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 --2- 172.21.15.33:0/1942591718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44d00f9920 0x7f44d0107570 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 >> 172.21.15.33:0/1942591718 conn(0x7f44d00f0e20 msgr2=0x7f44d00f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 shutdown_connections 2022-02-02T13:36:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:48.733+0000 7f44d6f4d700 1 -- 172.21.15.33:0/1942591718 wait complete. 2022-02-02T13:36:49.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2022-02-02T13:36:49.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2022-02-02T13:36:49.113 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2022-02-02T13:36:49.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2022-02-02T13:36:49.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2022-02-02T13:36:49.115 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2022-02-02T13:36:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.661 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.698 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.700 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.731 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.732 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:49 smithi033 conmon[31996]: cluster 2022-02-02T13:36:47.522664+0000 mgr.smithi033.xvkvzp (mgr.14164) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:49 smithi033 conmon[31996]: audit 2022-02-02T13:36:48.732270+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.33:0/1942591718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:49 smithi037 conmon[35544]: cluster 2022-02-02T13:36:47.522664+0000 mgr.smithi033.xvkvzp (mgr.14164) 159 : cluster [DBG] 2022-02-02T13:36:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:49 smithi037 conmon[35544]: pgmap v128: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:49.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:49 smithi037 conmon[35544]: audit 2022-02-02T13:36:48.732270+0000 mon.smithi033 (mon.0) 447 : audit [DBG] from='client.? 172.21.15.33:0/1942591718' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:36:51.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:51 smithi033 conmon[31996]: cluster 2022-02-02T13:36:49.523088+0000 mgr.smithi033.xvkvzp (mgr.14164) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:51 smithi037 conmon[35544]: cluster 2022-02-02T13:36:49.523088+0000 mgr.smithi033.xvkvzp (mgr.14164) 160 : cluster 2022-02-02T13:36:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:51 smithi037 conmon[35544]: [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:52.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 -- 172.21.15.33:0/3228319912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 msgr2=0x7f27280f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 --2- 172.21.15.33:0/3228319912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f27280f7ec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f271c004660 tx=0x7f271c009b30).stop 2022-02-02T13:36:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 -- 172.21.15.33:0/3228319912 shutdown_connections 2022-02-02T13:36:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 --2- 172.21.15.33:0/3228319912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f27280f7ec0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 --2- 172.21.15.33:0/3228319912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 0x7f27280f6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 -- 172.21.15.33:0/3228319912 >> 172.21.15.33:0/3228319912 conn(0x7f27280f1f20 msgr2=0x7f27280f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 -- 172.21.15.33:0/3228319912 shutdown_connections 2022-02-02T13:36:52.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.873+0000 7f272cb45700 1 -- 172.21.15.33:0/3228319912 wait complete. 2022-02-02T13:36:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 Processor -- start 2022-02-02T13:36:52.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 -- start start 2022-02-02T13:36:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 0x7f2728109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:52.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:52.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728109d30 con 0x7f27280f7a60 2022-02-02T13:36:52.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272cb45700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2728109e70 con 0x7f27280f67c0 2022-02-02T13:36:52.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f2725d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:52.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f2725d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56202/0 (socket says 172.21.15.33:56202) 2022-02-02T13:36:52.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f2725d9b700 1 -- 172.21.15.33:0/452171448 learned_addr learned my addr 172.21.15.33:0/452171448 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:52.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.874+0000 7f272659c700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 0x7f2728109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:52.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2725d9b700 1 -- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 msgr2=0x7f2728109290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:52.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2725d9b700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 0x7f2728109290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2725d9b700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c005040 con 0x7f27280f7a60 2022-02-02T13:36:52.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2725d9b700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f271c009990 tx=0x7f271c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:52.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c018070 con 0x7f27280f7a60 2022-02-02T13:36:52.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f271c013410 con 0x7f27280f7a60 2022-02-02T13:36:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272810a7b0 con 0x7f27280f7a60 2022-02-02T13:36:52.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c01de80 con 0x7f27280f7a60 2022-02-02T13:36:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.875+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272810ad10 con 0x7f27280f7a60 2022-02-02T13:36:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.876+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f272805dd30 con 0x7f27280f7a60 2022-02-02T13:36:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.876+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f271c01d420 con 0x7f27280f7a60 2022-02-02T13:36:52.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2716ffd700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 0x7f271005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f271c0776c0 con 0x7f27280f7a60 2022-02-02T13:36:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f272659c700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 0x7f271005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2716ffd700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 0x7f2710064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:52.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2710064a80 con 0x7f2710061fc0 2022-02-02T13:36:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f271c079d30 con 0x7f27280f7a60 2022-02-02T13:36:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2726d9d700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 0x7f2710064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f272659c700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 0x7f271005e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f27280f78c0 tx=0x7f271800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.877+0000 7f2726d9d700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 0x7f2710064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:52.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.878+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== osd.5 v2:172.21.15.37:6816/2797204966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f2710064a80 con 0x7f2710061fc0 2022-02-02T13:36:52.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.893+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 --> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f272810b240 con 0x7f2710061fc0 2022-02-02T13:36:52.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.893+0000 7f2716ffd700 1 -- 172.21.15.33:0/452171448 <== osd.5 v2:172.21.15.37:6816/2797204966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f272810b240 con 0x7f2710061fc0 2022-02-02T13:36:52.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 msgr2=0x7f2710064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:52.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 0x7f2710064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 msgr2=0x7f271005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:52.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 0x7f271005e760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f27280f78c0 tx=0x7f271800b040).stop 2022-02-02T13:36:52.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 msgr2=0x7f2728109780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:52.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f271c009990 tx=0x7f271c009b30).stop 2022-02-02T13:36:52.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 shutdown_connections 2022-02-02T13:36:52.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:6816/2797204966,v1:172.21.15.37:6817/2797204966] conn(0x7f2710061fc0 0x7f2710064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f271005c2a0 0x7f271005e760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27280f67c0 0x7f2728109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 --2- 172.21.15.33:0/452171448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27280f7a60 0x7f2728109780 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 >> 172.21.15.33:0/452171448 conn(0x7f27280f1f20 msgr2=0x7f27280f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 shutdown_connections 2022-02-02T13:36:52.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:52.894+0000 7f272cb45700 1 -- 172.21.15.33:0/452171448 wait complete. 2022-02-02T13:36:53.538 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:53 smithi033 conmon[31996]: cluster 2022-02-02T13:36:51.523401+0000 mgr.smithi033.xvkvzp (mgr.14164) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:53.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 -- 172.21.15.33:0/992544550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f6610 msgr2=0x7fc5200f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 --2- 172.21.15.33:0/992544550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f6610 0x7fc5200f6a30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fc510004660 tx=0x7fc510009b30).stop 2022-02-02T13:36:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 -- 172.21.15.33:0/992544550 shutdown_connections 2022-02-02T13:36:53.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 --2- 172.21.15.33:0/992544550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f78b0 0x7fc5200f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 --2- 172.21.15.33:0/992544550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f6610 0x7fc5200f6a30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 -- 172.21.15.33:0/992544550 >> 172.21.15.33:0/992544550 conn(0x7fc5200f1d70 msgr2=0x7fc5200f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 -- 172.21.15.33:0/992544550 shutdown_connections 2022-02-02T13:36:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.383+0000 7fc525402700 1 -- 172.21.15.33:0/992544550 wait complete. 2022-02-02T13:36:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 Processor -- start 2022-02-02T13:36:53.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 -- start start 2022-02-02T13:36:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f78b0 0x7fc5201073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520107960 con 0x7fc5200f78b0 2022-02-02T13:36:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc525402700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520107aa0 con 0x7fc5200f6610 2022-02-02T13:36:53.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc51ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:53.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc51ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:38696/0 (socket says 172.21.15.33:38696) 2022-02-02T13:36:53.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.384+0000 7fc51ffff700 1 -- 172.21.15.33:0/4213453837 learned_addr learned my addr 172.21.15.33:0/4213453837 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:53.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51f7fe700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f78b0 0x7fc5201073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:53.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51ffff700 1 -- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f78b0 msgr2=0x7fc5201073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51ffff700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f78b0 0x7fc5201073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51ffff700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc510005040 con 0x7fc5200f6610 2022-02-02T13:36:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51ffff700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc510004e30 tx=0x7fc510009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc510018070 con 0x7fc5200f6610 2022-02-02T13:36:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc510013410 con 0x7fc5200f6610 2022-02-02T13:36:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc51001c3c0 con 0x7fc5200f6610 2022-02-02T13:36:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5201083e0 con 0x7fc5200f6610 2022-02-02T13:36:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.385+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc520108940 con 0x7fc5200f6610 2022-02-02T13:36:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.386+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc52005db80 con 0x7fc5200f6610 2022-02-02T13:36:53.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc51001d420 con 0x7fc5200f6610 2022-02-02T13:36:53.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 0x7fc50805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:53.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fc5100777f0 con 0x7fc5200f6610 2022-02-02T13:36:53.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51f7fe700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 0x7fc50805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:53.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 0x7fc508064410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:53.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc508064a90 con 0x7fc508061fd0 2022-02-02T13:36:53.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.387+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc510079da0 con 0x7fc5200f6610 2022-02-02T13:36:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.388+0000 7fc524c01700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 0x7fc508064410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.388+0000 7fc51f7fe700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 0x7fc50805e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc514004c40 tx=0x7fc51400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.388+0000 7fc524c01700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 0x7fc508064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.389+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== osd.0 v2:172.21.15.33:6802/3011410766 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fc508064a90 con 0x7fc508061fd0 2022-02-02T13:36:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.404+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 --> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc520108e70 con 0x7fc508061fd0 2022-02-02T13:36:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.404+0000 7fc51cff9700 1 -- 172.21.15.33:0/4213453837 <== osd.0 v2:172.21.15.33:6802/3011410766 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc520108e70 con 0x7fc508061fd0 2022-02-02T13:36:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.404+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 msgr2=0x7fc508064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 0x7fc508064410 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 msgr2=0x7fc50805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 0x7fc50805e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fc514004c40 tx=0x7fc51400b040).stop 2022-02-02T13:36:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 msgr2=0x7fc520106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc510004e30 tx=0x7fc510009b30).stop 2022-02-02T13:36:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 shutdown_connections 2022-02-02T13:36:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6802/3011410766,v1:172.21.15.33:6803/3011410766] conn(0x7fc508061fd0 0x7fc508064410 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc50805c2b0 0x7fc50805e770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5200f6610 0x7fc520106ec0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 --2- 172.21.15.33:0/4213453837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5200f78b0 0x7fc5201073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 >> 172.21.15.33:0/4213453837 conn(0x7fc5200f1d70 msgr2=0x7fc5200fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 shutdown_connections 2022-02-02T13:36:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:53.405+0000 7fc525402700 1 -- 172.21.15.33:0/4213453837 wait complete. 2022-02-02T13:36:53.728 INFO:teuthology.orchestra.run.smithi033.stdout:154618822664 2022-02-02T13:36:53.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.5 2022-02-02T13:36:53.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:53 smithi037 conmon[35544]: cluster 2022-02-02T13:36:51.523401+0000 mgr.smithi033.xvkvzp (mgr.14164) 161 : cluster 2022-02-02T13:36:53.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:53 smithi037 conmon[35544]: [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:54.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 -- 172.21.15.33:0/3172304578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 msgr2=0x7f315c0f9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 --2- 172.21.15.33:0/3172304578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f9400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3150004660 tx=0x7f3150009b30).stop 2022-02-02T13:36:54.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 -- 172.21.15.33:0/3172304578 shutdown_connections 2022-02-02T13:36:54.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 --2- 172.21.15.33:0/3172304578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 0x7f315c0fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 --2- 172.21.15.33:0/3172304578 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f9400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.009+0000 7f3162f17700 1 -- 172.21.15.33:0/3172304578 >> 172.21.15.33:0/3172304578 conn(0x7f315c0f0e20 msgr2=0x7f315c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:54.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.010+0000 7f3162f17700 1 -- 172.21.15.33:0/3172304578 shutdown_connections 2022-02-02T13:36:54.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.010+0000 7f3162f17700 1 -- 172.21.15.33:0/3172304578 wait complete. 2022-02-02T13:36:54.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.010+0000 7f3162f17700 1 Processor -- start 2022-02-02T13:36:54.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.010+0000 7f3162f17700 1 -- start start 2022-02-02T13:36:54.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 0x7f315c0f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0f5860 con 0x7f315c060810 2022-02-02T13:36:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315c0f59a0 con 0x7f315c0f9980 2022-02-02T13:36:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56224/0 (socket says 172.21.15.33:56224) 2022-02-02T13:36:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 -- 172.21.15.33:0/3636130169 learned_addr learned my addr 172.21.15.33:0/3636130169 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f315bfff700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 0x7f315c0f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 -- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 msgr2=0x7f315c0f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 0x7f315c0f5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150005040 con 0x7f315c060810 2022-02-02T13:36:54.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3160cb3700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3150009990 tx=0x7f3150009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3150018070 con 0x7f315c060810 2022-02-02T13:36:54.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f3150013410 con 0x7f315c060810 2022-02-02T13:36:54.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315c0f5c20 con 0x7f315c060810 2022-02-02T13:36:54.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f315001de80 con 0x7f315c060810 2022-02-02T13:36:54.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.011+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315c0f6180 con 0x7f315c060810 2022-02-02T13:36:54.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.012+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f315c05dd30 con 0x7f315c060810 2022-02-02T13:36:54.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f315001d420 con 0x7f315c060810 2022-02-02T13:36:54.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 0x7f314c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f3150077790 con 0x7f315c060810 2022-02-02T13:36:54.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f315bfff700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 0x7f314c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 0x7f314c064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f314c064a80 con 0x7f314c061fc0 2022-02-02T13:36:54.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.013+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3150079da0 con 0x7f315c060810 2022-02-02T13:36:54.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.014+0000 7f31614b4700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 0x7f314c064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.014+0000 7f315bfff700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 0x7f314c05e760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f315c0605e0 tx=0x7f314800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.014+0000 7f31614b4700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 0x7f314c064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.015+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== osd.3 v2:172.21.15.37:6800/222406804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f314c064a80 con 0x7f314c061fc0 2022-02-02T13:36:54.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.030+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 --> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f315c058150 con 0x7f314c061fc0 2022-02-02T13:36:54.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f31597fa700 1 -- 172.21.15.33:0/3636130169 <== osd.3 v2:172.21.15.37:6800/222406804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f315c058150 con 0x7f314c061fc0 2022-02-02T13:36:54.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 msgr2=0x7f314c064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 0x7f314c064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 msgr2=0x7f314c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 0x7f314c05e760 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f315c0605e0 tx=0x7f314800b040).stop 2022-02-02T13:36:54.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 msgr2=0x7f315c0f6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f3150009990 tx=0x7f3150009b30).stop 2022-02-02T13:36:54.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 shutdown_connections 2022-02-02T13:36:54.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f314c05c2a0 0x7f314c05e760 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:6800/222406804,v1:172.21.15.37:6801/222406804] conn(0x7f314c061fc0 0x7f314c064400 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f315c060810 0x7f315c0f6e80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 --2- 172.21.15.33:0/3636130169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f315c0f9980 0x7f315c0f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 >> 172.21.15.33:0/3636130169 conn(0x7f315c0f0e20 msgr2=0x7f315c0f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 shutdown_connections 2022-02-02T13:36:54.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.031+0000 7f3162f17700 1 -- 172.21.15.33:0/3636130169 wait complete. 2022-02-02T13:36:54.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 -- 172.21.15.33:0/78263204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f5980 msgr2=0x7fb5380f5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 --2- 172.21.15.33:0/78263204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f5980 0x7fb5380f5e00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb524004660 tx=0x7fb524009b30).stop 2022-02-02T13:36:54.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 -- 172.21.15.33:0/78263204 shutdown_connections 2022-02-02T13:36:54.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 --2- 172.21.15.33:0/78263204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f5980 0x7fb5380f5e00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 --2- 172.21.15.33:0/78263204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f6c80 0x7fb5380f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 -- 172.21.15.33:0/78263204 >> 172.21.15.33:0/78263204 conn(0x7fb5380f0590 msgr2=0x7fb5380f29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 -- 172.21.15.33:0/78263204 shutdown_connections 2022-02-02T13:36:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.167+0000 7fb53eb95700 1 -- 172.21.15.33:0/78263204 wait complete. 2022-02-02T13:36:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 Processor -- start 2022-02-02T13:36:54.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 -- start start 2022-02-02T13:36:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 0x7fb5380f9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380f8230 con 0x7fb5380f6c80 2022-02-02T13:36:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.168+0000 7fb53eb95700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5380f8370 con 0x7fb5380f5980 2022-02-02T13:36:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56238/0 (socket says 172.21.15.33:56238) 2022-02-02T13:36:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 -- 172.21.15.33:0/692067079 learned_addr learned my addr 172.21.15.33:0/692067079 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb53c931700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 0x7fb5380f9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 -- 172.21.15.33:0/692067079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 msgr2=0x7fb5380f9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 0x7fb5380f9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb524005040 con 0x7fb5380f6c80 2022-02-02T13:36:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb53c931700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 0x7fb5380f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:36:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb537fff700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb524004e30 tx=0x7fb524009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb524018070 con 0x7fb5380f6c80 2022-02-02T13:36:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5380f85f0 con 0x7fb5380f6c80 2022-02-02T13:36:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb524013410 con 0x7fb5380f6c80 2022-02-02T13:36:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb52401c3c0 con 0x7fb5380f6c80 2022-02-02T13:36:54.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.169+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5380f8b50 con 0x7fb5380f6c80 2022-02-02T13:36:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.170+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb53805dd50 con 0x7fb5380f6c80 2022-02-02T13:36:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb52401d420 con 0x7fb5380f6c80 2022-02-02T13:36:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 0x7fb52805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fb5240778f0 con 0x7fb5380f6c80 2022-02-02T13:36:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 0x7fb528064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb528064a80 con 0x7fb528061fc0 2022-02-02T13:36:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb53c931700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 0x7fb52805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb52407c220 con 0x7fb5380f6c80 2022-02-02T13:36:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.171+0000 7fb53d132700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 0x7fb528064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:54.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.172+0000 7fb53c931700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 0x7fb52805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb52c009fd0 tx=0x7fb52c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.172+0000 7fb53d132700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 0x7fb528064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.172+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== osd.1 v2:172.21.15.33:6810/610736519 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fb528064a80 con 0x7fb528061fc0 2022-02-02T13:36:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.187+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 --> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb5380fb090 con 0x7fb528061fc0 2022-02-02T13:36:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.187+0000 7fb5357fa700 1 -- 172.21.15.33:0/692067079 <== osd.1 v2:172.21.15.33:6810/610736519 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb5380fb090 con 0x7fb528061fc0 2022-02-02T13:36:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 msgr2=0x7fb528064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 0x7fb528064400 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 msgr2=0x7fb52805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 0x7fb52805e760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fb52c009fd0 tx=0x7fb52c00b040).stop 2022-02-02T13:36:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 msgr2=0x7fb5380f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb524004e30 tx=0x7fb524009b30).stop 2022-02-02T13:36:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 shutdown_connections 2022-02-02T13:36:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6810/610736519,v1:172.21.15.33:6811/610736519] conn(0x7fb528061fc0 0x7fb528064400 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb52805c2a0 0x7fb52805e760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5380f5980 0x7fb5380f9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 --2- 172.21.15.33:0/692067079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5380f6c80 0x7fb5380f7cd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 >> 172.21.15.33:0/692067079 conn(0x7fb5380f0590 msgr2=0x7fb5380f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 shutdown_connections 2022-02-02T13:36:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:54.188+0000 7fb53eb95700 1 -- 172.21.15.33:0/692067079 wait complete. 2022-02-02T13:36:54.932 INFO:teuthology.orchestra.run.smithi033.stdout:115964117006 2022-02-02T13:36:54.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.3 2022-02-02T13:36:55.087 INFO:teuthology.orchestra.run.smithi033.stdout:38654705688 2022-02-02T13:36:55.088 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.0 2022-02-02T13:36:55.111 INFO:teuthology.orchestra.run.smithi033.stdout:60129542164 2022-02-02T13:36:55.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.1 2022-02-02T13:36:55.312 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 -- 172.21.15.33:0/672939057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f6980 msgr2=0x7fa63c0f6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:55.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 --2- 172.21.15.33:0/672939057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f6980 0x7fa63c0f6de0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fa630004660 tx=0x7fa630009b30).stop 2022-02-02T13:36:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 -- 172.21.15.33:0/672939057 shutdown_connections 2022-02-02T13:36:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 --2- 172.21.15.33:0/672939057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f6980 0x7fa63c0f6de0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 --2- 172.21.15.33:0/672939057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f56e0 0x7fa63c0f5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.390+0000 7fa6428a7700 1 -- 172.21.15.33:0/672939057 >> 172.21.15.33:0/672939057 conn(0x7fa63c0f0e20 msgr2=0x7fa63c0f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:55.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.391+0000 7fa6428a7700 1 -- 172.21.15.33:0/672939057 shutdown_connections 2022-02-02T13:36:55.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.391+0000 7fa6428a7700 1 -- 172.21.15.33:0/672939057 wait complete. 2022-02-02T13:36:55.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.391+0000 7fa6428a7700 1 Processor -- start 2022-02-02T13:36:55.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.391+0000 7fa6428a7700 1 -- start start 2022-02-02T13:36:55.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa6428a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:55.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa6428a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f6980 0x7fa63c10db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:55.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa6428a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c10e120 con 0x7fa63c0f56e0 2022-02-02T13:36:55.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa6428a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c10e260 con 0x7fa63c0f6980 2022-02-02T13:36:55.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:55.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56248/0 (socket says 172.21.15.33:56248) 2022-02-02T13:36:55.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 -- 172.21.15.33:0/3062426810 learned_addr learned my addr 172.21.15.33:0/3062426810 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:55.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63b7fe700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f6980 0x7fa63c10db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:55.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 -- 172.21.15.33:0/3062426810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f6980 msgr2=0x7fa63c10db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:55.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f6980 0x7fa63c10db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630005040 con 0x7fa63c0f56e0 2022-02-02T13:36:55.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.392+0000 7fa63bfff700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa62c002700 tx=0x7fa62c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:55.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.393+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62c0079c0 con 0x7fa63c0f56e0 2022-02-02T13:36:55.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.393+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa62c00f040 con 0x7fa63c0f56e0 2022-02-02T13:36:55.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.393+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c10ec00 con 0x7fa63c0f56e0 2022-02-02T13:36:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.393+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa62c014860 con 0x7fa63c0f56e0 2022-02-02T13:36:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.393+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c10f1c0 con 0x7fa63c0f56e0 2022-02-02T13:36:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.394+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa63c05dcf0 con 0x7fa63c0f56e0 2022-02-02T13:36:55.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa62c01b060 con 0x7fa63c0f56e0 2022-02-02T13:36:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 0x7fa62405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fa62c075a70 con 0x7fa63c0f56e0 2022-02-02T13:36:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa63b7fe700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 0x7fa62405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 0x7fa624064400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:55.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa624064a80 con 0x7fa624061fc0 2022-02-02T13:36:55.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa62c07a220 con 0x7fa63c0f56e0 2022-02-02T13:36:55.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.395+0000 7fa640e44700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 0x7fa624064400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:55.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.396+0000 7fa63b7fe700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 0x7fa62405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa630005010 tx=0x7fa630009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:55.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.396+0000 7fa640e44700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 0x7fa624064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:55.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.396+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== osd.2 v2:172.21.15.33:6818/2877179379 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fa624064a80 con 0x7fa624061fc0 2022-02-02T13:36:55.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.411+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 --> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa63c10f760 con 0x7fa624061fc0 2022-02-02T13:36:55.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa638ff9700 1 -- 172.21.15.33:0/3062426810 <== osd.2 v2:172.21.15.33:6818/2877179379 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa63c10f760 con 0x7fa624061fc0 2022-02-02T13:36:55.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 msgr2=0x7fa624064400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 0x7fa624064400 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 msgr2=0x7fa62405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 0x7fa62405e760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa630005010 tx=0x7fa630009b30).stop 2022-02-02T13:36:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 msgr2=0x7fa63c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa62c002700 tx=0x7fa62c009d80).stop 2022-02-02T13:36:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 shutdown_connections 2022-02-02T13:36:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa62405c2a0 0x7fa62405e760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:6818/2877179379,v1:172.21.15.33:6819/2877179379] conn(0x7fa624061fc0 0x7fa624064400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63c0f56e0 0x7fa63c10d680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 --2- 172.21.15.33:0/3062426810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0f6980 0x7fa63c10db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:55.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 >> 172.21.15.33:0/3062426810 conn(0x7fa63c0f0e20 msgr2=0x7fa63c0f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:55.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 shutdown_connections 2022-02-02T13:36:55.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:55.412+0000 7fa6428a7700 1 -- 172.21.15.33:0/3062426810 wait complete. 2022-02-02T13:36:55.453 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:55.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:55 smithi033 conmon[31996]: cluster 2022-02-02T13:36:53.523712+0000 mgr.smithi033.xvkvzp (mgr.14164) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:55 smithi037 conmon[35544]: cluster 2022-02-02T13:36:53.523712+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:36:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:55 smithi037 conmon[35544]: 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:56.073 INFO:teuthology.orchestra.run.smithi033.stdout:81604378642 2022-02-02T13:36:56.074 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.2 2022-02-02T13:36:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:56.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.481+0000 7fb4157fd700 1 -- 172.21.15.33:0/4022733021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f78b0 msgr2=0x7fb4100f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:56.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.481+0000 7fb4157fd700 1 --2- 172.21.15.33:0/4022733021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f78b0 0x7fb4100f7d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7fb404004660 tx=0x7fb404009b30).stop 2022-02-02T13:36:56.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.482+0000 7fb4157fd700 1 -- 172.21.15.33:0/4022733021 shutdown_connections 2022-02-02T13:36:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.482+0000 7fb4157fd700 1 --2- 172.21.15.33:0/4022733021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f78b0 0x7fb4100f7d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.482+0000 7fb4157fd700 1 --2- 172.21.15.33:0/4022733021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f6610 0x7fb4100f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.482+0000 7fb4157fd700 1 -- 172.21.15.33:0/4022733021 >> 172.21.15.33:0/4022733021 conn(0x7fb4100f1d70 msgr2=0x7fb4100f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:56.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.482+0000 7fb4157fd700 1 -- 172.21.15.33:0/4022733021 shutdown_connections 2022-02-02T13:36:56.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.483+0000 7fb4157fd700 1 -- 172.21.15.33:0/4022733021 wait complete. 2022-02-02T13:36:56.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.483+0000 7fb4157fd700 1 Processor -- start 2022-02-02T13:36:56.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.483+0000 7fb4157fd700 1 -- start start 2022-02-02T13:36:56.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb4157fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb4157fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f78b0 0x7fb4101073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb4157fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101079c0 con 0x7fb4100f6610 2022-02-02T13:36:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb4157fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101081d0 con 0x7fb4100f78b0 2022-02-02T13:36:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb40ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56260/0 (socket says 172.21.15.33:56260) 2022-02-02T13:36:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb40ffff700 1 -- 172.21.15.33:0/3121090789 learned_addr learned my addr 172.21.15.33:0/3121090789 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.484+0000 7fb40f7fe700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f78b0 0x7fb4101073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40ffff700 1 -- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f78b0 msgr2=0x7fb4101073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40ffff700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f78b0 0x7fb4101073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40ffff700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb404005040 con 0x7fb4100f6610 2022-02-02T13:36:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40ffff700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fb400002700 tx=0x7fb400009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb400009320 con 0x7fb4100f6610 2022-02-02T13:36:56.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fb40000f040 con 0x7fb4100f6610 2022-02-02T13:36:56.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.485+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb400014840 con 0x7fb4100f6610 2022-02-02T13:36:56.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.486+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb410108450 con 0x7fb4100f6610 2022-02-02T13:36:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.486+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4101089e0 con 0x7fb4100f6610 2022-02-02T13:36:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.487+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb41005db80 con 0x7fb4100f6610 2022-02-02T13:36:56.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.487+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb400009480 con 0x7fb4100f6610 2022-02-02T13:36:56.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.487+0000 7fb40cff9700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 0x7fb3f805e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:56.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fb400075fe0 con 0x7fb4100f6610 2022-02-02T13:36:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40f7fe700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 0x7fb3f805e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40cff9700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 0x7fb3f8064450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3f8064ad0 con 0x7fb3f8062010 2022-02-02T13:36:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4000763e0 con 0x7fb4100f6610 2022-02-02T13:36:56.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb40f7fe700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 0x7fb3f805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb404000c00 tx=0x7fb404009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:56.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb414ffc700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 0x7fb3f8064450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:56.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.488+0000 7fb414ffc700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 0x7fb3f8064450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:56.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.489+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== osd.4 v2:172.21.15.37:6808/2153304138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fb3f8064ad0 con 0x7fb3f8062010 2022-02-02T13:36:56.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.504+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 --> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb410108ef0 con 0x7fb3f8062010 2022-02-02T13:36:56.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.504+0000 7fb40cff9700 1 -- 172.21.15.33:0/3121090789 <== osd.4 v2:172.21.15.37:6808/2153304138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb410108ef0 con 0x7fb3f8062010 2022-02-02T13:36:56.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 msgr2=0x7fb3f8064450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 0x7fb3f8064450 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 msgr2=0x7fb3f805e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 0x7fb3f805e760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb404000c00 tx=0x7fb404009b30).stop 2022-02-02T13:36:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 msgr2=0x7fb410106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fb400002700 tx=0x7fb400009e00).stop 2022-02-02T13:36:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 shutdown_connections 2022-02-02T13:36:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:6808/2153304138,v1:172.21.15.37:6809/2153304138] conn(0x7fb3f8062010 0x7fb3f8064450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb3f805c2a0 0x7fb3f805e760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4100f6610 0x7fb410106ed0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 --2- 172.21.15.33:0/3121090789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4100f78b0 0x7fb4101073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:56.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 >> 172.21.15.33:0/3121090789 conn(0x7fb4100f1d70 msgr2=0x7fb4100fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:56.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 shutdown_connections 2022-02-02T13:36:56.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:56.505+0000 7fb4157fd700 1 -- 172.21.15.33:0/3121090789 wait complete. 2022-02-02T13:36:57.012 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:57.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:57 smithi033 conmon[31996]: cluster 2022-02-02T13:36:55.524225+0000 mgr.smithi033.xvkvzp (mgr.14164) 163 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:57 smithi037 conmon[35544]: cluster 2022-02-02T13:36:55.524225+0000 mgr.smithi033.xvkvzp (mgr.14164) 163 : cluster [DBG] 2022-02-02T13:36:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:57 smithi037 conmon[35544]: pgmap v132: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:57.927 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:57.943 INFO:teuthology.orchestra.run.smithi033.stdout:137438953483 2022-02-02T13:36:57.944 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.4 2022-02-02T13:36:58.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 -- 172.21.15.33:0/2782755655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad28060870 msgr2=0x7fad280f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/2782755655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad28060870 0x7fad280f93a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fad18004660 tx=0x7fad18009b30).stop 2022-02-02T13:36:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 -- 172.21.15.33:0/2782755655 shutdown_connections 2022-02-02T13:36:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/2782755655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad280f9920 0x7fad280fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/2782755655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad28060870 0x7fad280f93a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 -- 172.21.15.33:0/2782755655 >> 172.21.15.33:0/2782755655 conn(0x7fad280f0e20 msgr2=0x7fad280f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 -- 172.21.15.33:0/2782755655 shutdown_connections 2022-02-02T13:36:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.128+0000 7fad2d0a2700 1 -- 172.21.15.33:0/2782755655 wait complete. 2022-02-02T13:36:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 Processor -- start 2022-02-02T13:36:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 -- start start 2022-02-02T13:36:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 0x7fad280f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280f5800 con 0x7fad280f9920 2022-02-02T13:36:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2d0a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad280f5940 con 0x7fad28060870 2022-02-02T13:36:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56272/0 (socket says 172.21.15.33:56272) 2022-02-02T13:36:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad2659c700 1 -- 172.21.15.33:0/4240565492 learned_addr learned my addr 172.21.15.33:0/4240565492 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:58.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.129+0000 7fad26d9d700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 0x7fad280f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2659c700 1 -- 172.21.15.33:0/4240565492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 msgr2=0x7fad280f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2659c700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 0x7fad280f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2659c700 1 -- 172.21.15.33:0/4240565492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18005040 con 0x7fad280f9920 2022-02-02T13:36:58.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad26d9d700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 0x7fad280f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:36:58.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2659c700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fad1c00e7c0 tx=0x7fad1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad1c0092e0 con 0x7fad280f9920 2022-02-02T13:36:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fad1c00f040 con 0x7fad280f9920 2022-02-02T13:36:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad1c0146a0 con 0x7fad280f9920 2022-02-02T13:36:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad280f5c20 con 0x7fad280f9920 2022-02-02T13:36:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.130+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2810f050 con 0x7fad280f9920 2022-02-02T13:36:58.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.132+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad28045ad0 con 0x7fad280f9920 2022-02-02T13:36:58.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.132+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fad1c0077b0 con 0x7fad280f9920 2022-02-02T13:36:58.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.132+0000 7fad0f7fe700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 0x7fad1005e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.132+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fad1c075ed0 con 0x7fad280f9920 2022-02-02T13:36:58.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.132+0000 7fad26d9d700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 0x7fad1005e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.133+0000 7fad26d9d700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 0x7fad1005e700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fad18004d80 tx=0x7fad18016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:58.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.136+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fad1c048ef0 con 0x7fad280f9920 2022-02-02T13:36:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.317+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fad28027a00 con 0x7fad280f9920 2022-02-02T13:36:58.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.318+0000 7fad0f7fe700 1 -- 172.21.15.33:0/4240565492 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad1c04c510 con 0x7fad280f9920 2022-02-02T13:36:58.319 INFO:teuthology.orchestra.run.smithi033.stdout:154618822664 2022-02-02T13:36:58.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.319+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 msgr2=0x7fad1005e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.319+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 0x7fad1005e700 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fad18004d80 tx=0x7fad18016040).stop 2022-02-02T13:36:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.319+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 msgr2=0x7fad280f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.319+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fad1c00e7c0 tx=0x7fad1c00b040).stop 2022-02-02T13:36:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 shutdown_connections 2022-02-02T13:36:58.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fad1005c240 0x7fad1005e700 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad28060870 0x7fad280f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 --2- 172.21.15.33:0/4240565492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad280f9920 0x7fad280f52a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 >> 172.21.15.33:0/4240565492 conn(0x7fad280f0e20 msgr2=0x7fad280f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:58.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 shutdown_connections 2022-02-02T13:36:58.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.320+0000 7fad2d0a2700 1 -- 172.21.15.33:0/4240565492 wait complete. 2022-02-02T13:36:58.618 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:58 smithi033 conmon[31996]: audit 2022-02-02T13:36:58.318839+0000 mon.smithi033 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.33:0/4240565492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-02-02T13:36:58.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:58 smithi037 conmon[35544]: audit 2022-02-02T13:36:58.318839+0000 mon.smithi033 ( 2022-02-02T13:36:58.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:58 smithi037 conmon[35544]: mon.0) 448 : audit [DBG] from='client.? 172.21.15.33:0/4240565492' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-02-02T13:36:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 -- 172.21.15.33:0/3446239527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f67b0 msgr2=0x7fefa80f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 --2- 172.21.15.33:0/3446239527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f67b0 0x7fefa80f6c10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fef9c004660 tx=0x7fef9c009b30).stop 2022-02-02T13:36:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 -- 172.21.15.33:0/3446239527 shutdown_connections 2022-02-02T13:36:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 --2- 172.21.15.33:0/3446239527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f67b0 0x7fefa80f6c10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 --2- 172.21.15.33:0/3446239527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f5510 0x7fefa80f5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:36:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 -- 172.21.15.33:0/3446239527 >> 172.21.15.33:0/3446239527 conn(0x7fefa80f0c70 msgr2=0x7fefa80f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:58.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 -- 172.21.15.33:0/3446239527 shutdown_connections 2022-02-02T13:36:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.944+0000 7fefaf55c700 1 -- 172.21.15.33:0/3446239527 wait complete. 2022-02-02T13:36:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 Processor -- start 2022-02-02T13:36:58.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 -- start start 2022-02-02T13:36:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 0x7fefa80f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80f80e0 con 0x7fefa80f5510 2022-02-02T13:36:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefaf55c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa80f8220 con 0x7fefa80f67b0 2022-02-02T13:36:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56280/0 (socket says 172.21.15.33:56280) 2022-02-02T13:36:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 -- 172.21.15.33:0/1773851738 learned_addr learned my addr 172.21.15.33:0/1773851738 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefadd59700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 0x7fefa80f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 -- 172.21.15.33:0/1773851738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 msgr2=0x7fefa80f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 0x7fefa80f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 -- 172.21.15.33:0/1773851738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c005040 con 0x7fefa80f5510 2022-02-02T13:36:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefadd59700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 0x7fefa80f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:36:58.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.945+0000 7fefae55a700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fefa40093f0 tx=0x7fefa4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.946+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefa4009ea0 con 0x7fefa80f5510 2022-02-02T13:36:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.946+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fefa4013ad0 con 0x7fefa80f5510 2022-02-02T13:36:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.946+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefa400da80 con 0x7fefa80f5510 2022-02-02T13:36:58.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.946+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa80f8500 con 0x7fefa80f5510 2022-02-02T13:36:58.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.946+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa810ef40 con 0x7fefa80f5510 2022-02-02T13:36:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.947+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa8045ad0 con 0x7fefa80f5510 2022-02-02T13:36:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.947+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fefa401a060 con 0x7fefa80f5510 2022-02-02T13:36:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.948+0000 7fef9affd700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 0x7fef9405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:58.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.948+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fefa4075c00 con 0x7fefa80f5510 2022-02-02T13:36:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.948+0000 7fefadd59700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 0x7fef9405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.948+0000 7fefadd59700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 0x7fef9405e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fef9c004e30 tx=0x7fef9c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:58.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:58.952+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fefa407b020 con 0x7fefa80f5510 2022-02-02T13:36:59.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.112+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fefa80fdd70 con 0x7fefa80f5510 2022-02-02T13:36:59.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.112+0000 7fef9affd700 1 -- 172.21.15.33:0/1773851738 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fefa4048bc0 con 0x7fefa80f5510 2022-02-02T13:36:59.113 INFO:teuthology.orchestra.run.smithi033.stdout:115964117006 2022-02-02T13:36:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 msgr2=0x7fef9405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 0x7fef9405e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fef9c004e30 tx=0x7fef9c009b30).stop 2022-02-02T13:36:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 msgr2=0x7fefa80f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fefa40093f0 tx=0x7fefa4006ec0).stop 2022-02-02T13:36:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 shutdown_connections 2022-02-02T13:36:59.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fef9405c2b0 0x7fef9405e770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefa80f5510 0x7fefa80f9670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 --2- 172.21.15.33:0/1773851738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefa80f67b0 0x7fefa80f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.114+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 >> 172.21.15.33:0/1773851738 conn(0x7fefa80f0c70 msgr2=0x7fefa80603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.115+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 shutdown_connections 2022-02-02T13:36:59.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.115+0000 7fefaf55c700 1 -- 172.21.15.33:0/1773851738 wait complete. 2022-02-02T13:36:59.447 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822664 got 154618822664 for osd.5 2022-02-02T13:36:59.448 DEBUG:teuthology.parallel:result is None 2022-02-02T13:36:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:59 smithi033 conmon[31996]: cluster 2022-02-02T13:36:57.524509+0000 mgr.smithi033.xvkvzp (mgr.14164) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:36:59 smithi033 conmon[31996]: audit 2022-02-02T13:36:59.113604+0000 mon.smithi033 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.33:0/1773851738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-02-02T13:36:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 -- 172.21.15.33:0/2959331360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f56e0 msgr2=0x7f8c040f5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2959331360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f56e0 0x7f8c040f5b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8bf4004660 tx=0x7f8bf4009b30).stop 2022-02-02T13:36:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 -- 172.21.15.33:0/2959331360 shutdown_connections 2022-02-02T13:36:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2959331360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f6980 0x7f8c040f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2959331360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f56e0 0x7f8c040f5b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 -- 172.21.15.33:0/2959331360 >> 172.21.15.33:0/2959331360 conn(0x7f8c040f0e20 msgr2=0x7f8c040f3260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 -- 172.21.15.33:0/2959331360 shutdown_connections 2022-02-02T13:36:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.781+0000 7f8c097b9700 1 -- 172.21.15.33:0/2959331360 wait complete. 2022-02-02T13:36:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 Processor -- start 2022-02-02T13:36:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 -- start start 2022-02-02T13:36:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f56e0 0x7f8c040f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040f8220 con 0x7f8c040f6980 2022-02-02T13:36:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.782+0000 7f8c097b9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c040f8360 con 0x7f8c040f56e0 2022-02-02T13:36:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56292/0 (socket says 172.21.15.33:56292) 2022-02-02T13:36:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 -- 172.21.15.33:0/2993502034 learned_addr learned my addr 172.21.15.33:0/2993502034 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:36:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c02ffd700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f56e0 0x7f8c040f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 -- 172.21.15.33:0/2993502034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f56e0 msgr2=0x7f8c040f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f56e0 0x7f8c040f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 -- 172.21.15.33:0/2993502034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf4005040 con 0x7f8c040f6980 2022-02-02T13:36:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c027fc700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8bf80026d0 tx=0x7f8bf8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:59.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf80079c0 con 0x7f8c040f6980 2022-02-02T13:36:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f8bf800f040 con 0x7f8c040f6980 2022-02-02T13:36:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c040f8640 con 0x7f8c040f6980 2022-02-02T13:36:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8bf8014820 con 0x7f8c040f6980 2022-02-02T13:36:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.783+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0410f0d0 con 0x7f8c040f6980 2022-02-02T13:36:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.784+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c04045ad0 con 0x7f8c040f6980 2022-02-02T13:36:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.785+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f8bf80090d0 con 0x7f8c040f6980 2022-02-02T13:36:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.785+0000 7f8beb7fe700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 0x7f8bec05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:36:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.785+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f8bf8075f50 con 0x7f8c040f6980 2022-02-02T13:36:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.785+0000 7f8c02ffd700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 0x7f8bec05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:36:59.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.786+0000 7f8c02ffd700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 0x7f8bec05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8bf4013620 tx=0x7f8bf4009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:36:59.805 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:59 smithi037 conmon[35544]: cluster 2022-02-02T13:36:57.524509+0000 mgr.smithi033.xvkvzp (mgr.14164) 164 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:36:59.806 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:59 smithi037 conmon[35544]: audit 2022-02-02T13:36:59.113604+0000 mon.smithi033 (mon.0) 449 2022-02-02T13:36:59.806 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:36:59 smithi037 conmon[35544]: : audit [DBG] from='client.? 172.21.15.33:0/1773851738' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-02-02T13:36:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.789+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f8bf8049060 con 0x7f8c040f6980 2022-02-02T13:36:59.930 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:36:59.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.963+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8c040fdea0 con 0x7f8c040f6980 2022-02-02T13:36:59.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.963+0000 7f8beb7fe700 1 -- 172.21.15.33:0/2993502034 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bf804c680 con 0x7f8c040f6980 2022-02-02T13:36:59.964 INFO:teuthology.orchestra.run.smithi033.stdout:38654705689 2022-02-02T13:36:59.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 msgr2=0x7f8bec05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 0x7f8bec05e760 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f8bf4013620 tx=0x7f8bf4009b30).stop 2022-02-02T13:36:59.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 msgr2=0x7f8c040f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:36:59.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8bf80026d0 tx=0x7f8bf8009de0).stop 2022-02-02T13:36:59.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 shutdown_connections 2022-02-02T13:36:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f8bec05c2a0 0x7f8bec05e760 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c040f56e0 0x7f8c040f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 --2- 172.21.15.33:0/2993502034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c040f6980 0x7f8c040f7cc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:36:59.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 >> 172.21.15.33:0/2993502034 conn(0x7f8c040f0e20 msgr2=0x7f8c040603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:36:59.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 shutdown_connections 2022-02-02T13:36:59.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:36:59.965+0000 7f8c097b9700 1 -- 172.21.15.33:0/2993502034 wait complete. 2022-02-02T13:37:00.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:00 smithi033 conmon[31996]: audit 2022-02-02T13:36:59.964404+0000 mon.smithi033 2022-02-02T13:37:00.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:00 smithi033 conmon[31996]: (mon.0) 450 : audit [DBG] from='client.? 172.21.15.33:0/2993502034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-02-02T13:37:00.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117006 got 115964117006 for osd.3 2022-02-02T13:37:00.723 DEBUG:teuthology.parallel:result is None 2022-02-02T13:37:00.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:00 smithi037 conmon[35544]: audit 2022-02-02T13:36:59.964404+0000 mon.smithi033 (mon. 2022-02-02T13:37:00.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:00 smithi037 conmon[35544]: 0) 450 : audit [DBG] from='client.? 172.21.15.33:0/2993502034' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-02-02T13:37:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.820+0000 7f6fa359e700 1 -- 172.21.15.33:0/3298138353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f6620 msgr2=0x7f6fa40f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.820+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3298138353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f6620 0x7f6fa40f6a40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f6f94004660 tx=0x7f6f94009b30).stop 2022-02-02T13:37:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- 172.21.15.33:0/3298138353 shutdown_connections 2022-02-02T13:37:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3298138353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f78c0 0x7f6fa40f7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3298138353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f6620 0x7f6fa40f6a40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- 172.21.15.33:0/3298138353 >> 172.21.15.33:0/3298138353 conn(0x7f6fa40f1da0 msgr2=0x7f6fa40f41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- 172.21.15.33:0/3298138353 shutdown_connections 2022-02-02T13:37:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- 172.21.15.33:0/3298138353 wait complete. 2022-02-02T13:37:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 Processor -- start 2022-02-02T13:37:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- start start 2022-02-02T13:37:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f6620 0x7f6fa41090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4109b80 con 0x7f6fa40f78c0 2022-02-02T13:37:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.821+0000 7f6fa359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa4109cc0 con 0x7f6fa40f6620 2022-02-02T13:37:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56300/0 (socket says 172.21.15.33:56300) 2022-02-02T13:37:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 -- 172.21.15.33:0/3426407373 learned_addr learned my addr 172.21.15.33:0/3426407373 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa259c700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f6620 0x7f6fa41090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 -- 172.21.15.33:0/3426407373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f6620 msgr2=0x7f6fa41090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f6620 0x7f6fa41090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 -- 172.21.15.33:0/3426407373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94005040 con 0x7f6fa40f78c0 2022-02-02T13:37:00.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa1d9b700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f6f980026d0 tx=0x7f6f98009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:00.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f980079c0 con 0x7f6fa40f78c0 2022-02-02T13:37:00.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f6f9800f040 con 0x7f6fa40f78c0 2022-02-02T13:37:00.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa410a660 con 0x7f6fa40f78c0 2022-02-02T13:37:00.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f98014820 con 0x7f6fa40f78c0 2022-02-02T13:37:00.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.822+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa410ac20 con 0x7f6fa40f78c0 2022-02-02T13:37:00.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.823+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa4045ad0 con 0x7f6fa40f78c0 2022-02-02T13:37:00.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.824+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f6f980090d0 con 0x7f6fa40f78c0 2022-02-02T13:37:00.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.824+0000 7f6f92ffd700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 0x7f6f8c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:00.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.824+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f6f98075a50 con 0x7f6fa40f78c0 2022-02-02T13:37:00.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.824+0000 7f6fa259c700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 0x7f6f8c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:00.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.825+0000 7f6fa259c700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 0x7f6f8c05e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6f94005010 tx=0x7f6f94009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:00.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.828+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f6f98048ba0 con 0x7f6fa40f78c0 2022-02-02T13:37:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.994+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6fa4027a00 con 0x7f6fa40f78c0 2022-02-02T13:37:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.995+0000 7f6f92ffd700 1 -- 172.21.15.33:0/3426407373 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f9804c1c0 con 0x7f6fa40f78c0 2022-02-02T13:37:00.996 INFO:teuthology.orchestra.run.smithi033.stdout:60129542165 2022-02-02T13:37:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 msgr2=0x7f6f8c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 0x7f6f8c05e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f6f94005010 tx=0x7f6f94009b30).stop 2022-02-02T13:37:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 msgr2=0x7f6fa41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f6f980026d0 tx=0x7f6f98009de0).stop 2022-02-02T13:37:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 shutdown_connections 2022-02-02T13:37:00.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f6f8c05c2b0 0x7f6f8c05e770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa40f6620 0x7f6fa41090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 --2- 172.21.15.33:0/3426407373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa40f78c0 0x7f6fa41095d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 >> 172.21.15.33:0/3426407373 conn(0x7f6fa40f1da0 msgr2=0x7f6fa40f9300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.998+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 shutdown_connections 2022-02-02T13:37:01.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:00.999+0000 7f6fa359e700 1 -- 172.21.15.33:0/3426407373 wait complete. 2022-02-02T13:37:01.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705688 got 38654705689 for osd.0 2022-02-02T13:37:01.199 DEBUG:teuthology.parallel:result is None 2022-02-02T13:37:01.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.339+0000 7f0d61ca2700 1 -- 172.21.15.33:0/2640638637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 msgr2=0x7f0d5c0fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:01.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.339+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/2640638637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0fbd70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f0d50004660 tx=0x7f0d50009b30).stop 2022-02-02T13:37:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.339+0000 7f0d61ca2700 1 -- 172.21.15.33:0/2640638637 shutdown_connections 2022-02-02T13:37:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/2640638637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0fbd70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/2640638637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 0x7f0d5c0f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 -- 172.21.15.33:0/2640638637 >> 172.21.15.33:0/2640638637 conn(0x7f0d5c0f0e20 msgr2=0x7f0d5c0f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 -- 172.21.15.33:0/2640638637 shutdown_connections 2022-02-02T13:37:01.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 -- 172.21.15.33:0/2640638637 wait complete. 2022-02-02T13:37:01.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.340+0000 7f0d61ca2700 1 Processor -- start 2022-02-02T13:37:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d61ca2700 1 -- start start 2022-02-02T13:37:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d61ca2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 0x7f0d5c0f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d61ca2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:01.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d61ca2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0f5800 con 0x7f0d5c0f9920 2022-02-02T13:37:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d61ca2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0f5940 con 0x7f0d5c060870 2022-02-02T13:37:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56310/0 (socket says 172.21.15.33:56310) 2022-02-02T13:37:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 -- 172.21.15.33:0/3435603931 learned_addr learned my addr 172.21.15.33:0/3435603931 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:01.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5b7fe700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 0x7f0d5c0f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:01.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 -- 172.21.15.33:0/3435603931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 msgr2=0x7f0d5c0f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:01.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 0x7f0d5c0f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 -- 172.21.15.33:0/3435603931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50005040 con 0x7f0d5c0f9920 2022-02-02T13:37:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.341+0000 7f0d5affd700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f0d50004e30 tx=0x7f0d50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.342+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d50018070 con 0x7f0d5c0f9920 2022-02-02T13:37:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.342+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0d50004290 con 0x7f0d5c0f9920 2022-02-02T13:37:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.342+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5c0f5bc0 con 0x7f0d5c0f9920 2022-02-02T13:37:01.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.342+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d5001ddc0 con 0x7f0d5c0f9920 2022-02-02T13:37:01.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.342+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0f6120 con 0x7f0d5c0f9920 2022-02-02T13:37:01.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.343+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c045ad0 con 0x7f0d5c0f9920 2022-02-02T13:37:01.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.343+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0d5001d420 con 0x7f0d5c0f9920 2022-02-02T13:37:01.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.344+0000 7f0d43fff700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 0x7f0d4405e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.344+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f0d50077710 con 0x7f0d5c0f9920 2022-02-02T13:37:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.344+0000 7f0d5b7fe700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 0x7f0d4405e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.344+0000 7f0d5b7fe700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 0x7f0d4405e700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0d5c0f6bb0 tx=0x7f0d4c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:01.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.348+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0d5004a730 con 0x7f0d5c0f9920 2022-02-02T13:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.517+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0d5c027a00 con 0x7f0d5c0f9920 2022-02-02T13:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.517+0000 7f0d43fff700 1 -- 172.21.15.33:0/3435603931 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0d5004dd50 con 0x7f0d5c0f9920 2022-02-02T13:37:01.521 INFO:teuthology.orchestra.run.smithi033.stdout:81604378643 2022-02-02T13:37:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 msgr2=0x7f0d4405e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 0x7f0d4405e700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0d5c0f6bb0 tx=0x7f0d4c00b040).stop 2022-02-02T13:37:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 msgr2=0x7f0d5c0f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f0d50004e30 tx=0x7f0d50009b30).stop 2022-02-02T13:37:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 shutdown_connections 2022-02-02T13:37:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0d4405c240 0x7f0d4405e700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d5c060870 0x7f0d5c0f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 --2- 172.21.15.33:0/3435603931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d5c0f9920 0x7f0d5c0f52a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:01.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 >> 172.21.15.33:0/3435603931 conn(0x7f0d5c0f0e20 msgr2=0x7f0d5c0f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:01.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 shutdown_connections 2022-02-02T13:37:01.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:01.519+0000 7f0d61ca2700 1 -- 172.21.15.33:0/3435603931 wait complete. 2022-02-02T13:37:01.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:01 smithi037 conmon[35544]: cluster 2022-02-02T13:36:59. 2022-02-02T13:37:01.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:01 smithi037 conmon[35544]: 525127+0000 mgr.smithi033.xvkvzp (mgr.14164) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:01.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:01 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:37:01.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:01 smithi037 conmon[35544]: T13:37:00.996002+0000 mon.smithi033 (mon.0) 451 2022-02-02T13:37:01.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:01 smithi037 conmon[35544]: : audit [DBG] from='client.? 172.21.15.33:0/3426407373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-02-02T13:37:01.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:01 smithi033 conmon[31996]: cluster 2022-02-02T13:36:59.525127+0000 mgr.smithi033.xvkvzp (mgr.14164) 165 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:01.870 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:01 smithi033 conmon[31996]: audit 2022-02-02T13:37:00.996002+0000 mon.smithi033 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.33:0/3426407373' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-02-02T13:37:02.005 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378642 got 81604378643 for osd.2 2022-02-02T13:37:02.006 DEBUG:teuthology.parallel:result is None 2022-02-02T13:37:02.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542164 got 60129542165 for osd.1 2022-02-02T13:37:02.366 DEBUG:teuthology.parallel:result is None 2022-02-02T13:37:02.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:02 smithi033 conmon[31996]: audit 2022-02-02T13:37:01.518109+0000 mon.smithi033 ( 2022-02-02T13:37:02.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:02 smithi033 conmon[31996]: mon.0) 452 : audit [DBG] from='client.? 172.21.15.33:0/3435603931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-02-02T13:37:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:02 smithi037 conmon[35544]: audit 2022-02-02T13:37:01.518109+0000 mon.smithi033 (mon.0) 452 : audit [DBG] from='client.? 172.21.15.33:0/3435603931' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-02-02T13:37:02.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- 172.21.15.33:0/2123449613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f6960 msgr2=0x7f73e00f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:02.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 --2- 172.21.15.33:0/2123449613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f6960 0x7f73e00f6dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f73d0004660 tx=0x7f73d0009b30).stop 2022-02-02T13:37:02.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- 172.21.15.33:0/2123449613 shutdown_connections 2022-02-02T13:37:02.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 --2- 172.21.15.33:0/2123449613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f6960 0x7f73e00f6dc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:02.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 --2- 172.21.15.33:0/2123449613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f56c0 0x7f73e00f5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:02.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- 172.21.15.33:0/2123449613 >> 172.21.15.33:0/2123449613 conn(0x7f73e00f0e20 msgr2=0x7f73e00f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:02.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- 172.21.15.33:0/2123449613 shutdown_connections 2022-02-02T13:37:02.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- 172.21.15.33:0/2123449613 wait complete. 2022-02-02T13:37:02.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 Processor -- start 2022-02-02T13:37:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.983+0000 7f73e8715700 1 -- start start 2022-02-02T13:37:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e8715700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e8715700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f6960 0x7f73e010e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e8715700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0060810 con 0x7f73e00f56c0 2022-02-02T13:37:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e8715700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e0060950 con 0x7f73e00f6960 2022-02-02T13:37:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56318/0 (socket says 172.21.15.33:56318) 2022-02-02T13:37:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 -- 172.21.15.33:0/3043648132 learned_addr learned my addr 172.21.15.33:0/3043648132 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e5cb0700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f6960 0x7f73e010e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:02.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 -- 172.21.15.33:0/3043648132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f6960 msgr2=0x7f73e010e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:02.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f6960 0x7f73e010e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:02.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 -- 172.21.15.33:0/3043648132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0005040 con 0x7f73e00f56c0 2022-02-02T13:37:02.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73e64b1700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f73dc00c530 tx=0x7f73dc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.984+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73dc00f650 con 0x7f73e00f56c0 2022-02-02T13:37:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.985+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f73dc00fc40 con 0x7f73e00f56c0 2022-02-02T13:37:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.985+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e010ebd0 con 0x7f73e00f56c0 2022-02-02T13:37:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.985+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73dc012c90 con 0x7f73e00f56c0 2022-02-02T13:37:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.985+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e010f050 con 0x7f73e00f56c0 2022-02-02T13:37:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.985+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e0045ad0 con 0x7f73e00f56c0 2022-02-02T13:37:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.986+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f73dc019030 con 0x7f73e00f56c0 2022-02-02T13:37:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.986+0000 7f73d6ffd700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 0x7f73cc05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.986+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f73dc075730 con 0x7f73e00f56c0 2022-02-02T13:37:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.986+0000 7f73e5cb0700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 0x7f73cc05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.987+0000 7f73e5cb0700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 0x7f73cc05e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f73d0009d60 tx=0x7f73d0009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:02.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:02.990+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f73dc048820 con 0x7f73e00f56c0 2022-02-02T13:37:03.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.149+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f73e0027a00 con 0x7f73e00f56c0 2022-02-02T13:37:03.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.150+0000 7f73d6ffd700 1 -- 172.21.15.33:0/3043648132 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f73dc017090 con 0x7f73e00f56c0 2022-02-02T13:37:03.151 INFO:teuthology.orchestra.run.smithi033.stdout:137438953484 2022-02-02T13:37:03.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 msgr2=0x7f73cc05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 0x7f73cc05e760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f73d0009d60 tx=0x7f73d0009b30).stop 2022-02-02T13:37:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 msgr2=0x7f73e010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f73dc00c530 tx=0x7f73dc007e10).stop 2022-02-02T13:37:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 shutdown_connections 2022-02-02T13:37:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73cc05c2a0 0x7f73cc05e760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73e00f56c0 0x7f73e010c1e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 --2- 172.21.15.33:0/3043648132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73e00f6960 0x7f73e010e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 >> 172.21.15.33:0/3043648132 conn(0x7f73e00f0e20 msgr2=0x7f73e00fa3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:03.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 shutdown_connections 2022-02-02T13:37:03.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:03.152+0000 7f73e8715700 1 -- 172.21.15.33:0/3043648132 wait complete. 2022-02-02T13:37:03.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:03 smithi033 conmon[31996]: cluster 2022-02-02T13:37:01.525483 2022-02-02T13:37:03.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:03 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:03.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:03 smithi033 conmon[31996]: audit 2022-02-02T13:37:03.151012+0000 mon.smithi033 (mon.0) 453 : audit [DBG] from='client.? 172.21.15.33:0/3043648132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-02-02T13:37:03.783 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953483 got 137438953484 for osd.4 2022-02-02T13:37:03.783 DEBUG:teuthology.parallel:result is None 2022-02-02T13:37:03.783 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2022-02-02T13:37:03.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-02-02T13:37:03.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:03 smithi037 conmon[35544]: cluster 2022-02-02T13:37:01.525483+0000 mgr.smithi033.xvkvzp (mgr.14164) 166 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:03.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:03 smithi037 conmon[35544]: audit 2022-02-02T13:37:03.151012+0000 mon.smithi033 (mon.0) 453 : audit [DBG] 2022-02-02T13:37:03.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:03 smithi037 conmon[35544]: from='client.? 172.21.15.33:0/3043648132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-02-02T13:37:04.233 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 -- 172.21.15.33:0/4112966965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 msgr2=0x7fbac00f5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 --2- 172.21.15.33:0/4112966965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac00f5930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fbab4004660 tx=0x7fbab4009b30).stop 2022-02-02T13:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 -- 172.21.15.33:0/4112966965 shutdown_connections 2022-02-02T13:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 --2- 172.21.15.33:0/4112966965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 0x7fbac00f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 --2- 172.21.15.33:0/4112966965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac00f5930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 -- 172.21.15.33:0/4112966965 >> 172.21.15.33:0/4112966965 conn(0x7fbac00f0c70 msgr2=0x7fbac00f3090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 -- 172.21.15.33:0/4112966965 shutdown_connections 2022-02-02T13:37:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 -- 172.21.15.33:0/4112966965 wait complete. 2022-02-02T13:37:05.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:05 smithi033 conmon[31996]: cluster 2022-02-02T13:37:03.525921+0000 mgr.smithi033.xvkvzp (mgr.14164) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.644+0000 7fbac4aba700 1 Processor -- start 2022-02-02T13:37:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbac4aba700 1 -- start start 2022-02-02T13:37:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbac4aba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbac4aba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 0x7fbac01095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbac4aba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0109b60 con 0x7fbac00f5510 2022-02-02T13:37:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbac4aba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0109ca0 con 0x7fbac00f67b0 2022-02-02T13:37:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56328/0 (socket says 172.21.15.33:56328) 2022-02-02T13:37:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 -- 172.21.15.33:0/3075783108 learned_addr learned my addr 172.21.15.33:0/3075783108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:05.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabeffd700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 0x7fbac01095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:05.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 -- 172.21.15.33:0/3075783108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 msgr2=0x7fbac01095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:05.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 0x7fbac01095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 -- 172.21.15.33:0/3075783108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4005040 con 0x7fbac00f5510 2022-02-02T13:37:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.645+0000 7fbabf7fe700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbab4007a60 tx=0x7fbab4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.646+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab4018070 con 0x7fbac00f5510 2022-02-02T13:37:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.646+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac010a5e0 con 0x7fbac00f5510 2022-02-02T13:37:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.646+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fbab4013410 con 0x7fbac00f5510 2022-02-02T13:37:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.646+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab401c400 con 0x7fbac00f5510 2022-02-02T13:37:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.646+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac010ab40 con 0x7fbac00f5510 2022-02-02T13:37:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.647+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac0045ad0 con 0x7fbac00f5510 2022-02-02T13:37:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.647+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbab401d420 con 0x7fbac00f5510 2022-02-02T13:37:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.647+0000 7fbaa7fff700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 0x7fbaa805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.647+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fbab4077a50 con 0x7fbac00f5510 2022-02-02T13:37:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.647+0000 7fbabeffd700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 0x7fbaa805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.648+0000 7fbabeffd700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 0x7fbaa805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbab00041d0 tx=0x7fbab0009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.651+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbab404aa70 con 0x7fbac00f5510 2022-02-02T13:37:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:05 smithi037 conmon[35544]: cluster 2022-02-02T13:37:03.525921+0000 mgr.smithi033.xvkvzp (mgr.14164) 167 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:05.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.806+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbac00fa9f0 con 0x7fbaa805c2b0 2022-02-02T13:37:05.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.808+0000 7fbaa7fff700 1 -- 172.21.15.33:0/3075783108 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24193 (secure 0 0 0) 0x7fbac00fa9f0 con 0x7fbaa805c2b0 2022-02-02T13:37:05.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:05.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 msgr2=0x7fbaa805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 0x7fbaa805e770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fbab00041d0 tx=0x7fbab0009040).stop 2022-02-02T13:37:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 msgr2=0x7fbac01090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fbab4007a60 tx=0x7fbab4009b30).stop 2022-02-02T13:37:05.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 shutdown_connections 2022-02-02T13:37:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbaa805c2b0 0x7fbaa805e770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f5510 0x7fbac01090c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 --2- 172.21.15.33:0/3075783108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f67b0 0x7fbac01095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:05.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 >> 172.21.15.33:0/3075783108 conn(0x7fbac00f0c70 msgr2=0x7fbac00603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 shutdown_connections 2022-02-02T13:37:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:05.810+0000 7fbac4aba700 1 -- 172.21.15.33:0/3075783108 wait complete. 2022-02-02T13:37:05.813 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2022-02-02T13:37:06.252 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2022-02-02T13:37:05.526102+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":30984,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":28992,"kb_avail":562439928,"statfs":{"total":575970213888,"available":575938486272,"internally_reserved":0,"allocated":1990656,"data_stored":730146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29687808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"34","reported_epoch":"36","state":"active+clean","last_fresh":"2022-02-02T13:36:30.428635+0000","last_change":"2022-02-02T13:36:14.023576+0000","last_active":"2022-02-02T13:36:30.428635+0000","last_peered":"2022-02-02T13:36:30.428635+0000","last_clean":"2022-02-02T13:36:30.428635+0000","last_became_active":"2022-02-02T13:36:14.023235+0000","last_became_peered":"2022-02-02T13:36:14.023235+0000","last_unstale":"2022-02-02T13:36:30.428635+0000","last_undegraded":"2022-02-02T13:36:30.428635+0000","last_fullsized":"2022-02-02T13:36:30.428635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-02T13:35:51.727376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-02T13:35:51.727376+0000","last_clean_scrub_stamp":"2022-02-02T13:35:51.727376+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.435}]},{"osd":2,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378644,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:44 2022","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Feb 2 13:36:44 2022","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.311},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.32600000000000001}]},{"osd":3,"last update":"Wed Feb 2 13:36:58 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705690,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 2 13:36:27 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.32400000000000001}]},{"osd":2,"last update":"Wed Feb 2 13:36:45 2022","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.27200000000000002}]},{"osd":3,"last update":"Wed Feb 2 13:36:59 2022","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.67300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:26 2022","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Wed Feb 2 13:36:41 2022","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Feb 2 13:36:58 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-02-02T13:37:06.253 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-02-02T13:37:06.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:37:06.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:06 smithi033 conmon[31996]: cluster 2022-02-02T13:37:05.526283+0000 mgr.smithi033.xvkvzp (mgr.14164) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:06.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:06 smithi033 conmon[31996]: audit 2022-02-02T13:37:05.807871+0000 mgr.smithi033.xvkvzp (mgr.14164) 169 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T13:37:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:06 smithi037 conmon[35544]: cluster 2022-02-02T13:37:05.526283+0000 mgr.smithi033.xvkvzp (mgr.14164) 168 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:06 smithi037 conmon[35544]: audit 2022-02-02T13:37:05.807871+0000 mgr.smithi033.xvkvzp (mgr.14164) 169 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T13:37:07.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 -- 172.21.15.33:0/3984212502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f67c0 msgr2=0x7f25580f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:07.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 --2- 172.21.15.33:0/3984212502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f67c0 0x7f25580f6be0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2554004660 tx=0x7f2554009b30).stop 2022-02-02T13:37:07.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 -- 172.21.15.33:0/3984212502 shutdown_connections 2022-02-02T13:37:07.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 --2- 172.21.15.33:0/3984212502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f7a60 0x7f25580f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:07.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 --2- 172.21.15.33:0/3984212502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f67c0 0x7f25580f6be0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:07.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 -- 172.21.15.33:0/3984212502 >> 172.21.15.33:0/3984212502 conn(0x7f25580f1f20 msgr2=0x7f25580f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:07.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 -- 172.21.15.33:0/3984212502 shutdown_connections 2022-02-02T13:37:07.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.870+0000 7f255f977700 1 -- 172.21.15.33:0/3984212502 wait complete. 2022-02-02T13:37:07.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 Processor -- start 2022-02-02T13:37:07.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 -- start start 2022-02-02T13:37:07.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f67c0 0x7f255806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:07.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:07.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255806a410 con 0x7f25580f7a60 2022-02-02T13:37:07.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255f977700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255806a550 con 0x7f25580f67c0 2022-02-02T13:37:07.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:07.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56338/0 (socket says 172.21.15.33:56338) 2022-02-02T13:37:07.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 -- 172.21.15.33:0/2628941060 learned_addr learned my addr 172.21.15.33:0/2628941060 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:07.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255d713700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f67c0 0x7f255806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:07.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 -- 172.21.15.33:0/2628941060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f67c0 msgr2=0x7f255806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:07.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f67c0 0x7f255806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:07.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.871+0000 7f255cf12700 1 -- 172.21.15.33:0/2628941060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005040 con 0x7f25580f7a60 2022-02-02T13:37:07.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f255cf12700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f254c00b410 tx=0x7f254c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:07.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f254c0125f0 con 0x7f25580f7a60 2022-02-02T13:37:07.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f254c012be0 con 0x7f25580f7a60 2022-02-02T13:37:07.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255806a830 con 0x7f25580f7a60 2022-02-02T13:37:07.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f254c002a00 con 0x7f25580f7a60 2022-02-02T13:37:07.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.872+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255810f0e0 con 0x7f25580f7a60 2022-02-02T13:37:07.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.873+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2558045ad0 con 0x7f25580f7a60 2022-02-02T13:37:07.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.873+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f254c00f030 con 0x7f25580f7a60 2022-02-02T13:37:07.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.874+0000 7f2549ffb700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 0x7f254405e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:07.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.874+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f254c075ff0 con 0x7f25580f7a60 2022-02-02T13:37:07.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.874+0000 7f255d713700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 0x7f254405e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:07.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.874+0000 7f255d713700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 0x7f254405e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f2554004e30 tx=0x7f2554009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:07.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:07.878+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f254c049030 con 0x7f25580f7a60 2022-02-02T13:37:08.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.034+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25580ff170 con 0x7f254405c2a0 2022-02-02T13:37:08.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.035+0000 7f2549ffb700 1 -- 172.21.15.33:0/2628941060 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+24180 (secure 0 0 0) 0x7f25580ff170 con 0x7f254405c2a0 2022-02-02T13:37:08.036 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 msgr2=0x7f254405e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:08.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 0x7f254405e760 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f2554004e30 tx=0x7f2554009b30).stop 2022-02-02T13:37:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 msgr2=0x7f2558069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f254c00b410 tx=0x7f254c006ef0).stop 2022-02-02T13:37:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 shutdown_connections 2022-02-02T13:37:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f254405c2a0 0x7f254405e760 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:08.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25580f67c0 0x7f255806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:08.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 --2- 172.21.15.33:0/2628941060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25580f7a60 0x7f2558069e20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:08.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 >> 172.21.15.33:0/2628941060 conn(0x7f25580f1f20 msgr2=0x7f25580fb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:08.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 shutdown_connections 2022-02-02T13:37:08.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:08.037+0000 7f255f977700 1 -- 172.21.15.33:0/2628941060 wait complete. 2022-02-02T13:37:08.040 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2022-02-02T13:37:08.408 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2022-02-02T13:37:07.526449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":30984,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":28992,"kb_avail":562439928,"statfs":{"total":575970213888,"available":575938486272,"internally_reserved":0,"allocated":1990656,"data_stored":730146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29687808},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"34","reported_epoch":"36","state":"active+clean","last_fresh":"2022-02-02T13:36:30.428635+0000","last_change":"2022-02-02T13:36:14.023576+0000","last_active":"2022-02-02T13:36:30.428635+0000","last_peered":"2022-02-02T13:36:30.428635+0000","last_clean":"2022-02-02T13:36:30.428635+0000","last_became_active":"2022-02-02T13:36:14.023235+0000","last_became_peered":"2022-02-02T13:36:14.023235+0000","last_unstale":"2022-02-02T13:36:30.428635+0000","last_undegraded":"2022-02-02T13:36:30.428635+0000","last_fullsized":"2022-02-02T13:36:30.428635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-02T13:35:51.727376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-02T13:35:51.727376+0000","last_clean_scrub_stamp":"2022-02-02T13:35:51.727376+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":36,"seq":154618822667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953485,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5068,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93740084,"statfs":{"total":95995035648,"available":95989846016,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5132,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93740020,"statfs":{"total":95995035648,"available":95989780480,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.435}]},{"osd":2,"last update":"Wed Feb 2 13:36:57 2022","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.46300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]}]},{"osd":2,"up_from":19,"seq":81604378645,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5196,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739956,"statfs":{"total":95995035648,"available":95989714944,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:44 2022","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.378}]},{"osd":1,"last update":"Wed Feb 2 13:36:44 2022","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.39600000000000002}]},{"osd":3,"last update":"Wed Feb 2 13:36:58 2022","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 2 13:36:27 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Feb 2 13:36:45 2022","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Feb 2 13:36:59 2022","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.622}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5260,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739892,"statfs":{"total":95995035648,"available":95989649408,"internally_reserved":0,"allocated":331776,"data_stored":121691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 2 13:36:26 2022","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Wed Feb 2 13:36:41 2022","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Feb 2 13:36:58 2022","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-02-02T13:37:08.410 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2022-02-02T13:37:08.410 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-02-02T13:37:08.410 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2022-02-02T13:37:08.411 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph health --format=json 2022-02-02T13:37:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:37:09.091 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:08 smithi033 conmon[31996]: cluster 2022-02-02T13:37:07.526578+0000 2022-02-02T13:37:09.092 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:08 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 170 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:09.092 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:08 smithi033 conmon[31996]: audit 2022-02-02T13:37:08.035129+0000 mgr.smithi033.xvkvzp (mgr.14164) 171 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T13:37:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:08 smithi037 conmon[35544]: cluster 2022-02-02T13:37:07.526578+0000 mgr.smithi033.xvkvzp (mgr.14164) 170 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:08 smithi037 conmon[35544]: audit 2022-02-02T13:37:08.035129+0000 mgr.smithi033.xvkvzp (mgr.14164) 171 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-02-02T13:37:10.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 -- 172.21.15.33:0/3108594963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc374060870 msgr2=0x7fc3740f93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:10.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 --2- 172.21.15.33:0/3108594963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc374060870 0x7fc3740f93a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fc364004660 tx=0x7fc364009b30).stop 2022-02-02T13:37:10.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 -- 172.21.15.33:0/3108594963 shutdown_connections 2022-02-02T13:37:10.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 --2- 172.21.15.33:0/3108594963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3740f9920 0x7fc3740fbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:10.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 --2- 172.21.15.33:0/3108594963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc374060870 0x7fc3740f93a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:10.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 -- 172.21.15.33:0/3108594963 >> 172.21.15.33:0/3108594963 conn(0x7fc3740f0e20 msgr2=0x7fc3740f3240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:10.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 -- 172.21.15.33:0/3108594963 shutdown_connections 2022-02-02T13:37:10.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.138+0000 7fc37a513700 1 -- 172.21.15.33:0/3108594963 wait complete. 2022-02-02T13:37:10.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 Processor -- start 2022-02-02T13:37:10.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 -- start start 2022-02-02T13:37:10.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc374060870 0x7fc3740f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:10.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740f5890 con 0x7fc3740f9920 2022-02-02T13:37:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc37a513700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740f59d0 con 0x7fc374060870 2022-02-02T13:37:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.139+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56348/0 (socket says 172.21.15.33:56348) 2022-02-02T13:37:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 -- 172.21.15.33:0/697194382 learned_addr learned my addr 172.21.15.33:0/697194382 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc373fff700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc374060870 0x7fc3740f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 -- 172.21.15.33:0/697194382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc374060870 msgr2=0x7fc3740f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc374060870 0x7fc3740f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 -- 172.21.15.33:0/697194382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc364005040 con 0x7fc3740f9920 2022-02-02T13:37:10.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc3737fe700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fc3680093f0 tx=0x7fc368006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:10.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc368013640 con 0x7fc3740f9920 2022-02-02T13:37:10.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3740f5cb0 con 0x7fc3740f9920 2022-02-02T13:37:10.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc368013c30 con 0x7fc3740f9920 2022-02-02T13:37:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc368012be0 con 0x7fc3740f9920 2022-02-02T13:37:10.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.140+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37410f0b0 con 0x7fc3740f9920 2022-02-02T13:37:10.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.141+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374045ad0 con 0x7fc3740f9920 2022-02-02T13:37:10.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.142+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc36801a060 con 0x7fc3740f9920 2022-02-02T13:37:10.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.142+0000 7fc370ff9700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 0x7fc35c05e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:10.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.143+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fc368075f30 con 0x7fc3740f9920 2022-02-02T13:37:10.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.143+0000 7fc373fff700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 0x7fc35c05e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:10.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.143+0000 7fc373fff700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 0x7fc35c05e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc364004630 tx=0x7fc364009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:10.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.146+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc368048fe0 con 0x7fc3740f9920 2022-02-02T13:37:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.363+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc3740ff160 con 0x7fc3740f9920 2022-02-02T13:37:10.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.363+0000 7fc370ff9700 1 -- 172.21.15.33:0/697194382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fc36804c600 con 0x7fc3740f9920 2022-02-02T13:37:10.364 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:10.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 msgr2=0x7fc35c05e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 0x7fc35c05e760 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc364004630 tx=0x7fc364009b30).stop 2022-02-02T13:37:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 msgr2=0x7fc3740f52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fc3680093f0 tx=0x7fc368006ec0).stop 2022-02-02T13:37:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 shutdown_connections 2022-02-02T13:37:10.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc35c05c2a0 0x7fc35c05e760 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc374060870 0x7fc3740f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 --2- 172.21.15.33:0/697194382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3740f9920 0x7fc3740f52a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 >> 172.21.15.33:0/697194382 conn(0x7fc3740f0e20 msgr2=0x7fc3740f3210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:10.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 shutdown_connections 2022-02-02T13:37:10.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:10.365+0000 7fc37a513700 1 -- 172.21.15.33:0/697194382 wait complete. 2022-02-02T13:37:10.773 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-02-02T13:37:10.773 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2022-02-02T13:37:10.774 INFO:tasks.cephadm:Setup complete, yielding 2022-02-02T13:37:10.774 INFO:teuthology.run_tasks:Running task print... 2022-02-02T13:37:10.786 INFO:teuthology.task.print:**** done starting v16.2.4 2022-02-02T13:37:10.787 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:10.865 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:10.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph orch status' 2022-02-02T13:37:11.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:10 smithi033 conmon[31996]: cluster 2022-02-02T13:37:09.526977+0000 mgr.smithi033.xvkvzp (mgr.14164) 172 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:11.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:10 smithi033 conmon[31996]: audit 2022-02-02T13:37:10.364634+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.33:0/697194382' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-02-02T13:37:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:10 smithi037 conmon[35544]: cluster 2022-02-02T13:37:09.526977+0000 mgr.smithi033.xvkvzp (mgr.14164) 172 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:10 smithi037 conmon[35544]: audit 2022-02-02T13:37:10.364634+0000 mon.smithi033 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.33:0/697194382' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-02-02T13:37:12.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2263515577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 msgr2=0x7fa7040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:12.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2263515577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa7040f59e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa6f4004660 tx=0x7fa6f4009b30).stop 2022-02-02T13:37:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2263515577 shutdown_connections 2022-02-02T13:37:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2263515577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa7040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2263515577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa7040f59e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2263515577 >> 172.21.15.33:0/2263515577 conn(0x7fa7040f0d40 msgr2=0x7fa7040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:12.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2263515577 shutdown_connections 2022-02-02T13:37:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2263515577 wait complete. 2022-02-02T13:37:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.330+0000 7fa70c4e2700 1 Processor -- start 2022-02-02T13:37:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70c4e2700 1 -- start start 2022-02-02T13:37:12.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70c4e2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70c4e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa70410c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70c4e2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040604b0 con 0x7fa7040f55c0 2022-02-02T13:37:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70c4e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040605f0 con 0x7fa7040f6860 2022-02-02T13:37:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56356/0 (socket says 172.21.15.33:56356) 2022-02-02T13:37:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 -- 172.21.15.33:0/2832379777 learned_addr learned my addr 172.21.15.33:0/2832379777 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa709a7d700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa70410c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 -- 172.21.15.33:0/2832379777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 msgr2=0x7fa70410c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa70410c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 -- 172.21.15.33:0/2832379777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f4005040 con 0x7fa7040f55c0 2022-02-02T13:37:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa709a7d700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa70410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:37:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.331+0000 7fa70a27e700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fa6f4007a60 tx=0x7fa6f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.332+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4018070 con 0x7fa7040f55c0 2022-02-02T13:37:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.332+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fa6f4013410 con 0x7fa7040f55c0 2022-02-02T13:37:12.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.332+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70410c780 con 0x7fa7040f55c0 2022-02-02T13:37:12.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.332+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6f401c620 con 0x7fa7040f55c0 2022-02-02T13:37:12.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.332+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70410cce0 con 0x7fa7040f55c0 2022-02-02T13:37:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.333+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa704045ad0 con 0x7fa7040f55c0 2022-02-02T13:37:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.333+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fa6f401d940 con 0x7fa7040f55c0 2022-02-02T13:37:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.334+0000 7fa6faffd700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 0x7fa6f005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.334+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fa6f4077b40 con 0x7fa7040f55c0 2022-02-02T13:37:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.334+0000 7fa709a7d700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 0x7fa6f005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:12.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.334+0000 7fa709a7d700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 0x7fa6f005e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa70000b830 tx=0x7fa700008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:12.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.338+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fa6f404ab60 con 0x7fa7040f55c0 2022-02-02T13:37:12.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.529+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7040fdf10 con 0x7fa6f005c2b0 2022-02-02T13:37:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.530+0000 7fa6faffd700 1 -- 172.21.15.33:0/2832379777 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa7040fdf10 con 0x7fa6f005c2b0 2022-02-02T13:37:12.531 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2022-02-02T13:37:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2022-02-02T13:37:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2022-02-02T13:37:12.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 msgr2=0x7fa6f005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:12.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 0x7fa6f005e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fa70000b830 tx=0x7fa700008040).stop 2022-02-02T13:37:12.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 msgr2=0x7fa704109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:12.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fa6f4007a60 tx=0x7fa6f4009b30).stop 2022-02-02T13:37:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 shutdown_connections 2022-02-02T13:37:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fa6f005c2b0 0x7fa6f005e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7040f55c0 0x7fa704109c80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 --2- 172.21.15.33:0/2832379777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7040f6860 0x7fa70410c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 >> 172.21.15.33:0/2832379777 conn(0x7fa7040f0d40 msgr2=0x7fa7040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 shutdown_connections 2022-02-02T13:37:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:12.532+0000 7fa70c4e2700 1 -- 172.21.15.33:0/2832379777 wait complete. 2022-02-02T13:37:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:12 smithi033 conmon[31996]: cluster 2022-02-02T13:37:11.527408+0000 mgr.smithi033.xvkvzp (mgr.14164) 173 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:12.993 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ps' 2022-02-02T13:37:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:12 smithi037 conmon[35544]: cluster 2022-02-02T13:37:11.527408+0000 mgr.smithi033.xvkvzp (mgr.14164) 173 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:13 smithi033 conmon[31996]: audit 2022-02-02T13:37:12.531259+0000 mgr.smithi033.xvkvzp (mgr.14164) 174 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:13 smithi037 conmon[35544]: audit 2022-02-02T13:37:12.531259+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:13 smithi037 conmon[35544]: 14164) 174 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 -- 172.21.15.33:0/476006975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f5460 msgr2=0x7f4c740f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 --2- 172.21.15.33:0/476006975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f5460 0x7f4c740f5880 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f4c64004660 tx=0x7f4c64009b30).stop 2022-02-02T13:37:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 -- 172.21.15.33:0/476006975 shutdown_connections 2022-02-02T13:37:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 --2- 172.21.15.33:0/476006975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f6700 0x7f4c740f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 --2- 172.21.15.33:0/476006975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f5460 0x7f4c740f5880 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 -- 172.21.15.33:0/476006975 >> 172.21.15.33:0/476006975 conn(0x7f4c740f0bc0 msgr2=0x7f4c740f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 -- 172.21.15.33:0/476006975 shutdown_connections 2022-02-02T13:37:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 -- 172.21.15.33:0/476006975 wait complete. 2022-02-02T13:37:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.671+0000 7f4c7937a700 1 Processor -- start 2022-02-02T13:37:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c7937a700 1 -- start start 2022-02-02T13:37:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c7937a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f5460 0x7f4c74109a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c7937a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c7937a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c740603e0 con 0x7f4c740f6700 2022-02-02T13:37:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c7937a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c74060520 con 0x7f4c740f5460 2022-02-02T13:37:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56368/0 (socket says 172.21.15.33:56368) 2022-02-02T13:37:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 -- 172.21.15.33:0/4104936959 learned_addr learned my addr 172.21.15.33:0/4104936959 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c72ffd700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f5460 0x7f4c74109a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 -- 172.21.15.33:0/4104936959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f5460 msgr2=0x7f4c74109a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f5460 0x7f4c74109a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 -- 172.21.15.33:0/4104936959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c64005040 con 0x7f4c740f6700 2022-02-02T13:37:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c727fc700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f4c6800e7f0 tx=0x7f4c6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.672+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c680092e0 con 0x7f4c740f6700 2022-02-02T13:37:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.673+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7410c510 con 0x7f4c740f6700 2022-02-02T13:37:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.673+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4c6800f040 con 0x7f4c740f6700 2022-02-02T13:37:14.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.673+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c680146c0 con 0x7f4c740f6700 2022-02-02T13:37:14.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.673+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7410cad0 con 0x7f4c740f6700 2022-02-02T13:37:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.673+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74045ad0 con 0x7f4c740f6700 2022-02-02T13:37:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.675+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4c6801b030 con 0x7f4c740f6700 2022-02-02T13:37:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.675+0000 7f4c5b7fe700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 0x7f4c5c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.675+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f4c68075a10 con 0x7f4c740f6700 2022-02-02T13:37:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.675+0000 7f4c72ffd700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 0x7f4c5c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.675+0000 7f4c72ffd700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 0x7f4c5c05e7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4c64000c00 tx=0x7f4c64016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.678+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4c68048a80 con 0x7f4c740f6700 2022-02-02T13:37:14.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.864+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c740fddd0 con 0x7f4c5c05c300 2022-02-02T13:37:14.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.875+0000 7f4c5b7fe700 1 -- 172.21.15.33:0/4104936959 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2160 (secure 0 0 0) 0x7f4c6400f070 con 0x7f4c5c05c300 2022-02-02T13:37:14.875 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T13:37:14.875 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (2m) 56s ago 3m 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:37:14.876 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 56s ago 3m 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:37:14.876 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (3m) 48s ago 3m 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:37:14.876 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (2m) 56s ago 3m 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:37:14.877 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:9283 running (4m) 56s ago 4m 16.2.4 8d91d370c2b8 6ca660d1efdc 2022-02-02T13:37:14.877 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (2m) 48s ago 2m 16.2.4 8d91d370c2b8 63353a09a0c3 2022-02-02T13:37:14.877 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 56s ago 4m 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:37:14.877 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (2m) 48s ago 2m 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:37:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (3m) 56s ago 3m 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:37:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (2m) 48s ago 2m 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:37:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 56s ago 2m 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:37:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (117s) 56s ago 116s 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:37:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (99s) 56s ago 99s 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:37:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (84s) 48s ago 84s 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:37:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (67s) 48s ago 67s 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:37:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (51s) 48s ago 51s 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:37:14.880 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (2m) 56s ago 3m 2.18.1 de242295e225 27dc47493263 2022-02-02T13:37:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 msgr2=0x7f4c5c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 0x7f4c5c05e7c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4c64000c00 tx=0x7f4c64016040).stop 2022-02-02T13:37:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 msgr2=0x7f4c7410bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f4c6800e7f0 tx=0x7f4c6800b040).stop 2022-02-02T13:37:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 shutdown_connections 2022-02-02T13:37:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4c5c05c300 0x7f4c5c05e7c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c740f5460 0x7f4c74109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 --2- 172.21.15.33:0/4104936959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c740f6700 0x7f4c7410bf60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:14.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 >> 172.21.15.33:0/4104936959 conn(0x7f4c740f0bc0 msgr2=0x7f4c740fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 shutdown_connections 2022-02-02T13:37:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:14.876+0000 7f4c7937a700 1 -- 172.21.15.33:0/4104936959 wait complete. 2022-02-02T13:37:14.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:14 smithi033 conmon[31996]: cluster 2022-02-02T13:37:13.527804 2022-02-02T13:37:14.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:14 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:14 smithi037 conmon[35544]: cluster 2022-02-02T13:37:13.527804+0000 mgr.smithi033.xvkvzp (mgr.14164) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:15.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ls' 2022-02-02T13:37:16.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:15 smithi033 conmon[31996]: audit 2022-02-02T13:37:14.866269+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:16.055 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:15 smithi033 conmon[31996]: 14164) 176 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:15 smithi037 conmon[35544]: audit 2022-02-02T13:37:14.866269+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:37:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:15 smithi037 conmon[35544]: 176 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:16.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.863+0000 7f0541e23700 1 -- 172.21.15.33:0/2395010073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f5430 msgr2=0x7f053c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:16.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.863+0000 7f0541e23700 1 --2- 172.21.15.33:0/2395010073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f5430 0x7f053c0f5850 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f0530004660 tx=0x7f0530009b30).stop 2022-02-02T13:37:16.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.863+0000 7f0541e23700 1 -- 172.21.15.33:0/2395010073 shutdown_connections 2022-02-02T13:37:16.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.863+0000 7f0541e23700 1 --2- 172.21.15.33:0/2395010073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f66d0 0x7f053c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:16.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 --2- 172.21.15.33:0/2395010073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f5430 0x7f053c0f5850 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:16.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 -- 172.21.15.33:0/2395010073 >> 172.21.15.33:0/2395010073 conn(0x7f053c0f0b90 msgr2=0x7f053c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:16.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 -- 172.21.15.33:0/2395010073 shutdown_connections 2022-02-02T13:37:16.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 -- 172.21.15.33:0/2395010073 wait complete. 2022-02-02T13:37:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 Processor -- start 2022-02-02T13:37:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.864+0000 7f0541e23700 1 -- start start 2022-02-02T13:37:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f0541e23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f5430 0x7f053c109a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f0541e23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f0541e23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c060420 con 0x7f053c0f66d0 2022-02-02T13:37:16.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f0541e23700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053c060560 con 0x7f053c0f5430 2022-02-02T13:37:16.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:16.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56378/0 (socket says 172.21.15.33:56378) 2022-02-02T13:37:16.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 -- 172.21.15.33:0/3948911835 learned_addr learned my addr 172.21.15.33:0/3948911835 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:16.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f0540e21700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f5430 0x7f053c109a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:16.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 -- 172.21.15.33:0/3948911835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f5430 msgr2=0x7f053c109a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:16.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f5430 0x7f053c109a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:16.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 -- 172.21.15.33:0/3948911835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530005040 con 0x7f053c0f66d0 2022-02-02T13:37:16.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f053bfff700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f052800c790 tx=0x7f0528007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:16.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.865+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f052800e680 con 0x7f053c0f66d0 2022-02-02T13:37:16.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.866+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f052800ec70 con 0x7f053c0f66d0 2022-02-02T13:37:16.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.866+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053c10c560 con 0x7f053c0f66d0 2022-02-02T13:37:16.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.866+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0528013d30 con 0x7f053c0f66d0 2022-02-02T13:37:16.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.866+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053c10caf0 con 0x7f053c0f66d0 2022-02-02T13:37:16.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.867+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053c045ad0 con 0x7f053c0f66d0 2022-02-02T13:37:16.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.867+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f052801a060 con 0x7f053c0f66d0 2022-02-02T13:37:16.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.867+0000 7f05397fa700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 0x7f052c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:16.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.867+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f0528075d30 con 0x7f053c0f66d0 2022-02-02T13:37:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.868+0000 7f0540e21700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 0x7f052c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.868+0000 7f0540e21700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 0x7f052c05e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0530009d60 tx=0x7f0530009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:16.872+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0528048dd0 con 0x7f053c0f66d0 2022-02-02T13:37:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.056+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f053c0fdd60 con 0x7f052c05c300 2022-02-02T13:37:17.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.061+0000 7f05397fa700 1 -- 172.21.15.33:0/3948911835 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1107 (secure 0 0 0) 0x7f053c0fdd60 con 0x7f052c05c300 2022-02-02T13:37:17.062 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2022-02-02T13:37:17.062 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager 1/1 58s ago 4m count:1 2022-02-02T13:37:17.063 INFO:teuthology.orchestra.run.smithi033.stdout:crash 2/2 58s ago 4m * 2022-02-02T13:37:17.063 INFO:teuthology.orchestra.run.smithi033.stdout:grafana 1/1 58s ago 4m count:1 2022-02-02T13:37:17.063 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 2/2 58s ago 4m count:2 2022-02-02T13:37:17.063 INFO:teuthology.orchestra.run.smithi033.stdout:mon 2/2 58s ago 3m smithi033:172.21.15.33=smithi033;smithi037:172.21.15.37=smithi037;count:2 2022-02-02T13:37:17.064 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter 2/2 58s ago 4m * 2022-02-02T13:37:17.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.unmanaged 6/6 58s ago - 2022-02-02T13:37:17.064 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus 1/1 58s ago 4m count:1 2022-02-02T13:37:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.063+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 msgr2=0x7f052c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.063+0000 7f0541e23700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 0x7f052c05e7c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f0530009d60 tx=0x7f0530009b30).stop 2022-02-02T13:37:17.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.063+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 msgr2=0x7f053c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:17.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.063+0000 7f0541e23700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f052800c790 tx=0x7f0528007d70).stop 2022-02-02T13:37:17.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 shutdown_connections 2022-02-02T13:37:17.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f052c05c300 0x7f052c05e7c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:17.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f053c0f5430 0x7f053c109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:17.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 --2- 172.21.15.33:0/3948911835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f053c0f66d0 0x7f053c10bf50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:17.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 >> 172.21.15.33:0/3948911835 conn(0x7f053c0f0b90 msgr2=0x7f053c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:17.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 shutdown_connections 2022-02-02T13:37:17.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:17.064+0000 7f0541e23700 1 -- 172.21.15.33:0/3948911835 wait complete. 2022-02-02T13:37:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:16 smithi033 conmon[31996]: cluster 2022-02-02T13:37:15.528120+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:16 smithi033 conmon[31996]: 14164) 177 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:16 smithi037 conmon[35544]: cluster 2022-02-02T13:37:15.528120+0000 mgr.smithi033.xvkvzp (mgr.14164) 177 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:17.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph orch host ls' 2022-02-02T13:37:18.215 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:17 smithi033 conmon[31996]: audit 2022-02-02T13:37:17.058154+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:37:18.215 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:17 smithi033 conmon[31996]: mgr.14164) 178 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:17 smithi037 conmon[35544]: audit 2022-02-02T13:37:17.058154+0000 mgr.smithi033.xvkvzp (mgr.14164) 178 : audit [DBG] from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:19.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 -- 172.21.15.33:0/4253329701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f66d0 msgr2=0x7f5f3c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:19.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/4253329701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c0f6b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f5f2c004660 tx=0x7f5f2c009b30).stop 2022-02-02T13:37:19.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 -- 172.21.15.33:0/4253329701 shutdown_connections 2022-02-02T13:37:19.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/4253329701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c0f6b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/4253329701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.196+0000 7f5f3b59e700 1 -- 172.21.15.33:0/4253329701 >> 172.21.15.33:0/4253329701 conn(0x7f5f3c0f0b90 msgr2=0x7f5f3c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.197+0000 7f5f3b59e700 1 -- 172.21.15.33:0/4253329701 shutdown_connections 2022-02-02T13:37:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.197+0000 7f5f3b59e700 1 -- 172.21.15.33:0/4253329701 wait complete. 2022-02-02T13:37:19.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.197+0000 7f5f3b59e700 1 Processor -- start 2022-02-02T13:37:19.200 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:18 smithi033 conmon[31996]: cluster 2022-02-02T13:37:17.528477+0000 mgr.smithi033.xvkvzp (mgr.14164) 179 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:19.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.197+0000 7f5f3b59e700 1 -- start start 2022-02-02T13:37:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c106760 con 0x7f5f3c0f5430 2022-02-02T13:37:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c106f60 con 0x7f5f3c0f66d0 2022-02-02T13:37:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56386/0 (socket says 172.21.15.33:56386) 2022-02-02T13:37:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 -- 172.21.15.33:0/3895859182 learned_addr learned my addr 172.21.15.33:0/3895859182 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f39d9b700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 -- 172.21.15.33:0/3895859182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f66d0 msgr2=0x7f5f3c1061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c1061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 -- 172.21.15.33:0/3895859182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c005040 con 0x7f5f3c0f5430 2022-02-02T13:37:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f3a59c700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5f2400e9a0 tx=0x7f5f24007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.198+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2400c9b0 con 0x7f5f3c0f5430 2022-02-02T13:37:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.199+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f5f24011470 con 0x7f5f3c0f5430 2022-02-02T13:37:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.199+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c1071e0 con 0x7f5f3c0f5430 2022-02-02T13:37:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.199+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f24010610 con 0x7f5f3c0f5430 2022-02-02T13:37:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.199+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c107750 con 0x7f5f3c0f5430 2022-02-02T13:37:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.200+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f5f24010880 con 0x7f5f3c0f5430 2022-02-02T13:37:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.200+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c059100 con 0x7f5f3c0f5430 2022-02-02T13:37:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.200+0000 7f5f32ffd700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 0x7f5f2805e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.201+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f5f24078ad0 con 0x7f5f3c0f5430 2022-02-02T13:37:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.201+0000 7f5f39d9b700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 0x7f5f2805e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:19.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.201+0000 7f5f39d9b700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 0x7f5f2805e7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5f2c004e30 tx=0x7f5f2c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:19.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.205+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f5f2404c9f0 con 0x7f5f3c0f5430 2022-02-02T13:37:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:18 smithi037 conmon[35544]: cluster 2022-02-02T13:37:17.528477+0000 mgr.smithi033.xvkvzp (mgr.14164) 179 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:19.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.387+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f3c0ff670 con 0x7f5f2805c2e0 2022-02-02T13:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.388+0000 7f5f32ffd700 1 -- 172.21.15.33:0/3895859182 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+126 (secure 0 0 0) 0x7f5f3c0ff670 con 0x7f5f2805c2e0 2022-02-02T13:37:19.389 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2022-02-02T13:37:19.389 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2022-02-02T13:37:19.389 INFO:teuthology.orchestra.run.smithi033.stdout:smithi037 smithi037 2022-02-02T13:37:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 msgr2=0x7f5f2805e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:19.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 0x7f5f2805e7a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f5f2c004e30 tx=0x7f5f2c009b30).stop 2022-02-02T13:37:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 msgr2=0x7f5f3c105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f5f2400e9a0 tx=0x7f5f24007e20).stop 2022-02-02T13:37:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 shutdown_connections 2022-02-02T13:37:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f5f2805c2e0 0x7f5f2805e7a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f3c0f5430 0x7f5f3c105cc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 --2- 172.21.15.33:0/3895859182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f3c0f66d0 0x7f5f3c1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 >> 172.21.15.33:0/3895859182 conn(0x7f5f3c0f0b90 msgr2=0x7f5f3c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 shutdown_connections 2022-02-02T13:37:19.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:19.390+0000 7f5f3b59e700 1 -- 172.21.15.33:0/3895859182 wait complete. 2022-02-02T13:37:19.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph orch device ls' 2022-02-02T13:37:19.891 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:19 smithi033 conmon[31996]: audit 2022-02-02T13:37:19.388577+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:19.892 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:19 smithi033 conmon[31996]: 14164) 180 : audit [DBG] from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:19 smithi037 conmon[35544]: audit 2022-02-02T13:37:19.388577+0000 mgr.smithi033.xvkvzp (mgr.14164) 180 : audit [DBG] from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:21.125 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:20 smithi033 conmon[31996]: cluster 2022-02-02T13:37:19.528968+0000 mgr.smithi033.xvkvzp (mgr.14164) 181 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:20 smithi037 conmon[35544]: cluster 2022-02-02T13:37:19.528968+0000 mgr.smithi033.xvkvzp (mgr.14164) 181 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:21.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 -- 172.21.15.33:0/806093947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 msgr2=0x7f9c880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:21.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/806093947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c880f59e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f9c78004660 tx=0x7f9c78009b30).stop 2022-02-02T13:37:21.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 -- 172.21.15.33:0/806093947 shutdown_connections 2022-02-02T13:37:21.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/806093947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 0x7f9c880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/806093947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c880f59e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 -- 172.21.15.33:0/806093947 >> 172.21.15.33:0/806093947 conn(0x7f9c880f0d40 msgr2=0x7f9c880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:21.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 -- 172.21.15.33:0/806093947 shutdown_connections 2022-02-02T13:37:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 -- 172.21.15.33:0/806093947 wait complete. 2022-02-02T13:37:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.332+0000 7f9c8e06b700 1 Processor -- start 2022-02-02T13:37:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c8e06b700 1 -- start start 2022-02-02T13:37:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c8e06b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c8e06b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 0x7f9c8810c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c8e06b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88060420 con 0x7f9c880f55c0 2022-02-02T13:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c8e06b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88060560 con 0x7f9c880f6860 2022-02-02T13:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56396/0 (socket says 172.21.15.33:56396) 2022-02-02T13:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 -- 172.21.15.33:0/66980873 learned_addr learned my addr 172.21.15.33:0/66980873 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 -- 172.21.15.33:0/66980873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 msgr2=0x7f9c8810c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c86ffd700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 0x7f9c8810c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:21.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 0x7f9c8810c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 -- 172.21.15.33:0/66980873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78005040 con 0x7f9c880f55c0 2022-02-02T13:37:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.333+0000 7f9c877fe700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9c78007a60 tx=0x7f9c78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c78018070 con 0x7f9c880f55c0 2022-02-02T13:37:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8810c6b0 con 0x7f9c880f55c0 2022-02-02T13:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f9c78013410 con 0x7f9c880f55c0 2022-02-02T13:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7801c620 con 0x7f9c880f55c0 2022-02-02T13:37:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8810cbe0 con 0x7f9c880f55c0 2022-02-02T13:37:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.334+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c880f49b0 con 0x7f9c880f55c0 2022-02-02T13:37:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.335+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9c7801d940 con 0x7f9c880f55c0 2022-02-02T13:37:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.335+0000 7f9c7ffff700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 0x7f9c7405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.335+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7f9c78077b10 con 0x7f9c880f55c0 2022-02-02T13:37:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.335+0000 7f9c86ffd700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 0x7f9c7405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:21.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.336+0000 7f9c86ffd700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 0x7f9c7405e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9c700041d0 tx=0x7f9c70009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:21.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.339+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9c7804ab30 con 0x7f9c880f55c0 2022-02-02T13:37:21.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.527+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c880fdf30 con 0x7f9c7405c2b0 2022-02-02T13:37:21.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.529+0000 7f9c7ffff700 1 -- 172.21.15.33:0/66980873 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+279 (secure 0 0 0) 0x7f9c70012410 con 0x7f9c7405c2b0 2022-02-02T13:37:21.530 INFO:teuthology.orchestra.run.smithi033.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2022-02-02T13:37:21.530 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd CVFT5330008Q400BGN 400G Unknown N/A N/A No 2022-02-02T13:37:21.530 INFO:teuthology.orchestra.run.smithi033.stdout:smithi037 /dev/nvme0n1 ssd CVFT5331005T400BGN 400G Unknown N/A N/A No 2022-02-02T13:37:21.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 msgr2=0x7f9c7405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:21.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 0x7f9c7405e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f9c700041d0 tx=0x7f9c70009040).stop 2022-02-02T13:37:21.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 msgr2=0x7f9c88109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:21.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f9c78007a60 tx=0x7f9c78009b30).stop 2022-02-02T13:37:21.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 shutdown_connections 2022-02-02T13:37:21.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c7405c2b0 0x7f9c7405e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c880f55c0 0x7f9c88109c00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 --2- 172.21.15.33:0/66980873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c880f6860 0x7f9c8810c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:21.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 >> 172.21.15.33:0/66980873 conn(0x7f9c880f0d40 msgr2=0x7f9c880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:21.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 shutdown_connections 2022-02-02T13:37:21.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:21.531+0000 7f9c8e06b700 1 -- 172.21.15.33:0/66980873 wait complete. 2022-02-02T13:37:21.894 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:21.906 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:21.907 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs volume create cephfs --placement=4' 2022-02-02T13:37:22.979 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:22 smithi033 conmon[31996]: audit 2022-02-02T13:37:21.529272+0000 2022-02-02T13:37:22.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:22 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 182 : audit [DBG] from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:22.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:22 smithi033 conmon[31996]: cluster 2022-02-02T13:37:21.529452+0000 mgr.smithi033.xvkvzp (mgr.14164) 183 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:22 smithi037 conmon[35544]: audit 2022-02-02T13:37:21.529272+0000 mgr.smithi033.xvkvzp (mgr.14164) 182 : audit 2022-02-02T13:37:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:22 smithi037 conmon[35544]: [DBG] from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:23.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:22 smithi037 conmon[35544]: cluster 2022-02-02T13:37:21.529452+0000 mgr.smithi033.xvkvzp (mgr.14164) 183 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:23.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 -- 172.21.15.33:0/2130758944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f5440 msgr2=0x7fcb500f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:23.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 --2- 172.21.15.33:0/2130758944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f5440 0x7fcb500f5860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fcb4c004660 tx=0x7fcb4c009b30).stop 2022-02-02T13:37:23.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 -- 172.21.15.33:0/2130758944 shutdown_connections 2022-02-02T13:37:23.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 --2- 172.21.15.33:0/2130758944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f66e0 0x7fcb500f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:23.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 --2- 172.21.15.33:0/2130758944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f5440 0x7fcb500f5860 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:23.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 -- 172.21.15.33:0/2130758944 >> 172.21.15.33:0/2130758944 conn(0x7fcb500f0ba0 msgr2=0x7fcb500f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:23.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 -- 172.21.15.33:0/2130758944 shutdown_connections 2022-02-02T13:37:23.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.431+0000 7fcb56c54700 1 -- 172.21.15.33:0/2130758944 wait complete. 2022-02-02T13:37:23.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 Processor -- start 2022-02-02T13:37:23.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 -- start start 2022-02-02T13:37:23.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f5440 0x7fcb50109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:23.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:23.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50060450 con 0x7fcb500f66e0 2022-02-02T13:37:23.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb56c54700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb50060590 con 0x7fcb500f5440 2022-02-02T13:37:23.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.432+0000 7fcb55451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:23.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56408/0 (socket says 172.21.15.33:56408) 2022-02-02T13:37:23.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 -- 172.21.15.33:0/240156335 learned_addr learned my addr 172.21.15.33:0/240156335 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:23.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55c52700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f5440 0x7fcb50109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:23.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 -- 172.21.15.33:0/240156335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f5440 msgr2=0x7fcb50109aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f5440 0x7fcb50109aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 -- 172.21.15.33:0/240156335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c005040 con 0x7fcb500f66e0 2022-02-02T13:37:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb55451700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fcb4400b410 tx=0x7fcb44006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:23.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb440125f0 con 0x7fcb500f66e0 2022-02-02T13:37:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcb44012be0 con 0x7fcb500f66e0 2022-02-02T13:37:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5010c5b0 con 0x7fcb500f66e0 2022-02-02T13:37:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb44011c40 con 0x7fcb500f66e0 2022-02-02T13:37:23.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.433+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5010cb70 con 0x7fcb500f66e0 2022-02-02T13:37:23.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.434+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb50045ad0 con 0x7fcb500f66e0 2022-02-02T13:37:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.434+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcb4400f030 con 0x7fcb500f66e0 2022-02-02T13:37:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.435+0000 7fcb427fc700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 0x7fcb3c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.435+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4519+0+0 (secure 0 0 0) 0x7fcb44075f60 con 0x7fcb500f66e0 2022-02-02T13:37:23.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.435+0000 7fcb55c52700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 0x7fcb3c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:23.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.435+0000 7fcb55c52700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 0x7fcb3c05e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcb4c013620 tx=0x7fcb4c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:23.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.439+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcb44049000 con 0x7fcb500f66e0 2022-02-02T13:37:23.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:23.625+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb500fdd50 con 0x7fcb3c05c300 2022-02-02T13:37:24.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:24 smithi033 conmon[31996]: audit 2022-02-02T13:37:23.627609+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2022-02-02T13:37:25.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:24 smithi037 conmon[35544]: audit 2022-02-02T13:37:23.627609+0000 mon.smithi033 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2022-02-02T13:37:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.151+0000 7fcb427fc700 1 -- 172.21.15.33:0/240156335 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcb500fdd50 con 0x7fcb3c05c300 2022-02-02T13:37:25.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.154+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 msgr2=0x7fcb3c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:25.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.154+0000 7fcb56c54700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 0x7fcb3c05e7c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fcb4c013620 tx=0x7fcb4c009b30).stop 2022-02-02T13:37:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.154+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 msgr2=0x7fcb5010bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.154+0000 7fcb56c54700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fcb4400b410 tx=0x7fcb44006ef0).stop 2022-02-02T13:37:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 shutdown_connections 2022-02-02T13:37:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcb3c05c300 0x7fcb3c05e7c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb500f5440 0x7fcb50109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 --2- 172.21.15.33:0/240156335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb500f66e0 0x7fcb5010bfa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:25.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 >> 172.21.15.33:0/240156335 conn(0x7fcb500f0ba0 msgr2=0x7fcb500fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 shutdown_connections 2022-02-02T13:37:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:25.155+0000 7fcb56c54700 1 -- 172.21.15.33:0/240156335 wait complete. 2022-02-02T13:37:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: debug 2022-02-02T13:37:25.126+0000 7f1ede973700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:37:25.562 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs dump' 2022-02-02T13:37:25.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:23.529695+0000 2022-02-02T13:37:25.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 184 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:25.924 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:23.627086+0000 mgr.smithi033.xvkvzp (mgr.14164) 185 : audit [DBG] from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:25.924 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:24.121991+0000 mon.smithi033 (mon.0) 456 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2022-02-02T13:37:25.924 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:24.122065+0000 mon.smithi033 (mon.0) 457 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2022-02-02T13:37:25.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:24.124354+0000 mon.smithi033 (mon.0) 458 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2022-02-02T13:37:25.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:24.924959+0000 mon.smithi033 (mon.0) 459 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:37:25.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:24.927874+0000 mon.smithi033 (mon.0) 460 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:37:25.925 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.125096+0000 mon.smithi033 (mon.0) 461 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2022-02-02T13:37:25.926 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25.125358+0000 mon.smithi033 (mon.0) 462 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2022-02-02T13:37:25.926 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.127150+0000 mon.smithi033 (mon.0) 463 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2022-02-02T13:37:25.926 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25.128017+0000 mon.smithi033 (mon.0) 464 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:37:25.926 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25.128046+0000 mon.smithi033 (mon.0) 2022-02-02T13:37:25.927 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: 465 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T13:37:25.927 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25.138560+0000 mon.smithi033 (mon.0) 466 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2022-02-02T13:37:25.927 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.138716 2022-02-02T13:37:25.927 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 467 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2022-02-02T13:37:25.928 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25 2022-02-02T13:37:25.928 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: .138801+0000 mon.smithi033 (mon.0) 468 : 2022-02-02T13:37:25.928 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cluster [DBG] fsmap cephfs:0 2022-02-02T13:37:25.928 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: cephadm 2022-02-02T13:37 2022-02-02T13:37:25.928 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: :25.142862+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:37:25.929 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: 186 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2022-02-02T13:37:25.929 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:37:25.929 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: 13:37:25.152917+0000 mon.smithi033 ( 2022-02-02T13:37:25.929 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: mon.0) 469 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:25.930 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:37:25.930 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: 02T13:37:25.154100+0000 2022-02-02T13:37:25.930 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: mon.smithi033 (mon.0) 470 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:25.930 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:25 smithi033 conmon[31996]: 2022-02-02T13:37:26.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02-02T13:37:23.529695+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:37:26.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: ) 184 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37:23.627086+0000 mgr.smithi033.xvkvzp (mgr.14164) 185 : audit [DBG] from='client.14442 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:37:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37:24.121991+0000 mon.smithi033 (mon 2022-02-02T13:37:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: .0) 456 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2022-02-02T13:37:26.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02-02T13:37:24. 2022-02-02T13:37:26.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 122065+0000 mon.smithi033 (mon.0) 457 : cluster [DBG] 2022-02-02T13:37:26.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: osdmap e38: 6 total, 6 up, 6 in 2022-02-02T13:37:26.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37 2022-02-02T13:37:26.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: :24.124354+0000 mon.smithi033 (mon.0) 458 2022-02-02T13:37:26.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2022-02-02T13:37:26.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:37:26.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: :37:24.924959+0000 mon.smithi033 (mon. 2022-02-02T13:37:26.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 0) 459 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:37:26.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:37:26.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 02-02T13:37:24.927874+0000 2022-02-02T13:37:26.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: mon.smithi033 (mon.0) 460 : audit [INF] 2022-02-02T13:37:26.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:37:26.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:37:26.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: :37:25.125096+0000 mon.smithi033 (mon. 2022-02-02T13:37:26.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 0) 461 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2022-02-02T13:37:26.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02-02T13:37:26.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 2022-02-02T13:37:25.125358+0000 mon.smithi033 2022-02-02T13:37:26.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: (mon.0) 462 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2022-02-02T13:37:26.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.127150+0000 mon.smithi033 ( 2022-02-02T13:37:26.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: mon.0) 463 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2022-02-02T13:37:26.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02-02T13:37:25.128017+0000 mon.smithi033 (mon.0 2022-02-02T13:37:26.048 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: ) 464 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:37:26.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:37:26.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: -02-02T13:37:25.128046+0000 mon.smithi033 (mon.0) 465 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-02-02T13:37:26.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:37:26.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 02T13:37:25.138560+0000 mon.smithi033 2022-02-02T13:37:26.049 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: (mon.0) 466 : cluster [DBG] 2022-02-02T13:37:26.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: osdmap e40: 6 total, 6 up, 6 in 2022-02-02T13:37:26.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37:26.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 2022-02-02T13:37:25.138716+0000 mon.smithi033 (mon. 2022-02-02T13:37:26.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 0) 467 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2022-02-02T13:37:26.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cluster 2022-02-02 2022-02-02T13:37:26.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: T13:37:25.138801+0000 mon.smithi033 2022-02-02T13:37:26.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: (mon.0) 468 : cluster [DBG] fsmap cephfs:0 2022-02-02T13:37:26.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 2022-02-02T13:37:26.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: cephadm 2022-02-02T13:37:26.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 2022-02-02T13:37:25.142862+0000 2022-02-02T13:37:26.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 186 : cephadm 2022-02-02T13:37:26.052 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: [INF] Saving service mds.cephfs spec with placement count:4 2022-02-02T13:37:26.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:37:26.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: :37:25.152917+0000 mon.smithi033 (mon 2022-02-02T13:37:26.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: .0) 469 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:26.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: audit 2022-02-02T13:37:26.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 2022-02-02T13:37:25. 2022-02-02T13:37:26.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: 154100+0000 mon.smithi033 (mon.0) 470 : audit 2022-02-02T13:37:26.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:25 smithi037 conmon[35544]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:26.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: cluster 2022-02-02T13:37:25.530158+0000 mgr.smithi033.xvkvzp (mgr.14164) 187 : cluster [DBG] pgmap v150: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:26.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.654764+0000 mon.smithi033 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:26.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.661393+0000 mon.smithi033 (mon.0) 472 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:26.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.662259+0000 mon.smithi033 (mon.0) 473 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:26.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.666981+0000 mon.smithi033 (mon.0) 474 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:26.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: audit 2022-02-02T13:37:25.667727+0000 mon.smithi033 (mon.0) 475 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:26.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: cephadm 2022-02-02T13:37: 2022-02-02T13:37:26.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: 25.668383+0000 mgr.smithi033.xvkvzp (mgr.14164) 188 : cephadm [INF] Deploying daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:37:26.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:26 smithi033 conmon[31996]: cluster 2022-02-02T13:37:26.136660+0000 mon.smithi033 (mon.0) 476 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2022-02-02T13:37:26.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: cluster 2022-02-02T13:37:25.530158+0000 mgr.smithi033.xvkvzp (mgr.14164) 187 : cluster [DBG] pgmap v150: 65 pgs: 10 creating+peering, 1 active+clean, 54 unknown; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:26.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.654764+0000 mon.smithi033 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:26.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.661393+0000 mon.smithi033 (mon.0) 472 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:26.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.662259+0000 mon.smithi033 (mon.0) 473 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:26.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.666981+0000 mon.smithi033 (mon 2022-02-02T13:37:26.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: .0) 474 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:26.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: audit 2022-02-02T13:37:25.667727+0000 mon.smithi033 (mon.0) 475 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:26.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: cephadm 2022-02-02T13:37:25.668383+0000 mgr.smithi033.xvkvzp (mgr.14164) 188 : cephadm [INF] Deploying daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:37:26.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:26 smithi037 conmon[35544]: cluster 2022-02-02T13:37:26.136660+0000 mon.smithi033 (mon.0) 476 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2022-02-02T13:37:27.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- 172.21.15.33:0/3888495184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 msgr2=0x7f74dc0f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 --2- 172.21.15.33:0/3888495184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc0f6b40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f74c8004660 tx=0x7f74c8009b30).stop 2022-02-02T13:37:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- 172.21.15.33:0/3888495184 shutdown_connections 2022-02-02T13:37:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 --2- 172.21.15.33:0/3888495184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc0f6b40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 --2- 172.21.15.33:0/3888495184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 0x7f74dc0f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- 172.21.15.33:0/3888495184 >> 172.21.15.33:0/3888495184 conn(0x7f74dc0f0ba0 msgr2=0x7f74dc0f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:27.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- 172.21.15.33:0/3888495184 shutdown_connections 2022-02-02T13:37:27.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- 172.21.15.33:0/3888495184 wait complete. 2022-02-02T13:37:27.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 Processor -- start 2022-02-02T13:37:27.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.126+0000 7f74e1d85700 1 -- start start 2022-02-02T13:37:27.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74e1d85700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 0x7f74dc106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:27.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74e1d85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:27.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74e1d85700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc107830 con 0x7f74dc0f66e0 2022-02-02T13:37:27.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74e1d85700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc108040 con 0x7f74dc0f5440 2022-02-02T13:37:27.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:27.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56418/0 (socket says 172.21.15.33:56418) 2022-02-02T13:37:27.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 -- 172.21.15.33:0/580829606 learned_addr learned my addr 172.21.15.33:0/580829606 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:27.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74e0d83700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 0x7f74dc106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:27.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 -- 172.21.15.33:0/580829606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 msgr2=0x7f74dc106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:27.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 0x7f74dc106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 -- 172.21.15.33:0/580829606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8005040 con 0x7f74dc0f66e0 2022-02-02T13:37:27.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.127+0000 7f74dbfff700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f74c8000c00 tx=0x7f74c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:27.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.128+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c8019070 con 0x7f74dc0f66e0 2022-02-02T13:37:27.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.128+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc108260 con 0x7f74dc0f66e0 2022-02-02T13:37:27.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.128+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc1087c0 con 0x7f74dc0f66e0 2022-02-02T13:37:27.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.128+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f74c8007e50 con 0x7f74dc0f66e0 2022-02-02T13:37:27.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.128+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c8014c80 con 0x7f74dc0f66e0 2022-02-02T13:37:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.129+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc004fa0 con 0x7f74dc0f66e0 2022-02-02T13:37:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.129+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f74c8025070 con 0x7f74dc0f66e0 2022-02-02T13:37:27.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.129+0000 7f74d97fa700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 0x7f74cc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:27.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.129+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f74c8076d20 con 0x7f74dc0f66e0 2022-02-02T13:37:27.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.130+0000 7f74e0d83700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 0x7f74cc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:27.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.130+0000 7f74e0d83700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 0x7f74cc05e7c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f74dc106ab0 tx=0x7f74d000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:27.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.134+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f74c8049a80 con 0x7f74dc0f66e0 2022-02-02T13:37:27.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.333+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74bc005e80 con 0x7f74dc0f66e0 2022-02-02T13:37:27.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.333+0000 7f74d97fa700 1 -- 172.21.15.33:0/580829606 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1003 (secure 0 0 0) 0x7f74c804d0a0 con 0x7f74dc0f66e0 2022-02-02T13:37:27.335 INFO:teuthology.orchestra.run.smithi033.stdout:e2 2022-02-02T13:37:27.335 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:37:27.336 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:37:27.336 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:37:27.336 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:27.336 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:37:27.336 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:37:27.337 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 2 2022-02-02T13:37:27.337 INFO:teuthology.orchestra.run.smithi033.stdout:flags 12 2022-02-02T13:37:27.337 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:37:27.337 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:25.127924+0000 2022-02-02T13:37:27.338 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:37:27.338 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:37:27.338 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:37:27.338 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:37:27.338 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:37:27.339 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:37:27.339 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:37:27.339 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:37:27.339 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:37:27.340 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:37:27.340 INFO:teuthology.orchestra.run.smithi033.stdout:in 2022-02-02T13:37:27.340 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:37:27.340 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:37:27.340 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:37:27.341 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:37:27.341 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:37:27.341 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:37:27.341 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2022-02-02T13:37:27.341 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:37:27.342 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2022-02-02T13:37:27.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:27.342 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:27.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 msgr2=0x7f74cc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 0x7f74cc05e7c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f74dc106ab0 tx=0x7f74d000b040).stop 2022-02-02T13:37:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 msgr2=0x7f74dc107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f74c8000c00 tx=0x7f74c800b040).stop 2022-02-02T13:37:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 shutdown_connections 2022-02-02T13:37:27.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f74cc05c300 0x7f74cc05e7c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74dc0f5440 0x7f74dc106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 --2- 172.21.15.33:0/580829606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74dc0f66e0 0x7f74dc107230 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:27.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 >> 172.21.15.33:0/580829606 conn(0x7f74dc0f0ba0 msgr2=0x7f74dc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:27.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 shutdown_connections 2022-02-02T13:37:27.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:27.335+0000 7f74e1d85700 1 -- 172.21.15.33:0/580829606 wait complete. 2022-02-02T13:37:27.346 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2022-02-02T13:37:27.900 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:27.916 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:27.916 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs max_mds 1' 2022-02-02T13:37:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: cluster 2022-02-02T13:37:27.139944+0000 2022-02-02T13:37:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: mon.smithi033 (mon.0) 477 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2022-02-02T13:37:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: audit 2022-02-02T13:37:27.335315+0000 mon.smithi033 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.33:0/580829606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:37:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: audit 2022-02-02T13:37:27.694072+0000 mon.smithi033 (mon.0) 479 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:28.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: audit 2022-02-02T13:37:27.694808+0000 mon.smithi033 (mon.0) 480 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:28.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: audit 2022-02-02T13:37:27.697333+0000 mon.smithi033 (mon.0) 481 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:28.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:28 smithi033 conmon[31996]: audit 2022-02-02T13:37:27.698038+0000 mon.smithi033 (mon.0) 482 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: cluster 2022-02-02T13:37:27.139944+0000 mon.smithi033 (mon.0) 477 : cluster 2022-02-02T13:37:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: [DBG] osdmap e42: 6 total, 6 up, 6 in 2022-02-02T13:37:28.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: audit 2022-02-02T13:37:27.335315+0000 mon.smithi033 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.33:0/580829606' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:37:28.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: audit 2022-02-02T13:37:27.694072+0000 mon.smithi033 (mon.0) 479 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:28.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: audit 2022-02-02T13:37:27.694808+0000 mon.smithi033 (mon.0) 480 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:28.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: audit 2022-02-02T13:37:27.697333+0000 mon.smithi033 (mon.0) 481 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:28.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:28 smithi037 conmon[35544]: audit 2022-02-02T13:37:27.698038+0000 mon.smithi033 (mon.0) 482 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:29.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:27.530498+0000 mgr.smithi033.xvkvzp (mgr.14164) 189 : cluster [DBG] pgmap v153: 65 pgs: 10 creating+peering, 32 active+clean, 23 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:29.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cephadm 2022-02-02T13:37:27.698607+0000 mgr.smithi033.xvkvzp (mgr.14164) 190 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:37:29.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.146487+0000 mon.smithi033 (mon.0) 483 : cluster [DBG] mds.? [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435] up:boot 2022-02-02T13:37:29.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.146525+0000 mon.smithi033 (mon.0) 484 : cluster [INF] daemon mds.cephfs.smithi037.lqirod assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2022-02-02T13:37:29.397 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.146574+0000 mon.smithi033 (mon.0) 485 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:37:29.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.146593+0000 mon.smithi033 (mon.0) 486 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T13:37:29.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.146604+0000 mon.smithi033 (mon.0) 487 : cluster 2022-02-02T13:37:29.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: [INF] Cluster is now healthy 2022-02-02T13:37:29.399 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.148377+0000 mon.smithi033 (mon.0) 488 : cluster [DBG] fsmap cephfs:0 1 up:standby 2022-02-02T13:37:29.399 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: audit 2022-02-02T13:37:28.148507+0000 mon.smithi033 (mon.0) 489 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:37:29.399 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.151226+0000 mon.smithi033 (mon.0) 490 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:creating} 2022-02-02T13:37:29.400 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:29 smithi033 conmon[31996]: cluster 2022-02-02T13:37:28.163425+0000 mon.smithi033 (mon.0) 491 : cluster [INF] daemon mds.cephfs.smithi037.lqirod is now active in filesystem cephfs as rank 0 2022-02-02T13:37:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13:37:27.530498+0000 mgr.smithi033.xvkvzp (mgr.14164) 189 : cluster [DBG] pgmap v153: 65 pgs: 10 creating+peering, 32 active+clean, 23 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:29.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cephadm 2022-02-02T13:37:29.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 2022-02-02T13:37:27.698607+0000 mgr.smithi033.xvkvzp (mgr.14164) 190 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:37:29.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13:37:28.146487+0000 mon.smithi033 (mon.0) 483 : cluster [DBG] mds.? [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435] up:boot 2022-02-02T13:37:29.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13:37:28 2022-02-02T13:37:29.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: .146525+0000 mon.smithi033 (mon.0) 484 : 2022-02-02T13:37:29.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster [INF] daemon mds.cephfs.smithi037.lqirod assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2022-02-02T13:37:29.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13 2022-02-02T13:37:29.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: :37:28.146574+0000 mon.smithi033 (mon. 2022-02-02T13:37:29.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 0) 485 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:37:29.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:37:29.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 02T13:37:28.146593+0000 mon.smithi033 2022-02-02T13:37:29.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: (mon.0) 486 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-02-02T13:37:29.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 2022-02-02T13:37:29.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13:37:29.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 2022-02-02T13:37:28.146604+0000 2022-02-02T13:37:29.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: mon.smithi033 (mon.0) 487 : cluster [INF] 2022-02-02T13:37:29.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: Cluster is now healthy 2022-02-02T13:37:29.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13:37 2022-02-02T13:37:29.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: :28.148377+0000 mon.smithi033 (mon.0 2022-02-02T13:37:29.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: ) 488 : cluster [DBG] fsmap cephfs:0 1 up:standby 2022-02-02T13:37:29.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:37:29.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 02-02T13:37:28.148507+0000 2022-02-02T13:37:29.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: mon.smithi033 (mon.0) 489 : audit [DBG] 2022-02-02T13:37:29.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:37:29.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:37:29.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 37:28.151226+0000 mon.smithi033 (mon. 2022-02-02T13:37:29.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 0) 490 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:creating} 2022-02-02T13:37:29.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:37:29.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: -02-02T13:37:28. 2022-02-02T13:37:29.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: 163425+0000 mon.smithi033 (mon.0) 491 : cluster 2022-02-02T13:37:29.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:29 smithi037 conmon[35544]: [INF] daemon mds.cephfs.smithi037.lqirod is now active in filesystem cephfs as rank 0 2022-02-02T13:37:29.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 -- 172.21.15.33:0/3834232882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f5ed0 msgr2=0x7fe8ac0f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 --2- 172.21.15.33:0/3834232882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f5ed0 0x7fe8ac0f6900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe89c004660 tx=0x7fe89c009b30).stop 2022-02-02T13:37:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 -- 172.21.15.33:0/3834232882 shutdown_connections 2022-02-02T13:37:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 --2- 172.21.15.33:0/3834232882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f5ed0 0x7fe8ac0f6900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 --2- 172.21.15.33:0/3834232882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 -- 172.21.15.33:0/3834232882 >> 172.21.15.33:0/3834232882 conn(0x7fe8ac0f0de0 msgr2=0x7fe8ac0f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 -- 172.21.15.33:0/3834232882 shutdown_connections 2022-02-02T13:37:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.978+0000 7fe8b4312700 1 -- 172.21.15.33:0/3834232882 wait complete. 2022-02-02T13:37:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 Processor -- start 2022-02-02T13:37:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 -- start start 2022-02-02T13:37:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac0f5ed0 0x7fe8ac106330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac106930 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b4312700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ac107140 con 0x7fe8ac0f5ed0 2022-02-02T13:37:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b20ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b20ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56426/0 (socket says 172.21.15.33:56426) 2022-02-02T13:37:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.979+0000 7fe8b20ae700 1 -- 172.21.15.33:0/1804575581 learned_addr learned my addr 172.21.15.33:0/1804575581 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b20ae700 1 -- 172.21.15.33:0/1804575581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac0f5ed0 msgr2=0x7fe8ac106330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:37:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b20ae700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac0f5ed0 0x7fe8ac106330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b20ae700 1 -- 172.21.15.33:0/1804575581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c005040 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b20ae700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe8a800e7f0 tx=0x7fe8a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a80092e0 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ac1073c0 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe8a800f040 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8a8014750 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.980+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ac107980 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.981+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ac0f4a50 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.982+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe8a801b030 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.982+0000 7fe8a2ffd700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 0x7fe89805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.982+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe8a8075d40 con 0x7fe8ac0f55c0 2022-02-02T13:37:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.982+0000 7fe8b18ad700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 0x7fe89805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.983+0000 7fe8b18ad700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 0x7fe89805e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe89c004d80 tx=0x7fe89c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:29.986+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe8a8048ad0 con 0x7fe8ac0f55c0 2022-02-02T13:37:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:30.192+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7fe8ac0fddb0 con 0x7fe8ac0f55c0 2022-02-02T13:37:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:30 smithi033 conmon[31996]: cluster 2022-02-02T13:37:29.151819+0000 2022-02-02T13:37:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:30 smithi033 conmon[31996]: mon.smithi033 (mon.0) 492 : cluster [DBG] mds.? [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435] up:active 2022-02-02T13:37:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:30 smithi033 conmon[31996]: cluster 2022-02-02T13:37:29.151907+0000 mon.smithi033 (mon.0) 493 : 2022-02-02T13:37:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:30 smithi033 conmon[31996]: cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:30 smithi037 conmon[35544]: cluster 2022-02-02T13:37:29.151819+0000 mon.smithi033 (mon. 2022-02-02T13:37:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:30 smithi037 conmon[35544]: 0) 492 : cluster [DBG] mds.? [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435] up:active 2022-02-02T13:37:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:30 smithi037 conmon[35544]: cluster 2022-02-02T13:37:29.151907+0000 2022-02-02T13:37:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:30 smithi037 conmon[35544]: mon.smithi033 (mon.0) 493 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:31.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.160+0000 7fe8a2ffd700 1 -- 172.21.15.33:0/1804575581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe8a8019020 con 0x7fe8ac0f55c0 2022-02-02T13:37:31.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.162+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 msgr2=0x7fe89805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:31.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.162+0000 7fe8b4312700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 0x7fe89805e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fe89c004d80 tx=0x7fe89c00b040).stop 2022-02-02T13:37:31.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.162+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 msgr2=0x7fe8ac105e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:31.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.162+0000 7fe8b4312700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fe8a800e7f0 tx=0x7fe8a800b040).stop 2022-02-02T13:37:31.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 shutdown_connections 2022-02-02T13:37:31.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe89805c2b0 0x7fe89805e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:31.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8ac0f55c0 0x7fe8ac105e40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:31.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 --2- 172.21.15.33:0/1804575581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac0f5ed0 0x7fe8ac106330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:31.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 >> 172.21.15.33:0/1804575581 conn(0x7fe8ac0f0de0 msgr2=0x7fe8ac0fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:31.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 shutdown_connections 2022-02-02T13:37:31.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:31.163+0000 7fe8b4312700 1 -- 172.21.15.33:0/1804575581 wait complete. 2022-02-02T13:37:31.412 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: cluster 2022-02-02T13:37:29.530903+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:37:31.412 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: .14164) 191 : cluster [DBG] pgmap v154: 65 pgs: 10 creating+peering, 47 active+clean, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:31.412 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: audit 2022-02-02T13:37:30.194292+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='client.? 172.21.15.33:0/1804575581' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2022-02-02T13:37:31.412 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: audit 2022-02-02T13:37:30.559269+0000 mon.smithi033 (mon.0) 495 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:31.413 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: audit 2022-02-02T13:37:30.560041+0000 mon.smithi033 (mon.0) 496 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:31.413 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: audit 2022-02-02T13:37:30.562738+0000 mon.smithi033 (mon.0) 497 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:31.413 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:31 smithi037 conmon[35544]: audit 2022-02-02T13:37:30.563397+0000 mon.smithi033 (mon.0) 498 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: cluster 2022-02-02T13:37:29.530903+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:37:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: mgr.14164) 191 : cluster [DBG] pgmap v154: 65 pgs: 10 creating+peering, 47 active+clean, 8 unknown; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: audit 2022-02-02T13:37:30.194292+0000 mon.smithi033 (mon.0) 494 : audit [INF] from='client.? 172.21.15.33:0/1804575581' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2022-02-02T13:37:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: audit 2022-02-02T13:37:30.559269+0000 mon.smithi033 (mon.0) 495 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: audit 2022-02-02T13:37:30.560041+0000 mon.smithi033 (mon.0) 496 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:37:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: 02T13:37:30.562738+0000 mon.smithi033 (mon.0) 497 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:37:31.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: 02T13:37:30.563397+0000 mon.smithi033 (mon.0) 498 2022-02-02T13:37:31.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:31 smithi033 conmon[31996]: : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:31.640 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:31.653 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:31.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2022-02-02T13:37:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:32 smithi037 conmon[35544]: cephadm 2022-02-02T13:37: 2022-02-02T13:37:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:32 smithi037 conmon[35544]: 30.564125+0000 mgr.smithi033.xvkvzp (mgr.14164) 192 : cephadm [INF] Deploying daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:37:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:32 smithi037 conmon[35544]: audit 2022-02-02T13:37:31.162348+0000 mon.smithi033 (mon.0) 499 : audit [INF] from='client.? 172.21.15.33:0/1804575581' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2022-02-02T13:37:32.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:32 smithi037 conmon[35544]: cluster 2022-02-02T13:37:31.162442+0000 mon.smithi033 (mon.0) 500 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:32.421 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:32 smithi033 conmon[31996]: cephadm 2022-02-02T13:37:30.564125+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:37:32.422 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:32 smithi033 conmon[31996]: 192 : cephadm [INF] Deploying daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:37:32.422 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:32 smithi033 conmon[31996]: audit 2022-02-02T13:37:31.162348+0000 mon.smithi033 (mon.0) 499 : audit [INF] from='client.? 172.21.15.33:0/1804575581' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2022-02-02T13:37:32.422 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:32 smithi033 conmon[31996]: cluster 2022-02-02T13:37:31.162442+0000 mon.smithi033 (mon.0) 500 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 -- 172.21.15.33:0/820132542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 msgr2=0x7f2b740fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 --2- 172.21.15.33:0/820132542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b740fdfe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f2b68004660 tx=0x7f2b68009b30).stop 2022-02-02T13:37:33.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 -- 172.21.15.33:0/820132542 shutdown_connections 2022-02-02T13:37:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 --2- 172.21.15.33:0/820132542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b740fdfe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 --2- 172.21.15.33:0/820132542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b740fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 -- 172.21.15.33:0/820132542 >> 172.21.15.33:0/820132542 conn(0x7f2b740f0d40 msgr2=0x7f2b740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:33.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 -- 172.21.15.33:0/820132542 shutdown_connections 2022-02-02T13:37:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.389+0000 7f2b78fad700 1 -- 172.21.15.33:0/820132542 wait complete. 2022-02-02T13:37:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 Processor -- start 2022-02-02T13:37:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 -- start start 2022-02-02T13:37:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b74109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:33.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74109be0 con 0x7f2b740fbbf0 2022-02-02T13:37:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b78fad700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b74109d20 con 0x7f2b740602b0 2022-02-02T13:37:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:33.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56442/0 (socket says 172.21.15.33:56442) 2022-02-02T13:37:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 -- 172.21.15.33:0/2328921108 learned_addr learned my addr 172.21.15.33:0/2328921108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b7259c700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b74109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 -- 172.21.15.33:0/2328921108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 msgr2=0x7f2b74109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b74109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:33.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b71d9b700 1 -- 172.21.15.33:0/2328921108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b68005040 con 0x7f2b740fbbf0 2022-02-02T13:37:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.390+0000 7f2b7259c700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b74109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:37:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b71d9b700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2b68004e30 tx=0x7f2b68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b68018070 con 0x7f2b740fbbf0 2022-02-02T13:37:33.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f2b68013410 con 0x7f2b740fbbf0 2022-02-02T13:37:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6801c3c0 con 0x7f2b740fbbf0 2022-02-02T13:37:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7410a660 con 0x7f2b740fbbf0 2022-02-02T13:37:33.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.391+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7410abc0 con 0x7f2b740fbbf0 2022-02-02T13:37:33.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.392+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b74045ad0 con 0x7f2b740fbbf0 2022-02-02T13:37:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.392+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f2b6801d420 con 0x7f2b740fbbf0 2022-02-02T13:37:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.393+0000 7f2b62ffd700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 0x7f2b5c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.393+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f2b68077b20 con 0x7f2b740fbbf0 2022-02-02T13:37:33.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.393+0000 7f2b7259c700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 0x7f2b5c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.393+0000 7f2b7259c700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 0x7f2b5c05e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2b64009740 tx=0x7f2b64009be0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:33.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.397+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f2b6804a880 con 0x7f2b740fbbf0 2022-02-02T13:37:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: cluster 2022-02-02T13:37:31.531420+0000 2022-02-02T13:37:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 193 : cluster [DBG] pgmap v155: 65 pgs: 65 active+clean; 182 B data, 32 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: audit 2022-02-02T13:37:32.775660+0000 mon.smithi033 (mon.0) 501 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: audit 2022-02-02T13:37:32.776535+0000 mon.smithi033 (mon.0) 502 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: audit 2022-02-02T13:37:32.779319+0000 mon.smithi033 (mon.0) 503 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:33.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:33 smithi033 conmon[31996]: audit 2022-02-02T13:37:32.780033+0000 mon.smithi033 (mon.0) 504 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:33 smithi037 conmon[35544]: cluster 2022-02-02T13:37:31.531420+0000 mgr.smithi033.xvkvzp (mgr.14164) 193 : cluster [DBG] pgmap v155: 65 pgs: 65 active+clean; 182 B data, 32 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:37:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:33 smithi037 conmon[35544]: audit 2022-02-02T13:37:32.775660+0000 mon.smithi033 (mon.0) 501 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:33 smithi037 conmon[35544]: audit 2022-02-02T13:37:32.776535+0000 mon.smithi033 (mon.0) 502 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:37:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:33 smithi037 conmon[35544]: audit 2022-02-02T13:37:32.779319+0000 mon.smithi033 (mon.0) 503 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-02-02T13:37:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:33 smithi037 conmon[35544]: audit 2022-02-02T13:37:32.780033+0000 mon.smithi033 (mon.0) 504 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:37:33.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:33.609+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f2b74027a00 con 0x7f2b740fbbf0 2022-02-02T13:37:34.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.171+0000 7f2b62ffd700 1 -- 172.21.15.33:0/2328921108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v7) v1 ==== 121+0+0 (secure 0 0 0) 0x7f2b6801d6b0 con 0x7f2b740fbbf0 2022-02-02T13:37:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 msgr2=0x7f2b5c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 0x7f2b5c05e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2b64009740 tx=0x7f2b64009be0).stop 2022-02-02T13:37:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 msgr2=0x7f2b74109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f2b68004e30 tx=0x7f2b68009b30).stop 2022-02-02T13:37:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 shutdown_connections 2022-02-02T13:37:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f2b5c05c2b0 0x7f2b5c05e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b740602b0 0x7f2b74109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:34.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 --2- 172.21.15.33:0/2328921108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b740fbbf0 0x7f2b74109630 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:34.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 >> 172.21.15.33:0/2328921108 conn(0x7f2b740f0d40 msgr2=0x7f2b740f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:34.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 shutdown_connections 2022-02-02T13:37:34.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:34.172+0000 7f2b78fad700 1 -- 172.21.15.33:0/2328921108 wait complete. 2022-02-02T13:37:34.361 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:34 smithi033 conmon[31996]: cephadm 2022-02-02T13:37:32.780621+0000 2022-02-02T13:37:34.362 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:34 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 194 : cephadm [INF] Deploying daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:37:34.362 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:34 smithi033 conmon[31996]: audit 2022-02-02T13:37:33.611947+0000 mon.smithi033 (mon.0) 505 : audit [INF] from='client.? 172.21.15.33:0/2328921108' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-02-02T13:37:34.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:34 smithi037 conmon[35544]: cephadm 2022-02-02T13:37:32.780621+0000 mgr.smithi033.xvkvzp (mgr.14164) 194 : cephadm 2022-02-02T13:37:34.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:34 smithi037 conmon[35544]: [INF] Deploying daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:37:34.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:34 smithi037 conmon[35544]: audit 2022-02-02T13:37:33.611947+0000 mon.smithi033 (mon.0) 505 : audit [INF] from='client.? 172.21.15.33:0/2328921108' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2022-02-02T13:37:34.694 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:34.708 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:34.708 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2022-02-02T13:37:35.342 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: cluster 2022-02-02T13:37:33.531844+0000 mgr.smithi033.xvkvzp (mgr.14164) 195 : cluster [DBG] 2022-02-02T13:37:35.342 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: pgmap v156: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 16 op/s 2022-02-02T13:37:35.342 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: audit 2022-02-02T13:37:34.172777+0000 mon.smithi033 (mon.0) 506 : audit [INF] from='client.? 172.21.15.33:0/2328921108' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-02-02T13:37:35.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: cluster 2022-02-02T13:37:34.172837+0000 mon.smithi033 (mon.0) 507 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:35.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: audit 2022 2022-02-02T13:37:35.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: -02-02T13:37:35.144904+0000 mon.smithi033 (mon.0) 508 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:35.343 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: audit 2022-02-02T13:37:35.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: 2022-02-02T13:37 2022-02-02T13:37:35.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: :35.145765+0000 mon.smithi033 (mon.0) 2022-02-02T13:37:35.344 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:35 smithi033 conmon[31996]: 509 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: cluster 2022-02-02T13:37:33.531844+0000 mgr.smithi033.xvkvzp (mgr.14164) 195 : cluster [DBG] pgmap v156: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 5.0 KiB/s wr, 16 op/s 2022-02-02T13:37:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: audit 2022-02-02T13:37:34.172777+0000 mon.smithi033 (mon.0) 506 : audit [INF] from='client.? 172.21.15.33:0/2328921108' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2022-02-02T13:37:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: cluster 2022-02-02T13:37:34.172837+0000 mon.smithi033 (mon.0) 507 : 2022-02-02T13:37:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 2022-02-02T13:37:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:37:35.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: -02T13:37:35.144904+0000 mon.smithi033 (mon. 2022-02-02T13:37:35.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: 0) 508 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:35.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: audit 2022 2022-02-02T13:37:35.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: -02-02T13:37:35. 2022-02-02T13:37:35.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: 145765+0000 mon.smithi033 (mon.0) 509 : audit 2022-02-02T13:37:35.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:35 smithi037 conmon[35544]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:36.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 -- 172.21.15.33:0/36089101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 msgr2=0x7fe8040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:36.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 --2- 172.21.15.33:0/36089101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe8040f6b00 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fe800004660 tx=0x7fe800009b30).stop 2022-02-02T13:37:36.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 -- 172.21.15.33:0/36089101 shutdown_connections 2022-02-02T13:37:36.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 --2- 172.21.15.33:0/36089101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe8040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:36.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 --2- 172.21.15.33:0/36089101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe8040f6b00 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:36.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 -- 172.21.15.33:0/36089101 >> 172.21.15.33:0/36089101 conn(0x7fe8040f1e40 msgr2=0x7fe8040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:36.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 -- 172.21.15.33:0/36089101 shutdown_connections 2022-02-02T13:37:36.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.378+0000 7fe80b73c700 1 -- 172.21.15.33:0/36089101 wait complete. 2022-02-02T13:37:36.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 Processor -- start 2022-02-02T13:37:36.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 -- start start 2022-02-02T13:37:36.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:36.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe804069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:36.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80410abf0 con 0x7fe8040f66e0 2022-02-02T13:37:36.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe80b73c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80410ad30 con 0x7fe8040f7980 2022-02-02T13:37:36.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:36.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56468/0 (socket says 172.21.15.33:56468) 2022-02-02T13:37:36.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 -- 172.21.15.33:0/2647376782 learned_addr learned my addr 172.21.15.33:0/2647376782 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:36.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe808cd7700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe804069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:36.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 -- 172.21.15.33:0/2647376782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 msgr2=0x7fe804069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:36.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe804069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:36.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 -- 172.21.15.33:0/2647376782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800005040 con 0x7fe8040f66e0 2022-02-02T13:37:36.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe808cd7700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe804069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:37:36.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe8094d8700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe800014040 tx=0x7fe80000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:36.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.379+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe800019070 con 0x7fe8040f66e0 2022-02-02T13:37:36.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.380+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80406a370 con 0x7fe8040f66e0 2022-02-02T13:37:36.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.380+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fe800007e50 con 0x7fe8040f66e0 2022-02-02T13:37:36.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.380+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe800014d30 con 0x7fe8040f66e0 2022-02-02T13:37:36.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.380+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80406a8d0 con 0x7fe8040f66e0 2022-02-02T13:37:36.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.381+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe804045ad0 con 0x7fe8040f66e0 2022-02-02T13:37:36.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.381+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fe800025070 con 0x7fe8040f66e0 2022-02-02T13:37:36.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.382+0000 7fe7f9ffb700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 0x7fe7f005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:36.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.382+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fe800076f90 con 0x7fe8040f66e0 2022-02-02T13:37:36.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.382+0000 7fe808cd7700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 0x7fe7f005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:36.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.382+0000 7fe808cd7700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 0x7fe7f005e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fe7f4009170 tx=0x7fe7f400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:36.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.386+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fe800049c70 con 0x7fe8040f66e0 2022-02-02T13:37:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:36 smithi033 conmon[31996]: cluster 2022-02-02T13:37:35.179073+0000 mon.smithi033 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:boot 2022-02-02T13:37:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:36 smithi033 conmon[31996]: cluster 2022-02-02T13:37:35.179390+0000 mon.smithi033 (mon.0) 511 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby 2022-02-02T13:37:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:36 smithi033 conmon[31996]: audit 2022-02-02T13:37:35.179505+0000 mon.smithi033 (mon.0) 512 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:37:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:36 smithi033 conmon[31996]: cluster 2022-02-02T13:37:35.182253+0000 mon.smithi033 (mon.0) 513 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2022-02-02T13:37:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:36 smithi037 conmon[35544]: cluster 2022-02-02T13:37:35 2022-02-02T13:37:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:36 smithi037 conmon[35544]: .179073+0000 mon.smithi033 (mon.0) 510 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:boot 2022-02-02T13:37:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:36 smithi037 conmon[35544]: cluster 2022-02-02T13:37:35.179390+0000 mon.smithi033 (mon.0) 511 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby 2022-02-02T13:37:36.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:36 smithi037 conmon[35544]: audit 2022-02-02T13:37:35.179505+0000 mon.smithi033 (mon.0) 512 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:37:36.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:36 smithi037 conmon[35544]: cluster 2022-02-02T13:37:35.182253+0000 mon.smithi033 (mon.0) 513 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2022-02-02T13:37:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:36.593+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe804027a00 con 0x7fe8040f66e0 2022-02-02T13:37:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.186+0000 7fe7f9ffb700 1 -- 172.21.15.33:0/2647376782 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) v1 ==== 168+0+0 (secure 0 0 0) 0x7fe80004d290 con 0x7fe8040f66e0 2022-02-02T13:37:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 msgr2=0x7fe7f005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 0x7fe7f005e770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fe7f4009170 tx=0x7fe7f400b040).stop 2022-02-02T13:37:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 msgr2=0x7fe80406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fe800014040 tx=0x7fe80000b040).stop 2022-02-02T13:37:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 shutdown_connections 2022-02-02T13:37:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fe7f005c2b0 0x7fe7f005e770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8040f66e0 0x7fe80406b9a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 --2- 172.21.15.33:0/2647376782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8040f7980 0x7fe804069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.189+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 >> 172.21.15.33:0/2647376782 conn(0x7fe8040f1e40 msgr2=0x7fe8040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.190+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 shutdown_connections 2022-02-02T13:37:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:37.190+0000 7fe80b73c700 1 -- 172.21.15.33:0/2647376782 wait complete. 2022-02-02T13:37:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:inline data enabled 2022-02-02T13:37:37.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:37 smithi037 conmon[35544]: cluster 2022-02-02T13:37:35.532201+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:37.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:37 smithi037 conmon[35544]: 14164) 196 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2022-02-02T13:37:37.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:37 smithi037 conmon[35544]: audit 2022-02-02T13:37:36.594576+0000 mon.smithi033 (mon.0) 514 : audit [INF] from='client.? 172.21.15.33:0/2647376782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2022-02-02T13:37:37.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:37 smithi033 conmon[31996]: cluster 2022-02-02T13:37:35. 2022-02-02T13:37:37.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:37 smithi033 conmon[31996]: 532201+0000 mgr.smithi033.xvkvzp (mgr.14164) 196 : cluster [DBG] pgmap v157: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s wr, 8 op/s 2022-02-02T13:37:37.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:37 smithi033 conmon[31996]: audit 2022-02-02T13:37:36.594576+0000 mon.smithi033 (mon.0) 514 : audit [INF] from='client.? 172.21.15.33:0/2647376782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2022-02-02T13:37:37.891 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-02-02T13:37:37.905 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:37.906 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph fs dump' 2022-02-02T13:37:38.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: cluster 2022-02-02T13:37 2022-02-02T13:37:38.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: :37.183021+0000 mon.smithi033 (mon.0) 515 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2022-02-02T13:37:38.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: audit 2022-02-02T13:37:37.187124+0000 mon.smithi033 (mon.0) 516 : audit [INF] from='client.? 172.21.15.33:0/2647376782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2022-02-02T13:37:38.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: cluster 2022-02-02T13:37:37.187239+0000 mon.smithi033 (mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] up:boot 2022-02-02T13:37:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: cluster 2022-02-02T13:37:37.187315+0000 mon.smithi033 (mon.0) 518 2022-02-02T13:37:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T13:37:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:37:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: :37:37.187722+0000 mon.smithi033 (mon. 2022-02-02T13:37:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: 0) 519 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:37:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:37:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: 02-02T13:37:38.153124 2022-02-02T13:37:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 520 : audit 2022-02-02T13:37:38.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:38 smithi033 conmon[31996]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:38.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: cluster 2022-02-02T13:37:37.183021+0000 mon.smithi033 (mon.0 2022-02-02T13:37:38.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: ) 515 : cluster [WRN] Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2022-02-02T13:37:38.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: audit 2022-02-02T13:37:37.187124+0000 mon.smithi033 (mon.0) 516 : audit [INF] from='client.? 172.21.15.33:0/2647376782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2022-02-02T13:37:38.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: cluster 2022-02-02T13:37:37.187239+0000 mon.smithi033 ( 2022-02-02T13:37:38.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: mon.0) 517 : cluster [DBG] mds.? [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] up:boot 2022-02-02T13:37:38.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:37:38.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: -02-02T13:37:37.187315 2022-02-02T13:37:38.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 518 : cluster 2022-02-02T13:37:38.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 1 up:standby 2022-02-02T13:37:38.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:37:38.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: 37:37.187722+0000 mon.smithi033 (mon. 2022-02-02T13:37:38.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: 0) 519 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:37:38.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:37:38.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: -02T13:37:38.153124+0000 2022-02-02T13:37:38.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: mon.smithi033 (mon.0) 520 : audit 2022-02-02T13:37:38.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:38 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:39.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:39 smithi033 conmon[31996]: cluster 2022-02-02T13:37:37.532675+0000 mgr.smithi033.xvkvzp (mgr.14164) 197 : cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1.7 KiB/s wr, 5 op/s 2022-02-02T13:37:39.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:39 smithi037 conmon[35544]: cluster 2022-02-02T13:37:37.532675+0000 mgr.smithi033.xvkvzp (mgr.14164) 197 : 2022-02-02T13:37:39.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:39 smithi037 conmon[35544]: cluster [DBG] pgmap v158: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1.7 KiB/s wr, 5 op/s 2022-02-02T13:37:40.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- 172.21.15.33:0/3262451150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 msgr2=0x7fddf80f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 --2- 172.21.15.33:0/3262451150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf80f59f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fdde80099e0 tx=0x7fdde8004d10).stop 2022-02-02T13:37:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- 172.21.15.33:0/3262451150 shutdown_connections 2022-02-02T13:37:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 --2- 172.21.15.33:0/3262451150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 0x7fddf80f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 --2- 172.21.15.33:0/3262451150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf80f59f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- 172.21.15.33:0/3262451150 >> 172.21.15.33:0/3262451150 conn(0x7fddf80f0d30 msgr2=0x7fddf80f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:40.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- 172.21.15.33:0/3262451150 shutdown_connections 2022-02-02T13:37:40.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- 172.21.15.33:0/3262451150 wait complete. 2022-02-02T13:37:40.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 Processor -- start 2022-02-02T13:37:40.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.108+0000 7fde0067a700 1 -- start start 2022-02-02T13:37:40.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fde0067a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:40.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fde0067a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 0x7fddf810c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:40.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fde0067a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8060520 con 0x7fddf80f55d0 2022-02-02T13:37:40.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fde0067a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf8060660 con 0x7fddf80f6870 2022-02-02T13:37:40.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:40.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56480/0 (socket says 172.21.15.33:56480) 2022-02-02T13:37:40.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 -- 172.21.15.33:0/2307451239 learned_addr learned my addr 172.21.15.33:0/2307451239 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:40.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfdc15700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 0x7fddf810c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:40.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 -- 172.21.15.33:0/2307451239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 msgr2=0x7fddf810c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 0x7fddf810c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 -- 172.21.15.33:0/2307451239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde8009640 con 0x7fddf80f55d0 2022-02-02T13:37:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddfe416700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fdde800b3b0 tx=0x7fdde8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:40.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde800e030 con 0x7fddf80f55d0 2022-02-02T13:37:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.109+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdde8007df0 con 0x7fddf80f55d0 2022-02-02T13:37:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.110+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde8018070 con 0x7fddf80f55d0 2022-02-02T13:37:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.110+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf810c7f0 con 0x7fddf80f55d0 2022-02-02T13:37:40.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.110+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf810cca0 con 0x7fddf80f55d0 2022-02-02T13:37:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.111+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80f49c0 con 0x7fddf80f55d0 2022-02-02T13:37:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.111+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdde801d420 con 0x7fddf80f55d0 2022-02-02T13:37:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.111+0000 7fddf6ffd700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 0x7fdde005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.111+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdde8077ba0 con 0x7fddf80f55d0 2022-02-02T13:37:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.111+0000 7fddfdc15700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 0x7fdde005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.112+0000 7fddfdc15700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 0x7fdde005e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fddec0096c0 tx=0x7fddec009be0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.115+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdde804a8a0 con 0x7fddf80f55d0 2022-02-02T13:37:40.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.321+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fddf80fdea0 con 0x7fddf80f55d0 2022-02-02T13:37:40.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.322+0000 7fddf6ffd700 1 -- 172.21.15.33:0/2307451239 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) v1 ==== 76+0+1641 (secure 0 0 0) 0x7fdde804dec0 con 0x7fddf80f55d0 2022-02-02T13:37:40.323 INFO:teuthology.orchestra.run.smithi033.stdout:e11 2022-02-02T13:37:40.323 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:37:40.323 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:37:40.324 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:37:40.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:40.324 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:37:40.324 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:37:40.325 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 11 2022-02-02T13:37:40.325 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:37:40.325 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:37:40.325 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:39.197747+0000 2022-02-02T13:37:40.325 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:37:40.326 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:37:40.326 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:37:40.326 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:37:40.326 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:37:40.327 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:37:40.327 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:37:40.327 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:37:40.327 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:37:40.327 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:37:40.328 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:37:40.328 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24277} 2022-02-02T13:37:40.328 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:37:40.328 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:37:40.329 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:37:40.329 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:37:40.329 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:37:40.329 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:37:40.329 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:37:40.330 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:37:40.330 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{0:24277} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435]] 2022-02-02T13:37:40.330 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:14456} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153]] 2022-02-02T13:37:40.330 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:40.331 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:40.331 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:37:40.331 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:40.331 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14468} state up:standby seq 2 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:37:40.331 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 2 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:37:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 msgr2=0x7fdde005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 0x7fdde005e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fddec0096c0 tx=0x7fddec009be0).stop 2022-02-02T13:37:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 msgr2=0x7fddf8109d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fdde800b3b0 tx=0x7fdde8004d10).stop 2022-02-02T13:37:40.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 shutdown_connections 2022-02-02T13:37:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdde005c2b0 0x7fdde005e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddf80f55d0 0x7fddf8109d40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 --2- 172.21.15.33:0/2307451239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf80f6870 0x7fddf810c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 >> 172.21.15.33:0/2307451239 conn(0x7fddf80f0d30 msgr2=0x7fddf80fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 shutdown_connections 2022-02-02T13:37:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:40.324+0000 7fde0067a700 1 -- 172.21.15.33:0/2307451239 wait complete. 2022-02-02T13:37:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 11 2022-02-02T13:37:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:40 smithi033 conmon[31996]: cluster 2022-02-02T13:37:39.206086+0000 mon.smithi033 (mon.0) 521 2022-02-02T13:37:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:40 smithi033 conmon[31996]: : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:standby-replay 2022-02-02T13:37:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:40 smithi033 conmon[31996]: cluster 2022-02-02T13:37:39.206137+0000 mon.smithi033 (mon.0) 522 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:boot 2022-02-02T13:37:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:40 smithi033 conmon[31996]: cluster 2022-02-02T13:37:39.206230+0000 mon.smithi033 (mon.0) 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:40.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:40 smithi033 conmon[31996]: audit 2022-02-02T13:37:39.206346+0000 mon.smithi033 (mon.0) 524 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:37:40.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: cluster 2022-02-02T13:37:39.206086+0000 mon.smithi033 (mon.0) 521 2022-02-02T13:37:40.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:standby-replay 2022-02-02T13:37:40.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: cluster 2022-02-02T13:37:39.206137+0000 mon.smithi033 (mon.0) 522 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:boot 2022-02-02T13:37:40.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:37:40.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: 02-02T13:37:39.206230+0000 mon.smithi033 (mon.0) 2022-02-02T13:37:40.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:40.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: audit 2022-02-02T13:37:40.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: 2022-02-02T13:37:39.206346 2022-02-02T13:37:40.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 524 : audit [DBG] 2022-02-02T13:37:40.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:40 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:37:41.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2022-02-02T13:37:41.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:41 smithi033 conmon[31996]: cluster 2022-02-02T13:37:39.533101+0000 mgr.smithi033.xvkvzp (mgr.14164) 198 : cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2022-02-02T13:37:41.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:41 smithi033 conmon[31996]: audit 2022-02-02T13:37:40.323000+0000 mon.smithi033 (mon.0) 525 : audit [DBG] from='client.? 172.21.15.33:0/2307451239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:37:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:41 smithi037 conmon[35544]: cluster 2022-02-02T13:37:39.533101+0000 mgr.smithi033.xvkvzp (mgr.14164) 198 : 2022-02-02T13:37:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:41 smithi037 conmon[35544]: cluster [DBG] pgmap v159: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2022-02-02T13:37:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:41 smithi037 conmon[35544]: audit 2022-02-02T13:37:40.323000+0000 mon.smithi033 (mon.0) 525 : audit [DBG] from='client.? 172.21.15.33:0/2307451239' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:37:42.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: cluster 2022-02-02T13:37:41.214169+0000 mon.smithi033 2022-02-02T13:37:42.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: (mon.0) 526 : cluster [DBG] mds.? [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] up:standby 2022-02-02T13:37:42.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: cluster 2022-02-02T13:37:41.214235+0000 mon.smithi033 (mon.0) 527 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:42.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: audit 2022-02-02T13:37:41.522855+0000 mon.smithi033 (mon.0) 528 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:42.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: audit 2022-02-02T13:37:41.526159+0000 mon.smithi033 (mon.0) 529 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:42.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:42 smithi033 conmon[31996]: audit 2022-02-02T13:37:41.529886+0000 mon.smithi033 (mon.0) 530 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:42.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: cluster 2022-02-02T13:37:41.214169+0000 mon.smithi033 (mon 2022-02-02T13:37:42.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: .0) 526 : cluster [DBG] mds.? [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] up:standby 2022-02-02T13:37:42.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: cluster 2022-02-02T13:37:41.214235+0000 mon.smithi033 (mon.0) 527 : cluster [DBG] 2022-02-02T13:37:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:37:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: -02T13:37:41.522855+0000 mon.smithi033 (mon.0) 528 2022-02-02T13:37:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:37:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: 02T13:37:41.526159+0000 mon.smithi033 ( 2022-02-02T13:37:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: mon.0) 529 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: audit 2022 2022-02-02T13:37:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: -02-02T13:37:41.529886+0000 2022-02-02T13:37:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: mon.smithi033 (mon.0) 530 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:37:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:42 smithi037 conmon[35544]: 2022-02-02T13:37:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 -- 172.21.15.33:0/1765175805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f55c0 msgr2=0x7f7ed00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/1765175805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f59e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f7ec4004660 tx=0x7f7ec4009b30).stop 2022-02-02T13:37:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 -- 172.21.15.33:0/1765175805 shutdown_connections 2022-02-02T13:37:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/1765175805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/1765175805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f59e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 -- 172.21.15.33:0/1765175805 >> 172.21.15.33:0/1765175805 conn(0x7f7ed00f0d40 msgr2=0x7f7ed00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 -- 172.21.15.33:0/1765175805 shutdown_connections 2022-02-02T13:37:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.082+0000 7f7ed58ab700 1 -- 172.21.15.33:0/1765175805 wait complete. 2022-02-02T13:37:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.083+0000 7f7ed58ab700 1 Processor -- start 2022-02-02T13:37:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.083+0000 7f7ed58ab700 1 -- start start 2022-02-02T13:37:43.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ed58ab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:43.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ed58ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:43.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ed58ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed010ab80 con 0x7f7ed00f6860 2022-02-02T13:37:43.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ed58ab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed010acc0 con 0x7f7ed00f55c0 2022-02-02T13:37:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56492/0 (socket says 172.21.15.33:56492) 2022-02-02T13:37:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 -- 172.21.15.33:0/3970653343 learned_addr learned my addr 172.21.15.33:0/3970653343 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7eceffd700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 -- 172.21.15.33:0/3970653343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f55c0 msgr2=0x7f7ed00f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 -- 172.21.15.33:0/3970653343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4005040 con 0x7f7ed00f6860 2022-02-02T13:37:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.084+0000 7f7ece7fc700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7ec000e7f0 tx=0x7f7ec000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.085+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec00092e0 con 0x7f7ed00f6860 2022-02-02T13:37:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.085+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed00f8150 con 0x7f7ed00f6860 2022-02-02T13:37:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.085+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7ec000f040 con 0x7f7ed00f6860 2022-02-02T13:37:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.085+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ec00146c0 con 0x7f7ed00f6860 2022-02-02T13:37:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.085+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed00f8710 con 0x7f7ed00f6860 2022-02-02T13:37:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.086+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed0045ad0 con 0x7f7ed00f6860 2022-02-02T13:37:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.086+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f7ec001b030 con 0x7f7ed00f6860 2022-02-02T13:37:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.086+0000 7f7eb77fe700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 0x7f7eb805e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.086+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7ec0075c20 con 0x7f7ed00f6860 2022-02-02T13:37:43.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.087+0000 7f7eceffd700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 0x7f7eb805e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:43.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.087+0000 7f7eceffd700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 0x7f7eb805e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7ec4000c00 tx=0x7f7ec4016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:43.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.090+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f7ec00489b0 con 0x7f7ed00f6860 2022-02-02T13:37:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.292+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ed00f8930 con 0x7f7ed00f6860 2022-02-02T13:37:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.292+0000 7f7eb77fe700 1 -- 172.21.15.33:0/3970653343 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+3004 (secure 0 0 0) 0x7f7ec0019070 con 0x7f7ed00f6860 2022-02-02T13:37:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 msgr2=0x7f7eb805e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:43.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 0x7f7eb805e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f7ec4000c00 tx=0x7f7ec4016040).stop 2022-02-02T13:37:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 msgr2=0x7f7ed00f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7ec000e7f0 tx=0x7f7ec000b040).stop 2022-02-02T13:37:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 shutdown_connections 2022-02-02T13:37:43.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f7eb805c2b0 0x7f7eb805e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ed00f55c0 0x7f7ed00f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 --2- 172.21.15.33:0/3970653343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ed00f6860 0x7f7ed00f7ba0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 >> 172.21.15.33:0/3970653343 conn(0x7f7ed00f0d40 msgr2=0x7f7ed00fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 shutdown_connections 2022-02-02T13:37:43.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:43.294+0000 7f7ed58ab700 1 -- 172.21.15.33:0/3970653343 wait complete. 2022-02-02T13:37:43.297 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 12 2022-02-02T13:37:43.304 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:37:43.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:43 smithi033 conmon[31996]: cluster 2022-02-02T13:37:41.533592+0000 mgr.smithi033.xvkvzp (mgr.14164) 199 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1023 B/s wr, 4 op/s 2022-02-02T13:37:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:43 smithi037 conmon[35544]: cluster 2022-02-02T13:37:41.533592+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:37:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:43 smithi037 conmon[35544]: mgr.14164) 199 : cluster [DBG] pgmap v160: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.1 KiB/s rd, 1023 B/s wr, 4 op/s 2022-02-02T13:37:43.764 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- bash -c 'ceph --format=json mds versions | jq -e ". | add == 4"' 2022-02-02T13:37:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:44 smithi033 conmon[31996]: audit 2022-02-02T13:37:43. 2022-02-02T13:37:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:44 smithi033 conmon[31996]: 293094+0000 mon.smithi033 (mon.0) 531 : audit [DBG] from='client.? 172.21.15.33:0/3970653343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T13:37:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:44 smithi033 conmon[31996]: cluster 2022-02-02T13:37:43.531002+0000 mon.smithi033 (mon.0) 532 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:standby 2022-02-02T13:37:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:44 smithi033 conmon[31996]: cluster 2022-02-02T13:37:43.531060+0000 mon.smithi033 (mon.0) 533 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: audit 2022-02-02T13:37:43.293094 2022-02-02T13:37:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 531 : audit [DBG] from='client.? 172.21.15.33:0/3970653343' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T13:37:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: cluster 2022-02-02T13:37:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: 2022-02-02T13:37:43.531002+0000 mon.smithi033 (mon.0 2022-02-02T13:37:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: ) 532 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:standby 2022-02-02T13:37:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: cluster 2022-02-02T13:37:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: 2022-02-02T 2022-02-02T13:37:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: 13:37:43.531060+0000 2022-02-02T13:37:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: mon.smithi033 (mon.0) 533 2022-02-02T13:37:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:44 smithi037 conmon[35544]: : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi037.lqirod=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:37:45.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:45 smithi033 conmon[31996]: cluster 2022-02-02T13:37:43.534238+0000 mgr.smithi033.xvkvzp (mgr.14164) 200 : cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 853 B/s wr, 4 op/s 2022-02-02T13:37:45.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:45 smithi033 conmon[31996]: audit 2022-02-02T13:37:44.535226+0000 mon.smithi033 (mon.0) 534 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:45 smithi037 conmon[35544]: cluster 2022-02-02T13:37:43.534238+0000 mgr.smithi033.xvkvzp (mgr.14164) 200 : 2022-02-02T13:37:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:45 smithi037 conmon[35544]: cluster [DBG] pgmap v161: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 853 B/s wr, 4 op/s 2022-02-02T13:37:45.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:45 smithi037 conmon[35544]: audit 2022-02-02T13:37:44.535226+0000 mon.smithi033 (mon.0) 534 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 -- 172.21.15.33:0/1047341945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 msgr2=0x7f0a0c0f91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 --2- 172.21.15.33:0/1047341945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c0f91b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f0a00004660 tx=0x7f0a00009b30).stop 2022-02-02T13:37:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 -- 172.21.15.33:0/1047341945 shutdown_connections 2022-02-02T13:37:46.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 --2- 172.21.15.33:0/1047341945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 0x7f0a0c0fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:46.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 --2- 172.21.15.33:0/1047341945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c0f91b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:46.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 -- 172.21.15.33:0/1047341945 >> 172.21.15.33:0/1047341945 conn(0x7f0a0c0f0b90 msgr2=0x7f0a0c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:46.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 -- 172.21.15.33:0/1047341945 shutdown_connections 2022-02-02T13:37:46.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.270+0000 7f0a11be2700 1 -- 172.21.15.33:0/1047341945 wait complete. 2022-02-02T13:37:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 Processor -- start 2022-02-02T13:37:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 -- start start 2022-02-02T13:37:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 0x7f0a0c1072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c107930 con 0x7f0a0c060270 2022-02-02T13:37:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.271+0000 7f0a11be2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c1080e0 con 0x7f0a0c0f96a0 2022-02-02T13:37:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56500/0 (socket says 172.21.15.33:56500) 2022-02-02T13:37:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 -- 172.21.15.33:0/2428311900 learned_addr learned my addr 172.21.15.33:0/2428311900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a0bfff700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 0x7f0a0c1072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 -- 172.21.15.33:0/2428311900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 msgr2=0x7f0a0c1072a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 0x7f0a0c1072a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:46.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 -- 172.21.15.33:0/2428311900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00005040 con 0x7f0a0c060270 2022-02-02T13:37:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a10be0700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0a00009990 tx=0x7f0a00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a00018070 con 0x7f0a0c060270 2022-02-02T13:37:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c108360 con 0x7f0a0c060270 2022-02-02T13:37:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0a00013410 con 0x7f0a0c060270 2022-02-02T13:37:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0001c620 con 0x7f0a0c060270 2022-02-02T13:37:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.272+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c1088c0 con 0x7f0a0c060270 2022-02-02T13:37:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.273+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c059100 con 0x7f0a0c060270 2022-02-02T13:37:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.274+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0a0001d420 con 0x7f0a0c060270 2022-02-02T13:37:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.274+0000 7f0a097fa700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 0x7f09fc05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.274+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0a00077f20 con 0x7f0a0c060270 2022-02-02T13:37:46.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.274+0000 7f0a0bfff700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 0x7f09fc05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:46.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.274+0000 7f0a0bfff700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 0x7f09fc05e7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0a0c106b40 tx=0x7f09f8008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:46.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.278+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0a000a42b0 con 0x7f0a0c060270 2022-02-02T13:37:46.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.513+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f0a0c027a00 con 0x7f0a0c060270 2022-02-02T13:37:46.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.513+0000 7f0a097fa700 1 -- 172.21.15.33:0/2428311900 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) v1 ==== 78+0+86 (secure 0 0 0) 0x7f0a0004e630 con 0x7f0a0c060270 2022-02-02T13:37:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 msgr2=0x7f09fc05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 0x7f09fc05e7c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0a0c106b40 tx=0x7f09f8008040).stop 2022-02-02T13:37:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 msgr2=0x7f0a0c106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:46.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f0a00009990 tx=0x7f0a00009b30).stop 2022-02-02T13:37:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 shutdown_connections 2022-02-02T13:37:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f09fc05c300 0x7f09fc05e7c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c060270 0x7f0a0c106db0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 --2- 172.21.15.33:0/2428311900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a0c0f96a0 0x7f0a0c1072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:46.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.515+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 >> 172.21.15.33:0/2428311900 conn(0x7f0a0c0f0b90 msgr2=0x7f0a0c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:46.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.516+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 shutdown_connections 2022-02-02T13:37:46.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:46.516+0000 7f0a11be2700 1 -- 172.21.15.33:0/2428311900 wait complete. 2022-02-02T13:37:46.527 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:37:46.910 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2022-02-02T13:37:46.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-02-02T13:37:47.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 -- 172.21.15.33:0/971567319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 msgr2=0x7fcd180f9190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/971567319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd180f9190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fcd08004660 tx=0x7fcd08009b30).stop 2022-02-02T13:37:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 -- 172.21.15.33:0/971567319 shutdown_connections 2022-02-02T13:37:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/971567319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 0x7fcd180fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/971567319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd180f9190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 -- 172.21.15.33:0/971567319 >> 172.21.15.33:0/971567319 conn(0x7fcd180f0bd0 msgr2=0x7fcd180f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 -- 172.21.15.33:0/971567319 shutdown_connections 2022-02-02T13:37:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.113+0000 7fcd1ced1700 1 -- 172.21.15.33:0/971567319 wait complete. 2022-02-02T13:37:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 Processor -- start 2022-02-02T13:37:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 -- start start 2022-02-02T13:37:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 0x7fcd18107100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18107700 con 0x7fcd1805fe20 2022-02-02T13:37:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1ced1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd18107840 con 0x7fcd180f9680 2022-02-02T13:37:47.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56510/0 (socket says 172.21.15.33:56510) 2022-02-02T13:37:47.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 -- 172.21.15.33:0/3807659879 learned_addr learned my addr 172.21.15.33:0/3807659879 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:47.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd15d9b700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 0x7fcd18107100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 -- 172.21.15.33:0/3807659879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 msgr2=0x7fcd18107100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 0x7fcd18107100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 -- 172.21.15.33:0/3807659879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd08005040 con 0x7fcd1805fe20 2022-02-02T13:37:47.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd1659c700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fcd08004e30 tx=0x7fcd08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.114+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd08018070 con 0x7fcd1805fe20 2022-02-02T13:37:47.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.115+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1810c1f0 con 0x7fcd1805fe20 2022-02-02T13:37:47.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.115+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fcd08013410 con 0x7fcd1805fe20 2022-02-02T13:37:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.115+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd0801c3c0 con 0x7fcd1805fe20 2022-02-02T13:37:47.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.115+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1810c750 con 0x7fcd1805fe20 2022-02-02T13:37:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.116+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fcd0801d420 con 0x7fcd1805fe20 2022-02-02T13:37:47.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.116+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18027a00 con 0x7fcd1805fe20 2022-02-02T13:37:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.116+0000 7fcd06ffd700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 0x7fcd0005e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.116+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fcd08077c30 con 0x7fcd1805fe20 2022-02-02T13:37:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.116+0000 7fcd15d9b700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 0x7fcd0005e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.117+0000 7fcd15d9b700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 0x7fcd0005e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fcd0c0096c0 tx=0x7fcd0c009be0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.121+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fcd0804a910 con 0x7fcd1805fe20 2022-02-02T13:37:47.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.284+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd180fec80 con 0x7fcd1805fe20 2022-02-02T13:37:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.285+0000 7fcd06ffd700 1 -- 172.21.15.33:0/3807659879 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+14012 (secure 0 0 0) 0x7fcd0801d6b0 con 0x7fcd1805fe20 2022-02-02T13:37:47.285 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:47.286 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":42,"fsid":"7b277774-842c-11ec-8c35-001a4aab830c","created":"2022-02-02T13:32:17.154681+0000","modified":"2022-02-02T13:37:27.135752+0000","last_up_change":"2022-02-02T13:36:30.424546+0000","last_in_change":"2022-02-02T13:36:14.639029+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-02-02T13:35:51.198783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2022-02-02T13:37:24.068159+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2022-02-02T13:37:24.569549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"eaa79e13-f217-4edf-af55-0441c3f0542e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6803","nonce":3011410766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6805","nonce":3011410766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6809","nonce":3011410766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":3011410766},{"type":"v1","addr":"172.21.15.33:6807","nonce":3011410766}]},"public_addr":"172.21.15.33:6803/3011410766","cluster_addr":"172.21.15.33:6805/3011410766","heartbeat_back_addr":"172.21.15.33:6809/3011410766","heartbeat_front_addr":"172.21.15.33:6807/3011410766","state":["exists","up"]},{"osd":1,"uuid":"3a87ef55-5a97-4f8d-b149-c0b9a75cb5d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6811","nonce":610736519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6813","nonce":610736519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6817","nonce":610736519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":610736519},{"type":"v1","addr":"172.21.15.33:6815","nonce":610736519}]},"public_addr":"172.21.15.33:6811/610736519","cluster_addr":"172.21.15.33:6813/610736519","heartbeat_back_addr":"172.21.15.33:6817/610736519","heartbeat_front_addr":"172.21.15.33:6815/610736519","state":["exists","up"]},{"osd":2,"uuid":"f7749bdb-8ca3-4aee-9a82-a6cccbe50cf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6819","nonce":2877179379}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6821","nonce":2877179379}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6825","nonce":2877179379}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":2877179379},{"type":"v1","addr":"172.21.15.33:6823","nonce":2877179379}]},"public_addr":"172.21.15.33:6819/2877179379","cluster_addr":"172.21.15.33:6821/2877179379","heartbeat_back_addr":"172.21.15.33:6825/2877179379","heartbeat_front_addr":"172.21.15.33:6823/2877179379","state":["exists","up"]},{"osd":3,"uuid":"b9b6adbb-241e-4118-bd0e-81a4270ae5f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6801","nonce":222406804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6803","nonce":222406804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6807","nonce":222406804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":222406804},{"type":"v1","addr":"172.21.15.37:6805","nonce":222406804}]},"public_addr":"172.21.15.37:6801/222406804","cluster_addr":"172.21.15.37:6803/222406804","heartbeat_back_addr":"172.21.15.37:6807/222406804","heartbeat_front_addr":"172.21.15.37:6805/222406804","state":["exists","up"]},{"osd":4,"uuid":"5805195f-9663-47d0-8a38-153c13fdf8b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6809","nonce":2153304138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6811","nonce":2153304138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6815","nonce":2153304138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2153304138},{"type":"v1","addr":"172.21.15.37:6813","nonce":2153304138}]},"public_addr":"172.21.15.37:6809/2153304138","cluster_addr":"172.21.15.37:6811/2153304138","heartbeat_back_addr":"172.21.15.37:6815/2153304138","heartbeat_front_addr":"172.21.15.37:6813/2153304138","state":["exists","up"]},{"osd":5,"uuid":"8ed2843c-5bba-4de8-b85a-1dc22383c429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6817","nonce":2797204966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6819","nonce":2797204966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6823","nonce":2797204966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":2797204966},{"type":"v1","addr":"172.21.15.37:6821","nonce":2797204966}]},"public_addr":"172.21.15.37:6817/2797204966","cluster_addr":"172.21.15.37:6819/2797204966","heartbeat_back_addr":"172.21.15.37:6823/2797204966","heartbeat_front_addr":"172.21.15.37:6821/2797204966","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:04.086489+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:23.087132+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:40.382065+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:35:55.650901+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:12.162455+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-02-02T13:36:28.775958+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2749807665":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/540968763":"2022-02-03T13:33:23.434820+0000","172.21.15.33:6800/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/16578411":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/2202031572":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/2474768824":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6800/162045619":"2022-02-03T13:33:06.802848+0000","172.21.15.33:6801/2741123903":"2022-02-03T13:32:46.589804+0000","172.21.15.33:0/236147922":"2022-02-03T13:33:23.434820+0000","172.21.15.33:0/302733905":"2022-02-03T13:32:46.589804+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-02-02T13:37:47.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 msgr2=0x7fcd0005e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 0x7fcd0005e830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fcd0c0096c0 tx=0x7fcd0c009be0).stop 2022-02-02T13:37:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 msgr2=0x7fcd18106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fcd08004e30 tx=0x7fcd08009b30).stop 2022-02-02T13:37:47.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 shutdown_connections 2022-02-02T13:37:47.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fcd0005c370 0x7fcd0005e830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd1805fe20 0x7fcd18106c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 --2- 172.21.15.33:0/3807659879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd180f9680 0x7fcd18107100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.286+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 >> 172.21.15.33:0/3807659879 conn(0x7fcd180f0bd0 msgr2=0x7fcd180f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.287+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 shutdown_connections 2022-02-02T13:37:47.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.287+0000 7fcd1ced1700 1 -- 172.21.15.33:0/3807659879 wait complete. 2022-02-02T13:37:47.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-02-02T13:35:51.198783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2022-02-02T13:37:24.068159+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2022-02-02T13:37:24.569549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-02-02T13:37:47.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2022-02-02T13:37:47.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 -- 172.21.15.33:0/22994163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c05fdf0 msgr2=0x7fd86c0f9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 --2- 172.21.15.33:0/22994163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c05fdf0 0x7fd86c0f9150 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fd85c004660 tx=0x7fd85c009b30).stop 2022-02-02T13:37:47.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 -- 172.21.15.33:0/22994163 shutdown_connections 2022-02-02T13:37:47.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 --2- 172.21.15.33:0/22994163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c0f9640 0x7fd86c0fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 --2- 172.21.15.33:0/22994163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c05fdf0 0x7fd86c0f9150 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 -- 172.21.15.33:0/22994163 >> 172.21.15.33:0/22994163 conn(0x7fd86c0f0b70 msgr2=0x7fd86c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 -- 172.21.15.33:0/22994163 shutdown_connections 2022-02-02T13:37:47.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.426+0000 7fd870bcc700 1 -- 172.21.15.33:0/22994163 wait complete. 2022-02-02T13:37:47.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 Processor -- start 2022-02-02T13:37:47.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 -- start start 2022-02-02T13:37:47.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c05fdf0 0x7fd86c106c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c107760 con 0x7fd86c0f9640 2022-02-02T13:37:47.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.427+0000 7fd870bcc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86c1078d0 con 0x7fd86c05fdf0 2022-02-02T13:37:47.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56520/0 (socket says 172.21.15.33:56520) 2022-02-02T13:37:47.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 -- 172.21.15.33:0/2548235863 learned_addr learned my addr 172.21.15.33:0/2548235863 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:47.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd86a59c700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c05fdf0 0x7fd86c106c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 -- 172.21.15.33:0/2548235863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c05fdf0 msgr2=0x7fd86c106c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c05fdf0 0x7fd86c106c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 -- 172.21.15.33:0/2548235863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c005040 con 0x7fd86c0f9640 2022-02-02T13:37:47.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd869d9b700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd860002700 tx=0x7fd860009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8600079c0 con 0x7fd86c0f9640 2022-02-02T13:37:47.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fd86000f040 con 0x7fd86c0f9640 2022-02-02T13:37:47.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd86c10c340 con 0x7fd86c0f9640 2022-02-02T13:37:47.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8600146e0 con 0x7fd86c0f9640 2022-02-02T13:37:47.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.428+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd86c10c8d0 con 0x7fd86c0f9640 2022-02-02T13:37:47.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.429+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd86c046330 con 0x7fd86c0f9640 2022-02-02T13:37:47.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.430+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd86001b060 con 0x7fd86c0f9640 2022-02-02T13:37:47.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.430+0000 7fd85affd700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 0x7fd85405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.430+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd860075d00 con 0x7fd86c0f9640 2022-02-02T13:37:47.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.430+0000 7fd86a59c700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 0x7fd85405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.430+0000 7fd86a59c700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 0x7fd85405e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd85c013620 tx=0x7fd85c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.434+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd860079030 con 0x7fd86c0f9640 2022-02-02T13:37:47.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:47 smithi037 conmon[35544]: cluster 2022-02-02T13:37:45.534648+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:37:47.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:47 smithi037 conmon[35544]: ) 201 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2022-02-02T13:37:47.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:47 smithi037 conmon[35544]: audit 2022-02-02T13:37:46.514481+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.33:0/2428311900' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2022-02-02T13:37:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:47 smithi033 conmon[31996]: cluster 2022-02-02T13:37:45. 2022-02-02T13:37:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:47 smithi033 conmon[31996]: 534648+0000 mgr.smithi033.xvkvzp (mgr.14164) 201 : cluster [DBG] pgmap v162: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 2 op/s 2022-02-02T13:37:47.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:47 smithi033 conmon[31996]: audit 2022-02-02T13:37:46.514481+0000 mon.smithi033 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.33:0/2428311900' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2022-02-02T13:37:47.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.602+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd86c027a00 con 0x7fd86c0f9640 2022-02-02T13:37:47.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.602+0000 7fd85affd700 1 -- 172.21.15.33:0/2548235863 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v42) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd8600489e0 con 0x7fd86c0f9640 2022-02-02T13:37:47.603 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2022-02-02T13:37:47.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 msgr2=0x7fd85405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 0x7fd85405e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd85c013620 tx=0x7fd85c009b30).stop 2022-02-02T13:37:47.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 msgr2=0x7fd86c107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fd860002700 tx=0x7fd860009d60).stop 2022-02-02T13:37:47.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 shutdown_connections 2022-02-02T13:37:47.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd85405c2b0 0x7fd85405e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd86c05fdf0 0x7fd86c106c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 --2- 172.21.15.33:0/2548235863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd86c0f9640 0x7fd86c107160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 >> 172.21.15.33:0/2548235863 conn(0x7fd86c0f0b70 msgr2=0x7fd86c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 shutdown_connections 2022-02-02T13:37:47.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.604+0000 7fd870bcc700 1 -- 172.21.15.33:0/2548235863 wait complete. 2022-02-02T13:37:47.618 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2022-02-02T13:37:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/4043754847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f5390 msgr2=0x7f1b840f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/4043754847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f5390 0x7f1b840f57b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f1b74004660 tx=0x7f1b74009b30).stop 2022-02-02T13:37:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/4043754847 shutdown_connections 2022-02-02T13:37:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/4043754847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f6630 0x7f1b840f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/4043754847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f5390 0x7f1b840f57b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/4043754847 >> 172.21.15.33:0/4043754847 conn(0x7f1b840f0b10 msgr2=0x7f1b840f2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/4043754847 shutdown_connections 2022-02-02T13:37:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.740+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/4043754847 wait complete. 2022-02-02T13:37:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 Processor -- start 2022-02-02T13:37:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 -- start start 2022-02-02T13:37:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 0x7f1b84105af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b84106590 con 0x7f1b840f6630 2022-02-02T13:37:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b8c6bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b841066d0 con 0x7f1b840f5390 2022-02-02T13:37:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b89c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.741+0000 7f1b89c57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56528/0 (socket says 172.21.15.33:56528) 2022-02-02T13:37:47.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b89c57700 1 -- 172.21.15.33:0/3818969667 learned_addr learned my addr 172.21.15.33:0/3818969667 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:47.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b8a458700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 0x7f1b84105af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b89c57700 1 -- 172.21.15.33:0/3818969667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 msgr2=0x7f1b84105af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b89c57700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 0x7f1b84105af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b89c57700 1 -- 172.21.15.33:0/3818969667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b74005040 con 0x7f1b840f6630 2022-02-02T13:37:47.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b8a458700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 0x7f1b84105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:37:47.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b89c57700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f1b8000e7f0 tx=0x7f1b8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b800092e0 con 0x7f1b840f6630 2022-02-02T13:37:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f1b8000f040 con 0x7f1b840f6630 2022-02-02T13:37:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8410b170 con 0x7f1b840f6630 2022-02-02T13:37:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b800146c0 con 0x7f1b840f6630 2022-02-02T13:37:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.742+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8410b730 con 0x7f1b840f6630 2022-02-02T13:37:47.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.743+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b84027a00 con 0x7f1b840f6630 2022-02-02T13:37:47.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.743+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f1b8001b030 con 0x7f1b840f6630 2022-02-02T13:37:47.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.744+0000 7f1b7affd700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 0x7f1b7005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:47.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.744+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f1b80075ca0 con 0x7f1b840f6630 2022-02-02T13:37:47.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.744+0000 7f1b8a458700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 0x7f1b7005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.744+0000 7f1b8a458700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 0x7f1b7005e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1b74005010 tx=0x7f1b7400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.748+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f1b8007a070 con 0x7f1b840f6630 2022-02-02T13:37:47.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.924+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f1b840fdb50 con 0x7f1b840f6630 2022-02-02T13:37:47.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.924+0000 7f1b7affd700 1 -- 172.21.15.33:0/3818969667 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1b80019020 con 0x7f1b840f6630 2022-02-02T13:37:47.925 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2022-02-02T13:37:47.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 msgr2=0x7f1b7005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 0x7f1b7005e770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1b74005010 tx=0x7f1b7400b040).stop 2022-02-02T13:37:47.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 msgr2=0x7f1b84105fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:47.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f1b8000e7f0 tx=0x7f1b8000b040).stop 2022-02-02T13:37:47.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 shutdown_connections 2022-02-02T13:37:47.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f1b7005c2b0 0x7f1b7005e770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b840f5390 0x7f1b84105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 --2- 172.21.15.33:0/3818969667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b840f6630 0x7f1b84105fe0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:47.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 >> 172.21.15.33:0/3818969667 conn(0x7f1b840f0b10 msgr2=0x7f1b840fa080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:47.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 shutdown_connections 2022-02-02T13:37:47.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:47.926+0000 7f1b8c6bc700 1 -- 172.21.15.33:0/3818969667 wait complete. 2022-02-02T13:37:47.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2022-02-02T13:37:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 -- 172.21.15.33:0/1872882081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f6490 msgr2=0x7fc80c0f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 --2- 172.21.15.33:0/1872882081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f6490 0x7fc80c0f68b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fc800004660 tx=0x7fc800009b30).stop 2022-02-02T13:37:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 -- 172.21.15.33:0/1872882081 shutdown_connections 2022-02-02T13:37:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 --2- 172.21.15.33:0/1872882081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f7730 0x7fc80c0f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 --2- 172.21.15.33:0/1872882081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f6490 0x7fc80c0f68b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 -- 172.21.15.33:0/1872882081 >> 172.21.15.33:0/1872882081 conn(0x7fc80c0f1bd0 msgr2=0x7fc80c0f4010 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 -- 172.21.15.33:0/1872882081 shutdown_connections 2022-02-02T13:37:48.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 -- 172.21.15.33:0/1872882081 wait complete. 2022-02-02T13:37:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.066+0000 7fc81202a700 1 Processor -- start 2022-02-02T13:37:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc81202a700 1 -- start start 2022-02-02T13:37:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc81202a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f6490 0x7fc80c106cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc81202a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc81202a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c1077c0 con 0x7fc80c0f7730 2022-02-02T13:37:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc81202a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c107900 con 0x7fc80c0f6490 2022-02-02T13:37:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56538/0 (socket says 172.21.15.33:56538) 2022-02-02T13:37:48.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 -- 172.21.15.33:0/221870121 learned_addr learned my addr 172.21.15.33:0/221870121 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f6490 0x7fc80c106cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 -- 172.21.15.33:0/221870121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f6490 msgr2=0x7fc80c106cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f6490 0x7fc80c106cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.067+0000 7fc80affd700 1 -- 172.21.15.33:0/221870121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800005040 con 0x7fc80c0f7730 2022-02-02T13:37:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc80affd700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fc7fc0026d0 tx=0x7fc7fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc0079c0 con 0x7fc80c0f7730 2022-02-02T13:37:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fc7fc00f040 con 0x7fc80c0f7730 2022-02-02T13:37:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c069d60 con 0x7fc80c0f7730 2022-02-02T13:37:48.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc014820 con 0x7fc80c0f7730 2022-02-02T13:37:48.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.068+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c06a320 con 0x7fc80c0f7730 2022-02-02T13:37:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.069+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c027a00 con 0x7fc80c0f7730 2022-02-02T13:37:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.069+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc7fc0090d0 con 0x7fc80c0f7730 2022-02-02T13:37:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.070+0000 7fc7f3fff700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 0x7fc7f405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.070+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc7fc075e50 con 0x7fc80c0f7730 2022-02-02T13:37:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.070+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 0x7fc7f405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.070+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 0x7fc7f405e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc800013620 tx=0x7fc80001b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:48.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.074+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc7fc048ba0 con 0x7fc80c0f7730 2022-02-02T13:37:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.242+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fc80c0fec50 con 0x7fc80c0f7730 2022-02-02T13:37:48.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.243+0000 7fc7f3fff700 1 -- 172.21.15.33:0/221870121 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v42) v1 ==== 107+0+11 (secure 0 0 0) 0x7fc7fc04c1c0 con 0x7fc80c0f7730 2022-02-02T13:37:48.244 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2022-02-02T13:37:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.244+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 msgr2=0x7fc7f405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.244+0000 7fc81202a700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 0x7fc7f405e770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc800013620 tx=0x7fc80001b040).stop 2022-02-02T13:37:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.244+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 msgr2=0x7fc80c1071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.244+0000 7fc81202a700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fc7fc0026d0 tx=0x7fc7fc009de0).stop 2022-02-02T13:37:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 shutdown_connections 2022-02-02T13:37:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc7f405c2b0 0x7fc7f405e770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc80c0f6490 0x7fc80c106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 --2- 172.21.15.33:0/221870121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0f7730 0x7fc80c1071c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 >> 172.21.15.33:0/221870121 conn(0x7fc80c0f1bd0 msgr2=0x7fc80c0fb180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 shutdown_connections 2022-02-02T13:37:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.245+0000 7fc81202a700 1 -- 172.21.15.33:0/221870121 wait complete. 2022-02-02T13:37:48.258 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-02-02T13:37:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2922742581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 msgr2=0x7f4a640f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2922742581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a640f66f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4a58004660 tx=0x7f4a58009b30).stop 2022-02-02T13:37:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2922742581 shutdown_connections 2022-02-02T13:37:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2922742581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a640f66f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2922742581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 0x7f4a640f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2922742581 >> 172.21.15.33:0/2922742581 conn(0x7f4a640f0bd0 msgr2=0x7f4a640f2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.378+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2922742581 shutdown_connections 2022-02-02T13:37:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2922742581 wait complete. 2022-02-02T13:37:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 Processor -- start 2022-02-02T13:37:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 -- start start 2022-02-02T13:37:48.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 0x7f4a64105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64106550 con 0x7f4a640f5cc0 2022-02-02T13:37:48.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.379+0000 7f4a6a12f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64106690 con 0x7f4a640f53b0 2022-02-02T13:37:48.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56546/0 (socket says 172.21.15.33:56546) 2022-02-02T13:37:48.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 -- 172.21.15.33:0/2835560487 learned_addr learned my addr 172.21.15.33:0/2835560487 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:48.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a637fe700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 0x7f4a64105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 -- 172.21.15.33:0/2835560487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 msgr2=0x7f4a64105ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 0x7f4a64105ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 -- 172.21.15.33:0/2835560487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58005040 con 0x7f4a640f5cc0 2022-02-02T13:37:48.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a62ffd700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4a58009990 tx=0x7f4a58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:48.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5801a070 con 0x7f4a640f5cc0 2022-02-02T13:37:48.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f4a58012a60 con 0x7f4a640f5cc0 2022-02-02T13:37:48.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6405f230 con 0x7f4a640f5cc0 2022-02-02T13:37:48.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a5801f800 con 0x7f4a640f5cc0 2022-02-02T13:37:48.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.380+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6405f7f0 con 0x7f4a640f5cc0 2022-02-02T13:37:48.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.381+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a640fdba0 con 0x7f4a640f5cc0 2022-02-02T13:37:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.383+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f4a580125d0 con 0x7f4a640f5cc0 2022-02-02T13:37:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.383+0000 7f4a4bfff700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 0x7f4a4c05e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.383+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f4a5807a250 con 0x7f4a640f5cc0 2022-02-02T13:37:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.383+0000 7f4a637fe700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 0x7f4a4c05e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.384+0000 7f4a637fe700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 0x7f4a4c05e830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4a54004c40 tx=0x7f4a5400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.387+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f4a5804d020 con 0x7f4a640f5cc0 2022-02-02T13:37:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:48 smithi033 conmon[31996]: audit 2022-02-02T13:37:47.285375+0000 mon.smithi033 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.33:0/3807659879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:37:48.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:48 smithi033 conmon[31996]: audit 2022-02-02T13:37:47.603388+0000 mon.smithi033 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.33:0/2548235863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T13:37:48.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:48 smithi033 conmon[31996]: audit 2022-02-02T13:37:47.925533+0000 mon.smithi033 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.33:0/3818969667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2022-02-02T13:37:48.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:48 smithi037 conmon[35544]: audit 2022-02-02T13:37:47.285375+0000 mon.smithi033 (mon.0) 536 : audit [DBG] from='client.? 172.21.15.33:0/3807659879' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-02-02T13:37:48.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:48 smithi037 conmon[35544]: audit 2022-02-02T13:37:47.603388+0000 mon.smithi033 (mon.0) 537 : audit [DBG] from='client.? 172.21.15.33:0/2548235863' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-02-02T13:37:48.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:48 smithi037 conmon[35544]: audit 2022-02-02T13:37:47.925533+0000 mon.smithi033 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.33:0/3818969667' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2022-02-02T13:37:48.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.591+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a6410b070 con 0x7f4a640f5cc0 2022-02-02T13:37:48.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.592+0000 7f4a4bfff700 1 -- 172.21.15.33:0/2835560487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3003 (secure 0 0 0) 0x7f4a58050640 con 0x7f4a640f5cc0 2022-02-02T13:37:48.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:37:48.594 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14468,"name":"cephfs.smithi033.kvxxkv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.33:6829/2211146573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":2211146573},{"type":"v1","addr":"172.21.15.33:6829","nonce":2211146573}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":13},{"gid":24287,"name":"cephfs.smithi037.nnxzjs","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.37:6827/2795446536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2795446536},{"type":"v1","addr":"172.21.15.37:6827","nonce":2795446536}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":12}],"filesystems":[{"mdsmap":{"epoch":11,"flags":50,"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2022-02-02T13:37:25.127857+0000","modified":"2022-02-02T13:37:39.197747+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14456":{"gid":14456,"name":"cephfs.smithi033.cdqmmc","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":3,"addr":"172.21.15.33:6827/215947153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":215947153},{"type":"v1","addr":"172.21.15.33:6827","nonce":215947153}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0},"gid_24277":{"gid":24277,"name":"cephfs.smithi037.lqirod","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.37:6825/3022495435","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":3022495435},{"type":"v1","addr":"172.21.15.37:6825","nonce":3022495435}]},"join_fscid":1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2022-02-02T13:37:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 msgr2=0x7f4a4c05e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 0x7f4a4c05e830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f4a54004c40 tx=0x7f4a5400b040).stop 2022-02-02T13:37:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 msgr2=0x7f4a64105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4a58009990 tx=0x7f4a58009b30).stop 2022-02-02T13:37:48.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 shutdown_connections 2022-02-02T13:37:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f4a4c05c370 0x7f4a4c05e830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f53b0 0x7f4a64105ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 --2- 172.21.15.33:0/2835560487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f5cc0 0x7f4a64105fa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 >> 172.21.15.33:0/2835560487 conn(0x7f4a640f0bd0 msgr2=0x7f4a640fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 shutdown_connections 2022-02-02T13:37:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:48.593+0000 7f4a6a12f700 1 -- 172.21.15.33:0/2835560487 wait complete. 2022-02-02T13:37:48.598 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2022-02-02T13:37:48.606 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 50} 2022-02-02T13:37:48.606 INFO:teuthology.run_tasks:Running task kclient... 2022-02-02T13:37:48.631 INFO:tasks.kclient:Mounting kernel clients... 2022-02-02T13:37:48.632 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2022-02-02T13:37:48.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:48.633 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2022-02-02T13:37:48.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:48.652 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2022-02-02T13:37:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2022-02-02T13:37:48.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T13:37:48.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:48.722 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2022-02-02T13:37:48.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:48.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2022-02-02T13:37:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2022-02-02T13:37:48.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-02-02T13:37:48.824 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2022-02-02T13:37:48.824 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph fs ls 2022-02-02T13:37:49.266 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:37:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: cluster 2022-02-02T13:37:47.535180+0000 mgr.smithi033.xvkvzp (mgr.14164) 202 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2022-02-02T13:37:49.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: audit 2022-02-02T13:37:48.243676+0000 mon.smithi033 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.33:0/221870121' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2022-02-02T13:37:49.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: audit 2022-02-02T13:37:48.543500+0000 mon.smithi033 (mon.0) 540 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:49.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: audit 2022-02-02T13:37:49.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: 2022-02-02T13:37:48.546880+0000 mon.smithi033 (mon.0) 541 : audit [INF] 2022-02-02T13:37:49.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:49.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: audit 2022-02-02T13:37: 2022-02-02T13:37:49.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: 48.592604+0000 mon.smithi033 (mon.0) 542 2022-02-02T13:37:49.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:49 smithi033 conmon[31996]: : audit [DBG] from='client.? 172.21.15.33:0/2835560487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T13:37:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:49 smithi037 conmon[35544]: cluster 2022-02-02T13:37:47.535180+0000 mgr.smithi033.xvkvzp (mgr.14164) 202 : cluster [DBG] pgmap v163: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 1 op/s 2022-02-02T13:37:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:49 smithi037 conmon[35544]: audit 2022-02-02T13:37:48.243676+0000 mon.smithi033 (mon.0) 539 : audit [DBG] from='client.? 172.21.15.33:0/221870121' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2022-02-02T13:37:49.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:49 smithi037 conmon[35544]: audit 2022-02-02T13:37:48.543500+0000 mon.smithi033 (mon.0) 540 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:49.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:49 smithi037 conmon[35544]: audit 2022-02-02T13:37:48.546880+0000 mon.smithi033 (mon.0) 541 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:37:49.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:49 smithi037 conmon[35544]: audit 2022-02-02T13:37:48.592604+0000 mon.smithi033 (mon.0) 542 : audit [DBG] from='client.? 172.21.15.33:0/2835560487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2022-02-02T13:37:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.589+0000 7effaaad7700 1 -- 172.21.15.33:0/1573693442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 msgr2=0x7effa40f6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:50.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.589+0000 7effaaad7700 1 --2- 172.21.15.33:0/1573693442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa40f6a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7effa0004660 tx=0x7effa0009b30).stop 2022-02-02T13:37:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- 172.21.15.33:0/1573693442 shutdown_connections 2022-02-02T13:37:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 --2- 172.21.15.33:0/1573693442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 0x7effa40f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 --2- 172.21.15.33:0/1573693442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa40f6a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- 172.21.15.33:0/1573693442 >> 172.21.15.33:0/1573693442 conn(0x7effa40f1d70 msgr2=0x7effa40f4190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:50.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- 172.21.15.33:0/1573693442 shutdown_connections 2022-02-02T13:37:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- 172.21.15.33:0/1573693442 wait complete. 2022-02-02T13:37:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 Processor -- start 2022-02-02T13:37:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- start start 2022-02-02T13:37:50.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 0x7effa41073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4107960 con 0x7effa40f6610 2022-02-02T13:37:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.590+0000 7effaaad7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa4107aa0 con 0x7effa40f78b0 2022-02-02T13:37:50.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56554/0 (socket says 172.21.15.33:56554) 2022-02-02T13:37:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 -- 172.21.15.33:0/2792406024 learned_addr learned my addr 172.21.15.33:0/2792406024 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa92d4700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 0x7effa41073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 -- 172.21.15.33:0/2792406024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 msgr2=0x7effa41073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 0x7effa41073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 -- 172.21.15.33:0/2792406024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0005040 con 0x7effa40f6610 2022-02-02T13:37:50.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effa9ad5700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7effa0007a60 tx=0x7effa0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:50.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa0018070 con 0x7effa40f6610 2022-02-02T13:37:50.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa41083e0 con 0x7effa40f6610 2022-02-02T13:37:50.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7effa0013410 con 0x7effa40f6610 2022-02-02T13:37:50.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effa001c400 con 0x7effa40f6610 2022-02-02T13:37:50.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.591+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa4108940 con 0x7effa40f6610 2022-02-02T13:37:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.592+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa4045ad0 con 0x7effa40f6610 2022-02-02T13:37:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.593+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7effa001d420 con 0x7effa40f6610 2022-02-02T13:37:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.593+0000 7eff9a7fc700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 0x7eff9005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.593+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7effa0078390 con 0x7effa40f6610 2022-02-02T13:37:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.593+0000 7effa92d4700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 0x7eff9005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.594+0000 7effa92d4700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 0x7eff9005e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7eff940041d0 tx=0x7eff94009040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.597+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7effa004b160 con 0x7effa40f6610 2022-02-02T13:37:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.795+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effa40feea0 con 0x7effa40f6610 2022-02-02T13:37:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.795+0000 7eff9a7fc700 1 -- 172.21.15.33:0/2792406024 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7effa004e780 con 0x7effa40f6610 2022-02-02T13:37:50.796 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2022-02-02T13:37:50.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 msgr2=0x7eff9005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 0x7eff9005e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7eff940041d0 tx=0x7eff94009040).stop 2022-02-02T13:37:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 msgr2=0x7effa4106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7effa0007a60 tx=0x7effa0009b30).stop 2022-02-02T13:37:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 shutdown_connections 2022-02-02T13:37:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7eff9005c2b0 0x7eff9005e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effa40f6610 0x7effa4106ec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 --2- 172.21.15.33:0/2792406024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effa40f78b0 0x7effa41073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 >> 172.21.15.33:0/2792406024 conn(0x7effa40f1d70 msgr2=0x7effa40fb300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 shutdown_connections 2022-02-02T13:37:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:50.797+0000 7effaaad7700 1 -- 172.21.15.33:0/2792406024 wait complete. 2022-02-02T13:37:51.283 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-02-02T13:37:51.284 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-02-02T13:37:51.284 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2022-02-02T13:37:51.285 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-02-02T13:37:51.285 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:51.285 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-02-02T13:37:51.285 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-02-02T13:37:51.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-02-02T13:37:51.286 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-02-02T13:37:51.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.287 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2022-02-02T13:37:51.304 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-02-02T13:37:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-02-02T13:37:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2022-02-02T13:37:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2022-02-02T13:37:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:51.306 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:51.306 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:51.307 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-02-02T13:37:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-02-02T13:37:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42344sec preferred_lft 42344sec 2022-02-02T13:37:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link noprefixroute 2022-02-02T13:37:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:51.308 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:51.309 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-02-02T13:37:51.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.310 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2022-02-02T13:37:51.310 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2022-02-02T13:37:51.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2022-02-02T13:37:51.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2022-02-02T13:37:51.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2022-02-02T13:37:51.312 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-02-02T13:37:51.312 DEBUG:teuthology.orchestra.run.smithi033:> ') 2022-02-02T13:37:51.384 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:51 smithi033 conmon[31996]: cluster 2022-02-02T13:37:49.535595+0000 mgr.smithi033.xvkvzp (mgr.14164) 203 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2022-02-02T13:37:51.384 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:51 smithi033 conmon[31996]: audit 2022-02-02T13:37:50.796568+0000 mon.smithi033 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.33:0/2792406024' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T13:37:51.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.485 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-02-02T13:37:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:51 smithi037 conmon[35544]: cluster 2022-02-02T13:37:49.535595+0000 mgr.smithi033.xvkvzp (mgr.14164) 203 : cluster [DBG] pgmap v164: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2022-02-02T13:37:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:51 smithi037 conmon[35544]: audit 2022-02-02T13:37:50.796568+0000 mon.smithi033 (mon.0) 543 : audit [DBG] from='client.? 172.21.15.33:0/2792406024' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T13:37:51.554 INFO:teuthology.orchestra.run.smithi033.stdout:1 2022-02-02T13:37:51.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.556 DEBUG:teuthology.orchestra.run.smithi033:> route 2022-02-02T13:37:51.645 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2022-02-02T13:37:51.646 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-02-02T13:37:51.646 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-02-02T13:37:51.646 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-02-02T13:37:51.647 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-02-02T13:37:51.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.648 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2022-02-02T13:37:51.648 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2022-02-02T13:37:51.648 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-02-02T13:37:51.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-02-02T13:37:51.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-02-02T13:37:51.649 DEBUG:teuthology.orchestra.run.smithi033:> ') 2022-02-02T13:37:51.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.894 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2022-02-02T13:37:51.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.912 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2022-02-02T13:37:51.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:51.968 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2022-02-02T13:37:51.968 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2022-02-02T13:37:51.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-02-02T13:37:51.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-02-02T13:37:51.970 DEBUG:teuthology.orchestra.run.smithi033:> ') 2022-02-02T13:37:52.061 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-02-02T13:37:52.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:52.062 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2022-02-02T13:37:52.062 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2022-02-02T13:37:52.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-02-02T13:37:52.063 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-02-02T13:37:52.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-02-02T13:37:52.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-02-02T13:37:52.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-02-02T13:37:52.065 DEBUG:teuthology.orchestra.run.smithi033:> ') 2022-02-02T13:37:52.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:52.288 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2022-02-02T13:37:52.288 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2022-02-02T13:37:52.289 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2022-02-02T13:37:52.289 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2022-02-02T13:37:52.289 DEBUG:teuthology.orchestra.run.smithi033:> ') 2022-02-02T13:37:52.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T13:37:52.425 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:52.449 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-02-02T13:37:52.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T13:37:52.450 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:52.506 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-02-02T13:37:52.506 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-02-02T13:37:52.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T13:37:52.604 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T13:37:52.604 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2022-02-02T13:37:52.661 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-02-02T13:37:52.661 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs" will pass to kernel. 2022-02-02T13:37:52.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-02-02T13:37:52.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:52.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:52.692 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2022-02-02T13:37:52.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid 7b277774-842c-11ec-8c35-001a4aab830c -- ceph fs ls 2022-02-02T13:37:53.177 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/mon.smithi033/config 2022-02-02T13:37:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:53 smithi033 conmon[31996]: cluster 2022-02-02T13:37:51.536003+0000 mgr.smithi033.xvkvzp (mgr.14164) 204 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2022-02-02T13:37:53.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:53 smithi037 conmon[35544]: cluster 2022-02-02T13:37:51.536003+0000 mgr.smithi033.xvkvzp (mgr.14164) 204 : cluster [DBG] pgmap v165: 65 pgs: 65 active+clean; 2.3 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2022-02-02T13:37:54.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.659+0000 7f0afdb0a700 1 -- 172.21.15.33:0/4112347584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 msgr2=0x7f0af80f6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.659+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/4112347584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af80f6be0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f0ae8004660 tx=0x7f0ae8009b30).stop 2022-02-02T13:37:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 -- 172.21.15.33:0/4112347584 shutdown_connections 2022-02-02T13:37:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/4112347584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af80f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/4112347584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af80f6be0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 -- 172.21.15.33:0/4112347584 >> 172.21.15.33:0/4112347584 conn(0x7f0af80f1f20 msgr2=0x7f0af80f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:54.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 -- 172.21.15.33:0/4112347584 shutdown_connections 2022-02-02T13:37:54.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 -- 172.21.15.33:0/4112347584 wait complete. 2022-02-02T13:37:54.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 Processor -- start 2022-02-02T13:37:54.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.660+0000 7f0afdb0a700 1 -- start start 2022-02-02T13:37:54.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0afdb0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:54.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0afdb0a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af8109790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:54.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0afdb0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8109d40 con 0x7f0af80f67c0 2022-02-02T13:37:54.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0afdb0a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0af8109e80 con 0x7f0af80f7a60 2022-02-02T13:37:54.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:54.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56568/0 (socket says 172.21.15.33:56568) 2022-02-02T13:37:54.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 -- 172.21.15.33:0/1878249179 learned_addr learned my addr 172.21.15.33:0/1878249179 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af6ffd700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af8109790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 -- 172.21.15.33:0/1878249179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 msgr2=0x7f0af8109790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af8109790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 -- 172.21.15.33:0/1878249179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae8005040 con 0x7f0af80f67c0 2022-02-02T13:37:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af6ffd700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af8109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:37:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0af77fe700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0ae8004e30 tx=0x7f0ae8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8018070 con 0x7f0af80f67c0 2022-02-02T13:37:54.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f0ae8013410 con 0x7f0af80f67c0 2022-02-02T13:37:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0af810a7c0 con 0x7f0af80f67c0 2022-02-02T13:37:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.661+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae801c3c0 con 0x7f0af80f67c0 2022-02-02T13:37:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.662+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0af810ad20 con 0x7f0af80f67c0 2022-02-02T13:37:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.662+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0af8045ad0 con 0x7f0af80f67c0 2022-02-02T13:37:54.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.663+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f0ae801d420 con 0x7f0af80f67c0 2022-02-02T13:37:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.663+0000 7f0adffff700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 0x7f0ae005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.663+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f0ae8077c30 con 0x7f0af80f67c0 2022-02-02T13:37:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.663+0000 7f0af6ffd700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 0x7f0ae005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:54.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.664+0000 7f0af6ffd700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 0x7f0ae005e760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0aec009fd0 tx=0x7f0aec00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:54.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.667+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f0ae804a910 con 0x7f0af80f67c0 2022-02-02T13:37:54.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.865+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0af8027a00 con 0x7f0af80f67c0 2022-02-02T13:37:54.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.865+0000 7f0adffff700 1 -- 172.21.15.33:0/1878249179 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+83 (secure 0 0 0) 0x7f0ae801d6b0 con 0x7f0af80f67c0 2022-02-02T13:37:54.866 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2022-02-02T13:37:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 msgr2=0x7f0ae005e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 0x7f0ae005e760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f0aec009fd0 tx=0x7f0aec00b040).stop 2022-02-02T13:37:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 msgr2=0x7f0af81092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f0ae8004e30 tx=0x7f0ae8009b30).stop 2022-02-02T13:37:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 shutdown_connections 2022-02-02T13:37:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f0ae005c2a0 0x7f0ae005e760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0af80f67c0 0x7f0af81092a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 --2- 172.21.15.33:0/1878249179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0af80f7a60 0x7f0af8109790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 >> 172.21.15.33:0/1878249179 conn(0x7f0af80f1f20 msgr2=0x7f0af806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 shutdown_connections 2022-02-02T13:37:54.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:54.867+0000 7f0afdb0a700 1 -- 172.21.15.33:0/1878249179 wait complete. 2022-02-02T13:37:55.395 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:55 smithi033 conmon[31996]: cluster 2022-02-02T13:37:53.536664+0000 mgr.smithi033.xvkvzp (mgr.14164) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2022-02-02T13:37:55.396 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:55 smithi033 conmon[31996]: audit 2022-02-02T13:37:54.866396+0000 mon.smithi033 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.33:0/1878249179' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T13:37:55.397 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-02-02T13:37:55.397 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-02-02T13:37:55.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2022-02-02T13:37:55.398 INFO:tasks.cephfs.mount:self.client.name = client.1 2022-02-02T13:37:55.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:55.398 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-02-02T13:37:55.399 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-02-02T13:37:55.399 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-02-02T13:37:55.399 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2022-02-02T13:37:55.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.400 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2022-02-02T13:37:55.422 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-02-02T13:37:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-02-02T13:37:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2022-02-02T13:37:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2022-02-02T13:37:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:55.423 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:55.424 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:55.424 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2022-02-02T13:37:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2022-02-02T13:37:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42335sec preferred_lft 42335sec 2022-02-02T13:37:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2022-02-02T13:37:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2022-02-02T13:37:55.426 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-02-02T13:37:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2022-02-02T13:37:55.426 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-02-02T13:37:55.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.427 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-02-02T13:37:55.427 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-02-02T13:37:55.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2022-02-02T13:37:55.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2022-02-02T13:37:55.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2022-02-02T13:37:55.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-02-02T13:37:55.429 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-02-02T13:37:55.506 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:55 smithi037 conmon[35544]: cluster 2022-02-02T13:37:53.536664+0000 mgr.smithi033.xvkvzp (mgr.14164) 205 : cluster [DBG] pgmap v166: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2022-02-02T13:37:55.507 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:55 smithi037 conmon[35544]: audit 2022-02-02T13:37:54.866396+0000 mon.smithi033 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.33:0/1878249179' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2022-02-02T13:37:55.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.608 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-02-02T13:37:55.638 INFO:teuthology.orchestra.run.smithi037.stdout:1 2022-02-02T13:37:55.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.640 DEBUG:teuthology.orchestra.run.smithi037:> route 2022-02-02T13:37:55.743 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2022-02-02T13:37:55.744 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-02-02T13:37:55.744 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2022-02-02T13:37:55.744 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2022-02-02T13:37:55.744 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-02-02T13:37:55.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.745 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-02-02T13:37:55.746 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-02-02T13:37:55.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2022-02-02T13:37:55.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2022-02-02T13:37:55.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2022-02-02T13:37:55.747 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-02-02T13:37:55.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:55.990 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2022-02-02T13:37:56.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:56.007 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2022-02-02T13:37:56.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:56.063 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-02-02T13:37:56.063 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-02-02T13:37:56.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2022-02-02T13:37:56.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2022-02-02T13:37:56.064 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-02-02T13:37:56.157 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2022-02-02T13:37:56.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:56.158 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-02-02T13:37:56.158 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-02-02T13:37:56.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2022-02-02T13:37:56.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-02-02T13:37:56.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2022-02-02T13:37:56.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2022-02-02T13:37:56.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2022-02-02T13:37:56.160 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-02-02T13:37:56.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:56.370 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2022-02-02T13:37:56.370 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2022-02-02T13:37:56.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2022-02-02T13:37:56.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2022-02-02T13:37:56.371 DEBUG:teuthology.orchestra.run.smithi037:> ') 2022-02-02T13:37:56.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T13:37:56.490 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.511 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2022-02-02T13:37:56.512 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-02-02T13:37:56.512 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.567 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-02-02T13:37:56.568 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-02-02T13:37:56.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T13:37:56.677 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T13:37:56.678 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2022-02-02T13:37:56.712 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2022-02-02T13:37:56.713 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs" will pass to kernel. 2022-02-02T13:37:56.719 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-02-02T13:37:56.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-02-02T13:37:56.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.747 INFO:teuthology.run_tasks:Running task print... 2022-02-02T13:37:56.758 INFO:teuthology.task.print:**** done client 2022-02-02T13:37:56.759 INFO:teuthology.run_tasks:Running task parallel... 2022-02-02T13:37:56.824 INFO:teuthology.task.parallel:starting parallel... 2022-02-02T13:37:56.825 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-02-02T13:37:56.826 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-02-02T13:37:56.826 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:37:56.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -e sha1=b0d76d45e4cb48de326cfbdc43296681162f672c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2022-02-02T13:37:56.827 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-02-02T13:37:56.828 INFO:teuthology.task.sequential:In sequential, running task workunit... 2022-02-02T13:37:56.831 INFO:tasks.workunit:Pulling workunits from ref b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:37:56.833 INFO:tasks.workunit:Making a separate scratch dir for every client... 2022-02-02T13:37:56.833 INFO:tasks.workunit:timeout=3h 2022-02-02T13:37:56.834 INFO:tasks.workunit:cleanup=True 2022-02-02T13:37:56.834 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:56.859 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2022-02-02T13:37:56.859 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 99h/153d Inode: 1 Links: 2 2022-02-02T13:37:56.860 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:37:56.860 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:cephfs_t:s0 2022-02-02T13:37:56.860 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-02-02T13:37:56.860 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2022-02-02 13:37:28.150524656 +0000 2022-02-02T13:37:56.861 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2022-02-02 13:37:52.689553492 +0000 2022-02-02T13:37:56.861 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2022-02-02 13:37:28.150524656 +0000 2022-02-02T13:37:56.861 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2022-02-02T13:37:56.861 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2022-02-02T13:37:56.932 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.950 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.951 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2022-02-02T13:37:56.951 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 78h/120d Inode: 1 Links: 3 2022-02-02T13:37:56.951 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2022-02-02T13:37:56.951 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:cephfs_t:s0 2022-02-02T13:37:56.951 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2022-02-02T13:37:56.952 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2022-02-02 13:37:56.927486452 +0000 2022-02-02T13:37:56.952 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2022-02-02 13:37:56.927486452 +0000 2022-02-02T13:37:56.952 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2022-02-02 13:37:28.150524656 +0000 2022-02-02T13:37:56.953 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2022-02-02T13:37:56.953 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2022-02-02T13:37:57.021 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:37:57.022 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:37:57.039 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2022-02-02T13:37:57.077 INFO:tasks.workunit.client.1.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2022-02-02T13:37:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:57 smithi037 conmon[35544]: cluster 2022-02-02T13:37:55.537236+0000 mgr.smithi033.xvkvzp (mgr.14164) 206 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2022-02-02T13:37:57.608 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:57 smithi033 conmon[31996]: cluster 2022-02-02T13:37:55.537236+0000 mgr.smithi033.xvkvzp 2022-02-02T13:37:57.608 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:57 smithi033 conmon[31996]: (mgr.14164) 206 : cluster [DBG] pgmap v167: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2022-02-02T13:37:58.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4165918067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f6860 msgr2=0x7fdc640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:58.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4165918067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f6860 0x7fdc640f6cc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fdc4c004660 tx=0x7fdc4c009b30).stop 2022-02-02T13:37:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4165918067 shutdown_connections 2022-02-02T13:37:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4165918067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f6860 0x7fdc640f6cc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4165918067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f55c0 0x7fdc640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:37:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4165918067 >> 172.21.15.33:0/4165918067 conn(0x7fdc640f0d40 msgr2=0x7fdc640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:58.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4165918067 shutdown_connections 2022-02-02T13:37:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4165918067 wait complete. 2022-02-02T13:37:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 Processor -- start 2022-02-02T13:37:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.604+0000 7fdc6a0c1700 1 -- start start 2022-02-02T13:37:58.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f6860 0x7fdc64107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64107ab0 con 0x7fdc640f55c0 2022-02-02T13:37:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc64108360 con 0x7fdc640f6860 2022-02-02T13:37:58.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56580/0 (socket says 172.21.15.33:56580) 2022-02-02T13:37:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 -- 172.21.15.33:0/4122234857 learned_addr learned my addr 172.21.15.33:0/4122234857 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:37:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 -- 172.21.15.33:0/4122234857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f6860 msgr2=0x7fdc64107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc62ffd700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f6860 0x7fdc64107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:58.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f6860 0x7fdc64107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 -- 172.21.15.33:0/4122234857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c005040 con 0x7fdc640f55c0 2022-02-02T13:37:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc637fe700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdc540093f0 tx=0x7fdc54006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc54009ea0 con 0x7fdc640f55c0 2022-02-02T13:37:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc64108640 con 0x7fdc640f55c0 2022-02-02T13:37:58.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7fdc54013ad0 con 0x7fdc640f55c0 2022-02-02T13:37:58.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.605+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc64108c00 con 0x7fdc640f55c0 2022-02-02T13:37:58.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.606+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc5400da80 con 0x7fdc640f55c0 2022-02-02T13:37:58.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.607+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fdc5401a060 con 0x7fdc640f55c0 2022-02-02T13:37:58.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.607+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc640f49b0 con 0x7fdc640f55c0 2022-02-02T13:37:58.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.607+0000 7fdc5bfff700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 0x7fdc5005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:37:58.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.607+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fdc54075e90 con 0x7fdc640f55c0 2022-02-02T13:37:58.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.607+0000 7fdc62ffd700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 0x7fdc5005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:37:58.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.608+0000 7fdc62ffd700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 0x7fdc5005e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fdc4c009d60 tx=0x7fdc4c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:37:58.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.611+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fdc54048b90 con 0x7fdc640f55c0 2022-02-02T13:37:58.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.771+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fdc64045ad0 con 0x7fdc640f55c0 2022-02-02T13:37:58.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.772+0000 7fdc5bfff700 1 -- 172.21.15.33:0/4122234857 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v16)=0 v16) v1 ==== 155+0+0 (secure 0 0 0) 0x7fdc5404c1b0 con 0x7fdc640f55c0 2022-02-02T13:37:58.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 msgr2=0x7fdc5005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 0x7fdc5005e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fdc4c009d60 tx=0x7fdc4c009b30).stop 2022-02-02T13:37:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 msgr2=0x7fdc64106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:37:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fdc540093f0 tx=0x7fdc54006ec0).stop 2022-02-02T13:37:58.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 shutdown_connections 2022-02-02T13:37:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fdc5005c2b0 0x7fdc5005e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc640f55c0 0x7fdc64106f80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 --2- 172.21.15.33:0/4122234857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640f6860 0x7fdc64107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:37:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 >> 172.21.15.33:0/4122234857 conn(0x7fdc640f0d40 msgr2=0x7fdc6405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:37:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.773+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 shutdown_connections 2022-02-02T13:37:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:37:58.774+0000 7fdc6a0c1700 1 -- 172.21.15.33:0/4122234857 wait complete. 2022-02-02T13:37:59.285 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:37:59 smithi033 conmon[31996]: cluster 2022-02-02T13:37:57.537644+0000 mgr.smithi033.xvkvzp (mgr.14164) 207 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2022-02-02T13:37:59.286 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -e sha1=b0d76d45e4cb48de326cfbdc43296681162f672c -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2022-02-02T13:37:59.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:59 smithi037 conmon[35544]: cluster 2022-02-02T13:37:57.537644+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:37:59.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:37:59 smithi037 conmon[35544]: 14164) 207 : cluster [DBG] pgmap v168: 65 pgs: 65 active+clean; 2.5 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2022-02-02T13:38:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 -- 172.21.15.33:0/2788588460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 msgr2=0x7f78640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 --2- 172.21.15.33:0/2788588460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f78640f6b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7854004660 tx=0x7f7854009b30).stop 2022-02-02T13:38:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 -- 172.21.15.33:0/2788588460 shutdown_connections 2022-02-02T13:38:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 --2- 172.21.15.33:0/2788588460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 --2- 172.21.15.33:0/2788588460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f78640f6b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 -- 172.21.15.33:0/2788588460 >> 172.21.15.33:0/2788588460 conn(0x7f78640f1e40 msgr2=0x7f78640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 -- 172.21.15.33:0/2788588460 shutdown_connections 2022-02-02T13:38:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.057+0000 7f7869cad700 1 -- 172.21.15.33:0/2788588460 wait complete. 2022-02-02T13:38:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 Processor -- start 2022-02-02T13:38:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 -- start start 2022-02-02T13:38:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78641074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864107a50 con 0x7f78640f66e0 2022-02-02T13:38:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.058+0000 7f7869cad700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7864107b90 con 0x7f78640f7980 2022-02-02T13:38:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56590/0 (socket says 172.21.15.33:56590) 2022-02-02T13:38:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 -- 172.21.15.33:0/1969354023 learned_addr learned my addr 172.21.15.33:0/1969354023 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f7862ffd700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78641074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 -- 172.21.15.33:0/1969354023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 msgr2=0x7f78641074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78641074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 -- 172.21.15.33:0/1969354023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854005040 con 0x7f78640f66e0 2022-02-02T13:38:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f7862ffd700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78641074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:38:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f78637fe700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7854004e30 tx=0x7f7854009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7854018070 con 0x7f78640f66e0 2022-02-02T13:38:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f7854013410 con 0x7f78640f66e0 2022-02-02T13:38:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f785401c3c0 con 0x7f78640f66e0 2022-02-02T13:38:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78641084d0 con 0x7f78640f66e0 2022-02-02T13:38:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.059+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7864108a30 con 0x7f78640f66e0 2022-02-02T13:38:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.060+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7864045ad0 con 0x7f78640f66e0 2022-02-02T13:38:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.061+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f785401d420 con 0x7f78640f66e0 2022-02-02T13:38:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.061+0000 7f785bfff700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 0x7f785005e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.062+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f7854078270 con 0x7f78640f66e0 2022-02-02T13:38:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.062+0000 7f7862ffd700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 0x7f785005e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.062+0000 7f7862ffd700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 0x7f785005e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f784c009740 tx=0x7f784c009be0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.065+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f785404b020 con 0x7f78640f66e0 2022-02-02T13:38:01.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.223+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f78640ff020 con 0x7f78640f66e0 2022-02-02T13:38:01.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.223+0000 7f785bfff700 1 -- 172.21.15.33:0/1969354023 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v16)=0 v16) v1 ==== 163+0+0 (secure 0 0 0) 0x7f785401d6b0 con 0x7f78640f66e0 2022-02-02T13:38:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 msgr2=0x7f785005e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 0x7f785005e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f784c009740 tx=0x7f784c009be0).stop 2022-02-02T13:38:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 msgr2=0x7f7864106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7854004e30 tx=0x7f7854009b30).stop 2022-02-02T13:38:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 shutdown_connections 2022-02-02T13:38:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f785005c2b0 0x7f785005e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78640f66e0 0x7f7864106fb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 --2- 172.21.15.33:0/1969354023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78640f7980 0x7f78641074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:01.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 >> 172.21.15.33:0/1969354023 conn(0x7f78640f1e40 msgr2=0x7f78640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:01.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 shutdown_connections 2022-02-02T13:38:01.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:01.225+0000 7f7869cad700 1 -- 172.21.15.33:0/1969354023 wait complete. 2022-02-02T13:38:01.412 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:01 smithi033 conmon[31996]: cluster 2022-02-02T13:37:59.538041+0000 mgr.smithi033.xvkvzp (mgr.14164) 208 : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2022-02-02T13:38:01.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:01 smithi037 conmon[35544]: cluster 2022-02-02T13:37:59.538041+0000 mgr.smithi033.xvkvzp (mgr.14164) 208 2022-02-02T13:38:01.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:01 smithi037 conmon[35544]: : cluster [DBG] pgmap v169: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2022-02-02T13:38:01.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -e sha1=b0d76d45e4cb48de326cfbdc43296681162f672c -- bash -c 'ceph config set global log_to_journald false --force' 2022-02-02T13:38:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 -- 172.21.15.33:0/1601876174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 msgr2=0x7f87c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:03.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 --2- 172.21.15.33:0/1601876174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c40f59e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f87b8004660 tx=0x7f87b8009b30).stop 2022-02-02T13:38:03.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 -- 172.21.15.33:0/1601876174 shutdown_connections 2022-02-02T13:38:03.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 --2- 172.21.15.33:0/1601876174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 0x7f87c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:03.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 --2- 172.21.15.33:0/1601876174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c40f59e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:03.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 -- 172.21.15.33:0/1601876174 >> 172.21.15.33:0/1601876174 conn(0x7f87c40f0d40 msgr2=0x7f87c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:03.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 -- 172.21.15.33:0/1601876174 shutdown_connections 2022-02-02T13:38:03.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 -- 172.21.15.33:0/1601876174 wait complete. 2022-02-02T13:38:03.340 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:03 smithi033 conmon[31996]: cluster 2022-02-02T13:38:01.538461+0000 mgr.smithi033.xvkvzp (mgr.14164) 209 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2022-02-02T13:38:03.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.337+0000 7f87c94f1700 1 Processor -- start 2022-02-02T13:38:03.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c94f1700 1 -- start start 2022-02-02T13:38:03.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c94f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:03.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c94f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 0x7f87c4068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:03.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c94f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40603a0 con 0x7f87c40f55c0 2022-02-02T13:38:03.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c94f1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c40604e0 con 0x7f87c40f6860 2022-02-02T13:38:03.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:03.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56598/0 (socket says 172.21.15.33:56598) 2022-02-02T13:38:03.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 -- 172.21.15.33:0/2133186997 learned_addr learned my addr 172.21.15.33:0/2133186997 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:03.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c27fc700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 0x7f87c4068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:03.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 -- 172.21.15.33:0/2133186997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 msgr2=0x7f87c4068890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:03.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 0x7f87c4068890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:03.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 -- 172.21.15.33:0/2133186997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8005040 con 0x7f87c40f55c0 2022-02-02T13:38:03.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.338+0000 7f87c2ffd700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f87b8007a60 tx=0x7f87b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:03.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.339+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b8018070 con 0x7f87c40f55c0 2022-02-02T13:38:03.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.339+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(25 keys) v1 ==== 1047+0+0 (secure 0 0 0) 0x7f87b8013410 con 0x7f87c40f55c0 2022-02-02T13:38:03.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.339+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c4068d80 con 0x7f87c40f55c0 2022-02-02T13:38:03.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.339+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b801c620 con 0x7f87c40f55c0 2022-02-02T13:38:03.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.339+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c4069280 con 0x7f87c40f55c0 2022-02-02T13:38:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.340+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f87b801c890 con 0x7f87c40f55c0 2022-02-02T13:38:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.340+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c4045ad0 con 0x7f87c40f55c0 2022-02-02T13:38:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.340+0000 7f87ab7fe700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 0x7f87ac05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:03.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.340+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f87b8077e50 con 0x7f87c40f55c0 2022-02-02T13:38:03.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.341+0000 7f87c27fc700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 0x7f87ac05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:03.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.341+0000 7f87c27fc700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 0x7f87ac05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f87b400b790 tx=0x7f87b4008040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:03.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.345+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f87b804ab30 con 0x7f87c40f55c0 2022-02-02T13:38:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.507+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f87c40fdf70 con 0x7f87c40f55c0 2022-02-02T13:38:03.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.512+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f87b8009630 con 0x7f87c40f55c0 2022-02-02T13:38:03.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.512+0000 7f87ab7fe700 1 -- 172.21.15.33:0/2133186997 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v17)=0 v17) v1 ==== 135+0+0 (secure 0 0 0) 0x7f87b804e150 con 0x7f87c40f55c0 2022-02-02T13:38:03.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 msgr2=0x7f87ac05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:03.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 0x7f87ac05e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f87b400b790 tx=0x7f87b4008040).stop 2022-02-02T13:38:03.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 msgr2=0x7f87c405feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:03.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f87b8007a60 tx=0x7f87b8009b30).stop 2022-02-02T13:38:03.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 shutdown_connections 2022-02-02T13:38:03.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f87ac05c2b0 0x7f87ac05e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:03.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87c40f55c0 0x7f87c405feb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:03.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 --2- 172.21.15.33:0/2133186997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c40f6860 0x7f87c4068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:03.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.514+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 >> 172.21.15.33:0/2133186997 conn(0x7f87c40f0d40 msgr2=0x7f87c40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:03.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.515+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 shutdown_connections 2022-02-02T13:38:03.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:03.515+0000 7f87c94f1700 1 -- 172.21.15.33:0/2133186997 wait complete. 2022-02-02T13:38:03.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:03 smithi037 conmon[35544]: cluster 2022-02-02T13:38:01.538461+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:03.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:03 smithi037 conmon[35544]: 209 : cluster [DBG] pgmap v170: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2022-02-02T13:38:03.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -e sha1=b0d76d45e4cb48de326cfbdc43296681162f672c -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2022-02-02T13:38:04.716 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:04 smithi033 conmon[31996]: audit 2022-02-02T13:38:03.512811+0000 2022-02-02T13:38:04.716 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:04 smithi033 conmon[31996]: mon.smithi033 (mon.0) 545 : audit [INF] from='client.? 172.21.15.33:0/2133186997' entity='client.admin' 2022-02-02T13:38:04.716 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:04 smithi033 conmon[31996]: audit 2022-02-02T13:38:03.516945+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:04.717 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:04 smithi033 conmon[31996]: audit 2022-02-02T13:38:03.522299+0000 mon.smithi033 (mon.0) 547 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:04.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:04 smithi037 conmon[35544]: audit 2022-02-02T13:38:03.512811+0000 mon.smithi033 (mon.0) 545 : audit [INF] from='client.? 172.21.15.33:0/2133186997' entity='client.admin' 2022-02-02T13:38:04.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:04 smithi037 conmon[35544]: audit 2022-02-02T13:38:03.516945+0000 mon.smithi033 (mon.0) 546 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:04.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:04 smithi037 conmon[35544]: audit 2022-02-02T13:38:03.522299+0000 mon.smithi033 (mon.0 2022-02-02T13:38:04.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:04 smithi037 conmon[35544]: ) 547 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:05.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 -- 172.21.15.33:0/849061649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f55c0 msgr2=0x7f207c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 --2- 172.21.15.33:0/849061649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f55c0 0x7f207c0f59e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f2070004660 tx=0x7f2070009b30).stop 2022-02-02T13:38:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 -- 172.21.15.33:0/849061649 shutdown_connections 2022-02-02T13:38:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 --2- 172.21.15.33:0/849061649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f6860 0x7f207c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 --2- 172.21.15.33:0/849061649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f55c0 0x7f207c0f59e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 -- 172.21.15.33:0/849061649 >> 172.21.15.33:0/849061649 conn(0x7f207c0f0d40 msgr2=0x7f207c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 -- 172.21.15.33:0/849061649 shutdown_connections 2022-02-02T13:38:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.560+0000 7f20820c1700 1 -- 172.21.15.33:0/849061649 wait complete. 2022-02-02T13:38:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 Processor -- start 2022-02-02T13:38:05.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 -- start start 2022-02-02T13:38:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f55c0 0x7f207c10c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c060310 con 0x7f207c0f6860 2022-02-02T13:38:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f20820c1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c060450 con 0x7f207c0f55c0 2022-02-02T13:38:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f207affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f207affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56610/0 (socket says 172.21.15.33:56610) 2022-02-02T13:38:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.561+0000 7f207affd700 1 -- 172.21.15.33:0/215791805 learned_addr learned my addr 172.21.15.33:0/215791805 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:05.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f207b7fe700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f55c0 0x7f207c10c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f207affd700 1 -- 172.21.15.33:0/215791805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f55c0 msgr2=0x7f207c10c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f207affd700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f55c0 0x7f207c10c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f207affd700 1 -- 172.21.15.33:0/215791805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2070005040 con 0x7f207c0f6860 2022-02-02T13:38:05.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f207affd700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f206c0026d0 tx=0x7f206c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c009320 con 0x7f207c0f6860 2022-02-02T13:38:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c10ea20 con 0x7f207c0f6860 2022-02-02T13:38:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f206c00f040 con 0x7f207c0f6860 2022-02-02T13:38:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206c0147e0 con 0x7f207c0f6860 2022-02-02T13:38:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.562+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c10ef00 con 0x7f207c0f6860 2022-02-02T13:38:05.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.563+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c045ad0 con 0x7f207c0f6860 2022-02-02T13:38:05.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.564+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f206c009480 con 0x7f207c0f6860 2022-02-02T13:38:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.564+0000 7f2063fff700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 0x7f206405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:05.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.564+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f206c0765d0 con 0x7f207c0f6860 2022-02-02T13:38:05.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.564+0000 7f207b7fe700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 0x7f206405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:05.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.564+0000 7f207b7fe700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 0x7f206405e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2070004e30 tx=0x7f2070009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:05.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.568+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f206c0492b0 con 0x7f207c0f6860 2022-02-02T13:38:05.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:05 smithi033 conmon[31996]: cluster 2022-02-02T13:38:03.538963+0000 mgr.smithi033.xvkvzp (mgr.14164) 210 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2022-02-02T13:38:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.759+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c", "target": ["mon-mgr", ""]}) v1 -- 0x7f207c058070 con 0x7f206405c2b0 2022-02-02T13:38:05.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.764+0000 7f2063fff700 1 -- 172.21.15.33:0/215791805 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f207c058070 con 0x7f206405c2b0 2022-02-02T13:38:05.765 INFO:teuthology.orchestra.run.smithi033.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:38:05.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 msgr2=0x7f206405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:05.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 0x7f206405e770 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2070004e30 tx=0x7f2070009b30).stop 2022-02-02T13:38:05.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 msgr2=0x7f207c10e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f206c0026d0 tx=0x7f206c009de0).stop 2022-02-02T13:38:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 shutdown_connections 2022-02-02T13:38:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f206405c2b0 0x7f206405e770 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.766+0000 7f20820c1700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207c0f55c0 0x7f207c10c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.767+0000 7f20820c1700 1 --2- 172.21.15.33:0/215791805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0f6860 0x7f207c10e530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:05.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.767+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 >> 172.21.15.33:0/215791805 conn(0x7f207c0f0d40 msgr2=0x7f207c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:05.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.767+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 shutdown_connections 2022-02-02T13:38:05.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:05.767+0000 7f20820c1700 1 -- 172.21.15.33:0/215791805 wait complete. 2022-02-02T13:38:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:05 smithi037 conmon[35544]: cluster 2022-02-02T13:38:03.538963+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:05 smithi037 conmon[35544]: 14164) 210 : cluster [DBG] pgmap v171: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2022-02-02T13:38:06.212 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-02-02T13:38:06.212 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi033.front.sepia.ceph.com 2022-02-02T13:38:06.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7b277774-842c-11ec-8c35-001a4aab830c -e sha1=b0d76d45e4cb48de326cfbdc43296681162f672c -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; ceph fs dump; sleep 30 ; done' 2022-02-02T13:38:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: cluster 2022-02-02T13:38:05.539382+0000 mgr.smithi033.xvkvzp (mgr.14164) 211 2022-02-02T13:38:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: audit 2022-02-02T13:38:05.760695+0000 mgr.smithi033.xvkvzp (mgr.14164) 212 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:05.761340+0000 mgr.smithi033.xvkvzp (mgr.14164) 213 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:38:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: audit 2022-02-02T13:38:05.765164+0000 mon.smithi033 (mon.0) 548 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:07.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: audit 2022-02-02T13:38:05.765701+0000 mon.smithi033 (mon.0) 549 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:07.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: audit 2022-02-02T13:38:05.772610+0000 mon.smithi033 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:07.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:06 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:05.776438+0000 mgr.smithi033.xvkvzp (mgr.14164) 214 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:38:07.118 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: cluster 2022-02-02T13:38:05.539382+0000 mgr.smithi033.xvkvzp (mgr.14164) 211 : cluster [DBG] pgmap v172: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:07.118 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: audit 2022-02-02T13:38:05.760695+0000 mgr.smithi033.xvkvzp (mgr.14164) 212 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:07.118 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:05.761340+0000 mgr.smithi033.xvkvzp (mgr.14164) 213 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:38:07.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: audit 2022-02-02T13:38:05.765164+0000 mon.smithi033 (mon.0) 548 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:07.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: audit 2022-02-02T13:38:05.765701+0000 mon.smithi033 (mon.0) 549 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:07.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:38:07.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: :38:05.772610+0000 mon.smithi033 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:07.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:06 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:05.776438+0000 mgr.smithi033.xvkvzp (mgr.14164) 214 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:38:08.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- 172.21.15.33:0/1206233090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 msgr2=0x7fda900f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 --2- 172.21.15.33:0/1206233090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda900f6b30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fda80004660 tx=0x7fda80009b30).stop 2022-02-02T13:38:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- 172.21.15.33:0/1206233090 shutdown_connections 2022-02-02T13:38:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 --2- 172.21.15.33:0/1206233090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda900f6b30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 --2- 172.21.15.33:0/1206233090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda900f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- 172.21.15.33:0/1206233090 >> 172.21.15.33:0/1206233090 conn(0x7fda900f0b90 msgr2=0x7fda900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- 172.21.15.33:0/1206233090 shutdown_connections 2022-02-02T13:38:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- 172.21.15.33:0/1206233090 wait complete. 2022-02-02T13:38:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 Processor -- start 2022-02-02T13:38:08.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.253+0000 7fda96700700 1 -- start start 2022-02-02T13:38:08.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda96700700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda96700700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda9010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda96700700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda900603e0 con 0x7fda900f66d0 2022-02-02T13:38:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda96700700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90060520 con 0x7fda900f5430 2022-02-02T13:38:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39118/0 (socket says 172.21.15.33:39118) 2022-02-02T13:38:08.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 -- 172.21.15.33:0/2363412859 learned_addr learned my addr 172.21.15.33:0/2363412859 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda94efd700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda9010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 -- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 msgr2=0x7fda9010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda9010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.254+0000 7fda956fe700 1 -- 172.21.15.33:0/2363412859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80005040 con 0x7fda900f5430 2022-02-02T13:38:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda956fe700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fda8c00c530 tx=0x7fda8c007e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c00f650 con 0x7fda900f5430 2022-02-02T13:38:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9010c4d0 con 0x7fda900f5430 2022-02-02T13:38:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda8c00fc60 con 0x7fda900f5430 2022-02-02T13:38:08.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda8c012cb0 con 0x7fda900f5430 2022-02-02T13:38:08.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.255+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9010ca90 con 0x7fda900f5430 2022-02-02T13:38:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.256+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90045ad0 con 0x7fda900f5430 2022-02-02T13:38:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.256+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fda8c019030 con 0x7fda900f5430 2022-02-02T13:38:08.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.257+0000 7fda85ffb700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 0x7fda7c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.257+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fda8c075ac0 con 0x7fda900f5430 2022-02-02T13:38:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.257+0000 7fda94efd700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 0x7fda7c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.257+0000 7fda94efd700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 0x7fda7c05e7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fda80004630 tx=0x7fda80009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.261+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fda8c0462b0 con 0x7fda900f5430 2022-02-02T13:38:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.478+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda900fdda0 con 0x7fda7c05c300 2022-02-02T13:38:08.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.480+0000 7fda85ffb700 1 -- 172.21.15.33:0/2363412859 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fda80019040 con 0x7fda7c05c300 2022-02-02T13:38:08.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 msgr2=0x7fda7c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 0x7fda7c05e7c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fda80004630 tx=0x7fda80009b30).stop 2022-02-02T13:38:08.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 msgr2=0x7fda90109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fda8c00c530 tx=0x7fda8c007e10).stop 2022-02-02T13:38:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 shutdown_connections 2022-02-02T13:38:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fda7c05c300 0x7fda7c05e7c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda900f5430 0x7fda90109a20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 --2- 172.21.15.33:0/2363412859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda900f66d0 0x7fda9010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 >> 172.21.15.33:0/2363412859 conn(0x7fda900f0b90 msgr2=0x7fda900fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 shutdown_connections 2022-02-02T13:38:08.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.482+0000 7fda96700700 1 -- 172.21.15.33:0/2363412859 wait complete. 2022-02-02T13:38:08.492 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:38:08.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 -- 172.21.15.33:0/2114982633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f6700 msgr2=0x7f74080f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 --2- 172.21.15.33:0/2114982633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f6700 0x7f74080f6b60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f73fc004660 tx=0x7f73fc009b30).stop 2022-02-02T13:38:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 -- 172.21.15.33:0/2114982633 shutdown_connections 2022-02-02T13:38:08.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 --2- 172.21.15.33:0/2114982633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f6700 0x7f74080f6b60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 --2- 172.21.15.33:0/2114982633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f5460 0x7f74080f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 -- 172.21.15.33:0/2114982633 >> 172.21.15.33:0/2114982633 conn(0x7f74080f0bc0 msgr2=0x7f74080f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:08.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 -- 172.21.15.33:0/2114982633 shutdown_connections 2022-02-02T13:38:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.603+0000 7f740d56e700 1 -- 172.21.15.33:0/2114982633 wait complete. 2022-02-02T13:38:08.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 Processor -- start 2022-02-02T13:38:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 -- start start 2022-02-02T13:38:08.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f6700 0x7f7408106230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408106830 con 0x7f74080f5460 2022-02-02T13:38:08.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f740d56e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7408107040 con 0x7f74080f6700 2022-02-02T13:38:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.604+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56644/0 (socket says 172.21.15.33:56644) 2022-02-02T13:38:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 -- 172.21.15.33:0/2864000308 learned_addr learned my addr 172.21.15.33:0/2864000308 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f74067fc700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f6700 0x7f7408106230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 -- 172.21.15.33:0/2864000308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f6700 msgr2=0x7f7408106230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f6700 0x7f7408106230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 -- 172.21.15.33:0/2864000308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc005040 con 0x7f74080f5460 2022-02-02T13:38:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f7406ffd700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f73f800e9a0 tx=0x7f73f8007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f800c980 con 0x7f74080f5460 2022-02-02T13:38:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7408107260 con 0x7f74080f5460 2022-02-02T13:38:08.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74081077f0 con 0x7f74080f5460 2022-02-02T13:38:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f73f8011470 con 0x7f74080f5460 2022-02-02T13:38:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.605+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73f8010630 con 0x7f74080f5460 2022-02-02T13:38:08.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.607+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e8004fa0 con 0x7f74080f5460 2022-02-02T13:38:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.607+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f73f8021070 con 0x7f74080f5460 2022-02-02T13:38:08.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.607+0000 7f73ef7fe700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 0x7f73f005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.607+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f73f8078cd0 con 0x7f74080f5460 2022-02-02T13:38:08.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.607+0000 7f74067fc700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 0x7f73f005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.608+0000 7f74067fc700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 0x7f73f005e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f73fc004630 tx=0x7f73fc009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.612+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f73f804ba30 con 0x7f74080f5460 2022-02-02T13:38:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.853+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73e80029f0 con 0x7f73f005c300 2022-02-02T13:38:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.867+0000 7f73ef7fe700 1 -- 172.21.15.33:0/2864000308 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7f73e80029f0 con 0x7f73f005c300 2022-02-02T13:38:08.868 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T13:38:08.868 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 20s ago 4m 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:38:08.868 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 20s ago 4m 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:38:08.868 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (3m) 24s ago 3m 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:38:08.869 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 20s ago 4m 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:38:08.869 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (38s) 20s ago 38s 16.2.4 8d91d370c2b8 f8f3d0ec41ae 2022-02-02T13:38:08.869 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (34s) 20s ago 33s 16.2.4 8d91d370c2b8 acc3907c1697 2022-02-02T13:38:08.869 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (41s) 24s ago 41s 16.2.4 8d91d370c2b8 6bc814c0ef0a 2022-02-02T13:38:08.870 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (36s) 24s ago 36s 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:38:08.870 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:9283 running (5m) 20s ago 5m 16.2.4 8d91d370c2b8 6ca660d1efdc 2022-02-02T13:38:08.870 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (3m) 24s ago 3m 16.2.4 8d91d370c2b8 63353a09a0c3 2022-02-02T13:38:08.871 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 20s ago 5m 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:38:08.872 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (3m) 24s ago 3m 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:38:08.872 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (4m) 20s ago 4m 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:38:08.872 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (3m) 24s ago 3m 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:38:08.873 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 20s ago 3m 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:38:08.873 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:38:08.873 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 20s ago 2m 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:38:08.873 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:38:08.873 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:38:08.874 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (105s) 24s ago 105s 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:38:08.874 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 20s ago 4m 2.18.1 de242295e225 27dc47493263 2022-02-02T13:38:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 msgr2=0x7f73f005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 0x7f73f005e7c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f73fc004630 tx=0x7f73fc009b30).stop 2022-02-02T13:38:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 msgr2=0x7f7408105d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f73f800e9a0 tx=0x7f73f8007e80).stop 2022-02-02T13:38:08.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 shutdown_connections 2022-02-02T13:38:08.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f73f005c300 0x7f73f005e7c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74080f5460 0x7f7408105d40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 --2- 172.21.15.33:0/2864000308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74080f6700 0x7f7408106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 >> 172.21.15.33:0/2864000308 conn(0x7f74080f0bc0 msgr2=0x7f74080fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 shutdown_connections 2022-02-02T13:38:08.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.869+0000 7f740d56e700 1 -- 172.21.15.33:0/2864000308 wait complete. 2022-02-02T13:38:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 -- 172.21.15.33:0/1706708768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f7610 msgr2=0x7ff32c0fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 --2- 172.21.15.33:0/1706708768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f7610 0x7ff32c0fdfa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff320004660 tx=0x7ff320009b30).stop 2022-02-02T13:38:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 -- 172.21.15.33:0/1706708768 shutdown_connections 2022-02-02T13:38:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 --2- 172.21.15.33:0/1706708768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f7610 0x7ff32c0fdfa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 --2- 172.21.15.33:0/1706708768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 -- 172.21.15.33:0/1706708768 >> 172.21.15.33:0/1706708768 conn(0x7ff32c0f04c0 msgr2=0x7ff32c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.986+0000 7ff331e2c700 1 -- 172.21.15.33:0/1706708768 shutdown_connections 2022-02-02T13:38:08.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.987+0000 7ff331e2c700 1 -- 172.21.15.33:0/1706708768 wait complete. 2022-02-02T13:38:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.987+0000 7ff331e2c700 1 Processor -- start 2022-02-02T13:38:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.987+0000 7ff331e2c700 1 -- start start 2022-02-02T13:38:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff331e2c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff331e2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff331e2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0f8a20 con 0x7ff32c0f7610 2022-02-02T13:38:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff331e2c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c0f8b60 con 0x7ff32c0f6c70 2022-02-02T13:38:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56656/0 (socket says 172.21.15.33:56656) 2022-02-02T13:38:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 -- 172.21.15.33:0/2729263277 learned_addr learned my addr 172.21.15.33:0/2729263277 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32b7fe700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 -- 172.21.15.33:0/2729263277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 msgr2=0x7ff32c0f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 -- 172.21.15.33:0/2729263277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff320005040 con 0x7ff32c0f7610 2022-02-02T13:38:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32b7fe700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:38:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff32affd700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff320002040 tx=0x7ff32000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.988+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff320019070 con 0x7ff32c0f7610 2022-02-02T13:38:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.989+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff320007e40 con 0x7ff32c0f7610 2022-02-02T13:38:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.989+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c0f9470 con 0x7ff32c0f7610 2022-02-02T13:38:08.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.989+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c0f99d0 con 0x7ff32c0f7610 2022-02-02T13:38:08.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.989+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff320014cd0 con 0x7ff32c0f7610 2022-02-02T13:38:08.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.990+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c004fa0 con 0x7ff32c0f7610 2022-02-02T13:38:08.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.990+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7ff320025070 con 0x7ff32c0f7610 2022-02-02T13:38:08.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.991+0000 7ff313fff700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 0x7ff31405e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:08.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.991+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7ff320077090 con 0x7ff32c0f7610 2022-02-02T13:38:08.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.991+0000 7ff32b7fe700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 0x7ff31405e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:08.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.991+0000 7ff32b7fe700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 0x7ff31405e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff31c009da0 tx=0x7ff31c00b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:08.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:08.996+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7ff320049d10 con 0x7ff32c0f7610 2022-02-02T13:38:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:08 smithi033 conmon[31996]: cluster 2022-02-02T13:38:07.539772+0000 2022-02-02T13:38:09.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:08 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 215 : cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:09.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:08 smithi033 conmon[31996]: audit 2022-02-02T13:38:08.480468+0000 mgr.smithi033.xvkvzp (mgr.14164) 216 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:09.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.242+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff30c005e80 con 0x7ff32c0f7610 2022-02-02T13:38:09.244 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:38:09.244 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:38:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:38:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:38:09.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:38:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:38:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:38:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:09.246 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:38:09.247 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:38:09.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:09.247 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:38:09.247 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T13:38:09.248 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:38:09.248 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:38:09.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.242+0000 7ff313fff700 1 -- 172.21.15.33:0/2729263277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7ff320023070 con 0x7ff32c0f7610 2022-02-02T13:38:09.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 msgr2=0x7ff31405e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 0x7ff31405e770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7ff31c009da0 tx=0x7ff31c00b040).stop 2022-02-02T13:38:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 msgr2=0x7ff32c0f8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff320002040 tx=0x7ff32000b040).stop 2022-02-02T13:38:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 shutdown_connections 2022-02-02T13:38:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7ff31405c2b0 0x7ff31405e770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff32c0f6c70 0x7ff32c0f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 --2- 172.21.15.33:0/2729263277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff32c0f7610 0x7ff32c0f8420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.244+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 >> 172.21.15.33:0/2729263277 conn(0x7ff32c0f04c0 msgr2=0x7ff32c0f28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.245+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 shutdown_connections 2022-02-02T13:38:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.245+0000 7ff331e2c700 1 -- 172.21.15.33:0/2729263277 wait complete. 2022-02-02T13:38:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:08 smithi037 conmon[35544]: cluster 2022-02-02T13:38:07.539772+0000 mgr.smithi033.xvkvzp (mgr.14164) 215 : 2022-02-02T13:38:09.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:08 smithi037 conmon[35544]: cluster [DBG] pgmap v173: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:09.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:08 smithi037 conmon[35544]: audit 2022-02-02T13:38:08.480468+0000 mgr.smithi033.xvkvzp (mgr.14164) 216 : audit [DBG] from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 -- 172.21.15.33:0/534778344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 msgr2=0x7f95a00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 --2- 172.21.15.33:0/534778344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a00f5850 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f959c004660 tx=0x7f959c009b30).stop 2022-02-02T13:38:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 -- 172.21.15.33:0/534778344 shutdown_connections 2022-02-02T13:38:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 --2- 172.21.15.33:0/534778344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 --2- 172.21.15.33:0/534778344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a00f5850 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 -- 172.21.15.33:0/534778344 >> 172.21.15.33:0/534778344 conn(0x7f95a00f0b90 msgr2=0x7f95a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 -- 172.21.15.33:0/534778344 shutdown_connections 2022-02-02T13:38:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.352+0000 7f95a74b2700 1 -- 172.21.15.33:0/534778344 wait complete. 2022-02-02T13:38:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 Processor -- start 2022-02-02T13:38:09.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 -- start start 2022-02-02T13:38:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0106760 con 0x7f95a00f5430 2022-02-02T13:38:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a74b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0106f60 con 0x7f95a00f66d0 2022-02-02T13:38:09.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56662/0 (socket says 172.21.15.33:56662) 2022-02-02T13:38:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 -- 172.21.15.33:0/1260500930 learned_addr learned my addr 172.21.15.33:0/1260500930 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a5caf700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:09.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 -- 172.21.15.33:0/1260500930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 msgr2=0x7f95a01061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 -- 172.21.15.33:0/1260500930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c005040 con 0x7f95a00f5430 2022-02-02T13:38:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a5caf700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:38:09.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.353+0000 7f95a64b0700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f959c014040 tx=0x7f959c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.354+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c019070 con 0x7f95a00f5430 2022-02-02T13:38:09.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.354+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f959c007e70 con 0x7f95a00f5430 2022-02-02T13:38:09.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.354+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a01071e0 con 0x7f95a00f5430 2022-02-02T13:38:09.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.354+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c014d50 con 0x7f95a00f5430 2022-02-02T13:38:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.354+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a0107740 con 0x7f95a00f5430 2022-02-02T13:38:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.355+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0059100 con 0x7f95a00f5430 2022-02-02T13:38:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.355+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f959c025070 con 0x7f95a00f5430 2022-02-02T13:38:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.355+0000 7f9596ffd700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 0x7f958c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.356+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f959c076e30 con 0x7f95a00f5430 2022-02-02T13:38:09.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.356+0000 7f95a5caf700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 0x7f958c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:09.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.356+0000 7f95a5caf700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 0x7f958c05e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9590009da0 tx=0x7f959000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:09.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.360+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f959c049b90 con 0x7f95a00f5430 2022-02-02T13:38:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.583+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f95a00008d0 con 0x7f95a00f5430 2022-02-02T13:38:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.584+0000 7f9596ffd700 1 -- 172.21.15.33:0/1260500930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1667 (secure 0 0 0) 0x7f959c04d1b0 con 0x7f95a00f5430 2022-02-02T13:38:09.585 INFO:teuthology.orchestra.run.smithi033.stdout:e13 2022-02-02T13:38:09.585 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:38:09.585 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:38:09.586 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:38:09.586 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:09.586 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:38:09.586 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:38:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 11 2022-02-02T13:38:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:38:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:38:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:39.197747+0000 2022-02-02T13:38:09.587 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:38:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:38:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:38:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:38:09.588 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:38:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:38:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:38:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:38:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:38:09.589 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:38:09.590 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:38:09.590 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24277} 2022-02-02T13:38:09.590 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:38:09.590 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:38:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:38:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:38:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:38:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:38:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:38:09.592 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:38:09.592 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{0:24277} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435]] 2022-02-02T13:38:09.592 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:14456} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153]] 2022-02-02T13:38:09.592 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:09.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:09.593 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:38:09.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:09.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14468} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:38:09.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:38:09.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 msgr2=0x7f958c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 0x7f958c05e7c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9590009da0 tx=0x7f959000b040).stop 2022-02-02T13:38:09.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 msgr2=0x7f95a0105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:09.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f959c014040 tx=0x7f959c00b040).stop 2022-02-02T13:38:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 shutdown_connections 2022-02-02T13:38:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f958c05c300 0x7f958c05e7c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 --2- 172.21.15.33:0/1260500930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 >> 172.21.15.33:0/1260500930 conn(0x7f95a00f0b90 msgr2=0x7f95a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 shutdown_connections 2022-02-02T13:38:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:09.587+0000 7f95a74b2700 1 -- 172.21.15.33:0/1260500930 wait complete. 2022-02-02T13:38:09.597 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2022-02-02T13:38:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:09 smithi033 conmon[31996]: audit 2022-02-02T13:38:08.855690+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:09 smithi033 conmon[31996]: ) 217 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:09 smithi033 conmon[31996]: audit 2022-02-02T13:38:09.243297+0000 mon.smithi033 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.33:0/2729263277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:38:10.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:09 smithi033 conmon[31996]: audit 2022-02-02T13:38:09.584987+0000 mon.smithi033 2022-02-02T13:38:10.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:09 smithi033 conmon[31996]: (mon.0) 552 : audit [DBG] from='client.? 172.21.15.33:0/1260500930' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:38:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: audit 2022-02-02T13:38:08.855690+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: 217 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: audit 2022-02-02T13:38:09.243297+0000 mon.smithi033 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.33:0/2729263277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:38:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: 2022-02-02T13:38:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: audit 2022-02-02T13:38: 2022-02-02T13:38:10.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: 09.584987+0000 mon.smithi033 (mon.0) 552 : audit [DBG] 2022-02-02T13:38:10.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:09 smithi037 conmon[35544]: from='client.? 172.21.15.33:0/1260500930' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:38:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:10 smithi033 conmon[31996]: cluster 2022-02-02T13:38: 2022-02-02T13:38:11.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:10 smithi033 conmon[31996]: 09.540123+0000 mgr.smithi033.xvkvzp (mgr.14164) 218 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 3 op/s 2022-02-02T13:38:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:10 smithi037 conmon[35544]: cluster 2022-02-02T13:38:09.540123+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:10 smithi037 conmon[35544]: ) 218 : cluster [DBG] pgmap v174: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 3 op/s 2022-02-02T13:38:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:12 smithi033 conmon[31996]: cluster 2022-02-02T13:38:11.540556+0000 2022-02-02T13:38:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:12 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 219 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2022-02-02T13:38:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:12 smithi037 conmon[35544]: cluster 2022-02-02T13:38:11.540556+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:12 smithi037 conmon[35544]: 219 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 85 B/s wr, 1 op/s 2022-02-02T13:38:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:14 smithi033 conmon[31996]: cluster 2022-02-02T13:38:13.541074+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:14 smithi033 conmon[31996]: ) 220 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:14 smithi037 conmon[35544]: cluster 2022-02-02T13:38:13.541074+0000 2022-02-02T13:38:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:14 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 220 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:16 smithi033 conmon[31996]: cluster 2022-02-02T13:38:15. 2022-02-02T13:38:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:16 smithi033 conmon[31996]: 541486+0000 mgr.smithi033.xvkvzp (mgr.14164) 221 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:16 smithi037 conmon[35544]: cluster 2022-02-02T13:38:15 2022-02-02T13:38:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:16 smithi037 conmon[35544]: .541486+0000 mgr.smithi033.xvkvzp (mgr.14164) 221 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:18 smithi033 conmon[31996]: cluster 2022-02-02T13:38:17.541899+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:18 smithi033 conmon[31996]: 14164) 222 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:18 smithi037 conmon[35544]: cluster 2022-02-02T13:38:17.541899+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:18 smithi037 conmon[35544]: 14164) 222 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:20 smithi033 conmon[31996]: cluster 2022-02-02T13:38:19.542292+0000 mgr.smithi033.xvkvzp (mgr.14164) 223 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:20 smithi037 conmon[35544]: cluster 2022-02-02T13:38:19.542292+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:20 smithi037 conmon[35544]: ) 223 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:23.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:22 smithi033 conmon[31996]: cluster 2022-02-02T13:38:21.542715+0000 mgr.smithi033.xvkvzp (mgr.14164) 224 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:22 smithi037 conmon[35544]: cluster 2022-02-02T13:38:21.542715+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:38:23.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:22 smithi037 conmon[35544]: .14164) 224 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:24 smithi033 conmon[31996]: cluster 2022-02-02T13:38:23.543229+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:38:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:24 smithi033 conmon[31996]: mgr.14164) 225 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:24 smithi037 conmon[35544]: cluster 2022-02-02T13:38:23.543229+0000 mgr.smithi033.xvkvzp (mgr.14164) 225 2022-02-02T13:38:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:24 smithi037 conmon[35544]: : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:25 smithi033 conmon[31996]: audit 2022-02-02T13:38:24.926407 2022-02-02T13:38:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:25 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 553 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:38:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:25 smithi033 conmon[31996]: audit 2022-02-02T13:38:24.929242+0000 mon.smithi033 (mon.0) 2022-02-02T13:38:26.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:25 smithi033 conmon[31996]: 554 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:38:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:25 smithi037 conmon[35544]: audit 2022-02-02T13:38:24.926407+0000 mon.smithi033 (mon. 2022-02-02T13:38:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:25 smithi037 conmon[35544]: 0) 553 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:38:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:25 smithi037 conmon[35544]: audit 2022-02-02T13:38:24.929242+0000 mon.smithi033 (mon.0) 554 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:38:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:26 smithi033 conmon[31996]: cluster 2022-02-02T13:38:25.543656+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:38:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:26 smithi033 conmon[31996]: mgr.14164) 226 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:26 smithi037 conmon[35544]: cluster 2022-02-02T13:38:25.543656+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:26 smithi037 conmon[35544]: ) 226 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:28 smithi033 conmon[31996]: cluster 2022-02-02T13:38:27.544113+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:28 smithi033 conmon[31996]: ) 227 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:28 smithi037 conmon[35544]: cluster 2022-02-02T13:38:27.544113+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:38:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:28 smithi037 conmon[35544]: .14164) 227 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:30 smithi033 conmon[31996]: cluster 2022-02-02T13:38:29.544505+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:30 smithi033 conmon[31996]: 14164) 228 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:30 smithi037 conmon[35544]: cluster 2022-02-02T13:38:29.544505+0000 mgr.smithi033.xvkvzp (mgr.14164) 228 2022-02-02T13:38:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:30 smithi037 conmon[35544]: : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2022-02-02T13:38:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:32 smithi033 conmon[31996]: cluster 2022-02-02T13:38:31. 2022-02-02T13:38:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:32 smithi033 conmon[31996]: 545012+0000 mgr.smithi033.xvkvzp (mgr.14164) 229 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:32 smithi037 conmon[35544]: cluster 2022-02-02T13:38:31.545012+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:32 smithi037 conmon[35544]: 14164) 229 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 7.7 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2022-02-02T13:38:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:34 smithi033 conmon[31996]: cluster 2022-02-02T13:38:33.545529 2022-02-02T13:38:35.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:34 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 230 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2022-02-02T13:38:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:34 smithi037 conmon[35544]: cluster 2022-02-02T13:38:33.545529+0000 mgr.smithi033.xvkvzp (mgr.14164) 230 2022-02-02T13:38:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:34 smithi037 conmon[35544]: : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2022-02-02T13:38:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:36 smithi033 conmon[31996]: cluster 2022-02-02T13:38:35.546029+0000 mgr.smithi033.xvkvzp (mgr.14164) 231 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2022-02-02T13:38:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:36 smithi037 conmon[35544]: cluster 2022-02-02T13:38:35.546029+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:36 smithi037 conmon[35544]: 231 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2022-02-02T13:38:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:38 smithi033 conmon[31996]: cluster 2022-02-02T13:38:37.546556+0000 mgr.smithi033.xvkvzp 2022-02-02T13:38:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:38 smithi033 conmon[31996]: (mgr.14164) 232 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2022-02-02T13:38:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:38 smithi037 conmon[35544]: cluster 2022-02-02T13:38:37. 2022-02-02T13:38:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:38 smithi037 conmon[35544]: 546556+0000 mgr.smithi033.xvkvzp (mgr.14164) 232 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2022-02-02T13:38:39.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 -- 172.21.15.33:0/106380859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f5440 msgr2=0x7fd4480f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:39.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 --2- 172.21.15.33:0/106380859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f5440 0x7fd4480f5860 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fd438004660 tx=0x7fd438009b30).stop 2022-02-02T13:38:39.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 -- 172.21.15.33:0/106380859 shutdown_connections 2022-02-02T13:38:39.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 --2- 172.21.15.33:0/106380859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f66e0 0x7fd4480f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 --2- 172.21.15.33:0/106380859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f5440 0x7fd4480f5860 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 -- 172.21.15.33:0/106380859 >> 172.21.15.33:0/106380859 conn(0x7fd4480f0ba0 msgr2=0x7fd4480f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:39.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 -- 172.21.15.33:0/106380859 shutdown_connections 2022-02-02T13:38:39.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.696+0000 7fd44759e700 1 -- 172.21.15.33:0/106380859 wait complete. 2022-02-02T13:38:39.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 Processor -- start 2022-02-02T13:38:39.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 -- start start 2022-02-02T13:38:39.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f5440 0x7fd448068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:39.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:39.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd448069710 con 0x7fd4480f66e0 2022-02-02T13:38:39.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd44759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44810f7c0 con 0x7fd4480f5440 2022-02-02T13:38:39.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.697+0000 7fd445d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:39.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56674/0 (socket says 172.21.15.33:56674) 2022-02-02T13:38:39.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 -- 172.21.15.33:0/1565233744 learned_addr learned my addr 172.21.15.33:0/1565233744 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:39.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd44659c700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f5440 0x7fd448068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 -- 172.21.15.33:0/1565233744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f5440 msgr2=0x7fd448068c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f5440 0x7fd448068c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 -- 172.21.15.33:0/1565233744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd438005040 con 0x7fd4480f66e0 2022-02-02T13:38:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd445d9b700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd43c004fa0 tx=0x7fd43c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:39.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43c0094c0 con 0x7fd4480f66e0 2022-02-02T13:38:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44810fa40 con 0x7fd4480f66e0 2022-02-02T13:38:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd448110000 con 0x7fd4480f66e0 2022-02-02T13:38:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd43c00f040 con 0x7fd4480f66e0 2022-02-02T13:38:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.698+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd43c012b30 con 0x7fd4480f66e0 2022-02-02T13:38:39.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.700+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42c004fa0 con 0x7fd4480f66e0 2022-02-02T13:38:39.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.700+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fd43c022070 con 0x7fd4480f66e0 2022-02-02T13:38:39.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.701+0000 7fd436ffd700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 0x7fd43005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:39.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.701+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fd43c0780f0 con 0x7fd4480f66e0 2022-02-02T13:38:39.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.701+0000 7fd44659c700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 0x7fd43005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:39.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.701+0000 7fd44659c700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 0x7fd43005e7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd438005010 tx=0x7fd43800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:39.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.706+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fd43c04e800 con 0x7fd4480f66e0 2022-02-02T13:38:39.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.903+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd42c000bc0 con 0x7fd43005c300 2022-02-02T13:38:39.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.904+0000 7fd436ffd700 1 -- 172.21.15.33:0/1565233744 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+278 (secure 0 0 0) 0x7fd42c000bc0 con 0x7fd43005c300 2022-02-02T13:38:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 msgr2=0x7fd43005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 0x7fd43005e7c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd438005010 tx=0x7fd43800b040).stop 2022-02-02T13:38:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 msgr2=0x7fd448069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd43c004fa0 tx=0x7fd43c00b040).stop 2022-02-02T13:38:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 shutdown_connections 2022-02-02T13:38:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fd43005c300 0x7fd43005e7c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4480f5440 0x7fd448068c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 --2- 172.21.15.33:0/1565233744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4480f66e0 0x7fd448069160 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.906+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 >> 172.21.15.33:0/1565233744 conn(0x7fd4480f0ba0 msgr2=0x7fd4480fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.907+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 shutdown_connections 2022-02-02T13:38:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:39.907+0000 7fd44759e700 1 -- 172.21.15.33:0/1565233744 wait complete. 2022-02-02T13:38:39.921 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:38:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 -- 172.21.15.33:0/560986563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 msgr2=0x7f9c340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/560986563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 0x7f9c340f6cc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f9c28004660 tx=0x7f9c28009b30).stop 2022-02-02T13:38:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 -- 172.21.15.33:0/560986563 shutdown_connections 2022-02-02T13:38:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/560986563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 0x7f9c340f6cc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/560986563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 -- 172.21.15.33:0/560986563 >> 172.21.15.33:0/560986563 conn(0x7f9c340f0d40 msgr2=0x7f9c340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 -- 172.21.15.33:0/560986563 shutdown_connections 2022-02-02T13:38:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.025+0000 7f9c38c9e700 1 -- 172.21.15.33:0/560986563 wait complete. 2022-02-02T13:38:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 Processor -- start 2022-02-02T13:38:40.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 -- start start 2022-02-02T13:38:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 0x7f9c34106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34106920 con 0x7f9c340f6860 2022-02-02T13:38:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c38c9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34107130 con 0x7f9c340f55c0 2022-02-02T13:38:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39166/0 (socket says 172.21.15.33:39166) 2022-02-02T13:38:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 -- 172.21.15.33:0/1710591240 learned_addr learned my addr 172.21.15.33:0/1710591240 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 -- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 msgr2=0x7f9c34106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 0x7f9c34106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.026+0000 7f9c3259c700 1 -- 172.21.15.33:0/1710591240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28005040 con 0x7f9c340f55c0 2022-02-02T13:38:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c3259c700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9c240109d0 tx=0x7f9c2400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c240094c0 con 0x7f9c340f55c0 2022-02-02T13:38:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c24009620 con 0x7f9c340f55c0 2022-02-02T13:38:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c24007e20 con 0x7f9c340f55c0 2022-02-02T13:38:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c34107350 con 0x7f9c340f55c0 2022-02-02T13:38:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.027+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c34107890 con 0x7f9c340f55c0 2022-02-02T13:38:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.028+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34045ad0 con 0x7f9c340f55c0 2022-02-02T13:38:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.028+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f9c24018030 con 0x7f9c340f55c0 2022-02-02T13:38:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.029+0000 7f9c22ffd700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 0x7f9c1c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.029+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9c24078540 con 0x7f9c340f55c0 2022-02-02T13:38:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.029+0000 7f9c31d9b700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 0x7f9c1c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.030+0000 7f9c31d9b700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 0x7f9c1c05e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9c28004d80 tx=0x7f9c2800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.033+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9c2404b220 con 0x7f9c340f55c0 2022-02-02T13:38:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.224+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c340ff8a0 con 0x7f9c1c05c2b0 2022-02-02T13:38:40.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.241+0000 7f9c22ffd700 1 -- 172.21.15.33:0/1710591240 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2684 (secure 0 0 0) 0x7f9c340ff8a0 con 0x7f9c1c05c2b0 2022-02-02T13:38:40.242 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T13:38:40.242 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (3m) 51s ago 4m 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:38:40.243 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 51s ago 4m 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:38:40.243 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:38:40.243 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (3m) 51s ago 4m 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:38:40.243 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (70s) 51s ago 69s 16.2.4 8d91d370c2b8 f8f3d0ec41ae 2022-02-02T13:38:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (65s) 51s ago 65s 16.2.4 8d91d370c2b8 acc3907c1697 2022-02-02T13:38:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (72s) 55s ago 72s 16.2.4 8d91d370c2b8 6bc814c0ef0a 2022-02-02T13:38:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (67s) 55s ago 67s 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:38:40.244 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:9283 running (6m) 51s ago 6m 16.2.4 8d91d370c2b8 6ca660d1efdc 2022-02-02T13:38:40.245 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 63353a09a0c3 2022-02-02T13:38:40.245 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 51s ago 6m 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:38:40.245 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (4m) 55s ago 4m 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:38:40.245 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (4m) 51s ago 4m 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:38:40.245 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (4m) 55s ago 4m 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:38:40.246 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:38:40.246 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:38:40.246 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 51s ago 3m 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:38:40.246 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (2m) 55s ago 2m 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:38:40.247 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (2m) 55s ago 2m 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:38:40.247 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (2m) 55s ago 2m 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:38:40.247 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (3m) 51s ago 4m 2.18.1 de242295e225 27dc47493263 2022-02-02T13:38:40.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.243+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 msgr2=0x7f9c1c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.243+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 0x7f9c1c05e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f9c28004d80 tx=0x7f9c2800b040).stop 2022-02-02T13:38:40.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.243+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 msgr2=0x7f9c34105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9c240109d0 tx=0x7f9c2400b040).stop 2022-02-02T13:38:40.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 shutdown_connections 2022-02-02T13:38:40.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f9c1c05c2b0 0x7f9c1c05e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f55c0 0x7f9c34105e30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 --2- 172.21.15.33:0/1710591240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f6860 0x7f9c34106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 >> 172.21.15.33:0/1710591240 conn(0x7f9c340f0d40 msgr2=0x7f9c340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 shutdown_connections 2022-02-02T13:38:40.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.244+0000 7f9c38c9e700 1 -- 172.21.15.33:0/1710591240 wait complete. 2022-02-02T13:38:40.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 -- 172.21.15.33:0/158769858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f63b0 msgr2=0x7faca80f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 --2- 172.21.15.33:0/158769858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f63b0 0x7faca80f6810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fac98004660 tx=0x7fac98009b30).stop 2022-02-02T13:38:40.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 -- 172.21.15.33:0/158769858 shutdown_connections 2022-02-02T13:38:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 --2- 172.21.15.33:0/158769858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f63b0 0x7faca80f6810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 --2- 172.21.15.33:0/158769858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80f5a10 0x7faca80f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 -- 172.21.15.33:0/158769858 >> 172.21.15.33:0/158769858 conn(0x7faca80f0320 msgr2=0x7faca80f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.350+0000 7facaf2d8700 1 -- 172.21.15.33:0/158769858 shutdown_connections 2022-02-02T13:38:40.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.351+0000 7facaf2d8700 1 -- 172.21.15.33:0/158769858 wait complete. 2022-02-02T13:38:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.351+0000 7facaf2d8700 1 Processor -- start 2022-02-02T13:38:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.351+0000 7facaf2d8700 1 -- start start 2022-02-02T13:38:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facaf2d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facaf2d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80f63b0 0x7faca810beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facaf2d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80f5500 con 0x7faca80f5a10 2022-02-02T13:38:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facaf2d8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80f5640 con 0x7faca80f63b0 2022-02-02T13:38:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56692/0 (socket says 172.21.15.33:56692) 2022-02-02T13:38:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 -- 172.21.15.33:0/328342632 learned_addr learned my addr 172.21.15.33:0/328342632 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 -- 172.21.15.33:0/328342632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80f63b0 msgr2=0x7faca810beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80f63b0 0x7faca810beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 -- 172.21.15.33:0/328342632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98005040 con 0x7faca80f5a10 2022-02-02T13:38:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.352+0000 7facae2d6700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7faca400e7c0 tx=0x7faca400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.353+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca40092e0 con 0x7faca80f5a10 2022-02-02T13:38:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.353+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faca400f040 con 0x7faca80f5a10 2022-02-02T13:38:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.353+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca810c460 con 0x7faca80f5a10 2022-02-02T13:38:40.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.353+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca4014750 con 0x7faca80f5a10 2022-02-02T13:38:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.353+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca810ca20 con 0x7faca80f5a10 2022-02-02T13:38:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.354+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca8045ad0 con 0x7faca80f5a10 2022-02-02T13:38:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.355+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7faca401b030 con 0x7faca80f5a10 2022-02-02T13:38:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.355+0000 7fac9effd700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 0x7fac9405e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.355+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7faca4075e00 con 0x7faca80f5a10 2022-02-02T13:38:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.355+0000 7facadad5700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 0x7fac9405e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.356+0000 7facadad5700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 0x7fac9405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fac98004d80 tx=0x7fac9800b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.363+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7faca4048b90 con 0x7faca80f5a10 2022-02-02T13:38:40.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.591+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faca80fdcd0 con 0x7faca80f5a10 2022-02-02T13:38:40.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.591+0000 7fac9effd700 1 -- 172.21.15.33:0/328342632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7faca4019070 con 0x7faca80f5a10 2022-02-02T13:38:40.592 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:38:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:38:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:38:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:38:40.593 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:38:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:38:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:38:40.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:38:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:38:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:38:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:38:40.595 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T13:38:40.596 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:38:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:38:40.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.593+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 msgr2=0x7fac9405e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.593+0000 7facaf2d8700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 0x7fac9405e7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fac98004d80 tx=0x7fac9800b040).stop 2022-02-02T13:38:40.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.593+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 msgr2=0x7faca81099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.593+0000 7facaf2d8700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7faca400e7c0 tx=0x7faca400b040).stop 2022-02-02T13:38:40.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.593+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 shutdown_connections 2022-02-02T13:38:40.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fac9405c300 0x7fac9405e7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faca80f5a10 0x7faca81099b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 --2- 172.21.15.33:0/328342632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faca80f63b0 0x7faca810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 >> 172.21.15.33:0/328342632 conn(0x7faca80f0320 msgr2=0x7faca80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 shutdown_connections 2022-02-02T13:38:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.594+0000 7facaf2d8700 1 -- 172.21.15.33:0/328342632 wait complete. 2022-02-02T13:38:40.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 -- 172.21.15.33:0/1229761627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 msgr2=0x7fb61c0f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 --2- 172.21.15.33:0/1229761627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c0f7920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fb608004660 tx=0x7fb608009b30).stop 2022-02-02T13:38:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 -- 172.21.15.33:0/1229761627 shutdown_connections 2022-02-02T13:38:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 --2- 172.21.15.33:0/1229761627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c0f7920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 --2- 172.21.15.33:0/1229761627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb61c0f4800 0x7fb61c0f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.700+0000 7fb621f39700 1 -- 172.21.15.33:0/1229761627 >> 172.21.15.33:0/1229761627 conn(0x7fb61c0f0320 msgr2=0x7fb61c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.701+0000 7fb621f39700 1 -- 172.21.15.33:0/1229761627 shutdown_connections 2022-02-02T13:38:40.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.701+0000 7fb621f39700 1 -- 172.21.15.33:0/1229761627 wait complete. 2022-02-02T13:38:40.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.701+0000 7fb621f39700 1 Processor -- start 2022-02-02T13:38:40.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.701+0000 7fb621f39700 1 -- start start 2022-02-02T13:38:40.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.702+0000 7fb621f39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb61c0f4800 0x7fb61c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.702+0000 7fb621f39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.702+0000 7fb621f39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c107830 con 0x7fb61c0f51a0 2022-02-02T13:38:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.702+0000 7fb621f39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c108040 con 0x7fb61c0f4800 2022-02-02T13:38:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.703+0000 7fb61bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.703+0000 7fb61bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56704/0 (socket says 172.21.15.33:56704) 2022-02-02T13:38:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.703+0000 7fb61bfff700 1 -- 172.21.15.33:0/1844240373 learned_addr learned my addr 172.21.15.33:0/1844240373 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:38:40.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb61bfff700 1 -- 172.21.15.33:0/1844240373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb61c0f4800 msgr2=0x7fb61c106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb61bfff700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb61c0f4800 0x7fb61c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb61bfff700 1 -- 172.21.15.33:0/1844240373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb608005040 con 0x7fb61c0f51a0 2022-02-02T13:38:40.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb61bfff700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb608014040 tx=0x7fb60800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb608019070 con 0x7fb61c0f51a0 2022-02-02T13:38:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb608007e70 con 0x7fb61c0f51a0 2022-02-02T13:38:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c108260 con 0x7fb61c0f51a0 2022-02-02T13:38:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb608014d50 con 0x7fb61c0f51a0 2022-02-02T13:38:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.704+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1087c0 con 0x7fb61c0f51a0 2022-02-02T13:38:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.705+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c059100 con 0x7fb61c0f51a0 2022-02-02T13:38:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.706+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fb608025070 con 0x7fb61c0f51a0 2022-02-02T13:38:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.706+0000 7fb6197fa700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 0x7fb60c05e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:38:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.706+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fb608076e30 con 0x7fb61c0f51a0 2022-02-02T13:38:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.707+0000 7fb620f37700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 0x7fb60c05e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:38:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.707+0000 7fb620f37700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 0x7fb60c05e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb61c106ab0 tx=0x7fb61000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:38:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.714+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fb608049b90 con 0x7fb61c0f51a0 2022-02-02T13:38:40.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.921+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb61c0feea0 con 0x7fb61c0f51a0 2022-02-02T13:38:40.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.921+0000 7fb6197fa700 1 -- 172.21.15.33:0/1844240373 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1667 (secure 0 0 0) 0x7fb60804d1b0 con 0x7fb61c0f51a0 2022-02-02T13:38:40.922 INFO:teuthology.orchestra.run.smithi033.stdout:e13 2022-02-02T13:38:40.922 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:38:40.923 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:38:40.923 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:38:40.923 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:40.923 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:38:40.924 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:38:40.924 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 11 2022-02-02T13:38:40.924 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:38:40.924 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:38:40.924 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:39.197747+0000 2022-02-02T13:38:40.925 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:38:40.925 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:38:40.925 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:38:40.925 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:38:40.926 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:38:40.926 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:38:40.926 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:38:40.926 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:38:40.926 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:38:40.927 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:38:40.927 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:38:40.927 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24277} 2022-02-02T13:38:40.927 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:38:40.928 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:38:40.928 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:38:40.928 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:38:40.928 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:38:40.928 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:38:40.929 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:38:40.929 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:38:40.929 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{0:24277} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435]] 2022-02-02T13:38:40.929 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:14456} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153]] 2022-02-02T13:38:40.929 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:40.930 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:38:40.930 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:38:40.930 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14468} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:38:40.930 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:38:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.923+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 msgr2=0x7fb60c05e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.923+0000 7fb621f39700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 0x7fb60c05e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fb61c106ab0 tx=0x7fb61000b040).stop 2022-02-02T13:38:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.923+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 msgr2=0x7fb61c107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:38:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.923+0000 7fb621f39700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fb608014040 tx=0x7fb60800b040).stop 2022-02-02T13:38:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.924+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 shutdown_connections 2022-02-02T13:38:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.924+0000 7fb621f39700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fb60c05c300 0x7fb60c05e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.924+0000 7fb621f39700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb61c0f4800 0x7fb61c106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:38:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.924+0000 7fb621f39700 1 --2- 172.21.15.33:0/1844240373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c0f51a0 0x7fb61c107230 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:38:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.924+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 >> 172.21.15.33:0/1844240373 conn(0x7fb61c0f0320 msgr2=0x7fb61c0fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:38:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.925+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 shutdown_connections 2022-02-02T13:38:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:38:40.925+0000 7fb621f39700 1 -- 172.21.15.33:0/1844240373 wait complete. 2022-02-02T13:38:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2022-02-02T13:38:40.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: cluster 2022-02-02T13:38:39. 2022-02-02T13:38:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: 547029+0000 mgr.smithi033.xvkvzp (mgr.14164) 233 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2022-02-02T13:38:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: audit 2022-02-02T13:38:39.904940+0000 mgr.smithi033.xvkvzp (mgr.14164) 234 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: audit 2022-02-02T13:38:40.225918+0000 mgr.smithi033.xvkvzp (mgr.14164) 235 : audit [DBG] from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:40.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: 2022-02-02T13:38:40.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: audit 2022-02-02T13:38:40.592257+0000 2022-02-02T13:38:40.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:40 smithi033 conmon[31996]: mon.smithi033 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.33:0/328342632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:38:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: cluster 2022-02-02T13:38:39.547029+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: ) 233 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 3 op/s 2022-02-02T13:38:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: audit 2022-02-02T13:38:39.904940+0000 mgr.smithi033.xvkvzp (mgr.14164) 234 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: audit 2022-02-02T13:38:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: 2022-02-02T13:38:40.225918+0000 mgr.smithi033.xvkvzp (mgr.14164) 235 : audit [DBG] from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:38:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: audit 2022-02-02T13:38:40 2022-02-02T13:38:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: .592257+0000 mon.smithi033 (mon.0) 555 : audit [DBG] from='client.? 172.21.15.33:0/328342632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:38:41.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:40 smithi037 conmon[35544]: 2022-02-02T13:38:41.768 INFO:tasks.workunit.client.1.smithi037.stderr:Note: switching to 'b0d76d45e4cb48de326cfbdc43296681162f672c'. 2022-02-02T13:38:41.769 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.769 INFO:tasks.workunit.client.1.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-02-02T13:38:41.769 INFO:tasks.workunit.client.1.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2022-02-02T13:38:41.770 INFO:tasks.workunit.client.1.smithi037.stderr:state without impacting any branches by switching back to a branch. 2022-02-02T13:38:41.770 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.770 INFO:tasks.workunit.client.1.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2022-02-02T13:38:41.770 INFO:tasks.workunit.client.1.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2022-02-02T13:38:41.771 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.771 INFO:tasks.workunit.client.1.smithi037.stderr: git switch -c 2022-02-02T13:38:41.771 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.771 INFO:tasks.workunit.client.1.smithi037.stderr:Or undo this operation with: 2022-02-02T13:38:41.772 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.772 INFO:tasks.workunit.client.1.smithi037.stderr: git switch - 2022-02-02T13:38:41.772 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.772 INFO:tasks.workunit.client.1.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-02-02T13:38:41.773 INFO:tasks.workunit.client.1.smithi037.stderr: 2022-02-02T13:38:41.773 INFO:tasks.workunit.client.1.smithi037.stderr:HEAD is now at b0d76d45e4c Merge PR #44851 into wip-pdonnell-testing-20220202.034923 2022-02-02T13:38:41.774 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2022-02-02T13:38:41.838 INFO:tasks.workunit.client.1.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-02-02T13:38:41.840 INFO:tasks.workunit.client.1.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-02-02T13:38:41.841 INFO:tasks.workunit.client.1.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-02-02T13:38:42.179 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:41 smithi033 conmon[31996]: audit 2022-02-02T13:38:40. 2022-02-02T13:38:42.180 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:41 smithi033 conmon[31996]: 922313+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='client.? 172.21.15.33:0/1844240373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:38:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:41 smithi037 conmon[35544]: audit 2022-02-02T13:38:40.922313+0000 mon.smithi033 (mon.0) 556 : audit [DBG] from='client.? 172.21.15.33:0/1844240373' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:38:42.368 INFO:tasks.workunit.client.1.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-02-02T13:38:42.419 INFO:tasks.workunit.client.1.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-02-02T13:38:42.460 INFO:tasks.workunit.client.1.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2022-02-02T13:38:42.461 INFO:tasks.workunit.client.1.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-02-02T13:38:42.462 INFO:tasks.workunit.client.1.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-02-02T13:38:42.499 INFO:tasks.workunit.client.1.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2022-02-02T13:38:42.502 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-02-02T13:38:42.503 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2022-02-02T13:38:42.560 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2022-02-02T13:38:42.561 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2022-02-02T13:38:42.562 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0d76d45e4cb48de326cfbdc43296681162f672c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2022-02-02T13:38:42.623 INFO:tasks.workunit.client.1.smithi037.stderr:+ mkdir -p fsstress 2022-02-02T13:38:42.625 INFO:tasks.workunit.client.1.smithi037.stderr:+ pushd fsstress 2022-02-02T13:38:42.626 INFO:tasks.workunit.client.1.smithi037.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T13:38:42.626 INFO:tasks.workunit.client.1.smithi037.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2022-02-02T13:38:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: cluster 2022-02-02T13:38:41.547462 2022-02-02T13:38:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 236 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: audit 2022-02-02T13:38:42.220485+0000 mon.smithi033 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:42.221001+0000 mgr.smithi033.xvkvzp (mgr.14164) 237 : cephadm [INF] Upgrade: Target is version 17.0.0-10509-gb0d76d45 (unknown) 2022-02-02T13:38:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:42.221095+0000 mgr.smithi033.xvkvzp (mgr.14164) 238 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb'] 2022-02-02T13:38:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: audit 2022-02-02T13:38:42.222145+0000 mon.smithi033 (mon.0) 558 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:42.223467+0000 mgr.smithi033.xvkvzp (mgr.14164) 239 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:38:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: cluster 2022-02-02T13:38:41.547462+0000 mgr.smithi033.xvkvzp (mgr.14164) 236 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 11 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2022-02-02T13:38:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: audit 2022-02-02T13:38:42.220485+0000 mon.smithi033 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:38:43.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:42.221001+0000 mgr.smithi033.xvkvzp (mgr.14164) 237 : cephadm [INF] Upgrade: Target is version 17.0.0-10509-gb0d76d45 (unknown) 2022-02-02T13:38:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:42.221095+0000 mgr.smithi033.xvkvzp (mgr.14164) 238 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb'] 2022-02-02T13:38:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: audit 2022-02-02T13:38:42.222145+0000 mon.smithi033 (mon.0) 558 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:38:43.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:42.223467+0000 mgr.smithi033.xvkvzp (mgr.14164) 239 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:38:43.760 INFO:tasks.workunit.client.1.smithi037.stderr:+ tar xzf ltp-full.tgz 2022-02-02T13:38:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:44 smithi033 conmon[31996]: cephadm 2022-02-02T13:38:42.592301+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:44 smithi033 conmon[31996]: 240 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb on smithi037 2022-02-02T13:38:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:44 smithi037 conmon[35544]: cephadm 2022-02-02T13:38:42.592301 2022-02-02T13:38:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:44 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 240 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb on smithi037 2022-02-02T13:38:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:45 smithi033 conmon[31996]: cluster 2022-02-02T13:38:43.547881+0000 mgr.smithi033.xvkvzp (mgr.14164) 241 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 16 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2022-02-02T13:38:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:45 smithi037 conmon[35544]: cluster 2022-02-02T13:38:43. 2022-02-02T13:38:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:45 smithi037 conmon[35544]: 547881+0000 mgr.smithi033.xvkvzp (mgr.14164) 241 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 16 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2022-02-02T13:38:47.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:47 smithi037 conmon[35544]: cluster 2022-02-02T13:38:45.548387+0000 mgr.smithi033.xvkvzp 2022-02-02T13:38:47.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:47 smithi037 conmon[35544]: (mgr.14164) 242 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 16 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 767 B/s wr, 2 op/s 2022-02-02T13:38:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:47 smithi033 conmon[31996]: cluster 2022-02-02T13:38:45.548387+0000 mgr.smithi033.xvkvzp (mgr.14164) 242 : 2022-02-02T13:38:47.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:47 smithi033 conmon[31996]: cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 16 KiB data, 32 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 767 B/s wr, 2 op/s 2022-02-02T13:38:48.329 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to 'b0d76d45e4cb48de326cfbdc43296681162f672c'. 2022-02-02T13:38:48.330 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.330 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2022-02-02T13:38:48.330 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2022-02-02T13:38:48.331 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2022-02-02T13:38:48.331 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.331 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2022-02-02T13:38:48.331 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2022-02-02T13:38:48.332 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.332 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2022-02-02T13:38:48.332 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.333 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2022-02-02T13:38:48.333 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.333 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2022-02-02T13:38:48.333 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.334 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2022-02-02T13:38:48.334 INFO:tasks.workunit.client.0.smithi033.stderr: 2022-02-02T13:38:48.334 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at b0d76d45e4c Merge PR #44851 into wip-pdonnell-testing-20220202.034923 2022-02-02T13:38:48.337 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2022-02-02T13:38:48.372 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2022-02-02T13:38:48.375 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-02-02T13:38:48.375 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2022-02-02T13:38:48.939 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2022-02-02T13:38:48.997 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2022-02-02T13:38:49.037 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2022-02-02T13:38:49.038 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-02-02T13:38:49.039 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2022-02-02T13:38:49.076 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2022-02-02T13:38:49.080 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2022-02-02T13:38:49.080 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2022-02-02T13:38:49.137 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2022-02-02T13:38:49.138 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2022-02-02T13:38:49.139 DEBUG:teuthology.orchestra.run.smithi033:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b0d76d45e4cb48de326cfbdc43296681162f672c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2022-02-02T13:38:49.279 INFO:tasks.workunit.client.0.smithi033.stderr:+ mkdir -p fsstress 2022-02-02T13:38:49.317 INFO:tasks.workunit.client.0.smithi033.stderr:+ pushd fsstress 2022-02-02T13:38:49.318 INFO:tasks.workunit.client.0.smithi033.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2022-02-02T13:38:49.318 INFO:tasks.workunit.client.0.smithi033.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2022-02-02T13:38:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:49 smithi033 conmon[31996]: cluster 2022-02-02T13:38:47.548911+0000 2022-02-02T13:38:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:49 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 243 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 16 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 682 B/s wr, 2 op/s 2022-02-02T13:38:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:49 smithi037 conmon[35544]: cluster 2022-02-02T13:38:47.548911 2022-02-02T13:38:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:49 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 243 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 16 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 682 B/s wr, 2 op/s 2022-02-02T13:38:51.165 INFO:tasks.workunit.client.0.smithi033.stderr:+ tar xzf ltp-full.tgz 2022-02-02T13:38:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:51 smithi033 conmon[31996]: cluster 2022-02-02T13:38:49.549530+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:51.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:51 smithi033 conmon[31996]: 244 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 4.0 MiB data, 39 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 4 op/s 2022-02-02T13:38:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:51 smithi037 conmon[35544]: cluster 2022-02-02T13:38:49 2022-02-02T13:38:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:51 smithi037 conmon[35544]: .549530+0000 mgr.smithi033.xvkvzp (mgr.14164) 244 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 4.0 MiB data, 39 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 341 KiB/s wr, 4 op/s 2022-02-02T13:38:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:53 smithi033 conmon[31996]: cluster 2022-02-02T13:38: 2022-02-02T13:38:53.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:53 smithi033 conmon[31996]: 51.550225+0000 mgr.smithi033.xvkvzp (mgr.14164) 245 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 23 MiB data, 102 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 2.0 MiB/s wr, 106 op/s 2022-02-02T13:38:53.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:53 smithi037 conmon[35544]: cluster 2022-02-02T13:38:51. 2022-02-02T13:38:53.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:53 smithi037 conmon[35544]: 550225+0000 mgr.smithi033.xvkvzp (mgr.14164) 245 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 23 MiB data, 102 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 2.0 MiB/s wr, 106 op/s 2022-02-02T13:38:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:55 smithi037 conmon[35544]: cluster 2022-02-02T13:38:53.550657+0000 2022-02-02T13:38:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:55 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 246 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 32 MiB data, 145 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 207 op/s 2022-02-02T13:38:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:55 smithi033 conmon[31996]: cluster 2022-02-02T13:38:53.550657+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:38:55.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:55 smithi033 conmon[31996]: 246 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 32 MiB data, 145 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 207 op/s 2022-02-02T13:38:57.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:57 smithi037 conmon[35544]: cluster 2022-02-02T13:38:55.551209+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:38:57.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:57 smithi037 conmon[35544]: mgr.14164) 247 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 32 MiB data, 154 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 218 op/s 2022-02-02T13:38:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:57 smithi033 conmon[31996]: cluster 2022-02-02T13:38:55.551209+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:38:57.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:57 smithi033 conmon[31996]: ) 247 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 32 MiB data, 154 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 218 op/s 2022-02-02T13:38:59.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:59 smithi037 conmon[35544]: cluster 2022-02-02T13:38:57.551938+0000 mgr.smithi033.xvkvzp 2022-02-02T13:38:59.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:38:59 smithi037 conmon[35544]: (mgr.14164) 248 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 46 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 279 op/s 2022-02-02T13:38:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:59 smithi033 conmon[31996]: cluster 2022-02-02T13:38:57.551938+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:38:59.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:38:59 smithi033 conmon[31996]: 14164) 248 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 46 MiB data, 187 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.0 MiB/s wr, 279 op/s 2022-02-02T13:39:01.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:01 smithi037 conmon[35544]: cluster 2022-02-02T13:38:59.552500+0000 mgr.smithi033.xvkvzp 2022-02-02T13:39:01.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:01 smithi037 conmon[35544]: (mgr.14164) 249 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 53 MiB data, 206 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 297 op/s 2022-02-02T13:39:01.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:01 smithi033 conmon[31996]: cluster 2022-02-02T13:38:59.552500+0000 mgr.smithi033.xvkvzp (mgr.14164) 249 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 53 MiB data, 206 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 297 op/s 2022-02-02T13:39:03.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:03 smithi037 conmon[35544]: cluster 2022-02-02T13:39:01. 2022-02-02T13:39:03.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:03 smithi037 conmon[35544]: 553024+0000 mgr.smithi033.xvkvzp (mgr.14164) 250 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 54 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 306 op/s 2022-02-02T13:39:03.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:03 smithi033 conmon[31996]: cluster 2022-02-02T13:39:01.553024+0000 mgr.smithi033.xvkvzp (mgr.14164) 250 : cluster 2022-02-02T13:39:03.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:03 smithi033 conmon[31996]: [DBG] pgmap v200: 65 pgs: 65 active+clean; 54 MiB data, 235 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 306 op/s 2022-02-02T13:39:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:05 smithi037 conmon[35544]: cluster 2022-02-02T13:39:03.553539+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:39:05.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:05 smithi037 conmon[35544]: .14164) 251 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 64 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 211 op/s 2022-02-02T13:39:05.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:05 smithi033 conmon[31996]: cluster 2022-02-02T13:39:03.553539+0000 2022-02-02T13:39:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:05 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 251 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 64 MiB data, 251 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 211 op/s 2022-02-02T13:39:07.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:07 smithi037 conmon[35544]: cluster 2022-02-02T13:39:05.554199+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:39:07.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:07 smithi037 conmon[35544]: 252 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 64 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 110 op/s 2022-02-02T13:39:07.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:07 smithi033 conmon[31996]: cluster 2022-02-02T13:39:05.554199+0000 mgr.smithi033.xvkvzp (mgr.14164) 252 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 64 MiB data, 252 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 110 op/s 2022-02-02T13:39:09.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:09 smithi033 conmon[31996]: cluster 2022-02-02T13:39:07.554890+0000 2022-02-02T13:39:09.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:09 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 253 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 64 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 98 op/s 2022-02-02T13:39:09.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:09 smithi037 conmon[35544]: cluster 2022-02-02T13:39:07.554890+0000 mgr.smithi033.xvkvzp (mgr.14164) 253 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 64 MiB data, 268 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 98 op/s 2022-02-02T13:39:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 -- 172.21.15.33:0/1620443824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 msgr2=0x7f93580f5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 --2- 172.21.15.33:0/1620443824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580f5b90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f934c004660 tx=0x7f934c009b30).stop 2022-02-02T13:39:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 -- 172.21.15.33:0/1620443824 shutdown_connections 2022-02-02T13:39:11.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 --2- 172.21.15.33:0/1620443824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580f5b90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 --2- 172.21.15.33:0/1620443824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93580f6a10 0x7f93580f6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:39:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 -- 172.21.15.33:0/1620443824 >> 172.21.15.33:0/1620443824 conn(0x7f93580f0320 msgr2=0x7f93580f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 -- 172.21.15.33:0/1620443824 shutdown_connections 2022-02-02T13:39:11.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 -- 172.21.15.33:0/1620443824 wait complete. 2022-02-02T13:39:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.062+0000 7f935d31e700 1 Processor -- start 2022-02-02T13:39:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f935d31e700 1 -- start start 2022-02-02T13:39:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f935d31e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f935d31e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93580f6a10 0x7f9358067b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f935d31e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358102270 con 0x7f93580f5710 2022-02-02T13:39:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f935d31e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581023b0 con 0x7f93580f6a10 2022-02-02T13:39:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f9357fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f9357fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56730/0 (socket says 172.21.15.33:56730) 2022-02-02T13:39:11.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.063+0000 7f9357fff700 1 -- 172.21.15.33:0/2622638196 learned_addr learned my addr 172.21.15.33:0/2622638196 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9357fff700 1 -- 172.21.15.33:0/2622638196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93580f6a10 msgr2=0x7f9358067b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9357fff700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93580f6a10 0x7f9358067b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:39:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9357fff700 1 -- 172.21.15.33:0/2622638196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c005040 con 0x7f93580f5710 2022-02-02T13:39:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9357fff700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f93480093f0 tx=0x7f9348006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9348009ea0 con 0x7f93580f5710 2022-02-02T13:39:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.064+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9348013af0 con 0x7f93580f5710 2022-02-02T13:39:11.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.065+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9358068120 con 0x7f93580f5710 2022-02-02T13:39:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.065+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f934800db10 con 0x7f93580f5710 2022-02-02T13:39:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.065+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580686b0 con 0x7f93580f5710 2022-02-02T13:39:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.066+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9358059100 con 0x7f93580f5710 2022-02-02T13:39:11.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.066+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f934801a060 con 0x7f93580f5710 2022-02-02T13:39:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.067+0000 7f9354ff9700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 0x7f934005e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.067+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f9348075f10 con 0x7f93580f5710 2022-02-02T13:39:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.067+0000 7f93577fe700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 0x7f934005e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.067+0000 7f93577fe700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 0x7f934005e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f934c004e30 tx=0x7f934c009b30).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.072+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f9348048bf0 con 0x7f93580f5710 2022-02-02T13:39:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.311+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93580fa960 con 0x7f934005c300 2022-02-02T13:39:11.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.312+0000 7f9354ff9700 1 -- 172.21.15.33:0/2622638196 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+372 (secure 0 0 0) 0x7f93580fa960 con 0x7f934005c300 2022-02-02T13:39:11.313 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:11 smithi033 conmon[31996]: cluster 2022-02-02T13:39:09.555267+0000 mgr.smithi033.xvkvzp (mgr.14164) 2022-02-02T13:39:11.313 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:11 smithi033 conmon[31996]: 254 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 70 MiB data, 276 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 43 op/s 2022-02-02T13:39:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 msgr2=0x7f934005e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 0x7f934005e7c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f934c004e30 tx=0x7f934c009b30).stop 2022-02-02T13:39:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 msgr2=0x7f93580696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f93480093f0 tx=0x7f9348006ec0).stop 2022-02-02T13:39:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 shutdown_connections 2022-02-02T13:39:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f934005c300 0x7f934005e7c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93580f5710 0x7f93580696f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 --2- 172.21.15.33:0/2622638196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93580f6a10 0x7f9358067b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:39:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.314+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 >> 172.21.15.33:0/2622638196 conn(0x7f93580f0320 msgr2=0x7f93580f2080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.315+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 shutdown_connections 2022-02-02T13:39:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.315+0000 7f935d31e700 1 -- 172.21.15.33:0/2622638196 wait complete. 2022-02-02T13:39:11.325 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:39:11.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 -- 172.21.15.33:0/669069343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 msgr2=0x7f81b00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 --2- 172.21.15.33:0/669069343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f6b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f81a4004660 tx=0x7f81a4009b30).stop 2022-02-02T13:39:11.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 -- 172.21.15.33:0/669069343 shutdown_connections 2022-02-02T13:39:11.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 --2- 172.21.15.33:0/669069343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f6b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 --2- 172.21.15.33:0/669069343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 -- 172.21.15.33:0/669069343 >> 172.21.15.33:0/669069343 conn(0x7f81b00f0b90 msgr2=0x7f81b00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 -- 172.21.15.33:0/669069343 shutdown_connections 2022-02-02T13:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 -- 172.21.15.33:0/669069343 wait complete. 2022-02-02T13:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.416+0000 7f81b4d34700 1 Processor -- start 2022-02-02T13:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81b4d34700 1 -- start start 2022-02-02T13:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81b4d34700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81b4d34700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81b4d34700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00f7f70 con 0x7f81b00f66d0 2022-02-02T13:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81b4d34700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00f80b0 con 0x7f81b00f5430 2022-02-02T13:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39224/0 (socket says 172.21.15.33:39224) 2022-02-02T13:39:11.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81af7fe700 1 -- 172.21.15.33:0/3624708234 learned_addr learned my addr 172.21.15.33:0/3624708234 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:11.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81aeffd700 1 -- 172.21.15.33:0/3624708234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 msgr2=0x7f81b00f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81aeffd700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81aeffd700 1 -- 172.21.15.33:0/3624708234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4005040 con 0x7f81b00f66d0 2022-02-02T13:39:11.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.417+0000 7f81aeffd700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f7a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f81a4011000 tx=0x7f81a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.418+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a4019070 con 0x7f81b00f66d0 2022-02-02T13:39:11.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.418+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81a4007e70 con 0x7f81b00f66d0 2022-02-02T13:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.418+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b00f8330 con 0x7f81b00f66d0 2022-02-02T13:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.418+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81a4014c70 con 0x7f81b00f66d0 2022-02-02T13:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.418+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b00f8890 con 0x7f81b00f66d0 2022-02-02T13:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.419+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0045ad0 con 0x7f81b00f66d0 2022-02-02T13:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.419+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7f81a4025070 con 0x7f81b00f66d0 2022-02-02T13:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.419+0000 7f8197fff700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 0x7f819805e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.419+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7f81a4076e40 con 0x7f81b00f66d0 2022-02-02T13:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.420+0000 7f81af7fe700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 0x7f819805e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.420+0000 7f81af7fe700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 0x7f819805e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f81b00f9320 tx=0x7f81a000b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.423+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7f81a4049b20 con 0x7f81b00f66d0 2022-02-02T13:39:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:11 smithi037 conmon[35544]: cluster 2022-02-02T13:39:09.555267+0000 mgr.smithi033.xvkvzp 2022-02-02T13:39:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:11 smithi037 conmon[35544]: (mgr.14164) 254 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 70 MiB data, 276 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 43 op/s 2022-02-02T13:39:11.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.613+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 --> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f81b00fab10 con 0x7f819805c300 2022-02-02T13:39:11.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.626+0000 7f8197fff700 1 -- 172.21.15.33:0/3624708234 <== mgr.14164 v2:172.21.15.33:6800/2305865803 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2728 (secure 0 0 0) 0x7f81b00fab10 con 0x7f819805c300 2022-02-02T13:39:11.626 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-02-02T13:39:11.626 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (4m) 83s ago 5m 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:39:11.627 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 83s ago 5m 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:39:11.627 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (4m) 87s ago 4m 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:39:11.627 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 83s ago 5m 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:39:11.628 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (101s) 83s ago 101s 16.2.4 8d91d370c2b8 f8f3d0ec41ae 2022-02-02T13:39:11.628 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (96s) 83s ago 96s 16.2.4 8d91d370c2b8 acc3907c1697 2022-02-02T13:39:11.628 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (104s) 87s ago 103s 16.2.4 8d91d370c2b8 6bc814c0ef0a 2022-02-02T13:39:11.628 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (99s) 87s ago 98s 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:39:11.628 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:9283 running (6m) 83s ago 6m 16.2.4 8d91d370c2b8 6ca660d1efdc 2022-02-02T13:39:11.629 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (4m) 87s ago 4m 16.2.4 8d91d370c2b8 63353a09a0c3 2022-02-02T13:39:11.629 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 83s ago 6m 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:39:11.629 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (4m) 87s ago 4m 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:39:11.629 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 83s ago 5m 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:39:11.629 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (4m) 87s ago 4m 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:39:11.630 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 83s ago 4m 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:39:11.630 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 83s ago 3m 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:39:11.630 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 83s ago 3m 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:39:11.630 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (3m) 87s ago 3m 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:39:11.631 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (3m) 87s ago 3m 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:39:11.631 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (2m) 87s ago 2m 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:39:11.631 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 83s ago 5m 2.18.1 de242295e225 27dc47493263 2022-02-02T13:39:11.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 msgr2=0x7f819805e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 0x7f819805e7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f81b00f9320 tx=0x7f81a000b040).stop 2022-02-02T13:39:11.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 msgr2=0x7f81b00f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f7a10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f81a4011000 tx=0x7f81a400b040).stop 2022-02-02T13:39:11.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 shutdown_connections 2022-02-02T13:39:11.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7f819805c300 0x7f819805e7c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81b00f5430 0x7f81b00f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 --2- 172.21.15.33:0/3624708234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81b00f66d0 0x7f81b00f7a10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.627+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 >> 172.21.15.33:0/3624708234 conn(0x7f81b00f0b90 msgr2=0x7f81b005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.628+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 shutdown_connections 2022-02-02T13:39:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.628+0000 7f81b4d34700 1 -- 172.21.15.33:0/3624708234 wait complete. 2022-02-02T13:39:11.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 -- 172.21.15.33:0/897329175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 msgr2=0x7fc2900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 --2- 172.21.15.33:0/897329175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc2900f6b00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fc28c004660 tx=0x7fc28c009b30).stop 2022-02-02T13:39:11.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 -- 172.21.15.33:0/897329175 shutdown_connections 2022-02-02T13:39:11.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 --2- 172.21.15.33:0/897329175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 0x7fc2900f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 --2- 172.21.15.33:0/897329175 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc2900f6b00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 -- 172.21.15.33:0/897329175 >> 172.21.15.33:0/897329175 conn(0x7fc2900f1e40 msgr2=0x7fc2900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 -- 172.21.15.33:0/897329175 shutdown_connections 2022-02-02T13:39:11.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.727+0000 7fc298678700 1 -- 172.21.15.33:0/897329175 wait complete. 2022-02-02T13:39:11.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 Processor -- start 2022-02-02T13:39:11.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 -- start start 2022-02-02T13:39:11.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 0x7fc290107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc290107a00 con 0x7fc2900f66e0 2022-02-02T13:39:11.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc298678700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc290107b40 con 0x7fc2900f7980 2022-02-02T13:39:11.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56750/0 (socket says 172.21.15.33:56750) 2022-02-02T13:39:11.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 -- 172.21.15.33:0/3415423406 learned_addr learned my addr 172.21.15.33:0/3415423406 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:11.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc295c13700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 0x7fc290107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 -- 172.21.15.33:0/3415423406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 msgr2=0x7fc290107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 0x7fc290107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.728+0000 7fc296414700 1 -- 172.21.15.33:0/3415423406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c005040 con 0x7fc2900f66e0 2022-02-02T13:39:11.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc296414700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc28c014040 tx=0x7fc28c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc28c019070 con 0x7fc2900f66e0 2022-02-02T13:39:11.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc28c007e70 con 0x7fc2900f66e0 2022-02-02T13:39:11.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc28c014d10 con 0x7fc2900f66e0 2022-02-02T13:39:11.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc290108480 con 0x7fc2900f66e0 2022-02-02T13:39:11.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.729+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc290108990 con 0x7fc2900f66e0 2022-02-02T13:39:11.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.730+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc290045ad0 con 0x7fc2900f66e0 2022-02-02T13:39:11.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.730+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fc28c025070 con 0x7fc2900f66e0 2022-02-02T13:39:11.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.731+0000 7fc282ffd700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 0x7fc27c05e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:11.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.731+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fc28c076ee0 con 0x7fc2900f66e0 2022-02-02T13:39:11.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.731+0000 7fc295c13700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 0x7fc27c05e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:11.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.731+0000 7fc295c13700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 0x7fc27c05e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc284009fd0 tx=0x7fc28400b040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:11.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.735+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fc28c049bc0 con 0x7fc2900f66e0 2022-02-02T13:39:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.953+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc2900fefb0 con 0x7fc2900f66e0 2022-02-02T13:39:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.953+0000 7fc282ffd700 1 -- 172.21.15.33:0/3415423406 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+573 (secure 0 0 0) 0x7fc28c04d1e0 con 0x7fc2900f66e0 2022-02-02T13:39:11.954 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:39:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:39:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:39:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:11.955 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:39:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:39:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:39:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:39:11.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:39:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:39:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:11.957 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:39:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-02-02T13:39:11.958 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:39:11.958 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:39:11.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 msgr2=0x7fc27c05e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 0x7fc27c05e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fc284009fd0 tx=0x7fc28400b040).stop 2022-02-02T13:39:11.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 msgr2=0x7fc290106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fc28c014040 tx=0x7fc28c00b040).stop 2022-02-02T13:39:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 shutdown_connections 2022-02-02T13:39:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fc27c05c2b0 0x7fc27c05e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2900f66e0 0x7fc290106f60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 --2- 172.21.15.33:0/3415423406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2900f7980 0x7fc290107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:11.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 >> 172.21.15.33:0/3415423406 conn(0x7fc2900f1e40 msgr2=0x7fc2900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:11.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 shutdown_connections 2022-02-02T13:39:11.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:11.955+0000 7fc298678700 1 -- 172.21.15.33:0/3415423406 wait complete. 2022-02-02T13:39:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/1834330589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f6860 msgr2=0x7fbfd40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/1834330589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f6860 0x7fbfd40f6cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fbfbc004660 tx=0x7fbfbc009b30).stop 2022-02-02T13:39:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/1834330589 shutdown_connections 2022-02-02T13:39:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/1834330589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f6860 0x7fbfd40f6cc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/1834330589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f55c0 0x7fbfd40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/1834330589 >> 172.21.15.33:0/1834330589 conn(0x7fbfd40f0d40 msgr2=0x7fbfd40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:12.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/1834330589 shutdown_connections 2022-02-02T13:39:12.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/1834330589 wait complete. 2022-02-02T13:39:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.056+0000 7fbfd8e9e700 1 Processor -- start 2022-02-02T13:39:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd8e9e700 1 -- start start 2022-02-02T13:39:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd8e9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd8e9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f6860 0x7fbfd4106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd8e9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4106920 con 0x7fbfd40f55c0 2022-02-02T13:39:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd8e9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4107130 con 0x7fbfd40f6860 2022-02-02T13:39:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56758/0 (socket says 172.21.15.33:56758) 2022-02-02T13:39:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 -- 172.21.15.33:0/4173475304 learned_addr learned my addr 172.21.15.33:0/4173475304 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd1d9b700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f6860 0x7fbfd4106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 -- 172.21.15.33:0/4173475304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f6860 msgr2=0x7fbfd4106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f6860 0x7fbfd4106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 -- 172.21.15.33:0/4173475304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc005040 con 0x7fbfd40f55c0 2022-02-02T13:39:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.057+0000 7fbfd259c700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbfc400e7c0 tx=0x7fbfc400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.058+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc40092e0 con 0x7fbfd40f55c0 2022-02-02T13:39:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.058+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd41073b0 con 0x7fbfd40f55c0 2022-02-02T13:39:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.058+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbfc400f040 con 0x7fbfd40f55c0 2022-02-02T13:39:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.058+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfc40147e0 con 0x7fbfd40f55c0 2022-02-02T13:39:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.058+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd41078f0 con 0x7fbfd40f55c0 2022-02-02T13:39:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.059+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4045ad0 con 0x7fbfd40f55c0 2022-02-02T13:39:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.059+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 72193+0+0 (secure 0 0 0) 0x7fbfc401b030 con 0x7fbfd40f55c0 2022-02-02T13:39:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.059+0000 7fbfcaffd700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 0x7fbfc0060980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.060+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5349+0+0 (secure 0 0 0) 0x7fbfc4075e90 con 0x7fbfd40f55c0 2022-02-02T13:39:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.060+0000 7fbfd1d9b700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 0x7fbfc0060980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.060+0000 7fbfd1d9b700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 0x7fbfc0060980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbfbc005010 tx=0x7fbfbc016040).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.064+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+152212 (secure 0 0 0) 0x7fbfc4048b70 con 0x7fbfd40f55c0 2022-02-02T13:39:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.278+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbfd40ff790 con 0x7fbfd40f55c0 2022-02-02T13:39:12.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.278+0000 7fbfcaffd700 1 -- 172.21.15.33:0/4173475304 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1667 (secure 0 0 0) 0x7fbfc4019070 con 0x7fbfd40f55c0 2022-02-02T13:39:12.279 INFO:teuthology.orchestra.run.smithi033.stdout:e13 2022-02-02T13:39:12.280 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:39:12.280 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:39:12.280 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:39:12.280 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:12.281 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:39:12.281 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:39:12.281 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 11 2022-02-02T13:39:12.281 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:39:12.282 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:39:12.282 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:39.197747+0000 2022-02-02T13:39:12.282 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:39:12.282 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:39:12.282 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:39:12.283 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:39:12.283 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:39:12.283 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:39:12.283 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:39:12.284 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:39:12.284 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:39:12.284 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:39:12.284 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:39:12.284 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24277} 2022-02-02T13:39:12.285 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:39:12.285 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:39:12.285 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:39:12.285 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:39:12.286 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:39:12.286 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:39:12.286 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:39:12.286 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:39:12.286 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{0:24277} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435]] 2022-02-02T13:39:12.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:14456} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153]] 2022-02-02T13:39:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:12.287 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:12.287 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:39:12.288 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:12.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14468} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:39:12.288 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:39:12.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 msgr2=0x7fbfc0060980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:12.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 0x7fbfc0060980 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fbfbc005010 tx=0x7fbfbc016040).stop 2022-02-02T13:39:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 msgr2=0x7fbfd4105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7fbfc400e7c0 tx=0x7fbfc400b040).stop 2022-02-02T13:39:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 shutdown_connections 2022-02-02T13:39:12.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:6800/2305865803,v1:172.21.15.33:6801/2305865803] conn(0x7fbfc005e4c0 0x7fbfc0060980 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbfd40f55c0 0x7fbfd4105e30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 --2- 172.21.15.33:0/4173475304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfd40f6860 0x7fbfd4106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 >> 172.21.15.33:0/4173475304 conn(0x7fbfd40f0d40 msgr2=0x7fbfd40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:12.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 shutdown_connections 2022-02-02T13:39:12.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:12.280+0000 7fbfd8e9e700 1 -- 172.21.15.33:0/4173475304 wait complete. 2022-02-02T13:39:12.292 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2022-02-02T13:39:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: audit 2022-02-02T13:39:11.313144 2022-02-02T13:39:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 255 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: audit 2022-02-02T13:39:11. 2022-02-02T13:39:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: 954433+0000 mon.smithi033 (mon.0) 559 : audit [DBG] from='client.? 172.21.15.33:0/3415423406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:39:12.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:39:12.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: :39:12.279404+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:12.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:12 smithi033 conmon[31996]: 560 : audit [DBG] from='client.? 172.21.15.33:0/4173475304' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:39:12.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: audit 2022-02-02T13:39:11.313144+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:39:12.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: mgr.14164) 255 : audit [DBG] from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: audit 2022-02-02T13:39:11.954433+0000 mon.smithi033 (mon.0) 559 : audit 2022-02-02T13:39:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: [DBG] from='client.? 172.21.15.33:0/3415423406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:39:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:39:12.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: 02-02T13:39: 2022-02-02T13:39:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: 12.279404+0000 mon.smithi033 (mon. 2022-02-02T13:39:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: 0) 560 : audit [DBG] from='client.? 172.21.15.33:0/4173475304' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:39:12.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:12 smithi037 conmon[35544]: 2022-02-02T13:39:13.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:13 smithi033 conmon[31996]: cluster 2022-02-02T13:39:11.555771+0000 mgr.smithi033.xvkvzp (mgr.14164) 256 : cluster [DBG] 2022-02-02T13:39:13.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:13 smithi033 conmon[31996]: pgmap v205: 65 pgs: 65 active+clean; 91 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 374 op/s 2022-02-02T13:39:13.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:13 smithi033 conmon[31996]: audit 2022-02-02T13:39:11.615335+0000 mgr.smithi033.xvkvzp (mgr.14164) 257 : audit [DBG] from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:13 smithi037 conmon[35544]: cluster 2022-02-02T13:39:11. 2022-02-02T13:39:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:13 smithi037 conmon[35544]: 555771+0000 mgr.smithi033.xvkvzp (mgr.14164) 256 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 91 MiB data, 364 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.4 MiB/s wr, 374 op/s 2022-02-02T13:39:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:13 smithi037 conmon[35544]: audit 2022-02-02T13:39:11.615335+0000 mgr.smithi033.xvkvzp (mgr.14164) 257 : audit [DBG] from='client.14566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:13.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:13 smithi037 conmon[35544]: 2022-02-02T13:39:15.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:15 smithi033 conmon[31996]: cluster 2022-02-02T13:39:13.556437+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:39:15.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:15 smithi033 conmon[31996]: ) 258 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 120 MiB data, 515 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 808 op/s 2022-02-02T13:39:15.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:15 smithi037 conmon[35544]: cluster 2022-02-02T13:39:13.556437+0000 mgr.smithi033.xvkvzp 2022-02-02T13:39:15.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:15 smithi037 conmon[35544]: (mgr.14164) 258 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 120 MiB data, 515 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 808 op/s 2022-02-02T13:39:17.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:17 smithi033 conmon[31996]: cluster 2022-02-02T13:39:15.556887+0000 mgr.smithi033.xvkvzp (mgr.14164) 259 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 124 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 5.5 MiB/s wr, 886 op/s 2022-02-02T13:39:17.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:17 smithi037 conmon[35544]: cluster 2022-02-02T13:39:15.556887+0000 mgr.smithi033.xvkvzp 2022-02-02T13:39:17.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:17 smithi037 conmon[35544]: (mgr.14164) 259 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 124 MiB data, 580 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 5.5 MiB/s wr, 886 op/s 2022-02-02T13:39:19.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:19 smithi033 conmon[31996]: cluster 2022-02-02T13:39:17.557374+0000 mgr.smithi033.xvkvzp (mgr.14164) 260 : cluster [DBG] 2022-02-02T13:39:19.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:19 smithi033 conmon[31996]: pgmap v208: 65 pgs: 65 active+clean; 128 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.9 MiB/s wr, 887 op/s 2022-02-02T13:39:19.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:19 smithi037 conmon[35544]: cluster 2022-02-02T13:39:17.557374+0000 2022-02-02T13:39:19.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:19 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 260 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 128 MiB data, 603 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 5.9 MiB/s wr, 887 op/s 2022-02-02T13:39:21.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:21 smithi033 conmon[31996]: cluster 2022-02-02T13:39:19.557788+0000 mgr.smithi033.xvkvzp (mgr.14164) 261 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 132 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 892 op/s 2022-02-02T13:39:21.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:21 smithi033 conmon[31996]: 2022-02-02T13:39:21.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:21 smithi037 conmon[35544]: cluster 2022-02-02T13:39:19.557788+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:39:21.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:21 smithi037 conmon[35544]: .14164) 261 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 132 MiB data, 608 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 892 op/s 2022-02-02T13:39:23.599 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: cluster 2022-02-02T13:39: 2022-02-02T13:39:23.599 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: 21.558315+0000 mgr.smithi033.xvkvzp (mgr.14164) 262 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 136 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 6.0 MiB/s wr, 894 op/s 2022-02-02T13:39:23.599 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: audit 2022-02-02T13:39:23.018811+0000 mon.smithi033 (mon.0) 561 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:23.600 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: audit 2022-02-02T13:39:23.019764+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:39:23.600 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: audit 2022-02-02T13:39:23.020534+0000 mon.smithi033 (mon.0) 563 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:39:23.600 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:23 smithi037 conmon[35544]: audit 2022-02-02T13:39:23.021229+0000 mon.smithi033 (mon.0) 564 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:39:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: cluster 2022-02-02T13:39:21.558315+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:39:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: .14164) 262 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 136 MiB data, 627 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 6.0 MiB/s wr, 894 op/s 2022-02-02T13:39:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: audit 2022-02-02T13:39:23.018811+0000 mon.smithi033 (mon.0) 561 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: 2022-02-02T13:39:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:39:23.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: 13:39:23.019764+0000 mon.smithi033 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:39:23.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:39:23.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: T13:39:23.020534+0000 mon.smithi033 (mon.0) 563 : audit 2022-02-02T13:39:23.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:39:23.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: audit 2022-02-02T13:39:23.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: 2022-02-02T13:39:23.021229+0000 mon.smithi033 (mon.0) 564 : audit 2022-02-02T13:39:23.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:23 smithi033 conmon[31996]: [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:39:24.433 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:24 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:23.014743+0000 mgr.smithi033.xvkvzp (mgr.14164) 263 : cephadm [INF] Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:39:24.433 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:24 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:23.021804+0000 mgr.smithi033.xvkvzp (mgr.14164) 264 : cephadm [INF] Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:39:24.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:24 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:23.014743+0000 mgr.smithi033.xvkvzp (mgr.14164) 263 : cephadm [INF] Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:39:24.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:24 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:23.021804+0000 mgr.smithi033.xvkvzp (mgr.14164) 264 : cephadm [INF] Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:39:25.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: cluster 2022-02-02T13:39:23. 2022-02-02T13:39:25.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: 558773+0000 mgr.smithi033.xvkvzp (mgr.14164) 265 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 144 MiB data, 648 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 549 op/s 2022-02-02T13:39:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: audit 2022-02-02T13:39:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: 2022-02-02T13:39:24.928244+0000 2022-02-02T13:39:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: mon.smithi033 (mon.0) 565 : audit 2022-02-02T13:39:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:25.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: audit 2022 2022-02-02T13:39:25.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: -02-02T13:39: 2022-02-02T13:39:25.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: 24.930765+0000 mon.smithi033 (mon 2022-02-02T13:39:25.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: .0) 566 : audit [INF] 2022-02-02T13:39:25.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:25 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:25.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:25 smithi033 conmon[31996]: cluster 2022-02-02T13:39:23.558773+0000 mgr.smithi033.xvkvzp (mgr.14164) 265 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 144 MiB data, 648 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.7 MiB/s wr, 549 op/s 2022-02-02T13:39:25.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:25 smithi033 conmon[31996]: audit 2022-02-02T13:39:24.928244+0000 mon.smithi033 (mon.0) 565 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:25.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:25 smithi033 conmon[31996]: audit 2022-02-02T13:39:24 2022-02-02T13:39:25.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:25 smithi033 conmon[31996]: .930765+0000 mon.smithi033 (mon.0) 566 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:26.985 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: cluster 2022-02-02T13:39:25.559273+0000 2022-02-02T13:39:26.985 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14164) 266 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 148 MiB data, 653 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 112 op/s 2022-02-02T13:39:26.985 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: audit 2022-02-02T13:39:25 2022-02-02T13:39:26.985 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: .720179+0000 mon.smithi033 (mon.0) 567 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:26.986 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: audit 2022-02-02T13:39:26.986 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: 2022- 2022-02-02T13:39:26.986 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: 02-02T13:39:25.720942+0000 2022-02-02T13:39:26.987 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: mon.smithi033 (mon.0) 568 : audit [DBG] 2022-02-02T13:39:26.987 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:26 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:26 smithi033 conmon[31996]: cluster 2022-02-02T13:39:25.559273+0000 2022-02-02T13:39:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:26 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14164) 266 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 148 MiB data, 653 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 112 op/s 2022-02-02T13:39:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:26 smithi033 conmon[31996]: audit 2022-02-02T13:39:25.720179+0000 mon.smithi033 (mon.0) 567 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:26 smithi033 conmon[31996]: audit 2022-02-02T13:39:25.720942+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:26 smithi033 conmon[31996]: 568 : audit [DBG] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:28 smithi033 conmon[31996]: cluster 2022-02-02T13:39:27.559822+0000 mgr.smithi033.xvkvzp (mgr.14164) 267 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 152 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 27 op/s 2022-02-02T13:39:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:28 smithi037 conmon[35544]: cluster 2022-02-02T13:39:27.559822+0000 mgr.smithi033.xvkvzp (mgr.14164) 267 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 152 MiB data, 663 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 27 op/s 2022-02-02T13:39:31.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: cluster 2022-02-02T13:39:29.560408+0000 mgr.smithi033.xvkvzp (mgr.14164) 268 2022-02-02T13:39:31.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2022-02-02T13:39:31.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: audit 2022-02-02T13:39:30.029729+0000 mon.smithi033 (mon.0) 569 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:31.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: audit 2022-02-02T13:39:30.448950+0000 mon.smithi033 (mon.0) 570 : audit 2022-02-02T13:39:31.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:31.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: audit 2022-02-02T13:39:30.453942+0000 mon.smithi033 (mon.0) 571 : audit [DBG] 2022-02-02T13:39:31.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:31.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:30. 2022-02-02T13:39:31.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: 455034+0000 mgr.smithi033.xvkvzp (mgr.14164) 269 : cephadm [INF] 2022-02-02T13:39:31.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:39:31.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:31.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: 2022-02-02T13:39:30.457702+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:39:31.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: .14164) 270 : cephadm [INF] Failing over to other MGR 2022-02-02T13:39:31.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:39:31.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: T13:39:30.457963+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:31.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: 572 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr fail", "who": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:39:31.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: cluster 2022-02-02T 2022-02-02T13:39:31.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: 13:39:30.462180+0000 mon.smithi033 (mon.0 2022-02-02T13:39:31.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:31 smithi037 conmon[35544]: ) 573 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2022-02-02T13:39:31.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: cluster 2022-02-02T13:39:29.560408+0000 mgr.smithi033.xvkvzp (mgr.14164) 268 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 152 MiB data, 668 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 26 op/s 2022-02-02T13:39:31.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: audit 2022-02-02T13:39:30.029729+0000 mon.smithi033 (mon.0) 569 : audit [INF] 2022-02-02T13:39:31.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:31.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:39:31.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: T13:39:30.448950+0000 2022-02-02T13:39:31.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: mon.smithi033 (mon.0) 570 : audit [INF] 2022-02-02T13:39:31.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:39:31.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:39:31.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: T13:39:30.453942 2022-02-02T13:39:31.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 571 : audit [DBG] 2022-02-02T13:39:31.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:31.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: cephadm 2022-02- 2022-02-02T13:39:31.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 02T13:39:30.455034 2022-02-02T13:39:31.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14164) 269 : cephadm 2022-02-02T13:39:31.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: [INF] Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:39:31.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: cephadm 2022- 2022-02-02T13:39:31.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 02-02T13:39:30. 2022-02-02T13:39:31.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 457702+0000 mgr.smithi033.xvkvzp (mgr.14164 2022-02-02T13:39:31.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: ) 270 : cephadm [INF] Failing over to other MGR 2022-02-02T13:39:31.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:39:31.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 02T13:39:30.457963+0000 mon.smithi033 2022-02-02T13:39:31.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: (mon.0) 572 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr fail", "who": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:39:31.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 2022-02-02T13:39:31.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:39:31.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: 02T13:39:30.462180 2022-02-02T13:39:31.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 573 : cluster 2022-02-02T13:39:31.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:31 smithi033 conmon[31996]: [DBG] osdmap e43: 6 total, 6 up, 6 in 2022-02-02T13:39:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: cluster 2022-02-02T13:39:31.112656+0000 2022-02-02T13:39:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: mon.smithi033 (mon.0) 574 : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:39:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: audit 2022-02-02T13:39:31.462297+0000 mon.smithi033 (mon 2022-02-02T13:39:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: .0) 575 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "mgr fail", "who": "smithi033.xvkvzp"}]': finished 2022-02-02T13:39:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: cluster 2022-02-02T13:39:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: 2022-02-02T13:39:31.462370+0000 mon.smithi033 (mon.0 2022-02-02T13:39:32.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:32 smithi037 conmon[35544]: ) 576 : cluster [DBG] mgrmap e19: smithi037.npteou(active, starting, since 1.00377s), standbys: smithi033.xvkvzp 2022-02-02T13:39:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:32 smithi033 conmon[31996]: cluster 2022-02-02T13:39:31.112656+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:32 smithi033 conmon[31996]: 574 : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:39:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:32 smithi033 conmon[31996]: audit 2022-02-02T13:39:31.462297+0000 mon.smithi033 (mon.0) 575 : audit [INF] from='mgr.14164 172.21.15.33:0/2620458640' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "mgr fail", "who": "smithi033.xvkvzp"}]': finished 2022-02-02T13:39:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:32 smithi033 conmon[31996]: cluster 2022-02-02T13:39:31.462370+0000 mon.smithi033 (mon.0) 576 : cluster [DBG] mgrmap e19: smithi037.npteou(active, starting, since 1.00377s), standbys: smithi033.xvkvzp 2022-02-02T13:39:33.650 INFO:tasks.workunit.client.1.smithi037.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2022-02-02T13:39:33.670 INFO:tasks.workunit.client.1.smithi037.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T13:39:33.670 INFO:tasks.workunit.client.1.smithi037.stderr:+ make 2022-02-02T13:39:34.002 INFO:tasks.workunit.client.1.smithi037.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2022-02-02T13:39:34.273 INFO:tasks.workunit.client.1.smithi037.stderr:++ readlink -f fsstress 2022-02-02T13:39:34.274 INFO:tasks.workunit.client.1.smithi037.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2022-02-02T13:39:34.275 INFO:tasks.workunit.client.1.smithi037.stderr:+ popd 2022-02-02T13:39:34.276 INFO:tasks.workunit.client.1.smithi037.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2022-02-02T13:39:34.277 INFO:tasks.workunit.client.1.smithi037.stderr:+ popd 2022-02-02T13:39:34.277 INFO:tasks.workunit.client.1.smithi037.stdout:~/cephtest/mnt.1/client.1/tmp 2022-02-02T13:39:34.278 INFO:tasks.workunit.client.1.smithi037.stderr:++ mktemp -d -p . 2022-02-02T13:39:34.287 INFO:tasks.workunit.client.1.smithi037.stderr:+ T=./tmp.ik8ZYpsLwT 2022-02-02T13:39:34.288 INFO:tasks.workunit.client.1.smithi037.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ik8ZYpsLwT -l 1 -n 1000 -p 10 -v 2022-02-02T13:39:34.300 INFO:tasks.workunit.client.1.smithi037.stdout:seed = 1644043816 2022-02-02T13:39:34.426 INFO:tasks.workunit.client.1.smithi037.stdout:1/0: fdatasync - no filename 2022-02-02T13:39:34.426 INFO:tasks.workunit.client.1.smithi037.stdout:1/1: fsync - no filename 2022-02-02T13:39:34.426 INFO:tasks.workunit.client.1.smithi037.stdout:1/2: dread - no filename 2022-02-02T13:39:34.427 INFO:tasks.workunit.client.1.smithi037.stdout:1/3: dread - no filename 2022-02-02T13:39:34.428 INFO:tasks.workunit.client.1.smithi037.stdout:2/0: dwrite - no filename 2022-02-02T13:39:34.491 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: cluster 2022-02-02T13:39:34.379745+0000 mon.smithi033 (mon. 2022-02-02T13:39:34.492 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 0) 577 : cluster [INF] Active manager daemon smithi037.npteou restarted 2022-02-02T13:39:34.492 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: cluster 2022-02-02T13:39:34.380431+0000 mon.smithi033 (mon.0) 578 : cluster [INF] Activating manager daemon smithi037.npteou 2022-02-02T13:39:34.492 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: cluster 2022-02-02T 2022-02-02T13:39:34.492 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 13:39:34.391582+0000 mon.smithi033 (mon.0) 579 2022-02-02T13:39:34.493 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2022-02-02T13:39:34.493 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.493 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 2022-02-02T13:39:34.391851 2022-02-02T13:39:34.493 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: +0000 mon.smithi037 (mon.1) 16 : audit [DBG] 2022-02-02T13:39:34.494 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:39:34.494 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:39:34.494 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 13:39:34.401692+0000 mon.smithi037 ( 2022-02-02T13:39:34.494 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: mon.1) 17 : audit [DBG] from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:39:34.495 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:39:34.495 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: T13:39:34.403764+0000 mon.smithi037 (mon. 2022-02-02T13:39:34.495 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 1) 18 : audit [DBG] from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:39:34.495 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.495 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: 2022-02-02T13:39:34.404262+0000 2022-02-02T13:39:34.496 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: mon.smithi037 (mon.1) 19 : audit [DBG] 2022-02-02T13:39:34.496 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:34 smithi037 conmon[35544]: from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:39:34.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: cluster 2022-02-02T13:39:34.379745+0000 mon.smithi033 (mon.0) 577 : cluster [INF] Active manager daemon smithi037.npteou restarted 2022-02-02T13:39:34.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: cluster 2022-02-02T13:39:34.380431+0000 mon.smithi033 (mon.0) 578 : cluster [INF] Activating manager daemon smithi037.npteou 2022-02-02T13:39:34.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: cluster 2022-02-02T13:39 2022-02-02T13:39:34.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: :34.391582+0000 mon.smithi033 (mon.0) 579 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2022-02-02T13:39:34.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 2022-02-02T13:39:34.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 2022-02-02T13:39 2022-02-02T13:39:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: :34.391851+0000 mon.smithi037 (mon.1) 2022-02-02T13:39:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 16 : audit [DBG] from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:39:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:39:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 02-02T13:39:34 2022-02-02T13:39:34.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: .401692+0000 mon.smithi037 (mon.1) 17 2022-02-02T13:39:34.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: : audit [DBG] from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:39:34.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:39:34.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: T13:39:34.403764+0000 2022-02-02T13:39:34.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: mon.smithi037 (mon.1) 18 : audit [DBG] 2022-02-02T13:39:34.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:39:34.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:39:34.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 13:39:34.404262+0000 mon.smithi037 2022-02-02T13:39:34.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:39:34.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:34 smithi033 conmon[31996]: 2022-02-02T13:39:34.908 INFO:tasks.workunit.client.1.smithi037.stdout:1/4: mkdir d0 0 2022-02-02T13:39:34.908 INFO:tasks.workunit.client.1.smithi037.stdout:1/5: fdatasync - no filename 2022-02-02T13:39:34.946 INFO:tasks.workunit.client.1.smithi037.stdout:2/1: mkdir d0 0 2022-02-02T13:39:34.947 INFO:tasks.workunit.client.1.smithi037.stdout:2/2: fdatasync - no filename 2022-02-02T13:39:34.947 INFO:tasks.workunit.client.1.smithi037.stdout:2/3: dread - no filename 2022-02-02T13:39:35.139 INFO:tasks.workunit.client.1.smithi037.stdout:4/0: readlink - no filename 2022-02-02T13:39:35.139 INFO:tasks.workunit.client.1.smithi037.stdout:4/1: fdatasync - no filename 2022-02-02T13:39:35.140 INFO:tasks.workunit.client.1.smithi037.stdout:4/2: chown . 28498913 1 2022-02-02T13:39:35.140 INFO:tasks.workunit.client.1.smithi037.stdout:4/3: truncate - no filename 2022-02-02T13:39:35.140 INFO:tasks.workunit.client.1.smithi037.stdout:3/0: symlink l0 0 2022-02-02T13:39:35.146 INFO:tasks.workunit.client.1.smithi037.stdout:4/4: creat f0 x:0 0 0 2022-02-02T13:39:35.147 INFO:tasks.workunit.client.1.smithi037.stdout:4/5: write f0 [67951,76986] 0 2022-02-02T13:39:35.149 INFO:tasks.workunit.client.1.smithi037.stdout:3/1: mkdir d1 0 2022-02-02T13:39:35.149 INFO:tasks.workunit.client.1.smithi037.stdout:3/2: dread - no filename 2022-02-02T13:39:35.150 INFO:tasks.workunit.client.1.smithi037.stdout:3/3: write - no filename 2022-02-02T13:39:35.152 INFO:tasks.workunit.client.1.smithi037.stdout:6/0: write - no filename 2022-02-02T13:39:35.152 INFO:tasks.workunit.client.1.smithi037.stdout:6/1: rename - no filename 2022-02-02T13:39:35.153 INFO:tasks.workunit.client.1.smithi037.stdout:6/2: dwrite - no filename 2022-02-02T13:39:35.153 INFO:tasks.workunit.client.1.smithi037.stdout:6/3: fsync - no filename 2022-02-02T13:39:35.153 INFO:tasks.workunit.client.1.smithi037.stdout:6/4: dread - no filename 2022-02-02T13:39:35.153 INFO:tasks.workunit.client.1.smithi037.stdout:6/5: readlink - no filename 2022-02-02T13:39:35.154 INFO:tasks.workunit.client.1.smithi037.stdout:6/6: unlink - no file 2022-02-02T13:39:35.154 INFO:tasks.workunit.client.1.smithi037.stdout:6/7: fdatasync - no filename 2022-02-02T13:39:35.154 INFO:tasks.workunit.client.1.smithi037.stdout:6/8: dread - no filename 2022-02-02T13:39:35.154 INFO:tasks.workunit.client.1.smithi037.stdout:6/9: rename - no filename 2022-02-02T13:39:35.155 INFO:tasks.workunit.client.1.smithi037.stdout:6/10: chown . 467715111 1 2022-02-02T13:39:35.155 INFO:tasks.workunit.client.1.smithi037.stdout:6/11: unlink - no file 2022-02-02T13:39:35.155 INFO:tasks.workunit.client.1.smithi037.stdout:6/12: fdatasync - no filename 2022-02-02T13:39:35.156 INFO:tasks.workunit.client.1.smithi037.stdout:6/13: dwrite - no filename 2022-02-02T13:39:35.156 INFO:tasks.workunit.client.1.smithi037.stdout:6/14: read - no filename 2022-02-02T13:39:35.156 INFO:tasks.workunit.client.1.smithi037.stdout:6/15: dread - no filename 2022-02-02T13:39:35.156 INFO:tasks.workunit.client.1.smithi037.stdout:6/16: dwrite - no filename 2022-02-02T13:39:35.157 INFO:tasks.workunit.client.1.smithi037.stdout:6/17: dwrite - no filename 2022-02-02T13:39:35.157 INFO:tasks.workunit.client.1.smithi037.stdout:6/18: chown . 299 1 2022-02-02T13:39:35.157 INFO:tasks.workunit.client.1.smithi037.stdout:6/19: dread - no filename 2022-02-02T13:39:35.158 INFO:tasks.workunit.client.1.smithi037.stdout:5/0: creat f0 x:0 0 0 2022-02-02T13:39:35.158 INFO:tasks.workunit.client.1.smithi037.stdout:3/4: rmdir d1 0 2022-02-02T13:39:35.160 INFO:tasks.workunit.client.1.smithi037.stdout:7/0: dwrite - no filename 2022-02-02T13:39:35.160 INFO:tasks.workunit.client.1.smithi037.stdout:7/1: fdatasync - no filename 2022-02-02T13:39:35.160 INFO:tasks.workunit.client.1.smithi037.stdout:7/2: chown . 1 1 2022-02-02T13:39:35.161 INFO:tasks.workunit.client.1.smithi037.stdout:7/3: chown . 293160 1 2022-02-02T13:39:35.161 INFO:tasks.workunit.client.1.smithi037.stdout:7/4: readlink - no filename 2022-02-02T13:39:35.161 INFO:tasks.workunit.client.1.smithi037.stdout:7/5: fsync - no filename 2022-02-02T13:39:35.161 INFO:tasks.workunit.client.1.smithi037.stdout:7/6: dwrite - no filename 2022-02-02T13:39:35.162 INFO:tasks.workunit.client.1.smithi037.stdout:7/7: chown . 44049709 1 2022-02-02T13:39:35.162 INFO:tasks.workunit.client.1.smithi037.stdout:7/8: dread - no filename 2022-02-02T13:39:35.162 INFO:tasks.workunit.client.1.smithi037.stdout:7/9: unlink - no file 2022-02-02T13:39:35.162 INFO:tasks.workunit.client.1.smithi037.stdout:7/10: link - no file 2022-02-02T13:39:35.163 INFO:tasks.workunit.client.1.smithi037.stdout:7/11: write - no filename 2022-02-02T13:39:35.163 INFO:tasks.workunit.client.1.smithi037.stdout:7/12: rename - no filename 2022-02-02T13:39:35.163 INFO:tasks.workunit.client.1.smithi037.stdout:7/13: chown . 1333667 1 2022-02-02T13:39:35.163 INFO:tasks.workunit.client.1.smithi037.stdout:7/14: chown . 11831 1 2022-02-02T13:39:35.163 INFO:tasks.workunit.client.1.smithi037.stdout:7/15: fsync - no filename 2022-02-02T13:39:35.164 INFO:tasks.workunit.client.1.smithi037.stdout:7/16: write - no filename 2022-02-02T13:39:35.165 INFO:tasks.workunit.client.1.smithi037.stdout:6/20: creat f0 x:0 0 0 2022-02-02T13:39:35.165 INFO:tasks.workunit.client.1.smithi037.stdout:6/21: creat f1 x:0 0 0 2022-02-02T13:39:35.165 INFO:tasks.workunit.client.1.smithi037.stdout:6/22: chown f0 65 1 2022-02-02T13:39:35.165 INFO:tasks.workunit.client.1.smithi037.stdout:5/1: symlink l1 0 2022-02-02T13:39:35.166 INFO:tasks.workunit.client.1.smithi037.stdout:5/2: truncate f0 294311 0 2022-02-02T13:39:35.166 INFO:tasks.workunit.client.1.smithi037.stdout:5/3: rmdir - no directory 2022-02-02T13:39:35.166 INFO:tasks.workunit.client.1.smithi037.stdout:5/4: rmdir - no directory 2022-02-02T13:39:35.169 INFO:tasks.workunit.client.1.smithi037.stdout:7/17: creat f0 x:0 0 0 2022-02-02T13:39:35.173 INFO:tasks.workunit.client.1.smithi037.stdout:4/6: dwrite f0 [0,4194304] 0 2022-02-02T13:39:35.173 INFO:tasks.workunit.client.1.smithi037.stdout:6/23: symlink l2 0 2022-02-02T13:39:35.176 INFO:tasks.workunit.client.1.smithi037.stdout:5/5: link l1 l2 0 2022-02-02T13:39:35.176 INFO:tasks.workunit.client.1.smithi037.stdout:5/6: creat f3 x:0 0 0 2022-02-02T13:39:35.177 INFO:tasks.workunit.client.1.smithi037.stdout:9/0: rename - no filename 2022-02-02T13:39:35.177 INFO:tasks.workunit.client.1.smithi037.stdout:9/1: fdatasync - no filename 2022-02-02T13:39:35.178 INFO:tasks.workunit.client.1.smithi037.stdout:9/2: dwrite - no filename 2022-02-02T13:39:35.178 INFO:tasks.workunit.client.1.smithi037.stdout:9/3: truncate - no filename 2022-02-02T13:39:35.180 INFO:tasks.workunit.client.1.smithi037.stdout:8/0: mkdir d0 0 2022-02-02T13:39:35.186 INFO:tasks.workunit.client.1.smithi037.stdout:7/18: link f0 f1 0 2022-02-02T13:39:35.192 INFO:tasks.workunit.client.1.smithi037.stdout:4/7: symlink l1 0 2022-02-02T13:39:35.193 INFO:tasks.workunit.client.1.smithi037.stdout:6/24: dwrite f0 [0,4194304] 0 2022-02-02T13:39:35.196 INFO:tasks.workunit.client.1.smithi037.stdout:5/7: read f0 [287699,111597] 0 2022-02-02T13:39:35.196 INFO:tasks.workunit.client.1.smithi037.stdout:5/8: chown l2 1453832 1 2022-02-02T13:39:35.196 INFO:tasks.workunit.client.1.smithi037.stdout:5/9: chown f0 67 1 2022-02-02T13:39:35.229 INFO:tasks.workunit.client.1.smithi037.stdout:9/4: mkdir d0 0 2022-02-02T13:39:35.229 INFO:tasks.workunit.client.1.smithi037.stdout:9/5: chown d0 22 1 2022-02-02T13:39:35.229 INFO:tasks.workunit.client.1.smithi037.stdout:9/6: link - no file 2022-02-02T13:39:35.229 INFO:tasks.workunit.client.1.smithi037.stdout:9/7: read - no filename 2022-02-02T13:39:35.230 INFO:tasks.workunit.client.1.smithi037.stdout:9/8: getdents d0 0 2022-02-02T13:39:35.230 INFO:tasks.workunit.client.1.smithi037.stdout:9/9: unlink - no file 2022-02-02T13:39:35.230 INFO:tasks.workunit.client.1.smithi037.stdout:9/10: getdents d0 0 2022-02-02T13:39:35.230 INFO:tasks.workunit.client.1.smithi037.stdout:9/11: truncate - no filename 2022-02-02T13:39:35.231 INFO:tasks.workunit.client.1.smithi037.stdout:9/12: chown d0 7 1 2022-02-02T13:39:35.231 INFO:tasks.workunit.client.1.smithi037.stdout:9/13: dwrite - no filename 2022-02-02T13:39:35.344 INFO:tasks.workunit.client.1.smithi037.stdout:8/1: rmdir d0 0 2022-02-02T13:39:35.344 INFO:tasks.workunit.client.1.smithi037.stdout:8/2: fdatasync - no filename 2022-02-02T13:39:35.346 INFO:tasks.workunit.client.1.smithi037.stdout:7/19: mkdir d2 0 2022-02-02T13:39:35.346 INFO:tasks.workunit.client.1.smithi037.stdout:7/20: rename d2 to d2/d3 22 2022-02-02T13:39:35.346 INFO:tasks.workunit.client.1.smithi037.stdout:7/21: truncate f0 204572 0 2022-02-02T13:39:35.360 INFO:tasks.workunit.client.1.smithi037.stdout:5/10: mknod c4 0 2022-02-02T13:39:35.364 INFO:tasks.workunit.client.1.smithi037.stdout:9/14: creat d0/f1 x:0 0 0 2022-02-02T13:39:35.367 INFO:tasks.workunit.client.1.smithi037.stdout:8/3: creat f1 x:0 0 0 2022-02-02T13:39:35.367 INFO:tasks.workunit.client.1.smithi037.stdout:8/4: write f1 [186159,76553] 0 2022-02-02T13:39:35.367 INFO:tasks.workunit.client.1.smithi037.stdout:8/5: truncate f1 287252 0 2022-02-02T13:39:35.367 INFO:tasks.workunit.client.1.smithi037.stdout:8/6: write f1 [319678,119411] 0 2022-02-02T13:39:35.368 INFO:tasks.workunit.client.1.smithi037.stdout:8/7: rmdir - no directory 2022-02-02T13:39:35.368 INFO:tasks.workunit.client.1.smithi037.stdout:8/8: chown f1 473 1 2022-02-02T13:39:35.368 INFO:tasks.workunit.client.1.smithi037.stdout:8/9: truncate f1 730503 0 2022-02-02T13:39:35.369 INFO:tasks.workunit.client.1.smithi037.stdout:7/22: mknod d2/c4 0 2022-02-02T13:39:35.369 INFO:tasks.workunit.client.1.smithi037.stdout:7/23: rename d2 to d2/d5 22 2022-02-02T13:39:35.369 INFO:tasks.workunit.client.1.smithi037.stdout:7/24: rename d2 to d2/d6 22 2022-02-02T13:39:35.370 INFO:tasks.workunit.client.1.smithi037.stdout:7/25: fsync f0 0 2022-02-02T13:39:35.373 INFO:tasks.workunit.client.1.smithi037.stdout:6/25: rename f1 to f3 0 2022-02-02T13:39:35.373 INFO:tasks.workunit.client.1.smithi037.stdout:6/26: write f0 [5146270,68664] 0 2022-02-02T13:39:35.374 INFO:tasks.workunit.client.1.smithi037.stdout:6/27: readlink l2 0 2022-02-02T13:39:35.374 INFO:tasks.workunit.client.1.smithi037.stdout:4/8: unlink f0 0 2022-02-02T13:39:35.376 INFO:tasks.workunit.client.1.smithi037.stdout:8/10: symlink l2 0 2022-02-02T13:39:35.377 INFO:tasks.workunit.client.1.smithi037.stdout:8/11: truncate f1 1183855 0 2022-02-02T13:39:35.384 INFO:tasks.workunit.client.1.smithi037.stdout:9/15: dwrite d0/f1 [0,4194304] 0 2022-02-02T13:39:35.385 INFO:tasks.workunit.client.1.smithi037.stdout:8/12: fdatasync f1 0 2022-02-02T13:39:35.386 INFO:tasks.workunit.client.1.smithi037.stdout:7/26: creat d2/f7 x:0 0 0 2022-02-02T13:39:35.391 INFO:tasks.workunit.client.1.smithi037.stdout:9/16: write d0/f1 [3535657,23855] 0 2022-02-02T13:39:35.392 INFO:tasks.workunit.client.1.smithi037.stdout:9/17: chown d0/f1 322 1 2022-02-02T13:39:35.392 INFO:tasks.workunit.client.1.smithi037.stdout:8/13: symlink l3 0 2022-02-02T13:39:35.393 INFO:tasks.workunit.client.1.smithi037.stdout:8/14: read f1 [741999,66424] 0 2022-02-02T13:39:35.393 INFO:tasks.workunit.client.1.smithi037.stdout:8/15: creat f4 x:0 0 0 2022-02-02T13:39:35.393 INFO:tasks.workunit.client.1.smithi037.stdout:8/16: fdatasync f1 0 2022-02-02T13:39:35.394 INFO:tasks.workunit.client.1.smithi037.stdout:6/28: dwrite f3 [0,4194304] 0 2022-02-02T13:39:35.394 INFO:tasks.workunit.client.1.smithi037.stdout:7/27: mkdir d2/d8 0 2022-02-02T13:39:35.405 INFO:tasks.workunit.client.1.smithi037.stdout:4/9: getdents . 0 2022-02-02T13:39:35.419 INFO:tasks.workunit.client.1.smithi037.stdout:8/17: mknod c5 0 2022-02-02T13:39:35.429 INFO:tasks.workunit.client.1.smithi037.stdout:7/28: creat d2/d8/f9 x:0 0 0 2022-02-02T13:39:35.431 INFO:tasks.workunit.client.1.smithi037.stdout:9/18: rmdir d0 39 2022-02-02T13:39:35.433 INFO:tasks.workunit.client.1.smithi037.stdout:4/10: symlink l2 0 2022-02-02T13:39:35.434 INFO:tasks.workunit.client.1.smithi037.stdout:4/11: dread - no filename 2022-02-02T13:39:35.434 INFO:tasks.workunit.client.1.smithi037.stdout:8/18: dwrite f1 [0,4194304] 0 2022-02-02T13:39:35.435 INFO:tasks.workunit.client.1.smithi037.stdout:9/19: write d0/f1 [1467713,9509] 0 2022-02-02T13:39:35.435 INFO:tasks.workunit.client.1.smithi037.stdout:9/20: chown d0/f1 0 1 2022-02-02T13:39:35.435 INFO:tasks.workunit.client.1.smithi037.stdout:6/29: getdents . 0 2022-02-02T13:39:35.436 INFO:tasks.workunit.client.1.smithi037.stdout:6/30: rmdir - no directory 2022-02-02T13:39:35.437 INFO:tasks.workunit.client.1.smithi037.stdout:9/21: fsync d0/f1 0 2022-02-02T13:39:35.437 INFO:tasks.workunit.client.1.smithi037.stdout:9/22: fdatasync d0/f1 0 2022-02-02T13:39:35.438 INFO:tasks.workunit.client.1.smithi037.stdout:9/23: fdatasync d0/f1 0 2022-02-02T13:39:35.438 INFO:tasks.workunit.client.1.smithi037.stdout:9/24: readlink - no filename 2022-02-02T13:39:35.439 INFO:tasks.workunit.client.1.smithi037.stdout:7/29: symlink d2/la 0 2022-02-02T13:39:35.440 INFO:tasks.workunit.client.1.smithi037.stdout:7/30: dread - d2/d8/f9 zero size 2022-02-02T13:39:35.440 INFO:tasks.workunit.client.1.smithi037.stdout:7/31: fsync f1 0 2022-02-02T13:39:35.440 INFO:tasks.workunit.client.1.smithi037.stdout:7/32: write d2/f7 [865437,26503] 0 2022-02-02T13:39:35.448 INFO:tasks.workunit.client.1.smithi037.stdout:6/31: mknod c4 0 2022-02-02T13:39:35.452 INFO:tasks.workunit.client.1.smithi037.stdout:4/12: symlink l3 0 2022-02-02T13:39:35.453 INFO:tasks.workunit.client.1.smithi037.stdout:7/33: dread d2/f7 [0,4194304] 0 2022-02-02T13:39:35.453 INFO:tasks.workunit.client.1.smithi037.stdout:7/34: chown d2/d8 1 1 2022-02-02T13:39:35.453 INFO:tasks.workunit.client.1.smithi037.stdout:7/35: truncate d2/f7 1880054 0 2022-02-02T13:39:35.456 INFO:tasks.workunit.client.1.smithi037.stdout:9/25: dwrite d0/f1 [0,4194304] 0 2022-02-02T13:39:35.461 INFO:tasks.workunit.client.1.smithi037.stdout:4/13: readlink l1 0 2022-02-02T13:39:35.470 INFO:tasks.workunit.client.1.smithi037.stdout:7/36: unlink d2/c4 0 2022-02-02T13:39:35.470 INFO:tasks.workunit.client.1.smithi037.stdout:9/26: rmdir d0 39 2022-02-02T13:39:35.474 INFO:tasks.workunit.client.1.smithi037.stdout:8/19: truncate f1 2408684 0 2022-02-02T13:39:35.475 INFO:tasks.workunit.client.1.smithi037.stdout:7/37: mkdir d2/db 0 2022-02-02T13:39:35.478 INFO:tasks.workunit.client.1.smithi037.stdout:4/14: mknod c4 0 2022-02-02T13:39:35.478 INFO:tasks.workunit.client.1.smithi037.stdout:4/15: write - no filename 2022-02-02T13:39:35.478 INFO:tasks.workunit.client.1.smithi037.stdout:4/16: chown l3 1 1 2022-02-02T13:39:35.478 INFO:tasks.workunit.client.1.smithi037.stdout:4/17: dread - no filename 2022-02-02T13:39:35.479 INFO:tasks.workunit.client.1.smithi037.stdout:4/18: truncate - no filename 2022-02-02T13:39:35.479 INFO:tasks.workunit.client.1.smithi037.stdout:9/27: write d0/f1 [1031982,51655] 0 2022-02-02T13:39:35.480 INFO:tasks.workunit.client.1.smithi037.stdout:9/28: chown d0/f1 65478 1 2022-02-02T13:39:35.480 INFO:tasks.workunit.client.1.smithi037.stdout:9/29: rename d0 to d0/d2 22 2022-02-02T13:39:35.485 INFO:tasks.workunit.client.1.smithi037.stdout:7/38: symlink d2/d8/lc 0 2022-02-02T13:39:35.489 INFO:tasks.workunit.client.1.smithi037.stdout:7/39: symlink d2/d8/ld 0 2022-02-02T13:39:35.491 INFO:tasks.workunit.client.1.smithi037.stdout:9/30: fsync d0/f1 0 2022-02-02T13:39:35.491 INFO:tasks.workunit.client.1.smithi037.stdout:6/32: dwrite f0 [4194304,4194304] 0 2022-02-02T13:39:35.491 INFO:tasks.workunit.client.1.smithi037.stdout:6/33: chown f0 0 1 2022-02-02T13:39:35.496 INFO:tasks.workunit.client.1.smithi037.stdout:4/19: symlink l5 0 2022-02-02T13:39:35.497 INFO:tasks.workunit.client.1.smithi037.stdout:4/20: dwrite - no filename 2022-02-02T13:39:35.505 INFO:tasks.workunit.client.1.smithi037.stdout:9/31: dwrite d0/f1 [0,4194304] 0 2022-02-02T13:39:35.508 INFO:tasks.workunit.client.1.smithi037.stdout:8/20: rename f1 to f6 0 2022-02-02T13:39:35.513 INFO:tasks.workunit.client.1.smithi037.stdout:7/40: dread f1 [0,4194304] 0 2022-02-02T13:39:35.514 INFO:tasks.workunit.client.1.smithi037.stdout:7/41: write d2/f7 [1465369,112977] 0 2022-02-02T13:39:35.520 INFO:tasks.workunit.client.1.smithi037.stdout:9/32: symlink d0/l3 0 2022-02-02T13:39:35.522 INFO:tasks.workunit.client.1.smithi037.stdout:4/21: symlink l6 0 2022-02-02T13:39:35.523 INFO:tasks.workunit.client.1.smithi037.stdout:8/21: dwrite f6 [0,4194304] 0 2022-02-02T13:39:35.523 INFO:tasks.workunit.client.1.smithi037.stdout:7/42: dread f1 [0,4194304] 0 2022-02-02T13:39:35.527 INFO:tasks.workunit.client.1.smithi037.stdout:6/34: truncate f0 5402509 0 2022-02-02T13:39:35.527 INFO:tasks.workunit.client.1.smithi037.stdout:6/35: chown c4 18 1 2022-02-02T13:39:35.529 INFO:tasks.workunit.client.1.smithi037.stdout:9/33: creat d0/f4 x:0 0 0 2022-02-02T13:39:35.529 INFO:tasks.workunit.client.1.smithi037.stdout:9/34: fdatasync d0/f4 0 2022-02-02T13:39:35.530 INFO:tasks.workunit.client.1.smithi037.stdout:9/35: dread - d0/f4 zero size 2022-02-02T13:39:35.530 INFO:tasks.workunit.client.1.smithi037.stdout:9/36: fdatasync d0/f4 0 2022-02-02T13:39:35.530 INFO:tasks.workunit.client.1.smithi037.stdout:9/37: chown d0/l3 1 1 2022-02-02T13:39:35.530 INFO:tasks.workunit.client.1.smithi037.stdout:9/38: chown d0/l3 54643968 1 2022-02-02T13:39:35.533 INFO:tasks.workunit.client.1.smithi037.stdout:8/22: symlink l7 0 2022-02-02T13:39:35.533 INFO:tasks.workunit.client.1.smithi037.stdout:8/23: fdatasync f6 0 2022-02-02T13:39:35.534 INFO:tasks.workunit.client.1.smithi037.stdout:7/43: symlink d2/d8/le 0 2022-02-02T13:39:35.539 INFO:tasks.workunit.client.1.smithi037.stdout:9/39: fsync d0/f4 0 2022-02-02T13:39:35.539 INFO:tasks.workunit.client.1.smithi037.stdout:9/40: creat d0/f5 x:0 0 0 2022-02-02T13:39:35.542 INFO:tasks.workunit.client.1.smithi037.stdout:8/24: mknod c8 0 2022-02-02T13:39:35.546 INFO:tasks.workunit.client.1.smithi037.stdout:7/44: link d2/d8/ld d2/d8/lf 0 2022-02-02T13:39:35.548 INFO:tasks.workunit.client.1.smithi037.stdout:6/36: symlink l5 0 2022-02-02T13:39:35.558 INFO:tasks.workunit.client.1.smithi037.stdout:9/41: unlink d0/f5 0 2022-02-02T13:39:35.560 INFO:tasks.workunit.client.1.smithi037.stdout:9/42: read d0/f1 [3715629,3343] 0 2022-02-02T13:39:35.560 INFO:tasks.workunit.client.1.smithi037.stdout:9/43: dread - d0/f4 zero size 2022-02-02T13:39:35.561 INFO:tasks.workunit.client.1.smithi037.stdout:7/45: dwrite d2/d8/f9 [0,4194304] 0 2022-02-02T13:39:35.565 INFO:tasks.workunit.client.1.smithi037.stdout:8/25: getdents . 0 2022-02-02T13:39:35.568 INFO:tasks.workunit.client.1.smithi037.stdout:6/37: symlink l6 0 2022-02-02T13:39:35.582 INFO:tasks.workunit.client.1.smithi037.stdout:7/46: symlink d2/l10 0 2022-02-02T13:39:35.585 INFO:tasks.workunit.client.1.smithi037.stdout:8/26: creat f9 x:0 0 0 2022-02-02T13:39:35.587 INFO:tasks.workunit.client.1.smithi037.stdout:6/38: chown f3 5718548 1 2022-02-02T13:39:35.588 INFO:tasks.workunit.client.1.smithi037.stdout:9/44: truncate d0/f1 1243340 0 2022-02-02T13:39:35.594 INFO:tasks.workunit.client.1.smithi037.stdout:9/45: link d0/f4 d0/f6 0 2022-02-02T13:39:35.598 INFO:tasks.workunit.client.1.smithi037.stdout:9/46: mknod d0/c7 0 2022-02-02T13:39:35.598 INFO:tasks.workunit.client.1.smithi037.stdout:9/47: write d0/f4 [647343,124763] 0 2022-02-02T13:39:35.605 INFO:tasks.workunit.client.1.smithi037.stdout:6/39: dread f3 [0,4194304] 0 2022-02-02T13:39:35.606 INFO:tasks.workunit.client.1.smithi037.stdout:6/40: write f3 [4918252,28103] 0 2022-02-02T13:39:35.606 INFO:tasks.workunit.client.1.smithi037.stdout:7/47: dwrite f1 [0,4194304] 0 2022-02-02T13:39:35.608 INFO:tasks.workunit.client.1.smithi037.stdout:9/48: dread d0/f6 [0,4194304] 0 2022-02-02T13:39:35.608 INFO:tasks.workunit.client.1.smithi037.stdout:9/49: chown d0/c7 249202 1 2022-02-02T13:39:35.609 INFO:tasks.workunit.client.1.smithi037.stdout:7/48: write f0 [2524500,38627] 0 2022-02-02T13:39:35.617 INFO:tasks.workunit.client.1.smithi037.stdout:6/41: write f0 [4322775,114027] 0 2022-02-02T13:39:35.620 INFO:tasks.workunit.client.1.smithi037.stdout:6/42: write f0 [4004216,15085] 0 2022-02-02T13:39:35.620 INFO:tasks.workunit.client.1.smithi037.stdout:8/27: truncate f6 1188073 0 2022-02-02T13:39:35.622 INFO:tasks.workunit.client.1.smithi037.stdout:7/49: symlink d2/d8/l11 0 2022-02-02T13:39:35.626 INFO:tasks.workunit.client.1.smithi037.stdout:7/50: write f0 [119031,44883] 0 2022-02-02T13:39:35.631 INFO:tasks.workunit.client.1.smithi037.stdout:9/50: dwrite d0/f4 [0,4194304] 0 2022-02-02T13:39:35.631 INFO:tasks.workunit.client.1.smithi037.stdout:9/51: chown d0/f6 66 1 2022-02-02T13:39:35.631 INFO:tasks.workunit.client.1.smithi037.stdout:9/52: chown d0/f1 65825051 1 2022-02-02T13:39:35.631 INFO:tasks.workunit.client.1.smithi037.stdout:9/53: chown d0/f4 163165 1 2022-02-02T13:39:35.636 INFO:tasks.workunit.client.1.smithi037.stdout:7/51: link d2/f7 d2/db/f12 0 2022-02-02T13:39:35.636 INFO:tasks.workunit.client.1.smithi037.stdout:7/52: stat d2/l10 0 2022-02-02T13:39:35.639 INFO:tasks.workunit.client.1.smithi037.stdout:9/54: symlink d0/l8 0 2022-02-02T13:39:35.639 INFO:tasks.workunit.client.1.smithi037.stdout:9/55: stat d0 0 2022-02-02T13:39:35.642 INFO:tasks.workunit.client.1.smithi037.stdout:7/53: creat d2/db/f13 x:0 0 0 2022-02-02T13:39:35.655 INFO:tasks.workunit.client.1.smithi037.stdout:9/56: dread d0/f4 [0,4194304] 0 2022-02-02T13:39:35.656 INFO:tasks.workunit.client.1.smithi037.stdout:8/28: dwrite f6 [0,4194304] 0 2022-02-02T13:39:35.659 INFO:tasks.workunit.client.1.smithi037.stdout:6/43: dwrite f3 [4194304,4194304] 0 2022-02-02T13:39:35.659 INFO:tasks.workunit.client.1.smithi037.stdout:6/44: readlink l6 0 2022-02-02T13:39:35.679 INFO:tasks.workunit.client.1.smithi037.stdout:9/57: getdents d0 0 2022-02-02T13:39:35.684 INFO:tasks.workunit.client.1.smithi037.stdout:8/29: mknod ca 0 2022-02-02T13:39:35.684 INFO:tasks.workunit.client.1.smithi037.stdout:8/30: fsync f9 0 2022-02-02T13:39:35.685 INFO:tasks.workunit.client.1.smithi037.stdout:8/31: rmdir - no directory 2022-02-02T13:39:35.686 INFO:tasks.workunit.client.1.smithi037.stdout:6/45: mknod c7 0 2022-02-02T13:39:35.686 INFO:tasks.workunit.client.1.smithi037.stdout:6/46: stat l5 0 2022-02-02T13:39:35.688 INFO:tasks.workunit.client.1.smithi037.stdout:8/32: dread - f4 zero size 2022-02-02T13:39:35.712 INFO:tasks.workunit.client.1.smithi037.stdout:6/47: dwrite f3 [0,4194304] 0 2022-02-02T13:39:35.713 INFO:tasks.workunit.client.1.smithi037.stdout:8/33: dwrite f4 [0,4194304] 0 2022-02-02T13:39:35.713 INFO:tasks.workunit.client.1.smithi037.stdout:8/34: rmdir - no directory 2022-02-02T13:39:35.724 INFO:tasks.workunit.client.1.smithi037.stdout:6/48: dread f3 [4194304,4194304] 0 2022-02-02T13:39:35.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: cluster 2022-02-02T13:39:34.447489+0000 mon.smithi033 2022-02-02T13:39:35.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: (mon.0) 580 : cluster [DBG] mgrmap e20: smithi037.npteou(active, starting, since 0.0672972s), standbys: smithi033.xvkvzp 2022-02-02T13:39:35.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.459788+0000 mon.smithi037 (mon.1) 20 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:35.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.460023+0000 mon.smithi037 (mon.1) 21 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:35.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.461286+0000 mon.smithi037 (mon.1) 22 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:39:35.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.461676+0000 mon.smithi037 (mon.1) 23 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:39:35.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.462004+0000 mon.smithi037 (mon.1) 24 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:39:35.731 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.462344+0000 mon.smithi037 (mon.1) 25 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:39:35.731 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.462995+0000 mon.smithi037 (mon.1) 26 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:39:35.731 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.463203+0000 mon.smithi037 (mon.1) 27 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:39:35.732 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.463442+0000 mon.smithi037 (mon.1) 28 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:39:35.732 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.463805+0000 mon.smithi037 (mon.1) 29 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:39:35.732 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.464249+0000 mon.smithi037 (mon.1) 30 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:39:35.732 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.464609+0000 mon.smithi037 (mon.1) 31 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:39:35.732 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.464958+0000 mon.smithi037 (mon.1) 32 : audit [DBG] 2022-02-02T13:39:35.733 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:39:35.733 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.465278+0000 mon.smithi037 (mon.1) 33 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:39:35.734 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.466871+0000 mon.smithi037 (mon.1) 34 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:39:35.734 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.467442+0000 2022-02-02T13:39:35.734 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.smithi037 (mon.1) 35 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:39:35.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: 2022-02-02T13:39:35.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:39:35.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: 02T13:39:34.467980+0000 mon.smithi037 (mon.1) 2022-02-02T13:39:35.735 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: 36 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:39:35.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: cluster 2022-02-02T13:39:34.583571+0000 2022-02-02T13:39:35.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.smithi033 (mon.0) 581 : cluster [INF] Manager daemon smithi037.npteou is now available 2022-02-02T13:39:35.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.608625+0000 2022-02-02T13:39:35.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.smithi037 (mon.1) 37 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:35.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.611545+0000 2022-02-02T13:39:35.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.smithi037 (mon.1) 38 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:35.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:35.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: 2022-02-02T13:39:34.620682+0000 mon.smithi037 (mon.1) 39 : audit [INF] 2022-02-02T13:39:35.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T13:39:35.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:39:35.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: :39:34.621037+0000 mon.smithi033 (mon.0) 582 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T13:39:35.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.631845+0000 mon.smithi033 (mon 2022-02-02T13:39:35.738 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: .0) 583 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022 2022-02-02T13:39:35.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: -02-02T13:39:34.636436+0000 mon.smithi033 (mon.0) 584 : audit 2022-02-02T13:39:35.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39 2022-02-02T13:39:35.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: :34.650494+0000 mon.smithi037 (mon.1) 40 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:35.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.650849+0000 2022-02-02T13:39:35.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.smithi033 (mon.0) 585 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:35.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:34.655046+0000 mon.smithi037 ( 2022-02-02T13:39:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: mon.1) 41 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02T13:39:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: 2022-02-02T13:39:34.655378+0000 mon.smithi033 (mon.0) 586 2022-02-02T13:39:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:35.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:39:35.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:35 smithi033 conmon[31996]: T13:39:34.669240+0000 mon.smithi033 (mon.0) 587 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.742 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: cluster 2022-02-02T13:39:34.447489+0000 2022-02-02T13:39:35.742 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: mon.smithi033 (mon.0) 580 : cluster [DBG] mgrmap e20: smithi037.npteou(active, starting, since 0.0672972s), standbys: smithi033.xvkvzp 2022-02-02T13:39:35.742 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.459788+0000 mon.smithi037 (mon.1) 20 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:35.743 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.460023+0000 mon.smithi037 (mon.1) 21 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:35.743 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.461286+0000 mon.smithi037 (mon.1) 22 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:39:35.743 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.461676+0000 mon.smithi037 (mon.1) 23 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:39:35.743 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.462004+0000 mon.smithi037 (mon.1) 24 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:39:35.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.462344+0000 mon.smithi037 (mon.1) 25 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:39:35.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.462995+0000 mon.smithi037 (mon.1) 26 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:39:35.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.463203+0000 mon.smithi037 (mon.1) 27 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:39:35.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.463442+0000 mon.smithi037 (mon.1) 28 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:39:35.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.463805+0000 mon.smithi037 (mon.1) 29 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:39:35.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.464249+0000 mon.smithi037 (mon.1) 30 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:39:35.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:35.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: 2022-02-02T13:39:34.464609+0000 mon.smithi037 ( 2022-02-02T13:39:35.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: mon.1) 31 : audit 2022-02-02T13:39:35.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:39:35.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39: 2022-02-02T13:39:35.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: 34.464958+0000 mon.smithi037 (mon.1) 2022-02-02T13:39:35.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: 32 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:39:35.747 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.465278+0000 mon.smithi037 (mon.1) 33 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:39:35.747 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.466871+0000 mon.smithi037 (mon.1) 34 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:39:35.747 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.467442+0000 mon.smithi037 (mon.1) 35 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:39:35.747 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.467980+0000 mon.smithi037 (mon.1) 36 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:39:35.747 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: cluster 2022-02-02T13:39:34.583571+0000 mon.smithi033 (mon.0) 581 : cluster [INF] Manager daemon smithi037.npteou is now available 2022-02-02T13:39:35.748 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.608625+0000 mon.smithi037 (mon.1) 37 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:35.748 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.611545+0000 mon.smithi037 (mon.1) 38 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:39:35.748 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.620682+0000 mon.smithi037 (mon.1) 39 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T13:39:35.748 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.621037+0000 mon.smithi033 (mon.0) 582 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2022-02-02T13:39:35.748 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.631845+0000 mon.smithi033 (mon.0) 583 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.749 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.636436+0000 mon.smithi033 (mon.0) 584 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.749 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.650494+0000 mon.smithi037 (mon.1) 40 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:35.749 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.650849+0000 mon.smithi033 (mon.0) 585 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:39:35.749 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.655046+0000 mon.smithi037 (mon.1) 41 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:35.750 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.655378+0000 mon.smithi033 (mon.0) 586 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.npteou/trash_purge_schedule"}]: dispatch 2022-02-02T13:39:35.750 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:35 smithi037 conmon[35544]: audit 2022-02-02T13:39:34.669240+0000 mon.smithi033 (mon.0) 587 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:35.755 INFO:tasks.workunit.client.1.smithi037.stdout:6/49: dwrite f3 [4194304,4194304] 0 2022-02-02T13:39:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:35.072411+0000 mgr.smithi037.npteou (mgr.24381) 1 : cephadm [INF] Deploying cephadm binary to smithi033 2022-02-02T13:39:36.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:35.079390+0000 mgr.smithi037.npteou (mgr.24381) 2 : cephadm [INF] Deploying cephadm binary to smithi037 2022-02-02T13:39:36.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: audit 2022-02-02T13:39:35.470040+0000 mon.smithi033 (mon.0) 588 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2022-02-02T13:39:36.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: cluster 2022-02-02T13:39:35.470130+0000 mon.smithi033 (mon.0) 589 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2022-02-02T13:39:36.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: cluster 2022-02-02T13:39:35.470537+0000 mon.smithi033 (mon.0) 590 : cluster [DBG] mgrmap e21: smithi037.npteou(active, since 1.09035s), standbys: smithi033.xvkvzp 2022-02-02T13:39:36.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: cluster 2022-02-02T13:39:35.488991+0000 mgr.smithi037.npteou (mgr.24381) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:36.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:39:36.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: :39:35.501140+0000 mon.smithi037 (mon.1) 42 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T13:39:36.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:36 smithi033 conmon[31996]: audit 2022-02-02T13:39:35.501893+0000 mon.smithi033 (mon.0) 591 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T13:39:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: cephadm 2022-02-02T13:39 2022-02-02T13:39:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: :35.072411+0000 mgr.smithi037.npteou (mgr.24381) 1 : cephadm [INF] Deploying cephadm binary to smithi033 2022-02-02T13:39:36.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:35.079390+0000 mgr.smithi037.npteou (mgr. 2022-02-02T13:39:36.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 24381) 2 : cephadm [INF] Deploying cephadm binary to smithi037 2022-02-02T13:39:36.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: audit 2022 2022-02-02T13:39:36.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: -02-02T13:39:35.470040+0000 2022-02-02T13:39:36.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: mon.smithi033 (mon.0) 588 : audit [INF] 2022-02-02T13:39:36.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2022-02-02T13:39:36.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: cluster 2022-02-02T13:39:36.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 2022-02-02T13: 2022-02-02T13:39:36.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 39:35.470130+0000 mon.smithi033 ( 2022-02-02T13:39:36.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: mon.0) 589 : cluster 2022-02-02T13:39:36.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: [DBG] osdmap e45: 6 total, 6 up, 6 in 2022-02-02T13:39:36.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: cluster 2022-02-02T13 2022-02-02T13:39:36.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: :39:35.470537+0000 mon.smithi033 (mon.0) 590 : cluster [DBG] mgrmap e21: smithi037.npteou(active, since 1.09035s), standbys: smithi033.xvkvzp 2022-02-02T13:39:36.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: cluster 2022-02-02T13:39:36.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 2022-02-02T 2022-02-02T13:39:36.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 13:39:35.488991+0000 mgr.smithi037.npteou ( 2022-02-02T13:39:36.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: mgr.24381) 3 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:36.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:39:36.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: -02T13:39:35.501140+0000 mon.smithi037 ( 2022-02-02T13:39:36.796 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: mon.1) 42 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T13:39:36.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: 2022-02-02T13:39:36.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:39:36.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: :39:35.501893+0000 mon.smithi033 (mon 2022-02-02T13:39:36.797 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:36 smithi037 conmon[35544]: .0) 591 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2022-02-02T13:39:37.611 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cluster 2022-02-02T13:39:36.466949+0000 mgr.smithi037.npteou (mgr.24381) 4 : cluster 2022-02-02T13:39:37.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: [DBG] pgmap v5: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:37.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cluster 2022-02-02T13:39:36.479261+0000 mon.smithi033 (mon.0) 592 : cluster [DBG] mgrmap e22: smithi037.npteou(active, since 2s), standbys: smithi033.xvkvzp 2022-02-02T13:39:37.612 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: audit 2022-02-02T13:39:36.479569+0000 mon.smithi033 (mon.0) 593 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-02-02T13:39:37.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cluster 2022-02-02T13:39:36.479659+0000 mon.smithi033 (mon.0) 594 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2022-02-02T13:39:37.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:36.524797+0000 mgr.smithi037.npteou (mgr.24381) 5 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Bus STARTING 2022-02-02T13:39:37.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:36.655677+0000 mgr.smithi037.npteou (mgr.24381) 6 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Serving on https://172.21.15.37:7150 2022-02-02T13:39:37.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: cephadm 2022-02-02T13:39:36.655866 2022-02-02T13:39:37.613 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: +0000 mgr.smithi037.npteou (mgr.24381) 7 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Bus STARTED 2022-02-02T13:39:37.614 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:37 smithi033 conmon[31996]: audit 2022-02-02T13:39:36.661645+0000 mon.smithi033 (mon.0) 595 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cluster 2022-02-02T13:39:36.466949+0000 mgr.smithi037.npteou (mgr.24381) 4 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:37.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cluster 2022-02-02T13:39:36.479261+0000 mon.smithi033 (mon.0) 592 : cluster [DBG] mgrmap e22: smithi037.npteou(active, since 2s), standbys: smithi033.xvkvzp 2022-02-02T13:39:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: audit 2022-02-02T13:39:36.479569+0000 mon.smithi033 (mon.0) 593 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2022-02-02T13:39:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cluster 2022-02-02T13:39:36.479659+0000 mon.smithi033 (mon.0) 594 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2022-02-02T13:39:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:36.524797+0000 mgr.smithi037.npteou (mgr 2022-02-02T13:39:37.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: .24381) 5 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Bus STARTING 2022-02-02T13:39:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:36.655677+0000 mgr.smithi037.npteou 2022-02-02T13:39:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: (mgr.24381) 6 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Serving on https://172.21.15.37:7150 2022-02-02T13:39:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: cephadm 2022-02-02T13:39:36.655866+0000 2022-02-02T13:39:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: mgr.smithi037.npteou (mgr.24381) 7 : cephadm [INF] [02/Feb/2022:13:39:36] ENGINE Bus STARTED 2022-02-02T13:39:37.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: audit 2022-02-02T13:39: 2022-02-02T13:39:37.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: 36.661645+0000 mon.smithi033 (mon.0) 595 : audit [INF] 2022-02-02T13:39:37.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:37 smithi037 conmon[35544]: from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:38.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: audit 2022-02-02T13:39: 2022-02-02T13:39:38.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: 37.596766+0000 mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:38.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: cluster 2022-02-02T13:39:37.926633+0000 mon.smithi033 2022-02-02T13:39:38.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: (mon.0) 597 : cluster [DBG] Standby manager daemon smithi033.xvkvzp restarted 2022-02-02T13:39:38.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: cluster 2022-02-02T13:39: 2022-02-02T13:39:38.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: 37.926718+0000 mon.smithi033 (mon.0) 598 2022-02-02T13:39:38.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:39:38.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:39:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: 13:39:37.928929+0000 mon.smithi033 (mon 2022-02-02T13:39:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: .0) 599 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/crt"}]: dispatch 2022-02-02T13:39:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:39:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: -02T13:39:37.934317+0000 2022-02-02T13:39:38.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: mon.smithi033 (mon.0) 600 : audit [DBG] 2022-02-02T13:39:38.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:39:38.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: audit 2022-02-02T13:39:38.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: 2022-02-02T13:39:37.935450+0000 mon.smithi033 ( 2022-02-02T13:39:38.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: mon.0) 601 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/key"}]: dispatch 2022-02-02T13:39:38.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:39:38.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: 02-02T13:39:37.935839+0000 2022-02-02T13:39:38.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: mon.smithi033 (mon.0) 602 : audit [DBG] 2022-02-02T13:39:38.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:38 smithi033 conmon[31996]: from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:39:39.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: audit 2022-02-02T13:39:37.596766+0000 2022-02-02T13:39:39.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: mon.smithi033 (mon.0) 596 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:39.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: cluster 2022-02-02T13:39:37.926633+0000 mon.smithi033 (mon.0) 597 : cluster [DBG] Standby manager daemon smithi033.xvkvzp restarted 2022-02-02T13:39:39.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: cluster 2022-02-02T13:39:37.926718+0000 mon.smithi033 (mon.0) 598 : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:39:39.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: audit 2022-02-02T13:39:37.928929+0000 mon.smithi033 ( 2022-02-02T13:39:39.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: mon.0) 599 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/crt"}]: dispatch 2022-02-02T13:39:39.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:39:39.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: 02-02T13:39:37.934317+0000 mon.smithi033 (mon 2022-02-02T13:39:39.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: .0) 600 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:39:39.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: audit 2022 2022-02-02T13:39:39.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: -02-02T13:39:37.935450+0000 2022-02-02T13:39:39.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: mon.smithi033 (mon.0) 601 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/key"}]: dispatch 2022-02-02T13:39:39.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: audit 2022 2022-02-02T13:39:39.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: -02-02T13:39:37.935839+0000 mon.smithi033 2022-02-02T13:39:39.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:38 smithi037 conmon[35544]: (mon.0) 602 : audit [DBG] from='mgr.? 172.21.15.33:0/3781539096' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:39:39.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:39 smithi033 conmon[31996]: cluster 2022-02-02T13:39:38.467361+0000 mgr.smithi037.npteou (mgr.24381) 8 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:39.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:39 smithi033 conmon[31996]: cluster 2022-02-02T13:39:38.605716+0000 mon.smithi033 (mon.0) 603 : cluster [DBG] mgrmap e23: smithi037.npteou(active, since 4s), standbys: smithi033.xvkvzp 2022-02-02T13:39:40.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:39 smithi037 conmon[35544]: cluster 2022-02-02T13:39:38.467361+0000 2022-02-02T13:39:40.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:39 smithi037 conmon[35544]: mgr.smithi037.npteou (mgr.24381) 8 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:40.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:39 smithi037 conmon[35544]: cluster 2022-02-02T13:39:38.605716+0000 mon.smithi033 (mon.0) 603 : cluster [DBG] mgrmap e23: smithi037.npteou(active, since 4s), standbys: smithi033.xvkvzp 2022-02-02T13:39:41.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:41 smithi033 conmon[31996]: audit 2022-02-02T13:39:40.459680+0000 mon.smithi033 (mon 2022-02-02T13:39:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:41 smithi033 conmon[31996]: .0) 604 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:41.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:41 smithi033 conmon[31996]: cluster 2022-02-02T13:39:40.467719+0000 mgr.smithi037.npteou (mgr.24381) 9 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:39:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: 39:40.459680+0000 mon.smithi033 (mon.0) 604 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: cluster 2022-02-02T13:39 2022-02-02T13:39:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: :40.467719+0000 mgr.smithi037.npteou (mgr 2022-02-02T13:39:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: .24381) 9 : cluster [DBG] 2022-02-02T13:39:41.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:41 smithi037 conmon[35544]: pgmap v8: 65 pgs: 65 active+clean; 220 MiB data, 877 MiB used, 536 GiB / 536 GiB avail 2022-02-02T13:39:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- 172.21.15.33:0/411638128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 msgr2=0x7f6ee40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 --2- 172.21.15.33:0/411638128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee40f6b00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f6ee00045a0 tx=0x7f6ee0009b30).stop 2022-02-02T13:39:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- 172.21.15.33:0/411638128 shutdown_connections 2022-02-02T13:39:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 --2- 172.21.15.33:0/411638128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ee40f7980 0x7f6ee40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 --2- 172.21.15.33:0/411638128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee40f6b00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- 172.21.15.33:0/411638128 >> 172.21.15.33:0/411638128 conn(0x7f6ee40f1e40 msgr2=0x7f6ee40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- 172.21.15.33:0/411638128 shutdown_connections 2022-02-02T13:39:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- 172.21.15.33:0/411638128 wait complete. 2022-02-02T13:39:42.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 Processor -- start 2022-02-02T13:39:42.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 -- start start 2022-02-02T13:39:42.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.388+0000 7f6eeb440700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:42.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6eeb440700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ee40f7980 0x7f6ee4107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:42.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6eeb440700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee41079d0 con 0x7f6ee40f7980 2022-02-02T13:39:42.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6eeb440700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee4107b10 con 0x7f6ee40f66e0 2022-02-02T13:39:42.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:42.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39296/0 (socket says 172.21.15.33:39296) 2022-02-02T13:39:42.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 -- 172.21.15.33:0/2406259 learned_addr learned my addr 172.21.15.33:0/2406259 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:42.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 -- 172.21.15.33:0/2406259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ee40f7980 msgr2=0x7f6ee4107420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:39:42.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ee40f7980 0x7f6ee4107420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:39:42.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 -- 172.21.15.33:0/2406259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0005040 con 0x7f6ee40f66e0 2022-02-02T13:39:42.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ee91dc700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6ee0000c00 tx=0x7f6ee000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:42.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee000e070 con 0x7f6ee40f66e0 2022-02-02T13:39:42.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.389+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ee0007ba0 con 0x7f6ee40f66e0 2022-02-02T13:39:42.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.390+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee4108450 con 0x7f6ee40f66e0 2022-02-02T13:39:42.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.390+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee0019070 con 0x7f6ee40f66e0 2022-02-02T13:39:42.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.390+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee4108930 con 0x7f6ee40f66e0 2022-02-02T13:39:42.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.391+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 77539+0+0 (secure 0 0 0) 0x7f6ee0025070 con 0x7f6ee40f66e0 2022-02-02T13:39:42.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.391+0000 7f6ed9ffb700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 0x7f6ec8062d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:42.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.391+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee4045ad0 con 0x7f6ee40f66e0 2022-02-02T13:39:42.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.392+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f6ee007c880 con 0x7f6ee40f66e0 2022-02-02T13:39:42.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.392+0000 7f6ee89db700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 0x7f6ec8062d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:39:42.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.392+0000 7f6ee89db700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 0x7f6ec8062d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6ed4004ae0 tx=0x7f6ed400b040).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:42.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.397+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f6ee004e8c0 con 0x7f6ee40f66e0 2022-02-02T13:39:42.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.616+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 --> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ee4108ba0 con 0x7f6ec8060860 2022-02-02T13:39:42.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.618+0000 7f6ed9ffb700 1 -- 172.21.15.33:0/2406259 <== mgr.24381 v2:172.21.15.37:6828/2759415508 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f6ee4108ba0 con 0x7f6ec8060860 2022-02-02T13:39:42.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.619+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 msgr2=0x7f6ec8062d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:42.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.619+0000 7f6eeb440700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 0x7f6ec8062d20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f6ed4004ae0 tx=0x7f6ed400b040).stop 2022-02-02T13:39:42.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.619+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 msgr2=0x7f6ee4106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:42.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.619+0000 7f6eeb440700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f6ee0000c00 tx=0x7f6ee000b040).stop 2022-02-02T13:39:42.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 shutdown_connections 2022-02-02T13:39:42.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6ec8060860 0x7f6ec8062d20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ee40f66e0 0x7f6ee4106f30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 --2- 172.21.15.33:0/2406259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ee40f7980 0x7f6ee4107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:39:42.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 >> 172.21.15.33:0/2406259 conn(0x7f6ee40f1e40 msgr2=0x7f6ee40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:42.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 shutdown_connections 2022-02-02T13:39:42.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.620+0000 7f6eeb440700 1 -- 172.21.15.33:0/2406259 wait complete. 2022-02-02T13:39:42.630 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:39:42.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 -- 172.21.15.33:0/725144759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 msgr2=0x7f0a640f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:42.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 --2- 172.21.15.33:0/725144759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a640f7de0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f0a58004660 tx=0x7f0a58009b30).stop 2022-02-02T13:39:42.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 -- 172.21.15.33:0/725144759 shutdown_connections 2022-02-02T13:39:42.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 --2- 172.21.15.33:0/725144759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a640f7de0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 --2- 172.21.15.33:0/725144759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a640f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 -- 172.21.15.33:0/725144759 >> 172.21.15.33:0/725144759 conn(0x7f0a640f1e40 msgr2=0x7f0a640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:42.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 -- 172.21.15.33:0/725144759 shutdown_connections 2022-02-02T13:39:42.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.732+0000 7f0a6894c700 1 -- 172.21.15.33:0/725144759 wait complete. 2022-02-02T13:39:42.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 Processor -- start 2022-02-02T13:39:42.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 -- start start 2022-02-02T13:39:42.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:42.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:42.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6406a380 con 0x7f0a640f66e0 2022-02-02T13:39:42.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6894c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6406a4c0 con 0x7f0a640f7980 2022-02-02T13:39:42.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:42.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56820/0 (socket says 172.21.15.33:56820) 2022-02-02T13:39:42.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.733+0000 7f0a6259c700 1 -- 172.21.15.33:0/1564662577 learned_addr learned my addr 172.21.15.33:0/1564662577 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:42.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a61d9b700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:42.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a6259c700 1 -- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 msgr2=0x7f0a64069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a6259c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a64069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a6259c700 1 -- 172.21.15.33:0/1564662577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58005040 con 0x7f0a640f66e0 2022-02-02T13:39:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a61d9b700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a64069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:39:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:42.734+0000 7f0a6259c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0a5400e7c0 tx=0x7f0a5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.200+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a540092e0 con 0x7f0a640f66e0 2022-02-02T13:39:43.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.200+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6406a7a0 con 0x7f0a640f66e0 2022-02-02T13:39:43.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.201+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6410ef20 con 0x7f0a640f66e0 2022-02-02T13:39:43.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.201+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a5400f040 con 0x7f0a640f66e0 2022-02-02T13:39:43.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.201+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a54014750 con 0x7f0a640f66e0 2022-02-02T13:39:43.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.201+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a48004fa0 con 0x7f0a640f66e0 2022-02-02T13:39:43.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.202+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 77539+0+0 (secure 0 0 0) 0x7f0a5401b030 con 0x7f0a640f66e0 2022-02-02T13:39:43.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.203+0000 7f0a52ffd700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 0x7f0a4c062d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.203+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f0a5407bcd0 con 0x7f0a640f66e0 2022-02-02T13:39:43.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.203+0000 7f0a61d9b700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 0x7f0a4c062d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:39:43.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.204+0000 7f0a61d9b700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 0x7f0a4c062d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0a58005010 tx=0x7f0a58016040).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.208+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f0a5404a320 con 0x7f0a640f66e0 2022-02-02T13:39:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.389+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 --> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a48000b90 con 0x7f0a4c0608c0 2022-02-02T13:39:43.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.419+0000 7f0a52ffd700 1 -- 172.21.15.33:0/1564662577 <== mgr.24381 v2:172.21.15.37:6828/2759415508 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0a48000b90 con 0x7f0a4c0608c0 2022-02-02T13:39:43.420 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:39:43.420 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 1s ago 6m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:39:43.420 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 1s ago 5m 6995k - 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:39:43.420 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (5m) 13s ago 5m 7151k - 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:39:43.421 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (4m) 1s ago 5m 38.3M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:39:43.421 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (2m) 1s ago 2m 371M - 16.2.4 8d91d370c2b8 f8f3d0ec41ae 2022-02-02T13:39:43.421 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (2m) 1s ago 2m 14.0M - 16.2.4 8d91d370c2b8 acc3907c1697 2022-02-02T13:39:43.421 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (2m) 13s ago 2m 2110M - 16.2.4 8d91d370c2b8 6bc814c0ef0a 2022-02-02T13:39:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (2m) 13s ago 2m 13.8M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:39:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:9283 running (7m) 1s ago 7m 296M - 16.2.4 8d91d370c2b8 6ca660d1efdc 2022-02-02T13:39:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (18s) 13s ago 5m 39.1M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 6bb239af05fe 2022-02-02T13:39:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 1s ago 7m 89.4M 2048M 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:39:43.422 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (5m) 13s ago 5m 63.2M 2048M 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:39:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (5m) 1s ago 5m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:39:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (5m) 13s ago 5m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:39:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 1s ago 4m 302M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:39:43.423 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 1s ago 4m 320M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:39:43.424 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 1s ago 4m 262M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:39:43.424 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (3m) 13s ago 3m 261M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:39:43.424 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (3m) 13s ago 3m 213M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:39:43.424 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (3m) 13s ago 3m 253M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:39:43.424 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (4m) 1s ago 5m 35.2M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:39:43.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 msgr2=0x7f0a4c062d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 0x7f0a4c062d80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f0a58005010 tx=0x7f0a58016040).stop 2022-02-02T13:39:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 msgr2=0x7f0a6406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f0a5400e7c0 tx=0x7f0a5400b040).stop 2022-02-02T13:39:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 shutdown_connections 2022-02-02T13:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f0a4c0608c0 0x7f0a4c062d80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f66e0 0x7f0a6406b9a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 --2- 172.21.15.33:0/1564662577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f7980 0x7f0a64069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 >> 172.21.15.33:0/1564662577 conn(0x7f0a640f1e40 msgr2=0x7f0a640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 shutdown_connections 2022-02-02T13:39:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.421+0000 7f0a6894c700 1 -- 172.21.15.33:0/1564662577 wait complete. 2022-02-02T13:39:43.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 -- 172.21.15.33:0/3520570714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 msgr2=0x7f75c00f59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/3520570714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c00f59b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f75a8004660 tx=0x7f75a8009b30).stop 2022-02-02T13:39:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 -- 172.21.15.33:0/3520570714 shutdown_connections 2022-02-02T13:39:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/3520570714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c00f59b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/3520570714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 0x7f75c00f7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 -- 172.21.15.33:0/3520570714 >> 172.21.15.33:0/3520570714 conn(0x7f75c00f04c0 msgr2=0x7f75c00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 -- 172.21.15.33:0/3520570714 shutdown_connections 2022-02-02T13:39:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.521+0000 7f75c4e8c700 1 -- 172.21.15.33:0/3520570714 wait complete. 2022-02-02T13:39:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 Processor -- start 2022-02-02T13:39:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 -- start start 2022-02-02T13:39:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 0x7f75c0106fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0107a80 con 0x7f75c00f7590 2022-02-02T13:39:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75c4e8c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c0107bc0 con 0x7f75c00f6bf0 2022-02-02T13:39:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75bdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75bdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56832/0 (socket says 172.21.15.33:56832) 2022-02-02T13:39:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75bdd9b700 1 -- 172.21.15.33:0/1906304722 learned_addr learned my addr 172.21.15.33:0/1906304722 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.522+0000 7f75be59c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 0x7f75c0106fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75bdd9b700 1 -- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 msgr2=0x7f75c0106fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75bdd9b700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 0x7f75c0106fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75bdd9b700 1 -- 172.21.15.33:0/1906304722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8005040 con 0x7f75c00f7590 2022-02-02T13:39:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75bdd9b700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f75a8009990 tx=0x7f75a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a8018070 con 0x7f75c00f7590 2022-02-02T13:39:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c0108500 con 0x7f75c00f7590 2022-02-02T13:39:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c0108a60 con 0x7f75c00f7590 2022-02-02T13:39:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75a8007ba0 con 0x7f75c00f7590 2022-02-02T13:39:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.523+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a801dbc0 con 0x7f75c00f7590 2022-02-02T13:39:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.524+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c0045ad0 con 0x7f75c00f7590 2022-02-02T13:39:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.524+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 77539+0+0 (secure 0 0 0) 0x7f75a801d420 con 0x7f75c00f7590 2022-02-02T13:39:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.525+0000 7f75b6ffd700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 0x7f75ac062d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.525+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f75a807d550 con 0x7f75c00f7590 2022-02-02T13:39:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.525+0000 7f75be59c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 0x7f75ac062d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:39:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.525+0000 7f75be59c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 0x7f75ac062d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f75c005eb40 tx=0x7f75b000b040).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.529+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f75a804f5d0 con 0x7f75c00f7590 2022-02-02T13:39:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.771+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f75c01091b0 con 0x7f75c00f7590 2022-02-02T13:39:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.771+0000 7f75b6ffd700 1 -- 172.21.15.33:0/1906304722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+785 (secure 0 0 0) 0x7f75a804f1c0 con 0x7f75c00f7590 2022-02-02T13:39:43.772 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:39:43.773 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:39:43.773 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:39:43.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:43.773 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:39:43.774 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2022-02-02T13:39:43.774 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 1 2022-02-02T13:39:43.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:43.774 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:39:43.774 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:39:43.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:43.775 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:39:43.775 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:39:43.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:39:43.776 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:39:43.776 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13, 2022-02-02T13:39:43.776 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 1 2022-02-02T13:39:43.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:39:43.776 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:39:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 msgr2=0x7f75ac062d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 0x7f75ac062d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f75c005eb40 tx=0x7f75b000b040).stop 2022-02-02T13:39:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 msgr2=0x7f75c01074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f75a8009990 tx=0x7f75a8009b30).stop 2022-02-02T13:39:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 shutdown_connections 2022-02-02T13:39:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f75ac0608c0 0x7f75ac062d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c00f6bf0 0x7f75c0106fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 --2- 172.21.15.33:0/1906304722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c00f7590 0x7f75c01074d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 >> 172.21.15.33:0/1906304722 conn(0x7f75c00f04c0 msgr2=0x7f75c00f5080 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 shutdown_connections 2022-02-02T13:39:43.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.774+0000 7f75c4e8c700 1 -- 172.21.15.33:0/1906304722 wait complete. 2022-02-02T13:39:43.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 -- 172.21.15.33:0/473190377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 msgr2=0x7f06680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 --2- 172.21.15.33:0/473190377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f06680f7de0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f0654004660 tx=0x7f0654009b30).stop 2022-02-02T13:39:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 -- 172.21.15.33:0/473190377 shutdown_connections 2022-02-02T13:39:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 --2- 172.21.15.33:0/473190377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f06680f7de0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 --2- 172.21.15.33:0/473190377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f06680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 -- 172.21.15.33:0/473190377 >> 172.21.15.33:0/473190377 conn(0x7f06680f1e40 msgr2=0x7f06680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 -- 172.21.15.33:0/473190377 shutdown_connections 2022-02-02T13:39:43.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.876+0000 7f066f058700 1 -- 172.21.15.33:0/473190377 wait complete. 2022-02-02T13:39:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 Processor -- start 2022-02-02T13:39:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 -- start start 2022-02-02T13:39:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f0668106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668107a00 con 0x7f06680f7980 2022-02-02T13:39:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066f058700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0668107b40 con 0x7f06680f66e0 2022-02-02T13:39:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f0667fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:43.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f0667fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56842/0 (socket says 172.21.15.33:56842) 2022-02-02T13:39:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f0667fff700 1 -- 172.21.15.33:0/3107687846 learned_addr learned my addr 172.21.15.33:0/3107687846 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:39:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.877+0000 7f066cdf4700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f0668106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:39:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f0667fff700 1 -- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 msgr2=0x7f0668106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:43.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f0667fff700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f0668106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f0667fff700 1 -- 172.21.15.33:0/3107687846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654005040 con 0x7f06680f7980 2022-02-02T13:39:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f066cdf4700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f0668106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:39:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f0667fff700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0654009990 tx=0x7f0654009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0654018070 con 0x7f06680f7980 2022-02-02T13:39:43.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0654007ca0 con 0x7f06680f7980 2022-02-02T13:39:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0668108480 con 0x7f06680f7980 2022-02-02T13:39:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f065401c620 con 0x7f06680f7980 2022-02-02T13:39:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.878+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06681089e0 con 0x7f06680f7980 2022-02-02T13:39:43.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.879+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668045ad0 con 0x7f06680f7980 2022-02-02T13:39:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.880+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 77539+0+0 (secure 0 0 0) 0x7f065401d960 con 0x7f06680f7980 2022-02-02T13:39:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.880+0000 7f06657fa700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 0x7f0658062d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:39:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.880+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5515+0+0 (secure 0 0 0) 0x7f065407d7a0 con 0x7f06680f7980 2022-02-02T13:39:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.880+0000 7f066cdf4700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 0x7f0658062d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:39:43.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.880+0000 7f066cdf4700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 0x7f0658062d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06680f77e0 tx=0x7f065c009040).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:39:43.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:43.884+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f065404f8a0 con 0x7f06680f7980 2022-02-02T13:39:44.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.097+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0668027a00 con 0x7f06680f7980 2022-02-02T13:39:44.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.098+0000 7f06657fa700 1 -- 172.21.15.33:0/3107687846 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 13 v13) v1 ==== 76+0+1667 (secure 0 0 0) 0x7f065404f490 con 0x7f06680f7980 2022-02-02T13:39:44.099 INFO:teuthology.orchestra.run.smithi033.stdout:e13 2022-02-02T13:39:44.099 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:39:44.099 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:39:44.099 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:39:44.100 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:44.100 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:39:44.100 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:39:44.100 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 11 2022-02-02T13:39:44.100 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:39:44.101 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:39:44.101 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:37:39.197747+0000 2022-02-02T13:39:44.101 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:39:44.101 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:39:44.102 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:39:44.102 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:39:44.102 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:39:44.102 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:39:44.103 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:39:44.103 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2022-02-02T13:39:44.103 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:39:44.103 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:39:44.103 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:39:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24277} 2022-02-02T13:39:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:39:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:39:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:39:44.104 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:39:44.105 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:39:44.105 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:39:44.105 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:39:44.105 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:39:44.105 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{0:24277} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.37:6824/3022495435,v1:172.21.15.37:6825/3022495435]] 2022-02-02T13:39:44.106 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:14456} state up:standby-replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153]] 2022-02-02T13:39:44.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:44.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:44.106 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:39:44.106 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:39:44.107 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14468} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:39:44.107 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:39:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.099+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 msgr2=0x7f0658062d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.099+0000 7f066f058700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 0x7f0658062d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f06680f77e0 tx=0x7f065c009040).stop 2022-02-02T13:39:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.099+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 msgr2=0x7f0668107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:39:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.099+0000 7f066f058700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f0654009990 tx=0x7f0654009b30).stop 2022-02-02T13:39:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 shutdown_connections 2022-02-02T13:39:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f06580608c0 0x7f0658062d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06680f66e0 0x7f0668106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 --2- 172.21.15.33:0/3107687846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06680f7980 0x7f0668107450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:39:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 >> 172.21.15.33:0/3107687846 conn(0x7f06680f1e40 msgr2=0x7f06680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:39:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 shutdown_connections 2022-02-02T13:39:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:39:44.100+0000 7f066f058700 1 -- 172.21.15.33:0/3107687846 wait complete. 2022-02-02T13:39:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2022-02-02T13:39:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:42.237087+0000 mon.smithi033 (mon.0) 605 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:42.283991+0000 mon.smithi033 (mon.0) 606 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T13:39:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:42.284249+0000 mon.smithi037 (mon.1) 43 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:42.284424+0000 mon.smithi037 (mon.1) 44 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: cluster 2022-02-02T13:39:42.468243+0000 mgr.smithi037.npteou (mgr.24381) 10 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 235 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 48 op/s 2022-02-02T13:39:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:42.618178+0000 mgr.smithi037.npteou (mgr.24381) 11 : audit [DBG] from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:44 smithi033 conmon[31996]: audit 2022-02-02T13:39:43.200508+0000 mon.smithi033 (mon.0) 607 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T13:39:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022-02-02T13:39:42.237087+0000 2022-02-02T13:39:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: mon.smithi033 (mon.0) 605 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022-02-02T13:39:42.283991+0000 mon.smithi033 (mon.0) 606 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T13:39:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022-02-02T13:39:42.284249+0000 mon.smithi037 (mon.1) 43 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:44.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022-02-02T13:39:42 2022-02-02T13:39:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: .284424+0000 mon.smithi037 (mon.1) 44 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: cluster 2022-02 2022-02-02T13:39:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: -02T13:39:42.468243+0000 mgr.smithi037.npteou (mgr.24381) 2022-02-02T13:39:44.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: 10 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 235 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 6.7 MiB/s wr, 48 op/s 2022-02-02T13:39:44.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:39:44.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: 02T13:39:42.618178+0000 mgr.smithi037.npteou 2022-02-02T13:39:44.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: (mgr.24381) 11 : audit [DBG] from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:44.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:39:44.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: 02-02T13:39:43.200508 2022-02-02T13:39:44.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:44 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 607 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T13:39:45.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:43.203123+0000 mon.smithi037 ( 2022-02-02T13:39:45.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T13:39:45.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:43.391096+0000 mgr.smithi037.npteou (mgr.24381) 12 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:45.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:43.772455+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.33:0/1906304722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:39:45.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:44.098737+0000 mon.smithi033 (mon.0) 609 : audit [DBG] from='client.? 172.21.15.33:0/3107687846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:39:45.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:44.110489+0000 mon.smithi037 (mon.1) 46 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T13:39:45.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:44.111159+0000 mon.smithi037 ( 2022-02-02T13:39:45.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: mon.1) 47 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:45.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:44.111504+0000 mon.smithi037 (mon.1) 48 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:45.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: audit 2022-02-02T13:39:44.113675+0000 mon.smithi033 (mon.0) 610 : audit [INF] 2022-02-02T13:39:45.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:45.210 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: cluster 2022-02 2022-02-02T13:39:45.210 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: -02T13:39:44.468749+0000 mgr.smithi037.npteou (mgr.24381) 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 235 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 37 op/s 2022-02-02T13:39:45.210 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:45 smithi033 conmon[31996]: 2022-02-02T13:39:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13:39:43.203123+0000 mon.smithi037 (mon.1) 45 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2022-02-02T13:39:45.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13:39:43.391096+0000 mgr.smithi037.npteou (mgr.24381) 12 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:39:45.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:39:45.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 39:43.772455+0000 mon.smithi033 (mon.0) 608 : audit [DBG] from='client.? 172.21.15.33:0/1906304722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:39:45.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13:39:45.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 2022-02-02T13:39:44.098737+0000 mon.smithi033 (mon. 2022-02-02T13:39:45.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 0) 609 : audit [DBG] from='client.? 172.21.15.33:0/3107687846' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:39:45.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:39:45.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 39:44.110489+0000 mon.smithi037 (mon.1) 46 : audit [INF] 2022-02-02T13:39:45.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2022-02-02T13:39:45.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13:39:45.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 2022-02-02T13:39:44.111159+0000 mon.smithi037 (mon.1) 2022-02-02T13:39:45.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 47 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:39:45.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T13:39:44.111504 2022-02-02T13:39:45.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: +0000 mon.smithi037 (mon.1) 48 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:39:45.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:39:45.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 13:39:44.113675+0000 mon.smithi033 (mon.0) 610 2022-02-02T13:39:45.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:45.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: cluster 2022-02-02T13:39: 2022-02-02T13:39:45.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 44.468749+0000 mgr.smithi037.npteou (mgr.24381) 13 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 235 MiB data, 981 MiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 37 op/s 2022-02-02T13:39:45.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:45 smithi037 conmon[35544]: 2022-02-02T13:39:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: cluster 2022-02-02T13:39:46.469267+0000 mgr.smithi037.npteou ( 2022-02-02T13:39:47.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: mgr.24381) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 37 op/s 2022-02-02T13:39:47.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: audit 2022-02-02T13:39 2022-02-02T13:39:47.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: :47.209726+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:47.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:39:47.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: :39:47.213888+0000 mon.smithi037 (mon.1) 49 2022-02-02T13:39:47.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:39:47.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: audit 2022 2022-02-02T13:39:47.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: -02-02T13:39:47.214388+0000 mon.smithi033 (mon 2022-02-02T13:39:47.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:47 smithi037 conmon[35544]: .0) 612 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:39:47.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:47 smithi033 conmon[31996]: cluster 2022-02-02T13:39:46.469267+0000 mgr.smithi037.npteou (mgr.24381) 14 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 4.7 MiB/s wr, 37 op/s 2022-02-02T13:39:47.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:47 smithi033 conmon[31996]: audit 2022-02-02T13:39:47.209726+0000 mon.smithi033 (mon.0) 611 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:47.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:47 smithi033 conmon[31996]: audit 2022-02-02T13:39:47.213888+0000 mon.smithi037 (mon.1) 49 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:39:47.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:47 smithi033 conmon[31996]: audit 2022-02-02T13:39:47.214388+0000 mon.smithi033 (mon.0) 612 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:39:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:49 smithi037 conmon[35544]: cluster 2022-02-02T13:39:48.469681+0000 2022-02-02T13:39:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:49 smithi037 conmon[35544]: mgr.smithi037.npteou (mgr.24381) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 31 op/s 2022-02-02T13:39:49.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:49 smithi033 conmon[31996]: cluster 2022-02-02T13:39:48.469681+0000 mgr.smithi037.npteou (mgr.24381 2022-02-02T13:39:49.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:49 smithi033 conmon[31996]: ) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 31 op/s 2022-02-02T13:39:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:51 smithi037 conmon[35544]: cluster 2022-02-02T13:39:50.470126+0000 mgr.smithi037.npteou (mgr.24381) 16 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 31 op/s 2022-02-02T13:39:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:51 smithi033 conmon[31996]: cluster 2022-02-02T13:39:50.470126+0000 mgr.smithi037.npteou (mgr. 2022-02-02T13:39:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:51 smithi033 conmon[31996]: 24381) 16 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.9 MiB/s wr, 31 op/s 2022-02-02T13:39:52.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: cluster 2022-02-02T13:39:51.863353+0000 mon.smithi033 (mon.0) 613 : cluster [WRN] Replacing daemon mds.cephfs.smithi037.lqirod as rank 0 with standby daemon mds.cephfs.smithi033.cdqmmc 2022-02-02T13:39:52.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: cluster 2022-02-02T13:39:51.863455+0000 mon.smithi033 (mon.0) 614 : cluster [INF] MDS daemon mds.cephfs.smithi037.lqirod is removed because it is dead or otherwise unavailable. 2022-02-02T13:39:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: cluster 2022-02-02T13:39:51.864080+0000 mon.smithi033 (mon.0 2022-02-02T13:39:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: ) 615 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:39:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: cluster 2022-02-02T13:39:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: 2022-02-02T13:39: 2022-02-02T13:39:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: 51.869020+0000 mon.smithi033 (mon.0) 616 : cluster 2022-02-02T13:39:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: [DBG] osdmap e47: 6 total, 6 up, 6 in 2022-02-02T13:39:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: cluster 2022-02-02T 2022-02-02T13:39:52.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:52 smithi037 conmon[35544]: 13:39:51.873136+0000 mon.smithi033 (mon.0) 617 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 2 up:standby 2022-02-02T13:39:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: cluster 2022-02-02T13:39:51.863353+0000 mon.smithi033 (mon.0) 613 2022-02-02T13:39:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: : cluster [WRN] Replacing daemon mds.cephfs.smithi037.lqirod as rank 0 with standby daemon mds.cephfs.smithi033.cdqmmc 2022-02-02T13:39:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: cluster 2022-02-02T13:39:51.863455+0000 mon.smithi033 ( 2022-02-02T13:39:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: mon.0) 614 : cluster [INF] MDS daemon mds.cephfs.smithi037.lqirod is removed because it is dead or otherwise unavailable. 2022-02-02T13:39:52.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:39:52.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: -02-02T13:39:51.864080+0000 2022-02-02T13:39:52.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: mon.smithi033 (mon.0) 615 : cluster 2022-02-02T13:39:52.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:39:52.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:39:52.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: -02-02T13:39: 2022-02-02T13:39:52.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: 51.869020+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:52.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: 616 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2022-02-02T13:39:52.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: cluster 2022-02-02T13:39:52.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: 2022-02-02T13:39:51. 2022-02-02T13:39:52.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:52 smithi033 conmon[31996]: 873136+0000 mon.smithi033 (mon.0) 617 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 2 up:standby 2022-02-02T13:39:53.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:53 smithi037 conmon[35544]: cluster 2022-02-02T13:39:52.470668+0000 mgr.smithi037.npteou (mgr 2022-02-02T13:39:53.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:53 smithi037 conmon[35544]: .24381) 17 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 26 KiB/s wr, 6 op/s 2022-02-02T13:39:53.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:53 smithi033 conmon[31996]: cluster 2022-02-02T13:39:52.470668+0000 mgr.smithi037.npteou (mgr.24381) 17 : 2022-02-02T13:39:53.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:53 smithi033 conmon[31996]: cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 26 KiB/s wr, 6 op/s 2022-02-02T13:39:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:54 smithi033 conmon[31996]: cluster 2022-02-02T13:39:53.540999+0000 mon.smithi033 (mon 2022-02-02T13:39:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:54 smithi033 conmon[31996]: .0) 618 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:reconnect 2022-02-02T13:39:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:54 smithi033 conmon[31996]: cluster 2022-02-02T13:39:53.541070+0000 mon.smithi033 (mon.0) 619 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 2 up:standby 2022-02-02T13:39:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:54 smithi037 conmon[35544]: cluster 2022-02-02T13:39:53.540999+0000 2022-02-02T13:39:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:54 smithi037 conmon[35544]: mon.smithi033 (mon.0) 618 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:reconnect 2022-02-02T13:39:55.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:54 smithi037 conmon[35544]: cluster 2022-02-02T13:39:53.541070+0000 mon.smithi033 (mon.0) 619 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 2 up:standby 2022-02-02T13:39:55.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:55 smithi033 conmon[31996]: cluster 2022-02-02T13:39:54.471050+0000 mgr.smithi037.npteou (mgr.24381) 18 : cluster [DBG] 2022-02-02T13:39:55.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:55 smithi033 conmon[31996]: pgmap v16: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 26 KiB/s wr, 6 op/s 2022-02-02T13:39:55.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:55 smithi033 conmon[31996]: cluster 2022-02-02T13:39:54.544515+0000 mon.smithi033 (mon.0) 620 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:rejoin 2022-02-02T13:39:55.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:55 smithi033 conmon[31996]: cluster 2022-02-02T13:39:54.544554+0000 2022-02-02T13:39:55.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:55 smithi033 conmon[31996]: mon.smithi033 (mon.0) 621 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 2 up:standby 2022-02-02T13:39:56.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: cluster 2022-02-02T13:39:54.471050 2022-02-02T13:39:56.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: +0000 mgr.smithi037.npteou (mgr.24381) 18 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 26 KiB/s wr, 6 op/s 2022-02-02T13:39:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: cluster 2022-02-02T13:39:54.544515 2022-02-02T13:39:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 620 : cluster [DBG] mds.? [v2:172.21.15.33:6826/215947153,v1:172.21.15.33:6827/215947153] up:rejoin 2022-02-02T13:39:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: cluster 2022-02-02T13:39:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: 2022-02-02T13:39:54.544554+0000 mon.smithi033 (mon.0) 2022-02-02T13:39:56.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:55 smithi037 conmon[35544]: 621 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 2 up:standby 2022-02-02T13:39:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:57 smithi037 conmon[35544]: audit 2022-02-02T13:39:56.367766+0000 mon.smithi033 (mon.0) 622 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:57.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:57 smithi037 conmon[35544]: cluster 2022-02-02T13:39:56.471576+0000 mgr.smithi037.npteou (mgr.24381) 19 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:39:57.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:57 smithi037 conmon[35544]: audit 2022-02-02T13:39:57.181743+0000 mon.smithi033 (mon.0) 623 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:57.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:57 smithi033 conmon[31996]: audit 2022-02-02T13:39:56.367766+0000 mon.smithi033 (mon.0 2022-02-02T13:39:57.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:57 smithi033 conmon[31996]: ) 622 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:57.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:57 smithi033 conmon[31996]: cluster 2022-02-02T13:39:56.471576+0000 mgr.smithi037.npteou (mgr.24381) 19 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:39:57.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:57 smithi033 conmon[31996]: audit 2022-02-02T13:39:57.181743+0000 mon.smithi033 (mon.0) 623 2022-02-02T13:39:57.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:57 smithi033 conmon[31996]: : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:39:59.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: cluster 2022-02-02T13:39:58.183363+0000 mon.smithi033 (mon.0) 624 : 2022-02-02T13:39:59.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: cluster [DBG] mds.? [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] up:boot 2022-02-02T13:39:59.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: cluster 2022-02-02T13:39:58.183417+0000 mon.smithi033 (mon.0) 625 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:39:59.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: audit 2022-02-02T13:39:58.183690+0000 mon.smithi037 (mon.1) 50 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:39:59.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: cluster 2022-02-02T13:39:59.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: 2022-02-02T13:39:58.472090+0000 mgr.smithi037.npteou (mgr.24381) 2022-02-02T13:39:59.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:39:59 smithi033 conmon[31996]: 20 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:39:59.507 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:59 smithi037 conmon[35544]: cluster 2022-02-02T13:39:58.183363+0000 mon.smithi033 (mon.0) 624 : 2022-02-02T13:39:59.508 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:59 smithi037 conmon[35544]: cluster [DBG] mds.? [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] up:boot 2022-02-02T13:39:59.508 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:59 smithi037 conmon[35544]: cluster 2022-02-02T13:39:58.183417+0000 mon.smithi033 (mon.0) 625 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:39:59.509 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:59 smithi037 conmon[35544]: audit 2022-02-02T13:39:58.183690+0000 mon.smithi037 (mon.1) 50 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:39:59.509 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:39:59 smithi037 conmon[35544]: cluster 2022-02-02T13:39:58.472090+0000 mgr.smithi037.npteou (mgr.24381) 20 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:40:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.967275+0000 mon.smithi033 (mon.0) 626 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.968802+0000 mon.smithi037 (mon.1) 51 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.969319+0000 mon.smithi033 (mon.0) 627 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.975880+0000 mon.smithi033 (mon.0) 628 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.982776+0000 mon.smithi033 (mon.0) 629 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:39:59.991303+0000 mon.smithi033 (mon.0) 630 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:40:01.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: 13:39:59.997817+0000 mon.smithi033 (mon.0) 631 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.000115+0000 mon.smithi033 (mon.0) 632 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.000139+0000 mon.smithi033 (mon.0) 633 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:40:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.000170+0000 mon.smithi033 (mon.0) 634 : cluster [WRN] fs cephfs is degraded 2022-02-02T13:40:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.000188+0000 mon.smithi033 (mon.0) 635 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.000203+0000 mon.smithi033 (mon.0) 636 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:40:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:40:00.006776+0000 mon.smithi033 (mon.0) 637 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:40:00.015375+0000 mon.smithi037 (mon.1) 52 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: audit 2022-02-02T13:40:00.023085+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:00.024117+0000 mgr.smithi037.npteou (mgr.24381) 21 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:40:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:00 smithi033 conmon[31996]: cluster 2022-02-02T13:40:00.472456+0000 mgr.smithi037.npteou (mgr.24381) 22 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:40:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.967275+0000 mon.smithi033 (mon.0) 626 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.968802+0000 mon.smithi037 (mon.1) 51 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.969319+0000 mon.smithi033 (mon.0) 627 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.975880+0000 mon.smithi033 (mon.0) 628 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.982776+0000 mon.smithi033 (mon.0) 629 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.991303+0000 mon.smithi033 (mon.0) 630 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:39:59.997817+0000 mon.smithi033 (mon.0) 631 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:00.000115+0000 mon.smithi033 (mon.0) 632 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:00. 2022-02-02T13:40:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: 000139+0000 mon.smithi033 (mon.0) 633 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:40:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:00.000170+0000 mon.smithi033 (mon.0) 634 : cluster [WRN] fs cephfs is degraded 2022-02-02T13:40:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:00.000188+0000 mon.smithi033 (mon.0) 635 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:00.000203+0000 mon.smithi033 (mon.0) 636 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:40:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:40:00.006776+0000 mon.smithi033 (mon.0) 637 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:40:00.015375+0000 mon.smithi037 (mon.1) 52 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: audit 2022-02-02T13:40:00.023085+0000 mon.smithi033 (mon.0) 638 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:00.024117+0000 mgr.smithi037.npteou (mgr.24381) 21 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:40:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:40:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: 02-02T13:40:00.472456 2022-02-02T13:40:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: +0000 mgr.smithi037.npteou (mgr.24381) 22 : cluster 2022-02-02T13:40:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:00 smithi037 conmon[35544]: [DBG] pgmap v19: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 83 KiB/s rd, 5 op/s 2022-02-02T13:40:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:01.775961+0000 mgr.smithi037.npteou (mgr.24381) 23 : cephadm [INF] Upgrade: Updating mgr.smithi033.xvkvzp 2022-02-02T13:40:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: audit 2022-02-02T13:40:01.781072+0000 mon.smithi033 (mon.0) 639 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: audit 2022-02-02T13:40:01.783106+0000 mon.smithi037 (mon.1) 53 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: audit 2022-02-02T13:40:01.783703+0000 mon.smithi033 (mon.0) 640 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: audit 2022-02-02T13:40:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: 2022-02-02T13:40:01.784943+0000 mon.smithi037 (mon.1) 54 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:40:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: 02-02T13:40:01.786058 2022-02-02T13:40:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: +0000 mon.smithi037 (mon.1) 55 : audit 2022-02-02T13:40:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: cephadm 2022-02-02T13 2022-02-02T13:40:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: :40:01.787266+0000 mgr.smithi037.npteou (mgr 2022-02-02T13:40:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: .24381) 24 : cephadm [INF] Deploying daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:40:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: cluster 2022-02 2022-02-02T13:40:03.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: -02T13:40:02.025297+0000 2022-02-02T13:40:03.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: mon.smithi033 (mon.0) 641 : cluster [DBG] 2022-02-02T13:40:03.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: mds.? [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] up:standby 2022-02-02T13:40:03.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: cluster 2022-02-02T13:40:02 2022-02-02T13:40:03.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: .025349+0000 mon.smithi033 (mon.0) 642 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:40:03.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:40:03.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: 02T13:40:02.473226+0000 2022-02-02T13:40:03.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: mgr.smithi037.npteou (mgr.24381) 25 : cluster [DBG] 2022-02-02T13:40:03.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:02 smithi037 conmon[35544]: pgmap v20: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 77 KiB/s rd, 3 op/s 2022-02-02T13:40:03.121 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:01.775961+0000 mgr.smithi037.npteou (mgr.24381) 23 : cephadm [INF] Upgrade: Updating mgr.smithi033.xvkvzp 2022-02-02T13:40:03.121 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: audit 2022-02-02T13:40:01.781072+0000 mon.smithi033 (mon.0) 639 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:03.121 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: audit 2022-02-02T13:40:01.783106+0000 mon.smithi037 (mon.1) 53 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:03.122 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: audit 2022-02-02T13:40:01.783703+0000 mon.smithi033 (mon.0) 640 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:03.122 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: audit 2022-02-02T13:40:01.784943+0000 mon.smithi037 (mon.1) 54 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:40:03.122 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:03.122 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: 01.786058+0000 mon.smithi037 (mon.1) 55 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:03.123 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:01.787266+0000 mgr.smithi037.npteou (mgr.24381) 24 : cephadm [INF] Deploying daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:40:03.123 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: cluster 2022-02-02T13:40:02.025297+0000 mon.smithi033 (mon.0) 641 : cluster [DBG] mds.? [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] up:standby 2022-02-02T13:40:03.123 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: cluster 2022-02-02T13:40:02.025349+0000 mon.smithi033 (mon.0) 642 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:40:03.123 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:02 smithi033 conmon[31996]: cluster 2022-02-02T13:40:02.473226+0000 mgr.smithi037.npteou (mgr.24381) 25 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 77 KiB/s rd, 3 op/s 2022-02-02T13:40:05.513 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit 2022-02-02T13:40:04.445717+0000 mon.smithi033 (mon.0) 643 : 2022-02-02T13:40:05.513 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:05.514 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit 2022-02-02T13:40:04.447958+0000 mon.smithi037 (mon.1) 56 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:05.514 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit 2022-02-02T13:40:05.514 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 2022-02-02T13:40:04.449537+0000 mon.smithi037 (mon.1) 57 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:05.514 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:40:05.515 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 40:04.450554+0000 mon.smithi037 (mon.1) 58 : 2022-02-02T13:40:05.515 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:05.515 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: cephadm 2022-02-02T 2022-02-02T13:40:05.515 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 13:40:04.451419+0000 mgr.smithi037.npteou (mgr.24381) 2022-02-02T13:40:05.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 26 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:05.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: cluster 2022- 2022-02-02T13:40:05.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 02-02T13:40:04.473655+0000 mgr.smithi037.npteou ( 2022-02-02T13:40:05.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: mgr.24381) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 2 op/s 2022-02-02T13:40:05.516 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: audit 2022-02-02T13:40:05.517 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: 2022-02-02T13:40:04.639025+0000 mon.smithi033 2022-02-02T13:40:05.517 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:05 smithi033 conmon[31996]: (mon.0) 644 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: audit 2022-02-02T13:40:04.445717+0000 mon.smithi033 (mon.0) 643 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:05.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: audit 2022-02-02T13:40:04.447958+0000 mon.smithi037 (mon.1) 56 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:05.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: audit 2022-02-02T13:40:04.449537+0000 mon.smithi037 (mon.1) 57 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:05.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: 2022-02-02T13:40:05.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: audit 2022-02-02T13:40:04. 2022-02-02T13:40:05.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: 450554+0000 mon.smithi037 (mon.1) 58 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:05.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: 2022-02-02T13:40:05.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: cephadm 2022-02-02T13:40 2022-02-02T13:40:05.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: :04.451419+0000 mgr.smithi037.npteou (mgr.24381 2022-02-02T13:40:05.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: ) 26 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:05.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: cluster 2022-02 2022-02-02T13:40:05.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: -02T13:40:04.473655+0000 2022-02-02T13:40:05.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: mgr.smithi037.npteou (mgr.24381) 27 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 2 op/s 2022-02-02T13:40:05.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: 2022-02-02T13:40:05.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: audit 2022-02-02T13:40:05.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: 2022-02-02T13:40:04.639025+0000 2022-02-02T13:40:05.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: mon.smithi033 (mon.0) 644 : audit [INF] 2022-02-02T13:40:05.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:05 smithi037 conmon[35544]: from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:07 smithi037 conmon[35544]: cluster 2022-02-02T13:40:06.474392+0000 mgr.smithi037.npteou (mgr.24381) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2022-02-02T13:40:07.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:07 smithi033 conmon[31996]: cluster 2022-02-02T13:40:06.474392+0000 mgr.smithi037.npteou ( 2022-02-02T13:40:07.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:07 smithi033 conmon[31996]: mgr.24381) 28 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 68 KiB/s rd, 5.7 KiB/s wr, 3 op/s 2022-02-02T13:40:09.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: cluster 2022-02-02T 2022-02-02T13:40:09.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: 13:40:08.474830+0000 mgr.smithi037.npteou (mgr.24381) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s wr, 1 op/s 2022-02-02T13:40:09.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: cluster 2022-02-02T13:40:08.969287+0000 mon.smithi033 (mon 2022-02-02T13:40:09.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: .0) 645 : cluster [INF] daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:40:09.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:40:09.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: 02T13:40:08.973967+0000 mon.smithi033 (mon.0) 646 : cluster [DBG] 2022-02-02T13:40:09.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:09 smithi037 conmon[35544]: osdmap e48: 6 total, 6 up, 6 in 2022-02-02T13:40:09.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: debug 2022-02-02T13:40:09.528+0000 7f1ee1178700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:40:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: 40:08.474830+0000 mgr.smithi037.npteou (mgr.24381) 29 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s wr, 1 op/s 2022-02-02T13:40:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: cluster 2022- 2022-02-02T13:40:09.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: 02-02T13:40:08.969287+0000 mon.smithi033 (mon.0) 645 : cluster [INF] 2022-02-02T13:40:09.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:40:09.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: cluster 2022-02-02T 2022-02-02T13:40:09.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: 13:40:08.973967+0000 mon.smithi033 (mon 2022-02-02T13:40:09.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:09 smithi033 conmon[31996]: .0) 646 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2022-02-02T13:40:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40:09.529823+0000 mon.smithi033 (mon.0) 647 : cluster 2022-02-02T13:40:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:10.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40:09.533166+0000 mon.smithi033 (mon.0) 648 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:boot 2022-02-02T13:40:10.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40:09.533210+0000 mon.smithi033 (mon.0) 649 : cluster [INF] Standby daemon mds.cephfs.smithi033.kvxxkv assigned to filesystem cephfs as rank 0 2022-02-02T13:40:10.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40:09.533303+0000 mon.smithi033 (mon.0) 650 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:40:10.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40:09.533532+0000 mon.smithi033 (mon.0) 651 : cluster [DBG] 2022-02-02T13:40:10.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:40:10.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:40:10.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: T13:40:09.534816+0000 mon.smithi037 (mon.1) 59 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:40:10.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: cluster 2022-02-02T13:40: 2022-02-02T13:40:10.794 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:10 smithi037 conmon[35544]: 09.537808+0000 mon.smithi033 (mon.0) 652 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:replay} 3 up:standby 2022-02-02T13:40:10.850 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:09.529823+0000 mon.smithi033 (mon. 2022-02-02T13:40:10.850 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 0) 647 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:10.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:09 2022-02-02T13:40:10.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: .533166+0000 mon.smithi033 (mon.0) 648 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:boot 2022-02-02T13:40:10.852 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:09 2022-02-02T13:40:10.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: .533210+0000 mon.smithi033 (mon.0) 649 : cluster [INF] Standby daemon mds.cephfs.smithi033.kvxxkv assigned to filesystem cephfs as rank 0 2022-02-02T13:40:10.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 2022-02-02T13:40:10.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:10.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 2022-02-02T13:40:09.533303+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:10.853 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 650 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:40:10.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:10.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 2022-02-02T13:40:09.533532+0000 mon.smithi033 (mon. 2022-02-02T13:40:10.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 0) 651 : cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:40:10.854 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:10.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 09.534816+0000 mon.smithi037 (mon.1) 59 : audit 2022-02-02T13:40:10.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:40:10.855 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: cluster 2022-02-02T13:40:09.537808+0000 mon.smithi033 (mon. 2022-02-02T13:40:10.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:10 smithi033 conmon[31996]: 0) 652 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:replay} 3 up:standby 2022-02-02T13:40:11.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:11 smithi033 conmon[31996]: cluster 2022-02-02T13:40:10 2022-02-02T13:40:11.939 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:11 smithi033 conmon[31996]: .475465+0000 mgr.smithi037.npteou (mgr.24381) 30 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 6.8 KiB/s wr, 1 op/s 2022-02-02T13:40:12.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:11 smithi037 conmon[35544]: cluster 2022-02-02T13:40:10.475465+0000 mgr.smithi037.npteou (mgr.24381) 30 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 6.8 KiB/s wr, 1 op/s 2022-02-02T13:40:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02T13:40:11.881025 2022-02-02T13:40:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 653 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: cluster 2022-02-02T13:40:12.270995+0000 mon.smithi033 (mon.0) 654 : cluster [DBG] Standby manager daemon smithi033.xvkvzp restarted 2022-02-02T13:40:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: cluster 2022-02-02T13:40:12.271138+0000 mon.smithi033 (mon.0) 655 : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:40:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02T13:40:12.274489+0000 2022-02-02T13:40:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: mon.smithi033 (mon.0) 656 : audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/crt"}]: dispatch 2022-02-02T13:40:12.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:40:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: T13:40:12.275193+0000 mon.smithi033 (mon.0) 657 : audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: 2022-02-02T13:40:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02T13:40:12.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: 2022-02-02T13:40:12 2022-02-02T13:40:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: .277630+0000 mon.smithi033 (mon.0) 658 : audit 2022-02-02T13:40:12.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/key"}]: dispatch 2022-02-02T13:40:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:40:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: 13:40:12.279027+0000 mon.smithi033 (mon.0 2022-02-02T13:40:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: ) 659 : audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:12.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:40:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: 40:12.476085+0000 mgr.smithi037.npteou (mgr.24381) 31 : 2022-02-02T13:40:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 6.8 KiB/s wr, 5 op/s 2022-02-02T13:40:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:40:12.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: 40:12.752364+0000 mon.smithi033 (mon.0) 660 2022-02-02T13:40:13.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:12 smithi033 conmon[31996]: : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:13.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022-02-02T13:40:11.881025+0000 mon.smithi033 (mon.0) 653 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:13.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: cluster 2022-02-02T13:40:12.270995+0000 mon.smithi033 (mon.0) 654 : cluster [DBG] Standby manager daemon smithi033.xvkvzp restarted 2022-02-02T13:40:13.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:40:13.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: -02-02T13:40:12.271138+0000 mon.smithi033 ( 2022-02-02T13:40:13.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: mon.0) 655 : cluster [DBG] Standby manager daemon smithi033.xvkvzp started 2022-02-02T13:40:13.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:40:13.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: :40:12.274489+0000 mon.smithi033 (mon. 2022-02-02T13:40:13.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 0) 656 : audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/crt"}]: dispatch 2022-02-02T13:40:13.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:13.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 02-02T13:40:12.275193 2022-02-02T13:40:13.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 657 : audit 2022-02-02T13:40:13.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:13.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:40:13.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 02T13:40:12. 2022-02-02T13:40:13.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 277630+0000 mon.smithi033 (mon.0) 658 : 2022-02-02T13:40:13.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi033.xvkvzp/key"}]: dispatch 2022-02-02T13:40:13.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:13.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 02-02T13:40:12 2022-02-02T13:40:13.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: .279027+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:13.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 659 : audit [DBG] from='mgr.? 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:13.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:40:13.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 02-02T13:40:12. 2022-02-02T13:40:13.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 476085+0000 mgr.smithi037.npteou (mgr.24381) 31 : cluster 2022-02-02T13:40:13.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: [DBG] pgmap v26: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 6.8 KiB/s wr, 5 op/s 2022-02-02T13:40:13.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: audit 2022 2022-02-02T13:40:13.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: -02-02T13:40: 2022-02-02T13:40:13.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: 12.752364+0000 mon.smithi033 (mon.0 2022-02-02T13:40:13.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:12 smithi037 conmon[35544]: ) 660 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:13 smithi033 conmon[31996]: cluster 2022-02-02T13:40:12.891597+0000 mon.smithi033 (mon.0) 661 : cluster [DBG] mgrmap e24: smithi037.npteou(active, since 38s), standbys: smithi033.xvkvzp 2022-02-02T13:40:14.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.209+0000 7f1a495ef700 1 -- 172.21.15.33:0/3800230357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f6540 msgr2=0x7f1a440f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.209+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3800230357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f6540 0x7f1a440f6960 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f1a34004660 tx=0x7f1a34009b30).stop 2022-02-02T13:40:14.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 -- 172.21.15.33:0/3800230357 shutdown_connections 2022-02-02T13:40:14.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3800230357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f77e0 0x7f1a440f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3800230357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f6540 0x7f1a440f6960 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 -- 172.21.15.33:0/3800230357 >> 172.21.15.33:0/3800230357 conn(0x7f1a440f1ca0 msgr2=0x7f1a440f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:14.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 -- 172.21.15.33:0/3800230357 shutdown_connections 2022-02-02T13:40:14.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.210+0000 7f1a495ef700 1 -- 172.21.15.33:0/3800230357 wait complete. 2022-02-02T13:40:14.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 Processor -- start 2022-02-02T13:40:14.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 -- start start 2022-02-02T13:40:14.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f77e0 0x7f1a44069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4406a380 con 0x7f1a440f77e0 2022-02-02T13:40:14.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.211+0000 7f1a495ef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4406a4c0 con 0x7f1a440f6540 2022-02-02T13:40:14.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:14.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39394/0 (socket says 172.21.15.33:39394) 2022-02-02T13:40:14.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 -- 172.21.15.33:0/3505011504 learned_addr learned my addr 172.21.15.33:0/3505011504 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:14.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 -- 172.21.15.33:0/3505011504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f77e0 msgr2=0x7f1a44069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f77e0 0x7f1a44069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:14.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 -- 172.21.15.33:0/3505011504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34005040 con 0x7f1a440f6540 2022-02-02T13:40:14.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.212+0000 7f1a42ffd700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1a34013a70 tx=0x7f1a34009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:14.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.213+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a34018070 con 0x7f1a440f6540 2022-02-02T13:40:14.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.213+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1a340097d0 con 0x7f1a440f6540 2022-02-02T13:40:14.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.213+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4406a740 con 0x7f1a440f6540 2022-02-02T13:40:14.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.213+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a3401c3c0 con 0x7f1a440f6540 2022-02-02T13:40:14.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.213+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4406aca0 con 0x7f1a440f6540 2022-02-02T13:40:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.214+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a44045ad0 con 0x7f1a440f6540 2022-02-02T13:40:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.215+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f1a34007ba0 con 0x7f1a440f6540 2022-02-02T13:40:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.215+0000 7f1a2b7fe700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 0x7f1a2c0672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.215+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f1a34083380 con 0x7f1a440f6540 2022-02-02T13:40:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.215+0000 7f1a427fc700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 0x7f1a2c0672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:14.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.216+0000 7f1a427fc700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 0x7f1a2c0672d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1a38004bd0 tx=0x7f1a38009b10).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:14.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.220+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f1a34051860 con 0x7f1a440f6540 2022-02-02T13:40:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:13 smithi037 conmon[35544]: cluster 2022-02-02T13:40:12.891597+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:13 smithi037 conmon[35544]: 661 : cluster [DBG] mgrmap e24: smithi037.npteou(active, since 38s), standbys: smithi033.xvkvzp 2022-02-02T13:40:14.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.478+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 --> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a440fee10 con 0x7f1a2c064e10 2022-02-02T13:40:14.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.480+0000 7f1a2b7fe700 1 -- 172.21.15.33:0/3505011504 <== mgr.24381 v2:172.21.15.37:6828/2759415508 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7f1a440fee10 con 0x7f1a2c064e10 2022-02-02T13:40:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.482+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 msgr2=0x7f1a2c0672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.482+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 0x7f1a2c0672d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1a38004bd0 tx=0x7f1a38009b10).stop 2022-02-02T13:40:14.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.482+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 msgr2=0x7f1a4406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.482+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1a34013a70 tx=0x7f1a34009b30).stop 2022-02-02T13:40:14.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 shutdown_connections 2022-02-02T13:40:14.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f1a2c064e10 0x7f1a2c0672d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a440f6540 0x7f1a4406b9a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 --2- 172.21.15.33:0/3505011504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a440f77e0 0x7f1a44069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:14.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 >> 172.21.15.33:0/3505011504 conn(0x7f1a440f1ca0 msgr2=0x7f1a440fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 shutdown_connections 2022-02-02T13:40:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.483+0000 7f1a495ef700 1 -- 172.21.15.33:0/3505011504 wait complete. 2022-02-02T13:40:14.494 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.589+0000 7f62b35b9700 1 -- 172.21.15.33:0/3738857171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 msgr2=0x7f62ac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.589+0000 7f62b35b9700 1 --2- 172.21.15.33:0/3738857171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac0f59e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f62a8004660 tx=0x7f62a8009b30).stop 2022-02-02T13:40:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 -- 172.21.15.33:0/3738857171 shutdown_connections 2022-02-02T13:40:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 --2- 172.21.15.33:0/3738857171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 0x7f62ac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 --2- 172.21.15.33:0/3738857171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac0f59e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 -- 172.21.15.33:0/3738857171 >> 172.21.15.33:0/3738857171 conn(0x7f62ac0f0d40 msgr2=0x7f62ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 -- 172.21.15.33:0/3738857171 shutdown_connections 2022-02-02T13:40:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 -- 172.21.15.33:0/3738857171 wait complete. 2022-02-02T13:40:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 Processor -- start 2022-02-02T13:40:14.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.590+0000 7f62b35b9700 1 -- start start 2022-02-02T13:40:14.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b35b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b35b9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 0x7f62ac106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b35b9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac106950 con 0x7f62ac0f55c0 2022-02-02T13:40:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b35b9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac107160 con 0x7f62ac0f6860 2022-02-02T13:40:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56918/0 (socket says 172.21.15.33:56918) 2022-02-02T13:40:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 -- 172.21.15.33:0/2518962993 learned_addr learned my addr 172.21.15.33:0/2518962993 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b0b54700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 0x7f62ac106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 -- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 msgr2=0x7f62ac106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 0x7f62ac106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 -- 172.21.15.33:0/2518962993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a8005040 con 0x7f62ac0f55c0 2022-02-02T13:40:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.591+0000 7f62b1355700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f62a8013a70 tx=0x7f62a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.592+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a8018070 con 0x7f62ac0f55c0 2022-02-02T13:40:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.592+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f62a80097d0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.592+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62a801de80 con 0x7f62ac0f55c0 2022-02-02T13:40:14.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.592+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ac107380 con 0x7f62ac0f55c0 2022-02-02T13:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.592+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac1078e0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.594+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac0f49b0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.594+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f62a8007ba0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.595+0000 7f62a1ffb700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 0x7f6298067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.595+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f62a80831c0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.595+0000 7f62b0b54700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 0x7f6298067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.596+0000 7f62b0b54700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 0x7f6298067280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f629c004ce0 tx=0x7f629c00b040).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.599+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f62a80516a0 con 0x7f62ac0f55c0 2022-02-02T13:40:14.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.861+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 --> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f62ac0fddf0 con 0x7f6298064dc0 2022-02-02T13:40:14.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.877+0000 7f62a1ffb700 1 -- 172.21.15.33:0/2518962993 <== mgr.24381 v2:172.21.15.37:6828/2759415508 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f62ac0fddf0 con 0x7f6298064dc0 2022-02-02T13:40:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:40:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (5m) 3s ago 6m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:40:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 2s ago 6m 6995k - 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:40:14.878 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (6m) 18s ago 6m 7151k - 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:40:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (5m) 2s ago 6m 38.5M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:40:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (10s) 2s ago 2m 11.2M - 16.2.4 8d91d370c2b8 2e88ed522d92 2022-02-02T13:40:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (2m) 2s ago 2m 14.1M - 16.2.4 8d91d370c2b8 acc3907c1697 2022-02-02T13:40:14.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (25s) 18s ago 2m - - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:40:14.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (2m) 18s ago 2m 14.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:40:14.880 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (10s) 3s ago 7m 55.8M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:40:14.880 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (49s) 18s ago 5m 452M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 6bb239af05fe 2022-02-02T13:40:14.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 3s ago 7m 94.2M 2048M 16.2.4 8d91d370c2b8 3b0c5dd3211a 2022-02-02T13:40:14.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (5m) 18s ago 5m 70.4M 2048M 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:40:14.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 2s ago 6m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:40:14.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (5m) 18s ago 5m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:40:14.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 2s ago 5m 308M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:40:14.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (4m) 2s ago 4m 331M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:40:14.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (4m) 2s ago 4m 263M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:40:14.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (4m) 18s ago 4m 341M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:40:14.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (4m) 18s ago 4m 275M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:40:14.883 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (3m) 18s ago 3m 314M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:40:14.883 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 2s ago 6m 35.9M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:40:14.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 msgr2=0x7f6298067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 0x7f6298067280 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f629c004ce0 tx=0x7f629c00b040).stop 2022-02-02T13:40:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 msgr2=0x7f62ac105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f62a8013a70 tx=0x7f62a8009b30).stop 2022-02-02T13:40:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 shutdown_connections 2022-02-02T13:40:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f6298064dc0 0x7f6298067280 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ac0f55c0 0x7f62ac105e60 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 --2- 172.21.15.33:0/2518962993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62ac0f6860 0x7f62ac106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 >> 172.21.15.33:0/2518962993 conn(0x7f62ac0f0d40 msgr2=0x7f62ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:14.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 shutdown_connections 2022-02-02T13:40:14.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.881+0000 7f62b35b9700 1 -- 172.21.15.33:0/2518962993 wait complete. 2022-02-02T13:40:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 -- 172.21.15.33:0/314566558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 msgr2=0x7f91f80f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/314566558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f80f8160 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f91e8004660 tx=0x7f91e8009b30).stop 2022-02-02T13:40:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 -- 172.21.15.33:0/314566558 shutdown_connections 2022-02-02T13:40:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/314566558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91f80f86e0 0x7f91f80f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/314566558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f80f8160 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 -- 172.21.15.33:0/314566558 >> 172.21.15.33:0/314566558 conn(0x7f91f80f04c0 msgr2=0x7f91f80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:15.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 -- 172.21.15.33:0/314566558 shutdown_connections 2022-02-02T13:40:15.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:14.999+0000 7f91fe1cd700 1 -- 172.21.15.33:0/314566558 wait complete. 2022-02-02T13:40:15.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 Processor -- start 2022-02-02T13:40:15.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 -- start start 2022-02-02T13:40:15.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91f80f86e0 0x7f91f81074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f8107b00 con 0x7f91f80f7d40 2022-02-02T13:40:15.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.000+0000 7f91fe1cd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f81083b0 con 0x7f91f80f86e0 2022-02-02T13:40:15.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:15.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56928/0 (socket says 172.21.15.33:56928) 2022-02-02T13:40:15.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 -- 172.21.15.33:0/3455139501 learned_addr learned my addr 172.21.15.33:0/3455139501 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:15.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 -- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91f80f86e0 msgr2=0x7f91f81074c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:40:15.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91f80f86e0 0x7f91f81074c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:15.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 -- 172.21.15.33:0/3455139501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e8005040 con 0x7f91f80f7d40 2022-02-02T13:40:15.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91f77fe700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f91e8004f60 tx=0x7f91e8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:15.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e8018070 con 0x7f91f80f7d40 2022-02-02T13:40:15.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f91e8007ba0 con 0x7f91f80f7d40 2022-02-02T13:40:15.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f8108630 con 0x7f91f80f7d40 2022-02-02T13:40:15.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91e801c620 con 0x7f91f80f7d40 2022-02-02T13:40:15.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.001+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f8108b10 con 0x7f91f80f7d40 2022-02-02T13:40:15.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.003+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f8045ad0 con 0x7f91f80f7d40 2022-02-02T13:40:15.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.004+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 82786+0+0 (secure 0 0 0) 0x7f91e801c8e0 con 0x7f91f80f7d40 2022-02-02T13:40:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.005+0000 7f91dffff700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 0x7f91e006b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.005+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f91e8083b50 con 0x7f91f80f7d40 2022-02-02T13:40:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.005+0000 7f91f6ffd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 0x7f91e006b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.006+0000 7f91f6ffd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 0x7f91e006b690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f91ec009500 tx=0x7f91ec006a30).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.009+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7f91e80559e0 con 0x7f91f80f7d40 2022-02-02T13:40:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:14 smithi033 conmon[31996]: cluster 2022-02-02T13:40:13 2022-02-02T13:40:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:14 smithi033 conmon[31996]: .889161+0000 mon.smithi033 (mon.0) 662 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:standby 2022-02-02T13:40:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:14 smithi033 conmon[31996]: cluster 2022-02-02T13:40:13.889249+0000 mon.smithi033 (mon.0) 663 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:replay} 3 up:standby 2022-02-02T13:40:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:14 smithi033 conmon[31996]: cluster 2022-02-02T13:40:14.476699+0000 mgr.smithi037.npteou (mgr.24381) 32 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 6.8 KiB/s wr, 5 op/s 2022-02-02T13:40:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:14 smithi033 conmon[31996]: audit 2022-02-02T13:40:14.480589+0000 mgr.smithi037.npteou (mgr.24381) 33 : audit [DBG] from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: cluster 2022-02-02T13:40:13.889161+0000 mon.smithi033 (mon. 2022-02-02T13:40:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: 0) 662 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:standby 2022-02-02T13:40:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: cluster 2022-02-02T13:40:13.889249+0000 mon.smithi033 (mon.0) 663 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:replay} 3 up:standby 2022-02-02T13:40:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: cluster 2022-02-02T13 2022-02-02T13:40:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: :40:14.476699+0000 mgr.smithi037.npteou (mgr.24381) 32 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 5.7 MiB/s rd, 6.8 KiB/s wr, 5 op/s 2022-02-02T13:40:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:40:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:14 smithi037 conmon[35544]: 40:14.480589+0000 mgr.smithi037.npteou (mgr.24381) 33 : audit [DBG] from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.300+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f91f80fef30 con 0x7f91f80f7d40 2022-02-02T13:40:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.300+0000 7f91dffff700 1 -- 172.21.15.33:0/3455139501 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+691 (secure 0 0 0) 0x7f91e80821b0 con 0x7f91f80f7d40 2022-02-02T13:40:15.301 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:40:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:40:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-02-02T13:40:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:15.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:40:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:40:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:40:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:40:15.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:40:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:40:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:40:15.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12, 2022-02-02T13:40:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:40:15.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:40:15.305 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:40:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 msgr2=0x7f91e006b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 0x7f91e006b690 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f91ec009500 tx=0x7f91ec006a30).stop 2022-02-02T13:40:15.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 msgr2=0x7f91f8106fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f91e8004f60 tx=0x7f91e8009b30).stop 2022-02-02T13:40:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 shutdown_connections 2022-02-02T13:40:15.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7f91e00691d0 0x7f91e006b690 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f80f7d40 0x7f91f8106fd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 --2- 172.21.15.33:0/3455139501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91f80f86e0 0x7f91f81074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:15.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 >> 172.21.15.33:0/3455139501 conn(0x7f91f80f04c0 msgr2=0x7f91f80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:15.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 shutdown_connections 2022-02-02T13:40:15.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.302+0000 7f91fe1cd700 1 -- 172.21.15.33:0/3455139501 wait complete. 2022-02-02T13:40:15.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 -- 172.21.15.33:0/545770246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 msgr2=0x7fce980f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 --2- 172.21.15.33:0/545770246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce980f6950 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fce94004660 tx=0x7fce94009b30).stop 2022-02-02T13:40:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 -- 172.21.15.33:0/545770246 shutdown_connections 2022-02-02T13:40:15.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 --2- 172.21.15.33:0/545770246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 0x7fce980f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 --2- 172.21.15.33:0/545770246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce980f6950 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 -- 172.21.15.33:0/545770246 >> 172.21.15.33:0/545770246 conn(0x7fce980f1c90 msgr2=0x7fce980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 -- 172.21.15.33:0/545770246 shutdown_connections 2022-02-02T13:40:15.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.405+0000 7fce9ec33700 1 -- 172.21.15.33:0/545770246 wait complete. 2022-02-02T13:40:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 Processor -- start 2022-02-02T13:40:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 -- start start 2022-02-02T13:40:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 0x7fce98107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98107880 con 0x7fce980f6530 2022-02-02T13:40:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9ec33700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce98108090 con 0x7fce980f77d0 2022-02-02T13:40:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9dc31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:15.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9dc31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56936/0 (socket says 172.21.15.33:56936) 2022-02-02T13:40:15.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9dc31700 1 -- 172.21.15.33:0/1755969940 learned_addr learned my addr 172.21.15.33:0/1755969940 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:15.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.406+0000 7fce9d430700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 0x7fce98107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:15.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9dc31700 1 -- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 msgr2=0x7fce98107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9dc31700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 0x7fce98107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9dc31700 1 -- 172.21.15.33:0/1755969940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce94005040 con 0x7fce980f6530 2022-02-02T13:40:15.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9dc31700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fce94013a70 tx=0x7fce94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:15.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce94018070 con 0x7fce980f6530 2022-02-02T13:40:15.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce981082b0 con 0x7fce980f6530 2022-02-02T13:40:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce940097d0 con 0x7fce980f6530 2022-02-02T13:40:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9401c3c0 con 0x7fce980f6530 2022-02-02T13:40:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.407+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce98108810 con 0x7fce980f6530 2022-02-02T13:40:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.408+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce98045ad0 con 0x7fce980f6530 2022-02-02T13:40:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.409+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 82786+0+0 (secure 0 0 0) 0x7fce94007ba0 con 0x7fce980f6530 2022-02-02T13:40:15.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.409+0000 7fce8e7fc700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 0x7fce840672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:15.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.409+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5687+0+0 (secure 0 0 0) 0x7fce94083390 con 0x7fce980f6530 2022-02-02T13:40:15.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.409+0000 7fce9d430700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 0x7fce840672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:15.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.410+0000 7fce9d430700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 0x7fce840672d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fce88009740 tx=0x7fce88009c60).ready entity=mgr.24381 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:15.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.414+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162860 (secure 0 0 0) 0x7fce94051930 con 0x7fce980f6530 2022-02-02T13:40:15.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.640+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fce980fecf0 con 0x7fce980f6530 2022-02-02T13:40:15.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.641+0000 7fce8e7fc700 1 -- 172.21.15.33:0/1755969940 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1660 (secure 0 0 0) 0x7fce94054f50 con 0x7fce980f6530 2022-02-02T13:40:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:e21 2022-02-02T13:40:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:40:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:15.642 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:40:15.643 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:40:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:40:15.643 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 20 2022-02-02T13:40:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 2022-02-02T13:40:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:40:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:40:09.533232+0000 2022-02-02T13:40:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:40:15.644 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:40:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:40:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:40:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:40:15.645 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:40:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:40:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 48 2022-02-02T13:40:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:40:15.646 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:40:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=14468} 2022-02-02T13:40:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:40:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:40:15.647 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:40:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:40:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:40:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:40:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:40:15.648 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:40:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{0:14468} state up:replay seq 3 join_fscid=1 addr [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573]] 2022-02-02T13:40:15.649 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:15.649 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:15.649 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:40:15.650 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:14630} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735]] 2022-02-02T13:40:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536]] 2022-02-02T13:40:15.650 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250]] 2022-02-02T13:40:15.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 msgr2=0x7fce840672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 0x7fce840672d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fce88009740 tx=0x7fce88009c60).stop 2022-02-02T13:40:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 msgr2=0x7fce98106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fce94013a70 tx=0x7fce94009b30).stop 2022-02-02T13:40:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 shutdown_connections 2022-02-02T13:40:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:6828/2759415508,v1:172.21.15.37:6829/2759415508] conn(0x7fce84064e10 0x7fce840672d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce980f6530 0x7fce98106d90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 --2- 172.21.15.33:0/1755969940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce980f77d0 0x7fce98107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:15.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 >> 172.21.15.33:0/1755969940 conn(0x7fce980f1c90 msgr2=0x7fce980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:15.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 shutdown_connections 2022-02-02T13:40:15.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:15.643+0000 7fce9ec33700 1 -- 172.21.15.33:0/1755969940 wait complete. 2022-02-02T13:40:15.654 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 21 2022-02-02T13:40:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:15 smithi033 conmon[31996]: audit 2022-02-02T13:40:14.863347+0000 mgr.smithi037.npteou (mgr.24381) 34 : audit [DBG] from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:15 smithi033 conmon[31996]: audit 2022-02-02T13:40:15.301379+0000 mon.smithi033 (mon.0) 664 : audit [DBG] from='client.? 172.21.15.33:0/3455139501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:40:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:15 smithi033 conmon[31996]: audit 2022-02-02T13:40:15.641656+0000 mon.smithi033 (mon.0) 665 : audit [DBG] from='client.? 172.21.15.33:0/1755969940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:40:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:15 smithi037 conmon[35544]: audit 2022-02-02T13:40:14.863347+0000 mgr.smithi037.npteou (mgr.24381) 34 : 2022-02-02T13:40:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:15 smithi037 conmon[35544]: audit [DBG] from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:15 smithi037 conmon[35544]: audit 2022-02-02T13:40:15.301379+0000 mon.smithi033 (mon.0) 664 : audit [DBG] from='client.? 172.21.15.33:0/3455139501' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:40:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:15 smithi037 conmon[35544]: audit 2022-02-02T13:40:15.641656+0000 mon.smithi033 (mon.0) 665 : audit [DBG] from='client.? 172.21.15.33:0/1755969940' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:40:17.202 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.901545+0000 mds.cephfs.smithi033.kvxxkv (mds. 2022-02-02T13:40:17.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 0) 1 : cluster [DBG] reconnect by client.14596 172.21.15.37:0/952314643 after 0.000999985 2022-02-02T13:40:17.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.901653+0000 mds.cephfs.smithi033.kvxxkv (mds.0) 2 : cluster [DBG] reconnect by client.14598 172.21.15.37:0/3955113344 after 0.000999985 2022-02-02T13:40:17.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.902157+0000 mon.smithi033 (mon.0) 666 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:reconnect 2022-02-02T13:40:17.203 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.902209+0000 mon.smithi033 (mon.0) 667 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:reconnect} 3 up:standby 2022-02-02T13:40:17.204 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.923794+0000 mds.cephfs.smithi033.kvxxkv ( 2022-02-02T13:40:17.204 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: mds.0) 3 : cluster [DBG] reconnect by client.24335 v1:192.168.0.1:0/3031626784 after 0.0229996 2022-02-02T13:40:17.204 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:15.951083+0000 mds.cephfs.smithi033.kvxxkv (mds.0) 4 : cluster [DBG] reconnect by client.24331 v1:172.21.15.33:0/123632270 after 0.0509992 2022-02-02T13:40:17.204 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit 2022-02-02T13:40:17.205 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 2022-02-02T13:40:16.087236+0000 mon.smithi033 (mon.0) 668 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:17.205 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit 2022-02-02T13:40:16.092219+0000 mon.smithi033 ( 2022-02-02T13:40:17.205 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: mon.0) 669 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:17.205 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit 2022-02-02T13:40:16.100078+0000 mon.smithi037 ( 2022-02-02T13:40:17.205 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: mon.1) 60 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:17.206 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:16.103112+0000 mgr.smithi037.npteou (mgr 2022-02-02T13:40:17.206 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: .24381) 35 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:40:17.206 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:17.206 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 2022-02-02T13:40:16.105810+0000 mgr.smithi037.npteou (mgr.24381) 36 : cephadm 2022-02-02T13:40:17.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: [INF] Failing over to other MGR 2022-02-02T13:40:17.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:17.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: :40:16.106081+0000 mon.smithi037 (mon.1) 61 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr fail", "who": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:17.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit 2022-02-02T13:40:16.106462+0000 mon.smithi033 (mon.0) 670 : 2022-02-02T13:40:17.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr fail", "who": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:17.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022- 2022-02-02T13:40:17.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 02-02T13:40:16.109626+0000 mon.smithi033 (mon.0) 671 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2022-02-02T13:40:17.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 2022-02-02T13:40:17.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:40:17.208 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: 40:16.477185+0000 mgr.smithi037.npteou (mgr.24381) 37 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5 op/s 2022-02-02T13:40:17.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: cluster 2022-02-02T13:40:16.586496+0000 mon.smithi033 2022-02-02T13:40:17.209 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:16 smithi033 conmon[31996]: (mon.0) 672 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:17.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15.901545+0000 mds.cephfs.smithi033.kvxxkv (mds.0) 1 : cluster [DBG] reconnect by client.14596 172.21.15.37:0/952314643 after 0.000999985 2022-02-02T13:40:17.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15.901653+0000 mds.cephfs.smithi033.kvxxkv (mds.0) 2 : cluster [DBG] reconnect by client.14598 172.21.15.37:0/3955113344 after 0.000999985 2022-02-02T13:40:17.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15.902157+0000 mon.smithi033 (mon.0) 666 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:reconnect 2022-02-02T13:40:17.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15.902209+0000 mon.smithi033 (mon.0) 667 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:reconnect} 3 up:standby 2022-02-02T13:40:17.256 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15. 2022-02-02T13:40:17.256 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 923794+0000 mds.cephfs.smithi033.kvxxkv (mds.0) 3 : cluster [DBG] reconnect by client.24335 v1:192.168.0.1:0/3031626784 after 0.0229996 2022-02-02T13:40:17.256 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13:40:15.951083+0000 2022-02-02T13:40:17.256 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: mds.cephfs.smithi033.kvxxkv (mds.0) 4 : cluster [DBG] reconnect by client.24331 v1:172.21.15.33:0/123632270 after 0.0509992 2022-02-02T13:40:17.256 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: audit 2022-02-02T13:40:16.087236+0000 mon.smithi033 2022-02-02T13:40:17.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: (mon.0) 668 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:17.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: audit 2022-02-02T13:40:16.092219 2022-02-02T13:40:17.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 669 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' 2022-02-02T13:40:17.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: audit 2022-02-02T13:40: 2022-02-02T13:40:17.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 16.100078+0000 mon.smithi037 (mon.1) 60 : audit [DBG] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:17.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 2022-02-02T13:40:17.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cephadm 2022-02-02T13 2022-02-02T13:40:17.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: :40:16.103112+0000 mgr.smithi037.npteou (mgr.24381) 35 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:40:17.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cephadm 2022-02-02T13:40: 2022-02-02T13:40:17.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 16.105810+0000 mgr.smithi037.npteou (mgr.24381) 36 : cephadm [INF] Failing over to other MGR 2022-02-02T13:40:17.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:40:17.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 13:40:16.106081+0000 mon.smithi037 (mon.1 2022-02-02T13:40:17.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: ) 61 : audit [INF] from='mgr.24381 172.21.15.37:0/464673792' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr fail", "who": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:17.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: audit 2022-02-02T13:40 2022-02-02T13:40:17.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: :16.106462+0000 mon.smithi033 (mon.0) 670 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd=[{"prefix": "mgr fail", "who": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:17.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 2022-02-02T13:40:17.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:40:17.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 40:16.109626+0000 mon.smithi033 (mon.0) 671 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2022-02-02T13:40:17.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022-02-02T13 2022-02-02T13:40:17.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: :40:16.477185+0000 mgr.smithi037.npteou (mgr.24381) 37 : cluster [DBG] 2022-02-02T13:40:17.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: pgmap v29: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail; 10 MiB/s rd, 5 op/s 2022-02-02T13:40:17.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: cluster 2022- 2022-02-02T13:40:17.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: 02-02T13:40:16.586496+0000 mon.smithi033 (mon.0) 672 : cluster [DBG] 2022-02-02T13:40:17.262 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:16 smithi037 conmon[35544]: Standby manager daemon smithi037.npteou started 2022-02-02T13:40:18.162 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cluster 2022-02-02T13:40:16.909901+0000 mon.smithi033 (mon.0) 673 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:rejoin 2022-02-02T13:40:18.162 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cluster 2022-02-02T13:40:16.909967+0000 mon.smithi033 (mon.0) 674 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:rejoin} 3 up:standby 2022-02-02T13:40:18.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.098907+0000 mon.smithi033 (mon.0) 675 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "mgr fail", "who": "smithi037.npteou"}]': finished 2022-02-02T13:40:18.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cluster 2022-02-02T13:40:17.098999+0000 mon.smithi033 (mon.0) 676 : cluster [DBG] mgrmap e25: smithi033.xvkvzp(active, starting, since 0.991893s), standbys: smithi037.npteou 2022-02-02T13:40:18.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.100781+0000 mon.smithi033 (mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:40:18.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.100923+0000 mon.smithi033 (mon.0) 678 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:40:18.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.101037+0000 mon.smithi033 (mon.0) 679 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:40:18.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.101210+0000 mon.smithi033 (mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:40:18.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.101393+0000 mon.smithi033 (mon.0) 681 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:40:18.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17. 2022-02-02T13:40:18.165 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 101563+0000 mon.smithi033 (mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:40:18.165 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.103182+0000 mon.smithi033 (mon.0) 683 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:40:18.165 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.103441+0000 mon.smithi033 (mon.0) 684 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:18.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.103723+0000 mon.smithi033 (mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:40:18.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.104034+0000 mon.smithi033 (mon.0) 686 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:40:18.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.104284+0000 mon.smithi033 (mon.0) 687 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:40:18.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.104619+0000 mon.smithi033 (mon.0) 688 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:40:18.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.105006+0000 2022-02-02T13:40:18.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: mon.smithi033 (mon.0) 689 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:40:18.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:17.105355+0000 mon.smithi033 (mon 2022-02-02T13:40:18.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: .0) 690 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:40:18.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:40:18.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: T13:40:17.106338+0000 mon.smithi033 2022-02-02T13:40:18.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: (mon.0) 691 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:40:18.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:18.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:18.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:17.106608+0000 2022-02-02T13:40:18.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: mon.smithi033 (mon.0) 692 : audit [DBG] 2022-02-02T13:40:18.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:40:18.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:18.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02- 2022-02-02T13:40:18.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 02T13:40:17. 2022-02-02T13:40:18.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 106988+0000 mon.smithi033 (mon.0 2022-02-02T13:40:18.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: ) 693 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:40:18.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:18.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cluster 2022-02-02T13:40:18.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13: 2022-02-02T13:40:18.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 40:17.139112+0000 mon.smithi033 2022-02-02T13:40:18.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: (mon.0) 694 : cluster [INF] 2022-02-02T13:40:18.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:40:18.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:18.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40 2022-02-02T13:40:18.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: :17.152595+0000 mgr.smithi033.xvkvzp (mgr. 2022-02-02T13:40:18.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 14626) 1 : cephadm [INF] inventory: adjusted host smithi037 addr 'smithi037' -> '172.21.15.37' 2022-02-02T13:40:18.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:18.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 02-02T13:40:17.155677 2022-02-02T13:40:18.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 695 : audit 2022-02-02T13:40:18.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:18.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:40:18.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 13:40:17.169962+0000 mon.smithi033 ( 2022-02-02T13:40:18.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: mon.0) 696 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:18.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:18.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022 2022-02-02T13:40:18.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: -02-02T13:40:17.172853+0000 2022-02-02T13:40:18.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: mon.smithi033 (mon.0) 697 : audit [DBG] 2022-02-02T13:40:18.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:18.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40:18.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:17.174487 2022-02-02T13:40:18.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 698 : audit [DBG] 2022-02-02T13:40:18.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:18.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:40:18.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 40:17.176089+0000 mon.smithi033 (mon.0 2022-02-02T13:40:18.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: ) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:18.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: cephadm 2022-02 2022-02-02T13:40:18.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: -02T13:40:17.177092 2022-02-02T13:40:18.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14626) 2 : cephadm 2022-02-02T13:40:18.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:18.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02T13:40 2022-02-02T13:40:18.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: :17.205397+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:18.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 700 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:40:18.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022-02-02 2022-02-02T13:40:18.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: T13:40:17.219487+0000 mon.smithi033 ( 2022-02-02T13:40:18.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: mon.0) 701 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:40:18.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 2022-02-02T13:40:18.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:18.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: 02-02T13:40:17.675715 2022-02-02T13:40:18.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 702 : audit 2022-02-02T13:40:18.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:17 smithi037 conmon[35544]: [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cluster 2022-02-02T13:40:16.909901+0000 mon.smithi033 (mon.0) 673 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:rejoin 2022-02-02T13:40:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cluster 2022-02-02T13:40:16.909967+0000 mon.smithi033 (mon.0) 674 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:rejoin} 3 up:standby 2022-02-02T13:40:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:17.098907+0000 mon.smithi033 (mon.0) 675 : audit [INF] from='mgr.24381 ' entity='mgr.smithi037.npteou' cmd='[{"prefix": "mgr fail", "who": "smithi037.npteou"}]': finished 2022-02-02T13:40:18.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cluster 2022-02-02T13:40:17.098999+0000 2022-02-02T13:40:18.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.smithi033 (mon.0) 676 : cluster [DBG] mgrmap e25: smithi033.xvkvzp(active, starting, since 0.991893s), standbys: smithi037.npteou 2022-02-02T13:40:18.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:17.100781+0000 mon.smithi033 ( 2022-02-02T13:40:18.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 677 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:40:18.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:17 2022-02-02T13:40:18.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: .100923+0000 mon.smithi033 (mon.0) 678 : audit 2022-02-02T13:40:18.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:40:18.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:18.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 17.101037+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:18.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 679 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:40:18.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02 2022-02-02T13:40:18.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: T13:40:17.101210+0000 mon.smithi033 ( 2022-02-02T13:40:18.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 680 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:40:18.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17. 2022-02-02T13:40:18.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 101393+0000 mon.smithi033 (mon.0) 681 : audit 2022-02-02T13:40:18.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:40:18.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17.101563+0000 mon.smithi033 ( 2022-02-02T13:40:18.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 682 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:40:18.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:40:18.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 02-02T13:40:17.103182 2022-02-02T13:40:18.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: +0000 mon.smithi033 (mon.0) 683 : audit [DBG] 2022-02-02T13:40:18.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:40:18.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17.103441+0000 mon.smithi033 ( 2022-02-02T13:40:18.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 684 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:18.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02- 2022-02-02T13:40:18.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 02T13:40:17.103723+0000 mon.smithi033 ( 2022-02-02T13:40:18.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 685 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:40:18.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:18.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: :40:17.104034+0000 mon.smithi033 (mon.0) 686 2022-02-02T13:40:18.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:40:18.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13: 2022-02-02T13:40:18.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 40:17.104284+0000 mon.smithi033 (mon.0) 687 : audit [DBG] 2022-02-02T13:40:18.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:40:18.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:18.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02-02T13:40:17.104619+0000 mon.smithi033 (mon. 2022-02-02T13:40:18.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 0) 688 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:40:18.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:18.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: :40:17.105006+0000 mon.smithi033 (mon.0 2022-02-02T13:40:18.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: ) 689 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:40:18.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:18.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02-02T13:40:17. 2022-02-02T13:40:18.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 105355+0000 mon.smithi033 (mon.0) 690 : audit 2022-02-02T13:40:18.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:40:18.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:18.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 17.106338+0000 mon.smithi033 (mon.0) 691 : audit 2022-02-02T13:40:18.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:40:18.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:17 2022-02-02T13:40:18.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: .106608+0000 mon.smithi033 (mon.0) 692 : audit 2022-02-02T13:40:18.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:40:18.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:18.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: :40:17.106988+0000 mon.smithi033 (mon.0) 693 2022-02-02T13:40:18.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:40:18.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cluster 2022-02-02T13: 2022-02-02T13:40:18.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 40:17.139112+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:18.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 694 : cluster [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:40:18.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cephadm 2022- 2022-02-02T13:40:18.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 02-02T13:40:17.152595+0000 2022-02-02T13:40:18.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14626) 1 : cephadm [INF] inventory: adjusted host smithi037 addr 'smithi037' -> '172.21.15.37' 2022-02-02T13:40:18.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17.155677+0000 mon.smithi033 ( 2022-02-02T13:40:18.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 695 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:18.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022- 2022-02-02T13:40:18.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 02-02T13:40:17.169962+0000 2022-02-02T13:40:18.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.smithi033 (mon.0) 696 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:18.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:18.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17.172853+0000 mon.smithi033 ( 2022-02-02T13:40:18.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 697 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:18.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:40:18.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02T13:40:17.174487+0000 mon.smithi033 2022-02-02T13:40:18.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: (mon.0) 698 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:18.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:40:18.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02T13:40:17.176089+0000 mon.smithi033 2022-02-02T13:40:18.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: (mon.0) 699 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:18.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: cephadm 2022 2022-02-02T13:40:18.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02-02T13:40:17.177092+0000 2022-02-02T13:40:18.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mgr.smithi033.xvkvzp (mgr.14626) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:18.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:18.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02-02T13:40:18.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:17.205397+0000 mon.smithi033 ( 2022-02-02T13:40:18.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 700 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:40:18.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:40:18.261 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02T13:40:17.219487+0000 mon.smithi033 ( 2022-02-02T13:40:18.262 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.0) 701 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:40:18.262 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:18.262 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: -02-02T13:40:17.675715+0000 2022-02-02T13:40:18.262 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: mon.smithi033 (mon.0) 702 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:18.263 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:17 smithi033 conmon[31996]: 2022-02-02T13:40:19.413 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:17.550243+0000 2022-02-02T13:40:19.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14626) 3 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Bus STARTING 2022-02-02T13:40:19.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:17.670132+0000 mgr.smithi033.xvkvzp (mgr.14626) 4 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:40:19.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:17.670256+0000 mgr.smithi033.xvkvzp (mgr.14626) 5 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Bus STARTED 2022-02-02T13:40:19.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cluster 2022-02-02T13:40:18.119462+0000 mon.smithi033 (mon.0) 703 : cluster [DBG] mgrmap e26: smithi033.xvkvzp(active, since 2s), standbys: smithi037.npteou 2022-02-02T13:40:19.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cluster 2022-02-02T13:40:18.130249+0000 mgr.smithi033.xvkvzp (mgr.14626) 6 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:19.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cluster 2022-02-02T13:40:18.676671+0000 mon.smithi033 (mon.0) 704 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:clientreplay 2022-02-02T13:40:19.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:19 smithi037 conmon[35544]: cluster 2022-02-02T13:40:18.676726+0000 mon.smithi033 (mon.0) 705 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:clientreplay} 3 up:standby 2022-02-02T13:40:19.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:17.550243+0000 mgr.smithi033.xvkvzp (mgr.14626) 3 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Bus STARTING 2022-02-02T13:40:19.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:17.670132+0000 mgr.smithi033.xvkvzp (mgr.14626) 4 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:40:19.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:17.670256+0000 mgr.smithi033.xvkvzp (mgr.14626) 5 : cephadm [INF] [02/Feb/2022:13:40:17] ENGINE Bus STARTED 2022-02-02T13:40:19.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cluster 2022-02-02T13:40:18.119462+0000 mon.smithi033 (mon.0) 703 : cluster [DBG] mgrmap e26: smithi033.xvkvzp(active, since 2s), standbys: smithi037.npteou 2022-02-02T13:40:19.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: 2022-02-02T13:40:19.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cluster 2022-02-02T13:40:18.130249+0000 mgr.smithi033.xvkvzp (mgr.14626) 6 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:19.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cluster 2022-02-02T13:40:18.676671+0000 mon.smithi033 (mon.0) 704 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:clientreplay 2022-02-02T13:40:19.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:19 smithi033 conmon[31996]: cluster 2022-02-02T13:40:18.676726+0000 mon.smithi033 (mon.0) 705 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.kvxxkv=up:clientreplay} 3 up:standby 2022-02-02T13:40:20.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:20 smithi037 conmon[35544]: cluster 2022-02-02T13:40:19.106591+0000 mgr.smithi033.xvkvzp (mgr.14626) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:20.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:20 smithi037 conmon[35544]: cluster 2022-02-02T13:40:19.127374+0000 mon.smithi033 (mon.0) 706 : cluster [DBG] mgrmap e27: smithi033.xvkvzp(active, since 3s), standbys: smithi037.npteou 2022-02-02T13:40:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:20 smithi033 conmon[31996]: cluster 2022-02-02T13:40:19 2022-02-02T13:40:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:20 smithi033 conmon[31996]: .106591+0000 mgr.smithi033.xvkvzp (mgr.14626) 7 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:20 smithi033 conmon[31996]: cluster 2022-02-02T13:40:19.127374+0000 mon.smithi033 (mon.0) 706 : cluster [DBG] mgrmap e27: smithi033.xvkvzp(active, since 3s), standbys: smithi037.npteou 2022-02-02T13:40:21.268 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:21 smithi037 conmon[35544]: cluster 2022-02 2022-02-02T13:40:21.269 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:21 smithi037 conmon[35544]: -02T13:40:20.315400+0000 mon.smithi033 (mon.0) 707 : cluster [INF] daemon mds.cephfs.smithi033.kvxxkv is now active in filesystem cephfs as rank 0 2022-02-02T13:40:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:21 smithi033 conmon[31996]: cluster 2022-02-02T13:40:20.315400+0000 mon.smithi033 (mon.0 2022-02-02T13:40:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:21 smithi033 conmon[31996]: ) 707 : cluster [INF] daemon mds.cephfs.smithi033.kvxxkv is now active in filesystem cephfs as rank 0 2022-02-02T13:40:21.926 INFO:tasks.workunit.client.1.smithi037.stdout:8/35: mknod cb 0 2022-02-02T13:40:21.932 INFO:tasks.workunit.client.1.smithi037.stdout:8/36: fsync f4 0 2022-02-02T13:40:22.012 INFO:tasks.workunit.client.1.smithi037.stdout:1/6: sync 2022-02-02T13:40:22.012 INFO:tasks.workunit.client.1.smithi037.stdout:4/22: sync 2022-02-02T13:40:22.012 INFO:tasks.workunit.client.1.smithi037.stdout:5/11: sync 2022-02-02T13:40:22.012 INFO:tasks.workunit.client.1.smithi037.stdout:4/23: read - no filename 2022-02-02T13:40:22.013 INFO:tasks.workunit.client.1.smithi037.stdout:0/0: sync 2022-02-02T13:40:22.013 INFO:tasks.workunit.client.1.smithi037.stdout:5/12: rmdir - no directory 2022-02-02T13:40:22.013 INFO:tasks.workunit.client.1.smithi037.stdout:0/1: rename - no filename 2022-02-02T13:40:22.013 INFO:tasks.workunit.client.1.smithi037.stdout:2/4: sync 2022-02-02T13:40:22.013 INFO:tasks.workunit.client.1.smithi037.stdout:3/5: sync 2022-02-02T13:40:22.014 INFO:tasks.workunit.client.1.smithi037.stdout:3/6: dwrite - no filename 2022-02-02T13:40:22.014 INFO:tasks.workunit.client.1.smithi037.stdout:6/50: sync 2022-02-02T13:40:22.014 INFO:tasks.workunit.client.1.smithi037.stdout:7/54: sync 2022-02-02T13:40:22.014 INFO:tasks.workunit.client.1.smithi037.stdout:9/58: sync 2022-02-02T13:40:22.019 INFO:tasks.workunit.client.1.smithi037.stdout:4/24: chown c4 377950520 1 2022-02-02T13:40:22.031 INFO:tasks.workunit.client.1.smithi037.stdout:6/51: creat f8 x:0 0 0 2022-02-02T13:40:22.044 INFO:tasks.workunit.client.1.smithi037.stdout:1/7: creat d0/f1 x:0 0 0 2022-02-02T13:40:22.045 INFO:tasks.workunit.client.1.smithi037.stdout:1/8: write d0/f1 [616031,4321] 0 2022-02-02T13:40:22.045 INFO:tasks.workunit.client.1.smithi037.stdout:1/9: read d0/f1 [497434,119510] 0 2022-02-02T13:40:22.045 INFO:tasks.workunit.client.1.smithi037.stdout:1/10: write d0/f1 [1335723,126995] 0 2022-02-02T13:40:22.045 INFO:tasks.workunit.client.1.smithi037.stdout:1/11: chown d0 21 1 2022-02-02T13:40:22.048 INFO:tasks.workunit.client.1.smithi037.stdout:4/25: getdents . 0 2022-02-02T13:40:22.054 INFO:tasks.workunit.client.1.smithi037.stdout:1/12: dread d0/f1 [0,4194304] 0 2022-02-02T13:40:22.054 INFO:tasks.workunit.client.1.smithi037.stdout:1/13: readlink - no filename 2022-02-02T13:40:22.056 INFO:tasks.workunit.client.1.smithi037.stdout:1/14: write d0/f1 [292270,115614] 0 2022-02-02T13:40:22.057 INFO:tasks.workunit.client.1.smithi037.stdout:1/15: truncate d0/f1 2315834 0 2022-02-02T13:40:22.057 INFO:tasks.workunit.client.1.smithi037.stdout:2/5: creat d0/f1 x:0 0 0 2022-02-02T13:40:22.060 INFO:tasks.workunit.client.1.smithi037.stdout:8/37: getdents . 0 2022-02-02T13:40:22.064 INFO:tasks.workunit.client.1.smithi037.stdout:3/7: mknod c2 0 2022-02-02T13:40:22.064 INFO:tasks.workunit.client.1.smithi037.stdout:3/8: stat c2 0 2022-02-02T13:40:22.073 INFO:tasks.workunit.client.1.smithi037.stdout:4/26: mknod c7 0 2022-02-02T13:40:22.073 INFO:tasks.workunit.client.1.smithi037.stdout:4/27: fsync - no filename 2022-02-02T13:40:22.074 INFO:tasks.workunit.client.1.smithi037.stdout:4/28: dread - no filename 2022-02-02T13:40:22.080 INFO:tasks.workunit.client.1.smithi037.stdout:2/6: rename d0 to d0/d2 22 2022-02-02T13:40:22.091 INFO:tasks.workunit.client.1.smithi037.stdout:3/9: unlink c2 0 2022-02-02T13:40:22.096 INFO:tasks.workunit.client.1.smithi037.stdout:4/29: mknod c8 0 2022-02-02T13:40:22.096 INFO:tasks.workunit.client.1.smithi037.stdout:4/30: truncate - no filename 2022-02-02T13:40:22.096 INFO:tasks.workunit.client.1.smithi037.stdout:4/31: fdatasync - no filename 2022-02-02T13:40:22.096 INFO:tasks.workunit.client.1.smithi037.stdout:4/32: write - no filename 2022-02-02T13:40:22.099 INFO:tasks.workunit.client.1.smithi037.stdout:1/16: mkdir d0/d2 0 2022-02-02T13:40:22.119 INFO:tasks.workunit.client.1.smithi037.stdout:4/33: mkdir d9 0 2022-02-02T13:40:22.123 INFO:tasks.workunit.client.1.smithi037.stdout:1/17: symlink d0/d2/l3 0 2022-02-02T13:40:22.131 INFO:tasks.workunit.client.1.smithi037.stdout:2/7: mkdir d0/d3 0 2022-02-02T13:40:22.140 INFO:tasks.workunit.client.1.smithi037.stdout:4/34: unlink l5 0 2022-02-02T13:40:22.141 INFO:tasks.workunit.client.1.smithi037.stdout:4/35: dwrite - no filename 2022-02-02T13:40:22.141 INFO:tasks.workunit.client.1.smithi037.stdout:4/36: dread - no filename 2022-02-02T13:40:22.147 INFO:tasks.workunit.client.1.smithi037.stdout:1/18: creat d0/f4 x:0 0 0 2022-02-02T13:40:22.147 INFO:tasks.workunit.client.1.smithi037.stdout:1/19: truncate d0/f4 921205 0 2022-02-02T13:40:22.160 INFO:tasks.workunit.client.1.smithi037.stdout:2/8: mknod d0/d3/c4 0 2022-02-02T13:40:22.160 INFO:tasks.workunit.client.1.smithi037.stdout:2/9: write d0/f1 [1042221,115484] 0 2022-02-02T13:40:22.161 INFO:tasks.workunit.client.1.smithi037.stdout:2/10: write d0/f1 [105511,4549] 0 2022-02-02T13:40:22.161 INFO:tasks.workunit.client.1.smithi037.stdout:2/11: chown d0/f1 748611 1 2022-02-02T13:40:22.167 INFO:tasks.workunit.client.1.smithi037.stdout:4/37: symlink d9/la 0 2022-02-02T13:40:22.180 INFO:tasks.workunit.client.1.smithi037.stdout:4/38: mknod d9/cb 0 2022-02-02T13:40:22.180 INFO:tasks.workunit.client.1.smithi037.stdout:4/39: chown c7 341 1 2022-02-02T13:40:22.187 INFO:tasks.workunit.client.1.smithi037.stdout:4/40: mknod d9/cc 0 2022-02-02T13:40:22.191 INFO:tasks.workunit.client.1.smithi037.stdout:9/59: creat d0/f9 x:0 0 0 2022-02-02T13:40:22.191 INFO:tasks.workunit.client.1.smithi037.stdout:9/60: chown d0/f9 0 1 2022-02-02T13:40:22.194 INFO:tasks.workunit.client.1.smithi037.stdout:4/41: symlink d9/ld 0 2022-02-02T13:40:22.194 INFO:tasks.workunit.client.1.smithi037.stdout:4/42: write - no filename 2022-02-02T13:40:22.202 INFO:tasks.workunit.client.1.smithi037.stdout:9/61: dread d0/f6 [0,4194304] 0 2022-02-02T13:40:22.203 INFO:tasks.workunit.client.1.smithi037.stdout:4/43: creat d9/fe x:0 0 0 2022-02-02T13:40:22.207 INFO:tasks.workunit.client.1.smithi037.stdout:9/62: creat d0/fa x:0 0 0 2022-02-02T13:40:22.208 INFO:tasks.workunit.client.1.smithi037.stdout:9/63: fdatasync d0/fa 0 2022-02-02T13:40:22.209 INFO:tasks.workunit.client.1.smithi037.stdout:4/44: mkdir d9/df 0 2022-02-02T13:40:22.215 INFO:tasks.workunit.client.1.smithi037.stdout:4/45: unlink d9/cc 0 2022-02-02T13:40:22.215 INFO:tasks.workunit.client.1.smithi037.stdout:4/46: chown d9/df 151656 1 2022-02-02T13:40:22.215 INFO:tasks.workunit.client.1.smithi037.stdout:4/47: chown l3 219333078 1 2022-02-02T13:40:22.228 INFO:tasks.workunit.client.1.smithi037.stdout:6/52: write f0 [2741430,9871] 0 2022-02-02T13:40:22.234 INFO:tasks.workunit.client.1.smithi037.stdout:8/38: write f6 [2460978,66947] 0 2022-02-02T13:40:22.237 INFO:tasks.workunit.client.1.smithi037.stdout:5/13: write f0 [206931,122047] 0 2022-02-02T13:40:22.238 INFO:tasks.workunit.client.1.smithi037.stdout:6/53: getdents . 0 2022-02-02T13:40:22.239 INFO:tasks.workunit.client.1.smithi037.stdout:5/14: stat l1 0 2022-02-02T13:40:22.240 INFO:tasks.workunit.client.1.smithi037.stdout:4/48: dwrite d9/fe [0,4194304] 0 2022-02-02T13:40:22.241 INFO:tasks.workunit.client.1.smithi037.stdout:4/49: chown d9/la 93997 1 2022-02-02T13:40:22.241 INFO:tasks.workunit.client.1.smithi037.stdout:6/54: creat f9 x:0 0 0 2022-02-02T13:40:22.247 INFO:tasks.workunit.client.1.smithi037.stdout:1/20: truncate d0/f1 1147645 0 2022-02-02T13:40:22.251 INFO:tasks.workunit.client.1.smithi037.stdout:4/50: dread d9/fe [0,4194304] 0 2022-02-02T13:40:22.252 INFO:tasks.workunit.client.1.smithi037.stdout:4/51: chown l1 433326 1 2022-02-02T13:40:22.253 INFO:tasks.workunit.client.1.smithi037.stdout:4/52: write d9/fe [2065667,94272] 0 2022-02-02T13:40:22.253 INFO:tasks.workunit.client.1.smithi037.stdout:4/53: chown d9/ld 39 1 2022-02-02T13:40:22.254 INFO:tasks.workunit.client.1.smithi037.stdout:4/54: read d9/fe [1938789,80447] 0 2022-02-02T13:40:22.274 INFO:tasks.workunit.client.1.smithi037.stdout:4/55: dwrite d9/fe [0,4194304] 0 2022-02-02T13:40:22.301 INFO:tasks.workunit.client.1.smithi037.stdout:4/56: dwrite d9/fe [0,4194304] 0 2022-02-02T13:40:22.334 INFO:tasks.workunit.client.1.smithi037.stdout:4/57: dwrite d9/fe [0,4194304] 0 2022-02-02T13:40:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: cluster 2022-02-02T13:40:21.107019 2022-02-02T13:40:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: +0000 mgr.smithi033.xvkvzp (mgr.14626) 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: cluster 2022-02-02T13:40:21.120518+0000 mon.smithi033 (mon.0) 708 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T13:40:22.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: cluster 2022-02-02T13:40:21.127424+0000 mon.smithi033 (mon.0) 709 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:active 2022-02-02T13:40:22.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: cluster 2022-02-02T13:40:21.127844+0000 mon.smithi033 (mon.0) 710 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.kvxxkv=up:active} 3 up:standby 2022-02-02T13:40:22.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:22 smithi033 conmon[31996]: cluster 2022-02-02T13:40:21.137810+0000 mon.smithi033 (mon.0) 711 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.kvxxkv=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:40:22.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: cluster 2022-02-02T13:40:21.107019+0000 2022-02-02T13:40:22.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14626) 8 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:22.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: cluster 2022-02-02T13:40:21.120518+0000 mon.smithi033 (mon.0) 708 : cluster [INF] 2022-02-02T13:40:22.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T13:40:22.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: cluster 2022-02-02T13:40:21.127424+0000 2022-02-02T13:40:22.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: mon.smithi033 (mon.0) 709 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2211146573,v1:172.21.15.33:6829/2211146573] up:active 2022-02-02T13:40:22.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: cluster 2022-02-02T13:40:21.127844+0000 2022-02-02T13:40:22.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: mon.smithi033 (mon.0) 710 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.kvxxkv=up:active} 3 up:standby 2022-02-02T13:40:22.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: cluster 2022-02-02T13:40 2022-02-02T13:40:22.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: :21.137810+0000 mon.smithi033 (mon.0) 711 : cluster [DBG] 2022-02-02T13:40:22.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:22 smithi037 conmon[35544]: fsmap cephfs:1 {0=cephfs.smithi033.kvxxkv=up:active} 1 up:standby-replay 2 up:standby 2022-02-02T13:40:23.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:23 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:23.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:23 smithi033 conmon[31996]: 22.199744+0000 mon.smithi033 (mon.0) 712 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:23.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:23 smithi033 conmon[31996]: audit 2022-02-02T13:40:23.089467+0000 mon.smithi033 (mon.0) 713 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:23 smithi037 conmon[35544]: audit 2022-02-02T13:40:22.199744+0000 mon.smithi033 (mon.0 2022-02-02T13:40:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:23 smithi037 conmon[35544]: ) 712 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:23 smithi037 conmon[35544]: audit 2022-02-02T13:40:23.089467+0000 mon.smithi033 (mon.0) 713 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:24.252 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:24 smithi037 conmon[35544]: cluster 2022-02-02T13:40:23.107405+0000 mgr.smithi033.xvkvzp 2022-02-02T13:40:24.252 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:24 smithi037 conmon[35544]: (mgr.14626) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:24.252 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:24 smithi037 conmon[35544]: cluster 2022-02-02T13:40:23.210053+0000 mon.smithi033 (mon.0) 714 : cluster 2022-02-02T13:40:24.253 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:24 smithi037 conmon[35544]: [DBG] mgrmap e28: smithi033.xvkvzp(active, since 7s), standbys: smithi037.npteou 2022-02-02T13:40:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:24 smithi033 conmon[31996]: cluster 2022-02-02T13:40:23.107405+0000 mgr.smithi033.xvkvzp (mgr.14626) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 235 MiB data, 985 MiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:24 smithi033 conmon[31996]: cluster 2022-02-02T13:40:23.210053+0000 mon.smithi033 (mon.0) 714 : cluster [DBG] mgrmap e28: smithi033.xvkvzp(active, since 7s), standbys: smithi037.npteou 2022-02-02T13:40:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: cluster 2022-02-02T13:40:25.108092+0000 2022-02-02T13:40:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.14626) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 429 op/s 2022-02-02T13:40:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:25.436142+0000 mon.smithi033 (mon.0) 715 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: cluster 2022-02-02T13:40:25.490706+0000 mon.smithi033 (mon.0) 716 : cluster [DBG] Standby manager daemon smithi037.npteou restarted 2022-02-02T13:40:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: cluster 2022-02-02T13:40:25.490822+0000 mon.smithi033 (mon.0) 717 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:25.492556+0000 mon.smithi037 (mon.1) 62 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:40:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:25.494168+0000 mon.smithi037 (mon.1) 63 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:25.496908+0000 mon.smithi037 (mon.1) 64 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:40:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:25.497323+0000 mon.smithi037 (mon.1) 65 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:26.094597+0000 mon.smithi033 (mon.0) 718 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:26.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:26 smithi037 conmon[35544]: audit 2022-02-02T13:40:26.096058+0000 mon.smithi033 (mon.0) 719 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:26.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: cluster 2022-02-02T13:40: 2022-02-02T13:40:26.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 25.108092+0000 mgr.smithi033.xvkvzp (mgr.14626) 10 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 3.5 MiB/s wr, 429 op/s 2022-02-02T13:40:26.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:26.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: -02-02T13:40:25.436142+0000 mon.smithi033 (mon.0) 715 2022-02-02T13:40:26.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:26.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: cluster 2022-02-02T13:40:26.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 2022-02-02T13:40:25 2022-02-02T13:40:26.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: .490706+0000 mon.smithi033 (mon. 2022-02-02T13:40:26.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 0) 716 : cluster [DBG] Standby manager daemon smithi037.npteou restarted 2022-02-02T13:40:26.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 2022-02-02T13:40:26.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: cluster 2022-02-02T13:40:25.490822+0000 mon.smithi033 (mon.0) 717 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:26.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022-02-02T13:40:26.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 2022-02-02T13:40:25.492556+0000 mon.smithi037 ( 2022-02-02T13:40:26.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: mon.1) 62 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:40:26.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:26.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: -02-02T13:40: 2022-02-02T13:40:26.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 25.494168+0000 mon.smithi037 (mon 2022-02-02T13:40:26.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: .1) 63 : audit 2022-02-02T13:40:26.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:26.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022-02-02T13:40:26.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 2022-02-02T 2022-02-02T13:40:26.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 13:40:25.496908+0000 mon.smithi037 (mon 2022-02-02T13:40:26.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: .1) 64 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:40:26.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022-02-02T13:40:26.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 2022-02-02T13:40:25 2022-02-02T13:40:26.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: .497323+0000 mon.smithi037 (mon. 2022-02-02T13:40:26.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: 1) 65 : audit [DBG] from='mgr.? 172.21.15.37:0/1010243586' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:26.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022-02 2022-02-02T13:40:26.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: -02T13:40:26.094597+0000 2022-02-02T13:40:26.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: mon.smithi033 (mon.0) 718 : audit 2022-02-02T13:40:26.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:26.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:26.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: :40:26.096058+0000 2022-02-02T13:40:26.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: mon.smithi033 (mon.0) 719 : audit 2022-02-02T13:40:26.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:26 smithi033 conmon[31996]: [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:27.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:27 smithi033 conmon[31996]: audit 2022-02-02T13:40:26.279989+0000 mon.smithi033 (mon.0) 720 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:27.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:27 smithi033 conmon[31996]: cluster 2022-02-02T13:40:26.442092+0000 mon.smithi033 (mon.0) 721 : cluster [DBG] mgrmap e29: smithi033.xvkvzp(active, since 10s), standbys: smithi037.npteou 2022-02-02T13:40:27.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:27 smithi037 conmon[35544]: audit 2022-02-02T13:40:26.279989+0000 mon.smithi033 (mon.0) 720 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:27.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:27 smithi037 conmon[35544]: cluster 2022-02-02T13:40:26.442092+0000 mon.smithi033 (mon.0) 721 : cluster [DBG] mgrmap e29: smithi033.xvkvzp(active, since 10s), standbys: smithi037.npteou 2022-02-02T13:40:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:28 smithi037 conmon[35544]: cluster 2022-02-02T13:40:27.108468+0000 mgr.smithi033.xvkvzp (mgr.14626) 11 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 2.7 MiB/s wr, 333 op/s 2022-02-02T13:40:28.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:28 smithi033 conmon[31996]: cluster 2022-02-02T13:40:27.108468+0000 mgr.smithi033.xvkvzp (mgr.14626) 2022-02-02T13:40:28.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:28 smithi033 conmon[31996]: 11 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.6 MiB/s rd, 2.7 MiB/s wr, 333 op/s 2022-02-02T13:40:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:30 smithi037 conmon[35544]: audit 2022-02-02T13:40:29.016471+0000 mon.smithi033 (mon.0) 722 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:30 smithi037 conmon[35544]: audit 2022-02-02T13:40:29.017629+0000 mon.smithi033 (mon.0) 723 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:30.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:30 smithi037 conmon[35544]: cluster 2022-02-02T13:40:29.018685+0000 mgr.smithi033.xvkvzp (mgr.14626) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 2.2 MiB/s wr, 275 op/s 2022-02-02T13:40:30.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:30 smithi037 conmon[35544]: audit 2022-02-02T13:40:29.021745+0000 mon.smithi033 (mon.0) 724 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:30.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:30 smithi037 conmon[35544]: audit 2022-02-02T13:40:29.027467+0000 mon.smithi033 (mon.0) 725 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:30 smithi033 conmon[31996]: audit 2022-02-02T13:40:29.016471+0000 mon.smithi033 (mon.0) 722 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:30 smithi033 conmon[31996]: audit 2022-02-02T13:40:29.017629+0000 mon.smithi033 (mon.0) 723 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:40:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:30 smithi033 conmon[31996]: cluster 2022-02-02T13:40:29.018685+0000 mgr.smithi033.xvkvzp (mgr.14626) 12 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 2.2 MiB/s wr, 275 op/s 2022-02-02T13:40:30.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:30 smithi033 conmon[31996]: audit 2022-02-02T13:40:29.021745+0000 mon.smithi033 (mon.0) 724 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:30.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:30 smithi033 conmon[31996]: audit 2022-02-02T13:40:29.027467+0000 mon.smithi033 (mon.0) 725 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:31.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:31 smithi037 conmon[35544]: cluster 2022-02-02T13:40:30.014462+0000 mon.smithi033 (mon.0) 726 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:40:31.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:31 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:30.377406+0000 mgr.smithi033.xvkvzp (mgr.14626) 13 : cephadm [INF] Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:40:31.112 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:31 smithi037 conmon[35544]: audit 2022-02-02T13:40:30.377910+0000 mon.smithi033 (mon.0) 727 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:31.113 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:31 smithi037 conmon[35544]: audit 2022-02-02T13:40:30.379074+0000 mon.smithi033 (mon.0) 728 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:40:31.113 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:31 smithi037 conmon[35544]: audit 2022-02-02T13:40:30.380105+0000 mon.smithi033 (mon.0) 729 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: cluster 2022-02-02T13:40:30.014462+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: 726 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:40:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:30.377406+0000 mgr.smithi033.xvkvzp (mgr.14626) 13 : cephadm [INF] Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:40:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: audit 2022-02-02T13:40:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: 2022-02-02T13:40:30.377910+0000 mon.smithi033 (mon.0) 727 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:40:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: audit 2022-02-02T13 2022-02-02T13:40:31.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: :40:30.379074+0000 mon.smithi033 (mon.0) 728 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:40:31.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: audit 2022-02-02T13:40:30.380105+0000 mon.smithi033 2022-02-02T13:40:31.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:31 smithi033 conmon[31996]: (mon.0) 729 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:32.347 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:32 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:30 2022-02-02T13:40:32.348 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:32 smithi037 conmon[35544]: .381187+0000 mgr.smithi033.xvkvzp (mgr.14626) 14 : cephadm [INF] Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:40:32.348 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:32 smithi037 conmon[35544]: cluster 2022-02-02T13:40:31.019268+0000 mgr.smithi033.xvkvzp (mgr.14626) 15 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 2.0 MiB/s wr, 251 op/s 2022-02-02T13:40:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:32 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:30.381187+0000 mgr.smithi033.xvkvzp (mgr.14626) 14 : cephadm 2022-02-02T13:40:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:32 smithi033 conmon[31996]: [INF] Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:40:32.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:32 smithi033 conmon[31996]: cluster 2022-02-02T13:40:31.019268+0000 mgr.smithi033.xvkvzp (mgr.14626) 15 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 2.0 MiB/s wr, 251 op/s 2022-02-02T13:40:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: audit 2022-02-02T13:40:32.199469+0000 mon.smithi033 (mon.0) 730 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: audit 2022-02-02T13:40:32.996602+0000 mon.smithi033 (mon.0) 731 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: audit 2022-02-02T13:40:32.997765+0000 mon.smithi033 (mon.0) 732 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:33.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: audit 2022-02-02T13:40:32.999194+0000 mon.smithi033 (mon.0) 733 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:33.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: audit 2022-02-02T13:40:33.000120+0000 mon.smithi033 ( 2022-02-02T13:40:33.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:33 smithi033 conmon[31996]: mon.0) 734 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: audit 2022-02-02T13:40:32.199469+0000 mon.smithi033 2022-02-02T13:40:33.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: (mon.0) 730 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: audit 2022-02-02T13:40:32.996602+0000 mon.smithi033 (mon.0) 731 : audit 2022-02-02T13:40:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: audit 2022-02-02T13:40:33.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: 2022-02-02T13:40:32.997765+0000 mon.smithi033 (mon. 2022-02-02T13:40:33.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: 0) 732 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:33.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: audit 2022-02-02T13:40:33.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: 2022-02-02T13:40:32.999194+0000 2022-02-02T13:40:33.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: mon.smithi033 (mon.0) 733 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:33.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: 2022-02-02T13:40:33.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: audit 2022-02-02T13:40:33.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: 2022-02-02T13:40:33.000120+0000 mon.smithi033 ( 2022-02-02T13:40:33.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:33 smithi037 conmon[35544]: mon.0) 734 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:34.286 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:34 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:33.000923+0000 mgr.smithi033.xvkvzp (mgr.14626) 16 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:34.286 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:34 smithi033 conmon[31996]: cluster 2022-02-02T13:40:33.019835+0000 mgr.smithi033.xvkvzp (mgr.14626) 17 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 2.0 MiB/s wr, 251 op/s 2022-02-02T13:40:34.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:34 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:33.000923+0000 mgr.smithi033.xvkvzp (mgr.14626) 16 : 2022-02-02T13:40:34.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:34 smithi037 conmon[35544]: cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:34.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:34 smithi037 conmon[35544]: cluster 2022-02-02T13:40:33.019835+0000 mgr.smithi033.xvkvzp (mgr.14626) 17 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.2 MiB/s rd, 2.0 MiB/s wr, 251 op/s 2022-02-02T13:40:35.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:35 smithi033 conmon[31996]: debug 2022-02-02T13:40:35.199+0000 7f1ee1178700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:35.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:35 smithi033 conmon[31996]: cluster 2022-02-02T13:40:34.263282+0000 mon.smithi033 ( 2022-02-02T13:40:35.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:35 smithi033 conmon[31996]: mon.0) 735 : cluster [INF] daemon mds.cephfs.smithi033.kvxxkv restarted 2022-02-02T13:40:35.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:35 smithi033 conmon[31996]: cluster 2022-02-02T13:40:34.267663+0000 mon.smithi033 (mon.0) 736 2022-02-02T13:40:35.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:35 smithi033 conmon[31996]: : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2022-02-02T13:40:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:35 smithi037 conmon[35544]: cluster 2022-02-02T13:40:34.263282+0000 2022-02-02T13:40:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:35 smithi037 conmon[35544]: mon.smithi033 (mon.0) 735 : cluster [INF] daemon mds.cephfs.smithi033.kvxxkv restarted 2022-02-02T13:40:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:35 smithi037 conmon[35544]: cluster 2022-02-02T13:40:34.267663+0000 2022-02-02T13:40:35.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:35 smithi037 conmon[35544]: mon.smithi033 (mon.0) 736 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2022-02-02T13:40:36.328 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022-02-02T13:40:35.020395 2022-02-02T13:40:36.328 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: +0000 mgr.smithi033.xvkvzp (mgr.14626) 18 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2 op/s 2022-02-02T13:40:36.328 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:40:36.329 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 40:35.200692+0000 mon.smithi033 (mon.0) 737 : 2022-02-02T13:40:36.329 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:40:36.329 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:40:36.329 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: -02-02T13:40: 2022-02-02T13:40:36.330 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 35.200729+0000 mon.smithi033 (mon 2022-02-02T13:40:36.330 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: .0) 738 : cluster [ERR] 2022-02-02T13:40:36.330 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:36.330 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022-02-02T13:40:36.331 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 2022-02-02T13:40 2022-02-02T13:40:36.331 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: :35.204777+0000 mon.smithi033 ( 2022-02-02T13:40:36.331 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: mon.0) 739 : cluster 2022-02-02T13:40:36.331 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: [DBG] mds.? [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] up:boot 2022-02-02T13:40:36.331 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:40:36.332 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: -02-02T13:40: 2022-02-02T13:40:36.332 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 35.204842+0000 mon.smithi033 (mon 2022-02-02T13:40:36.332 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: .0) 740 : cluster [INF] 2022-02-02T13:40:36.332 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: Standby daemon mds.cephfs.smithi033.cdqmmc assigned to filesystem cephfs as rank 0 2022-02-02T13:40:36.332 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022-02-02T13:40:36.333 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 2022-02-02T13:40 2022-02-02T13:40:36.333 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: :35.204997+0000 mon.smithi033 ( 2022-02-02T13:40:36.333 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: mon.0) 741 : cluster 2022-02-02T13:40:36.333 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:40:36.334 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022 2022-02-02T13:40:36.334 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: -02-02T13:40: 2022-02-02T13:40:36.334 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 35.205315+0000 mon.smithi033 ( 2022-02-02T13:40:36.334 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: mon.0) 742 : cluster 2022-02-02T13:40:36.335 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: [DBG] fsmap cephfs:0/1 1 up:standby-replay 3 up:standby, 1 failed 2022-02-02T13:40:36.335 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: audit 2022 2022-02-02T13:40:36.335 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: -02-02T13:40: 2022-02-02T13:40:36.335 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 35.205975+0000 mon.smithi033 ( 2022-02-02T13:40:36.335 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: mon.0) 743 : audit 2022-02-02T13:40:36.336 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:40:36.336 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: cluster 2022-02-02T13:40:36.336 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 2022-02-02T13: 2022-02-02T13:40:36.336 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: 40:35.210306+0000 mon.smithi033 2022-02-02T13:40:36.337 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: (mon.0) 744 : cluster 2022-02-02T13:40:36.337 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:36 smithi037 conmon[35544]: [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 3 up:standby 2022-02-02T13:40:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02-02T13:40:35.020395+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:40:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: mgr.14626) 18 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2 op/s 2022-02-02T13:40:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02-02T13:40:35.200692+0000 mon.smithi033 (mon.0) 737 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:40:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02-02T13:40:35.200729+0000 mon.smithi033 (mon.0) 738 2022-02-02T13:40:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022 2022-02-02T13:40:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: -02-02T13:40:35.204777+0000 mon.smithi033 (mon. 2022-02-02T13:40:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: 0) 739 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] up:boot 2022-02-02T13:40:36.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02- 2022-02-02T13:40:36.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: 02T13:40:35.204842+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:36.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: 740 : cluster [INF] Standby daemon mds.cephfs.smithi033.cdqmmc assigned to filesystem cephfs as rank 0 2022-02-02T13:40:36.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02-02T13:40:36.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: 2022-02-02T13:40:35.204997+0000 mon.smithi033 (mon 2022-02-02T13:40:36.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: .0) 741 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:40:36.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02 2022-02-02T13:40:36.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: -02T13:40:35.205315+0000 mon.smithi033 (mon.0) 742 : cluster [DBG] fsmap cephfs:0/1 1 up:standby-replay 3 up:standby, 1 failed 2022-02-02T13:40:36.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: audit 2022-02-02T13:40:35.205975+0000 mon.smithi033 (mon.0) 743 : audit 2022-02-02T13:40:36.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:40:36.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: cluster 2022-02-02T13:40:36.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: 2022-02-02T13:40:35.210306+0000 mon.smithi033 (mon.0) 744 : cluster [DBG] 2022-02-02T13:40:36.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:36 smithi033 conmon[31996]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 3 up:standby 2022-02-02T13:40:37.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:37 smithi037 conmon[35544]: cluster 2022-02-02T13:40:36. 2022-02-02T13:40:37.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:37 smithi037 conmon[35544]: 274703+0000 mon.smithi033 (mon.0) 745 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:reconnect 2022-02-02T13:40:37.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:37 smithi037 conmon[35544]: cluster 2022-02-02T13:40:36.274761+0000 mon.smithi033 (mon.0) 746 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:37.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:37 smithi037 conmon[35544]: audit 2022-02-02T13:40:37.250757+0000 mon.smithi033 (mon.0) 747 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: cluster 2022-02-02T13:40:36.274703+0000 mon.smithi033 (mon.0 2022-02-02T13:40:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: ) 745 : cluster [DBG] mds.? [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] up:reconnect 2022-02-02T13:40:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: cluster 2022-02-02T13:40:36.274761+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:37.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: 746 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:37.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: audit 2022-02-02T13:40:37.250757+0000 2022-02-02T13:40:37.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:37 smithi033 conmon[31996]: mon.smithi033 (mon.0) 747 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:38.521 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:38 smithi033 conmon[31996]: cluster 2022-02-02T13 2022-02-02T13:40:38.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:38 smithi033 conmon[31996]: :40:37.020921+0000 mgr.smithi033.xvkvzp (mgr.14626) 19 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2 op/s 2022-02-02T13:40:38.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:38 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:38.522 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:38 smithi033 conmon[31996]: 38.086147+0000 mon.smithi033 (mon.0) 748 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:38.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:38 smithi037 conmon[35544]: cluster 2022-02-02T13:40:37.020921+0000 mgr.smithi033.xvkvzp (mgr.14626) 19 2022-02-02T13:40:38.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:38 smithi037 conmon[35544]: : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2 op/s 2022-02-02T13:40:38.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:38 smithi037 conmon[35544]: audit 2022-02-02T13:40:38.086147+0000 mon.smithi033 (mon.0) 748 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:40.467 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:40 smithi037 conmon[35544]: cluster 2022-02-02T13:40: 2022-02-02T13:40:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:40 smithi037 conmon[35544]: 39.021533+0000 mgr.smithi033.xvkvzp (mgr.14626) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 196 KiB/s rd, 5 op/s 2022-02-02T13:40:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:40 smithi037 conmon[35544]: cluster 2022-02-02T13:40:39.088323+0000 mon.smithi033 (mon.0) 749 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] up:standby 2022-02-02T13:40:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:40 smithi037 conmon[35544]: cluster 2022-02-02T13:40:39.088401+0000 mon.smithi033 (mon.0) 750 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:40 smithi033 conmon[31996]: cluster 2022-02-02T13:40:39.021533+0000 mgr.smithi033.xvkvzp (mgr.14626) 20 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 196 KiB/s rd, 5 op/s 2022-02-02T13:40:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:40 smithi033 conmon[31996]: 2022-02-02T13:40:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:40 smithi033 conmon[31996]: cluster 2022-02-02T13:40:39.088323+0000 mon.smithi033 (mon.0) 749 : cluster [DBG] mds.? [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] up:standby 2022-02-02T13:40:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:40 smithi033 conmon[31996]: cluster 2022-02-02T13:40:39.088401+0000 mon.smithi033 (mon.0) 750 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:41.370 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: cluster 2022-02-02T13:40:40.590301+0000 mon.smithi033 (mon.0) 751 : cluster [DBG] Standby manager daemon smithi037.npteou restarted 2022-02-02T13:40:41.370 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: cluster 2022-02-02T13:40:40.590442+0000 mon.smithi033 (mon.0) 752 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:41.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: audit 2022-02-02T13:40: 2022-02-02T13:40:41.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 40.591710+0000 mon.smithi037 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:40:41.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 2022-02-02T13:40 2022-02-02T13:40:41.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: :40.592119+0000 mon.smithi037 (mon. 2022-02-02T13:40:41.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 1) 67 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:41.372 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:41.373 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: -02-02T13:40: 2022-02-02T13:40:41.373 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 40.594366+0000 mon.smithi037 (mon.1) 2022-02-02T13:40:41.373 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 68 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:40:41.373 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: audit 2022 2022-02-02T13:40:41.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: -02-02T13:40: 2022-02-02T13:40:41.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 40.595517+0000 mon.smithi037 (mon.1) 2022-02-02T13:40:41.374 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:41 smithi033 conmon[31996]: 69 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: cluster 2022-02-02T13:40:40.590301+0000 mon.smithi033 (mon.0) 751 : cluster [DBG] Standby manager daemon smithi037.npteou restarted 2022-02-02T13:40:41.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: cluster 2022-02-02T13:40:40.590442+0000 mon.smithi033 (mon.0) 752 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:41.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: audit 2022-02-02T13:40:40.591710+0000 mon.smithi037 (mon.1) 66 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:40:41.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: audit 2022-02-02T13:40:40.592119+0000 mon.smithi037 (mon.1) 67 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:41.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: audit 2022-02-02T13:40:40.594366+0000 mon.smithi037 (mon.1) 68 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:40:41.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: audit 2022-02-02T13: 2022-02-02T13:40:41.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:41 smithi037 conmon[35544]: 40:40.595517+0000 mon.smithi037 (mon.1) 69 : audit [DBG] from='mgr.? 172.21.15.37:0/1477839776' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:42.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: cluster 2022-02-02T13:40:41.022008+0000 mgr.smithi033.xvkvzp (mgr.14626) 21 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 196 KiB/s rd, 5 op/s 2022-02-02T13:40:42.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: cluster 2022-02-02T13:40:41.101908+0000 mon.smithi033 (mon.0) 753 : cluster [DBG] mgrmap e30: smithi033.xvkvzp(active, since 24s), standbys: smithi037.npteou 2022-02-02T13:40:42.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.301977+0000 mon.smithi033 (mon.0) 754 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: cluster 2022-02-02T13:40:41.303008+0000 mgr.smithi033.xvkvzp (mgr.14626) 22 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 237 KiB/s rd, 6 op/s 2022-02-02T13:40:42.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: cluster 2022-02-02T13:40:41.303322+0000 mgr.smithi033.xvkvzp (mgr.14626) 23 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 117 KiB/s rd, 4 op/s 2022-02-02T13:40:42.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.308877+0000 mon.smithi033 (mon.0) 755 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.315933+0000 mon.smithi033 (mon.0) 756 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:42.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.318203+0000 mon.smithi033 (mon.0) 757 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:40:42.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: 2022-02-02T13:40:41.319020+0000 mgr.smithi033.xvkvzp (mgr.14626) 24 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-02-02T13:40:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.325169+0000 mon.smithi033 (mon.0) 758 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.326157+0000 mon.smithi033 (mon.0) 759 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.xvkvzp"}]: dispatch 2022-02-02T13:40:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.332048+0000 mon.smithi033 (mon.0) 760 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.xvkvzp"}]': finished 2022-02-02T13:40:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.332907+0000 mon.smithi033 (mon.0) 761 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.npteou"}]: dispatch 2022-02-02T13:40:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T13:40:41.338475+0000 2022-02-02T13:40:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: mon.smithi033 (mon.0) 762 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.npteou"}]': finished 2022-02-02T13:40:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: audit 2022-02-02T 2022-02-02T13:40:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: 13:40:41.339526+0000 2022-02-02T13:40:42.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: mon.smithi033 (mon.0) 763 : audit 2022-02-02T13:40:42.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:42 smithi033 conmon[31996]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T13:40:42.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: cluster 2022-02-02T13:40:41.022008+0000 mgr.smithi033.xvkvzp (mgr.14626) 21 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 196 KiB/s rd, 5 op/s 2022-02-02T13:40:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: cluster 2022-02-02T13:40:41.101908+0000 mon.smithi033 (mon.0) 753 : cluster [DBG] mgrmap e30: smithi033.xvkvzp(active, since 24s), standbys: smithi037.npteou 2022-02-02T13:40:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.301977+0000 mon.smithi033 (mon.0) 754 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: cluster 2022-02-02T13:40:41.303008+0000 mgr.smithi033.xvkvzp (mgr.14626) 22 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 237 KiB/s rd, 6 op/s 2022-02-02T13:40:42.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: cluster 2022-02-02T13:40:41.303322+0000 mgr.smithi033.xvkvzp (mgr.14626) 23 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 117 KiB/s rd, 4 op/s 2022-02-02T13:40:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:40:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: 02T13:40:41.308877+0000 mon.smithi033 (mon.0) 755 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.315933+0000 mon.smithi033 (mon.0) 756 : audit 2022-02-02T13:40:42.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41. 2022-02-02T13:40:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: 318203+0000 mon.smithi033 (mon.0) 757 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:40:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:41.319020+0000 mgr.smithi033.xvkvzp (mgr 2022-02-02T13:40:42.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: .14626) 24 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-02-02T13:40:42.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.325169+0000 mon.smithi033 ( 2022-02-02T13:40:42.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: mon.0) 758 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:42.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.326157+0000 mon.smithi033 ( 2022-02-02T13:40:42.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: mon.0) 759 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.xvkvzp"}]: dispatch 2022-02-02T13:40:42.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.332048+0000 mon.smithi033 2022-02-02T13:40:42.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: (mon.0) 760 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi033.xvkvzp"}]': finished 2022-02-02T13:40:42.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.332907+0000 mon.smithi033 ( 2022-02-02T13:40:42.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: mon.0) 761 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.npteou"}]: dispatch 2022-02-02T13:40:42.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.338475+0000 mon.smithi033 (mon. 2022-02-02T13:40:42.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: 0) 762 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.npteou"}]': finished 2022-02-02T13:40:42.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: audit 2022-02-02T13:40:41.339526+0000 mon.smithi033 ( 2022-02-02T13:40:42.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:42 smithi037 conmon[35544]: mon.0) 763 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T13:40:43.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:42.684541+0000 mgr.smithi033.xvkvzp (mgr.14626) 25 : cephadm [INF] Upgrade: Updating mon.smithi033 2022-02-02T13:40:43.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: audit 2022-02-02T13:40:42.688759+0000 mon.smithi033 (mon.0) 764 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:43.729 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: audit 2022-02-02T13:40:42.689539+0000 mon.smithi033 (mon.0) 765 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:40:43.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: audit 2022-02-02T13:40:42.690215+0000 mon.smithi033 (mon.0) 766 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:40:43.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: audit 2022-02-02T13:40:42.690858+0000 mon.smithi033 (mon.0) 767 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:43.730 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: cephadm 2022-02-02T13:40:42.691552+0000 mgr.smithi033.xvkvzp (mgr.14626) 26 : cephadm [INF] Deploying daemon mon.smithi033 on smithi033 2022-02-02T13:40:43.731 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: cluster 2022-02-02T13:40:43.304046+0000 mgr.smithi033.xvkvzp 2022-02-02T13:40:43.731 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:43 smithi033 conmon[31996]: (mgr.14626) 27 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s rd, 3 op/s 2022-02-02T13:40:44.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:42.684541+0000 mgr.smithi033.xvkvzp (mgr.14626) 25 : cephadm [INF] Upgrade: Updating mon.smithi033 2022-02-02T13:40:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: audit 2022-02-02T13:40:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: 2022-02-02T13:40:42.688759+0000 mon.smithi033 (mon.0) 764 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: audit 2022-02-02T13:40:42.689539+0000 mon.smithi033 (mon.0) 765 : audit [INF] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:40:44.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: 02-02T13:40:42.690215+0000 mon.smithi033 (mon.0) 766 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:40:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: audit 2022-02- 2022-02-02T13:40:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: 02T13:40:42.690858+0000 mon.smithi033 (mon.0) 767 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:44.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:42 2022-02-02T13:40:44.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: .691552+0000 mgr.smithi033.xvkvzp (mgr.14626) 26 : cephadm [INF] Deploying daemon mon.smithi033 on smithi033 2022-02-02T13:40:44.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: cluster 2022-02-02T13:40:43 2022-02-02T13:40:44.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:43 smithi037 conmon[35544]: .304046+0000 mgr.smithi033.xvkvzp (mgr.14626) 27 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s rd, 3 op/s 2022-02-02T13:40:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 systemd[1]: Stopping Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:40:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 conmon[31996]: debug 2022-02-02T13:40:44.210+0000 7f1ee5180700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi033 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T13:40:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 conmon[31996]: debug 2022-02-02T13:40:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 conmon[31996]: 2022-02-02T13:40:44.210+0000 7f1ee5180700 -1 mon.smithi033@0(leader) e2 *** Got Signal Terminated *** 2022-02-02T13:40:44.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 bash[100746]: ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon.smithi033 2022-02-02T13:40:44.856 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 bash[100746]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon-smithi033" found: no such container 2022-02-02T13:40:45.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 bash[100746]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon.smithi033" found: no such container 2022-02-02T13:40:45.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi033.service: Succeeded. 2022-02-02T13:40:45.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:44 smithi033 systemd[1]: Stopped Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:40:45.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 systemd[1]: Starting Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:40:45.621 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 podman[101101]: 2022-02-02T13:40:45.621 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: set uid:gid to 167:167 (ceph:ceph) 2022-02-02T13:40:45.621 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev), process ceph-mon, pid 7 2022-02-02T13:40:45.621 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: pidfile_write: ignore empty --pid-file 2022-02-02T13:40:45.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: load: jerasure load: lrc 2022-02-02T13:40:45.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: RocksDB version: 6.15.5 2022-02-02T13:40:45.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T13:40:45.622 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Compile date Feb 2 2022 2022-02-02T13:40:45.623 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: DB SUMMARY 2022-02-02T13:40:45.623 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: DB Session ID: 7OAVVSXMJ5CAFR7PQI3B 2022-02-02T13:40:45.623 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: CURRENT file: CURRENT 2022-02-02T13:40:45.623 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 bash[100944]: 9624ba3f3e1a77d9cb94be55936e50d909bf90bea5f7fb970aab6ade6d46e90c 2022-02-02T13:40:45.623 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: IDENTITY file: IDENTITY 2022-02-02T13:40:45.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2022-02-02T13:40:45.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi033/store.db dir, Total Num: 1, files: 000014.sst 2022-02-02T13:40:45.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi033/store.db: 000012.log size: 8266665 ; 2022-02-02T13:40:45.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.error_if_exists: 0 2022-02-02T13:40:45.625 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.create_if_missing: 0 2022-02-02T13:40:45.625 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.paranoid_checks: 1 2022-02-02T13:40:45.625 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-02-02T13:40:45.625 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.env: 0x55bc559f8860 2022-02-02T13:40:45.625 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.fs: Posix File System 2022-02-02T13:40:45.626 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.info_log: 0x55bc566a3e00 2022-02-02T13:40:45.626 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_file_opening_threads: 16 2022-02-02T13:40:45.626 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.statistics: (nil) 2022-02-02T13:40:45.626 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.use_fsync: 0 2022-02-02T13:40:45.627 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_log_file_size: 0 2022-02-02T13:40:45.627 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T13:40:45.627 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T13:40:45.627 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.keep_log_file_num: 1000 2022-02-02T13:40:45.627 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.recycle_log_file_num: 0 2022-02-02T13:40:45.628 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_fallocate: 1 2022-02-02T13:40:45.628 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_mmap_reads: 0 2022-02-02T13:40:45.628 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_mmap_writes: 0 2022-02-02T13:40:45.628 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.use_direct_reads: 0 2022-02-02T13:40:45.629 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T13:40:45.629 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.create_missing_column_families: 0 2022-02-02T13:40:45.629 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.db_log_dir: 2022-02-02T13:40:45.629 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi033/store.db 2022-02-02T13:40:45.629 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T13:40:45.630 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T13:40:45.630 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T13:40:45.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T13:40:45.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T13:40:45.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T13:40:45.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.advise_random_on_open: 1 2022-02-02T13:40:45.631 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.db_write_buffer_size: 0 2022-02-02T13:40:45.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.write_buffer_manager: 0x55bc56792330 2022-02-02T13:40:45.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T13:40:45.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T13:40:45.632 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T13:40:45.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T13:40:45.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.rate_limiter: (nil) 2022-02-02T13:40:45.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T13:40:45.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.wal_recovery_mode: 2 2022-02-02T13:40:45.633 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.enable_thread_tracking: 0 2022-02-02T13:40:45.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.enable_pipelined_write: 0 2022-02-02T13:40:45.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.unordered_write: 0 2022-02-02T13:40:45.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T13:40:45.634 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T13:40:45.635 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T13:40:45.635 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T13:40:45.635 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.row_cache: None 2022-02-02T13:40:45.635 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.wal_filter: None 2022-02-02T13:40:45.635 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T13:40:45.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_ingest_behind: 0 2022-02-02T13:40:45.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.preserve_deletes: 0 2022-02-02T13:40:45.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.two_write_queues: 0 2022-02-02T13:40:45.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.manual_wal_flush: 0 2022-02-02T13:40:45.636 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.atomic_flush: 0 2022-02-02T13:40:45.637 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T13:40:45.637 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T13:40:45.637 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T13:40:45.637 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.log_readahead_size: 0 2022-02-02T13:40:45.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-02-02T13:40:45.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.best_efforts_recovery: 0 2022-02-02T13:40:45.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-02-02T13:40:45.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-02-02T13:40:45.638 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.allow_data_in_errors: 0 2022-02-02T13:40:45.639 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.db_host_id: __hostname__ 2022-02-02T13:40:45.639 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_background_jobs: 2 2022-02-02T13:40:45.639 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_background_compactions: -1 2022-02-02T13:40:45.639 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_subcompactions: 1 2022-02-02T13:40:45.640 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T13:40:45.640 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T13:40:45.640 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T13:40:45.641 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_total_wal_size: 0 2022-02-02T13:40:45.641 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T13:40:45.641 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T13:40:45.641 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T13:40:45.641 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T13:40:45.642 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_open_files: -1 2022-02-02T13:40:45.642 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bytes_per_sync: 0 2022-02-02T13:40:45.642 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T13:40:45.643 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T13:40:45.643 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_readahead_size: 0 2022-02-02T13:40:45.643 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_background_flushes: -1 2022-02-02T13:40:45.643 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Compression algorithms supported: 2022-02-02T13:40:45.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T13:40:45.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kZSTD supported: 0 2022-02-02T13:40:45.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kXpressCompression supported: 0 2022-02-02T13:40:45.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kLZ4HCCompression supported: 1 2022-02-02T13:40:45.644 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kLZ4Compression supported: 1 2022-02-02T13:40:45.645 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kBZip2Compression supported: 0 2022-02-02T13:40:45.645 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kZlibCompression supported: 1 2022-02-02T13:40:45.645 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: kSnappyCompression supported: 1 2022-02-02T13:40:45.645 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T13:40:45.646 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000008 2022-02-02T13:40:45.646 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2022-02-02T13:40:45.646 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T13:40:45.646 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.merge_operator: 2022-02-02T13:40:45.646 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_filter: None 2022-02-02T13:40:45.647 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_filter_factory: None 2022-02-02T13:40:45.647 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.sst_partitioner_factory: None 2022-02-02T13:40:45.647 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T13:40:45.647 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T13:40:45.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bc5666fc20) 2022-02-02T13:40:45.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks: 1 2022-02-02T13:40:45.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T13:40:45.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T13:40:45.648 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: pin_top_level_index_and_filter: 1 2022-02-02T13:40:45.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_type: 0 2022-02-02T13:40:45.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_index_type: 0 2022-02-02T13:40:45.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_shortening: 1 2022-02-02T13:40:45.649 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2022-02-02T13:40:45.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: hash_index_allow_collision: 1 2022-02-02T13:40:45.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: checksum: 1 2022-02-02T13:40:45.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: no_block_cache: 0 2022-02-02T13:40:45.650 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache: 0x55bc566da170 2022-02-02T13:40:45.651 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_name: BinnedLRUCache 2022-02-02T13:40:45.651 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_options: 2022-02-02T13:40:45.651 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: capacity : 536870912 2022-02-02T13:40:45.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: num_shard_bits : 4 2022-02-02T13:40:45.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: strict_capacity_limit : 0 2022-02-02T13:40:45.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: high_pri_pool_ratio: 0.000 2022-02-02T13:40:45.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_cache_compressed: (nil) 2022-02-02T13:40:45.652 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: persistent_cache: (nil) 2022-02-02T13:40:45.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size: 4096 2022-02-02T13:40:45.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_size_deviation: 10 2022-02-02T13:40:45.653 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_restart_interval: 16 2022-02-02T13:40:45.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: index_block_restart_interval: 1 2022-02-02T13:40:45.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: metadata_block_size: 4096 2022-02-02T13:40:45.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: partition_filters: 0 2022-02-02T13:40:45.654 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: use_delta_encoding: 1 2022-02-02T13:40:45.655 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T13:40:45.655 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: whole_key_filtering: 1 2022-02-02T13:40:45.655 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: verify_compression: 0 2022-02-02T13:40:45.655 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: read_amp_bytes_per_bit: 0 2022-02-02T13:40:45.655 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: format_version: 4 2022-02-02T13:40:45.656 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_index_compression: 1 2022-02-02T13:40:45.656 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: block_align: 0 2022-02-02T13:40:45.656 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.write_buffer_size: 33554432 2022-02-02T13:40:45.656 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_write_buffer_number: 2 2022-02-02T13:40:45.656 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression: NoCompression 2022-02-02T13:40:45.657 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression: Disabled 2022-02-02T13:40:45.657 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.prefix_extractor: nullptr 2022-02-02T13:40:45.657 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T13:40:45.658 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.num_levels: 7 2022-02-02T13:40:45.658 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T13:40:45.658 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T13:40:45.659 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T13:40:45.659 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T13:40:45.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T13:40:45.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T13:40:45.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T13:40:45.661 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:40:45.661 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-02-02T13:40:45.661 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T13:40:45.662 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T13:40:45.662 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.level: 32767 2022-02-02T13:40:45.663 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.strategy: 0 2022-02-02T13:40:45.663 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T13:40:45.663 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:40:45.664 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-02-02T13:40:45.664 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compression_opts.enabled: false 2022-02-02T13:40:45.664 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T13:40:45.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T13:40:45.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T13:40:45.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.target_file_size_base: 67108864 2022-02-02T13:40:45.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T13:40:45.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T13:40:45.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T13:40:45.666 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T13:40:45.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T13:40:45.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T13:40:45.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T13:40:45.667 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T13:40:45.668 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T13:40:45.668 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T13:40:45.668 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T13:40:45.668 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T13:40:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T13:40:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.arena_block_size: 4194304 2022-02-02T13:40:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T13:40:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T13:40:45.669 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T13:40:45.670 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.disable_auto_compactions: 0 2022-02-02T13:40:45.670 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T13:40:45.670 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T13:40:45.670 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T13:40:45.671 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T13:40:45.671 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T13:40:45.671 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T13:40:45.671 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T13:40:45.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T13:40:45.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T13:40:45.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T13:40:45.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.table_properties_collectors: 2022-02-02T13:40:45.672 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.inplace_update_support: 0 2022-02-02T13:40:45.673 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T13:40:45.673 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T13:40:45.673 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T13:40:45.673 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T13:40:45.673 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.bloom_locality: 0 2022-02-02T13:40:45.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.max_successive_merges: 0 2022-02-02T13:40:45.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T13:40:45.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.paranoid_file_checks: 0 2022-02-02T13:40:45.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.force_consistency_checks: 1 2022-02-02T13:40:45.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.report_bg_io_stats: 0 2022-02-02T13:40:45.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.ttl: 2592000 2022-02-02T13:40:45.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T13:40:45.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.enable_blob_files: false 2022-02-02T13:40:45.676 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.min_blob_size: 0 2022-02-02T13:40:45.676 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.blob_file_size: 268435456 2022-02-02T13:40:45.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.blob_compression_type: NoCompression 2022-02-02T13:40:45.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.enable_blob_garbage_collection: false 2022-02-02T13:40:45.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-02-02T13:40:45.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:40:45.677 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi033/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6531, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T13:40:45.678 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 12 2022-02-02T13:40:45.678 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:4083] Creating manifest 16 2022-02-02T13:40:45.678 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:40:45.678 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809245518822, "job": 1, "event": "recovery_started", "wal_files": [12]} 2022-02-02T13:40:45.679 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #12 mode 2 2022-02-02T13:40:45.679 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T13:40:45.680 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809245535083, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 17, "file_size": 7893731, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 7884534, "index_size": 6912, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1349, "raw_key_size": 10953, "raw_average_key_size": 20, "raw_value_size": 7869507, "raw_average_value_size": 15046, "num_data_blocks": 313, "num_entries": 523, "num_deletions": 5, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643809245, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "421125e2-e635-4514-878f-753fc0f60767", "db_session_id": "7OAVVSXMJ5CAFR7PQI3B"}} 2022-02-02T13:40:45.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:4083] Creating manifest 18 2022-02-02T13:40:45.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:40:45.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809245539618, "job": 1, "event": "recovery_finished"} 2022-02-02T13:40:45.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi033/store.db/000012.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-02-02T13:40:45.681 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55bc566c0a80 2022-02-02T13:40:45.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: DB pointer 0x55bc566d0000 2022-02-02T13:40:45.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2022-02-02T13:40:45.682 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-02-02T13:40:45.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** DB Stats ** 2022-02-02T13:40:45.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:40:45.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T13:40:45.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T13:40:45.683 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:40:45.684 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T13:40:45.684 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T13:40:45.685 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:40:45.685 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.685 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2022-02-02T13:40:45.685 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:40:45.686 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:40:45.686 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L0 1/0 7.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L6 1/0 17.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:40:45.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Sum 2/0 24.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.687 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2022-02-02T13:40:45.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:40:45.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:40:45.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.688 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:40:45.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Flush(GB): cumulative 0.007, interval 0.007 2022-02-02T13:40:45.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:40:45.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:40:45.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:40:45.690 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:40:45.690 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative compaction: 0.01 GB write, 318.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:40:45.690 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval compaction: 0.01 GB write, 318.65 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:40:45.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:40:45.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:40:45.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.691 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2022-02-02T13:40:45.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:40:45.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:40:45.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L0 1/0 7.53 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.692 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: L6 1/0 17.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:40:45.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Sum 2/0 24.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:40:45.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.693 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** Compaction Stats [default] ** 2022-02-02T13:40:45.694 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:40:45.694 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:40:45.694 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 789.5 0.01 0.00 1 0.010 0 0 2022-02-02T13:40:45.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:40:45.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Flush(GB): cumulative 0.007, interval 0.000 2022-02-02T13:40:45.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:40:45.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:40:45.695 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:40:45.696 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:40:45.696 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Cumulative compaction: 0.01 GB write, 318.16 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:40:45.696 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:40:45.696 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:40:45.697 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.697 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:40:45.697 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: starting mon.smithi033 rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi033 fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:40:45.697 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???) e2 preinit fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:40:45.698 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).mds e30 new map 2022-02-02T13:40:45.698 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).mds e30 print_map 2022-02-02T13:40:45.698 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: e30 2022-02-02T13:40:45.698 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:40:45.699 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:45.699 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: legacy client fscid: 1 2022-02-02T13:40:45.699 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.699 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Filesystem 'cephfs' (1) 2022-02-02T13:40:45.700 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: fs_name cephfs 2022-02-02T13:40:45.700 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: epoch 29 2022-02-02T13:40:45.700 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:40:45.700 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:40:45.701 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: modified 2022-02-02T13:40:36.270569+0000 2022-02-02T13:40:45.701 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: tableserver 0 2022-02-02T13:40:45.702 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: root 0 2022-02-02T13:40:45.702 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: session_timeout 60 2022-02-02T13:40:45.702 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: session_autoclose 300 2022-02-02T13:40:45.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_file_size 1099511627776 2022-02-02T13:40:45.703 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: required_client_features {} 2022-02-02T13:40:45.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: last_failure 0 2022-02-02T13:40:45.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: last_failure_osd_epoch 50 2022-02-02T13:40:45.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:45.704 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: max_mds 1 2022-02-02T13:40:45.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: in 0 2022-02-02T13:40:45.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: up {0=14630} 2022-02-02T13:40:45.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: failed 2022-02-02T13:40:45.705 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: damaged 2022-02-02T13:40:45.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: stopped 2022-02-02T13:40:45.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: data_pools [3] 2022-02-02T13:40:45.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: metadata_pool 2 2022-02-02T13:40:45.706 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: inline_data enabled 2022-02-02T13:40:45.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: balancer 2022-02-02T13:40:45.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: standby_count_wanted 1 2022-02-02T13:40:45.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi033.cdqmmc{0:14630} state up:reconnect seq 9 join_fscid=1 addr [v2:172.21.15.33:6800/4266944735,v1:172.21.15.33:6801/4266944735] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T13:40:45.707 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: Standby daemons: 2022-02-02T13:40:45.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: 2022-02-02T13:40:45.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:45.708 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:45.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout: [mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:45.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).osd e50 crush map has features 3314933000852226048, adjusting msgr requires 2022-02-02T13:40:45.709 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:40:45.710 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:40:45.710 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).osd e50 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:40:45.710 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 ceph-mon[101165]: mon.smithi033@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2022-02-02T13:40:45.711 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:45 smithi033 systemd[1]: Started Ceph mon.smithi033 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:40:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 -- 172.21.15.33:0/37755143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 msgr2=0x7fddc00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 --2- 172.21.15.33:0/37755143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc00f6cc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fddb0009fd0 tx=0x7fddb0009ba0).stop 2022-02-02T13:40:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 -- 172.21.15.33:0/37755143 shutdown_connections 2022-02-02T13:40:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 --2- 172.21.15.33:0/37755143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc00f6cc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 --2- 172.21.15.33:0/37755143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:45.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 -- 172.21.15.33:0/37755143 >> 172.21.15.33:0/37755143 conn(0x7fddc00f0d40 msgr2=0x7fddc00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:45.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 -- 172.21.15.33:0/37755143 shutdown_connections 2022-02-02T13:40:45.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.953+0000 7fddc7839700 1 -- 172.21.15.33:0/37755143 wait complete. 2022-02-02T13:40:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 Processor -- start 2022-02-02T13:40:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 -- start start 2022-02-02T13:40:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc0109ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0060420 con 0x7fddc00f6860 2022-02-02T13:40:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.954+0000 7fddc7839700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc0060560 con 0x7fddc00f55c0 2022-02-02T13:40:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39716/0 (socket says 172.21.15.33:39716) 2022-02-02T13:40:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 -- 172.21.15.33:0/3129748296 learned_addr learned my addr 172.21.15.33:0/3129748296 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc0109ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 msgr2=0x7fddc0109ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc0109ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0005040 con 0x7fddc00f55c0 2022-02-02T13:40:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc0109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:40:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc55d5700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fddbc0049f0 tx=0x7fddbc009b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc00fa30 con 0x7fddc00f55c0 2022-02-02T13:40:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fddbc015470 con 0x7fddc00f55c0 2022-02-02T13:40:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc010a4e0 con 0x7fddc00f55c0 2022-02-02T13:40:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.955+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddbc014630 con 0x7fddc00f55c0 2022-02-02T13:40:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.956+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc010aaa0 con 0x7fddc00f55c0 2022-02-02T13:40:45.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fddbc0148f0 con 0x7fddc00f55c0 2022-02-02T13:40:45.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc00f49b0 con 0x7fddc00f55c0 2022-02-02T13:40:45.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddb5ffb700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:45.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:45.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6117+0+0 (secure 0 0 0) 0x7fddbc0827c0 con 0x7fddc00f55c0 2022-02-02T13:40:45.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.957+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2022-02-02T13:40:45.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:45.962+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fddbc0519b0 con 0x7fddc00f55c0 2022-02-02T13:40:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:46.158+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:46.158+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2022-02-02T13:40:46.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:46.165+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddc00ffd00 con 0x7fddac064de0 2022-02-02T13:40:46.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: audit 2022-02-02T13:40:44. 2022-02-02T13:40:46.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 222123+0000 mon.smithi037 (mon.1) 70 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:40:46.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: audit 2022-02-02T13:40:44.223569+0000 mon.smithi037 (mon.1) 71 : audit [DBG] from='mgr.14626 172.21.15.33:0/1260374907' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:40:46.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.304435+0000 mgr.smithi033.xvkvzp (mgr.14626) 28 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 99 KiB/s rd, 3 op/s 2022-02-02T13:40:46.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.750607+0000 mon.smithi033 (mon.0) 1 : cluster [INF] mon.smithi033 calling monitor election 2022-02-02T13:40:46.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.763855+0000 mon.smithi033 (mon.0) 2 : cluster [INF] mon.smithi033 is new leader, mons smithi033,smithi037 in quorum (ranks 0,1) 2022-02-02T13:40:46.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.769249+0000 mon.smithi033 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2022-02-02T13:40:46.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.769336+0000 mon.smithi033 (mon.0) 4 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:46.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.769370+0000 mon.smithi033 (mon.0) 5 : cluster [DBG] osdmap e50: 6 total, 6 up, 6 in 2022-02-02T13:40:46.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.770103+0000 mon.smithi033 (mon.0) 6 : cluster [DBG] mgrmap e30: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:40:46.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:45.778122+0000 mon.smithi033 (mon.0) 7 : cluster [DBG] mgrmap e31: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:40:46.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:40:46.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 40:45.778156+0000 mon.smithi033 (mon.0) 8 : cluster 2022-02-02T13:40:46.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: [WRN] Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:46.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40 2022-02-02T13:40:46.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: :45.778182+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:46.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 9 : cluster [WRN] [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:40:46.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02 2022-02-02T13:40:46.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: T13:40:45.778192+0000 mon.smithi033 2022-02-02T13:40:46.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: (mon.0) 10 : cluster [WRN] daemon mds.cephfs.smithi033.kvxxkv on smithi033 is in error state 2022-02-02T13:40:46.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 2022-02-02T13:40:46.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:46.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 2022-02-02T13:40:45.778202+0000 2022-02-02T13:40:46.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: mon.smithi033 (mon.0) 11 : cluster [WRN] 2022-02-02T13:40:46.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:40:46.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40:46.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 2022-02-02T13:40:45.778210+0000 2022-02-02T13:40:46.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: mon.smithi033 (mon.0) 12 : cluster [WRN] 2022-02-02T13:40:46.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: fs cephfs is degraded 2022-02-02T13:40:46.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02-02T13:40 2022-02-02T13:40:46.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: :45.778219+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:46.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 13 : cluster [WRN] [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:40:46.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: cluster 2022-02- 2022-02-02T13:40:46.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 02T13:40:45.778229+0000 2022-02-02T13:40:46.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: mon.smithi033 (mon.0) 14 : cluster [WRN] fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:40:46.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:40:46.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: :40:45.778357+0000 mon.smithi033 (mon 2022-02-02T13:40:46.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: .0) 15 : audit [INF] from='mgr.14626 ' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:46.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: audit 2022 2022-02-02T13:40:46.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: -02-02T13:40:45. 2022-02-02T13:40:46.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: 788026+0000 mon.smithi033 (mon.0) 16 : audit 2022-02-02T13:40:46.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:45 smithi037 conmon[35544]: [INF] from='mgr.14626 ' entity='' 2022-02-02T13:40:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:46.559+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:46.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:46.559+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2022-02-02T13:40:47.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:47.360+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:47.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:47.360+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2022-02-02T13:40:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:40:47 smithi033 conmon[101141]: 2022-02-02T13:40:47.284+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:47 smithi037 conmon[35544]: cluster 2022-02-02T13:40:47.234909+0000 mon.smithi033 2022-02-02T13:40:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:47 smithi037 conmon[35544]: (mon.0) 17 : cluster [INF] daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:40:47.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:47 smithi037 conmon[35544]: cluster 2022-02-02T13:40:47.237943+0000 mon.smithi033 (mon.0) 18 : 2022-02-02T13:40:47.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:47 smithi037 conmon[35544]: cluster [DBG] osdmap e51: 6 total, 6 up, 6 in 2022-02-02T13:40:48.646 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:47.285604+0000 mon.smithi033 ( 2022-02-02T13:40:48.647 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: mon.0) 19 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:40:48.647 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:47.288639+0000 mon.smithi033 (mon.0) 20 : 2022-02-02T13:40:48.648 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster [DBG] mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:boot 2022-02-02T13:40:48.648 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:48.648 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 2022-02-02T13:40:47.288709+0000 mon.smithi033 (mon. 2022-02-02T13:40:48.648 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 0) 21 : cluster [INF] Standby daemon mds.cephfs.smithi033.cdqmmc assigned to filesystem cephfs as rank 0 2022-02-02T13:40:48.649 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:48.649 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 2022-02-02T13: 2022-02-02T13:40:48.649 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 40:47.288848+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:48.649 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 22 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:40:48.650 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:48.650 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 2022-02-02T13:40: 2022-02-02T13:40:48.650 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 47.289132+0000 mon.smithi033 (mon.0) 23 : 2022-02-02T13:40:48.650 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster [DBG] fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:40:48.651 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: cluster 2022-02-02T13:40:48.651 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 2022-02-02T13:40:47. 2022-02-02T13:40:48.651 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: 293985+0000 mon.smithi033 (mon.0) 24 : cluster 2022-02-02T13:40:48.651 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:48 smithi037 conmon[35544]: [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 3 up:standby 2022-02-02T13:40:48.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:48.962+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:48.962+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2022-02-02T13:40:52.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:52.165+0000 7fddc4dd4700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6826/271477002 2022-02-02T13:40:52.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:52.165+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 6.400000 2022-02-02T13:40:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:54.104+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 32) v1 ==== 82416+0+0 (secure 0 0 0) 0x7fddbc00fdb0 con 0x7fddc00f55c0 2022-02-02T13:40:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:54.104+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 msgr2=0x7fddac0672a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:40:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:54.104+0000 7fddb5ffb700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:54.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.091936+0000 mon.smithi033 (mon.0 2022-02-02T13:40:54.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: ) 25 : cluster [DBG] mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:reconnect 2022-02-02T13:40:54.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.091995+0000 mon.smithi033 (mon.0) 26 : cluster [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:40:54.415 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40 2022-02-02T13:40:54.416 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: :53.140071+0000 mon.smithi033 (mon.0) 27 : cluster [DBG] Standby manager daemon smithi037.npteou restarted 2022-02-02T13:40:54.416 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.140164+0000 mon.smithi033 2022-02-02T13:40:54.416 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: (mon.0) 28 : cluster [DBG] Standby manager daemon smithi037.npteou started 2022-02-02T13:40:54.416 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: audit 2022- 2022-02-02T13:40:54.416 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: 02-02T13:40:53.142332+0000 mon.smithi037 (mon.1) 72 : audit [DBG] from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:40:54.417 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: 2022-02-02T13:40:54.417 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: audit 2022-02-02T13 2022-02-02T13:40:54.417 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: :40:53.142871+0000 mon.smithi037 (mon.1) 73 : audit [DBG] from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:40:54.417 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: audit 2022-02-02T 2022-02-02T13:40:54.418 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: 13:40:53.144745+0000 mon.smithi037 (mon.1) 74 : audit [DBG] from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:40:54.418 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: audit 2022-02-02T13:40:53.146070+0000 mon.smithi037 ( 2022-02-02T13:40:54.418 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: mon.1) 75 : audit [DBG] from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:40:54.418 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.147665+0000 mds.cephfs.smithi033.cdqmmc 2022-02-02T13:40:54.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: (mds.0) 1 : cluster [DBG] reconnect by client.24335 v1:192.168.0.1:0/3031626784 after 0.0569991 2022-02-02T13:40:54.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.178117+0000 2022-02-02T13:40:54.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: mds.cephfs.smithi033.cdqmmc (mds.0) 2 : cluster [DBG] reconnect by client.24331 v1:172.21.15.33:0/123632270 after 0.0879986 2022-02-02T13:40:54.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53.381718+0000 2022-02-02T13:40:54.420 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: mon.smithi033 (mon.0) 29 : cluster [INF] Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:40:54.420 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13:40:53. 2022-02-02T13:40:54.420 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: 382251+0000 mon.smithi033 (mon.0) 30 : cluster [INF] Activating manager daemon smithi033.xvkvzp 2022-02-02T13:40:54.420 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: cluster 2022-02-02T13: 2022-02-02T13:40:54.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: 40:53.385046+0000 mon.smithi033 (mon.0) 31 : cluster [DBG] 2022-02-02T13:40:54.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:54 smithi037 conmon[35544]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T13:40:55.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.111+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mon.1 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 33) v1 ==== 82526+0+0 (secure 0 0 0) 0x7fddbc015650 con 0x7fddc00f55c0 2022-02-02T13:40:55.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.111+0000 7fddb5ffb700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 0x7fddac06e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.111+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fddc00ffd00 con 0x7fddac032370 2022-02-02T13:40:55.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.112+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 0x7fddac06e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.112+0000 7fddc4dd4700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 0x7fddac06e950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fddb0004fd0 tx=0x7fddb0002040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.114+0000 7fddb5ffb700 1 -- 172.21.15.33:0/3129748296 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+257 (secure 0 0 0) 0x7fddc00ffd00 con 0x7fddac032370 2022-02-02T13:40:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 msgr2=0x7fddac06e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 0x7fddac06e950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fddb0004fd0 tx=0x7fddb0002040).stop 2022-02-02T13:40:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 msgr2=0x7fddc01079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fddbc0049f0 tx=0x7fddbc009b90).stop 2022-02-02T13:40:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 shutdown_connections 2022-02-02T13:40:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddac032370 0x7fddac06e950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:6826/271477002,v1:172.21.15.33:6827/271477002] conn(0x7fddac064de0 0x7fddac0672a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:40:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddc00f55c0 0x7fddc01079d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 --2- 172.21.15.33:0/3129748296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddc00f6860 0x7fddc0109ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.118+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 >> 172.21.15.33:0/3129748296 conn(0x7fddc00f0d40 msgr2=0x7fddc00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.119+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 shutdown_connections 2022-02-02T13:40:55.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.119+0000 7fddc7839700 1 -- 172.21.15.33:0/3129748296 wait complete. 2022-02-02T13:40:55.135 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:40:55.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 -- 172.21.15.33:0/3513522062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 msgr2=0x7f85300f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 --2- 172.21.15.33:0/3513522062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f4dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8520004660 tx=0x7f8520009b30).stop 2022-02-02T13:40:55.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 -- 172.21.15.33:0/3513522062 shutdown_connections 2022-02-02T13:40:55.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 --2- 172.21.15.33:0/3513522062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 0x7f85300f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 --2- 172.21.15.33:0/3513522062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f4dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 -- 172.21.15.33:0/3513522062 >> 172.21.15.33:0/3513522062 conn(0x7f85300f04c0 msgr2=0x7f85300f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 -- 172.21.15.33:0/3513522062 shutdown_connections 2022-02-02T13:40:55.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.232+0000 7f85369f4700 1 -- 172.21.15.33:0/3513522062 wait complete. 2022-02-02T13:40:55.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 Processor -- start 2022-02-02T13:40:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 -- start start 2022-02-02T13:40:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 0x7f85300f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300f5f30 con 0x7f85300f49a0 2022-02-02T13:40:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f85369f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85300f6070 con 0x7f85300f5340 2022-02-02T13:40:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f852ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f852ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57476/0 (socket says 172.21.15.33:57476) 2022-02-02T13:40:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.233+0000 7f852ffff700 1 -- 172.21.15.33:0/1303914194 learned_addr learned my addr 172.21.15.33:0/1303914194 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852f7fe700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 0x7f85300f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852ffff700 1 -- 172.21.15.33:0/1303914194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 msgr2=0x7f85300f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852ffff700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 0x7f85300f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852ffff700 1 -- 172.21.15.33:0/1303914194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8520005040 con 0x7f85300f49a0 2022-02-02T13:40:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852ffff700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8520000c00 tx=0x7f8520009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8520018070 con 0x7f85300f49a0 2022-02-02T13:40:55.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300f62f0 con 0x7f85300f49a0 2022-02-02T13:40:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8520007cf0 con 0x7f85300f49a0 2022-02-02T13:40:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f852001c3c0 con 0x7f85300f49a0 2022-02-02T13:40:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.234+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300f6850 con 0x7f85300f49a0 2022-02-02T13:40:55.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.235+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8530045ad0 con 0x7f85300f49a0 2022-02-02T13:40:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.235+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 33) v1 ==== 82526+0+0 (secure 0 0 0) 0x7f852001c680 con 0x7f85300f49a0 2022-02-02T13:40:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.236+0000 7f852cff9700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 0x7f8518067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.236+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f85200835f0 con 0x7f85300f49a0 2022-02-02T13:40:55.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.236+0000 7f852f7fe700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 0x7f8518067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.236+0000 7f852f7fe700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 0x7f8518067050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8524007fd0 tx=0x7f8524009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.240+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85200517d0 con 0x7f85300f49a0 2022-02-02T13:40:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.432+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f85300ff060 con 0x7f8518064b90 2022-02-02T13:40:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.448+0000 7f852cff9700 1 -- 172.21.15.33:0/1303914194 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f85300ff060 con 0x7f8518064b90 2022-02-02T13:40:55.449 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:40:55.449 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 30s ago 7m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:40:55.450 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 30s ago 7m 6995k - 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:40:55.450 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (6m) 18s ago 6m 7155k - 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:40:55.450 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 30s ago 6m 38.5M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:40:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (50s) 30s ago 3m 12.7M - 16.2.4 8d91d370c2b8 2e88ed522d92 2022-02-02T13:40:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 error 30s ago 3m - - 2022-02-02T13:40:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (66s) 18s ago 3m 16.2M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:40:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (3m) 18s ago 3m 15.1M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:40:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (51s) 30s ago 8m 444M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:40:55.452 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (22s) 18s ago 6m 44.7M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:40:55.452 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 starting - - - 2048M 2022-02-02T13:40:55.452 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (6m) 18s ago 6m 89.1M 2048M 16.2.4 8d91d370c2b8 3146766def98 2022-02-02T13:40:55.452 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (6m) 30s ago 6m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:40:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (6m) 18s ago 6m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:40:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (5m) 30s ago 5m 310M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:40:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (5m) 30s ago 5m 335M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:40:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 30s ago 5m 265M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:40:55.453 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (5m) 18s ago 5m 388M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:40:55.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (4m) 18s ago 4m 317M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:40:55.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (4m) 18s ago 4m 357M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:40:55.454 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (5m) 30s ago 6m 42.9M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:40:55.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 msgr2=0x7f8518067050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 0x7f8518067050 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8524007fd0 tx=0x7f8524009040).stop 2022-02-02T13:40:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 msgr2=0x7f85300f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f8520000c00 tx=0x7f8520009b30).stop 2022-02-02T13:40:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 shutdown_connections 2022-02-02T13:40:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8518064b90 0x7f8518067050 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85300f49a0 0x7f85300f7550 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 --2- 172.21.15.33:0/1303914194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85300f5340 0x7f85300f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 >> 172.21.15.33:0/1303914194 conn(0x7f85300f04c0 msgr2=0x7f85300fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 shutdown_connections 2022-02-02T13:40:55.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.452+0000 7f85369f4700 1 -- 172.21.15.33:0/1303914194 wait complete. 2022-02-02T13:40:55.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cluster 2022-02-02T13:40:54.099051+0000 mon.smithi033 (mon.0) 32 : cluster [DBG] mgrmap e32: smithi033.xvkvzp(active, starting, since 0.716855s), standbys: smithi037.npteou 2022-02-02T13:40:55.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.100962+0000 mon.smithi033 (mon.0) 33 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:40:55.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.101167+0000 mon.smithi033 (mon.0) 34 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:40:55.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.102050+0000 mon.smithi033 (mon.0) 35 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:40:55.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.102251+0000 mon.smithi033 (mon.0) 36 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:40:55.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.102506+0000 mon.smithi033 (mon.0) 37 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:40:55.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.102852+0000 mon.smithi033 (mon.0) 38 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:40:55.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.103179+0000 mon.smithi033 (mon.0) 39 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:40:55.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.103429+0000 mon.smithi033 (mon.0) 40 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:40:55.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.104091+0000 mon.smithi033 (mon.0) 41 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:40:55.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.104501+0000 mon.smithi033 (mon.0) 42 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:40:55.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.104808+0000 mon.smithi033 (mon.0) 43 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:40:55.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.105135+0000 mon.smithi033 (mon.0) 44 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:40:55.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.105424+0000 mon.smithi033 (mon.0) 45 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:40:55.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.105661+0000 mon.smithi033 (mon.0) 46 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:40:55.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.107042+0000 mon.smithi033 (mon.0) 47 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:40:55.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.107395+0000 mon.smithi033 (mon.0) 48 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:40:55.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.107862+0000 mon.smithi033 (mon.0) 49 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:40:55.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cluster 2022-02-02T13:40:54.128998+0000 mon.smithi033 (mon.0) 50 : cluster [INF] Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:40:55.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.157083+0000 mon.smithi033 (mon.0) 51 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:55.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.159960+0000 mon.smithi033 (mon.0) 52 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:40:55.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.161589+0000 mon.smithi033 (mon.0) 53 : audit 2022-02-02T13:40:55.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:40:55.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.162948+0000 mon.smithi033 (mon.0) 54 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:40:55.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:54.164328+0000 mgr.smithi033.xvkvzp (mgr.34102) 1 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:40:55.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 2022-02-02T13:40:55.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.186155+0000 mon.smithi033 ( 2022-02-02T13:40:55.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: mon.0) 55 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:55.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:54.190745+0000 2022-02-02T13:40:55.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: mon.smithi033 (mon.0) 56 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:40:55.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 2022-02-02T13:40:55.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02 2022-02-02T13:40:55.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: -02T13:40:54.199622+0000 mon.smithi033 (mon.0) 57 : audit 2022-02-02T13:40:55.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:40:55.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:54.376315+0000 mgr.smithi033.xvkvzp ( 2022-02-02T13:40:55.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: mgr.34102) 2 : cephadm [INF] [02/Feb/2022:13:40:54] ENGINE Bus STARTING 2022-02-02T13:40:55.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cluster 2022-02-02 2022-02-02T13:40:55.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: T13:40:54.386215+0000 mon.smithi033 (mon.0) 58 2022-02-02T13:40:55.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: : cluster [DBG] mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:rejoin 2022-02-02T13:40:55.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cluster 2022-02-02T13:40:54. 2022-02-02T13:40:55.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 386284+0000 mon.smithi033 (mon.0) 59 : cluster [DBG] 2022-02-02T13:40:55.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:40:55.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:55.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 2022-02-02T13:40:54.610912+0000 mgr.smithi033.xvkvzp (mgr.34102) 3 2022-02-02T13:40:55.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: : cephadm [INF] [02/Feb/2022:13:40:54] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:40:55.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: cephadm 2022-02-02T13:40:54. 2022-02-02T13:40:55.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 611097+0000 mgr.smithi033.xvkvzp (mgr.34102) 4 : cephadm [INF] 2022-02-02T13:40:55.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: [02/Feb/2022:13:40:54] ENGINE Bus STARTED 2022-02-02T13:40:55.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: audit 2022-02-02T13:40:55.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: 2022-02-02T13:40:54.615331+0000 mon.smithi033 (mon.0) 60 : audit 2022-02-02T13:40:55.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:55 smithi037 conmon[35544]: [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:40:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 -- 172.21.15.33:0/994077416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f7970 msgr2=0x7fc6ec0f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 --2- 172.21.15.33:0/994077416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec0f7dd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6e0004660 tx=0x7fc6e0009b30).stop 2022-02-02T13:40:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 -- 172.21.15.33:0/994077416 shutdown_connections 2022-02-02T13:40:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 --2- 172.21.15.33:0/994077416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec0f7dd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 --2- 172.21.15.33:0/994077416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec0f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 -- 172.21.15.33:0/994077416 >> 172.21.15.33:0/994077416 conn(0x7fc6ec0f1e50 msgr2=0x7fc6ec0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 -- 172.21.15.33:0/994077416 shutdown_connections 2022-02-02T13:40:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.565+0000 7fc6f1269700 1 -- 172.21.15.33:0/994077416 wait complete. 2022-02-02T13:40:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 Processor -- start 2022-02-02T13:40:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 -- start start 2022-02-02T13:40:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec107970 con 0x7fc6ec0f66d0 2022-02-02T13:40:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6f1269700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec107ab0 con 0x7fc6ec0f7970 2022-02-02T13:40:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6ea7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6ea7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:39972/0 (socket says 172.21.15.33:39972) 2022-02-02T13:40:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6ea7fc700 1 -- 172.21.15.33:0/1513201054 learned_addr learned my addr 172.21.15.33:0/1513201054 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6ea7fc700 1 -- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 msgr2=0x7fc6ec106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.566+0000 7fc6ea7fc700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6ea7fc700 1 -- 172.21.15.33:0/1513201054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0005040 con 0x7fc6ec0f7970 2022-02-02T13:40:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6eaffd700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:40:55.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6ea7fc700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc6e0002040 tx=0x7fc6e000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e0019070 con 0x7fc6ec0f7970 2022-02-02T13:40:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc6e0007e70 con 0x7fc6ec0f7970 2022-02-02T13:40:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec1083f0 con 0x7fc6ec0f7970 2022-02-02T13:40:55.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec108950 con 0x7fc6ec0f7970 2022-02-02T13:40:55.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.567+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e0014db0 con 0x7fc6ec0f7970 2022-02-02T13:40:55.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.568+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec045ad0 con 0x7fc6ec0f7970 2022-02-02T13:40:55.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.568+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 82526+0+0 (secure 0 0 0) 0x7fc6e0025070 con 0x7fc6ec0f7970 2022-02-02T13:40:55.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.569+0000 7fc6d37fe700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 0x7fc6d4066ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.569+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7fc6e0082690 con 0x7fc6ec0f7970 2022-02-02T13:40:55.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.569+0000 7fc6eaffd700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 0x7fc6d4066ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.569+0000 7fc6eaffd700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 0x7fc6d4066ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6dc009fd0 tx=0x7fc6dc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.573+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc6e0050930 con 0x7fc6ec0f7970 2022-02-02T13:40:55.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.827+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc6ec027a00 con 0x7fc6ec0f7970 2022-02-02T13:40:55.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.827+0000 7fc6d37fe700 1 -- 172.21.15.33:0/1513201054 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+797 (secure 0 0 0) 0x7fc6e0023020 con 0x7fc6ec0f7970 2022-02-02T13:40:55.829 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:40:55.830 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:40:55.830 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2022-02-02T13:40:55.831 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 1 2022-02-02T13:40:55.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:55.832 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:40:55.832 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:40:55.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:55.832 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:40:55.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:40:55.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:55.833 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:40:55.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:40:55.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:40:55.834 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:40:55.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 11, 2022-02-02T13:40:55.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 3 2022-02-02T13:40:55.834 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:40:55.835 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:40:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 msgr2=0x7fc6d4066ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 0x7fc6d4066ff0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6dc009fd0 tx=0x7fc6dc00b040).stop 2022-02-02T13:40:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 msgr2=0x7fc6ec1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc6e0002040 tx=0x7fc6e000b040).stop 2022-02-02T13:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 shutdown_connections 2022-02-02T13:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6d4064b30 0x7fc6d4066ff0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6ec0f66d0 0x7fc6ec106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 --2- 172.21.15.33:0/1513201054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6ec0f7970 0x7fc6ec1073c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 >> 172.21.15.33:0/1513201054 conn(0x7fc6ec0f1e50 msgr2=0x7fc6ec0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 shutdown_connections 2022-02-02T13:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.829+0000 7fc6f1269700 1 -- 172.21.15.33:0/1513201054 wait complete. 2022-02-02T13:40:55.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/1547369905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 msgr2=0x7f0e780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/1547369905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e780f59e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0e68004660 tx=0x7f0e68009b30).stop 2022-02-02T13:40:55.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/1547369905 shutdown_connections 2022-02-02T13:40:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/1547369905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/1547369905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e780f59e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/1547369905 >> 172.21.15.33:0/1547369905 conn(0x7f0e780f0d40 msgr2=0x7f0e780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/1547369905 shutdown_connections 2022-02-02T13:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.939+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/1547369905 wait complete. 2022-02-02T13:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 Processor -- start 2022-02-02T13:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 -- start start 2022-02-02T13:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e7810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78060310 con 0x7f0e780f55c0 2022-02-02T13:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e7d3bb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e78060450 con 0x7f0e780f6860 2022-02-02T13:40:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57498/0 (socket says 172.21.15.33:57498) 2022-02-02T13:40:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e76ffd700 1 -- 172.21.15.33:0/2386310278 learned_addr learned my addr 172.21.15.33:0/2386310278 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:40:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.940+0000 7f0e767fc700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e7810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2022-02-02T13:40:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e76ffd700 1 -- 172.21.15.33:0/2386310278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 msgr2=0x7f0e7810e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e76ffd700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e7810e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e76ffd700 1 -- 172.21.15.33:0/2386310278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68005040 con 0x7f0e780f55c0 2022-02-02T13:40:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e767fc700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e7810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:40:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e76ffd700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0e68014040 tx=0x7f0e6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e68019070 con 0x7f0e780f55c0 2022-02-02T13:40:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7810e9a0 con 0x7f0e780f55c0 2022-02-02T13:40:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e68007e70 con 0x7f0e780f55c0 2022-02-02T13:40:55.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e68014d10 con 0x7f0e780f55c0 2022-02-02T13:40:55.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.941+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7810edc0 con 0x7f0e780f55c0 2022-02-02T13:40:55.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.942+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e780f49b0 con 0x7f0e780f55c0 2022-02-02T13:40:55.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.942+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 33) v1 ==== 82526+0+0 (secure 0 0 0) 0x7f0e68025070 con 0x7f0e780f55c0 2022-02-02T13:40:55.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.943+0000 7f0e5f7fe700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 0x7f0e60067060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:40:55.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.943+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6547+0+0 (secure 0 0 0) 0x7f0e68082750 con 0x7f0e780f55c0 2022-02-02T13:40:55.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.943+0000 7f0e767fc700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 0x7f0e60067060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:40:55.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.943+0000 7f0e767fc700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 0x7f0e60067060 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0e6c009fd0 tx=0x7f0e6c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:40:55.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:55.948+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e680509f0 con 0x7f0e780f55c0 2022-02-02T13:40:56.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.119+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 34) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e68080820 con 0x7f0e780f55c0 2022-02-02T13:40:56.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.186+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e780fdd80 con 0x7f0e780f55c0 2022-02-02T13:40:56.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.187+0000 7f0e5f7fe700 1 -- 172.21.15.33:0/2386310278 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1849 (secure 0 0 0) 0x7f0e6806ba20 con 0x7f0e780f55c0 2022-02-02T13:40:56.188 INFO:teuthology.orchestra.run.smithi033.stdout:e35 2022-02-02T13:40:56.189 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:40:56.189 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:56.190 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:40:56.190 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:56.191 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:40:56.191 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:40:56.192 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 35 2022-02-02T13:40:56.192 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:40:56.193 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:40:56.193 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:40:56.104972+0000 2022-02-02T13:40:56.193 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:40:56.194 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:40:56.194 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:40:56.195 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:40:56.195 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:40:56.196 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:40:56.196 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:40:56.197 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 51 2022-02-02T13:40:56.197 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:40:56.198 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:40:56.198 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:40:56.198 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24487} 2022-02-02T13:40:56.199 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2022-02-02T13:40:56.199 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:40:56.200 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:40:56.200 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:40:56.201 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:40:56.201 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:40:56.202 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:40:56.202 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:40:56.203 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{0:24487} state up:clientreplay seq 5 join_fscid=1 addr [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T13:40:56.203 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:56.204 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:56.204 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:40:56.205 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:40:56.205 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:56.205 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:56.206 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:40:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 msgr2=0x7f0e60067060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 0x7f0e60067060 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f0e6c009fd0 tx=0x7f0e6c00b040).stop 2022-02-02T13:40:56.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 msgr2=0x7f0e7810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:40:56.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0e68014040 tx=0x7f0e6800b040).stop 2022-02-02T13:40:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 shutdown_connections 2022-02-02T13:40:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e60064ba0 0x7f0e60067060 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e780f55c0 0x7f0e7810bfb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 --2- 172.21.15.33:0/2386310278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e780f6860 0x7f0e7810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:40:56.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 >> 172.21.15.33:0/2386310278 conn(0x7f0e780f0d40 msgr2=0x7f0e780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:40:56.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 shutdown_connections 2022-02-02T13:40:56.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:40:56.189+0000 7f0e7d3bb700 1 -- 172.21.15.33:0/2386310278 wait complete. 2022-02-02T13:40:56.214 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 35 2022-02-02T13:40:56.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: cluster 2022-02-02T13:40:55.108256+0000 2022-02-02T13:40:56.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: mon.smithi033 (mon.0) 61 : cluster [DBG] mgrmap e33: smithi033.xvkvzp(active, since 1.72608s), standbys: smithi037.npteou 2022-02-02T13:40:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: audit 2022-02-02T13:40:55.114688+0000 mgr.smithi033.xvkvzp (mgr.34102) 5 : audit [DBG] from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: cluster 2022-02-02T13:40:55.116079+0000 mgr.smithi033.xvkvzp (mgr.34102) 6 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: audit 2022-02-02T13:40:55.435147+0000 mgr.smithi033.xvkvzp (mgr.34102) 7 : audit [DBG] from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:40:56.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:56 smithi037 conmon[35544]: audit 2022-02-02T13:40:55.828215+0000 mon.smithi037 (mon.1) 76 : audit [DBG] from='client.? 172.21.15.33:0/1513201054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:40:57.487 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: cluster 2022-02-02T13:40:56.104100+0000 mon.smithi033 (mon.0) 62 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T13:40:57.487 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: cluster 2022-02-02T13:40:56.107179+0000 mgr.smithi033.xvkvzp (mgr.34102) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:40:57.487 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: cluster 2022-02-02T13:40:56.117591+0000 mon.smithi033 (mon.0) 2022-02-02T13:40:57.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: 63 : cluster [DBG] mgrmap e34: smithi033.xvkvzp(active, since 2s), standbys: smithi037.npteou 2022-02-02T13:40:57.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: cluster 2022-02-02T13:40:57.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: 2022-02-02T13:40:56.117664+0000 2022-02-02T13:40:57.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: mon.smithi033 (mon.0) 64 : cluster [DBG] 2022-02-02T13:40:57.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:clientreplay 2022-02-02T13:40:57.489 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: cluster 2022-02-02T13:40:57.489 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: 2022-02-02T13:40:56.117726 2022-02-02T13:40:57.489 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: +0000 mon.smithi033 (mon.0) 65 : cluster 2022-02-02T13:40:57.489 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: [DBG] fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:clientreplay} 3 up:standby 2022-02-02T13:40:57.490 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: audit 2022 2022-02-02T13:40:57.490 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: -02-02T13:40:56. 2022-02-02T13:40:57.490 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: 187944+0000 mon.smithi033 (mon.0) 66 : 2022-02-02T13:40:57.490 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:57 smithi037 conmon[35544]: audit [DBG] from='client.? 172.21.15.33:0/2386310278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:59 smithi037 conmon[35544]: cluster 2022-02-02T13:40:58.107590+0000 mgr.smithi033.xvkvzp 2022-02-02T13:41:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:59 smithi037 conmon[35544]: (mgr.34102) 9 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:59 smithi037 conmon[35544]: audit 2022-02-02T13:40:58.627592+0000 mon.smithi033 (mon.0) 67 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:40:59 smithi037 conmon[35544]: audit 2022-02-02T13:40:59.579931+0000 mon.smithi033 (mon.0) 68 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:00.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:00 smithi037 conmon[35544]: cluster 2022-02-02T13:40:59.658921+0000 mon.smithi033 (mon.0) 69 : cluster [INF] daemon mds.cephfs.smithi033.cdqmmc is now active in filesystem cephfs as rank 0 2022-02-02T13:41:00.861 INFO:tasks.workunit.client.1.smithi037.stdout:7/55: rename d2/d8/l11 to d2/l14 0 2022-02-02T13:41:00.862 INFO:tasks.workunit.client.1.smithi037.stdout:8/39: dread - f9 zero size 2022-02-02T13:41:00.864 INFO:tasks.workunit.client.1.smithi037.stdout:5/15: creat f5 x:0 0 0 2022-02-02T13:41:00.865 INFO:tasks.workunit.client.1.smithi037.stdout:4/58: mknod d9/c10 0 2022-02-02T13:41:01.990 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:01 smithi037 conmon[35544]: cluster 2022-02-02T13:41:00.107964+0000 2022-02-02T13:41:01.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:01 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.34102) 10 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:01.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:01 smithi037 conmon[35544]: cluster 2022-02-02T13:41:00.626085+0000 mon.smithi033 (mon.0) 70 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T13:41:01.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:01 smithi037 conmon[35544]: cluster 2022-02-02T13:41:00.635738+0000 mon.smithi033 (mon.0) 71 : cluster [DBG] mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:active 2022-02-02T13:41:01.992 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:01 smithi037 conmon[35544]: cluster 2022-02-02T13:41:00.635802+0000 mon.smithi033 (mon.0) 72 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi033.cdqmmc=up:active} 3 up:standby 2022-02-02T13:41:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:02 smithi037 conmon[35544]: cluster 2022-02-02T13:41:01.637459+0000 mon.smithi033 (mon.0) 73 : cluster [DBG] mgrmap e35: smithi033.xvkvzp(active, since 8s), standbys: smithi037.npteou 2022-02-02T13:41:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:02 smithi037 conmon[35544]: audit 2022-02-02T13:41:02.360641+0000 mon.smithi033 (mon.0) 74 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:02 smithi037 conmon[35544]: audit 2022-02-02T13:41:02.388328+0000 mon.smithi033 (mon.0) 75 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:02 smithi037 conmon[35544]: audit 2022-02-02T13:41:02.389768+0000 mon.smithi033 (mon.0) 76 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:03.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: cluster 2022-02-02T13:41:02.108577+0000 mgr.smithi033.xvkvzp 2022-02-02T13:41:03.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: (mgr.34102) 11 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2022-02-02T13:41:03.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.184869+0000 mon.smithi033 (mon.0) 77 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:03.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.185959+0000 mon.smithi033 (mon.0) 78 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:03.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.189567+0000 mon.smithi033 (mon.0) 79 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:03.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.195407+0000 mon.smithi033 (mon.0) 80 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:03.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.197267+0000 mon.smithi033 (mon.0) 81 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:03.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: audit 2022-02-02T13:41:03.198140+0000 mon.smithi033 (mon 2022-02-02T13:41:03.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:03 smithi037 conmon[35544]: .0) 82 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T13:41:05.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: cluster 2022-02-02T13:41:03.186857+0000 2022-02-02T13:41:05.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: mgr.smithi033.xvkvzp (mgr.34102) 12 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 1.0 MiB/s wr, 248 op/s 2022-02-02T13:41:05.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: cluster 2022-02-02T13:41:04.183027+0000 mon.smithi033 (mon.0) 83 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:41:05.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: audit 2022-02-02T13:41:04.557741+0000 mon.smithi033 (mon.0) 84 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:05.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: audit 2022-02-02T13:41:04.558847+0000 mon.smithi033 (mon.0) 85 : audit [INF] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:05.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: audit 2022-02-02T13:41:04.559697+0000 mon.smithi033 (mon.0) 86 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:05.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:04 smithi037 conmon[35544]: audit 2022-02-02T13:41:04.560538+0000 mon.smithi033 (mon.0) 87 : audit [DBG] from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:05.871 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:05 smithi037 conmon[35544]: cephadm 2022-02-02T13:41:04.553216+0000 mgr.smithi033.xvkvzp (mgr.34102) 13 : cephadm [INF] Upgrade: Updating mon.smithi037 2022-02-02T13:41:05.871 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:05 smithi037 conmon[35544]: cephadm 2022-02-02T13:41:04.561527+0000 mgr.smithi033.xvkvzp (mgr.34102) 14 : cephadm [INF] Deploying daemon mon.smithi037 on smithi037 2022-02-02T13:41:06.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:05 smithi037 systemd[1]: Stopping Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:41:06.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:05 smithi037 conmon[35544]: debug 2022-02-02T13:41:05.968+0000 7f3c53a0a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi037 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-02-02T13:41:06.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:05 smithi037 conmon[35544]: debug 2022-02-02T13:41:05.968+0000 7f3c53a0a700 -1 mon.smithi037@1(peon) e2 *** Got Signal Terminated *** 2022-02-02T13:41:06.480 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 bash[68594]: ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon.smithi037 2022-02-02T13:41:06.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 bash[68594]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon-smithi037" found: no such container 2022-02-02T13:41:06.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 bash[68594]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-mon.smithi037" found: no such container 2022-02-02T13:41:06.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@mon.smithi037.service: Succeeded. 2022-02-02T13:41:06.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 systemd[1]: Stopped Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:41:06.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 systemd[1]: Starting Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:41:07.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:06 smithi037 podman[68953]: 2022-02-02T13:41:07.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: set uid:gid to 167:167 (ceph:ceph) 2022-02-02T13:41:07.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev), process ceph-mon, pid 7 2022-02-02T13:41:07.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: pidfile_write: ignore empty --pid-file 2022-02-02T13:41:07.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 bash[68800]: 1f28d219515bb9a72883b841efdcc74954464db7b94a0dc4b6462bbab426c350 2022-02-02T13:41:07.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: load: jerasure load: lrc 2022-02-02T13:41:07.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: RocksDB version: 6.15.5 2022-02-02T13:41:07.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-02-02T13:41:07.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Compile date Feb 2 2022 2022-02-02T13:41:07.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: DB SUMMARY 2022-02-02T13:41:07.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: DB Session ID: NCRTXR1CMZF3L4UPIYQD 2022-02-02T13:41:07.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: CURRENT file: CURRENT 2022-02-02T13:41:07.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: IDENTITY file: IDENTITY 2022-02-02T13:41:07.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: MANIFEST file: MANIFEST-000005 size: 316 Bytes 2022-02-02T13:41:07.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi037/store.db dir, Total Num: 1, files: 000011.sst 2022-02-02T13:41:07.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi037/store.db: 000009.log size: 16229938 ; 2022-02-02T13:41:07.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.error_if_exists: 0 2022-02-02T13:41:07.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.create_if_missing: 0 2022-02-02T13:41:07.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.paranoid_checks: 1 2022-02-02T13:41:07.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2022-02-02T13:41:07.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.env: 0x561470189860 2022-02-02T13:41:07.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.fs: Posix File System 2022-02-02T13:41:07.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.info_log: 0x5614720e3e00 2022-02-02T13:41:07.155 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_file_opening_threads: 16 2022-02-02T13:41:07.155 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.statistics: (nil) 2022-02-02T13:41:07.155 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.use_fsync: 0 2022-02-02T13:41:07.156 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_log_file_size: 0 2022-02-02T13:41:07.156 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_manifest_file_size: 1073741824 2022-02-02T13:41:07.157 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.log_file_time_to_roll: 0 2022-02-02T13:41:07.157 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.keep_log_file_num: 1000 2022-02-02T13:41:07.158 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.recycle_log_file_num: 0 2022-02-02T13:41:07.158 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_fallocate: 1 2022-02-02T13:41:07.158 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_mmap_reads: 0 2022-02-02T13:41:07.159 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_mmap_writes: 0 2022-02-02T13:41:07.159 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.use_direct_reads: 0 2022-02-02T13:41:07.160 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-02-02T13:41:07.160 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.create_missing_column_families: 0 2022-02-02T13:41:07.161 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.db_log_dir: 2022-02-02T13:41:07.161 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi037/store.db 2022-02-02T13:41:07.162 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.table_cache_numshardbits: 6 2022-02-02T13:41:07.162 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.WAL_ttl_seconds: 0 2022-02-02T13:41:07.162 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.WAL_size_limit_MB: 0 2022-02-02T13:41:07.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-02-02T13:41:07.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.manifest_preallocation_size: 4194304 2022-02-02T13:41:07.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.is_fd_close_on_exec: 1 2022-02-02T13:41:07.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.advise_random_on_open: 1 2022-02-02T13:41:07.165 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.db_write_buffer_size: 0 2022-02-02T13:41:07.165 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.write_buffer_manager: 0x5614721d2330 2022-02-02T13:41:07.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.access_hint_on_compaction_start: 1 2022-02-02T13:41:07.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-02-02T13:41:07.166 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.random_access_max_buffer_size: 1048576 2022-02-02T13:41:07.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.use_adaptive_mutex: 0 2022-02-02T13:41:07.167 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.rate_limiter: (nil) 2022-02-02T13:41:07.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-02-02T13:41:07.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.wal_recovery_mode: 2 2022-02-02T13:41:07.168 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.enable_thread_tracking: 0 2022-02-02T13:41:07.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.enable_pipelined_write: 0 2022-02-02T13:41:07.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.unordered_write: 0 2022-02-02T13:41:07.169 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_concurrent_memtable_write: 1 2022-02-02T13:41:07.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-02-02T13:41:07.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.write_thread_max_yield_usec: 100 2022-02-02T13:41:07.170 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.write_thread_slow_yield_usec: 3 2022-02-02T13:41:07.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.row_cache: None 2022-02-02T13:41:07.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.wal_filter: None 2022-02-02T13:41:07.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.avoid_flush_during_recovery: 0 2022-02-02T13:41:07.171 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_ingest_behind: 0 2022-02-02T13:41:07.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.preserve_deletes: 0 2022-02-02T13:41:07.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.two_write_queues: 0 2022-02-02T13:41:07.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.manual_wal_flush: 0 2022-02-02T13:41:07.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.atomic_flush: 0 2022-02-02T13:41:07.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-02-02T13:41:07.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.persist_stats_to_disk: 0 2022-02-02T13:41:07.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.write_dbid_to_manifest: 0 2022-02-02T13:41:07.173 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.log_readahead_size: 0 2022-02-02T13:41:07.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.file_checksum_gen_factory: Unknown 2022-02-02T13:41:07.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.best_efforts_recovery: 0 2022-02-02T13:41:07.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2022-02-02T13:41:07.174 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2022-02-02T13:41:07.175 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.allow_data_in_errors: 0 2022-02-02T13:41:07.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.db_host_id: __hostname__ 2022-02-02T13:41:07.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_background_jobs: 2 2022-02-02T13:41:07.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_background_compactions: -1 2022-02-02T13:41:07.176 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_subcompactions: 1 2022-02-02T13:41:07.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.avoid_flush_during_shutdown: 0 2022-02-02T13:41:07.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-02-02T13:41:07.177 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.delayed_write_rate : 16777216 2022-02-02T13:41:07.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_total_wal_size: 0 2022-02-02T13:41:07.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-02-02T13:41:07.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.stats_dump_period_sec: 600 2022-02-02T13:41:07.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.stats_persist_period_sec: 600 2022-02-02T13:41:07.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.stats_history_buffer_size: 1048576 2022-02-02T13:41:07.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_open_files: -1 2022-02-02T13:41:07.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bytes_per_sync: 0 2022-02-02T13:41:07.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.wal_bytes_per_sync: 0 2022-02-02T13:41:07.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.strict_bytes_per_sync: 0 2022-02-02T13:41:07.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_readahead_size: 0 2022-02-02T13:41:07.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_background_flushes: -1 2022-02-02T13:41:07.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Compression algorithms supported: 2022-02-02T13:41:07.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kZSTDNotFinalCompression supported: 0 2022-02-02T13:41:07.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kZSTD supported: 0 2022-02-02T13:41:07.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kXpressCompression supported: 0 2022-02-02T13:41:07.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kLZ4HCCompression supported: 1 2022-02-02T13:41:07.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kLZ4Compression supported: 1 2022-02-02T13:41:07.182 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kBZip2Compression supported: 0 2022-02-02T13:41:07.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kZlibCompression supported: 1 2022-02-02T13:41:07.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: kSnappyCompression supported: 1 2022-02-02T13:41:07.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Fast CRC32 supported: Supported on x86 2022-02-02T13:41:07.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000005 2022-02-02T13:41:07.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2022-02-02T13:41:07.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-02-02T13:41:07.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.merge_operator: 2022-02-02T13:41:07.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_filter: None 2022-02-02T13:41:07.184 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_filter_factory: None 2022-02-02T13:41:07.185 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.sst_partitioner_factory: None 2022-02-02T13:41:07.185 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.memtable_factory: SkipListFactory 2022-02-02T13:41:07.185 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.table_factory: BlockBasedTable 2022-02-02T13:41:07.185 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5614720afc20) 2022-02-02T13:41:07.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks: 1 2022-02-02T13:41:07.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2022-02-02T13:41:07.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2022-02-02T13:41:07.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_top_level_index_and_filter: 1 2022-02-02T13:41:07.186 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_type: 0 2022-02-02T13:41:07.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_index_type: 0 2022-02-02T13:41:07.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_shortening: 1 2022-02-02T13:41:07.187 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2022-02-02T13:41:07.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: hash_index_allow_collision: 1 2022-02-02T13:41:07.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: checksum: 1 2022-02-02T13:41:07.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: no_block_cache: 0 2022-02-02T13:41:07.188 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache: 0x56147211a170 2022-02-02T13:41:07.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_name: BinnedLRUCache 2022-02-02T13:41:07.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_options: 2022-02-02T13:41:07.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: capacity : 536870912 2022-02-02T13:41:07.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: num_shard_bits : 4 2022-02-02T13:41:07.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: strict_capacity_limit : 0 2022-02-02T13:41:07.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: high_pri_pool_ratio: 0.000 2022-02-02T13:41:07.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_compressed: (nil) 2022-02-02T13:41:07.190 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: persistent_cache: (nil) 2022-02-02T13:41:07.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size: 4096 2022-02-02T13:41:07.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size_deviation: 10 2022-02-02T13:41:07.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_restart_interval: 16 2022-02-02T13:41:07.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_block_restart_interval: 1 2022-02-02T13:41:07.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: metadata_block_size: 4096 2022-02-02T13:41:07.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: partition_filters: 0 2022-02-02T13:41:07.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: use_delta_encoding: 1 2022-02-02T13:41:07.192 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2022-02-02T13:41:07.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: whole_key_filtering: 1 2022-02-02T13:41:07.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: verify_compression: 0 2022-02-02T13:41:07.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: read_amp_bytes_per_bit: 0 2022-02-02T13:41:07.193 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: format_version: 4 2022-02-02T13:41:07.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_index_compression: 1 2022-02-02T13:41:07.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_align: 0 2022-02-02T13:41:07.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.write_buffer_size: 33554432 2022-02-02T13:41:07.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_write_buffer_number: 2 2022-02-02T13:41:07.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression: NoCompression 2022-02-02T13:41:07.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression: Disabled 2022-02-02T13:41:07.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.prefix_extractor: nullptr 2022-02-02T13:41:07.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-02-02T13:41:07.195 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.num_levels: 7 2022-02-02T13:41:07.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-02-02T13:41:07.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-02-02T13:41:07.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-02-02T13:41:07.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-02-02T13:41:07.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.level: 32767 2022-02-02T13:41:07.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-02-02T13:41:07.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-02-02T13:41:07.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:41:07.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2022-02-02T13:41:07.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bottommost_compression_opts.enabled: false 2022-02-02T13:41:07.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.window_bits: -14 2022-02-02T13:41:07.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.level: 32767 2022-02-02T13:41:07.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.strategy: 0 2022-02-02T13:41:07.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-02-02T13:41:07.199 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-02-02T13:41:07.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.parallel_threads: 1 2022-02-02T13:41:07.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compression_opts.enabled: false 2022-02-02T13:41:07.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-02-02T13:41:07.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-02-02T13:41:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.level0_stop_writes_trigger: 36 2022-02-02T13:41:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.target_file_size_base: 67108864 2022-02-02T13:41:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.target_file_size_multiplier: 1 2022-02-02T13:41:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_base: 268435456 2022-02-02T13:41:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-02-02T13:41:07.202 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-02-02T13:41:07.202 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-02-02T13:41:07.202 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-02-02T13:41:07.202 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-02-02T13:41:07.203 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-02-02T13:41:07.203 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-02-02T13:41:07.203 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-02-02T13:41:07.203 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-02-02T13:41:07.203 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-02-02T13:41:07.204 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_compaction_bytes: 1677721600 2022-02-02T13:41:07.204 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.arena_block_size: 4194304 2022-02-02T13:41:07.204 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-02-02T13:41:07.204 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-02-02T13:41:07.204 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-02-02T13:41:07.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.disable_auto_compactions: 0 2022-02-02T13:41:07.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-02-02T13:41:07.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-02-02T13:41:07.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-02-02T13:41:07.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-02-02T13:41:07.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-02-02T13:41:07.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-02-02T13:41:07.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-02-02T13:41:07.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-02-02T13:41:07.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-02-02T13:41:07.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-02-02T13:41:07.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.table_properties_collectors: 2022-02-02T13:41:07.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.inplace_update_support: 0 2022-02-02T13:41:07.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.inplace_update_num_locks: 10000 2022-02-02T13:41:07.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-02-02T13:41:07.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.memtable_whole_key_filtering: 0 2022-02-02T13:41:07.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.memtable_huge_page_size: 0 2022-02-02T13:41:07.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.bloom_locality: 0 2022-02-02T13:41:07.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.max_successive_merges: 0 2022-02-02T13:41:07.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.optimize_filters_for_hits: 0 2022-02-02T13:41:07.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.paranoid_file_checks: 0 2022-02-02T13:41:07.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.force_consistency_checks: 1 2022-02-02T13:41:07.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.report_bg_io_stats: 0 2022-02-02T13:41:07.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.ttl: 2592000 2022-02-02T13:41:07.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.periodic_compaction_seconds: 0 2022-02-02T13:41:07.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.enable_blob_files: false 2022-02-02T13:41:07.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.min_blob_size: 0 2022-02-02T13:41:07.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.blob_file_size: 268435456 2022-02-02T13:41:07.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.blob_compression_type: NoCompression 2022-02-02T13:41:07.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.enable_blob_garbage_collection: false 2022-02-02T13:41:07.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2022-02-02T13:41:07.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:41:07.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 13, last_sequence is 6456, log_number is 9,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-02-02T13:41:07.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 9 2022-02-02T13:41:07.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2022-02-02T13:41:07.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:41:07.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809267132517, "job": 1, "event": "recovery_started", "wal_files": [9]} 2022-02-02T13:41:07.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #9 mode 2 2022-02-02T13:41:07.214 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-02-02T13:41:07.214 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 systemd[1]: Started Ceph mon.smithi037 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:41:07.214 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809267162805, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 10260445, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 10248994, "index_size": 8782, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1733, "raw_key_size": 13170, "raw_average_key_size": 20, "raw_value_size": 10230427, "raw_average_value_size": 15935, "num_data_blocks": 399, "num_entries": 642, "num_deletions": 5, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1643809267, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "fca92bde-98d7-4539-8572-63645aa7c297", "db_session_id": "NCRTXR1CMZF3L4UPIYQD"}} 2022-02-02T13:41:07.214 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2022-02-02T13:41:07.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-02-02T13:41:07.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: EVENT_LOG_v1 {"time_micros": 1643809267166367, "job": 1, "event": "recovery_finished"} 2022-02-02T13:41:07.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-smithi037/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2022-02-02T13:41:07.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x561472100a80 2022-02-02T13:41:07.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: DB pointer 0x561472110000 2022-02-02T13:41:07.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2022-02-02T13:41:07.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: rocksdb: [db/db_impl/db_impl.cc:903] 2022-02-02T13:41:07.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** DB Stats ** 2022-02-02T13:41:07.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:41:07.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-02-02T13:41:07.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-02-02T13:41:07.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:41:07.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-02-02T13:41:07.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-02-02T13:41:07.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-02-02T13:41:07.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2022-02-02T13:41:07.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:41:07.219 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:41:07.219 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L0 1/0 9.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.219 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L6 1/0 17.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:41:07.219 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Sum 2/0 26.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.219 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2022-02-02T13:41:07.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:41:07.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:41:07.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:41:07.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Flush(GB): cumulative 0.010, interval 0.010 2022-02-02T13:41:07.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:41:07.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:41:07.222 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:41:07.222 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:41:07.222 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative compaction: 0.01 GB write, 261.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:41:07.222 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval compaction: 0.01 GB write, 261.66 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:41:07.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:41:07.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:41:07.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2022-02-02T13:41:07.224 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:41:07.224 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:41:07.224 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L0 1/0 9.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.224 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L6 1/0 17.20 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:41:07.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Sum 2/0 26.99 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-02-02T13:41:07.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2022-02-02T13:41:07.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-02-02T13:41:07.226 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-02-02T13:41:07.226 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 707.9 0.01 0.00 1 0.014 0 0 2022-02-02T13:41:07.226 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2022-02-02T13:41:07.226 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Flush(GB): cumulative 0.010, interval 0.000 2022-02-02T13:41:07.227 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2022-02-02T13:41:07.227 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2022-02-02T13:41:07.227 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2022-02-02T13:41:07.227 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2022-02-02T13:41:07.227 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative compaction: 0.01 GB write, 261.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:41:07.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-02-02T13:41:07.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-02-02T13:41:07.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2022-02-02T13:41:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: starting mon.smithi037 rank 1 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi037 fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:41:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???) e2 preinit fsid 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:41:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).mds e36 new map 2022-02-02T13:41:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).mds e36 print_map 2022-02-02T13:41:07.229 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: e36 2022-02-02T13:41:07.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:41:07.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:07.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: legacy client fscid: 1 2022-02-02T13:41:07.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.231 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Filesystem 'cephfs' (1) 2022-02-02T13:41:07.231 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: fs_name cephfs 2022-02-02T13:41:07.231 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: epoch 36 2022-02-02T13:41:07.231 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:41:07.231 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:41:07.232 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: modified 2022-02-02T13:41:00.625997+0000 2022-02-02T13:41:07.232 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: tableserver 0 2022-02-02T13:41:07.232 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: root 0 2022-02-02T13:41:07.232 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: session_timeout 60 2022-02-02T13:41:07.233 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: session_autoclose 300 2022-02-02T13:41:07.233 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_file_size 1099511627776 2022-02-02T13:41:07.233 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: required_client_features {} 2022-02-02T13:41:07.233 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: last_failure 0 2022-02-02T13:41:07.233 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: last_failure_osd_epoch 51 2022-02-02T13:41:07.234 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:07.234 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_mds 1 2022-02-02T13:41:07.234 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: in 0 2022-02-02T13:41:07.234 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: up {0=24487} 2022-02-02T13:41:07.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: failed 2022-02-02T13:41:07.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: damaged 2022-02-02T13:41:07.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: stopped 2022-02-02T13:41:07.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_pools [3] 2022-02-02T13:41:07.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: metadata_pool 2 2022-02-02T13:41:07.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: inline_data enabled 2022-02-02T13:41:07.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: balancer 2022-02-02T13:41:07.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: standby_count_wanted 1 2022-02-02T13:41:07.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi033.cdqmmc{0:24487} state up:active seq 7 join_fscid=1 addr [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] compat {c=[1],r=[1],i=[7ff]}] 2022-02-02T13:41:07.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.237 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.237 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Standby daemons: 2022-02-02T13:41:07.237 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2022-02-02T13:41:07.237 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:07.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:07.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:07.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).osd e52 crush map has features 3314933000852226048, adjusting msgr requires 2022-02-02T13:41:07.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:41:07.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:41:07.239 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).osd e52 crush map has features 288514051259236352, adjusting msgr requires 2022-02-02T13:41:07.239 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:07 smithi037 ceph-mon[69017]: mon.smithi037@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2022-02-02T13:41:08.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mkfs 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:41:08.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Applying service osd.None on host smithi037... 2022-02-02T13:41:08.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon osd.4 on smithi037 2022-02-02T13:41:08.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Applying service osd.None on host smithi037... 2022-02-02T13:41:08.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon osd.5 on smithi037 2022-02-02T13:41:08.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Saving service mds.cephfs spec with placement count:4 2022-02-02T13:41:08.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:41:08.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:41:08.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:41:08.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:41:08.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:41:08.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:41:08.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Target is version 17.0.0-10509-gb0d76d45 (unknown) 2022-02-02T13:41:08.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb'] 2022-02-02T13:41:08.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:41:08.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb on smithi037 2022-02-02T13:41:08.547 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:41:08.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:08.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:41:08.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Failing over to other MGR 2022-02-02T13:41:08.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying cephadm binary to smithi033 2022-02-02T13:41:08.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying cephadm binary to smithi037 2022-02-02T13:41:08.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:39:36] ENGINE Bus STARTING 2022-02-02T13:41:08.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:39:36] ENGINE Serving on https://172.21.15.37:7150 2022-02-02T13:41:08.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:39:36] ENGINE Bus STARTED 2022-02-02T13:41:08.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:41:08.549 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Updating mgr.smithi033.xvkvzp 2022-02-02T13:41:08.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:41:08.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:41:08.550 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Failing over to other MGR 2022-02-02T13:41:08.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: inventory: adjusted host smithi037 addr 'smithi037' -> '172.21.15.37' 2022-02-02T13:41:08.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:17] ENGINE Bus STARTING 2022-02-02T13:41:08.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:17] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:41:08.551 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:17] ENGINE Bus STARTED 2022-02-02T13:41:08.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:41:08.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:08.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Setting container_image for all mgr 2022-02-02T13:41:08.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Updating mon.smithi033 2022-02-02T13:41:08.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mon.smithi033 on smithi033 2022-02-02T13:41:08.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:41:08.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T13:41:08.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e30: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:41:08.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e31: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:41:08.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.554 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.kvxxkv on smithi033 is in error state 2022-02-02T13:41:08.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:41:08.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fs cephfs is degraded 2022-02-02T13:41:08.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.555 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.14626 ' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.14626 ' entity='' 2022-02-02T13:41:08.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:41:08.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: osdmap e51: 6 total, 6 up, 6 in 2022-02-02T13:41:08.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:41:08.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:boot 2022-02-02T13:41:08.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Standby daemon mds.cephfs.smithi033.cdqmmc assigned to filesystem cephfs as rank 0 2022-02-02T13:41:08.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:41:08.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:41:08.557 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 3 up:standby 2022-02-02T13:41:08.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:reconnect 2022-02-02T13:41:08.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:41:08.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Standby manager daemon smithi037.npteou restarted 2022-02-02T13:41:08.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Standby manager daemon smithi037.npteou started 2022-02-02T13:41:08.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:41:08.559 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:41:08.559 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:41:08.559 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:41:08.559 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: reconnect by client.24335 v1:192.168.0.1:0/3031626784 after 0.0569991 2022-02-02T13:41:08.560 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: reconnect by client.24331 v1:172.21.15.33:0/123632270 after 0.0879986 2022-02-02T13:41:08.560 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:41:08.560 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Activating manager daemon smithi033.xvkvzp 2022-02-02T13:41:08.560 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T13:41:08.560 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e32: smithi033.xvkvzp(active, starting, since 0.716855s), standbys: smithi037.npteou 2022-02-02T13:41:08.561 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:41:08.561 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:41:08.561 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:41:08.561 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:41:08.562 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:41:08.562 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:41:08.562 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:41:08.562 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:41:08.562 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:41:08.563 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:41:08.563 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:41:08.563 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:41:08.563 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:41:08.563 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:41:08.564 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:41:08.564 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:41:08.564 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:41:08.564 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:41:08.565 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.565 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.565 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.565 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:08.566 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.566 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.566 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:41:08.566 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:41:08.567 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:54] ENGINE Bus STARTING 2022-02-02T13:41:08.567 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:rejoin 2022-02-02T13:41:08.567 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:41:08.567 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:54] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:41:08.567 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [02/Feb/2022:13:40:54] ENGINE Bus STARTED 2022-02-02T13:41:08.568 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.568 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e33: smithi033.xvkvzp(active, since 1.72608s), standbys: smithi037.npteou 2022-02-02T13:41:08.568 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:08.568 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v3: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:08.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1513201054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:08.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T13:41:08.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v4: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e34: smithi033.xvkvzp(active, since 2s), standbys: smithi037.npteou 2022-02-02T13:41:08.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:clientreplay 2022-02-02T13:41:08.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:clientreplay} 3 up:standby 2022-02-02T13:41:08.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2386310278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:08.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v5: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.cdqmmc is now active in filesystem cephfs as rank 0 2022-02-02T13:41:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v6: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T13:41:08.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:active 2022-02-02T13:41:08.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1 {0=cephfs.smithi033.cdqmmc=up:active} 3 up:standby 2022-02-02T13:41:08.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e35: smithi033.xvkvzp(active, since 8s), standbys: smithi037.npteou 2022-02-02T13:41:08.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v7: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2022-02-02T13:41:08.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:08.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:08.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v8: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 1.0 MiB/s wr, 248 op/s 2022-02-02T13:41:08.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:08.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T13:41:08.575 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:41:08.575 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Upgrade: Updating mon.smithi037 2022-02-02T13:41:08.575 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.575 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:08.576 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:08.576 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.576 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Deploying daemon mon.smithi037 on smithi037 2022-02-02T13:41:08.576 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v9: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 1.2 MiB/s wr, 293 op/s 2022-02-02T13:41:08.576 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: pgmap v10: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 266 op/s 2022-02-02T13:41:08.577 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.577 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.577 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.cdqmmc on smithi033 is in error state 2022-02-02T13:41:08.577 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.577 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.578 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:41:08.578 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mon.smithi033 calling monitor election 2022-02-02T13:41:08.578 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mon.smithi037 calling monitor election 2022-02-02T13:41:08.578 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:41:08.579 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mon.smithi033 is new leader, mons smithi033,smithi037 in quorum (ranks 0,1) 2022-02-02T13:41:08.579 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: monmap e3: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2022-02-02T13:41:08.579 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fsmap cephfs:1 {0=cephfs.smithi033.cdqmmc=up:active} 3 up:standby 2022-02-02T13:41:08.579 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T13:41:08.579 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: mgrmap e35: smithi033.xvkvzp(active, since 13s), standbys: smithi037.npteou 2022-02-02T13:41:08.580 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.580 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.580 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.cdqmmc on smithi033 is in error state 2022-02-02T13:41:08.580 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.581 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.581 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.581 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.581 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.581 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:08.582 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:08 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mkfs 7b277774-842c-11ec-8c35-001a4aab830c 2022-02-02T13:41:08.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Applying service osd.None on host smithi037... 2022-02-02T13:41:08.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon osd.4 on smithi037 2022-02-02T13:41:08.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Applying service osd.None on host smithi037... 2022-02-02T13:41:08.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon osd.5 on smithi037 2022-02-02T13:41:08.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Detected new or changed devices on smithi037 2022-02-02T13:41:08.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Saving service mds.cephfs spec with placement count:4 2022-02-02T13:41:08.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:41:08.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:41:08.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:41:08.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:41:08.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:41:08.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b0d76d45e4cb48de326cfbdc43296681162f672c 2022-02-02T13:41:08.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Target is version 17.0.0-10509-gb0d76d45 (unknown) 2022-02-02T13:41:08.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb, digests ['quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb'] 2022-02-02T13:41:08.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:41:08.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:8e4135a149d595bfc9ef5177b73ed1aac2327ed846dab5b9c3545d9df83698cb on smithi037 2022-02-02T13:41:08.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:41:08.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:08.746 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Need to upgrade myself (mgr.smithi033.xvkvzp) 2022-02-02T13:41:08.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Failing over to other MGR 2022-02-02T13:41:08.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying cephadm binary to smithi033 2022-02-02T13:41:08.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying cephadm binary to smithi037 2022-02-02T13:41:08.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:39:36] ENGINE Bus STARTING 2022-02-02T13:41:08.748 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:39:36] ENGINE Serving on https://172.21.15.37:7150 2022-02-02T13:41:08.748 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:39:36] ENGINE Bus STARTED 2022-02-02T13:41:08.748 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:41:08.748 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Updating mgr.smithi033.xvkvzp 2022-02-02T13:41:08.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:41:08.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Need to upgrade myself (mgr.smithi037.npteou) 2022-02-02T13:41:08.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Failing over to other MGR 2022-02-02T13:41:08.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: inventory: adjusted host smithi037 addr 'smithi037' -> '172.21.15.37' 2022-02-02T13:41:08.750 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.750 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:17] ENGINE Bus STARTING 2022-02-02T13:41:08.750 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:17] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:41:08.750 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:17] ENGINE Bus STARTED 2022-02-02T13:41:08.751 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Updating mgr.smithi037.npteou 2022-02-02T13:41:08.751 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:08.751 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.751 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Setting container_image for all mgr 2022-02-02T13:41:08.751 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Updating mon.smithi033 2022-02-02T13:41:08.752 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mon.smithi033 on smithi033 2022-02-02T13:41:08.752 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:41:08.752 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: osdmap e50: 6 total, 6 up, 6 in 2022-02-02T13:41:08.752 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e30: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:41:08.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e31: smithi033.xvkvzp(active, since 29s), standbys: smithi037.npteou 2022-02-02T13:41:08.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.753 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.kvxxkv on smithi033 is in error state 2022-02-02T13:41:08.754 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:41:08.754 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fs cephfs is degraded 2022-02-02T13:41:08.754 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.754 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.14626 ' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.14626 ' entity='' 2022-02-02T13:41:08.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:41:08.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: osdmap e51: 6 total, 6 up, 6 in 2022-02-02T13:41:08.755 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:41:08.756 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:boot 2022-02-02T13:41:08.756 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Standby daemon mds.cephfs.smithi033.cdqmmc assigned to filesystem cephfs as rank 0 2022-02-02T13:41:08.756 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-02-02T13:41:08.756 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:41:08.757 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:replay} 3 up:standby 2022-02-02T13:41:08.757 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:reconnect 2022-02-02T13:41:08.757 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:reconnect} 3 up:standby 2022-02-02T13:41:08.758 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Standby manager daemon smithi037.npteou restarted 2022-02-02T13:41:08.758 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Standby manager daemon smithi037.npteou started 2022-02-02T13:41:08.758 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/crt"}]: dispatch 2022-02-02T13:41:08.758 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-02-02T13:41:08.758 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.npteou/key"}]: dispatch 2022-02-02T13:41:08.759 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.? 172.21.15.37:0/3227096304' entity='mgr.smithi037.npteou' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-02-02T13:41:08.759 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: reconnect by client.24335 v1:192.168.0.1:0/3031626784 after 0.0569991 2022-02-02T13:41:08.759 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: reconnect by client.24331 v1:172.21.15.33:0/123632270 after 0.0879986 2022-02-02T13:41:08.759 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Active manager daemon smithi033.xvkvzp restarted 2022-02-02T13:41:08.760 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Activating manager daemon smithi033.xvkvzp 2022-02-02T13:41:08.760 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T13:41:08.760 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e32: smithi033.xvkvzp(active, starting, since 0.716855s), standbys: smithi037.npteou 2022-02-02T13:41:08.760 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:41:08.761 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:41:08.761 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.kvxxkv"}]: dispatch 2022-02-02T13:41:08.761 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.nnxzjs"}]: dispatch 2022-02-02T13:41:08.761 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.lqirod"}]: dispatch 2022-02-02T13:41:08.761 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:41:08.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi033.xvkvzp", "id": "smithi033.xvkvzp"}]: dispatch 2022-02-02T13:41:08.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr metadata", "who": "smithi037.npteou", "id": "smithi037.npteou"}]: dispatch 2022-02-02T13:41:08.762 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-02-02T13:41:08.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-02-02T13:41:08.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-02-02T13:41:08.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-02-02T13:41:08.763 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-02-02T13:41:08.764 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-02-02T13:41:08.764 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-02-02T13:41:08.764 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-02-02T13:41:08.764 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-02-02T13:41:08.765 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Manager daemon smithi033.xvkvzp is now available 2022-02-02T13:41:08.765 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.765 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.765 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.766 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:08.766 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:08.766 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.766 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:41:08.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:41:08.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:54] ENGINE Bus STARTING 2022-02-02T13:41:08.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:rejoin 2022-02-02T13:41:08.767 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:rejoin} 3 up:standby 2022-02-02T13:41:08.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:54] ENGINE Serving on https://172.21.15.33:7150 2022-02-02T13:41:08.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [02/Feb/2022:13:40:54] ENGINE Bus STARTED 2022-02-02T13:41:08.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.768 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e33: smithi033.xvkvzp(active, since 1.72608s), standbys: smithi037.npteou 2022-02-02T13:41:08.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='client.24483 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:08.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v3: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:08.769 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1513201054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T13:41:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v4: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e34: smithi033.xvkvzp(active, since 2s), standbys: smithi037.npteou 2022-02-02T13:41:08.770 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:clientreplay 2022-02-02T13:41:08.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1/1 {0=cephfs.smithi033.cdqmmc=up:clientreplay} 3 up:standby 2022-02-02T13:41:08.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2386310278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:08.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v5: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.771 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.cdqmmc is now active in filesystem cephfs as rank 0 2022-02-02T13:41:08.772 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v6: 65 pgs: 65 active+clean; 249 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:08.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-02-02T13:41:08.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/79449455,v1:172.21.15.33:6801/79449455] up:active 2022-02-02T13:41:08.773 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1 {0=cephfs.smithi033.cdqmmc=up:active} 3 up:standby 2022-02-02T13:41:08.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e35: smithi033.xvkvzp(active, since 8s), standbys: smithi037.npteou 2022-02-02T13:41:08.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v7: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.6 KiB/s rd, 1.2 MiB/s wr, 287 op/s 2022-02-02T13:41:08.774 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:08.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.775 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:41:08.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v8: 65 pgs: 65 active+clean; 257 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.8 KiB/s rd, 1.0 MiB/s wr, 248 op/s 2022-02-02T13:41:08.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.776 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:08.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-02-02T13:41:08.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:41:08.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Upgrade: Updating mon.smithi037 2022-02-02T13:41:08.777 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:08.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:08.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.778 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Deploying daemon mon.smithi037 on smithi037 2022-02-02T13:41:08.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v9: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 1.2 MiB/s wr, 293 op/s 2022-02-02T13:41:08.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: pgmap v10: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 266 op/s 2022-02-02T13:41:08.779 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.cdqmmc on smithi033 is in error state 2022-02-02T13:41:08.780 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi033"}]: dispatch 2022-02-02T13:41:08.781 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mon.smithi033 calling monitor election 2022-02-02T13:41:08.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mon.smithi037 calling monitor election 2022-02-02T13:41:08.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2022-02-02T13:41:08.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mon.smithi033 is new leader, mons smithi033,smithi037 in quorum (ranks 0,1) 2022-02-02T13:41:08.782 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: monmap e3: 2 mons at {smithi033=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} 2022-02-02T13:41:08.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fsmap cephfs:1 {0=cephfs.smithi033.cdqmmc=up:active} 3 up:standby 2022-02-02T13:41:08.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: osdmap e52: 6 total, 6 up, 6 in 2022-02-02T13:41:08.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: mgrmap e35: smithi033.xvkvzp(active, since 13s), standbys: smithi037.npteou 2022-02-02T13:41:08.783 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: Health detail: HEALTH_WARN 1 failed cephadm daemon(s); 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T13:41:08.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.cdqmmc on smithi033 is in error state 2022-02-02T13:41:08.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:41:08.784 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:41:08.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:08.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:08.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:08.785 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:08.786 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:08 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:10 smithi033 ceph-mon[101165]: pgmap v11: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 266 op/s 2022-02-02T13:41:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:10 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:10 smithi037 ceph-mon[69017]: pgmap v11: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 266 op/s 2022-02-02T13:41:10.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:10 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:12.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:12 smithi037 ceph-mon[69017]: pgmap v12: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 272 op/s 2022-02-02T13:41:12.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:12 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:12.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:12 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:12 smithi033 ceph-mon[101165]: pgmap v12: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s rd, 1.1 MiB/s wr, 272 op/s 2022-02-02T13:41:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:12 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:12.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:12 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:13 smithi033 conmon[101141]: 2022-02-02T13:41:13.252+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:41:13.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:13 smithi033 ceph-mon[101165]: daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:41:13.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:13 smithi033 ceph-mon[101165]: osdmap e53: 6 total, 6 up, 6 in 2022-02-02T13:41:13.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:13 smithi037 ceph-mon[69017]: daemon mds.cephfs.smithi033.cdqmmc restarted 2022-02-02T13:41:13.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:13 smithi037 ceph-mon[69017]: osdmap e53: 6 total, 6 up, 6 in 2022-02-02T13:41:14.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: pgmap v14: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 445 KiB/s wr, 100 op/s 2022-02-02T13:41:14.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:41:14.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2022-02-02T13:41:14.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:41:14.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: mds.? [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] up:boot 2022-02-02T13:41:14.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:41:14.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:41:14.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: pgmap v14: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 445 KiB/s wr, 100 op/s 2022-02-02T13:41:14.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-02-02T13:41:14.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: Health check failed: 1 filesystem has a failed mds daemon (FS_WITH_FAILED_MDS) 2022-02-02T13:41:14.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-02-02T13:41:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: mds.? [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] up:boot 2022-02-02T13:41:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: fsmap cephfs:0/1 4 up:standby, 1 failed 2022-02-02T13:41:14.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi033.cdqmmc"}]: dispatch 2022-02-02T13:41:16.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:16.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: pgmap v15: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s wr, 6 op/s 2022-02-02T13:41:16.126 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: pgmap v16: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s wr, 7 op/s 2022-02-02T13:41:16.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:16.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: Reconfiguring mon.smithi033 (monmap changed)... 2022-02-02T13:41:16.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:16.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:16.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:16.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:15 smithi033 ceph-mon[101165]: Reconfiguring daemon mon.smithi033 on smithi033 2022-02-02T13:41:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: pgmap v15: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 34 KiB/s wr, 6 op/s 2022-02-02T13:41:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: pgmap v16: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s wr, 7 op/s 2022-02-02T13:41:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: Reconfiguring mon.smithi033 (monmap changed)... 2022-02-02T13:41:16.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:16.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:16.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:16.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:15 smithi037 ceph-mon[69017]: Reconfiguring daemon mon.smithi033 on smithi033 2022-02-02T13:41:17.189 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:17.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: Reconfiguring mgr.smithi033.xvkvzp (monmap changed)... 2022-02-02T13:41:17.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:41:17.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:41:17.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:17.191 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:17 smithi033 ceph-mon[101165]: Reconfiguring daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:41:17.487 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:17.487 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: Reconfiguring mgr.smithi033.xvkvzp (monmap changed)... 2022-02-02T13:41:17.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi033.xvkvzp", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:41:17.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:41:17.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:17.488 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:17 smithi037 ceph-mon[69017]: Reconfiguring daemon mgr.smithi033.xvkvzp on smithi033 2022-02-02T13:41:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: pgmap v17: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s wr, 7 op/s 2022-02-02T13:41:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: Reconfiguring crash.smithi033 (monmap changed)... 2022-02-02T13:41:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:18.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:18.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:18 smithi033 ceph-mon[101165]: Reconfiguring daemon crash.smithi033 on smithi033 2022-02-02T13:41:18.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: pgmap v17: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s wr, 7 op/s 2022-02-02T13:41:18.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:18.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: Reconfiguring crash.smithi033 (monmap changed)... 2022-02-02T13:41:18.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:18.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:18.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:18 smithi037 ceph-mon[69017]: Reconfiguring daemon crash.smithi033 on smithi033 2022-02-02T13:41:19.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:19 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:19.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:19 smithi033 ceph-mon[101165]: Reconfiguring osd.0 (monmap changed)... 2022-02-02T13:41:19.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:19 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.0 on smithi033 2022-02-02T13:41:20.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:19 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:20.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:19 smithi037 ceph-mon[69017]: Reconfiguring osd.0 (monmap changed)... 2022-02-02T13:41:20.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:19 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.0 on smithi033 2022-02-02T13:41:20.945 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:20 smithi033 ceph-mon[101165]: pgmap v18: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:20.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:20 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:20.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:20 smithi033 ceph-mon[101165]: Reconfiguring osd.1 (monmap changed)... 2022-02-02T13:41:20.946 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:20 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.1 on smithi033 2022-02-02T13:41:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:20 smithi037 ceph-mon[69017]: pgmap v18: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:20 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:21.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:20 smithi037 ceph-mon[69017]: Reconfiguring osd.1 (monmap changed)... 2022-02-02T13:41:21.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:20 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.1 on smithi033 2022-02-02T13:41:22.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:21 smithi033 ceph-mon[101165]: pgmap v19: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:22.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:21 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:22.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:21 smithi033 ceph-mon[101165]: Reconfiguring osd.2 (monmap changed)... 2022-02-02T13:41:22.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:21 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.2 on smithi033 2022-02-02T13:41:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:21 smithi037 ceph-mon[69017]: pgmap v19: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:22.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:21 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:22.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:21 smithi037 ceph-mon[69017]: Reconfiguring osd.2 (monmap changed)... 2022-02-02T13:41:22.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:21 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.2 on smithi033 2022-02-02T13:41:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:23 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:23 smithi033 ceph-mon[101165]: Reconfiguring mds.cephfs.smithi033.cdqmmc (monmap changed)... 2022-02-02T13:41:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:23 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:23 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:23.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:23 smithi033 ceph-mon[101165]: Reconfiguring daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:41:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:23 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:23 smithi037 ceph-mon[69017]: Reconfiguring mds.cephfs.smithi033.cdqmmc (monmap changed)... 2022-02-02T13:41:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:23 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.cdqmmc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:23 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:23 smithi037 ceph-mon[69017]: Reconfiguring daemon mds.cephfs.smithi033.cdqmmc on smithi033 2022-02-02T13:41:24.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:24 smithi033 ceph-mon[101165]: pgmap v20: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:24.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:24 smithi037 ceph-mon[69017]: pgmap v20: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:25 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:25.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:25 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 -- 172.21.15.33:0/3899605265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 msgr2=0x7fe4a80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3899605265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a80f7de0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fe4a4004660 tx=0x7fe4a4009b30).stop 2022-02-02T13:41:26.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 -- 172.21.15.33:0/3899605265 shutdown_connections 2022-02-02T13:41:26.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3899605265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a80f7de0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3899605265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:41:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 -- 172.21.15.33:0/3899605265 >> 172.21.15.33:0/3899605265 conn(0x7fe4a80f1e40 msgr2=0x7fe4a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 -- 172.21.15.33:0/3899605265 shutdown_connections 2022-02-02T13:41:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 -- 172.21.15.33:0/3899605265 wait complete. 2022-02-02T13:41:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.298+0000 7fe4af88e700 1 Processor -- start 2022-02-02T13:41:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4af88e700 1 -- start start 2022-02-02T13:41:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4af88e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4af88e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4af88e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8107ae0 con 0x7fe4a80f7980 2022-02-02T13:41:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4af88e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a8108390 con 0x7fe4a80f66e0 2022-02-02T13:41:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57606/0 (socket says 172.21.15.33:57606) 2022-02-02T13:41:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 -- 172.21.15.33:0/3016217407 learned_addr learned my addr 172.21.15.33:0/3016217407 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:26.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ad62a700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 -- 172.21.15.33:0/3016217407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 msgr2=0x7fe4a8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 -- 172.21.15.33:0/3016217407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a4005040 con 0x7fe4a80f7980 2022-02-02T13:41:26.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ad62a700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:41:26.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.299+0000 7fe4ace29700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe4a4009da0 tx=0x7fe4a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.300+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4a4018070 con 0x7fe4a80f7980 2022-02-02T13:41:26.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.300+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe4a4007d70 con 0x7fe4a80f7980 2022-02-02T13:41:26.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.300+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4a401dea0 con 0x7fe4a80f7980 2022-02-02T13:41:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.300+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8108610 con 0x7fe4a80f7980 2022-02-02T13:41:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.300+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a8108b70 con 0x7fe4a80f7980 2022-02-02T13:41:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.301+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a80f5ad0 con 0x7fe4a80f7980 2022-02-02T13:41:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.301+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fe4a401d420 con 0x7fe4a80f7980 2022-02-02T13:41:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.302+0000 7fe49dffb700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 0x7fe494067310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.302+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe4a40839a0 con 0x7fe4a80f7980 2022-02-02T13:41:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.302+0000 7fe4ad62a700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 0x7fe494067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.302+0000 7fe4ad62a700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 0x7fe494067310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4a80f77e0 tx=0x7fe498008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.308+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe4a4055490 con 0x7fe4a80f7980 2022-02-02T13:41:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.505+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4a80fefb0 con 0x7fe494064e50 2022-02-02T13:41:26.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.506+0000 7fe49dffb700 1 -- 172.21.15.33:0/3016217407 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+303 (secure 0 0 0) 0x7fe4a80fefb0 con 0x7fe494064e50 2022-02-02T13:41:26.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 msgr2=0x7fe494067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 0x7fe494067310 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fe4a80f77e0 tx=0x7fe498008040).stop 2022-02-02T13:41:26.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 msgr2=0x7fe4a81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe4a4009da0 tx=0x7fe4a4009b30).stop 2022-02-02T13:41:26.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 shutdown_connections 2022-02-02T13:41:26.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe494064e50 0x7fe494067310 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a80f66e0 0x7fe4a8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 --2- 172.21.15.33:0/3016217407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4a80f7980 0x7fe4a81074a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 >> 172.21.15.33:0/3016217407 conn(0x7fe4a80f1e40 msgr2=0x7fe4a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 shutdown_connections 2022-02-02T13:41:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.508+0000 7fe4af88e700 1 -- 172.21.15.33:0/3016217407 wait complete. 2022-02-02T13:41:26.519 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:41:26.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 -- 172.21.15.33:0/1933418686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f77d0 msgr2=0x7f7a5c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 --2- 172.21.15.33:0/1933418686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c0f7c30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f7a50004660 tx=0x7f7a50009b30).stop 2022-02-02T13:41:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 -- 172.21.15.33:0/1933418686 shutdown_connections 2022-02-02T13:41:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 --2- 172.21.15.33:0/1933418686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c0f7c30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 --2- 172.21.15.33:0/1933418686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.611+0000 7f7a61564700 1 -- 172.21.15.33:0/1933418686 >> 172.21.15.33:0/1933418686 conn(0x7f7a5c0f1c90 msgr2=0x7f7a5c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.612+0000 7f7a61564700 1 -- 172.21.15.33:0/1933418686 shutdown_connections 2022-02-02T13:41:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.612+0000 7f7a61564700 1 -- 172.21.15.33:0/1933418686 wait complete. 2022-02-02T13:41:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.612+0000 7f7a61564700 1 Processor -- start 2022-02-02T13:41:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a61564700 1 -- start start 2022-02-02T13:41:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a61564700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a61564700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a61564700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c107880 con 0x7f7a5c0f6530 2022-02-02T13:41:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a61564700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c108090 con 0x7f7a5c0f77d0 2022-02-02T13:41:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57614/0 (socket says 172.21.15.33:57614) 2022-02-02T13:41:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 -- 172.21.15.33:0/2224260021 learned_addr learned my addr 172.21.15.33:0/2224260021 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5b7fe700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 -- 172.21.15.33:0/2224260021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f77d0 msgr2=0x7f7a5c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.613+0000 7f7a5bfff700 1 -- 172.21.15.33:0/2224260021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a50005040 con 0x7f7a5c0f6530 2022-02-02T13:41:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a5bfff700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7a4c002700 tx=0x7f7a4c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c009320 con 0x7f7a5c0f6530 2022-02-02T13:41:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c108310 con 0x7f7a5c0f6530 2022-02-02T13:41:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a4c00f040 con 0x7f7a5c0f6530 2022-02-02T13:41:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c014900 con 0x7f7a5c0f6530 2022-02-02T13:41:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.614+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c1088d0 con 0x7f7a5c0f6530 2022-02-02T13:41:26.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.615+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c059100 con 0x7f7a5c0f6530 2022-02-02T13:41:26.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.616+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f7a4c0077b0 con 0x7f7a5c0f6530 2022-02-02T13:41:26.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.616+0000 7f7a58ff9700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 0x7f7a44067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.616+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7a4c081d20 con 0x7f7a5c0f6530 2022-02-02T13:41:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.616+0000 7f7a5b7fe700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 0x7f7a44067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.617+0000 7f7a5b7fe700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 0x7f7a44067350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7a50004630 tx=0x7f7a50009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.621+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a4c04fde0 con 0x7f7a5c0f6530 2022-02-02T13:41:26.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.808+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5c0fedd0 con 0x7f7a44064e90 2022-02-02T13:41:26.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: pgmap v21: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:26.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:26.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: Reconfiguring mds.cephfs.smithi033.kvxxkv (monmap changed)... 2022-02-02T13:41:26.809 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:26.810 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:26.810 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:26 smithi033 ceph-mon[101165]: Reconfiguring daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:41:26.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.823+0000 7f7a58ff9700 1 -- 172.21.15.33:0/2224260021 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7a5c0fedd0 con 0x7f7a44064e90 2022-02-02T13:41:26.825 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:41:26.825 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (6m) 24s ago 7m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:41:26.825 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 24s ago 7m 6995k - 16.2.4 8d91d370c2b8 c876a97406d4 2022-02-02T13:41:26.826 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (7m) 15s ago 7m 7151k - 16.2.4 8d91d370c2b8 be351b82efe0 2022-02-02T13:41:26.826 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (6m) 24s ago 7m 38.7M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:41:26.827 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 error 24s ago 3m - - 2022-02-02T13:41:26.828 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (52s) 24s ago 3m 14.2M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:41:26.828 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (97s) 15s ago 3m 16.5M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:41:26.829 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (3m) 15s ago 3m 15.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:41:26.829 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (82s) 24s ago 9m 442M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:41:26.829 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (54s) 15s ago 7m 415M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:41:26.830 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (41s) 24s ago 9m 44.6M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:41:26.830 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (19s) 15s ago 7m 43.6M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:41:26.831 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 24s ago 7m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:41:26.831 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (6m) 15s ago 6m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:41:26.832 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 24s ago 6m 351M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:41:26.832 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 24s ago 6m 359M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:41:26.833 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (5m) 24s ago 5m 270M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:41:26.833 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (5m) 15s ago 5m 430M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:41:26.833 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (5m) 15s ago 5m 343M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:41:26.834 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (5m) 15s ago 5m 386M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:41:26.834 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (6m) 24s ago 7m 47.3M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:41:26.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 msgr2=0x7f7a44067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 0x7f7a44067350 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f7a50004630 tx=0x7f7a50009b30).stop 2022-02-02T13:41:26.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 msgr2=0x7f7a5c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7a4c002700 tx=0x7f7a4c009d80).stop 2022-02-02T13:41:26.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 shutdown_connections 2022-02-02T13:41:26.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a44064e90 0x7f7a44067350 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a5c0f6530 0x7f7a5c106d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 --2- 172.21.15.33:0/2224260021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a5c0f77d0 0x7f7a5c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.825+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 >> 172.21.15.33:0/2224260021 conn(0x7f7a5c0f1c90 msgr2=0x7f7a5c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.826+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 shutdown_connections 2022-02-02T13:41:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.826+0000 7f7a61564700 1 -- 172.21.15.33:0/2224260021 wait complete. 2022-02-02T13:41:26.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.930+0000 7faefa9a7700 1 -- 172.21.15.33:0/3486891597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 msgr2=0x7faef40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.930+0000 7faefa9a7700 1 --2- 172.21.15.33:0/3486891597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef40f6b00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faee4004660 tx=0x7faee4009b30).stop 2022-02-02T13:41:26.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 -- 172.21.15.33:0/3486891597 shutdown_connections 2022-02-02T13:41:26.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 --2- 172.21.15.33:0/3486891597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 0x7faef40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:41:26.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 --2- 172.21.15.33:0/3486891597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef40f6b00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 -- 172.21.15.33:0/3486891597 >> 172.21.15.33:0/3486891597 conn(0x7faef40f1e40 msgr2=0x7faef40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:26.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 -- 172.21.15.33:0/3486891597 shutdown_connections 2022-02-02T13:41:26.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 -- 172.21.15.33:0/3486891597 wait complete. 2022-02-02T13:41:26.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.931+0000 7faefa9a7700 1 Processor -- start 2022-02-02T13:41:26.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faefa9a7700 1 -- start start 2022-02-02T13:41:26.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faefa9a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faefa9a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 0x7faef41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faefa9a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4107ae0 con 0x7faef40f66e0 2022-02-02T13:41:26.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faefa9a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef4108390 con 0x7faef40f7980 2022-02-02T13:41:26.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57624/0 (socket says 172.21.15.33:57624) 2022-02-02T13:41:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faef3fff700 1 -- 172.21.15.33:0/2264061373 learned_addr learned my addr 172.21.15.33:0/2264061373 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.932+0000 7faeebfff700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 0x7faef41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef3fff700 1 -- 172.21.15.33:0/2264061373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 msgr2=0x7faef41074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:26.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef3fff700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 0x7faef41074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:26.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef3fff700 1 -- 172.21.15.33:0/2264061373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4005040 con 0x7faef40f66e0 2022-02-02T13:41:26.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef3fff700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7faee4004f60 tx=0x7faee4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee4018070 con 0x7faef40f66e0 2022-02-02T13:41:26.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faee4009770 con 0x7faef40f66e0 2022-02-02T13:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faee401c3c0 con 0x7faef40f66e0 2022-02-02T13:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef4108610 con 0x7faef40f66e0 2022-02-02T13:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.933+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef4108af0 con 0x7faef40f66e0 2022-02-02T13:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.934+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef4045ad0 con 0x7faef40f66e0 2022-02-02T13:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.935+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7faee401d420 con 0x7faef40f66e0 2022-02-02T13:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.935+0000 7faef17fa700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 0x7faee0067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.935+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faee4083ec0 con 0x7faef40f66e0 2022-02-02T13:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.935+0000 7faeebfff700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 0x7faee0067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.936+0000 7faeebfff700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 0x7faee0067300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7faedc006fd0 tx=0x7faedc008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:26.939+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faee4055af0 con 0x7faef40f66e0 2022-02-02T13:41:27.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: pgmap v21: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:27.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:27.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: Reconfiguring mds.cephfs.smithi033.kvxxkv (monmap changed)... 2022-02-02T13:41:27.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi033.kvxxkv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:27.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:27.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:26 smithi037 ceph-mon[69017]: Reconfiguring daemon mds.cephfs.smithi033.kvxxkv on smithi033 2022-02-02T13:41:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.182+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faef4027a00 con 0x7faef40f66e0 2022-02-02T13:41:27.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.182+0000 7faef17fa700 1 -- 172.21.15.33:0/2264061373 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+703 (secure 0 0 0) 0x7faee40556e0 con 0x7faef40f66e0 2022-02-02T13:41:27.184 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:41:27.184 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:41:27.184 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:41:27.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:27.185 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:41:27.185 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:41:27.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:27.185 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:41:27.185 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:41:27.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:27.186 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:41:27.186 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:41:27.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:27.187 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:41:27.187 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2022-02-02T13:41:27.187 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:41:27.187 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:41:27.188 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:41:27.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 msgr2=0x7faee0067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 0x7faee0067300 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7faedc006fd0 tx=0x7faedc008040).stop 2022-02-02T13:41:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 msgr2=0x7faef4106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7faee4004f60 tx=0x7faee4009b30).stop 2022-02-02T13:41:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 shutdown_connections 2022-02-02T13:41:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faee0064e40 0x7faee0067300 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faef40f66e0 0x7faef4106fb0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 --2- 172.21.15.33:0/2264061373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faef40f7980 0x7faef41074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.184+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 >> 172.21.15.33:0/2264061373 conn(0x7faef40f1e40 msgr2=0x7faef40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:27.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.185+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 shutdown_connections 2022-02-02T13:41:27.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.185+0000 7faefa9a7700 1 -- 172.21.15.33:0/2264061373 wait complete. 2022-02-02T13:41:27.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 -- 172.21.15.33:0/589201341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 msgr2=0x7fd2280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 --2- 172.21.15.33:0/589201341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd2280f6cc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fd210004660 tx=0x7fd210009b30).stop 2022-02-02T13:41:27.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 -- 172.21.15.33:0/589201341 shutdown_connections 2022-02-02T13:41:27.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 --2- 172.21.15.33:0/589201341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd2280f6cc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 --2- 172.21.15.33:0/589201341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd2280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 -- 172.21.15.33:0/589201341 >> 172.21.15.33:0/589201341 conn(0x7fd2280f0d40 msgr2=0x7fd2280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:27.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 -- 172.21.15.33:0/589201341 shutdown_connections 2022-02-02T13:41:27.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.287+0000 7fd22d589700 1 -- 172.21.15.33:0/589201341 wait complete. 2022-02-02T13:41:27.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 Processor -- start 2022-02-02T13:41:27.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 -- start start 2022-02-02T13:41:27.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd228105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:27.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:27.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd228106920 con 0x7fd2280f6860 2022-02-02T13:41:27.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd22d589700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd228107130 con 0x7fd2280f55c0 2022-02-02T13:41:27.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd2267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:27.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd226ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd228105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:27.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.288+0000 7fd2267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57636/0 (socket says 172.21.15.33:57636) 2022-02-02T13:41:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd2267fc700 1 -- 172.21.15.33:0/2717370307 learned_addr learned my addr 172.21.15.33:0/2717370307 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd2267fc700 1 -- 172.21.15.33:0/2717370307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 msgr2=0x7fd228105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd2267fc700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd228105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd2267fc700 1 -- 172.21.15.33:0/2717370307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210005040 con 0x7fd2280f6860 2022-02-02T13:41:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd226ffd700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd228105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:41:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd2267fc700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd210000c00 tx=0x7fd21000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2100079c0 con 0x7fd2280f6860 2022-02-02T13:41:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd228107350 con 0x7fd2280f6860 2022-02-02T13:41:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd210014420 con 0x7fd2280f6860 2022-02-02T13:41:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd21001e5d0 con 0x7fd2280f6860 2022-02-02T13:41:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.289+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2281078b0 con 0x7fd2280f6860 2022-02-02T13:41:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.291+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fd210026070 con 0x7fd2280f6860 2022-02-02T13:41:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.291+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2280f49b0 con 0x7fd2280f6860 2022-02-02T13:41:27.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.291+0000 7fd21f7fe700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 0x7fd214067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:27.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.291+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd210083bb0 con 0x7fd2280f6860 2022-02-02T13:41:27.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.291+0000 7fd226ffd700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 0x7fd214067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:27.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.292+0000 7fd226ffd700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 0x7fd214067300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd228105ba0 tx=0x7fd21800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:27.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.296+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd210051bb0 con 0x7fd2280f6860 2022-02-02T13:41:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.510+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd2280ff790 con 0x7fd2280f6860 2022-02-02T13:41:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.511+0000 7fd21f7fe700 1 -- 172.21.15.33:0/2717370307 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd210024070 con 0x7fd2280f6860 2022-02-02T13:41:27.511 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:41:27.512 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:41:27.512 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:27.512 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:41:27.513 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:27.513 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:41:27.513 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:41:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:41:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:41:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:41:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:41:27.514 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:41:27.515 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:41:27.515 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:41:27.515 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:41:27.515 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:41:27.516 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:41:27.516 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:41:27.516 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:41:27.516 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:27.516 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:41:27.517 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:41:27.517 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:41:27.517 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:41:27.517 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:41:27.518 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:41:27.518 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:41:27.518 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:41:27.518 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:41:27.519 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:41:27.519 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:41:27.519 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:27.519 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:27.519 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:41:27.520 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:27.520 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:27.520 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:27.520 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:27.521 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 msgr2=0x7fd214067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 0x7fd214067300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fd228105ba0 tx=0x7fd21800b040).stop 2022-02-02T13:41:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 msgr2=0x7fd228106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:27.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fd210000c00 tx=0x7fd21000b040).stop 2022-02-02T13:41:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 shutdown_connections 2022-02-02T13:41:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd214064e40 0x7fd214067300 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2280f55c0 0x7fd228105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 --2- 172.21.15.33:0/2717370307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2280f6860 0x7fd228106320 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.512+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 >> 172.21.15.33:0/2717370307 conn(0x7fd2280f0d40 msgr2=0x7fd2280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.513+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 shutdown_connections 2022-02-02T13:41:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:27.513+0000 7fd22d589700 1 -- 172.21.15.33:0/2717370307 wait complete. 2022-02-02T13:41:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:41:27.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:27.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:27.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:27.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:27.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:27.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2264061373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:27.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:27 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2717370307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:28.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:28.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='client.34156 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:28.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:28.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:28.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:28.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2264061373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:28.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:27 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2717370307' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:28.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: pgmap v22: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:28.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: Reconfiguring crash.smithi037 (monmap changed)... 2022-02-02T13:41:28.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: Reconfiguring daemon crash.smithi037 on smithi037 2022-02-02T13:41:28.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:28.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:41:28.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:41:28.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:29.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: pgmap v22: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:29.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: Reconfiguring crash.smithi037 (monmap changed)... 2022-02-02T13:41:29.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: Reconfiguring daemon crash.smithi037 on smithi037 2022-02-02T13:41:29.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:29.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.npteou", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-02-02T13:41:29.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "mgr services"}]: dispatch 2022-02-02T13:41:29.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:30.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: Reconfiguring mgr.smithi037.npteou (monmap changed)... 2022-02-02T13:41:30.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: Reconfiguring daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:30.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:30.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:30.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:30.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: Reconfiguring mgr.smithi037.npteou (monmap changed)... 2022-02-02T13:41:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: Reconfiguring daemon mgr.smithi037.npteou on smithi037 2022-02-02T13:41:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-02-02T13:41:30.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-02-02T13:41:30.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:30.961 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:30 smithi037 ceph-mon[69017]: pgmap v23: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:30.961 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:30 smithi037 ceph-mon[69017]: Reconfiguring mon.smithi037 (monmap changed)... 2022-02-02T13:41:30.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:30 smithi037 ceph-mon[69017]: Reconfiguring daemon mon.smithi037 on smithi037 2022-02-02T13:41:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:30 smithi033 ceph-mon[101165]: pgmap v23: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:30 smithi033 ceph-mon[101165]: Reconfiguring mon.smithi037 (monmap changed)... 2022-02-02T13:41:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:30 smithi033 ceph-mon[101165]: Reconfiguring daemon mon.smithi037 on smithi037 2022-02-02T13:41:32.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:31 smithi037 ceph-mon[69017]: pgmap v24: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:32.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:32.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:31 smithi037 ceph-mon[69017]: Reconfiguring osd.3 (monmap changed)... 2022-02-02T13:41:32.214 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:31 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.3 on smithi037 2022-02-02T13:41:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:31 smithi033 ceph-mon[101165]: pgmap v24: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:32.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:32.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:31 smithi033 ceph-mon[101165]: Reconfiguring osd.3 (monmap changed)... 2022-02-02T13:41:32.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:31 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.3 on smithi037 2022-02-02T13:41:33.363 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:33 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:33.364 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:33 smithi037 ceph-mon[69017]: Reconfiguring osd.4 (monmap changed)... 2022-02-02T13:41:33.364 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:33 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.4 on smithi037 2022-02-02T13:41:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:33 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:33 smithi033 ceph-mon[101165]: Reconfiguring osd.4 (monmap changed)... 2022-02-02T13:41:33.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:33 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.4 on smithi037 2022-02-02T13:41:34.682 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:34 smithi037 ceph-mon[69017]: pgmap v25: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:34.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:34 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:34.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:34 smithi037 ceph-mon[69017]: Reconfiguring osd.5 (monmap changed)... 2022-02-02T13:41:34.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:34 smithi037 ceph-mon[69017]: Reconfiguring daemon osd.5 on smithi037 2022-02-02T13:41:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:34 smithi033 ceph-mon[101165]: pgmap v25: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:34 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:34.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:34 smithi033 ceph-mon[101165]: Reconfiguring osd.5 (monmap changed)... 2022-02-02T13:41:34.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:34 smithi033 ceph-mon[101165]: Reconfiguring daemon osd.5 on smithi037 2022-02-02T13:41:35.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:35 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:35.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:35 smithi037 ceph-mon[69017]: Reconfiguring mds.cephfs.smithi037.lqirod (monmap changed)... 2022-02-02T13:41:35.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:35 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:35.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:35 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:35.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:35 smithi037 ceph-mon[69017]: Reconfiguring daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:41:35.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:35 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:35.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:35 smithi033 ceph-mon[101165]: Reconfiguring mds.cephfs.smithi037.lqirod (monmap changed)... 2022-02-02T13:41:35.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:35 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.lqirod", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:35.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:35 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:35.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:35 smithi033 ceph-mon[101165]: Reconfiguring daemon mds.cephfs.smithi037.lqirod on smithi037 2022-02-02T13:41:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: pgmap v26: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: Reconfiguring mds.cephfs.smithi037.nnxzjs (monmap changed)... 2022-02-02T13:41:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:36.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:36.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:36 smithi033 ceph-mon[101165]: Reconfiguring daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:41:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: pgmap v26: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:37.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:37.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: Reconfiguring mds.cephfs.smithi037.nnxzjs (monmap changed)... 2022-02-02T13:41:37.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.nnxzjs", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-02-02T13:41:37.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:37.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:36 smithi037 ceph-mon[69017]: Reconfiguring daemon mds.cephfs.smithi037.nnxzjs on smithi037 2022-02-02T13:41:38.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: pgmap v27: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:38.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:38.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:38.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:38.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:38.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: Upgrade: Setting container_image for all mon 2022-02-02T13:41:38.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:38.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2022-02-02T13:41:38.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2022-02-02T13:41:38.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]: dispatch 2022-02-02T13:41:38.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]': finished 2022-02-02T13:41:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: pgmap v27: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:38.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:38.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:38.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:38.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:38.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: Upgrade: Setting container_image for all mon 2022-02-02T13:41:38.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:38.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]: dispatch 2022-02-02T13:41:38.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi033"}]': finished 2022-02-02T13:41:38.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]: dispatch 2022-02-02T13:41:38.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]': finished 2022-02-02T13:41:39.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:39 smithi033 ceph-mon[101165]: Upgrade: Updating crash.smithi033 (1/2) 2022-02-02T13:41:39.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:39 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:39.660 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:39 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:39.661 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:39 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:39.661 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:39 smithi033 ceph-mon[101165]: Deploying daemon crash.smithi033 on smithi033 2022-02-02T13:41:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:39 smithi037 ceph-mon[69017]: Upgrade: Updating crash.smithi033 (1/2) 2022-02-02T13:41:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:39 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:39 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi033", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:39 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:39.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:39 smithi037 ceph-mon[69017]: Deploying daemon crash.smithi033 on smithi033 2022-02-02T13:41:40.630 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:40 smithi033 ceph-mon[101165]: pgmap v28: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:40.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:40 smithi037 ceph-mon[69017]: pgmap v28: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: pgmap v29: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.216 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: from='client.34168 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:42.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: pgmap v30: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.217 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: Health check failed: 1 daemons have recently crashed (RECENT_CRASH) 2022-02-02T13:41:42.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: from='client.34172 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:42.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:41 smithi037 ceph-mon[69017]: pgmap v31: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: pgmap v29: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: from='client.34168 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: pgmap v30: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:42.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: Health check failed: 1 daemons have recently crashed (RECENT_CRASH) 2022-02-02T13:41:42.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: from='client.34172 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:42.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:42.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:41 smithi033 ceph-mon[101165]: pgmap v31: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: Upgrade: Updating crash.smithi037 (2/2) 2022-02-02T13:41:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:43.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: Deploying daemon crash.smithi037 on smithi037 2022-02-02T13:41:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: from='client.34176 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:43.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:43.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:43 smithi033 ceph-mon[101165]: pgmap v32: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:43.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: Upgrade: Updating crash.smithi037 (2/2) 2022-02-02T13:41:43.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:43.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-02-02T13:41:43.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:43.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: Deploying daemon crash.smithi037 on smithi037 2022-02-02T13:41:43.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: from='client.34176 -' entity='client.crash.smithi033' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:43.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:43.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:43 smithi037 ceph-mon[69017]: pgmap v32: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:46.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: pgmap v33: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:46.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:46.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:46.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:46.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:46.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:46.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:45 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:46.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: pgmap v33: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:46.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:46.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:46.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:41:46.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:41:46.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:41:46.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:45 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:46 smithi037 ceph-mon[69017]: from='client.44129 -' entity='client.crash.smithi037' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:46 smithi037 ceph-mon[69017]: pgmap v34: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:46 smithi033 ceph-mon[101165]: from='client.44129 -' entity='client.crash.smithi037' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:47.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:46 smithi033 ceph-mon[101165]: pgmap v34: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:49.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:48 smithi037 ceph-mon[69017]: pgmap v35: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:49.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:48 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:48 smithi033 ceph-mon[101165]: pgmap v35: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:48 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:50.508 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:50 smithi037 ceph-mon[69017]: pgmap v36: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:50.509 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:50 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:50 smithi033 ceph-mon[101165]: pgmap v36: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:50.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:50 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:51.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:51 smithi033 ceph-mon[101165]: Health check update: 4 daemons have recently crashed (RECENT_CRASH) 2022-02-02T13:41:51.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:51 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:51.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:51 smithi037 ceph-mon[69017]: Health check update: 4 daemons have recently crashed (RECENT_CRASH) 2022-02-02T13:41:51.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:51 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:52.678 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:52 smithi033 ceph-mon[101165]: pgmap v37: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:52.679 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:52 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:52.679 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:52 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:52.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:52 smithi037 ceph-mon[69017]: pgmap v37: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:52.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:52 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:52.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:52 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:54.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:54 smithi033 ceph-mon[101165]: pgmap v38: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:54.676 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:54.676 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:41:54.676 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:41:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:54 smithi037 ceph-mon[69017]: pgmap v38: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:54.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:41:54.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:41:55.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:55.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: pgmap v39: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:55.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:55.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:55.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:55.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:55.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:55.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: Upgrade: Setting container_image for all crash 2022-02-02T13:41:55.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:55.999 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2022-02-02T13:41:56.000 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2022-02-02T13:41:56.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]: dispatch 2022-02-02T13:41:56.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]': finished 2022-02-02T13:41:56.001 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T13:41:56.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T13:41:56.002 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:55 smithi033 ceph-mon[101165]: Upgrade: osd.0 is safe to restart 2022-02-02T13:41:56.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: pgmap v39: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:41:56.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:56.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:56.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:56.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: Upgrade: Setting container_image for all crash 2022-02-02T13:41:56.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:56.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]: dispatch 2022-02-02T13:41:56.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi033"}]': finished 2022-02-02T13:41:56.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]: dispatch 2022-02-02T13:41:56.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]': finished 2022-02-02T13:41:56.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T13:41:56.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-02-02T13:41:56.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:55 smithi037 ceph-mon[69017]: Upgrade: osd.0 is safe to restart 2022-02-02T13:41:56.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:56 smithi033 ceph-mon[101165]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T13:41:56.836 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:56 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:56 smithi037 ceph-mon[69017]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2022-02-02T13:41:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:56 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:41:57.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 -- 172.21.15.33:0/560866310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f66e0 msgr2=0x7f428c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 --2- 172.21.15.33:0/560866310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f66e0 0x7f428c0f6b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f427c004660 tx=0x7f427c009b30).stop 2022-02-02T13:41:57.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 -- 172.21.15.33:0/560866310 shutdown_connections 2022-02-02T13:41:57.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 --2- 172.21.15.33:0/560866310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f7980 0x7f428c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 --2- 172.21.15.33:0/560866310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f66e0 0x7f428c0f6b00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 -- 172.21.15.33:0/560866310 >> 172.21.15.33:0/560866310 conn(0x7f428c0f1e40 msgr2=0x7f428c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:57.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.622+0000 7f4292885700 1 -- 172.21.15.33:0/560866310 shutdown_connections 2022-02-02T13:41:57.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 -- 172.21.15.33:0/560866310 wait complete. 2022-02-02T13:41:57.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 Processor -- start 2022-02-02T13:41:57.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 -- start start 2022-02-02T13:41:57.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f66e0 0x7f428c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c06a380 con 0x7f428c0f7980 2022-02-02T13:41:57.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.623+0000 7f4292885700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c06a4c0 con 0x7f428c0f66e0 2022-02-02T13:41:57.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57676/0 (socket says 172.21.15.33:57676) 2022-02-02T13:41:57.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 -- 172.21.15.33:0/1784857078 learned_addr learned my addr 172.21.15.33:0/1784857078 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:57.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428bfff700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f66e0 0x7f428c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 -- 172.21.15.33:0/1784857078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f66e0 msgr2=0x7f428c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f66e0 0x7f428c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 -- 172.21.15.33:0/1784857078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c005040 con 0x7f428c0f7980 2022-02-02T13:41:57.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f428b7fe700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f42800026d0 tx=0x7f4280009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:57.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42800079c0 con 0x7f428c0f7980 2022-02-02T13:41:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f428000f040 con 0x7f428c0f7980 2022-02-02T13:41:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c06a7a0 con 0x7f428c0f7980 2022-02-02T13:41:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42800148b0 con 0x7f428c0f7980 2022-02-02T13:41:57.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.624+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c10efe0 con 0x7f428c0f7980 2022-02-02T13:41:57.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.626+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f4280014a10 con 0x7f428c0f7980 2022-02-02T13:41:57.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.626+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c045ad0 con 0x7f428c0f7980 2022-02-02T13:41:57.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.626+0000 7f4288ff9700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 0x7f4274067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.626+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f42800819a0 con 0x7f428c0f7980 2022-02-02T13:41:57.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.626+0000 7f428bfff700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 0x7f4274067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.627+0000 7f428bfff700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 0x7f4274067300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f427c013690 tx=0x7f427c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:57.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.631+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f428004fa60 con 0x7f428c0f7980 2022-02-02T13:41:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:57 smithi037 ceph-mon[69017]: Upgrade: Updating osd.0 2022-02-02T13:41:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:57 smithi037 ceph-mon[69017]: Deploying daemon osd.0 on smithi033 2022-02-02T13:41:57.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:57 smithi037 ceph-mon[69017]: pgmap v40: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:57.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.822+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f428c057f10 con 0x7f4274064e40 2022-02-02T13:41:57.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:57 smithi033 ceph-mon[101165]: Upgrade: Updating osd.0 2022-02-02T13:41:57.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:57 smithi033 ceph-mon[101165]: Deploying daemon osd.0 on smithi033 2022-02-02T13:41:57.823 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:57 smithi033 ceph-mon[101165]: pgmap v40: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:57.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.823+0000 7f4288ff9700 1 -- 172.21.15.33:0/1784857078 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f428c057f10 con 0x7f4274064e40 2022-02-02T13:41:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.825+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 msgr2=0x7f4274067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.825+0000 7f4292885700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 0x7f4274067300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f427c013690 tx=0x7f427c009b30).stop 2022-02-02T13:41:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.825+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 msgr2=0x7f428c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.825+0000 7f4292885700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f42800026d0 tx=0x7f4280009de0).stop 2022-02-02T13:41:57.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 shutdown_connections 2022-02-02T13:41:57.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4274064e40 0x7f4274067300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f66e0 0x7f428c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 --2- 172.21.15.33:0/1784857078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f7980 0x7f428c069e20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 >> 172.21.15.33:0/1784857078 conn(0x7f428c0f1e40 msgr2=0x7f428c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:57.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 shutdown_connections 2022-02-02T13:41:57.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.826+0000 7f4292885700 1 -- 172.21.15.33:0/1784857078 wait complete. 2022-02-02T13:41:57.837 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 -- 172.21.15.33:0/2598012896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 msgr2=0x7f7a9c0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 --2- 172.21.15.33:0/2598012896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0fbc70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7a8c004660 tx=0x7f7a8c009b30).stop 2022-02-02T13:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 -- 172.21.15.33:0/2598012896 shutdown_connections 2022-02-02T13:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 --2- 172.21.15.33:0/2598012896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0fbc70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 --2- 172.21.15.33:0/2598012896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 0x7f7a9c0f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.936+0000 7f7aa3342700 1 -- 172.21.15.33:0/2598012896 >> 172.21.15.33:0/2598012896 conn(0x7f7a9c0f0d40 msgr2=0x7f7a9c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 -- 172.21.15.33:0/2598012896 shutdown_connections 2022-02-02T13:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 -- 172.21.15.33:0/2598012896 wait complete. 2022-02-02T13:41:57.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 Processor -- start 2022-02-02T13:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 -- start start 2022-02-02T13:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 0x7f7a9c0f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c0f5740 con 0x7f7a9c0f9860 2022-02-02T13:41:57.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.937+0000 7f7aa3342700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9c0f5880 con 0x7f7a9c0602d0 2022-02-02T13:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57686/0 (socket says 172.21.15.33:57686) 2022-02-02T13:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 -- 172.21.15.33:0/176341448 learned_addr learned my addr 172.21.15.33:0/176341448 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:57.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa10de700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 0x7f7a9c0f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 -- 172.21.15.33:0/176341448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 msgr2=0x7f7a9c0f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 0x7f7a9c0f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 -- 172.21.15.33:0/176341448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c005040 con 0x7f7a9c0f9860 2022-02-02T13:41:57.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa08dd700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7a8c013a70 tx=0x7f7a8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:57.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c018070 con 0x7f7a9c0f9860 2022-02-02T13:41:57.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9c0f5b00 con 0x7f7a9c0f9860 2022-02-02T13:41:57.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a8c0097d0 con 0x7f7a9c0f9860 2022-02-02T13:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.938+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a8c01de80 con 0x7f7a9c0f9860 2022-02-02T13:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.939+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9c0f6060 con 0x7f7a9c0f9860 2022-02-02T13:41:57.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.939+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a9c045ad0 con 0x7f7a9c0f9860 2022-02-02T13:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.940+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f7a8c007ba0 con 0x7f7a9c0f9860 2022-02-02T13:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.940+0000 7f7a91ffb700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 0x7f7a88067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:57.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.941+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7a8c0836e0 con 0x7f7a9c0f9860 2022-02-02T13:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.941+0000 7f7aa10de700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 0x7f7a88067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.941+0000 7f7aa10de700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 0x7f7a88067300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7a9c0f6af0 tx=0x7f7a9800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:57.945+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a8c0517a0 con 0x7f7a9c0f9860 2022-02-02T13:41:58.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.135+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a9c0fef90 con 0x7f7a88064e40 2022-02-02T13:41:58.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.150+0000 7f7a91ffb700 1 -- 172.21.15.33:0/176341448 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f7a9c0fef90 con 0x7f7a88064e40 2022-02-02T13:41:58.151 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:41:58.151 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (7m) 7s ago 8m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:41:58.151 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (17s) 7s ago 8m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:41:58.151 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (13s) 9s ago 7m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:41:58.152 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (7m) 7s ago 8m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:41:58.152 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (46s) 7s ago 4m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:41:58.152 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (84s) 7s ago 4m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:41:58.152 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (2m) 9s ago 4m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:41:58.153 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (4m) 9s ago 4m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:41:58.153 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (114s) 7s ago 9m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:41:58.153 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (85s) 9s ago 7m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:41:58.153 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (72s) 7s ago 9m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:41:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (51s) 9s ago 7m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:41:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (7m) 7s ago 7m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:41:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (7m) 9s ago 7m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:41:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (6m) 7s ago 6m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:41:58.154 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 7s ago 6m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:41:58.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 7s ago 6m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:41:58.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (6m) 9s ago 6m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:41:58.155 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (5m) 9s ago 5m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:41:58.156 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (5m) 9s ago 5m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:41:58.156 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (7m) 7s ago 7m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:41:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 msgr2=0x7f7a88067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 0x7f7a88067300 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f7a9c0f6af0 tx=0x7f7a9800b040).stop 2022-02-02T13:41:58.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 msgr2=0x7f7a9c0f51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7a8c013a70 tx=0x7f7a8c009b30).stop 2022-02-02T13:41:58.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 shutdown_connections 2022-02-02T13:41:58.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a88064e40 0x7f7a88067300 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a9c0602d0 0x7f7a9c0f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 --2- 172.21.15.33:0/176341448 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a9c0f9860 0x7f7a9c0f51e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 >> 172.21.15.33:0/176341448 conn(0x7f7a9c0f0d40 msgr2=0x7f7a9c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.152+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 shutdown_connections 2022-02-02T13:41:58.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.153+0000 7f7aa3342700 1 -- 172.21.15.33:0/176341448 wait complete. 2022-02-02T13:41:58.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2049170702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 msgr2=0x7f6b300f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2049170702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b300f6950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f6b20004660 tx=0x7f6b20009b30).stop 2022-02-02T13:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2049170702 shutdown_connections 2022-02-02T13:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2049170702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 0x7f6b300f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2049170702 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b300f6950 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2049170702 >> 172.21.15.33:0/2049170702 conn(0x7f6b300f1c90 msgr2=0x7f6b300f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:58.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2049170702 shutdown_connections 2022-02-02T13:41:58.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.257+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2049170702 wait complete. 2022-02-02T13:41:58.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 Processor -- start 2022-02-02T13:41:58.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 -- start start 2022-02-02T13:41:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 0x7f6b30069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3006a380 con 0x7f6b300f6530 2022-02-02T13:41:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.258+0000 7f6b2ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3006a4c0 con 0x7f6b300f77d0 2022-02-02T13:41:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57694/0 (socket says 172.21.15.33:57694) 2022-02-02T13:41:58.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 -- 172.21.15.33:0/2685463647 learned_addr learned my addr 172.21.15.33:0/2685463647 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:58.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2e7fc700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 0x7f6b30069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 -- 172.21.15.33:0/2685463647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 msgr2=0x7f6b30069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 0x7f6b30069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 -- 172.21.15.33:0/2685463647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20005040 con 0x7f6b300f6530 2022-02-02T13:41:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2effd700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6b20000c00 tx=0x7f6b20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b20018070 con 0x7f6b300f6530 2022-02-02T13:41:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b20007cf0 con 0x7f6b300f6530 2022-02-02T13:41:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3006a740 con 0x7f6b300f6530 2022-02-02T13:41:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2001c3c0 con 0x7f6b300f6530 2022-02-02T13:41:58.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.259+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3006aca0 con 0x7f6b300f6530 2022-02-02T13:41:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.260+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30045ad0 con 0x7f6b300f6530 2022-02-02T13:41:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.261+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f6b2001d420 con 0x7f6b300f6530 2022-02-02T13:41:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.261+0000 7f6b177fe700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 0x7f6b18067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.261+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6b20083960 con 0x7f6b300f6530 2022-02-02T13:41:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.261+0000 7f6b2e7fc700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 0x7f6b18067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.262+0000 7f6b2e7fc700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 0x7f6b18067360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6b240041d0 tx=0x7f6b24009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.266+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b20051a20 con 0x7f6b300f6530 2022-02-02T13:41:58.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.537+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6b300fedc0 con 0x7f6b300f6530 2022-02-02T13:41:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.538+0000 7f6b177fe700 1 -- 172.21.15.33:0/2685463647 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+703 (secure 0 0 0) 0x7f6b20055040 con 0x7f6b300f6530 2022-02-02T13:41:58.541 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:41:58.541 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:41:58.542 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:41:58.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:58.542 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:41:58.542 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:41:58.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:58.543 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:41:58.543 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 6 2022-02-02T13:41:58.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:41:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:41:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:41:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:41:58.544 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2022-02-02T13:41:58.545 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:41:58.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:41:58.545 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:41:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 msgr2=0x7f6b18067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 0x7f6b18067360 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6b240041d0 tx=0x7f6b24009040).stop 2022-02-02T13:41:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 msgr2=0x7f6b3006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f6b20000c00 tx=0x7f6b20009b30).stop 2022-02-02T13:41:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 shutdown_connections 2022-02-02T13:41:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064ea0 0x7f6b18067360 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b300f6530 0x7f6b3006b9a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/2685463647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300f77d0 0x7f6b30069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 >> 172.21.15.33:0/2685463647 conn(0x7f6b300f1c90 msgr2=0x7f6b300fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:58.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 shutdown_connections 2022-02-02T13:41:58.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.541+0000 7f6b2ffff700 1 -- 172.21.15.33:0/2685463647 wait complete. 2022-02-02T13:41:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.672+0000 7fd4cf451700 1 -- 172.21.15.33:0/4022053369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 msgr2=0x7fd4c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.672+0000 7fd4cf451700 1 --2- 172.21.15.33:0/4022053369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c80f6cc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fd4b8004660 tx=0x7fd4b8009b30).stop 2022-02-02T13:41:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 -- 172.21.15.33:0/4022053369 shutdown_connections 2022-02-02T13:41:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 --2- 172.21.15.33:0/4022053369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c80f6cc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 --2- 172.21.15.33:0/4022053369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 0x7fd4c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 -- 172.21.15.33:0/4022053369 >> 172.21.15.33:0/4022053369 conn(0x7fd4c80f0d40 msgr2=0x7fd4c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 -- 172.21.15.33:0/4022053369 shutdown_connections 2022-02-02T13:41:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 -- 172.21.15.33:0/4022053369 wait complete. 2022-02-02T13:41:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 Processor -- start 2022-02-02T13:41:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.673+0000 7fd4cf451700 1 -- start start 2022-02-02T13:41:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cf451700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 0x7fd4c8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cf451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cf451700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8107a10 con 0x7fd4c80f6860 2022-02-02T13:41:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cf451700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8107b50 con 0x7fd4c80f55c0 2022-02-02T13:41:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57716/0 (socket says 172.21.15.33:57716) 2022-02-02T13:41:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 -- 172.21.15.33:0/3654158177 learned_addr learned my addr 172.21.15.33:0/3654158177 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:41:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cd1ed700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 0x7fd4c8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 -- 172.21.15.33:0/3654158177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 msgr2=0x7fd4c8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 0x7fd4c8106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 -- 172.21.15.33:0/3654158177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b8005040 con 0x7fd4c80f6860 2022-02-02T13:41:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4cc9ec700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd4b8009990 tx=0x7fd4b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.674+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b8018070 con 0x7fd4c80f6860 2022-02-02T13:41:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.675+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c8108490 con 0x7fd4c80f6860 2022-02-02T13:41:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.675+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd4b8007ba0 con 0x7fd4c80f6860 2022-02-02T13:41:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.675+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4b801c3c0 con 0x7fd4c80f6860 2022-02-02T13:41:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.675+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c81089f0 con 0x7fd4c80f6860 2022-02-02T13:41:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.676+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c8045ad0 con 0x7fd4c80f6860 2022-02-02T13:41:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.676+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fd4b801d420 con 0x7fd4c80f6860 2022-02-02T13:41:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.677+0000 7fd4bdffb700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 0x7fd4b4067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:41:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.677+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd4b8083720 con 0x7fd4c80f6860 2022-02-02T13:41:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.677+0000 7fd4cd1ed700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 0x7fd4b4067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:41:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.677+0000 7fd4cd1ed700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 0x7fd4b4067300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd4c80f66c0 tx=0x7fd4c400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:41:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.681+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd4b80552d0 con 0x7fd4c80f6860 2022-02-02T13:41:58.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:58 smithi033 ceph-mon[101165]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:58.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:58 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2685463647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:58.748 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:58 smithi033 systemd[1]: Stopping Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:41:58.748 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:58 smithi033 conmon[50728]: debug 2022-02-02T13:41:58.583+0000 7f7970b1c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-02-02T13:41:58.748 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:58 smithi033 conmon[50728]: debug 2022-02-02T13:41:58.583+0000 7f7970b1c700 -1 osd.0 53 *** Got signal Terminated *** 2022-02-02T13:41:58.749 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:58 smithi033 conmon[50728]: debug 2022-02-02T13:41:58.583+0000 7f7970b1c700 -1 osd.0 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-02-02T13:41:58.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.904+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4c81090f0 con 0x7fd4c80f6860 2022-02-02T13:41:58.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.905+0000 7fd4bdffb700 1 -- 172.21.15.33:0/3654158177 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd4b8054ec0 con 0x7fd4c80f6860 2022-02-02T13:41:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:41:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:41:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:41:58.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:41:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:41:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:41:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:41:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:41:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:41:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:41:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:41:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:41:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:41:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:41:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:41:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:41:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:41:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:41:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:41:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:41:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:41:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:41:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:41:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:41:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:41:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:41:58.913 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:41:58.913 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:41:58.913 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:41:58.914 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:58.914 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:58.914 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:41:58.915 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:41:58.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:58.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:58.915 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:58.916 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:41:58.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 msgr2=0x7fd4b4067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 0x7fd4b4067300 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd4c80f66c0 tx=0x7fd4c400b040).stop 2022-02-02T13:41:58.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 msgr2=0x7fd4c8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:41:58.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd4b8009990 tx=0x7fd4b8009b30).stop 2022-02-02T13:41:58.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 shutdown_connections 2022-02-02T13:41:58.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd4b4064e40 0x7fd4b4067300 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4c80f55c0 0x7fd4c8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 --2- 172.21.15.33:0/3654158177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4c80f6860 0x7fd4c8107460 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:41:58.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 >> 172.21.15.33:0/3654158177 conn(0x7fd4c80f0d40 msgr2=0x7fd4c805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:41:58.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 shutdown_connections 2022-02-02T13:41:58.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:41:58.907+0000 7fd4cf451700 1 -- 172.21.15.33:0/3654158177 wait complete. 2022-02-02T13:41:58.920 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:41:59.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:58 smithi037 ceph-mon[69017]: from='client.34184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:59.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:58 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2685463647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:41:59.092 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:58 smithi033 bash[109560]: ceph-7b277774-842c-11ec-8c35-001a4aab830c-osd.0 2022-02-02T13:41:59.093 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:59 smithi033 bash[109560]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-osd-0" found: no such container 2022-02-02T13:41:59.093 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:59 smithi033 bash[109560]: Error: no container with name or ID "ceph-7b277774-842c-11ec-8c35-001a4aab830c-osd.0" found: no such container 2022-02-02T13:41:59.708 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:41:59 smithi033 podman[109910]: 2022-02-02T13:41:59.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:41:59.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: pgmap v41: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:41:59.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.5 2022-02-02T13:41:59.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.5) 2022-02-02T13:41:59.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.5 2022-02-02T13:41:59.994 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.1 2022-02-02T13:41:59.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.4 2022-02-02T13:41:59.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.3 2022-02-02T13:41:59.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.2 2022-02-02T13:41:59.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.1 2022-02-02T13:41:59.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.4 2022-02-02T13:41:59.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.3 2022-02-02T13:41:59.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.2 2022-02-02T13:41:59.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3654158177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:41:59.996 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.4 2022-02-02T13:41:59.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.4 2022-02-02T13:41:59.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.3 2022-02-02T13:41:59.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.5 2022-02-02T13:41:59.997 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.1 2022-02-02T13:41:59.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.3 2022-02-02T13:41:59.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.2 2022-02-02T13:41:59.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.5 2022-02-02T13:41:59.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.1 2022-02-02T13:41:59.998 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:41:59 smithi033 ceph-mon[101165]: osd.0 reported immediately failed by osd.2 2022-02-02T13:42:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:42:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: pgmap v41: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.5 2022-02-02T13:42:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.5) 2022-02-02T13:42:00.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.5 2022-02-02T13:42:00.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.1 2022-02-02T13:42:00.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.4 2022-02-02T13:42:00.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.3 2022-02-02T13:42:00.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.2 2022-02-02T13:42:00.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.1 2022-02-02T13:42:00.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.4 2022-02-02T13:42:00.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.3 2022-02-02T13:42:00.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.2 2022-02-02T13:42:00.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3654158177' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:42:00.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.4 2022-02-02T13:42:00.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.4 2022-02-02T13:42:00.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.3 2022-02-02T13:42:00.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.5 2022-02-02T13:42:00.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.1 2022-02-02T13:42:00.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.3 2022-02-02T13:42:00.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.2 2022-02-02T13:42:00.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.5 2022-02-02T13:42:00.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.1 2022-02-02T13:42:00.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:41:59 smithi037 ceph-mon[69017]: osd.0 reported immediately failed by osd.2 2022-02-02T13:42:00.426 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:42:00 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Succeeded. 2022-02-02T13:42:00.426 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:42:00 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:42:00.709 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:42:00 smithi033 systemd[1]: Starting Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:42:00.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:42:00 smithi033 podman[110208]: 2022-02-02T13:42:00.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:00 smithi033 ceph-mon[101165]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T13:42:00.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:00 smithi033 ceph-mon[101165]: osdmap e54: 6 total, 5 up, 6 in 2022-02-02T13:42:01.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:00 smithi037 ceph-mon[69017]: Health check failed: 1 osds down (OSD_DOWN) 2022-02-02T13:42:01.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:00 smithi037 ceph-mon[69017]: osdmap e54: 6 total, 5 up, 6 in 2022-02-02T13:42:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:01 smithi033 ceph-mon[101165]: pgmap v43: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:01 smithi033 ceph-mon[101165]: osdmap e55: 6 total, 5 up, 6 in 2022-02-02T13:42:01.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:01 smithi033 ceph-mon[101165]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2022-02-02T13:42:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:01 smithi037 ceph-mon[69017]: pgmap v43: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:01 smithi037 ceph-mon[69017]: osdmap e55: 6 total, 5 up, 6 in 2022-02-02T13:42:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:01 smithi037 ceph-mon[69017]: Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2022-02-02T13:42:03.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:03 smithi033 ceph-mon[101165]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:03 smithi037 ceph-mon[69017]: pgmap v45: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:05.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:05 smithi033 ceph-mon[101165]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:05 smithi037 ceph-mon[69017]: pgmap v46: 65 pgs: 34 peering, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2022-02-02T13:42:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:06 smithi037 ceph-mon[69017]: Health check failed: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T13:42:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:06 smithi037 ceph-mon[69017]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 9 pgs peering) 2022-02-02T13:42:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:06 smithi033 ceph-mon[101165]: Health check failed: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded (PG_DEGRADED) 2022-02-02T13:42:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:06 smithi033 ceph-mon[101165]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 9 pgs peering) 2022-02-02T13:42:08.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:07 smithi037 ceph-mon[69017]: pgmap v47: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:07 smithi033 ceph-mon[101165]: pgmap v47: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:09 smithi037 ceph-mon[69017]: pgmap v48: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:10.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:09 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:42:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:09 smithi033 ceph-mon[101165]: pgmap v48: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:09 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:42:11.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:11 smithi033 ceph-mon[101165]: pgmap v49: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:12.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:11 smithi037 ceph-mon[69017]: pgmap v49: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:13 smithi037 ceph-mon[69017]: pgmap v50: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:14.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:13 smithi033 ceph-mon[101165]: pgmap v50: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:16.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:15 smithi037 ceph-mon[69017]: pgmap v51: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:15 smithi033 ceph-mon[101165]: pgmap v51: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:18.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:17 smithi037 ceph-mon[69017]: pgmap v52: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:17 smithi033 ceph-mon[101165]: pgmap v52: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:20.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:19 smithi037 ceph-mon[69017]: pgmap v53: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:20.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:19 smithi033 ceph-mon[101165]: pgmap v53: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:21.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:21 smithi033 ceph-mon[101165]: pgmap v54: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:22.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:21 smithi037 ceph-mon[69017]: pgmap v54: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:24.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:23 smithi037 ceph-mon[69017]: pgmap v55: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:23 smithi033 ceph-mon[101165]: pgmap v55: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:26.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:25 smithi037 ceph-mon[69017]: pgmap v56: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:25 smithi033 ceph-mon[101165]: pgmap v56: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:28.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:27 smithi037 ceph-mon[69017]: pgmap v57: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:28.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:27 smithi033 ceph-mon[101165]: pgmap v57: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.026+0000 7ff6d257f700 1 -- 172.21.15.33:0/174434673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f6860 msgr2=0x7ff6cc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.026+0000 7ff6d257f700 1 --2- 172.21.15.33:0/174434673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc0f6cc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff6b4004660 tx=0x7ff6b4009b30).stop 2022-02-02T13:42:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 -- 172.21.15.33:0/174434673 shutdown_connections 2022-02-02T13:42:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 --2- 172.21.15.33:0/174434673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc0f6cc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 --2- 172.21.15.33:0/174434673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 -- 172.21.15.33:0/174434673 >> 172.21.15.33:0/174434673 conn(0x7ff6cc0f0d40 msgr2=0x7ff6cc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 -- 172.21.15.33:0/174434673 shutdown_connections 2022-02-02T13:42:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 -- 172.21.15.33:0/174434673 wait complete. 2022-02-02T13:42:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 Processor -- start 2022-02-02T13:42:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.027+0000 7ff6d257f700 1 -- start start 2022-02-02T13:42:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6d257f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6d257f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6d257f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc0603c0 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6d257f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc060500 con 0x7ff6cc0f6860 2022-02-02T13:42:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57742/0 (socket says 172.21.15.33:57742) 2022-02-02T13:42:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 -- 172.21.15.33:0/3742824199 learned_addr learned my addr 172.21.15.33:0/3742824199 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:42:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cb7fe700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 -- 172.21.15.33:0/3742824199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f6860 msgr2=0x7ff6cc10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc10c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 -- 172.21.15.33:0/3742824199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4005040 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.028+0000 7ff6cbfff700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff6bc002700 tx=0x7ff6bc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.029+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6bc009320 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.029+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6bc00f040 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.029+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc10c690 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.029+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6bc0148e0 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.029+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc10cc20 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.030+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7ff6bc009480 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.030+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc0f49b0 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.030+0000 7ff6c8ff9700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 0x7ff6b8067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.031+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff6bc081df0 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.031+0000 7ff6cb7fe700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 0x7ff6b8067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.031+0000 7ff6cb7fe700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 0x7ff6b8067300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff6b4009da0 tx=0x7ff6b4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.035+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff6bc04feb0 con 0x7ff6cc0f55c0 2022-02-02T13:42:29.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.224+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6cc057f10 con 0x7ff6b8064e40 2022-02-02T13:42:29.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.225+0000 7ff6c8ff9700 1 -- 172.21.15.33:0/3742824199 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7ff6cc057f10 con 0x7ff6b8064e40 2022-02-02T13:42:29.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 msgr2=0x7ff6b8067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 0x7ff6b8067300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff6b4009da0 tx=0x7ff6b4009b30).stop 2022-02-02T13:42:29.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 msgr2=0x7ff6cc109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7ff6bc002700 tx=0x7ff6bc009e00).stop 2022-02-02T13:42:29.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 shutdown_connections 2022-02-02T13:42:29.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6b8064e40 0x7ff6b8067300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6cc0f55c0 0x7ff6cc109be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 --2- 172.21.15.33:0/3742824199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6cc0f6860 0x7ff6cc10c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 >> 172.21.15.33:0/3742824199 conn(0x7ff6cc0f0d40 msgr2=0x7ff6cc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 shutdown_connections 2022-02-02T13:42:29.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.227+0000 7ff6d257f700 1 -- 172.21.15.33:0/3742824199 wait complete. 2022-02-02T13:42:29.238 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:42:29.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 -- 172.21.15.33:0/833221004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f66d0 msgr2=0x7fb1740f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 --2- 172.21.15.33:0/833221004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f66d0 0x7fb1740f6b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fb160004660 tx=0x7fb160009b30).stop 2022-02-02T13:42:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 -- 172.21.15.33:0/833221004 shutdown_connections 2022-02-02T13:42:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 --2- 172.21.15.33:0/833221004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f66d0 0x7fb1740f6b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 --2- 172.21.15.33:0/833221004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f5430 0x7fb1740f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.329+0000 7fb179e89700 1 -- 172.21.15.33:0/833221004 >> 172.21.15.33:0/833221004 conn(0x7fb1740f0b90 msgr2=0x7fb1740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.330+0000 7fb179e89700 1 -- 172.21.15.33:0/833221004 shutdown_connections 2022-02-02T13:42:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.330+0000 7fb179e89700 1 -- 172.21.15.33:0/833221004 wait complete. 2022-02-02T13:42:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.330+0000 7fb179e89700 1 Processor -- start 2022-02-02T13:42:29.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.330+0000 7fb179e89700 1 -- start start 2022-02-02T13:42:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb179e89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb179e89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f66d0 0x7fb1741093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb179e89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174109970 con 0x7fb1740f5430 2022-02-02T13:42:29.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb179e89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb174109ab0 con 0x7fb1740f66d0 2022-02-02T13:42:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57752/0 (socket says 172.21.15.33:57752) 2022-02-02T13:42:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 -- 172.21.15.33:0/1355139178 learned_addr learned my addr 172.21.15.33:0/1355139178 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:42:29.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb173fff700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f66d0 0x7fb1741093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 -- 172.21.15.33:0/1355139178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f66d0 msgr2=0x7fb1741093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f66d0 0x7fb1741093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 -- 172.21.15.33:0/1355139178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb160005040 con 0x7fb1740f5430 2022-02-02T13:42:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb178e87700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb16800e7c0 tx=0x7fb16800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.331+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1680092e0 con 0x7fb1740f5430 2022-02-02T13:42:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.332+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17410a450 con 0x7fb1740f5430 2022-02-02T13:42:29.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.332+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb16800f040 con 0x7fb1740f5430 2022-02-02T13:42:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.332+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1680147e0 con 0x7fb1740f5430 2022-02-02T13:42:29.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.332+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb17410aa10 con 0x7fb1740f5430 2022-02-02T13:42:29.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.333+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb174045ad0 con 0x7fb1740f5430 2022-02-02T13:42:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.333+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7fb16801b030 con 0x7fb1740f5430 2022-02-02T13:42:29.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.333+0000 7fb1717fa700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 0x7fb164067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.333+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb168081a90 con 0x7fb1740f5430 2022-02-02T13:42:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.333+0000 7fb173fff700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 0x7fb164067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.334+0000 7fb173fff700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 0x7fb164067360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb160009720 tx=0x7fb160016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.338+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb168053580 con 0x7fb1740f5430 2022-02-02T13:42:29.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.517+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1740fa910 con 0x7fb164064ea0 2022-02-02T13:42:29.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.532+0000 7fb1717fa700 1 -- 172.21.15.33:0/1355139178 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fb1740fa910 con 0x7fb164064ea0 2022-02-02T13:42:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:42:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (7m) 38s ago 8m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:42:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (48s) 38s ago 8m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:42:29.533 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (45s) 40s ago 8m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:42:29.537 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (7m) 38s ago 8m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:42:29.537 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (77s) 38s ago 4m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:42:29.538 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (115s) 38s ago 4m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:42:29.539 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (2m) 40s ago 5m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:42:29.539 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (4m) 40s ago 4m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:42:29.539 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (2m) 38s ago 10m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:42:29.540 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (116s) 40s ago 8m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:42:29.540 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (104s) 38s ago 10m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:42:29.541 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (82s) 40s ago 8m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:42:29.541 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (8m) 38s ago 8m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:42:29.542 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (8m) 40s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:42:29.543 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 38s ago 7m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:42:29.544 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 38s ago 7m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:42:29.544 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 38s ago 6m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:42:29.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (6m) 40s ago 6m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:42:29.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (6m) 40s ago 6m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:42:29.545 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (6m) 40s ago 6m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:42:29.546 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (7m) 38s ago 8m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:42:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 msgr2=0x7fb164067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 0x7fb164067360 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb160009720 tx=0x7fb160016040).stop 2022-02-02T13:42:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 msgr2=0x7fb174108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fb16800e7c0 tx=0x7fb16800b040).stop 2022-02-02T13:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 shutdown_connections 2022-02-02T13:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb164064ea0 0x7fb164067360 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1740f5430 0x7fb174108ed0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 --2- 172.21.15.33:0/1355139178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1740f66d0 0x7fb1741093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 >> 172.21.15.33:0/1355139178 conn(0x7fb1740f0b90 msgr2=0x7fb17405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 shutdown_connections 2022-02-02T13:42:29.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.534+0000 7fb179e89700 1 -- 172.21.15.33:0/1355139178 wait complete. 2022-02-02T13:42:29.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- 172.21.15.33:0/4247611476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 msgr2=0x7f9f680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/4247611476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f680f7de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f9f54004660 tx=0x7f9f54009b30).stop 2022-02-02T13:42:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- 172.21.15.33:0/4247611476 shutdown_connections 2022-02-02T13:42:29.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/4247611476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f680f7de0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/4247611476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- 172.21.15.33:0/4247611476 >> 172.21.15.33:0/4247611476 conn(0x7f9f680f1e40 msgr2=0x7f9f680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- 172.21.15.33:0/4247611476 shutdown_connections 2022-02-02T13:42:29.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- 172.21.15.33:0/4247611476 wait complete. 2022-02-02T13:42:29.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 Processor -- start 2022-02-02T13:42:29.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.635+0000 7f9f6eedb700 1 -- start start 2022-02-02T13:42:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6eedb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6eedb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6eedb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6806a380 con 0x7f9f680f7980 2022-02-02T13:42:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6eedb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f6806a4c0 con 0x7f9f680f66e0 2022-02-02T13:42:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57764/0 (socket says 172.21.15.33:57764) 2022-02-02T13:42:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 -- 172.21.15.33:0/1321743295 learned_addr learned my addr 172.21.15.33:0/1321743295 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:42:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6cc77700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 -- 172.21.15.33:0/1321743295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 msgr2=0x7f9f6806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f6806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f67fff700 1 -- 172.21.15.33:0/1321743295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f54005040 con 0x7f9f680f7980 2022-02-02T13:42:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.636+0000 7f9f6cc77700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:42:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f67fff700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f54000c00 tx=0x7f9f5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f54019070 con 0x7f9f680f7980 2022-02-02T13:42:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f54007e70 con 0x7f9f680f7980 2022-02-02T13:42:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f6806a740 con 0x7f9f680f7980 2022-02-02T13:42:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f54014ce0 con 0x7f9f680f7980 2022-02-02T13:42:29.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.637+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f6806aca0 con 0x7f9f680f7980 2022-02-02T13:42:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.638+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f68045ad0 con 0x7f9f680f7980 2022-02-02T13:42:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.638+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f9f54025070 con 0x7f9f680f7980 2022-02-02T13:42:29.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.639+0000 7f9f657fa700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 0x7f9f58067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.639+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9f54082a30 con 0x7f9f680f7980 2022-02-02T13:42:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.639+0000 7f9f6cc77700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 0x7f9f58067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.639+0000 7f9f6cc77700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 0x7f9f58067300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9f6806b730 tx=0x7f9f5c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.643+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f54050af0 con 0x7f9f680f7980 2022-02-02T13:42:29.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.888+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9f68027a00 con 0x7f9f680f7980 2022-02-02T13:42:29.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:29 smithi033 ceph-mon[101165]: pgmap v58: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:29.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.889+0000 7f9f657fa700 1 -- 172.21.15.33:0/1321743295 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9f54023070 con 0x7f9f680f7980 2022-02-02T13:42:29.891 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:42:29.891 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:42:29.891 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:42:29.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:42:29.892 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:42:29.892 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:42:29.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:42:29.892 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:42:29.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:42:29.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:42:29.893 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:42:29.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:42:29.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:42:29.894 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:42:29.894 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:42:29.894 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:42:29.894 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:42:29.895 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:42:29.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.890+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 msgr2=0x7f9f58067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.890+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 0x7f9f58067300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9f6806b730 tx=0x7f9f5c00b040).stop 2022-02-02T13:42:29.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.890+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 msgr2=0x7f9f68069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.890+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f9f54000c00 tx=0x7f9f5400b040).stop 2022-02-02T13:42:29.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 shutdown_connections 2022-02-02T13:42:29.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f58064e40 0x7f9f58067300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f680f66e0 0x7f9f6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 --2- 172.21.15.33:0/1321743295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f680f7980 0x7f9f68069e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 >> 172.21.15.33:0/1321743295 conn(0x7f9f680f1e40 msgr2=0x7f9f680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 shutdown_connections 2022-02-02T13:42:29.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.891+0000 7f9f6eedb700 1 -- 172.21.15.33:0/1321743295 wait complete. 2022-02-02T13:42:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 -- 172.21.15.33:0/2441607602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f6860 msgr2=0x7f24400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:29.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 --2- 172.21.15.33:0/2441607602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f6860 0x7f24400f6cc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2434004660 tx=0x7f2434009b30).stop 2022-02-02T13:42:29.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 -- 172.21.15.33:0/2441607602 shutdown_connections 2022-02-02T13:42:29.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 --2- 172.21.15.33:0/2441607602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f6860 0x7f24400f6cc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 --2- 172.21.15.33:0/2441607602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f55c0 0x7f24400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 -- 172.21.15.33:0/2441607602 >> 172.21.15.33:0/2441607602 conn(0x7f24400f0d40 msgr2=0x7f24400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 -- 172.21.15.33:0/2441607602 shutdown_connections 2022-02-02T13:42:29.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.992+0000 7f244629b700 1 -- 172.21.15.33:0/2441607602 wait complete. 2022-02-02T13:42:29.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 Processor -- start 2022-02-02T13:42:29.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 -- start start 2022-02-02T13:42:29.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f6860 0x7f244010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:29.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400602b0 con 0x7f24400f55c0 2022-02-02T13:42:29.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f244629b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24400603f0 con 0x7f24400f6860 2022-02-02T13:42:30.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f243ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:30.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f243ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57770/0 (socket says 172.21.15.33:57770) 2022-02-02T13:42:30.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f243ffff700 1 -- 172.21.15.33:0/487477148 learned_addr learned my addr 172.21.15.33:0/487477148 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:42:30.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.993+0000 7f243f7fe700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f6860 0x7f244010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:30.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243ffff700 1 -- 172.21.15.33:0/487477148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f6860 msgr2=0x7f244010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:30.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243ffff700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f6860 0x7f244010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:30.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243ffff700 1 -- 172.21.15.33:0/487477148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434005040 con 0x7f24400f55c0 2022-02-02T13:42:30.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243ffff700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f243000c530 tx=0x7f2430007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:30.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243000f650 con 0x7f24400f55c0 2022-02-02T13:42:30.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244010ea60 con 0x7f24400f55c0 2022-02-02T13:42:30.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244010eee0 con 0x7f24400f55c0 2022-02-02T13:42:30.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f243000fc60 con 0x7f24400f55c0 2022-02-02T13:42:30.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.994+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2430012cb0 con 0x7f24400f55c0 2022-02-02T13:42:30.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.995+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2420004fa0 con 0x7f24400f55c0 2022-02-02T13:42:30.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.995+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 35) v1 ==== 82812+0+0 (secure 0 0 0) 0x7f2430019030 con 0x7f24400f55c0 2022-02-02T13:42:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.996+0000 7f243cff9700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 0x7f2428067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:42:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.996+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2430081590 con 0x7f24400f55c0 2022-02-02T13:42:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.996+0000 7f243f7fe700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 0x7f2428067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:42:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:29.996+0000 7f243f7fe700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 0x7f2428067300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2434004630 tx=0x7f2434009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:42:30.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.000+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24300487d0 con 0x7f24400f55c0 2022-02-02T13:42:30.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:29 smithi037 ceph-mon[69017]: pgmap v58: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:30.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.214+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2420005e80 con 0x7f24400f55c0 2022-02-02T13:42:30.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.215+0000 7f243cff9700 1 -- 172.21.15.33:0/487477148 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2430017070 con 0x7f24400f55c0 2022-02-02T13:42:30.216 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:42:30.216 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:42:30.216 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:42:30.216 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:42:30.217 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:42:30.217 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:42:30.217 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:42:30.217 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:42:30.218 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:42:30.218 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:42:30.218 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:42:30.219 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:42:30.219 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:42:30.220 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:42:30.220 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:42:30.221 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:42:30.221 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:42:30.221 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:42:30.222 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:42:30.222 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:42:30.223 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:42:30.223 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:42:30.224 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:42:30.224 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:42:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:42:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:42:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:42:30.226 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:42:30.226 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:42:30.227 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:42:30.227 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:42:30.227 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:42:30.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:42:30.228 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:42:30.229 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:42:30.229 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:42:30.230 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:42:30.230 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:42:30.230 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:42:30.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 msgr2=0x7f2428067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:30.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 0x7f2428067300 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f2434004630 tx=0x7f2434009b30).stop 2022-02-02T13:42:30.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 msgr2=0x7f244010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:42:30.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f243000c530 tx=0x7f2430007e10).stop 2022-02-02T13:42:30.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 shutdown_connections 2022-02-02T13:42:30.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2428064e40 0x7f2428067300 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:30.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24400f55c0 0x7f244010c070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:30.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 --2- 172.21.15.33:0/487477148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24400f6860 0x7f244010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:42:30.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 >> 172.21.15.33:0/487477148 conn(0x7f24400f0d40 msgr2=0x7f24400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:42:30.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.218+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 shutdown_connections 2022-02-02T13:42:30.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:42:30.219+0000 7f244629b700 1 -- 172.21.15.33:0/487477148 wait complete. 2022-02-02T13:42:30.237 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:42:31.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:30 smithi037 ceph-mon[69017]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:42:31.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:30 smithi037 ceph-mon[69017]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:42:31.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1321743295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:42:31.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/487477148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:42:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:30 smithi033 ceph-mon[101165]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:42:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:30 smithi033 ceph-mon[101165]: from='client.34204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:42:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1321743295' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:42:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/487477148' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:42:32.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:31 smithi037 ceph-mon[69017]: pgmap v59: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:31 smithi033 ceph-mon[101165]: pgmap v59: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:34.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:33 smithi037 ceph-mon[69017]: pgmap v60: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:33 smithi033 ceph-mon[101165]: pgmap v60: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:36.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:35 smithi037 ceph-mon[69017]: pgmap v61: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:35 smithi033 ceph-mon[101165]: pgmap v61: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:38.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:37 smithi037 ceph-mon[69017]: pgmap v62: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:37 smithi033 ceph-mon[101165]: pgmap v62: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:40.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:39 smithi037 ceph-mon[69017]: pgmap v63: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:39 smithi033 ceph-mon[101165]: pgmap v63: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:41.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:41 smithi033 ceph-mon[101165]: pgmap v64: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:42.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:41 smithi037 ceph-mon[69017]: pgmap v64: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:44.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:43 smithi037 ceph-mon[69017]: pgmap v65: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:44.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:43 smithi033 ceph-mon[101165]: pgmap v65: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:46.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:45 smithi037 ceph-mon[69017]: pgmap v66: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:45 smithi033 ceph-mon[101165]: pgmap v66: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:48.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:47 smithi037 ceph-mon[69017]: pgmap v67: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:47 smithi033 ceph-mon[101165]: pgmap v67: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:50.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:49 smithi037 ceph-mon[69017]: pgmap v68: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:49 smithi033 ceph-mon[101165]: pgmap v68: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:51 smithi033 ceph-mon[101165]: pgmap v69: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:51 smithi037 ceph-mon[69017]: pgmap v69: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:54.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:53 smithi037 ceph-mon[69017]: pgmap v70: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:54.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:53 smithi033 ceph-mon[101165]: pgmap v70: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:42:55.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:42:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:42:55.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:42:56.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:55 smithi037 ceph-mon[69017]: pgmap v71: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:56.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:55 smithi033 ceph-mon[101165]: pgmap v71: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:58.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:57 smithi037 ceph-mon[69017]: pgmap v72: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:58.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:57 smithi037 ceph-mon[69017]: mgrmap e36: smithi033.xvkvzp(active, since 2m), standbys: smithi037.npteou 2022-02-02T13:42:58.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:57 smithi033 ceph-mon[101165]: pgmap v72: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:42:58.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:57 smithi033 ceph-mon[101165]: mgrmap e36: smithi033.xvkvzp(active, since 2m), standbys: smithi037.npteou 2022-02-02T13:43:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:42:59 smithi033 ceph-mon[101165]: pgmap v73: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:00.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:42:59 smithi037 ceph-mon[69017]: pgmap v73: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:00.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 -- 172.21.15.33:0/2793018359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 msgr2=0x7f03ec0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/2793018359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec0f7de0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f03dc004660 tx=0x7f03dc009b30).stop 2022-02-02T13:43:00.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 -- 172.21.15.33:0/2793018359 shutdown_connections 2022-02-02T13:43:00.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/2793018359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec0f7de0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/2793018359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 0x7f03ec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 -- 172.21.15.33:0/2793018359 >> 172.21.15.33:0/2793018359 conn(0x7f03ec0f1e40 msgr2=0x7f03ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:00.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 -- 172.21.15.33:0/2793018359 shutdown_connections 2022-02-02T13:43:00.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.336+0000 7f03f0f6f700 1 -- 172.21.15.33:0/2793018359 wait complete. 2022-02-02T13:43:00.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 Processor -- start 2022-02-02T13:43:00.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 -- start start 2022-02-02T13:43:00.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 0x7f03ec106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec1079b0 con 0x7f03ec0f7980 2022-02-02T13:43:00.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03f0f6f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec107af0 con 0x7f03ec0f66e0 2022-02-02T13:43:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03e9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03e9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57782/0 (socket says 172.21.15.33:57782) 2022-02-02T13:43:00.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.337+0000 7f03e9d9b700 1 -- 172.21.15.33:0/4229032808 learned_addr learned my addr 172.21.15.33:0/4229032808 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:00.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03ea59c700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 0x7f03ec106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03e9d9b700 1 -- 172.21.15.33:0/4229032808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 msgr2=0x7f03ec106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03e9d9b700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 0x7f03ec106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03e9d9b700 1 -- 172.21.15.33:0/4229032808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc005040 con 0x7f03ec0f7980 2022-02-02T13:43:00.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03e9d9b700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f03dc009830 tx=0x7f03dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc018070 con 0x7f03ec0f7980 2022-02-02T13:43:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec108430 con 0x7f03ec0f7980 2022-02-02T13:43:00.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03dc007ba0 con 0x7f03ec0f7980 2022-02-02T13:43:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03dc01c3c0 con 0x7f03ec0f7980 2022-02-02T13:43:00.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.338+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec108990 con 0x7f03ec0f7980 2022-02-02T13:43:00.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.339+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec045ad0 con 0x7f03ec0f7980 2022-02-02T13:43:00.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.340+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03dc007d10 con 0x7f03ec0f7980 2022-02-02T13:43:00.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.340+0000 7f03daffd700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 0x7f03d4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.341+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f03dc0839d0 con 0x7f03ec0f7980 2022-02-02T13:43:00.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.341+0000 7f03ea59c700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 0x7f03d4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.341+0000 7f03ea59c700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 0x7f03d4067270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f03ec0f77e0 tx=0x7f03e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.344+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03dc0555f0 con 0x7f03ec0f7980 2022-02-02T13:43:00.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.533+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec108c00 con 0x7f03d4064db0 2022-02-02T13:43:00.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.534+0000 7f03daffd700 1 -- 172.21.15.33:0/4229032808 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7f03ec108c00 con 0x7f03d4064db0 2022-02-02T13:43:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 msgr2=0x7f03d4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 0x7f03d4067270 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f03ec0f77e0 tx=0x7f03e000b040).stop 2022-02-02T13:43:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 msgr2=0x7f03ec107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f03dc009830 tx=0x7f03dc009b30).stop 2022-02-02T13:43:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 shutdown_connections 2022-02-02T13:43:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03d4064db0 0x7f03d4067270 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0f66e0 0x7f03ec106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 --2- 172.21.15.33:0/4229032808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03ec0f7980 0x7f03ec107400 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 >> 172.21.15.33:0/4229032808 conn(0x7f03ec0f1e40 msgr2=0x7f03ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 shutdown_connections 2022-02-02T13:43:00.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.536+0000 7f03f0f6f700 1 -- 172.21.15.33:0/4229032808 wait complete. 2022-02-02T13:43:00.547 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:43:00.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 -- 172.21.15.33:0/1418531837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 msgr2=0x7fb4900f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 --2- 172.21.15.33:0/1418531837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb4900f6b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fb48c004660 tx=0x7fb48c009b30).stop 2022-02-02T13:43:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 -- 172.21.15.33:0/1418531837 shutdown_connections 2022-02-02T13:43:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 --2- 172.21.15.33:0/1418531837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb4900f6b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 --2- 172.21.15.33:0/1418531837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 0x7fb4900f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 -- 172.21.15.33:0/1418531837 >> 172.21.15.33:0/1418531837 conn(0x7fb4900f0b90 msgr2=0x7fb4900f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 -- 172.21.15.33:0/1418531837 shutdown_connections 2022-02-02T13:43:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.638+0000 7fb4973c5700 1 -- 172.21.15.33:0/1418531837 wait complete. 2022-02-02T13:43:00.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 Processor -- start 2022-02-02T13:43:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 -- start start 2022-02-02T13:43:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 0x7fb490109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4900603c0 con 0x7fb4900f66d0 2022-02-02T13:43:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4973c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb490060500 con 0x7fb4900f5430 2022-02-02T13:43:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57792/0 (socket says 172.21.15.33:57792) 2022-02-02T13:43:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 -- 172.21.15.33:0/2639443628 learned_addr learned my addr 172.21.15.33:0/2639443628 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:00.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb4963c3700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 0x7fb490109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 -- 172.21.15.33:0/2639443628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 msgr2=0x7fb490109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 0x7fb490109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.639+0000 7fb495bc2700 1 -- 172.21.15.33:0/2639443628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c005040 con 0x7fb4900f66d0 2022-02-02T13:43:00.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb495bc2700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb48c009990 tx=0x7fb48c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c01c070 con 0x7fb4900f66d0 2022-02-02T13:43:00.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb490105820 con 0x7fb4900f66d0 2022-02-02T13:43:00.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb490105d80 con 0x7fb4900f66d0 2022-02-02T13:43:00.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb48c009630 con 0x7fb4900f66d0 2022-02-02T13:43:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.640+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48c021660 con 0x7fb4900f66d0 2022-02-02T13:43:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.641+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb478004fa0 con 0x7fb4900f66d0 2022-02-02T13:43:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.642+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb48c0125d0 con 0x7fb4900f66d0 2022-02-02T13:43:00.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.642+0000 7fb486ffd700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 0x7fb47c067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.642+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb48c087af0 con 0x7fb4900f66d0 2022-02-02T13:43:00.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.642+0000 7fb4963c3700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 0x7fb47c067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.643+0000 7fb4963c3700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 0x7fb47c067280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb490060040 tx=0x7fb48000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.646+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb48c055ba0 con 0x7fb4900f66d0 2022-02-02T13:43:00.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.828+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb478000bc0 con 0x7fb47c064dc0 2022-02-02T13:43:00.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.842+0000 7fb486ffd700 1 -- 172.21.15.33:0/2639443628 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fb478000bc0 con 0x7fb47c064dc0 2022-02-02T13:43:00.843 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:43:00.843 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (8m) 69s ago 9m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:43:00.844 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (80s) 69s ago 9m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:43:00.844 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (76s) 72s ago 8m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:43:00.844 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (8m) 69s ago 9m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:43:00.844 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (108s) 69s ago 5m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:43:00.845 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (2m) 69s ago 5m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:43:00.845 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (3m) 72s ago 5m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:43:00.845 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (5m) 72s ago 5m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:43:00.846 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (2m) 69s ago 10m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:43:00.846 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (2m) 72s ago 8m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:43:00.846 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 69s ago 10m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:43:00.846 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (113s) 72s ago 8m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:43:00.846 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (9m) 69s ago 9m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:43:00.847 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (8m) 72s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:43:00.847 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (8m) 69s ago 8m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:43:00.847 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 69s ago 7m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:43:00.847 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 69s ago 7m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:43:00.848 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (7m) 72s ago 7m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:43:00.848 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (6m) 72s ago 6m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:43:00.848 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (6m) 72s ago 6m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:43:00.848 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (8m) 69s ago 8m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:43:00.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 msgr2=0x7fb47c067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 0x7fb47c067280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb490060040 tx=0x7fb48000b040).stop 2022-02-02T13:43:00.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 msgr2=0x7fb49010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fb48c009990 tx=0x7fb48c009b30).stop 2022-02-02T13:43:00.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 shutdown_connections 2022-02-02T13:43:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb47c064dc0 0x7fb47c067280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f5430 0x7fb490109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 --2- 172.21.15.33:0/2639443628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f66d0 0x7fb49010bf40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.844+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 >> 172.21.15.33:0/2639443628 conn(0x7fb4900f0b90 msgr2=0x7fb4900fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:00.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.845+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 shutdown_connections 2022-02-02T13:43:00.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.845+0000 7fb4973c5700 1 -- 172.21.15.33:0/2639443628 wait complete. 2022-02-02T13:43:00.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 -- 172.21.15.33:0/1638912674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 msgr2=0x7effe00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 --2- 172.21.15.33:0/1638912674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe00f6b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7effd0004660 tx=0x7effd0009b30).stop 2022-02-02T13:43:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 -- 172.21.15.33:0/1638912674 shutdown_connections 2022-02-02T13:43:00.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 --2- 172.21.15.33:0/1638912674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe00f6b30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 --2- 172.21.15.33:0/1638912674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 0x7effe00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.945+0000 7effe68f2700 1 -- 172.21.15.33:0/1638912674 >> 172.21.15.33:0/1638912674 conn(0x7effe00f0b90 msgr2=0x7effe00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 -- 172.21.15.33:0/1638912674 shutdown_connections 2022-02-02T13:43:00.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 -- 172.21.15.33:0/1638912674 wait complete. 2022-02-02T13:43:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 Processor -- start 2022-02-02T13:43:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 -- start start 2022-02-02T13:43:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 0x7effe01099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0060420 con 0x7effe00f66d0 2022-02-02T13:43:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.946+0000 7effe68f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe0060560 con 0x7effe00f5430 2022-02-02T13:43:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57802/0 (socket says 172.21.15.33:57802) 2022-02-02T13:43:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 -- 172.21.15.33:0/1761962005 learned_addr learned my addr 172.21.15.33:0/1761962005 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe58f0700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 0x7effe01099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 -- 172.21.15.33:0/1761962005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 msgr2=0x7effe01099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:00.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 0x7effe01099e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 -- 172.21.15.33:0/1761962005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0005040 con 0x7effe00f66d0 2022-02-02T13:43:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe50ef700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7effd0009990 tx=0x7effd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd0018070 con 0x7effe00f66d0 2022-02-02T13:43:00.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe010c490 con 0x7effe00f66d0 2022-02-02T13:43:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7effd0007ba0 con 0x7effe00f66d0 2022-02-02T13:43:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.947+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe010c9c0 con 0x7effe00f66d0 2022-02-02T13:43:00.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.948+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7effd001c3c0 con 0x7effe00f66d0 2022-02-02T13:43:00.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.949+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7effd001d420 con 0x7effe00f66d0 2022-02-02T13:43:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.949+0000 7effd67fc700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 0x7effcc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.949+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7effd0083590 con 0x7effe00f66d0 2022-02-02T13:43:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.949+0000 7effe58f0700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 0x7effcc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:00.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.950+0000 7effe58f0700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 0x7effcc0672e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7effe00600a0 tx=0x7effdc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.950+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc8004fa0 con 0x7effe00f66d0 2022-02-02T13:43:00.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:00.955+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7effd0051640 con 0x7effe00f66d0 2022-02-02T13:43:01.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.204+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7effc8005e80 con 0x7effe00f66d0 2022-02-02T13:43:01.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.205+0000 7effd67fc700 1 -- 172.21.15.33:0/1761962005 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7effd0054c60 con 0x7effe00f66d0 2022-02-02T13:43:01.206 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:43:01.206 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:43:01.206 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:43:01.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:01.207 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:43:01.207 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:43:01.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:01.208 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:43:01.208 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:43:01.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:01.209 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:43:01.209 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:43:01.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:01.210 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:43:01.210 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:43:01.210 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:43:01.211 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:43:01.211 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:43:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 msgr2=0x7effcc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 0x7effcc0672e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7effe00600a0 tx=0x7effdc00b040).stop 2022-02-02T13:43:01.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 msgr2=0x7effe010bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7effd0009990 tx=0x7effd0009b30).stop 2022-02-02T13:43:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 shutdown_connections 2022-02-02T13:43:01.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7effcc064e20 0x7effcc0672e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effe00f5430 0x7effe01099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 --2- 172.21.15.33:0/1761962005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effe00f66d0 0x7effe010bee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.206+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 >> 172.21.15.33:0/1761962005 conn(0x7effe00f0b90 msgr2=0x7effe00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:01.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.207+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 shutdown_connections 2022-02-02T13:43:01.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.207+0000 7effe68f2700 1 -- 172.21.15.33:0/1761962005 wait complete. 2022-02-02T13:43:01.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.308+0000 7f2ea0499700 1 -- 172.21.15.33:0/3042757303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 msgr2=0x7f2e980f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.308+0000 7f2ea0499700 1 --2- 172.21.15.33:0/3042757303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e980f6b00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f2e94004660 tx=0x7f2e94009b30).stop 2022-02-02T13:43:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- 172.21.15.33:0/3042757303 shutdown_connections 2022-02-02T13:43:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 --2- 172.21.15.33:0/3042757303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 0x7f2e980f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 --2- 172.21.15.33:0/3042757303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e980f6b00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- 172.21.15.33:0/3042757303 >> 172.21.15.33:0/3042757303 conn(0x7f2e980f1e40 msgr2=0x7f2e980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- 172.21.15.33:0/3042757303 shutdown_connections 2022-02-02T13:43:01.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- 172.21.15.33:0/3042757303 wait complete. 2022-02-02T13:43:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 Processor -- start 2022-02-02T13:43:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- start start 2022-02-02T13:43:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 0x7f2e98069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9806a380 con 0x7f2e980f66e0 2022-02-02T13:43:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.309+0000 7f2ea0499700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9806a4c0 con 0x7f2e980f7980 2022-02-02T13:43:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:01.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57810/0 (socket says 172.21.15.33:57810) 2022-02-02T13:43:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 -- 172.21.15.33:0/1537879261 learned_addr learned my addr 172.21.15.33:0/1537879261 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9da34700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 0x7f2e98069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 -- 172.21.15.33:0/1537879261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 msgr2=0x7f2e98069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 0x7f2e98069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 -- 172.21.15.33:0/1537879261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e94005040 con 0x7f2e980f66e0 2022-02-02T13:43:01.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e9e235700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2e94000c00 tx=0x7f2e9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:01.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e94019070 con 0x7f2e980f66e0 2022-02-02T13:43:01.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9806a740 con 0x7f2e980f66e0 2022-02-02T13:43:01.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e94013380 con 0x7f2e980f66e0 2022-02-02T13:43:01.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.310+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e94014cd0 con 0x7f2e980f66e0 2022-02-02T13:43:01.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.311+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9806aca0 con 0x7f2e980f66e0 2022-02-02T13:43:01.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.311+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e98045ad0 con 0x7f2e980f66e0 2022-02-02T13:43:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.312+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e94025070 con 0x7f2e980f66e0 2022-02-02T13:43:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.313+0000 7f2e8effd700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 0x7f2e84067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.313+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2e94082e10 con 0x7f2e980f66e0 2022-02-02T13:43:01.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.313+0000 7f2e9da34700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 0x7f2e84067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.313+0000 7f2e9da34700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 0x7f2e84067270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2e88009fd0 tx=0x7f2e8800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:01.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.316+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e94050ec0 con 0x7f2e980f66e0 2022-02-02T13:43:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.528+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2e980586e0 con 0x7f2e980f66e0 2022-02-02T13:43:01.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.529+0000 7f2e8effd700 1 -- 172.21.15.33:0/1537879261 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2e94023070 con 0x7f2e980f66e0 2022-02-02T13:43:01.530 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:43:01.530 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:43:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:43:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:43:01.531 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:43:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:43:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:43:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:43:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:43:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:43:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:43:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:43:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:43:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:43:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:43:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:43:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:43:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:43:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:43:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:43:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:43:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:43:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:43:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:43:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:43:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:43:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:43:01.537 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:43:01.537 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:43:01.537 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:43:01.537 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:01.537 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:01.538 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:43:01.538 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:01.538 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:01.538 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:01.539 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:01.539 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 msgr2=0x7f2e84067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 0x7f2e84067270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f2e88009fd0 tx=0x7f2e8800b040).stop 2022-02-02T13:43:01.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 msgr2=0x7f2e9806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f2e94000c00 tx=0x7f2e9400b040).stop 2022-02-02T13:43:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 shutdown_connections 2022-02-02T13:43:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e84064db0 0x7f2e84067270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e980f66e0 0x7f2e9806b9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 --2- 172.21.15.33:0/1537879261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e980f7980 0x7f2e98069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 >> 172.21.15.33:0/1537879261 conn(0x7f2e980f1e40 msgr2=0x7f2e980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 shutdown_connections 2022-02-02T13:43:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:01.531+0000 7f2ea0499700 1 -- 172.21.15.33:0/1537879261 wait complete. 2022-02-02T13:43:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:43:01.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:01 smithi033 ceph-mon[101165]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:01 smithi033 ceph-mon[101165]: pgmap v74: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:01 smithi033 ceph-mon[101165]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:01 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1761962005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:43:01.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:01 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1537879261' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:43:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:01 smithi037 ceph-mon[69017]: from='client.34216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:01 smithi037 ceph-mon[69017]: pgmap v74: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:01 smithi037 ceph-mon[69017]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:01 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1761962005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:43:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:01 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1537879261' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:43:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:02 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 33 pgs undersized (PG_DEGRADED) 2022-02-02T13:43:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:02 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 33 pgs undersized (PG_DEGRADED) 2022-02-02T13:43:03.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:03 smithi033 ceph-mon[101165]: pgmap v75: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:03 smithi037 ceph-mon[69017]: pgmap v75: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:05 smithi037 ceph-mon[69017]: pgmap v76: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:05 smithi033 ceph-mon[101165]: pgmap v76: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:08.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:07 smithi037 ceph-mon[69017]: pgmap v77: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:08.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:07 smithi033 ceph-mon[101165]: pgmap v77: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:09 smithi037 ceph-mon[69017]: pgmap v78: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:09 smithi033 ceph-mon[101165]: pgmap v78: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:11.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:10 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized (PG_DEGRADED) 2022-02-02T13:43:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:10 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized (PG_DEGRADED) 2022-02-02T13:43:12.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:11 smithi037 ceph-mon[69017]: pgmap v79: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:11 smithi033 ceph-mon[101165]: pgmap v79: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:13 smithi037 ceph-mon[69017]: pgmap v80: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:14.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:13 smithi033 ceph-mon[101165]: pgmap v80: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:16.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:15 smithi037 ceph-mon[69017]: pgmap v81: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:15 smithi033 ceph-mon[101165]: pgmap v81: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:17 smithi033 ceph-mon[101165]: pgmap v82: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:17 smithi037 ceph-mon[69017]: pgmap v82: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:19 smithi033 ceph-mon[101165]: pgmap v83: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:19 smithi037 ceph-mon[69017]: pgmap v83: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:21.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:21 smithi033 ceph-mon[101165]: pgmap v84: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:22.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:21 smithi037 ceph-mon[69017]: pgmap v84: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:24.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:23 smithi037 ceph-mon[69017]: pgmap v85: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:24.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:23 smithi033 ceph-mon[101165]: pgmap v85: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:26.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:25 smithi037 ceph-mon[69017]: pgmap v86: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:25 smithi033 ceph-mon[101165]: pgmap v86: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:28.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:27 smithi037 ceph-mon[69017]: pgmap v87: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:27 smithi033 ceph-mon[101165]: pgmap v87: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:29 smithi033 ceph-mon[101165]: pgmap v88: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:29 smithi037 ceph-mon[69017]: pgmap v88: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:31.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 -- 172.21.15.33:0/1376020422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f6530 msgr2=0x7fd3dc0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 --2- 172.21.15.33:0/1376020422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc0f6950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fd3d8004660 tx=0x7fd3d8009b30).stop 2022-02-02T13:43:31.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 -- 172.21.15.33:0/1376020422 shutdown_connections 2022-02-02T13:43:31.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 --2- 172.21.15.33:0/1376020422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 --2- 172.21.15.33:0/1376020422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc0f6950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 -- 172.21.15.33:0/1376020422 >> 172.21.15.33:0/1376020422 conn(0x7fd3dc0f1c90 msgr2=0x7fd3dc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:31.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 -- 172.21.15.33:0/1376020422 shutdown_connections 2022-02-02T13:43:31.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.649+0000 7fd3e340b700 1 -- 172.21.15.33:0/1376020422 wait complete. 2022-02-02T13:43:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 Processor -- start 2022-02-02T13:43:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 -- start start 2022-02-02T13:43:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc06a380 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e340b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc06a4c0 con 0x7fd3dc0f6530 2022-02-02T13:43:31.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e1c08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e1c08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57822/0 (socket says 172.21.15.33:57822) 2022-02-02T13:43:31.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e1c08700 1 -- 172.21.15.33:0/96003766 learned_addr learned my addr 172.21.15.33:0/96003766 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e2409700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.650+0000 7fd3e1c08700 1 -- 172.21.15.33:0/96003766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f6530 msgr2=0x7fd3dc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3e1c08700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3e1c08700 1 -- 172.21.15.33:0/96003766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d8005040 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3e1c08700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd3cc00e7f0 tx=0x7fd3cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc0092e0 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3cc00f040 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc06a7a0 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3cc014750 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.651+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc10ed50 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.652+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc045ad0 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.652+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3cc01b030 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.653+0000 7fd3d2ffd700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 0x7fd3c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.653+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3cc0817d0 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.653+0000 7fd3e2409700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 0x7fd3c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.653+0000 7fd3e2409700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 0x7fd3c80672e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd3d8000c00 tx=0x7fd3d8016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.657+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3cc04f930 con 0x7fd3dc0f77d0 2022-02-02T13:43:31.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.846+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3dc057f10 con 0x7fd3c8064e20 2022-02-02T13:43:31.851 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:31 smithi033 ceph-mon[101165]: pgmap v89: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:31.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.848+0000 7fd3d2ffd700 1 -- 172.21.15.33:0/96003766 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+320 (secure 0 0 0) 0x7fd3dc057f10 con 0x7fd3c8064e20 2022-02-02T13:43:31.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 msgr2=0x7fd3c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 0x7fd3c80672e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fd3d8000c00 tx=0x7fd3d8016040).stop 2022-02-02T13:43:31.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 msgr2=0x7fd3dc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fd3cc00e7f0 tx=0x7fd3cc00b040).stop 2022-02-02T13:43:31.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 shutdown_connections 2022-02-02T13:43:31.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3c8064e20 0x7fd3c80672e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3dc0f6530 0x7fd3dc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 --2- 172.21.15.33:0/96003766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3dc0f77d0 0x7fd3dc069e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 >> 172.21.15.33:0/96003766 conn(0x7fd3dc0f1c90 msgr2=0x7fd3dc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:31.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 shutdown_connections 2022-02-02T13:43:31.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.850+0000 7fd3e340b700 1 -- 172.21.15.33:0/96003766 wait complete. 2022-02-02T13:43:31.866 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:43:31.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 -- 172.21.15.33:0/3816410704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f6860 msgr2=0x7fc2ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/3816410704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f6cc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc2e8004660 tx=0x7fc2e8009b30).stop 2022-02-02T13:43:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 -- 172.21.15.33:0/3816410704 shutdown_connections 2022-02-02T13:43:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/3816410704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f6cc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/3816410704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 -- 172.21.15.33:0/3816410704 >> 172.21.15.33:0/3816410704 conn(0x7fc2ec0f0d40 msgr2=0x7fc2ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:31.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 -- 172.21.15.33:0/3816410704 shutdown_connections 2022-02-02T13:43:31.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.952+0000 7fc2f3e47700 1 -- 172.21.15.33:0/3816410704 wait complete. 2022-02-02T13:43:31.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 Processor -- start 2022-02-02T13:43:31.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 -- start start 2022-02-02T13:43:31.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0f8920 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f3e47700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec0f8a60 con 0x7fc2ec0f6860 2022-02-02T13:43:31.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57830/0 (socket says 172.21.15.33:57830) 2022-02-02T13:43:31.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 -- 172.21.15.33:0/1196641720 learned_addr learned my addr 172.21.15.33:0/1196641720 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:31.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f13e2700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 -- 172.21.15.33:0/1196641720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f6860 msgr2=0x7fc2ec0f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:31.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 -- 172.21.15.33:0/1196641720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8005040 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.953+0000 7fc2f1be3700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc2e000c790 tx=0x7fc2e0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.954+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e000e680 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.954+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec0f8d40 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.954+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2e000ec90 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.954+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2e0012d00 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.954+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec10efa0 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.955+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ec045ad0 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.955+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2e0010070 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.955+0000 7fc2de7fc700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:31.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.956+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc2e0081b80 con 0x7fc2ec0f55c0 2022-02-02T13:43:31.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.956+0000 7fc2f13e2700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:31.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.956+0000 7fc2f13e2700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 0x7fc2d8067290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc2e8009da0 tx=0x7fc2e8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:31.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:31.960+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2e004fc30 con 0x7fc2ec0f55c0 2022-02-02T13:43:32.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:31 smithi037 ceph-mon[69017]: pgmap v89: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:32.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.144+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2ec05fd30 con 0x7fc2d8064dd0 2022-02-02T13:43:32.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.159+0000 7fc2de7fc700 1 -- 172.21.15.33:0/1196641720 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fc2ec05fd30 con 0x7fc2d8064dd0 2022-02-02T13:43:32.160 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:43:32.160 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (8m) 101s ago 9m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:43:32.160 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (111s) 101s ago 9m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:43:32.161 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (107s) 103s ago 9m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:43:32.161 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (8m) 101s ago 9m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:43:32.161 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (2m) 101s ago 6m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:43:32.161 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (2m) 101s ago 5m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:43:32.161 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (3m) 103s ago 6m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:43:32.162 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (5m) 103s ago 5m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:43:32.162 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (3m) 101s ago 11m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:43:32.162 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (2m) 103s ago 9m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:43:32.162 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (2m) 101s ago 11m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:43:32.163 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (2m) 103s ago 9m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:43:32.163 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (9m) 101s ago 9m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:43:32.163 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (9m) 103s ago 9m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:43:32.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (8m) 101s ago 8m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:43:32.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 101s ago 8m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:43:32.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 101s ago 7m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:43:32.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (7m) 103s ago 7m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:43:32.165 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (7m) 103s ago 7m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:43:32.165 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (7m) 103s ago 7m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:43:32.165 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (8m) 101s ago 9m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:43:32.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 msgr2=0x7fc2d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 0x7fc2d8067290 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc2e8009da0 tx=0x7fc2e8009b30).stop 2022-02-02T13:43:32.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 msgr2=0x7fc2ec0f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fc2e000c790 tx=0x7fc2e0007d90).stop 2022-02-02T13:43:32.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 shutdown_connections 2022-02-02T13:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2d8064dd0 0x7fc2d8067290 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2ec0f55c0 0x7fc2ec0f9f40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 --2- 172.21.15.33:0/1196641720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2ec0f6860 0x7fc2ec0f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 >> 172.21.15.33:0/1196641720 conn(0x7fc2ec0f0d40 msgr2=0x7fc2ec05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 shutdown_connections 2022-02-02T13:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.161+0000 7fc2f3e47700 1 -- 172.21.15.33:0/1196641720 wait complete. 2022-02-02T13:43:32.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.261+0000 7f13f7363700 1 -- 172.21.15.33:0/1234547871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f66d0 msgr2=0x7f13f00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.261+0000 7f13f7363700 1 --2- 172.21.15.33:0/1234547871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f66d0 0x7f13f00f6b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f13e0004660 tx=0x7f13e0009b30).stop 2022-02-02T13:43:32.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.261+0000 7f13f7363700 1 -- 172.21.15.33:0/1234547871 shutdown_connections 2022-02-02T13:43:32.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.261+0000 7f13f7363700 1 --2- 172.21.15.33:0/1234547871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f66d0 0x7f13f00f6b30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.261+0000 7f13f7363700 1 --2- 172.21.15.33:0/1234547871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f5430 0x7f13f00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- 172.21.15.33:0/1234547871 >> 172.21.15.33:0/1234547871 conn(0x7f13f00f0b90 msgr2=0x7f13f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:32.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- 172.21.15.33:0/1234547871 shutdown_connections 2022-02-02T13:43:32.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- 172.21.15.33:0/1234547871 wait complete. 2022-02-02T13:43:32.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 Processor -- start 2022-02-02T13:43:32.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- start start 2022-02-02T13:43:32.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 0x7f13f00f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f00f8790 con 0x7f13f00f5430 2022-02-02T13:43:32.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.262+0000 7f13f7363700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f00f88d0 con 0x7f13f00f66d0 2022-02-02T13:43:32.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57838/0 (socket says 172.21.15.33:57838) 2022-02-02T13:43:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 -- 172.21.15.33:0/2167408291 learned_addr learned my addr 172.21.15.33:0/2167408291 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f5b60700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 0x7f13f00f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 -- 172.21.15.33:0/2167408291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 msgr2=0x7f13f00f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 0x7f13f00f8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 -- 172.21.15.33:0/2167408291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0005040 con 0x7f13f00f5430 2022-02-02T13:43:32.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f5b60700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 0x7f13f00f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:43:32.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f6361700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f13ec002700 tx=0x7f13ec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:32.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ec009320 con 0x7f13f00f5430 2022-02-02T13:43:32.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f00f8bb0 con 0x7f13f00f5430 2022-02-02T13:43:32.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13ec00f040 con 0x7f13f00f5430 2022-02-02T13:43:32.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13ec014900 con 0x7f13f00f5430 2022-02-02T13:43:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.263+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f010ed80 con 0x7f13f00f5430 2022-02-02T13:43:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.264+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f0045ad0 con 0x7f13f00f5430 2022-02-02T13:43:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.265+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f13ec009480 con 0x7f13f00f5430 2022-02-02T13:43:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.265+0000 7f13e6ffd700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 0x7f13dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.265+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f13ec081d10 con 0x7f13f00f5430 2022-02-02T13:43:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.265+0000 7f13f5b60700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 0x7f13dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.266+0000 7f13f5b60700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 0x7f13dc0672e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13e0004630 tx=0x7f13e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.269+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13ec04fe80 con 0x7f13f00f5430 2022-02-02T13:43:32.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.512+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13f010f4d0 con 0x7f13f00f5430 2022-02-02T13:43:32.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.513+0000 7f13e6ffd700 1 -- 172.21.15.33:0/2167408291 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f13ec0534a0 con 0x7f13f00f5430 2022-02-02T13:43:32.513 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:43:32.514 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:43:32.514 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:43:32.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:32.514 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:43:32.515 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:43:32.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:32.515 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:43:32.515 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:43:32.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:32.516 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:43:32.516 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:43:32.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:43:32.516 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:43:32.517 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:43:32.517 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:43:32.517 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:43:32.517 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:43:32.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 msgr2=0x7f13dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 0x7f13dc0672e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f13e0004630 tx=0x7f13e0009b30).stop 2022-02-02T13:43:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 msgr2=0x7f13f00f9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f13ec002700 tx=0x7f13ec009d80).stop 2022-02-02T13:43:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 shutdown_connections 2022-02-02T13:43:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13dc064e20 0x7f13dc0672e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13f00f5430 0x7f13f00f9db0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 --2- 172.21.15.33:0/2167408291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13f00f66d0 0x7f13f00f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.514+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 >> 172.21.15.33:0/2167408291 conn(0x7f13f00f0b90 msgr2=0x7f13f005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:32.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.515+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 shutdown_connections 2022-02-02T13:43:32.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.515+0000 7f13f7363700 1 -- 172.21.15.33:0/2167408291 wait complete. 2022-02-02T13:43:32.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.616+0000 7fa2f492e700 1 -- 172.21.15.33:0/2117231876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f5430 msgr2=0x7fa2f00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.616+0000 7fa2f492e700 1 --2- 172.21.15.33:0/2117231876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f5430 0x7fa2f00f5850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa2e0004660 tx=0x7fa2e0009b30).stop 2022-02-02T13:43:32.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.616+0000 7fa2f492e700 1 -- 172.21.15.33:0/2117231876 shutdown_connections 2022-02-02T13:43:32.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.616+0000 7fa2f492e700 1 --2- 172.21.15.33:0/2117231876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f66d0 0x7fa2f00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 --2- 172.21.15.33:0/2117231876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f5430 0x7fa2f00f5850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 -- 172.21.15.33:0/2117231876 >> 172.21.15.33:0/2117231876 conn(0x7fa2f00f0b90 msgr2=0x7fa2f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 -- 172.21.15.33:0/2117231876 shutdown_connections 2022-02-02T13:43:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 -- 172.21.15.33:0/2117231876 wait complete. 2022-02-02T13:43:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 Processor -- start 2022-02-02T13:43:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.617+0000 7fa2f492e700 1 -- start start 2022-02-02T13:43:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2f492e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 0x7fa2f0108f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2f492e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 0x7fa2f0109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2f492e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01099d0 con 0x7fa2f00f66d0 2022-02-02T13:43:32.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2f492e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0109b10 con 0x7fa2f00f5430 2022-02-02T13:43:32.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 0x7fa2f0109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 0x7fa2f0109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57850/0 (socket says 172.21.15.33:57850) 2022-02-02T13:43:32.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2eeffd700 1 -- 172.21.15.33:0/629089668 learned_addr learned my addr 172.21.15.33:0/629089668 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:43:32.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2ef7fe700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 0x7fa2f0108f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2ef7fe700 1 -- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 msgr2=0x7fa2f0109420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2ef7fe700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 0x7fa2f0109420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2ef7fe700 1 -- 172.21.15.33:0/629089668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0005040 con 0x7fa2f00f5430 2022-02-02T13:43:32.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.618+0000 7fa2ef7fe700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 0x7fa2f0108f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa2e0000c00 tx=0x7fa2e0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:32.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.619+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e0018070 con 0x7fa2f00f5430 2022-02-02T13:43:32.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.619+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f010a450 con 0x7fa2f00f5430 2022-02-02T13:43:32.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.619+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2e0007ba0 con 0x7fa2f00f5430 2022-02-02T13:43:32.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.619+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e001de60 con 0x7fa2f00f5430 2022-02-02T13:43:32.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.619+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f010a980 con 0x7fa2f00f5430 2022-02-02T13:43:32.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.620+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f0059100 con 0x7fa2f00f5430 2022-02-02T13:43:32.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.620+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2e001d420 con 0x7fa2f00f5430 2022-02-02T13:43:32.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.620+0000 7fa2e7fff700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 0x7fa2dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:43:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.621+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa2e0083520 con 0x7fa2f00f5430 2022-02-02T13:43:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.621+0000 7fa2eeffd700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 0x7fa2dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:43:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.621+0000 7fa2eeffd700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 0x7fa2dc0672e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa2d80041d0 tx=0x7fa2d800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:43:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.625+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2e0054fa0 con 0x7fa2f00f5430 2022-02-02T13:43:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.838+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa2f010b180 con 0x7fa2f00f5430 2022-02-02T13:43:32.839 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:32 smithi033 ceph-mon[101165]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:32.840 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:32 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2167408291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:43:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.839+0000 7fa2e7fff700 1 -- 172.21.15.33:0/629089668 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa2f010b180 con 0x7fa2f00f5430 2022-02-02T13:43:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:43:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:43:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:43:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:43:32.842 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:43:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:43:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:43:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:43:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:43:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:43:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:43:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:43:32.844 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:43:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:43:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:43:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:43:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:43:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:43:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:43:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:43:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:43:32.847 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:43:32.847 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:43:32.847 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:43:32.847 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:43:32.848 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:43:32.848 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:43:32.848 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:43:32.848 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:43:32.848 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:43:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:32.849 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:43:32.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:43:32.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:32.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:32.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:32.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:43:32.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 msgr2=0x7fa2dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 0x7fa2dc0672e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fa2d80041d0 tx=0x7fa2d800b040).stop 2022-02-02T13:43:32.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 msgr2=0x7fa2f0108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:43:32.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 0x7fa2f0108f30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fa2e0000c00 tx=0x7fa2e0009b30).stop 2022-02-02T13:43:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 shutdown_connections 2022-02-02T13:43:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2dc064e20 0x7fa2dc0672e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f00f5430 0x7fa2f0108f30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 --2- 172.21.15.33:0/629089668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f00f66d0 0x7fa2f0109420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:43:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 >> 172.21.15.33:0/629089668 conn(0x7fa2f00f0b90 msgr2=0x7fa2f005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:43:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 shutdown_connections 2022-02-02T13:43:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:43:32.841+0000 7fa2f492e700 1 -- 172.21.15.33:0/629089668 wait complete. 2022-02-02T13:43:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:43:33.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:32 smithi037 ceph-mon[69017]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:33.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:32 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2167408291' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:43:33.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:33 smithi033 ceph-mon[101165]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:33.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:33 smithi033 ceph-mon[101165]: pgmap v90: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:33.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/629089668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:43:34.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:33 smithi037 ceph-mon[69017]: from='client.34236 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:43:34.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:33 smithi037 ceph-mon[69017]: pgmap v90: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:34.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/629089668' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:43:36.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:35 smithi037 ceph-mon[69017]: pgmap v91: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:35 smithi033 ceph-mon[101165]: pgmap v91: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:37 smithi033 ceph-mon[101165]: pgmap v92: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:37 smithi037 ceph-mon[69017]: pgmap v92: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:40.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:39 smithi033 ceph-mon[101165]: pgmap v93: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:39 smithi037 ceph-mon[69017]: pgmap v93: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:41.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:41 smithi033 ceph-mon[101165]: pgmap v94: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:42.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:41 smithi037 ceph-mon[69017]: pgmap v94: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:44.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:43 smithi037 ceph-mon[69017]: pgmap v95: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:44.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:43 smithi033 ceph-mon[101165]: pgmap v95: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:46.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:45 smithi033 ceph-mon[101165]: pgmap v96: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:46.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:45 smithi037 ceph-mon[69017]: pgmap v96: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:47 smithi033 ceph-mon[101165]: pgmap v97: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:47 smithi037 ceph-mon[69017]: pgmap v97: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:50.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:49 smithi033 ceph-mon[101165]: pgmap v98: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:49 smithi037 ceph-mon[69017]: pgmap v98: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:51 smithi033 ceph-mon[101165]: pgmap v99: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:51 smithi037 ceph-mon[69017]: pgmap v99: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:54.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:53 smithi033 ceph-mon[101165]: pgmap v100: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:53 smithi037 ceph-mon[69017]: pgmap v100: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:43:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:43:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:43:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:43:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:55 smithi033 ceph-mon[101165]: pgmap v101: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:56.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:55 smithi037 ceph-mon[69017]: pgmap v101: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:58.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:57 smithi033 ceph-mon[101165]: pgmap v102: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:43:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:57 smithi037 ceph-mon[69017]: pgmap v102: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:00.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:43:59 smithi033 ceph-mon[101165]: pgmap v103: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:00.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:43:59 smithi037 ceph-mon[69017]: pgmap v103: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:00.813 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:00 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-02-02T13:44:01.241 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:00 smithi033 podman[110736]: 2022-02-02T13:44:01.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:01 smithi033 ceph-mon[101165]: pgmap v104: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:01.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:01 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:44:01.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:01 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:44:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:01 smithi037 ceph-mon[69017]: pgmap v104: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:02.950 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:44:02.951 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:02.951 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:44:02.951 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: pgmap v105: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:02.951 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:44:02.952 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:44:02.952 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:44:02.952 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:02.952 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:02.953 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:44:02.953 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:44:02.953 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:44:02.953 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:02.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- 172.21.15.33:0/2566656835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 msgr2=0x7fbb600f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:02.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 --2- 172.21.15.33:0/2566656835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb600f4820 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fbb54004660 tx=0x7fbb54009b30).stop 2022-02-02T13:44:02.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- 172.21.15.33:0/2566656835 shutdown_connections 2022-02-02T13:44:02.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 --2- 172.21.15.33:0/2566656835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb600f4820 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:02.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 --2- 172.21.15.33:0/2566656835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb600f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:02.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- 172.21.15.33:0/2566656835 >> 172.21.15.33:0/2566656835 conn(0x7fbb600f0540 msgr2=0x7fbb600f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:02.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- 172.21.15.33:0/2566656835 shutdown_connections 2022-02-02T13:44:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- 172.21.15.33:0/2566656835 wait complete. 2022-02-02T13:44:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 Processor -- start 2022-02-02T13:44:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.949+0000 7fbb65512700 1 -- start start 2022-02-02T13:44:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb65512700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb60106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:02.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb65512700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:02.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb65512700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb60107a30 con 0x7fbb600f8610 2022-02-02T13:44:02.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb65512700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb60107b70 con 0x7fbb600f7d00 2022-02-02T13:44:02.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57858/0 (socket says 172.21.15.33:57858) 2022-02-02T13:44:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 -- 172.21.15.33:0/2616077504 learned_addr learned my addr 172.21.15.33:0/2616077504 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5effd700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb60106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 -- 172.21.15.33:0/2616077504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 msgr2=0x7fbb60106f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb60106f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 -- 172.21.15.33:0/2616077504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54005040 con 0x7fbb600f8610 2022-02-02T13:44:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5effd700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb60106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:44:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.950+0000 7fbb5e7fc700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fbb54009990 tx=0x7fbb54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.951+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb54020820 con 0x7fbb600f8610 2022-02-02T13:44:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.951+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb601084b0 con 0x7fbb600f8610 2022-02-02T13:44:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.951+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb54020e30 con 0x7fbb600f8610 2022-02-02T13:44:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.951+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb5401fc10 con 0x7fbb600f8610 2022-02-02T13:44:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.951+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb60108a10 con 0x7fbb600f8610 2022-02-02T13:44:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.952+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb60045ad0 con 0x7fbb600f8610 2022-02-02T13:44:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.952+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb54030070 con 0x7fbb600f8610 2022-02-02T13:44:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.953+0000 7fbb477fe700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 0x7fbb48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:02.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.953+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbb5408c2a0 con 0x7fbb600f8610 2022-02-02T13:44:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.953+0000 7fbb5effd700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 0x7fbb48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.953+0000 7fbb5effd700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 0x7fbb48067290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbb500041d0 tx=0x7fbb50009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:02.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:02.957+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb5405dd20 con 0x7fbb600f8610 2022-02-02T13:44:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:44:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:44:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: pgmap v105: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:03.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:44:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:44:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:44:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:03.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:44:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:44:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:44:03.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:03.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.148+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb600ff080 con 0x7fbb48064dd0 2022-02-02T13:44:03.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.150+0000 7fbb477fe700 1 -- 172.21.15.33:0/2616077504 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fbb50004600 con 0x7fbb48064dd0 2022-02-02T13:44:03.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 msgr2=0x7fbb48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 0x7fbb48067290 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fbb500041d0 tx=0x7fbb50009040).stop 2022-02-02T13:44:03.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 msgr2=0x7fbb60107480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fbb54009990 tx=0x7fbb54009b30).stop 2022-02-02T13:44:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 shutdown_connections 2022-02-02T13:44:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb48064dd0 0x7fbb48067290 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb600f7d00 0x7fbb60106f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 --2- 172.21.15.33:0/2616077504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb600f8610 0x7fbb60107480 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.151+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 >> 172.21.15.33:0/2616077504 conn(0x7fbb600f0540 msgr2=0x7fbb600fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.152+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 shutdown_connections 2022-02-02T13:44:03.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.152+0000 7fbb65512700 1 -- 172.21.15.33:0/2616077504 wait complete. 2022-02-02T13:44:03.162 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:44:03.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2353746601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 msgr2=0x7fbae80f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2353746601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae80f6d00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fbadc004660 tx=0x7fbadc009b30).stop 2022-02-02T13:44:03.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2353746601 shutdown_connections 2022-02-02T13:44:03.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2353746601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 0x7fbae80f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2353746601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae80f6d00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2353746601 >> 172.21.15.33:0/2353746601 conn(0x7fbae80f2020 msgr2=0x7fbae80f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2353746601 shutdown_connections 2022-02-02T13:44:03.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.254+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2353746601 wait complete. 2022-02-02T13:44:03.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 Processor -- start 2022-02-02T13:44:03.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 -- start start 2022-02-02T13:44:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 0x7fbae8107650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8107c00 con 0x7fbae80f68e0 2022-02-02T13:44:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.255+0000 7fbaeec5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae8107d40 con 0x7fbae80f7b80 2022-02-02T13:44:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57864/0 (socket says 172.21.15.33:57864) 2022-02-02T13:44:03.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 -- 172.21.15.33:0/2636956402 learned_addr learned my addr 172.21.15.33:0/2636956402 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbae7fff700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 0x7fbae8107650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 -- 172.21.15.33:0/2636956402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 msgr2=0x7fbae8107650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 0x7fbae8107650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 -- 172.21.15.33:0/2636956402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbadc005040 con 0x7fbae80f68e0 2022-02-02T13:44:03.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaec9fa700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbadc014040 tx=0x7fbadc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbadc019070 con 0x7fbae80f68e0 2022-02-02T13:44:03.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbadc007e70 con 0x7fbae80f68e0 2022-02-02T13:44:03.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbadc014d10 con 0x7fbae80f68e0 2022-02-02T13:44:03.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae8108680 con 0x7fbae80f68e0 2022-02-02T13:44:03.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.256+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae8108b90 con 0x7fbae80f68e0 2022-02-02T13:44:03.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.257+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae8045ad0 con 0x7fbae80f68e0 2022-02-02T13:44:03.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.258+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbadc025070 con 0x7fbae80f68e0 2022-02-02T13:44:03.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.258+0000 7fbae57fa700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 0x7fbad8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.259+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbadc082e70 con 0x7fbae80f68e0 2022-02-02T13:44:03.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.259+0000 7fbae7fff700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 0x7fbad8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.259+0000 7fbae7fff700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 0x7fbad8067290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbad4009fd0 tx=0x7fbad400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.262+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbadc054950 con 0x7fbae80f68e0 2022-02-02T13:44:03.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.450+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbae80ff0a0 con 0x7fbad8064dd0 2022-02-02T13:44:03.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.465+0000 7fbae57fa700 1 -- 172.21.15.33:0/2636956402 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbae80ff0a0 con 0x7fbad8064dd0 2022-02-02T13:44:03.465 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:44:03.466 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (9m) 2m ago 10m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:44:03.466 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 2m ago 10m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:44:03.466 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (2m) 2m ago 9m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:44:03.466 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (9m) 2m ago 10m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:44:03.466 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (2m) 2m ago 6m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:44:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (3m) 2m ago 6m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:44:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (4m) 2m ago 6m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:44:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (6m) 2m ago 6m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:44:03.467 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (3m) 2m ago 11m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:44:03.468 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (3m) 2m ago 9m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:44:03.468 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 2m ago 11m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:44:03.468 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (2m) 2m ago 9m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:44:03.468 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (10m) 2m ago 10m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:44:03.469 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (9m) 2m ago 9m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:44:03.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 2m ago 9m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:44:03.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 2m ago 8m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:44:03.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 2m ago 8m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:44:03.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (8m) 2m ago 8m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:44:03.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (7m) 2m ago 7m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:44:03.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (7m) 2m ago 7m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:44:03.470 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (9m) 2m ago 9m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:44:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 msgr2=0x7fbad8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 0x7fbad8067290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fbad4009fd0 tx=0x7fbad400b040).stop 2022-02-02T13:44:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 msgr2=0x7fbae8107160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbadc014040 tx=0x7fbadc00b040).stop 2022-02-02T13:44:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 shutdown_connections 2022-02-02T13:44:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbad8064dd0 0x7fbad8067290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbae80f68e0 0x7fbae8107160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 --2- 172.21.15.33:0/2636956402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae80f7b80 0x7fbae8107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.466+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 >> 172.21.15.33:0/2636956402 conn(0x7fbae80f2020 msgr2=0x7fbae80fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.467+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 shutdown_connections 2022-02-02T13:44:03.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.467+0000 7fbaeec5e700 1 -- 172.21.15.33:0/2636956402 wait complete. 2022-02-02T13:44:03.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/2279738251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 msgr2=0x7fe2d00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/2279738251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d00f6b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe2c0004660 tx=0x7fe2c0009b30).stop 2022-02-02T13:44:03.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/2279738251 shutdown_connections 2022-02-02T13:44:03.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/2279738251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 0x7fe2d00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/2279738251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d00f6b00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/2279738251 >> 172.21.15.33:0/2279738251 conn(0x7fe2d00f1e40 msgr2=0x7fe2d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.567+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/2279738251 shutdown_connections 2022-02-02T13:44:03.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.568+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/2279738251 wait complete. 2022-02-02T13:44:03.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.568+0000 7fe2d4ffc700 1 Processor -- start 2022-02-02T13:44:03.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2d4ffc700 1 -- start start 2022-02-02T13:44:03.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2d4ffc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2d4ffc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 0x7fe2d01073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2d4ffc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0107990 con 0x7fe2d00f66e0 2022-02-02T13:44:03.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2d4ffc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0107ad0 con 0x7fe2d00f7980 2022-02-02T13:44:03.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57874/0 (socket says 172.21.15.33:57874) 2022-02-02T13:44:03.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 -- 172.21.15.33:0/811661371 learned_addr learned my addr 172.21.15.33:0/811661371 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:03.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2cdd9b700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 0x7fe2d01073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 -- 172.21.15.33:0/811661371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 msgr2=0x7fe2d01073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 0x7fe2d01073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 -- 172.21.15.33:0/811661371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c0005040 con 0x7fe2d00f66e0 2022-02-02T13:44:03.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.569+0000 7fe2ce59c700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe2c0014040 tx=0x7fe2c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.570+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c0019070 con 0x7fe2d00f66e0 2022-02-02T13:44:03.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.570+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0108410 con 0x7fe2d00f66e0 2022-02-02T13:44:03.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.570+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2c0007e70 con 0x7fe2d00f66e0 2022-02-02T13:44:03.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.570+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c0014d50 con 0x7fe2d00f66e0 2022-02-02T13:44:03.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.570+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d0108970 con 0x7fe2d00f66e0 2022-02-02T13:44:03.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.571+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d0045ad0 con 0x7fe2d00f66e0 2022-02-02T13:44:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.572+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2c0014420 con 0x7fe2d00f66e0 2022-02-02T13:44:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.572+0000 7fe2c6ffd700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 0x7fe2bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.572+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe2c00828c0 con 0x7fe2d00f66e0 2022-02-02T13:44:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.572+0000 7fe2cdd9b700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 0x7fe2bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.573+0000 7fe2cdd9b700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 0x7fe2bc067290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe2b8007f80 tx=0x7fe2b800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.576+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2c00543a0 con 0x7fe2d00f66e0 2022-02-02T13:44:03.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.821+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe2d00ff020 con 0x7fe2d00f66e0 2022-02-02T13:44:03.822 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:03 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:44:03.822 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:03 smithi033 ceph-mon[101165]: Health check failed: Upgrading daemon osd.0 on host smithi033 failed. (UPGRADE_REDEPLOY_DAEMON) 2022-02-02T13:44:03.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.821+0000 7fe2c6ffd700 1 -- 172.21.15.33:0/811661371 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe2c0023070 con 0x7fe2d00f66e0 2022-02-02T13:44:03.823 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:44:03.823 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:44:03.824 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:44:03.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:03.825 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:44:03.825 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:44:03.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:03.826 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:44:03.826 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:44:03.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:03.826 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:44:03.827 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:44:03.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:03.827 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:44:03.828 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:44:03.828 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:44:03.828 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:44:03.828 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:44:03.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 msgr2=0x7fe2bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 0x7fe2bc067290 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fe2b8007f80 tx=0x7fe2b800b040).stop 2022-02-02T13:44:03.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 msgr2=0x7fe2d0106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fe2c0014040 tx=0x7fe2c000b040).stop 2022-02-02T13:44:03.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 shutdown_connections 2022-02-02T13:44:03.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2bc064dd0 0x7fe2bc067290 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00f66e0 0x7fe2d0106ef0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 --2- 172.21.15.33:0/811661371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2d00f7980 0x7fe2d01073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 >> 172.21.15.33:0/811661371 conn(0x7fe2d00f1e40 msgr2=0x7fe2d00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 shutdown_connections 2022-02-02T13:44:03.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.823+0000 7fe2d4ffc700 1 -- 172.21.15.33:0/811661371 wait complete. 2022-02-02T13:44:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 -- 172.21.15.33:0/3527613971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f55c0 msgr2=0x7fed7c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 --2- 172.21.15.33:0/3527613971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f59e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fed6c004660 tx=0x7fed6c009b30).stop 2022-02-02T13:44:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 -- 172.21.15.33:0/3527613971 shutdown_connections 2022-02-02T13:44:03.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 --2- 172.21.15.33:0/3527613971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 --2- 172.21.15.33:0/3527613971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f59e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 -- 172.21.15.33:0/3527613971 >> 172.21.15.33:0/3527613971 conn(0x7fed7c0f0d40 msgr2=0x7fed7c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 -- 172.21.15.33:0/3527613971 shutdown_connections 2022-02-02T13:44:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.924+0000 7fed80f7f700 1 -- 172.21.15.33:0/3527613971 wait complete. 2022-02-02T13:44:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 Processor -- start 2022-02-02T13:44:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 -- start start 2022-02-02T13:44:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0f8100 con 0x7fed7c0f6860 2022-02-02T13:44:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed80f7f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0f8240 con 0x7fed7c0f55c0 2022-02-02T13:44:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed79d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed79d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57886/0 (socket says 172.21.15.33:57886) 2022-02-02T13:44:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed79d9b700 1 -- 172.21.15.33:0/2297575011 learned_addr learned my addr 172.21.15.33:0/2297575011 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.925+0000 7fed7a59c700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed79d9b700 1 -- 172.21.15.33:0/2297575011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f55c0 msgr2=0x7fed7c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed79d9b700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed79d9b700 1 -- 172.21.15.33:0/2297575011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c005040 con 0x7fed7c0f6860 2022-02-02T13:44:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed79d9b700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fed640026d0 tx=0x7fed64009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed640079c0 con 0x7fed7c0f6860 2022-02-02T13:44:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0f8520 con 0x7fed7c0f6860 2022-02-02T13:44:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed6400f040 con 0x7fed7c0f6860 2022-02-02T13:44:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed640148b0 con 0x7fed7c0f6860 2022-02-02T13:44:03.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.926+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c10efa0 con 0x7fed7c0f6860 2022-02-02T13:44:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.927+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c045ad0 con 0x7fed7c0f6860 2022-02-02T13:44:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.927+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed64007b20 con 0x7fed7c0f6860 2022-02-02T13:44:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.928+0000 7fed72ffd700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.928+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fed64081a30 con 0x7fed7c0f6860 2022-02-02T13:44:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.928+0000 7fed7a59c700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.928+0000 7fed7a59c700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 0x7fed68067290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fed6c013690 tx=0x7fed6c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:03.932+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed6404fae0 con 0x7fed7c0f6860 2022-02-02T13:44:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:03 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:44:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:03 smithi037 ceph-mon[69017]: Health check failed: Upgrading daemon osd.0 on host smithi033 failed. (UPGRADE_REDEPLOY_DAEMON) 2022-02-02T13:44:04.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.140+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fed7c0fdd80 con 0x7fed7c0f6860 2022-02-02T13:44:04.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.141+0000 7fed72ffd700 1 -- 172.21.15.33:0/2297575011 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fed64053100 con 0x7fed7c0f6860 2022-02-02T13:44:04.142 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:44:04.142 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:44:04.142 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:44:04.143 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:44:04.143 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:04.143 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:44:04.143 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:44:04.144 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:44:04.144 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:44:04.144 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:44:04.144 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:44:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:44:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:44:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:44:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:44:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:44:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:44:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:44:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:44:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:44:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:44:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:44:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:44:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:44:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:44:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:44:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:44:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:44:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:44:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:44:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:44:04.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:04.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:44:04.150 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:04.150 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:04.150 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:04.150 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:04.151 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 msgr2=0x7fed68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 0x7fed68067290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fed6c013690 tx=0x7fed6c009b30).stop 2022-02-02T13:44:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 msgr2=0x7fed7c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fed640026d0 tx=0x7fed64009de0).stop 2022-02-02T13:44:04.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 shutdown_connections 2022-02-02T13:44:04.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed68064dd0 0x7fed68067290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:04.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed7c0f55c0 0x7fed7c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:04.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 --2- 172.21.15.33:0/2297575011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed7c0f6860 0x7fed7c0f7ba0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:04.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 >> 172.21.15.33:0/2297575011 conn(0x7fed7c0f0d40 msgr2=0x7fed7c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:04.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 shutdown_connections 2022-02-02T13:44:04.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:04.143+0000 7fed80f7f700 1 -- 172.21.15.33:0/2297575011 wait complete. 2022-02-02T13:44:04.154 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:44:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:04 smithi033 ceph-mon[101165]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:04 smithi033 ceph-mon[101165]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:04 smithi033 ceph-mon[101165]: pgmap v106: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:05.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/811661371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:44:05.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2297575011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:44:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:04 smithi037 ceph-mon[69017]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:04 smithi037 ceph-mon[69017]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:04 smithi037 ceph-mon[69017]: pgmap v106: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/811661371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:44:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2297575011' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:44:06.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:06 smithi033 ceph-mon[101165]: pgmap v107: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:06 smithi037 ceph-mon[69017]: pgmap v107: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:09.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:08 smithi033 ceph-mon[101165]: pgmap v108: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:08 smithi037 ceph-mon[69017]: pgmap v108: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:10 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:10 smithi033 ceph-mon[101165]: pgmap v109: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:10 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:44:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:10 smithi037 ceph-mon[69017]: pgmap v109: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:12.027 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-02-02T13:44:12.028 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 1. 2022-02-02T13:44:12.028 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:44:12.028 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110056 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.028 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.029 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110208 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.029 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.029 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110249 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.029 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.030 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: Starting Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:44:12.030 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110056 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.030 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.030 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110208 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.030 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.031 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 110249 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:44:12.031 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:11 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:44:12.484 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:12 smithi033 bash[111126]: e60b500e574eece335d64ed36cff04165dc1625ae9d71587cdf1013e074fd3d1 2022-02-02T13:44:12.740 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:12 smithi033 podman[111327]: 2022-02-02T13:44:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:12 smithi033 ceph-mon[101165]: pgmap v110: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:12 smithi037 ceph-mon[69017]: pgmap v110: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:13.740 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:44:13 smithi033 bash[110056]: time="2022-02-02T13:44:13Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-02-02T13:44:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:14 smithi033 ceph-mon[101165]: pgmap v111: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:14 smithi037 ceph-mon[69017]: pgmap v111: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:16 smithi033 ceph-mon[101165]: pgmap v112: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:17.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:16 smithi037 ceph-mon[69017]: pgmap v112: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:18 smithi033 ceph-mon[101165]: pgmap v113: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:18 smithi037 ceph-mon[69017]: pgmap v113: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:21.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:20 smithi033 ceph-mon[101165]: pgmap v114: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:21.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:20 smithi037 ceph-mon[69017]: pgmap v114: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:22 smithi033 ceph-mon[101165]: pgmap v115: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:22 smithi037 ceph-mon[69017]: pgmap v115: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:24 smithi033 ceph-mon[101165]: pgmap v116: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:24 smithi037 ceph-mon[69017]: pgmap v116: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:26 smithi033 ceph-mon[101165]: pgmap v117: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:26 smithi037 ceph-mon[69017]: pgmap v117: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:28 smithi033 ceph-mon[101165]: pgmap v118: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:28 smithi037 ceph-mon[69017]: pgmap v118: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:30 smithi033 ceph-mon[101165]: pgmap v119: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:30 smithi037 ceph-mon[69017]: pgmap v119: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:32 smithi033 ceph-mon[101165]: pgmap v120: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:32 smithi037 ceph-mon[69017]: pgmap v120: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 -- 172.21.15.33:0/814438771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f6860 msgr2=0x7f34580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 --2- 172.21.15.33:0/814438771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f6860 0x7f34580f6cc0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f344c004660 tx=0x7f344c009b30).stop 2022-02-02T13:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 -- 172.21.15.33:0/814438771 shutdown_connections 2022-02-02T13:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 --2- 172.21.15.33:0/814438771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f6860 0x7f34580f6cc0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 --2- 172.21.15.33:0/814438771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f55c0 0x7f34580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 -- 172.21.15.33:0/814438771 >> 172.21.15.33:0/814438771 conn(0x7f34580f0d40 msgr2=0x7f34580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 -- 172.21.15.33:0/814438771 shutdown_connections 2022-02-02T13:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.262+0000 7f34607e8700 1 -- 172.21.15.33:0/814438771 wait complete. 2022-02-02T13:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 Processor -- start 2022-02-02T13:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 -- start start 2022-02-02T13:44:34.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f6860 0x7f345810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34580603e0 con 0x7f34580f55c0 2022-02-02T13:44:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f34607e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3458060520 con 0x7f34580f6860 2022-02-02T13:44:34.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f345e584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f345e584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57894/0 (socket says 172.21.15.33:57894) 2022-02-02T13:44:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f345e584700 1 -- 172.21.15.33:0/3083679048 learned_addr learned my addr 172.21.15.33:0/3083679048 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.263+0000 7f345dd83700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f6860 0x7f345810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f345e584700 1 -- 172.21.15.33:0/3083679048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f6860 msgr2=0x7f345810c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f345e584700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f6860 0x7f345810c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f345e584700 1 -- 172.21.15.33:0/3083679048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c005040 con 0x7f34580f55c0 2022-02-02T13:44:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f345e584700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f345400c530 tx=0x7f3454007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f345400f650 con 0x7f34580f55c0 2022-02-02T13:44:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f345400fc60 con 0x7f34580f55c0 2022-02-02T13:44:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345810c700 con 0x7f34580f55c0 2022-02-02T13:44:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3454012cb0 con 0x7f34580f55c0 2022-02-02T13:44:34.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.264+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345810ccc0 con 0x7f34580f55c0 2022-02-02T13:44:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.265+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458045ad0 con 0x7f34580f55c0 2022-02-02T13:44:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.266+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3454019030 con 0x7f34580f55c0 2022-02-02T13:44:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.267+0000 7f344affd700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 0x7f3444067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.267+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3454081c70 con 0x7f34580f55c0 2022-02-02T13:44:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.267+0000 7f345dd83700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 0x7f3444067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.267+0000 7f345dd83700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 0x7f3444067290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f344c004630 tx=0x7f344c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.271+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f345404fe90 con 0x7f34580f55c0 2022-02-02T13:44:34.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.460+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3458057f10 con 0x7f3444064dd0 2022-02-02T13:44:34.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.461+0000 7f344affd700 1 -- 172.21.15.33:0/3083679048 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3458057f10 con 0x7f3444064dd0 2022-02-02T13:44:34.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 msgr2=0x7f3444067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 0x7f3444067290 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f344c004630 tx=0x7f344c009b30).stop 2022-02-02T13:44:34.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 msgr2=0x7f3458109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f345400c530 tx=0x7f3454007e10).stop 2022-02-02T13:44:34.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 shutdown_connections 2022-02-02T13:44:34.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3444064dd0 0x7f3444067290 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34580f55c0 0x7f3458109c50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 --2- 172.21.15.33:0/3083679048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34580f6860 0x7f345810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 >> 172.21.15.33:0/3083679048 conn(0x7f34580f0d40 msgr2=0x7f34580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:34.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 shutdown_connections 2022-02-02T13:44:34.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.463+0000 7f34607e8700 1 -- 172.21.15.33:0/3083679048 wait complete. 2022-02-02T13:44:34.474 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:44:34.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 -- 172.21.15.33:0/51969008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 msgr2=0x7fc7500f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 --2- 172.21.15.33:0/51969008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc7500f6cc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fc740004660 tx=0x7fc740009b30).stop 2022-02-02T13:44:34.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 -- 172.21.15.33:0/51969008 shutdown_connections 2022-02-02T13:44:34.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 --2- 172.21.15.33:0/51969008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc7500f6cc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 --2- 172.21.15.33:0/51969008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc7500f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 -- 172.21.15.33:0/51969008 >> 172.21.15.33:0/51969008 conn(0x7fc7500f0d40 msgr2=0x7fc7500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:34.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 -- 172.21.15.33:0/51969008 shutdown_connections 2022-02-02T13:44:34.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.565+0000 7fc7554a8700 1 -- 172.21.15.33:0/51969008 wait complete. 2022-02-02T13:44:34.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 Processor -- start 2022-02-02T13:44:34.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 -- start start 2022-02-02T13:44:34.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc75010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500602b0 con 0x7fc7500f6860 2022-02-02T13:44:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc7554a8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7500603f0 con 0x7fc7500f55c0 2022-02-02T13:44:34.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc74e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc75010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc74effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc74e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc75010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57906/0 (socket says 172.21.15.33:57906) 2022-02-02T13:44:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc74effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:40388/0 (socket says 172.21.15.33:40388) 2022-02-02T13:44:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.566+0000 7fc74e7fc700 1 -- 172.21.15.33:0/3173858514 learned_addr learned my addr 172.21.15.33:0/3173858514 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:34.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc74effd700 1 -- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 msgr2=0x7fc75010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc74effd700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc75010e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc74effd700 1 -- 172.21.15.33:0/3173858514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740005040 con 0x7fc7500f55c0 2022-02-02T13:44:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc74effd700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc7500f66c0 tx=0x7fc74400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7440092e0 con 0x7fc7500f55c0 2022-02-02T13:44:34.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc74400f040 con 0x7fc7500f55c0 2022-02-02T13:44:34.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75010e9d0 con 0x7fc7500f55c0 2022-02-02T13:44:34.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7440147a0 con 0x7fc7500f55c0 2022-02-02T13:44:34.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.567+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75010ee50 con 0x7fc7500f55c0 2022-02-02T13:44:34.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.568+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc750045ad0 con 0x7fc7500f55c0 2022-02-02T13:44:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.569+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc74401b030 con 0x7fc7500f55c0 2022-02-02T13:44:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.569+0000 7fc7377fe700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 0x7fc7380672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.569+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc7440819c0 con 0x7fc7500f55c0 2022-02-02T13:44:34.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.569+0000 7fc74e7fc700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 0x7fc7380672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.570+0000 7fc74e7fc700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 0x7fc7380672d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc740009d60 tx=0x7fc740016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.574+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc74404f9b0 con 0x7fc7500f55c0 2022-02-02T13:44:34.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.753+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc750057f10 con 0x7fc738064e10 2022-02-02T13:44:34.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.768+0000 7fc7377fe700 1 -- 172.21.15.33:0/3173858514 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc750057f10 con 0x7fc738064e10 2022-02-02T13:44:34.769 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:44:34.769 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (9m) 2m ago 10m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:44:34.769 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (2m) 2m ago 10m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:44:34.769 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (2m) 2m ago 10m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:44:34.770 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (9m) 2m ago 10m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:44:34.770 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (3m) 2m ago 7m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:44:34.770 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (4m) 2m ago 6m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:44:34.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (4m) 2m ago 7m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:44:34.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (7m) 2m ago 7m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:44:34.771 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (4m) 2m ago 12m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:44:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (4m) 2m ago 10m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:44:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (3m) 2m ago 12m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:44:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (3m) 2m ago 10m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:44:34.772 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (10m) 2m ago 10m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:44:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (10m) 2m ago 10m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:44:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 2m ago 9m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:44:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (9m) 2m ago 9m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:44:34.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 2m ago 8m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:44:34.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (8m) 2m ago 8m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:44:34.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (8m) 2m ago 8m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:44:34.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (8m) 2m ago 8m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:44:34.774 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (9m) 2m ago 10m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:44:34.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.770+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 msgr2=0x7fc7380672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.770+0000 7fc7554a8700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 0x7fc7380672d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fc740009d60 tx=0x7fc740016040).stop 2022-02-02T13:44:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.770+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 msgr2=0x7fc75010bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.770+0000 7fc7554a8700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fc7500f66c0 tx=0x7fc74400b040).stop 2022-02-02T13:44:34.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 shutdown_connections 2022-02-02T13:44:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc738064e10 0x7fc7380672d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7500f55c0 0x7fc75010bfe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 --2- 172.21.15.33:0/3173858514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7500f6860 0x7fc75010e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 >> 172.21.15.33:0/3173858514 conn(0x7fc7500f0d40 msgr2=0x7fc7500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:34.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 shutdown_connections 2022-02-02T13:44:34.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.771+0000 7fc7554a8700 1 -- 172.21.15.33:0/3173858514 wait complete. 2022-02-02T13:44:34.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- 172.21.15.33:0/3858929585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f77e0 msgr2=0x7f0a640f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 --2- 172.21.15.33:0/3858929585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f77e0 0x7f0a640f7c40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f0a58004660 tx=0x7f0a58009b30).stop 2022-02-02T13:44:34.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- 172.21.15.33:0/3858929585 shutdown_connections 2022-02-02T13:44:34.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 --2- 172.21.15.33:0/3858929585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f77e0 0x7f0a640f7c40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 --2- 172.21.15.33:0/3858929585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f6540 0x7f0a640f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- 172.21.15.33:0/3858929585 >> 172.21.15.33:0/3858929585 conn(0x7f0a640f1ca0 msgr2=0x7f0a640f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:34.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- 172.21.15.33:0/3858929585 shutdown_connections 2022-02-02T13:44:34.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- 172.21.15.33:0/3858929585 wait complete. 2022-02-02T13:44:34.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 Processor -- start 2022-02-02T13:44:34.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.873+0000 7f0a6999d700 1 -- start start 2022-02-02T13:44:34.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a6999d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a6999d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f77e0 0x7f0a64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a6999d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6406a380 con 0x7f0a640f6540 2022-02-02T13:44:34.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a6999d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6406a4c0 con 0x7f0a640f77e0 2022-02-02T13:44:34.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57912/0 (socket says 172.21.15.33:57912) 2022-02-02T13:44:34.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 -- 172.21.15.33:0/2962345408 learned_addr learned my addr 172.21.15.33:0/2962345408 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a627fc700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f77e0 0x7f0a64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 -- 172.21.15.33:0/2962345408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f77e0 msgr2=0x7f0a64069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f77e0 0x7f0a64069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 -- 172.21.15.33:0/2962345408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a58005040 con 0x7f0a640f6540 2022-02-02T13:44:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a62ffd700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0a5400e7c0 tx=0x7f0a5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.874+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a540092e0 con 0x7f0a640f6540 2022-02-02T13:44:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.875+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6406a7a0 con 0x7f0a640f6540 2022-02-02T13:44:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.875+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6410ed10 con 0x7f0a640f6540 2022-02-02T13:44:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.875+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a5400f040 con 0x7f0a640f6540 2022-02-02T13:44:34.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.875+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a540147e0 con 0x7f0a640f6540 2022-02-02T13:44:34.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.876+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a44004fa0 con 0x7f0a640f6540 2022-02-02T13:44:34.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.876+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a5401b030 con 0x7f0a640f6540 2022-02-02T13:44:34.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.876+0000 7f0a4b7fe700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 0x7f0a4c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.876+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0a54081640 con 0x7f0a640f6540 2022-02-02T13:44:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.877+0000 7f0a627fc700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 0x7f0a4c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.877+0000 7f0a627fc700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 0x7f0a4c0672e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0a58005010 tx=0x7f0a58016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:34.881+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a5404f7a0 con 0x7f0a640f6540 2022-02-02T13:44:35.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.127+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0a44005e80 con 0x7f0a640f6540 2022-02-02T13:44:35.128 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:34 smithi033 ceph-mon[101165]: pgmap v121: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:35.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.127+0000 7f0a4b7fe700 1 -- 172.21.15.33:0/2962345408 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0a54052dc0 con 0x7f0a640f6540 2022-02-02T13:44:35.129 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:44:35.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:44:35.129 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:44:35.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:35.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:44:35.130 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:44:35.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:35.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:44:35.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:44:35.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:35.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:44:35.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:44:35.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:44:35.132 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:44:35.132 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:44:35.132 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:44:35.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:44:35.133 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:44:35.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 msgr2=0x7f0a4c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 0x7f0a4c0672e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f0a58005010 tx=0x7f0a58016040).stop 2022-02-02T13:44:35.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 msgr2=0x7f0a6406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f0a5400e7c0 tx=0x7f0a5400b040).stop 2022-02-02T13:44:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 shutdown_connections 2022-02-02T13:44:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a4c064e20 0x7f0a4c0672e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a640f6540 0x7f0a6406b9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 --2- 172.21.15.33:0/2962345408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a640f77e0 0x7f0a64069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.129+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 >> 172.21.15.33:0/2962345408 conn(0x7f0a640f1ca0 msgr2=0x7f0a640fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.130+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 shutdown_connections 2022-02-02T13:44:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.130+0000 7f0a6999d700 1 -- 172.21.15.33:0/2962345408 wait complete. 2022-02-02T13:44:35.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 -- 172.21.15.33:0/4114904055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f6860 msgr2=0x7f85280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 --2- 172.21.15.33:0/4114904055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f6860 0x7f85280f6cc0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8510004660 tx=0x7f8510009b30).stop 2022-02-02T13:44:35.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 -- 172.21.15.33:0/4114904055 shutdown_connections 2022-02-02T13:44:35.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 --2- 172.21.15.33:0/4114904055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f6860 0x7f85280f6cc0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 --2- 172.21.15.33:0/4114904055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f55c0 0x7f85280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 -- 172.21.15.33:0/4114904055 >> 172.21.15.33:0/4114904055 conn(0x7f85280f0d40 msgr2=0x7f85280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:35.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 -- 172.21.15.33:0/4114904055 shutdown_connections 2022-02-02T13:44:35.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.231+0000 7f852c8a3700 1 -- 172.21.15.33:0/4114904055 wait complete. 2022-02-02T13:44:35.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 Processor -- start 2022-02-02T13:44:35.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 -- start start 2022-02-02T13:44:35.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 0x7f852810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280602b0 con 0x7f85280f55c0 2022-02-02T13:44:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852c8a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280603f0 con 0x7f85280f6860 2022-02-02T13:44:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:35.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57922/0 (socket says 172.21.15.33:57922) 2022-02-02T13:44:35.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.232+0000 7f852659c700 1 -- 172.21.15.33:0/2127483009 learned_addr learned my addr 172.21.15.33:0/2127483009 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:44:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f8525d9b700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 0x7f852810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852659c700 1 -- 172.21.15.33:0/2127483009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 msgr2=0x7f852810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852659c700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 0x7f852810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852659c700 1 -- 172.21.15.33:0/2127483009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8510005040 con 0x7f85280f55c0 2022-02-02T13:44:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f8525d9b700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 0x7f852810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:44:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852659c700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f851800c530 tx=0x7f8518007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f851800f650 con 0x7f85280f55c0 2022-02-02T13:44:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f851800fc60 con 0x7f85280f55c0 2022-02-02T13:44:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852810ea60 con 0x7f85280f55c0 2022-02-02T13:44:35.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8518012d20 con 0x7f85280f55c0 2022-02-02T13:44:35.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.233+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852810eee0 con 0x7f85280f55c0 2022-02-02T13:44:35.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.234+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8528045ad0 con 0x7f85280f55c0 2022-02-02T13:44:35.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.235+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8518019030 con 0x7f85280f55c0 2022-02-02T13:44:35.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.235+0000 7f851effd700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 0x7f8514067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:44:35.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.235+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8518081710 con 0x7f85280f55c0 2022-02-02T13:44:35.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.235+0000 7f8525d9b700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 0x7f8514067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:44:35.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.236+0000 7f8525d9b700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 0x7f8514067290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8510004e30 tx=0x7f8510009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:44:35.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.239+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f851804f810 con 0x7f85280f55c0 2022-02-02T13:44:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:34 smithi037 ceph-mon[69017]: pgmap v121: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.452+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f85280586e0 con 0x7f85280f55c0 2022-02-02T13:44:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.452+0000 7f851effd700 1 -- 172.21.15.33:0/2127483009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f8518052e30 con 0x7f85280f55c0 2022-02-02T13:44:35.453 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:44:35.454 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:44:35.454 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:44:35.454 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:44:35.454 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:44:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:44:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:44:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:44:35.455 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:44:35.456 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:44:35.456 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:44:35.456 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:44:35.456 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:44:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:44:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:44:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:44:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:44:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:44:35.458 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:44:35.458 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:44:35.458 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:44:35.458 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:44:35.459 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:44:35.459 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:44:35.459 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:44:35.459 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:44:35.459 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:44:35.460 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:44:35.460 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:44:35.460 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:44:35.460 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:35.460 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:35.461 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:44:35.461 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:44:35.461 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:35.461 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:35.462 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:35.462 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:44:35.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 msgr2=0x7f8514067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 0x7f8514067290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8510004e30 tx=0x7f8510009b30).stop 2022-02-02T13:44:35.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 msgr2=0x7f852810c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:44:35.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f851800c530 tx=0x7f8518007e10).stop 2022-02-02T13:44:35.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 shutdown_connections 2022-02-02T13:44:35.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8514064dd0 0x7f8514067290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85280f55c0 0x7f852810c070 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 --2- 172.21.15.33:0/2127483009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85280f6860 0x7f852810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:44:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 >> 172.21.15.33:0/2127483009 conn(0x7f85280f0d40 msgr2=0x7f85280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:44:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 shutdown_connections 2022-02-02T13:44:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:44:35.456+0000 7f852c8a3700 1 -- 172.21.15.33:0/2127483009 wait complete. 2022-02-02T13:44:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:44:36.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:35 smithi033 ceph-mon[101165]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:36.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:35 smithi033 ceph-mon[101165]: from='client.44203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:36.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:35 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2962345408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:44:36.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:35 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2127483009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:44:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:35 smithi037 ceph-mon[69017]: from='client.34264 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:35 smithi037 ceph-mon[69017]: from='client.44203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:44:36.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:35 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2962345408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:44:36.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:35 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2127483009' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:44:37.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:36 smithi033 ceph-mon[101165]: pgmap v122: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:37.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:36 smithi037 ceph-mon[69017]: pgmap v122: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:38 smithi033 ceph-mon[101165]: pgmap v123: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:38 smithi037 ceph-mon[69017]: pgmap v123: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:40 smithi033 ceph-mon[101165]: pgmap v124: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:40 smithi037 ceph-mon[69017]: pgmap v124: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:42 smithi033 ceph-mon[101165]: pgmap v125: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:42 smithi037 ceph-mon[69017]: pgmap v125: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:44 smithi033 ceph-mon[101165]: pgmap v126: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:44 smithi037 ceph-mon[69017]: pgmap v126: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:46 smithi033 ceph-mon[101165]: pgmap v127: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:46 smithi037 ceph-mon[69017]: pgmap v127: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:48 smithi033 ceph-mon[101165]: pgmap v128: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:48 smithi037 ceph-mon[69017]: pgmap v128: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:50 smithi033 ceph-mon[101165]: pgmap v129: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:50 smithi037 ceph-mon[69017]: pgmap v129: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:52 smithi033 ceph-mon[101165]: pgmap v130: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:52 smithi037 ceph-mon[69017]: pgmap v130: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:54 smithi033 ceph-mon[101165]: pgmap v131: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:44:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:44:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:54 smithi037 ceph-mon[69017]: pgmap v131: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:44:55.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:44:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:56 smithi033 ceph-mon[101165]: pgmap v132: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:56 smithi037 ceph-mon[69017]: pgmap v132: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:59.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:44:58 smithi033 ceph-mon[101165]: pgmap v133: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:44:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:44:58 smithi037 ceph-mon[69017]: pgmap v133: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:00 smithi033 ceph-mon[101165]: pgmap v134: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:00 smithi037 ceph-mon[69017]: pgmap v134: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:02 smithi033 ceph-mon[101165]: pgmap v135: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:45:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:45:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:02 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:45:03.021 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:02 smithi037 ceph-mon[69017]: pgmap v135: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:03.021 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:45:03.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:45:03.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:02 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:45:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:03 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:45:04.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:03 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:45:04.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:03 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:45:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:03 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:45:04.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:03 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:45:04.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:03 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:45:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:04 smithi033 ceph-mon[101165]: pgmap v136: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:04 smithi037 ceph-mon[69017]: pgmap v136: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:05.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 -- 172.21.15.33:0/1238589395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f55c0 msgr2=0x7f91c00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 --2- 172.21.15.33:0/1238589395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f55c0 0x7f91c00f59e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f91b0004660 tx=0x7f91b0009b30).stop 2022-02-02T13:45:05.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 -- 172.21.15.33:0/1238589395 shutdown_connections 2022-02-02T13:45:05.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 --2- 172.21.15.33:0/1238589395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f6860 0x7f91c00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 --2- 172.21.15.33:0/1238589395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f55c0 0x7f91c00f59e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 -- 172.21.15.33:0/1238589395 >> 172.21.15.33:0/1238589395 conn(0x7f91c00f0d40 msgr2=0x7f91c00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:05.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 -- 172.21.15.33:0/1238589395 shutdown_connections 2022-02-02T13:45:05.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 -- 172.21.15.33:0/1238589395 wait complete. 2022-02-02T13:45:05.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.576+0000 7f91c6993700 1 Processor -- start 2022-02-02T13:45:05.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91c6993700 1 -- start start 2022-02-02T13:45:05.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91c6993700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 0x7f91c010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91c6993700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91c6993700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00602b0 con 0x7f91c00f6860 2022-02-02T13:45:05.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91c6993700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c00603f0 con 0x7f91c00f55c0 2022-02-02T13:45:05.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91bf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:05.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91bf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57938/0 (socket says 172.21.15.33:57938) 2022-02-02T13:45:05.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91bf7fe700 1 -- 172.21.15.33:0/2288265419 learned_addr learned my addr 172.21.15.33:0/2288265419 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:05.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.577+0000 7f91bffff700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 0x7f91c010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:05.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bf7fe700 1 -- 172.21.15.33:0/2288265419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 msgr2=0x7f91c010c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bf7fe700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 0x7f91c010c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bf7fe700 1 -- 172.21.15.33:0/2288265419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b0005040 con 0x7f91c00f6860 2022-02-02T13:45:05.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bffff700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 0x7f91c010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:45:05.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bf7fe700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f91b40026d0 tx=0x7f91b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:05.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b4009320 con 0x7f91c00f6860 2022-02-02T13:45:05.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c010ea80 con 0x7f91c00f6860 2022-02-02T13:45:05.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f91b400f040 con 0x7f91c00f6860 2022-02-02T13:45:05.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91b40147e0 con 0x7f91c00f6860 2022-02-02T13:45:05.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.578+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c010ef00 con 0x7f91c00f6860 2022-02-02T13:45:05.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.579+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c0045ad0 con 0x7f91c00f6860 2022-02-02T13:45:05.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.580+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f91b4009480 con 0x7f91c00f6860 2022-02-02T13:45:05.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.580+0000 7f91bcff9700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 0x7f91a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.580+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f91b4082170 con 0x7f91c00f6860 2022-02-02T13:45:05.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.580+0000 7f91bffff700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 0x7f91a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:05.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.581+0000 7f91bffff700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 0x7f91a8067290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f91b0004e30 tx=0x7f91b0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:05.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.584+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f91b4050220 con 0x7f91c00f6860 2022-02-02T13:45:05.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.773+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91c0057f10 con 0x7f91a8064dd0 2022-02-02T13:45:05.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.774+0000 7f91bcff9700 1 -- 172.21.15.33:0/2288265419 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f91c0057f10 con 0x7f91a8064dd0 2022-02-02T13:45:05.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 msgr2=0x7f91a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 0x7f91a8067290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f91b0004e30 tx=0x7f91b0009b30).stop 2022-02-02T13:45:05.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 msgr2=0x7f91c010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f91b40026d0 tx=0x7f91b4009de0).stop 2022-02-02T13:45:05.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 shutdown_connections 2022-02-02T13:45:05.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f91a8064dd0 0x7f91a8067290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c00f55c0 0x7f91c010c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 --2- 172.21.15.33:0/2288265419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91c00f6860 0x7f91c010e590 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 >> 172.21.15.33:0/2288265419 conn(0x7f91c00f0d40 msgr2=0x7f91c00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:05.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 shutdown_connections 2022-02-02T13:45:05.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.776+0000 7f91c6993700 1 -- 172.21.15.33:0/2288265419 wait complete. 2022-02-02T13:45:05.787 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:45:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 -- 172.21.15.33:0/1388159775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f6860 msgr2=0x7f8b580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/1388159775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f6860 0x7f8b580f6cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8b40004660 tx=0x7f8b40009b30).stop 2022-02-02T13:45:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 -- 172.21.15.33:0/1388159775 shutdown_connections 2022-02-02T13:45:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/1388159775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f6860 0x7f8b580f6cc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/1388159775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b580f55c0 0x7f8b580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 -- 172.21.15.33:0/1388159775 >> 172.21.15.33:0/1388159775 conn(0x7f8b580f0d40 msgr2=0x7f8b580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 -- 172.21.15.33:0/1388159775 shutdown_connections 2022-02-02T13:45:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.878+0000 7f8b5d04e700 1 -- 172.21.15.33:0/1388159775 wait complete. 2022-02-02T13:45:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 Processor -- start 2022-02-02T13:45:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 -- start start 2022-02-02T13:45:05.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b580f6860 0x7f8b58107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58107a10 con 0x7f8b580f55c0 2022-02-02T13:45:05.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b5d04e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b58107b50 con 0x7f8b580f6860 2022-02-02T13:45:05.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b56d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:05.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b56d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57946/0 (socket says 172.21.15.33:57946) 2022-02-02T13:45:05.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.879+0000 7f8b56d9d700 1 -- 172.21.15.33:0/3153762975 learned_addr learned my addr 172.21.15.33:0/3153762975 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:05.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b56d9d700 1 -- 172.21.15.33:0/3153762975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b580f6860 msgr2=0x7f8b58107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:05.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b56d9d700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b580f6860 0x7f8b58107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:45:05.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b56d9d700 1 -- 172.21.15.33:0/3153762975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b40005040 con 0x7f8b580f55c0 2022-02-02T13:45:05.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b56d9d700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8b4800d7f0 tx=0x7f8b48004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:05.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4800b4f0 con 0x7f8b580f55c0 2022-02-02T13:45:05.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b4800f040 con 0x7f8b580f55c0 2022-02-02T13:45:05.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b48013980 con 0x7f8b580f55c0 2022-02-02T13:45:05.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b581084f0 con 0x7f8b580f55c0 2022-02-02T13:45:05.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.880+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b58108ab0 con 0x7f8b580f55c0 2022-02-02T13:45:05.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.881+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b58045ad0 con 0x7f8b580f55c0 2022-02-02T13:45:05.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.882+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8b4801a030 con 0x7f8b580f55c0 2022-02-02T13:45:05.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.883+0000 7f8b4f7fe700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 0x7f8b44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:05.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.883+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8b48081ce0 con 0x7f8b580f55c0 2022-02-02T13:45:05.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.883+0000 7f8b5659c700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 0x7f8b44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:05.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.883+0000 7f8b5659c700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 0x7f8b44067290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8b40004e30 tx=0x7f8b40009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:05.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:05.886+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8b480537c0 con 0x7f8b580f55c0 2022-02-02T13:45:06.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.066+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b580faca0 con 0x7f8b44064dd0 2022-02-02T13:45:06.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.081+0000 7f8b4f7fe700 1 -- 172.21.15.33:0/3153762975 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8b580faca0 con 0x7f8b44064dd0 2022-02-02T13:45:06.082 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:45:06.082 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (10m) 3m ago 11m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:45:06.082 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 3m ago 11m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:45:06.083 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (3m) 3m ago 10m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:45:06.083 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (10m) 3m ago 11m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:45:06.083 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (3m) 3m ago 7m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:45:06.084 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (4m) 3m ago 7m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:45:06.084 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (5m) 3m ago 7m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:45:06.084 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (7m) 3m ago 7m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:45:06.084 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (5m) 3m ago 12m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:45:06.085 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (4m) 3m ago 10m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:45:06.085 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 3m ago 12m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:45:06.085 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (3m) 3m ago 10m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:45:06.085 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (11m) 3m ago 11m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:45:06.086 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (10m) 3m ago 10m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:45:06.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (10m) 3m ago 10m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:45:06.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (9m) 3m ago 9m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:45:06.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (9m) 3m ago 9m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:45:06.087 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (9m) 3m ago 9m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:45:06.087 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (8m) 3m ago 8m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:45:06.087 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (8m) 3m ago 8m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:45:06.087 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (10m) 3m ago 10m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:45:06.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 msgr2=0x7f8b44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 0x7f8b44067290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8b40004e30 tx=0x7f8b40009b30).stop 2022-02-02T13:45:06.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 msgr2=0x7f8b58106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8b4800d7f0 tx=0x7f8b48004e80).stop 2022-02-02T13:45:06.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 shutdown_connections 2022-02-02T13:45:06.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b44064dd0 0x7f8b44067290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b580f55c0 0x7f8b58106f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 --2- 172.21.15.33:0/3153762975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b580f6860 0x7f8b58107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:45:06.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 >> 172.21.15.33:0/3153762975 conn(0x7f8b580f0d40 msgr2=0x7f8b5805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:06.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 shutdown_connections 2022-02-02T13:45:06.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.083+0000 7f8b5d04e700 1 -- 172.21.15.33:0/3153762975 wait complete. 2022-02-02T13:45:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 -- 172.21.15.33:0/375684359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 msgr2=0x7fedd80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 --2- 172.21.15.33:0/375684359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd80f7de0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fedcc004660 tx=0x7fedcc009b30).stop 2022-02-02T13:45:06.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 -- 172.21.15.33:0/375684359 shutdown_connections 2022-02-02T13:45:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 --2- 172.21.15.33:0/375684359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd80f7de0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 --2- 172.21.15.33:0/375684359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 0x7fedd80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 -- 172.21.15.33:0/375684359 >> 172.21.15.33:0/375684359 conn(0x7fedd80f1e40 msgr2=0x7fedd80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 -- 172.21.15.33:0/375684359 shutdown_connections 2022-02-02T13:45:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.183+0000 7feddcd30700 1 -- 172.21.15.33:0/375684359 wait complete. 2022-02-02T13:45:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 Processor -- start 2022-02-02T13:45:06.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 -- start start 2022-02-02T13:45:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 0x7fedd8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8107a00 con 0x7fedd80f7980 2022-02-02T13:45:06.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7feddcd30700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd8107b40 con 0x7fedd80f66e0 2022-02-02T13:45:06.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7fedd5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7fedd5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57958/0 (socket says 172.21.15.33:57958) 2022-02-02T13:45:06.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.184+0000 7fedd5d9b700 1 -- 172.21.15.33:0/3322919613 learned_addr learned my addr 172.21.15.33:0/3322919613 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:06.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedd659c700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 0x7fedd8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedd5d9b700 1 -- 172.21.15.33:0/3322919613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 msgr2=0x7fedd8106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedd5d9b700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 0x7fedd8106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedd5d9b700 1 -- 172.21.15.33:0/3322919613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc005040 con 0x7fedd80f7980 2022-02-02T13:45:06.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedd5d9b700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fedcc009990 tx=0x7fedcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:06.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedcc018070 con 0x7fedd80f7980 2022-02-02T13:45:06.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fedcc007ba0 con 0x7fedd80f7980 2022-02-02T13:45:06.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd8108480 con 0x7fedd80f7980 2022-02-02T13:45:06.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedcc01c620 con 0x7fedd80f7980 2022-02-02T13:45:06.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.185+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd81089e0 con 0x7fedd80f7980 2022-02-02T13:45:06.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.186+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd8045ad0 con 0x7fedd80f7980 2022-02-02T13:45:06.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.187+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fedcc01c8e0 con 0x7fedd80f7980 2022-02-02T13:45:06.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.187+0000 7fedc6ffd700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 0x7fedc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.187+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fedcc0838a0 con 0x7fedd80f7980 2022-02-02T13:45:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.187+0000 7fedd659c700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 0x7fedc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.188+0000 7fedd659c700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 0x7fedc0067290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fedd80f77e0 tx=0x7fedc8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.192+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fedcc055380 con 0x7fedd80f7980 2022-02-02T13:45:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.434+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedd8027a00 con 0x7fedd80f7980 2022-02-02T13:45:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.435+0000 7fedc6ffd700 1 -- 172.21.15.33:0/3322919613 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fedcc054f70 con 0x7fedd80f7980 2022-02-02T13:45:06.435 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:45:06.436 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:45:06.436 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:45:06.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:06.436 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:45:06.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:45:06.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:06.437 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:45:06.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:45:06.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:06.438 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:45:06.438 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:45:06.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:06.439 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:45:06.439 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:45:06.439 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:45:06.439 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:45:06.440 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:45:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 msgr2=0x7fedc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 0x7fedc0067290 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fedd80f77e0 tx=0x7fedc8009040).stop 2022-02-02T13:45:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 msgr2=0x7fedd8107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fedcc009990 tx=0x7fedcc009b30).stop 2022-02-02T13:45:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 shutdown_connections 2022-02-02T13:45:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedc0064dd0 0x7fedc0067290 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd80f66e0 0x7fedd8106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 --2- 172.21.15.33:0/3322919613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd80f7980 0x7fedd8107450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 >> 172.21.15.33:0/3322919613 conn(0x7fedd80f1e40 msgr2=0x7fedd80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 shutdown_connections 2022-02-02T13:45:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.437+0000 7feddcd30700 1 -- 172.21.15.33:0/3322919613 wait complete. 2022-02-02T13:45:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 -- 172.21.15.33:0/3959299763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 msgr2=0x7fe80c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 --2- 172.21.15.33:0/3959299763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c0f59e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fe7fc004660 tx=0x7fe7fc009b30).stop 2022-02-02T13:45:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 -- 172.21.15.33:0/3959299763 shutdown_connections 2022-02-02T13:45:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 --2- 172.21.15.33:0/3959299763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 --2- 172.21.15.33:0/3959299763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c0f59e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 -- 172.21.15.33:0/3959299763 >> 172.21.15.33:0/3959299763 conn(0x7fe80c0f0d40 msgr2=0x7fe80c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 -- 172.21.15.33:0/3959299763 shutdown_connections 2022-02-02T13:45:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.539+0000 7fe81243e700 1 -- 172.21.15.33:0/3959299763 wait complete. 2022-02-02T13:45:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 Processor -- start 2022-02-02T13:45:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 -- start start 2022-02-02T13:45:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c10c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c0603e0 con 0x7fe80c0f55c0 2022-02-02T13:45:06.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe81243e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80c060520 con 0x7fe80c0f6860 2022-02-02T13:45:06.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe80bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57966/0 (socket says 172.21.15.33:57966) 2022-02-02T13:45:06.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe80bfff700 1 -- 172.21.15.33:0/1667897190 learned_addr learned my addr 172.21.15.33:0/1667897190 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:06.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.540+0000 7fe80b7fe700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c10c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe80bfff700 1 -- 172.21.15.33:0/1667897190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 msgr2=0x7fe80c10c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe80bfff700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c10c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe80bfff700 1 -- 172.21.15.33:0/1667897190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc005040 con 0x7fe80c0f55c0 2022-02-02T13:45:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe80b7fe700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c10c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:45:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe80bfff700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7fc000c00 tx=0x7fe7fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7fc019070 con 0x7fe80c0f55c0 2022-02-02T13:45:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe7fc013380 con 0x7fe80c0f55c0 2022-02-02T13:45:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7fc014d30 con 0x7fe80c0f55c0 2022-02-02T13:45:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe80c10c640 con 0x7fe80c0f55c0 2022-02-02T13:45:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.541+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe80c10cba0 con 0x7fe80c0f55c0 2022-02-02T13:45:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.542+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80c045ad0 con 0x7fe80c0f55c0 2022-02-02T13:45:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.543+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe7fc025070 con 0x7fe80c0f55c0 2022-02-02T13:45:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.543+0000 7fe808ff9700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 0x7fe7f4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.543+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe7fc0829e0 con 0x7fe80c0f55c0 2022-02-02T13:45:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.543+0000 7fe80b7fe700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 0x7fe7f4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.543+0000 7fe80b7fe700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 0x7fe7f4067270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe800007fc0 tx=0x7fe80000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.547+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe7fc050a90 con 0x7fe80c0f55c0 2022-02-02T13:45:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:06 smithi033 ceph-mon[101165]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:06.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:06 smithi033 ceph-mon[101165]: pgmap v137: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:06.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:06 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3322919613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:45:06.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.763+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe80c0fdec0 con 0x7fe80c0f55c0 2022-02-02T13:45:06.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.764+0000 7fe808ff9700 1 -- 172.21.15.33:0/1667897190 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe7fc023020 con 0x7fe80c0f55c0 2022-02-02T13:45:06.765 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:45:06.765 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:45:06.765 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:45:06.765 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:45:06.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:06.766 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:45:06.766 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:45:06.766 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:45:06.766 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:45:06.767 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:45:06.767 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:45:06.767 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:45:06.767 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:45:06.768 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:45:06.768 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:45:06.768 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:45:06.768 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:45:06.769 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:45:06.769 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:45:06.769 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:45:06.769 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:45:06.769 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:45:06.770 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:45:06.770 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:45:06.770 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:45:06.770 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:45:06.771 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:45:06.771 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:45:06.772 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:45:06.772 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:45:06.772 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:45:06.772 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:06.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:06.773 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:45:06.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:06.773 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:06.774 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:06.774 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:06.774 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:06.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 msgr2=0x7fe7f4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 0x7fe7f4067270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fe800007fc0 tx=0x7fe80000b040).stop 2022-02-02T13:45:06.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 msgr2=0x7fe80c109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:06.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fe7fc000c00 tx=0x7fe7fc00b040).stop 2022-02-02T13:45:06.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 shutdown_connections 2022-02-02T13:45:06.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe7f4064db0 0x7fe7f4067270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe80c0f55c0 0x7fe80c109bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 --2- 172.21.15.33:0/1667897190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe80c0f6860 0x7fe80c10c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:06.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 >> 172.21.15.33:0/1667897190 conn(0x7fe80c0f0d40 msgr2=0x7fe80c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:06.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 shutdown_connections 2022-02-02T13:45:06.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:06.766+0000 7fe81243e700 1 -- 172.21.15.33:0/1667897190 wait complete. 2022-02-02T13:45:06.778 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:45:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:06 smithi037 ceph-mon[69017]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:06 smithi037 ceph-mon[69017]: pgmap v137: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:06 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3322919613' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:45:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:07 smithi037 ceph-mon[69017]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:07.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1667897190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:45:07.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:07 smithi033 ceph-mon[101165]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1667897190' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:45:08.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:08 smithi033 ceph-mon[101165]: pgmap v138: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:09.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:08 smithi037 ceph-mon[69017]: pgmap v138: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:10 smithi033 ceph-mon[101165]: pgmap v139: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:10 smithi037 ceph-mon[69017]: pgmap v139: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:12 smithi033 ceph-mon[101165]: pgmap v140: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:12 smithi037 ceph-mon[69017]: pgmap v140: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:14 smithi033 ceph-mon[101165]: pgmap v141: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:14 smithi037 ceph-mon[69017]: pgmap v141: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:16 smithi033 ceph-mon[101165]: pgmap v142: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:17.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:16 smithi037 ceph-mon[69017]: pgmap v142: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:18 smithi033 ceph-mon[101165]: pgmap v143: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:18 smithi037 ceph-mon[69017]: pgmap v143: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:20 smithi033 ceph-mon[101165]: pgmap v144: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:20 smithi037 ceph-mon[69017]: pgmap v144: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:23.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:22 smithi033 ceph-mon[101165]: pgmap v145: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:22 smithi037 ceph-mon[69017]: pgmap v145: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:24 smithi033 ceph-mon[101165]: pgmap v146: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:24 smithi037 ceph-mon[69017]: pgmap v146: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:26 smithi033 ceph-mon[101165]: pgmap v147: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:26 smithi037 ceph-mon[69017]: pgmap v147: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:28 smithi033 ceph-mon[101165]: pgmap v148: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:28 smithi037 ceph-mon[69017]: pgmap v148: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:30 smithi033 ceph-mon[101165]: pgmap v149: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:30 smithi037 ceph-mon[69017]: pgmap v149: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:33.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:32 smithi033 ceph-mon[101165]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:32 smithi037 ceph-mon[69017]: pgmap v150: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:34 smithi033 ceph-mon[101165]: pgmap v151: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:34 smithi037 ceph-mon[69017]: pgmap v151: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:36.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 -- 172.21.15.33:0/1100644575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f55c0 msgr2=0x7f8f800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 --2- 172.21.15.33:0/1100644575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f55c0 0x7f8f800f59e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f8f74004660 tx=0x7f8f74009b30).stop 2022-02-02T13:45:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 -- 172.21.15.33:0/1100644575 shutdown_connections 2022-02-02T13:45:36.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 --2- 172.21.15.33:0/1100644575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f6860 0x7f8f800f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 --2- 172.21.15.33:0/1100644575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f55c0 0x7f8f800f59e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 -- 172.21.15.33:0/1100644575 >> 172.21.15.33:0/1100644575 conn(0x7f8f800f0d40 msgr2=0x7f8f800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:36.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 -- 172.21.15.33:0/1100644575 shutdown_connections 2022-02-02T13:45:36.884 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:36 smithi033 ceph-mon[101165]: pgmap v152: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:36.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.881+0000 7f8f84bae700 1 -- 172.21.15.33:0/1100644575 wait complete. 2022-02-02T13:45:36.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 Processor -- start 2022-02-02T13:45:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 -- start start 2022-02-02T13:45:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 0x7f8f80109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 0x7f8f8010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:36.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f800603e0 con 0x7f8f800f6860 2022-02-02T13:45:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f84bae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f80060520 con 0x7f8f800f55c0 2022-02-02T13:45:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f7dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 0x7f8f8010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f7dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 0x7f8f8010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57978/0 (socket says 172.21.15.33:57978) 2022-02-02T13:45:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f7dd9b700 1 -- 172.21.15.33:0/2467426575 learned_addr learned my addr 172.21.15.33:0/2467426575 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:36.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.882+0000 7f8f7e59c700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 0x7f8f80109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:36.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f7e59c700 1 -- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 msgr2=0x7f8f8010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:36.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f7e59c700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 0x7f8f8010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:36.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f7e59c700 1 -- 172.21.15.33:0/2467426575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74005040 con 0x7f8f800f55c0 2022-02-02T13:45:36.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f7e59c700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 0x7f8f80109c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8f74000c00 tx=0x7f8f74009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:36.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f74018070 con 0x7f8f800f55c0 2022-02-02T13:45:36.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8010c6c0 con 0x7f8f800f55c0 2022-02-02T13:45:36.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f740097d0 con 0x7f8f800f55c0 2022-02-02T13:45:36.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7401ddb0 con 0x7f8f800f55c0 2022-02-02T13:45:36.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.883+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8010cc20 con 0x7f8f800f55c0 2022-02-02T13:45:36.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.884+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f80045ad0 con 0x7f8f800f55c0 2022-02-02T13:45:36.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.885+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f74007ca0 con 0x7f8f800f55c0 2022-02-02T13:45:36.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.885+0000 7f8f6effd700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 0x7f8f68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:36.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.885+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8f74083670 con 0x7f8f800f55c0 2022-02-02T13:45:36.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.885+0000 7f8f7dd9b700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 0x7f8f68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:36.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.886+0000 7f8f7dd9b700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 0x7f8f68067290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f700041d0 tx=0x7f8f7000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:36.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:36.890+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f74051720 con 0x7f8f800f55c0 2022-02-02T13:45:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:36 smithi037 ceph-mon[69017]: pgmap v152: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:37.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.077+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f800fdef0 con 0x7f8f68064dd0 2022-02-02T13:45:37.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.078+0000 7f8f6effd700 1 -- 172.21.15.33:0/2467426575 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8f800fdef0 con 0x7f8f68064dd0 2022-02-02T13:45:37.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 msgr2=0x7f8f68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 0x7f8f68067290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f8f700041d0 tx=0x7f8f7000b040).stop 2022-02-02T13:45:37.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 msgr2=0x7f8f80109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 0x7f8f80109c70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f8f74000c00 tx=0x7f8f74009b30).stop 2022-02-02T13:45:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 shutdown_connections 2022-02-02T13:45:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f68064dd0 0x7f8f68067290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f800f55c0 0x7f8f80109c70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 --2- 172.21.15.33:0/2467426575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f800f6860 0x7f8f8010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 >> 172.21.15.33:0/2467426575 conn(0x7f8f800f0d40 msgr2=0x7f8f800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 shutdown_connections 2022-02-02T13:45:37.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.080+0000 7f8f84bae700 1 -- 172.21.15.33:0/2467426575 wait complete. 2022-02-02T13:45:37.091 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:45:37.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 -- 172.21.15.33:0/371973119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f6860 msgr2=0x7ff0b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/371973119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f6860 0x7ff0b40f6cc0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff0a8004660 tx=0x7ff0a8009b30).stop 2022-02-02T13:45:37.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 -- 172.21.15.33:0/371973119 shutdown_connections 2022-02-02T13:45:37.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/371973119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f6860 0x7ff0b40f6cc0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/371973119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f55c0 0x7ff0b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.182+0000 7ff0ba24a700 1 -- 172.21.15.33:0/371973119 >> 172.21.15.33:0/371973119 conn(0x7ff0b40f0d40 msgr2=0x7ff0b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.183+0000 7ff0ba24a700 1 -- 172.21.15.33:0/371973119 shutdown_connections 2022-02-02T13:45:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.183+0000 7ff0ba24a700 1 -- 172.21.15.33:0/371973119 wait complete. 2022-02-02T13:45:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 Processor -- start 2022-02-02T13:45:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 -- start start 2022-02-02T13:45:37.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 0x7ff0b410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b40603c0 con 0x7ff0b40f55c0 2022-02-02T13:45:37.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0ba24a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b4060500 con 0x7ff0b40f6860 2022-02-02T13:45:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57986/0 (socket says 172.21.15.33:57986) 2022-02-02T13:45:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.184+0000 7ff0b37fe700 1 -- 172.21.15.33:0/1828393191 learned_addr learned my addr 172.21.15.33:0/1828393191 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:37.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b2ffd700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 0x7ff0b410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b37fe700 1 -- 172.21.15.33:0/1828393191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 msgr2=0x7ff0b410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b37fe700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 0x7ff0b410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b37fe700 1 -- 172.21.15.33:0/1828393191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8005040 con 0x7ff0b40f55c0 2022-02-02T13:45:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b2ffd700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 0x7ff0b410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:45:37.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0b37fe700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff0a400c530 tx=0x7ff0a4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a400f650 con 0x7ff0b40f55c0 2022-02-02T13:45:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b410c720 con 0x7ff0b40f55c0 2022-02-02T13:45:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff0a400fc60 con 0x7ff0b40f55c0 2022-02-02T13:45:37.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a4012d20 con 0x7ff0b40f55c0 2022-02-02T13:45:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.185+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b410ccb0 con 0x7ff0b40f55c0 2022-02-02T13:45:37.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.186+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b4045ad0 con 0x7ff0b40f55c0 2022-02-02T13:45:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.187+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff0a4019030 con 0x7ff0b40f55c0 2022-02-02T13:45:37.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.187+0000 7ff09bfff700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 0x7ff09c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.188+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff0a4081710 con 0x7ff0b40f55c0 2022-02-02T13:45:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.188+0000 7ff0b2ffd700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 0x7ff09c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.188+0000 7ff0b2ffd700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 0x7ff09c067290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff0a8004e30 tx=0x7ff0a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.192+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff0a404f810 con 0x7ff0b40f55c0 2022-02-02T13:45:37.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.374+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b40fdef0 con 0x7ff09c064dd0 2022-02-02T13:45:37.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.389+0000 7ff09bfff700 1 -- 172.21.15.33:0/1828393191 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff0b40fdef0 con 0x7ff09c064dd0 2022-02-02T13:45:37.389 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:45:37.389 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (10m) 3m ago 11m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:45:37.390 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (3m) 3m ago 11m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:45:37.390 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (3m) 3m ago 11m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:45:37.390 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (10m) 3m ago 11m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:45:37.390 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (4m) 3m ago 8m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:45:37.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (5m) 3m ago 8m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:45:37.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (5m) 3m ago 8m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:45:37.391 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (8m) 3m ago 8m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:45:37.391 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (5m) 3m ago 13m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:45:37.392 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (5m) 3m ago 11m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:45:37.392 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (4m) 3m ago 13m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:45:37.392 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (4m) 3m ago 11m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:45:37.392 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (11m) 3m ago 11m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:45:37.393 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (11m) 3m ago 11m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:45:37.393 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (10m) 3m ago 10m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:45:37.393 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (10m) 3m ago 10m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:45:37.394 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (10m) 3m ago 10m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:45:37.394 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (9m) 3m ago 9m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:45:37.394 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (9m) 3m ago 9m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:45:37.394 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (9m) 3m ago 9m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:45:37.394 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (10m) 3m ago 11m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:45:37.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 msgr2=0x7ff09c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 0x7ff09c067290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7ff0a8004e30 tx=0x7ff0a8009b30).stop 2022-02-02T13:45:37.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 msgr2=0x7ff0b4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff0a400c530 tx=0x7ff0a4007e10).stop 2022-02-02T13:45:37.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 shutdown_connections 2022-02-02T13:45:37.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff09c064dd0 0x7ff09c067290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0b40f55c0 0x7ff0b4109c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 --2- 172.21.15.33:0/1828393191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0b40f6860 0x7ff0b410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 >> 172.21.15.33:0/1828393191 conn(0x7ff0b40f0d40 msgr2=0x7ff0b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 shutdown_connections 2022-02-02T13:45:37.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.391+0000 7ff0ba24a700 1 -- 172.21.15.33:0/1828393191 wait complete. 2022-02-02T13:45:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1674343555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f77d0 msgr2=0x7fdb7c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1674343555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c0f7c30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fdb70004660 tx=0x7fdb70009b30).stop 2022-02-02T13:45:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1674343555 shutdown_connections 2022-02-02T13:45:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1674343555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c0f7c30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1674343555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1674343555 >> 172.21.15.33:0/1674343555 conn(0x7fdb7c0f1c90 msgr2=0x7fdb7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1674343555 shutdown_connections 2022-02-02T13:45:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1674343555 wait complete. 2022-02-02T13:45:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 Processor -- start 2022-02-02T13:45:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.492+0000 7fdb7b59e700 1 -- start start 2022-02-02T13:45:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c107830 con 0x7fdb7c0f6530 2022-02-02T13:45:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7c108040 con 0x7fdb7c0f77d0 2022-02-02T13:45:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57994/0 (socket says 172.21.15.33:57994) 2022-02-02T13:45:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 -- 172.21.15.33:0/1685558017 learned_addr learned my addr 172.21.15.33:0/1685558017 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb79d9b700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 -- 172.21.15.33:0/1685558017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f77d0 msgr2=0x7fdb7c107230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c107230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 -- 172.21.15.33:0/1685558017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb70005040 con 0x7fdb7c0f6530 2022-02-02T13:45:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb7a59c700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdb6c00e7c0 tx=0x7fdb6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.493+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c0092e0 con 0x7fdb7c0f6530 2022-02-02T13:45:37.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.494+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb7c1082c0 con 0x7fdb7c0f6530 2022-02-02T13:45:37.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.494+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb6c00f040 con 0x7fdb7c0f6530 2022-02-02T13:45:37.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.494+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c0147e0 con 0x7fdb7c0f6530 2022-02-02T13:45:37.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.494+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c108880 con 0x7fdb7c0f6530 2022-02-02T13:45:37.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.495+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c059100 con 0x7fdb7c0f6530 2022-02-02T13:45:37.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.496+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdb6c01b030 con 0x7fdb7c0f6530 2022-02-02T13:45:37.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.496+0000 7fdb6affd700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 0x7fdb640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.496+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdb6c0817e0 con 0x7fdb7c0f6530 2022-02-02T13:45:37.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.496+0000 7fdb79d9b700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 0x7fdb640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.497+0000 7fdb79d9b700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 0x7fdb640672e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fdb70005010 tx=0x7fdb70016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.500+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb6c04f940 con 0x7fdb7c0f6530 2022-02-02T13:45:37.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.743+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdb7c0fedb0 con 0x7fdb7c0f6530 2022-02-02T13:45:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.744+0000 7fdb6affd700 1 -- 172.21.15.33:0/1685558017 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fdb6c052f60 con 0x7fdb7c0f6530 2022-02-02T13:45:37.745 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:45:37.746 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:45:37.746 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:45:37.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:37.747 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:45:37.747 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:45:37.747 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:37.747 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:45:37.747 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:45:37.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:37.748 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:45:37.748 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:45:37.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:45:37.749 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:45:37.749 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:45:37.749 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:45:37.750 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:45:37.750 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:45:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 msgr2=0x7fdb640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 0x7fdb640672e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fdb70005010 tx=0x7fdb70016040).stop 2022-02-02T13:45:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 msgr2=0x7fdb7c106d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fdb6c00e7c0 tx=0x7fdb6c00b040).stop 2022-02-02T13:45:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 shutdown_connections 2022-02-02T13:45:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb64064e20 0x7fdb640672e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb7c0f6530 0x7fdb7c106d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 --2- 172.21.15.33:0/1685558017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7c0f77d0 0x7fdb7c107230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 >> 172.21.15.33:0/1685558017 conn(0x7fdb7c0f1c90 msgr2=0x7fdb7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 shutdown_connections 2022-02-02T13:45:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.746+0000 7fdb7b59e700 1 -- 172.21.15.33:0/1685558017 wait complete. 2022-02-02T13:45:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 -- 172.21.15.33:0/2584241315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f55c0 msgr2=0x7f947c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 --2- 172.21.15.33:0/2584241315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f55c0 0x7f947c0f59e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f946c004660 tx=0x7f946c009b30).stop 2022-02-02T13:45:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 -- 172.21.15.33:0/2584241315 shutdown_connections 2022-02-02T13:45:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 --2- 172.21.15.33:0/2584241315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f6860 0x7f947c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 --2- 172.21.15.33:0/2584241315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f55c0 0x7f947c0f59e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 -- 172.21.15.33:0/2584241315 >> 172.21.15.33:0/2584241315 conn(0x7f947c0f0d40 msgr2=0x7f947c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 -- 172.21.15.33:0/2584241315 shutdown_connections 2022-02-02T13:45:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.848+0000 7f9482017700 1 -- 172.21.15.33:0/2584241315 wait complete. 2022-02-02T13:45:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 Processor -- start 2022-02-02T13:45:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 -- start start 2022-02-02T13:45:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f55c0 0x7f947c105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1069a0 con 0x7f947c0f6860 2022-02-02T13:45:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f9482017700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c1071b0 con 0x7f947c0f55c0 2022-02-02T13:45:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f947affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f947affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58006/0 (socket says 172.21.15.33:58006) 2022-02-02T13:45:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f947affd700 1 -- 172.21.15.33:0/774395924 learned_addr learned my addr 172.21.15.33:0/774395924 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:45:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.849+0000 7f947b7fe700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f55c0 0x7f947c105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f947affd700 1 -- 172.21.15.33:0/774395924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f55c0 msgr2=0x7f947c105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f947affd700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f55c0 0x7f947c105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f947affd700 1 -- 172.21.15.33:0/774395924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c005040 con 0x7f947c0f6860 2022-02-02T13:45:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f947affd700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f947000e7f0 tx=0x7f947000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94700092e0 con 0x7f947c0f6860 2022-02-02T13:45:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c107430 con 0x7f947c0f6860 2022-02-02T13:45:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f947000f040 con 0x7f947c0f6860 2022-02-02T13:45:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9470014750 con 0x7f947c0f6860 2022-02-02T13:45:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.850+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c1079f0 con 0x7f947c0f6860 2022-02-02T13:45:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.851+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c0f49b0 con 0x7f947c0f6860 2022-02-02T13:45:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.852+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f947001b030 con 0x7f947c0f6860 2022-02-02T13:45:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.852+0000 7f9463fff700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 0x7f9464067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:45:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.852+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9470081770 con 0x7f947c0f6860 2022-02-02T13:45:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.852+0000 7f947b7fe700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 0x7f9464067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:45:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.853+0000 7f947b7fe700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 0x7f9464067290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f946c000c00 tx=0x7f946c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:45:37.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:37.856+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f947004f8d0 con 0x7f947c0f6860 2022-02-02T13:45:38.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.067+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f947c0fdf10 con 0x7f947c0f6860 2022-02-02T13:45:38.067 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:37 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1685558017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:45:38.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.067+0000 7f9463fff700 1 -- 172.21.15.33:0/774395924 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f947c0fdf10 con 0x7f947c0f6860 2022-02-02T13:45:38.068 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:45:38.069 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:45:38.069 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:45:38.069 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:45:38.069 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:38.070 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:45:38.070 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:45:38.070 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:45:38.070 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:45:38.070 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:45:38.071 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:45:38.071 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:45:38.071 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:45:38.071 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:45:38.072 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:45:38.072 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:45:38.072 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:45:38.072 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:45:38.072 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:45:38.073 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:45:38.073 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:45:38.073 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:45:38.073 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:45:38.074 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:45:38.074 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:45:38.074 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:45:38.074 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:45:38.075 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:45:38.075 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:45:38.075 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:45:38.075 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:45:38.075 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:38.076 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:38.076 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:45:38.076 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:45:38.076 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:38.077 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:38.077 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:38.077 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:45:38.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 msgr2=0x7f9464067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:38.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 0x7f9464067290 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f946c000c00 tx=0x7f946c00b040).stop 2022-02-02T13:45:38.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 msgr2=0x7f947c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:45:38.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f947000e7f0 tx=0x7f947000b040).stop 2022-02-02T13:45:38.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 shutdown_connections 2022-02-02T13:45:38.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9464064dd0 0x7f9464067290 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:38.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f947c0f55c0 0x7f947c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:38.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 --2- 172.21.15.33:0/774395924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f947c0f6860 0x7f947c1063a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:45:38.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 >> 172.21.15.33:0/774395924 conn(0x7f947c0f0d40 msgr2=0x7f947c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:45:38.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 shutdown_connections 2022-02-02T13:45:38.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:45:38.069+0000 7f9482017700 1 -- 172.21.15.33:0/774395924 wait complete. 2022-02-02T13:45:38.081 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:45:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:37 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1685558017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:45:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:38 smithi033 ceph-mon[101165]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:38 smithi033 ceph-mon[101165]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:38 smithi033 ceph-mon[101165]: pgmap v153: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/774395924' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:45:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:38 smithi037 ceph-mon[69017]: from='client.44225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:39.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:38 smithi037 ceph-mon[69017]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:45:39.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:38 smithi037 ceph-mon[69017]: pgmap v153: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:39.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/774395924' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:45:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:40 smithi033 ceph-mon[101165]: pgmap v154: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:40 smithi037 ceph-mon[69017]: pgmap v154: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:42 smithi033 ceph-mon[101165]: pgmap v155: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:42 smithi037 ceph-mon[69017]: pgmap v155: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:44 smithi033 ceph-mon[101165]: pgmap v156: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:44 smithi037 ceph-mon[69017]: pgmap v156: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:46.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:46 smithi037 ceph-mon[69017]: pgmap v157: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:46 smithi033 ceph-mon[101165]: pgmap v157: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:48 smithi033 ceph-mon[101165]: pgmap v158: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:48 smithi037 ceph-mon[69017]: pgmap v158: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:51.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:50 smithi033 ceph-mon[101165]: pgmap v159: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:50 smithi037 ceph-mon[69017]: pgmap v159: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:52 smithi033 ceph-mon[101165]: pgmap v160: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:52 smithi037 ceph-mon[69017]: pgmap v160: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:54 smithi033 ceph-mon[101165]: pgmap v161: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:45:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:45:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:54 smithi037 ceph-mon[69017]: pgmap v161: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:45:55.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:45:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:56 smithi033 ceph-mon[101165]: pgmap v162: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:56 smithi037 ceph-mon[69017]: pgmap v162: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:45:58 smithi033 ceph-mon[101165]: pgmap v163: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:45:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:45:58 smithi037 ceph-mon[69017]: pgmap v163: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:00 smithi033 ceph-mon[101165]: pgmap v164: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:00 smithi037 ceph-mon[69017]: pgmap v164: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:02 smithi033 ceph-mon[101165]: pgmap v165: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:02 smithi037 ceph-mon[69017]: pgmap v165: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:03 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:46:04.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:03 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:46:04.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:03 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:46:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:03 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:46:04.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:03 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:46:04.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:03 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:46:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:04 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:04 smithi033 ceph-mon[101165]: pgmap v166: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:46:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:04 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:46:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:04 smithi037 ceph-mon[69017]: pgmap v166: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:46:06.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:06 smithi033 ceph-mon[101165]: pgmap v167: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:06 smithi037 ceph-mon[69017]: pgmap v167: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:08.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 -- 172.21.15.33:0/1525382905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 msgr2=0x7f59f40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 --2- 172.21.15.33:0/1525382905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f40f6b30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f59e4004660 tx=0x7f59e4009b30).stop 2022-02-02T13:46:08.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 -- 172.21.15.33:0/1525382905 shutdown_connections 2022-02-02T13:46:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 --2- 172.21.15.33:0/1525382905 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f40f6b30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 --2- 172.21.15.33:0/1525382905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 0x7f59f40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 -- 172.21.15.33:0/1525382905 >> 172.21.15.33:0/1525382905 conn(0x7f59f40f0b90 msgr2=0x7f59f40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:08.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 -- 172.21.15.33:0/1525382905 shutdown_connections 2022-02-02T13:46:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 -- 172.21.15.33:0/1525382905 wait complete. 2022-02-02T13:46:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.187+0000 7f59f359e700 1 Processor -- start 2022-02-02T13:46:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f359e700 1 -- start start 2022-02-02T13:46:08.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 0x7f59f4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f4107870 con 0x7f59f40f66d0 2022-02-02T13:46:08.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41080b0 con 0x7f59f40f5430 2022-02-02T13:46:08.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58016/0 (socket says 172.21.15.33:58016) 2022-02-02T13:46:08.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 -- 172.21.15.33:0/1819493198 learned_addr learned my addr 172.21.15.33:0/1819493198 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:08.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f259c700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 0x7f59f4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 -- 172.21.15.33:0/1819493198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 msgr2=0x7f59f4106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 0x7f59f4106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 -- 172.21.15.33:0/1819493198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e4005040 con 0x7f59f40f66d0 2022-02-02T13:46:08.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.188+0000 7f59f1d9b700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f59e4009990 tx=0x7f59e4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.189+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e4018070 con 0x7f59f40f66d0 2022-02-02T13:46:08.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.189+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f4108330 con 0x7f59f40f66d0 2022-02-02T13:46:08.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.189+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f59e4007ba0 con 0x7f59f40f66d0 2022-02-02T13:46:08.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.189+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59e401c620 con 0x7f59f40f66d0 2022-02-02T13:46:08.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.189+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f4108810 con 0x7f59f40f66d0 2022-02-02T13:46:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.190+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f4059100 con 0x7f59f40f66d0 2022-02-02T13:46:08.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.190+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f59e401c8e0 con 0x7f59f40f66d0 2022-02-02T13:46:08.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.191+0000 7f59e2ffd700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 0x7f59dc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.191+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f59e40838a0 con 0x7f59f40f66d0 2022-02-02T13:46:08.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.191+0000 7f59f259c700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 0x7f59dc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.191+0000 7f59f259c700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 0x7f59dc0672e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f59f4107b40 tx=0x7f59e8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.195+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f59e4051950 con 0x7f59f40f66d0 2022-02-02T13:46:08.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.386+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f59f40fdda0 con 0x7f59dc064e20 2022-02-02T13:46:08.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.387+0000 7f59e2ffd700 1 -- 172.21.15.33:0/1819493198 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f59e8004780 con 0x7f59dc064e20 2022-02-02T13:46:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 msgr2=0x7f59dc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 0x7f59dc0672e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f59f4107b40 tx=0x7f59e8009040).stop 2022-02-02T13:46:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 msgr2=0x7f59f4107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f59e4009990 tx=0x7f59e4009b30).stop 2022-02-02T13:46:08.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 shutdown_connections 2022-02-02T13:46:08.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f59dc064e20 0x7f59dc0672e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f40f5430 0x7f59f4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 --2- 172.21.15.33:0/1819493198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f59f40f66d0 0x7f59f4107270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 >> 172.21.15.33:0/1819493198 conn(0x7f59f40f0b90 msgr2=0x7f59f405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 shutdown_connections 2022-02-02T13:46:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.389+0000 7f59f359e700 1 -- 172.21.15.33:0/1819493198 wait complete. 2022-02-02T13:46:08.399 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:46:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.490+0000 7fecbb59e700 1 -- 172.21.15.33:0/3854229990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 msgr2=0x7fecbc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.490+0000 7fecbb59e700 1 --2- 172.21.15.33:0/3854229990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc0f5850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fecac004660 tx=0x7fecac009b30).stop 2022-02-02T13:46:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 -- 172.21.15.33:0/3854229990 shutdown_connections 2022-02-02T13:46:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 --2- 172.21.15.33:0/3854229990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 0x7fecbc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 --2- 172.21.15.33:0/3854229990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc0f5850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 -- 172.21.15.33:0/3854229990 >> 172.21.15.33:0/3854229990 conn(0x7fecbc0f0b90 msgr2=0x7fecbc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 -- 172.21.15.33:0/3854229990 shutdown_connections 2022-02-02T13:46:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 -- 172.21.15.33:0/3854229990 wait complete. 2022-02-02T13:46:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 Processor -- start 2022-02-02T13:46:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.491+0000 7fecbb59e700 1 -- start start 2022-02-02T13:46:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecbb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecbb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 0x7fecbc109410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecbb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc1099c0 con 0x7fecbc0f5430 2022-02-02T13:46:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecbb59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc109b00 con 0x7fecbc0f66d0 2022-02-02T13:46:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58024/0 (socket says 172.21.15.33:58024) 2022-02-02T13:46:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 -- 172.21.15.33:0/731101851 learned_addr learned my addr 172.21.15.33:0/731101851 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecb9d9b700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 0x7fecbc109410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 -- 172.21.15.33:0/731101851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 msgr2=0x7fecbc109410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 0x7fecbc109410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 -- 172.21.15.33:0/731101851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecac005040 con 0x7fecbc0f5430 2022-02-02T13:46:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecba59c700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fecac014040 tx=0x7fecac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.492+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecac019070 con 0x7fecbc0f5430 2022-02-02T13:46:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.493+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc10a440 con 0x7fecbc0f5430 2022-02-02T13:46:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.493+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc10a9a0 con 0x7fecbc0f5430 2022-02-02T13:46:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.493+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecac007e70 con 0x7fecbc0f5430 2022-02-02T13:46:08.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.493+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecac014d50 con 0x7fecbc0f5430 2022-02-02T13:46:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.494+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc045ad0 con 0x7fecbc0f5430 2022-02-02T13:46:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.494+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fecac025070 con 0x7fecbc0f5430 2022-02-02T13:46:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.495+0000 7fecaaffd700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.495+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fecac082d70 con 0x7fecbc0f5430 2022-02-02T13:46:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.495+0000 7fecb9d9b700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.495+0000 7fecb9d9b700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 0x7feca40672e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fecb0007f80 tx=0x7fecb000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.499+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fecac0548d0 con 0x7fecbc0f5430 2022-02-02T13:46:08.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.680+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fecbc0fa910 con 0x7feca4064e20 2022-02-02T13:46:08.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.694+0000 7fecaaffd700 1 -- 172.21.15.33:0/731101851 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fecbc0fa910 con 0x7feca4064e20 2022-02-02T13:46:08.695 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:46:08.695 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (11m) 4m ago 12m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:46:08.696 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 4m ago 12m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:46:08.696 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (4m) 4m ago 11m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:46:08.696 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (11m) 4m ago 12m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:46:08.696 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (4m) 4m ago 8m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:46:08.696 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (5m) 4m ago 8m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:46:08.697 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (6m) 4m ago 8m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:46:08.697 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (8m) 4m ago 8m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:46:08.697 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (6m) 4m ago 13m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:46:08.697 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (5m) 4m ago 11m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:46:08.698 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 4m ago 13m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:46:08.698 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (5m) 4m ago 11m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:46:08.698 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (12m) 4m ago 12m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:46:08.698 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (11m) 4m ago 11m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:46:08.699 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (11m) 4m ago 11m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:46:08.699 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (10m) 4m ago 10m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:46:08.699 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (10m) 4m ago 10m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:46:08.699 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (10m) 4m ago 10m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:46:08.699 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (10m) 4m ago 10m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:46:08.700 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (9m) 4m ago 9m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:46:08.700 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (11m) 4m ago 12m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:46:08.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 msgr2=0x7feca40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 0x7feca40672e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fecb0007f80 tx=0x7fecb000b040).stop 2022-02-02T13:46:08.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 msgr2=0x7fecbc108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fecac014040 tx=0x7fecac00b040).stop 2022-02-02T13:46:08.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 shutdown_connections 2022-02-02T13:46:08.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feca4064e20 0x7feca40672e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecbc0f5430 0x7fecbc108f20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 --2- 172.21.15.33:0/731101851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecbc0f66d0 0x7fecbc109410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 >> 172.21.15.33:0/731101851 conn(0x7fecbc0f0b90 msgr2=0x7fecbc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:08.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 shutdown_connections 2022-02-02T13:46:08.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.696+0000 7fecbb59e700 1 -- 172.21.15.33:0/731101851 wait complete. 2022-02-02T13:46:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 -- 172.21.15.33:0/1346743070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 msgr2=0x7f80d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 --2- 172.21.15.33:0/1346743070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d40f6cc0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f80bc004660 tx=0x7f80bc009b30).stop 2022-02-02T13:46:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 -- 172.21.15.33:0/1346743070 shutdown_connections 2022-02-02T13:46:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 --2- 172.21.15.33:0/1346743070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d40f6cc0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 --2- 172.21.15.33:0/1346743070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 -- 172.21.15.33:0/1346743070 >> 172.21.15.33:0/1346743070 conn(0x7f80d40f0d40 msgr2=0x7f80d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:08.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 -- 172.21.15.33:0/1346743070 shutdown_connections 2022-02-02T13:46:08.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.798+0000 7f80d8a90700 1 -- 172.21.15.33:0/1346743070 wait complete. 2022-02-02T13:46:08.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 Processor -- start 2022-02-02T13:46:08.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 -- start start 2022-02-02T13:46:08.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d40603c0 con 0x7f80d40f6860 2022-02-02T13:46:08.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d8a90700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d4060500 con 0x7f80d40f55c0 2022-02-02T13:46:08.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.799+0000 7f80d259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:40516/0 (socket says 172.21.15.33:40516) 2022-02-02T13:46:08.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 -- 172.21.15.33:0/68807382 learned_addr learned my addr 172.21.15.33:0/68807382 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:08.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d1d9b700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 -- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 msgr2=0x7f80d410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:08.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:08.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 -- 172.21.15.33:0/68807382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc005040 con 0x7f80d40f55c0 2022-02-02T13:46:08.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d259c700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f80c400c790 tx=0x7f80c4007d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c4013630 con 0x7f80d40f55c0 2022-02-02T13:46:08.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d410c720 con 0x7f80d40f55c0 2022-02-02T13:46:08.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80c4012860 con 0x7f80d40f55c0 2022-02-02T13:46:08.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c4002780 con 0x7f80d40f55c0 2022-02-02T13:46:08.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.800+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d410ccb0 con 0x7f80d40f55c0 2022-02-02T13:46:08.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.801+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d40f49b0 con 0x7f80d40f55c0 2022-02-02T13:46:08.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.802+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80c4010070 con 0x7f80d40f55c0 2022-02-02T13:46:08.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.802+0000 7f80caffd700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 0x7f80c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:08.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.802+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f80c4081b50 con 0x7f80d40f55c0 2022-02-02T13:46:08.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.802+0000 7f80d1d9b700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 0x7f80c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:08.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.803+0000 7f80d1d9b700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 0x7f80c0067290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f80bc004630 tx=0x7f80bc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:08.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:08.807+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80c404fba0 con 0x7f80d40f55c0 2022-02-02T13:46:09.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.056+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80d40fde50 con 0x7f80d40f55c0 2022-02-02T13:46:09.057 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:08 smithi033 ceph-mon[101165]: pgmap v168: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:09.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.057+0000 7f80caffd700 1 -- 172.21.15.33:0/68807382 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f80c40531c0 con 0x7f80d40f55c0 2022-02-02T13:46:09.059 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:46:09.059 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:46:09.059 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:46:09.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:09.060 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:46:09.060 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:46:09.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:09.061 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:46:09.061 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:46:09.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:09.062 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:46:09.062 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:46:09.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:09.062 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:46:09.063 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:46:09.063 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:46:09.063 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:46:09.063 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:46:09.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.059+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 msgr2=0x7f80c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.059+0000 7f80d8a90700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 0x7f80c0067290 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f80bc004630 tx=0x7f80bc009b30).stop 2022-02-02T13:46:09.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.059+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 msgr2=0x7f80d4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.059+0000 7f80d8a90700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f80c400c790 tx=0x7f80c4007d90).stop 2022-02-02T13:46:09.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 shutdown_connections 2022-02-02T13:46:09.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80c0064dd0 0x7f80c0067290 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80d40f55c0 0x7f80d4109c70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 --2- 172.21.15.33:0/68807382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80d40f6860 0x7f80d410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 >> 172.21.15.33:0/68807382 conn(0x7f80d40f0d40 msgr2=0x7f80d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:09.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 shutdown_connections 2022-02-02T13:46:09.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.060+0000 7f80d8a90700 1 -- 172.21.15.33:0/68807382 wait complete. 2022-02-02T13:46:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 -- 172.21.15.33:0/3829677533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 msgr2=0x7fd9a80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 --2- 172.21.15.33:0/3829677533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a80f59e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fd9a4004660 tx=0x7fd9a4009b30).stop 2022-02-02T13:46:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 -- 172.21.15.33:0/3829677533 shutdown_connections 2022-02-02T13:46:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 --2- 172.21.15.33:0/3829677533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 0x7fd9a80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 --2- 172.21.15.33:0/3829677533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a80f59e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 -- 172.21.15.33:0/3829677533 >> 172.21.15.33:0/3829677533 conn(0x7fd9a80f0d40 msgr2=0x7fd9a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 -- 172.21.15.33:0/3829677533 shutdown_connections 2022-02-02T13:46:09.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.162+0000 7fd9b0029700 1 -- 172.21.15.33:0/3829677533 wait complete. 2022-02-02T13:46:09.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 Processor -- start 2022-02-02T13:46:09.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 -- start start 2022-02-02T13:46:09.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:09.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 0x7fd9a810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:09.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80603e0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9b0029700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8060520 con 0x7fd9a80f6860 2022-02-02T13:46:09.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:09.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58042/0 (socket says 172.21.15.33:58042) 2022-02-02T13:46:09.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 -- 172.21.15.33:0/2010705568 learned_addr learned my addr 172.21.15.33:0/2010705568 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:09.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9ad5c4700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 0x7fd9a810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:09.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 -- 172.21.15.33:0/2010705568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 msgr2=0x7fd9a810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 0x7fd9a810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.163+0000 7fd9addc5700 1 -- 172.21.15.33:0/2010705568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4005040 con 0x7fd9a80f55c0 2022-02-02T13:46:09.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd9addc5700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd9a4013a70 tx=0x7fd9a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:09.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a4018070 con 0x7fd9a80f55c0 2022-02-02T13:46:09.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a810c6c0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9a40097d0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a401de80 con 0x7fd9a80f55c0 2022-02-02T13:46:09.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.164+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a810cc20 con 0x7fd9a80f55c0 2022-02-02T13:46:09.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.165+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a8045ad0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.165+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9a4007ba0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.166+0000 7fd99a7fc700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 0x7fd994067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:09.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.166+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd9a40836b0 con 0x7fd9a80f55c0 2022-02-02T13:46:09.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.166+0000 7fd9ad5c4700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 0x7fd994067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:09.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.166+0000 7fd9ad5c4700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 0x7fd994067290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd99c004c40 tx=0x7fd99c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:09.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.170+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9a4051760 con 0x7fd9a80f55c0 2022-02-02T13:46:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:08 smithi037 ceph-mon[69017]: pgmap v168: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:09.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.386+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9a80fde50 con 0x7fd9a80f55c0 2022-02-02T13:46:09.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.387+0000 7fd99a7fc700 1 -- 172.21.15.33:0/2010705568 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd9a4054d80 con 0x7fd9a80f55c0 2022-02-02T13:46:09.388 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:46:09.388 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:46:09.388 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:46:09.389 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:46:09.389 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:09.389 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:46:09.389 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:46:09.390 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:46:09.390 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:46:09.390 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:46:09.390 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:46:09.391 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:46:09.391 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:46:09.391 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:46:09.391 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:46:09.391 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:46:09.392 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:46:09.392 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:46:09.392 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:46:09.392 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:46:09.393 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:46:09.393 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:46:09.393 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:46:09.393 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:46:09.393 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:46:09.394 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:46:09.394 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:46:09.394 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:46:09.394 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:46:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:46:09.395 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:46:09.396 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:09.396 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:09.396 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:46:09.396 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:09.396 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:09.397 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:09.397 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:09.397 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:09.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 msgr2=0x7fd994067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 0x7fd994067290 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fd99c004c40 tx=0x7fd99c00b040).stop 2022-02-02T13:46:09.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 msgr2=0x7fd9a8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:09.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd9a4013a70 tx=0x7fd9a4009b30).stop 2022-02-02T13:46:09.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 shutdown_connections 2022-02-02T13:46:09.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd994064dd0 0x7fd994067290 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9a80f55c0 0x7fd9a8109c70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 --2- 172.21.15.33:0/2010705568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9a80f6860 0x7fd9a810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:09.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 >> 172.21.15.33:0/2010705568 conn(0x7fd9a80f0d40 msgr2=0x7fd9a80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:09.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 shutdown_connections 2022-02-02T13:46:09.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:09.389+0000 7fd9b0029700 1 -- 172.21.15.33:0/2010705568 wait complete. 2022-02-02T13:46:09.402 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:46:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:09 smithi033 ceph-mon[101165]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:09 smithi033 ceph-mon[101165]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/68807382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:46:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2010705568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:46:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:09 smithi037 ceph-mon[69017]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:09 smithi037 ceph-mon[69017]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/68807382' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:46:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2010705568' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:46:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:10 smithi033 ceph-mon[101165]: pgmap v169: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:10 smithi037 ceph-mon[69017]: pgmap v169: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:12.317 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:11 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-02-02T13:46:12.741 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:12 smithi033 podman[112125]: 2022-02-02T13:46:13.212 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:12 smithi033 ceph-mon[101165]: pgmap v170: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:12 smithi037 ceph-mon[69017]: pgmap v170: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:13.490 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:13 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:46:13.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:13 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:46:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:14 smithi033 ceph-mon[101165]: pgmap v171: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:14 smithi037 ceph-mon[69017]: pgmap v171: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:16 smithi033 ceph-mon[101165]: pgmap v172: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:17.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:16 smithi037 ceph-mon[69017]: pgmap v172: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:18 smithi033 ceph-mon[101165]: pgmap v173: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:18 smithi037 ceph-mon[69017]: pgmap v173: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:20 smithi033 ceph-mon[101165]: pgmap v174: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:20 smithi037 ceph-mon[69017]: pgmap v174: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:22 smithi033 ceph-mon[101165]: pgmap v175: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:22 smithi037 ceph-mon[69017]: pgmap v175: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:23.664 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-02-02T13:46:23.665 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 2. 2022-02-02T13:46:23.665 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:46:23.665 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111126 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.665 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.666 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111327 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.666 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.666 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111367 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.666 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.667 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: Starting Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:46:23.667 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111126 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.667 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.667 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111327 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.668 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.668 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 111367 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:46:23.668 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:46:23.990 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:23 smithi033 bash[112245]: c51a7b7b15aec4f0d802f021e46cd742dd1727b29104e427c80a78b8b90e6c2f 2022-02-02T13:46:24.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:24 smithi033 podman[112447]: 2022-02-02T13:46:25.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:24 smithi033 ceph-mon[101165]: pgmap v176: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:25.241 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:46:24 smithi033 bash[111126]: time="2022-02-02T13:46:24Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-02-02T13:46:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:24 smithi037 ceph-mon[69017]: pgmap v176: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:26 smithi033 ceph-mon[101165]: pgmap v177: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:26 smithi037 ceph-mon[69017]: pgmap v177: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:28 smithi033 ceph-mon[101165]: pgmap v178: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:28 smithi037 ceph-mon[69017]: pgmap v178: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:30 smithi033 ceph-mon[101165]: pgmap v179: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:30 smithi037 ceph-mon[69017]: pgmap v179: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:32 smithi033 ceph-mon[101165]: pgmap v180: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:32 smithi037 ceph-mon[69017]: pgmap v180: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:34 smithi033 ceph-mon[101165]: pgmap v181: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:34 smithi037 ceph-mon[69017]: pgmap v181: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:36 smithi033 ceph-mon[101165]: pgmap v182: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:36 smithi037 ceph-mon[69017]: pgmap v182: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:38 smithi033 ceph-mon[101165]: pgmap v183: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:38 smithi037 ceph-mon[69017]: pgmap v183: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:39.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- 172.21.15.33:0/3837397180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 msgr2=0x7ff9e00f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:39.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/3837397180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e00f9340 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ff9dc004660 tx=0x7ff9dc009b30).stop 2022-02-02T13:46:39.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- 172.21.15.33:0/3837397180 shutdown_connections 2022-02-02T13:46:39.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/3837397180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 0x7ff9e00fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/3837397180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e00f9340 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- 172.21.15.33:0/3837397180 >> 172.21.15.33:0/3837397180 conn(0x7ff9e00f0d40 msgr2=0x7ff9e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- 172.21.15.33:0/3837397180 shutdown_connections 2022-02-02T13:46:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- 172.21.15.33:0/3837397180 wait complete. 2022-02-02T13:46:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 Processor -- start 2022-02-02T13:46:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.508+0000 7ff9e86f4700 1 -- start start 2022-02-02T13:46:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e86f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e86f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 0x7ff9e0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e86f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0107a00 con 0x7ff9e0060270 2022-02-02T13:46:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e86f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e0107b40 con 0x7ff9e00f9830 2022-02-02T13:46:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58052/0 (socket says 172.21.15.33:58052) 2022-02-02T13:46:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 -- 172.21.15.33:0/2780936914 learned_addr learned my addr 172.21.15.33:0/2780936914 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e5c8f700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 0x7ff9e0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 -- 172.21.15.33:0/2780936914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 msgr2=0x7ff9e0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 0x7ff9e0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 -- 172.21.15.33:0/2780936914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc005040 con 0x7ff9e0060270 2022-02-02T13:46:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9e6490700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff9dc009990 tx=0x7ff9dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.509+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc018070 con 0x7ff9e0060270 2022-02-02T13:46:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.510+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9dc007c70 con 0x7ff9e0060270 2022-02-02T13:46:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.510+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e0108480 con 0x7ff9e0060270 2022-02-02T13:46:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.510+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc01c620 con 0x7ff9e0060270 2022-02-02T13:46:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.510+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e01089e0 con 0x7ff9e0060270 2022-02-02T13:46:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.511+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9dc01c890 con 0x7ff9e0060270 2022-02-02T13:46:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.511+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e0045ad0 con 0x7ff9e0060270 2022-02-02T13:46:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.512+0000 7ff9d6ffd700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 0x7ff9cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.512+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9dc0838a0 con 0x7ff9e0060270 2022-02-02T13:46:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.512+0000 7ff9e5c8f700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 0x7ff9cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.512+0000 7ff9e5c8f700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 0x7ff9cc067290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff9d0007fd0 tx=0x7ff9d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.516+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9dc055440 con 0x7ff9e0060270 2022-02-02T13:46:39.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.704+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9e00fefc0 con 0x7ff9cc064dd0 2022-02-02T13:46:39.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.706+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/2780936914 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff9e00fefc0 con 0x7ff9cc064dd0 2022-02-02T13:46:39.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.707+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 msgr2=0x7ff9cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:39.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.707+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 0x7ff9cc067290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff9d0007fd0 tx=0x7ff9d0009040).stop 2022-02-02T13:46:39.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 msgr2=0x7ff9e0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:39.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7ff9dc009990 tx=0x7ff9dc009b30).stop 2022-02-02T13:46:39.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 shutdown_connections 2022-02-02T13:46:39.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9cc064dd0 0x7ff9cc067290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e0060270 0x7ff9e0106f60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 --2- 172.21.15.33:0/2780936914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e00f9830 0x7ff9e0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 >> 172.21.15.33:0/2780936914 conn(0x7ff9e00f0d40 msgr2=0x7ff9e00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:39.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 shutdown_connections 2022-02-02T13:46:39.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.708+0000 7ff9e86f4700 1 -- 172.21.15.33:0/2780936914 wait complete. 2022-02-02T13:46:39.718 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:46:39.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 -- 172.21.15.33:0/2555029650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 msgr2=0x7f82000f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:39.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 --2- 172.21.15.33:0/2555029650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f82000f6b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f81fc004660 tx=0x7f81fc009b30).stop 2022-02-02T13:46:39.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 -- 172.21.15.33:0/2555029650 shutdown_connections 2022-02-02T13:46:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 --2- 172.21.15.33:0/2555029650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f82000f6b30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 --2- 172.21.15.33:0/2555029650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82000f5430 0x7f82000f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 -- 172.21.15.33:0/2555029650 >> 172.21.15.33:0/2555029650 conn(0x7f82000f0b90 msgr2=0x7f82000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:39.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.809+0000 7f82072a9700 1 -- 172.21.15.33:0/2555029650 shutdown_connections 2022-02-02T13:46:39.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 -- 172.21.15.33:0/2555029650 wait complete. 2022-02-02T13:46:39.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 Processor -- start 2022-02-02T13:46:39.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 -- start start 2022-02-02T13:46:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82000f5430 0x7f820010be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000602b0 con 0x7f82000f66d0 2022-02-02T13:46:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f82072a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82000603f0 con 0x7f82000f5430 2022-02-02T13:46:39.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f8205aa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:39.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f8205aa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58064/0 (socket says 172.21.15.33:58064) 2022-02-02T13:46:39.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.810+0000 7f8205aa6700 1 -- 172.21.15.33:0/1372879888 learned_addr learned my addr 172.21.15.33:0/1372879888 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:39.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f8205aa6700 1 -- 172.21.15.33:0/1372879888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82000f5430 msgr2=0x7f820010be40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T13:46:39.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f8205aa6700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82000f5430 0x7f820010be40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:46:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f8205aa6700 1 -- 172.21.15.33:0/1372879888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc005040 con 0x7f82000f66d0 2022-02-02T13:46:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f8205aa6700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f81fc009990 tx=0x7f81fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc018070 con 0x7f82000f66d0 2022-02-02T13:46:39.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820010e830 con 0x7f82000f66d0 2022-02-02T13:46:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f81fc007ca0 con 0x7f82000f66d0 2022-02-02T13:46:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81fc01c620 con 0x7f82000f66d0 2022-02-02T13:46:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.811+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820010ec00 con 0x7f82000f66d0 2022-02-02T13:46:39.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.812+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8200045ad0 con 0x7f82000f66d0 2022-02-02T13:46:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.813+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f81fc01d960 con 0x7f82000f66d0 2022-02-02T13:46:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.813+0000 7f81f6ffd700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 0x7f81ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.814+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f81fc0837e0 con 0x7f82000f66d0 2022-02-02T13:46:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.814+0000 7f82062a7700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 0x7f81ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:39.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.814+0000 7f82062a7700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 0x7f81ec0672e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8200060040 tx=0x7f81f00079e0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:39.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:39.818+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f81fc051890 con 0x7f82000f66d0 2022-02-02T13:46:40.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.001+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8200057f10 con 0x7f81ec064e20 2022-02-02T13:46:40.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.015+0000 7f81f6ffd700 1 -- 172.21.15.33:0/1372879888 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8200057f10 con 0x7f81ec064e20 2022-02-02T13:46:40.016 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:46:40.016 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (11m) 4m ago 12m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:46:40.017 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (4m) 4m ago 12m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:46:40.017 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (4m) 4m ago 12m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:46:40.017 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (11m) 4m ago 12m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:46:40.017 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (5m) 4m ago 9m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:46:40.018 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (6m) 4m ago 9m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:46:40.018 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (6m) 4m ago 9m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:46:40.018 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (9m) 4m ago 9m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:46:40.018 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (6m) 4m ago 14m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:46:40.019 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (6m) 4m ago 12m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:46:40.019 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (5m) 4m ago 14m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:46:40.019 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (5m) 4m ago 12m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:46:40.019 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (12m) 4m ago 12m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:46:40.019 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (12m) 4m ago 12m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:46:40.020 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (11m) 4m ago 11m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:46:40.020 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (11m) 4m ago 11m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:46:40.020 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (11m) 4m ago 11m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:46:40.020 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (10m) 4m ago 10m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:46:40.021 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (10m) 4m ago 10m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:46:40.021 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (10m) 4m ago 10m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:46:40.021 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (11m) 4m ago 12m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:46:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 msgr2=0x7f81ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 0x7f81ec0672e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f8200060040 tx=0x7f81f00079e0).stop 2022-02-02T13:46:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 msgr2=0x7f820010e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f81fc009990 tx=0x7f81fc009b30).stop 2022-02-02T13:46:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 shutdown_connections 2022-02-02T13:46:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f81ec064e20 0x7f81ec0672e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82000f5430 0x7f820010be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:46:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 --2- 172.21.15.33:0/1372879888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82000f66d0 0x7f820010e340 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 >> 172.21.15.33:0/1372879888 conn(0x7f82000f0b90 msgr2=0x7f82000fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 shutdown_connections 2022-02-02T13:46:40.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.017+0000 7f82072a9700 1 -- 172.21.15.33:0/1372879888 wait complete. 2022-02-02T13:46:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 -- 172.21.15.33:0/2794508067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 msgr2=0x7ff4280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 --2- 172.21.15.33:0/2794508067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff4280f6b00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7ff418004660 tx=0x7ff418009b30).stop 2022-02-02T13:46:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 -- 172.21.15.33:0/2794508067 shutdown_connections 2022-02-02T13:46:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 --2- 172.21.15.33:0/2794508067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 0x7ff4280f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 --2- 172.21.15.33:0/2794508067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff4280f6b00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 -- 172.21.15.33:0/2794508067 >> 172.21.15.33:0/2794508067 conn(0x7ff4280f1e40 msgr2=0x7ff4280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.118+0000 7ff42d06e700 1 -- 172.21.15.33:0/2794508067 shutdown_connections 2022-02-02T13:46:40.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.119+0000 7ff42d06e700 1 -- 172.21.15.33:0/2794508067 wait complete. 2022-02-02T13:46:40.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.119+0000 7ff42d06e700 1 Processor -- start 2022-02-02T13:46:40.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.119+0000 7ff42d06e700 1 -- start start 2022-02-02T13:46:40.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff42d06e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff42d06e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 0x7ff428069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff42d06e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42806a380 con 0x7ff4280f66e0 2022-02-02T13:46:40.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff42d06e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42806a4c0 con 0x7ff4280f7980 2022-02-02T13:46:40.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58072/0 (socket says 172.21.15.33:58072) 2022-02-02T13:46:40.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 -- 172.21.15.33:0/17340230 learned_addr learned my addr 172.21.15.33:0/17340230 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:40.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff42659c700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 0x7ff428069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 -- 172.21.15.33:0/17340230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 msgr2=0x7ff428069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 0x7ff428069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 -- 172.21.15.33:0/17340230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff418005040 con 0x7ff4280f66e0 2022-02-02T13:46:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.120+0000 7ff426d9d700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff418000c00 tx=0x7ff418009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.121+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff418018070 con 0x7ff4280f66e0 2022-02-02T13:46:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.121+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff418007d70 con 0x7ff4280f66e0 2022-02-02T13:46:40.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.121+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42806a740 con 0x7ff4280f66e0 2022-02-02T13:46:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.121+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff41801c620 con 0x7ff4280f66e0 2022-02-02T13:46:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.121+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42806aca0 con 0x7ff4280f66e0 2022-02-02T13:46:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.122+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428045ad0 con 0x7ff4280f66e0 2022-02-02T13:46:40.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.122+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff41801c860 con 0x7ff4280f66e0 2022-02-02T13:46:40.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.123+0000 7ff41f7fe700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 0x7ff414067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.123+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff418083940 con 0x7ff4280f66e0 2022-02-02T13:46:40.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.123+0000 7ff42659c700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 0x7ff414067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.123+0000 7ff42659c700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 0x7ff414067270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff4100041d0 tx=0x7ff410009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:40.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.127+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4180519f0 con 0x7ff4280f66e0 2022-02-02T13:46:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.369+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4280fefb0 con 0x7ff4280f66e0 2022-02-02T13:46:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.369+0000 7ff41f7fe700 1 -- 172.21.15.33:0/17340230 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff418055010 con 0x7ff4280f66e0 2022-02-02T13:46:40.370 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:46:40.371 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:46:40.371 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:46:40.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:40.371 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:46:40.372 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:46:40.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:40.372 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:46:40.372 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:46:40.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:40.373 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:46:40.373 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:46:40.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:46:40.373 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:46:40.374 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:46:40.374 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:46:40.374 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:46:40.374 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:46:40.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 msgr2=0x7ff414067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 0x7ff414067270 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7ff4100041d0 tx=0x7ff410009040).stop 2022-02-02T13:46:40.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 msgr2=0x7ff42806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7ff418000c00 tx=0x7ff418009b30).stop 2022-02-02T13:46:40.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 shutdown_connections 2022-02-02T13:46:40.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff414064db0 0x7ff414067270 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4280f66e0 0x7ff42806b9a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 --2- 172.21.15.33:0/17340230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4280f7980 0x7ff428069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 >> 172.21.15.33:0/17340230 conn(0x7ff4280f1e40 msgr2=0x7ff4280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:40.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 shutdown_connections 2022-02-02T13:46:40.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.371+0000 7ff42d06e700 1 -- 172.21.15.33:0/17340230 wait complete. 2022-02-02T13:46:40.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 -- 172.21.15.33:0/403183542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f66e0 msgr2=0x7ff55c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 --2- 172.21.15.33:0/403183542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f66e0 0x7ff55c0f6b00 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff550004660 tx=0x7ff550009b30).stop 2022-02-02T13:46:40.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 -- 172.21.15.33:0/403183542 shutdown_connections 2022-02-02T13:46:40.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 --2- 172.21.15.33:0/403183542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f7980 0x7ff55c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 --2- 172.21.15.33:0/403183542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f66e0 0x7ff55c0f6b00 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 -- 172.21.15.33:0/403183542 >> 172.21.15.33:0/403183542 conn(0x7ff55c0f1e40 msgr2=0x7ff55c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:40.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 -- 172.21.15.33:0/403183542 shutdown_connections 2022-02-02T13:46:40.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.472+0000 7ff5642f4700 1 -- 172.21.15.33:0/403183542 wait complete. 2022-02-02T13:46:40.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 Processor -- start 2022-02-02T13:46:40.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 -- start start 2022-02-02T13:46:40.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f66e0 0x7ff55c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c107a50 con 0x7ff55c0f7980 2022-02-02T13:46:40.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff5642f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55c107b90 con 0x7ff55c0f66e0 2022-02-02T13:46:40.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff56188f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff56188f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58084/0 (socket says 172.21.15.33:58084) 2022-02-02T13:46:40.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.473+0000 7ff56188f700 1 -- 172.21.15.33:0/813076189 learned_addr learned my addr 172.21.15.33:0/813076189 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:46:40.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff562090700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f66e0 0x7ff55c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff56188f700 1 -- 172.21.15.33:0/813076189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f66e0 msgr2=0x7ff55c106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff56188f700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f66e0 0x7ff55c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff56188f700 1 -- 172.21.15.33:0/813076189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550005040 con 0x7ff55c0f7980 2022-02-02T13:46:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff56188f700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5580026d0 tx=0x7ff558009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff558009320 con 0x7ff55c0f7980 2022-02-02T13:46:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55c108530 con 0x7ff55c0f7980 2022-02-02T13:46:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff55800f040 con 0x7ff55c0f7980 2022-02-02T13:46:40.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5580147e0 con 0x7ff55c0f7980 2022-02-02T13:46:40.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.474+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55c108af0 con 0x7ff55c0f7980 2022-02-02T13:46:40.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.475+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55c045ad0 con 0x7ff55c0f7980 2022-02-02T13:46:40.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.475+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff558009480 con 0x7ff55c0f7980 2022-02-02T13:46:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.476+0000 7ff54effd700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:46:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.476+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff558082170 con 0x7ff55c0f7980 2022-02-02T13:46:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.476+0000 7ff562090700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:46:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.476+0000 7ff562090700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff550009da0 tx=0x7ff550009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:46:40.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.480+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff558053c50 con 0x7ff55c0f7980 2022-02-02T13:46:40.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.693+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff55c108d70 con 0x7ff55c0f7980 2022-02-02T13:46:40.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.693+0000 7ff54effd700 1 -- 172.21.15.33:0/813076189 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff558053840 con 0x7ff55c0f7980 2022-02-02T13:46:40.694 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:46:40.695 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:46:40.695 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:46:40.695 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:46:40.695 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:40.696 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:46:40.696 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:46:40.696 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:46:40.696 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:46:40.697 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:46:40.697 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:46:40.697 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:46:40.697 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:46:40.698 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:46:40.698 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:46:40.698 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:46:40.698 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:46:40.698 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:46:40.699 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:46:40.699 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:46:40.699 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:46:40.699 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:46:40.700 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:46:40.700 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:46:40.700 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:46:40.700 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:46:40.700 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:46:40.701 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:46:40.701 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:46:40.701 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:46:40.701 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:46:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:40.702 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:46:40.702 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:46:40.703 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:40.703 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:40.703 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:40.703 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:46:40.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 msgr2=0x7ff548067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7ff550009da0 tx=0x7ff550009b30).stop 2022-02-02T13:46:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 msgr2=0x7ff55c1074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:46:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5580026d0 tx=0x7ff558009de0).stop 2022-02-02T13:46:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 shutdown_connections 2022-02-02T13:46:40.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff55c0f66e0 0x7ff55c106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 --2- 172.21.15.33:0/813076189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff55c0f7980 0x7ff55c1074a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:46:40.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 >> 172.21.15.33:0/813076189 conn(0x7ff55c0f1e40 msgr2=0x7ff55c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:46:40.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 shutdown_connections 2022-02-02T13:46:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:46:40.697+0000 7ff5642f4700 1 -- 172.21.15.33:0/813076189 wait complete. 2022-02-02T13:46:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:46:40.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:40 smithi033 ceph-mon[101165]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:40 smithi033 ceph-mon[101165]: pgmap v184: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:40 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/17340230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:46:40.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:40 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/813076189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:46:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:40 smithi037 ceph-mon[69017]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:40 smithi037 ceph-mon[69017]: pgmap v184: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:40 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/17340230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:46:41.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:40 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/813076189' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:46:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:41 smithi033 ceph-mon[101165]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:41 smithi037 ceph-mon[69017]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:46:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:42 smithi033 ceph-mon[101165]: pgmap v185: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:42 smithi037 ceph-mon[69017]: pgmap v185: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:44 smithi033 ceph-mon[101165]: pgmap v186: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:44 smithi037 ceph-mon[69017]: pgmap v186: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:46 smithi033 ceph-mon[101165]: pgmap v187: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:46 smithi037 ceph-mon[69017]: pgmap v187: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:48 smithi033 ceph-mon[101165]: pgmap v188: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:48 smithi037 ceph-mon[69017]: pgmap v188: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:50 smithi033 ceph-mon[101165]: pgmap v189: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:50 smithi037 ceph-mon[69017]: pgmap v189: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:53.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:52 smithi033 ceph-mon[101165]: pgmap v190: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:52 smithi037 ceph-mon[69017]: pgmap v190: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:54 smithi033 ceph-mon[101165]: pgmap v191: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:46:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:46:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:54 smithi037 ceph-mon[69017]: pgmap v191: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:55.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:46:55.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:46:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:56 smithi033 ceph-mon[101165]: pgmap v192: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:56 smithi037 ceph-mon[69017]: pgmap v192: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:46:58 smithi033 ceph-mon[101165]: pgmap v193: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:46:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:46:58 smithi037 ceph-mon[69017]: pgmap v193: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:00 smithi033 ceph-mon[101165]: pgmap v194: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:00 smithi037 ceph-mon[69017]: pgmap v194: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:02 smithi033 ceph-mon[101165]: pgmap v195: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:02 smithi037 ceph-mon[69017]: pgmap v195: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:04 smithi033 ceph-mon[101165]: pgmap v196: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:47:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:47:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:47:05.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:47:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:04 smithi037 ceph-mon[69017]: pgmap v196: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:47:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:47:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:47:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:47:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:05 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:47:06.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:05 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:47:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:06 smithi033 ceph-mon[101165]: pgmap v197: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:06 smithi037 ceph-mon[69017]: pgmap v197: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:08 smithi033 ceph-mon[101165]: pgmap v198: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:08 smithi037 ceph-mon[69017]: pgmap v198: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:10.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 -- 172.21.15.33:0/449644706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 msgr2=0x7f04000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:10.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 --2- 172.21.15.33:0/449644706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f59e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f03f0004660 tx=0x7f03f0009b30).stop 2022-02-02T13:47:10.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 -- 172.21.15.33:0/449644706 shutdown_connections 2022-02-02T13:47:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 --2- 172.21.15.33:0/449644706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 0x7f04000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 --2- 172.21.15.33:0/449644706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f59e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 -- 172.21.15.33:0/449644706 >> 172.21.15.33:0/449644706 conn(0x7f04000f0d40 msgr2=0x7f04000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 -- 172.21.15.33:0/449644706 shutdown_connections 2022-02-02T13:47:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.814+0000 7f0405a81700 1 -- 172.21.15.33:0/449644706 wait complete. 2022-02-02T13:47:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 Processor -- start 2022-02-02T13:47:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 -- start start 2022-02-02T13:47:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 0x7f04000f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040010ac00 con 0x7f04000f55c0 2022-02-02T13:47:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f0405a81700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040010ad40 con 0x7f04000f6860 2022-02-02T13:47:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.815+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58092/0 (socket says 172.21.15.33:58092) 2022-02-02T13:47:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 -- 172.21.15.33:0/3471066206 learned_addr learned my addr 172.21.15.33:0/3471066206 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03feffd700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 0x7f04000f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 -- 172.21.15.33:0/3471066206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 msgr2=0x7f04000f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 0x7f04000f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 -- 172.21.15.33:0/3471066206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f0005040 con 0x7f04000f55c0 2022-02-02T13:47:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03ff7fe700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f03f0004f60 tx=0x7f03f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f0018070 con 0x7f04000f55c0 2022-02-02T13:47:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04000f8910 con 0x7f04000f55c0 2022-02-02T13:47:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f03f0009770 con 0x7f04000f55c0 2022-02-02T13:47:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03f001c3c0 con 0x7f04000f55c0 2022-02-02T13:47:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.816+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04000f8e70 con 0x7f04000f55c0 2022-02-02T13:47:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.818+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400045ad0 con 0x7f04000f55c0 2022-02-02T13:47:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.818+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f03f001d420 con 0x7f04000f55c0 2022-02-02T13:47:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.819+0000 7f03e7fff700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 0x7f03e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.819+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f03f0083890 con 0x7f04000f55c0 2022-02-02T13:47:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.819+0000 7f03feffd700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 0x7f03e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.819+0000 7f03feffd700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 0x7f03e8067290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f03f4007fd0 tx=0x7f03f4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:10.823+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f03f0051a00 con 0x7f04000f55c0 2022-02-02T13:47:11.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.012+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04000f9290 con 0x7f03e8064dd0 2022-02-02T13:47:11.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.013+0000 7f03e7fff700 1 -- 172.21.15.33:0/3471066206 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f04000f9290 con 0x7f03e8064dd0 2022-02-02T13:47:11.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 msgr2=0x7f03e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 0x7f03e8067290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f03f4007fd0 tx=0x7f03f4009040).stop 2022-02-02T13:47:11.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 msgr2=0x7f04000f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f03f0004f60 tx=0x7f03f0009b30).stop 2022-02-02T13:47:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 shutdown_connections 2022-02-02T13:47:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f03e8064dd0 0x7f03e8067290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04000f55c0 0x7f04000f9f40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 --2- 172.21.15.33:0/3471066206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04000f6860 0x7f04000f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.015+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 >> 172.21.15.33:0/3471066206 conn(0x7f04000f0d40 msgr2=0x7f040005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.016+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 shutdown_connections 2022-02-02T13:47:11.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.016+0000 7f0405a81700 1 -- 172.21.15.33:0/3471066206 wait complete. 2022-02-02T13:47:11.026 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:47:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3967026180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f55c0 msgr2=0x7f4e480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3967026180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f55c0 0x7f4e480f59e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f4e44004660 tx=0x7f4e44009b30).stop 2022-02-02T13:47:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3967026180 shutdown_connections 2022-02-02T13:47:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3967026180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f6860 0x7f4e480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3967026180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f55c0 0x7f4e480f59e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3967026180 >> 172.21.15.33:0/3967026180 conn(0x7f4e480f0d40 msgr2=0x7f4e480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.120 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:10 smithi033 ceph-mon[101165]: pgmap v199: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3967026180 shutdown_connections 2022-02-02T13:47:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.118+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3967026180 wait complete. 2022-02-02T13:47:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 Processor -- start 2022-02-02T13:47:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 -- start start 2022-02-02T13:47:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f55c0 0x7f4e4810c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48060310 con 0x7f4e480f6860 2022-02-02T13:47:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4fabc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e48060450 con 0x7f4e480f55c0 2022-02-02T13:47:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58104/0 (socket says 172.21.15.33:58104) 2022-02-02T13:47:11.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 -- 172.21.15.33:0/3400268356 learned_addr learned my addr 172.21.15.33:0/3400268356 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:11.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d858700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f55c0 0x7f4e4810c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 -- 172.21.15.33:0/3400268356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f55c0 msgr2=0x7f4e4810c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f55c0 0x7f4e4810c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.119+0000 7f4e4d057700 1 -- 172.21.15.33:0/3400268356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e44005040 con 0x7f4e480f6860 2022-02-02T13:47:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e4d057700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4e3c00c790 tx=0x7f4e3c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3c00e680 con 0x7f4e480f6860 2022-02-02T13:47:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e3c00ec90 con 0x7f4e480f6860 2022-02-02T13:47:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4810ea20 con 0x7f4e480f6860 2022-02-02T13:47:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3c013d60 con 0x7f4e480f6860 2022-02-02T13:47:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.120+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4810ef00 con 0x7f4e480f6860 2022-02-02T13:47:11.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.121+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e48045ad0 con 0x7f4e480f6860 2022-02-02T13:47:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.122+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4e3c01a060 con 0x7f4e480f6860 2022-02-02T13:47:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.122+0000 7f4e3a7fc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 0x7f4e34067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.122+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4e3c081d90 con 0x7f4e480f6860 2022-02-02T13:47:11.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.122+0000 7f4e4d858700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 0x7f4e34067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.123+0000 7f4e4d858700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 0x7f4e34067270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4e44000c00 tx=0x7f4e44009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.126+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4e3c04fe40 con 0x7f4e480f6860 2022-02-02T13:47:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:10 smithi037 ceph-mon[69017]: pgmap v199: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.309+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e480fde90 con 0x7f4e34064db0 2022-02-02T13:47:11.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.323+0000 7f4e3a7fc700 1 -- 172.21.15.33:0/3400268356 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4e480fde90 con 0x7f4e34064db0 2022-02-02T13:47:11.325 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:47:11.325 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (12m) 5m ago 13m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:47:11.326 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (5m) 5m ago 13m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:47:11.326 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (5m) 5m ago 12m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:47:11.328 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (12m) 5m ago 13m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:47:11.328 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (5m) 5m ago 9m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:47:11.329 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (6m) 5m ago 9m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:47:11.330 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (7m) 5m ago 9m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:47:11.330 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (9m) 5m ago 9m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:47:11.330 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (7m) 5m ago 14m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:47:11.331 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (6m) 5m ago 12m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:47:11.331 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 5m ago 14m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:47:11.332 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (6m) 5m ago 12m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:47:11.332 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (13m) 5m ago 13m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:47:11.333 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (12m) 5m ago 12m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:47:11.333 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (12m) 5m ago 12m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:47:11.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (11m) 5m ago 11m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:47:11.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (11m) 5m ago 11m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:47:11.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (11m) 5m ago 11m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:47:11.335 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (11m) 5m ago 11m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:47:11.335 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (10m) 5m ago 10m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:47:11.336 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (12m) 5m ago 13m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:47:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.325+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 msgr2=0x7f4e34067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.325+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 0x7f4e34067270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4e44000c00 tx=0x7f4e44009b30).stop 2022-02-02T13:47:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.325+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 msgr2=0x7f4e4810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.325+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4e3c00c790 tx=0x7f4e3c007d70).stop 2022-02-02T13:47:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 shutdown_connections 2022-02-02T13:47:11.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e34064db0 0x7f4e34067270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e480f55c0 0x7f4e4810c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 --2- 172.21.15.33:0/3400268356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e480f6860 0x7f4e4810e530 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 >> 172.21.15.33:0/3400268356 conn(0x7f4e480f0d40 msgr2=0x7f4e480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 shutdown_connections 2022-02-02T13:47:11.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.326+0000 7f4e4fabc700 1 -- 172.21.15.33:0/3400268356 wait complete. 2022-02-02T13:47:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 -- 172.21.15.33:0/1908521178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 msgr2=0x7f86640f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 --2- 172.21.15.33:0/1908521178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f86640f59e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f8654004660 tx=0x7f8654009b30).stop 2022-02-02T13:47:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 -- 172.21.15.33:0/1908521178 shutdown_connections 2022-02-02T13:47:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 --2- 172.21.15.33:0/1908521178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 0x7f86640f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:47:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 --2- 172.21.15.33:0/1908521178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f86640f59e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 -- 172.21.15.33:0/1908521178 >> 172.21.15.33:0/1908521178 conn(0x7f86640f0d40 msgr2=0x7f86640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 -- 172.21.15.33:0/1908521178 shutdown_connections 2022-02-02T13:47:11.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.426+0000 7f866a7dd700 1 -- 172.21.15.33:0/1908521178 wait complete. 2022-02-02T13:47:11.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.427+0000 7f866a7dd700 1 Processor -- start 2022-02-02T13:47:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.427+0000 7f866a7dd700 1 -- start start 2022-02-02T13:47:11.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.427+0000 7f866a7dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.427+0000 7f866a7dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 0x7f8664107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f866a7dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664107ac0 con 0x7f86640f55c0 2022-02-02T13:47:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f866a7dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664108370 con 0x7f86640f6860 2022-02-02T13:47:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58112/0 (socket says 172.21.15.33:58112) 2022-02-02T13:47:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 -- 172.21.15.33:0/2806923943 learned_addr learned my addr 172.21.15.33:0/2806923943 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f86637fe700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 0x7f8664107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 -- 172.21.15.33:0/2806923943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 msgr2=0x7f8664107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 0x7f8664107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 -- 172.21.15.33:0/2806923943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654005040 con 0x7f86640f55c0 2022-02-02T13:47:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8663fff700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8654004f60 tx=0x7f8654009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8654018070 con 0x7f86640f55c0 2022-02-02T13:47:11.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86641085f0 con 0x7f86640f55c0 2022-02-02T13:47:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8654007ba0 con 0x7f86640f55c0 2022-02-02T13:47:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.428+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f865401c620 con 0x7f86640f55c0 2022-02-02T13:47:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.429+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8664108b50 con 0x7f86640f55c0 2022-02-02T13:47:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.429+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640f49b0 con 0x7f86640f55c0 2022-02-02T13:47:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.430+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f865401c8e0 con 0x7f86640f55c0 2022-02-02T13:47:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.431+0000 7f8660ff9700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 0x7f864c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.431+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8654083990 con 0x7f86640f55c0 2022-02-02T13:47:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.431+0000 7f86637fe700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 0x7f864c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.431+0000 7f86637fe700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 0x7f864c067290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f865800b790 tx=0x7f8658008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.435+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8654055470 con 0x7f86640f55c0 2022-02-02T13:47:11.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.677+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f866410d5b0 con 0x7f86640f55c0 2022-02-02T13:47:11.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.678+0000 7f8660ff9700 1 -- 172.21.15.33:0/2806923943 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8654055060 con 0x7f86640f55c0 2022-02-02T13:47:11.679 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:47:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:47:11.679 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:47:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:47:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:47:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:11.680 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:47:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:47:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:47:11.681 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:47:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:47:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:47:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:47:11.682 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:47:11.683 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:47:11.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 msgr2=0x7f864c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 0x7f864c067290 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f865800b790 tx=0x7f8658008040).stop 2022-02-02T13:47:11.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 msgr2=0x7f8664106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f8654004f60 tx=0x7f8654009b30).stop 2022-02-02T13:47:11.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 shutdown_connections 2022-02-02T13:47:11.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f864c064dd0 0x7f864c067290 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640f55c0 0x7f8664106f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 --2- 172.21.15.33:0/2806923943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86640f6860 0x7f8664107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 >> 172.21.15.33:0/2806923943 conn(0x7f86640f0d40 msgr2=0x7f866405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 shutdown_connections 2022-02-02T13:47:11.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.680+0000 7f866a7dd700 1 -- 172.21.15.33:0/2806923943 wait complete. 2022-02-02T13:47:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 -- 172.21.15.33:0/3103370600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f77d0 msgr2=0x7f95c00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 --2- 172.21.15.33:0/3103370600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f77d0 0x7f95c00f7c30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f95b0004660 tx=0x7f95b0009b30).stop 2022-02-02T13:47:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 -- 172.21.15.33:0/3103370600 shutdown_connections 2022-02-02T13:47:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 --2- 172.21.15.33:0/3103370600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f77d0 0x7f95c00f7c30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 --2- 172.21.15.33:0/3103370600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f6530 0x7f95c00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.782+0000 7f95c6db6700 1 -- 172.21.15.33:0/3103370600 >> 172.21.15.33:0/3103370600 conn(0x7f95c00f1c90 msgr2=0x7f95c00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:11.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 -- 172.21.15.33:0/3103370600 shutdown_connections 2022-02-02T13:47:11.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 -- 172.21.15.33:0/3103370600 wait complete. 2022-02-02T13:47:11.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 Processor -- start 2022-02-02T13:47:11.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 -- start start 2022-02-02T13:47:11.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 0x7f95c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c006a380 con 0x7f95c00f6530 2022-02-02T13:47:11.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.783+0000 7f95c6db6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c006a4c0 con 0x7f95c00f77d0 2022-02-02T13:47:11.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58122/0 (socket says 172.21.15.33:58122) 2022-02-02T13:47:11.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 -- 172.21.15.33:0/1748816908 learned_addr learned my addr 172.21.15.33:0/1748816908 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:11.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c55b3700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 0x7f95c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 -- 172.21.15.33:0/1748816908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 msgr2=0x7f95c0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:11.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 0x7f95c0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:11.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 -- 172.21.15.33:0/1748816908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b0005040 con 0x7f95c00f6530 2022-02-02T13:47:11.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c55b3700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 0x7f95c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:47:11.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c5db4700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f95bc00c530 tx=0x7f95bc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc00f650 con 0x7f95c00f6530 2022-02-02T13:47:11.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c006a7a0 con 0x7f95c00f6530 2022-02-02T13:47:11.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f95bc00fc60 con 0x7f95c00f6530 2022-02-02T13:47:11.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95bc012d20 con 0x7f95c00f6530 2022-02-02T13:47:11.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.784+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c010ed50 con 0x7f95c00f6530 2022-02-02T13:47:11.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.785+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c0045ad0 con 0x7f95c00f6530 2022-02-02T13:47:11.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.786+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f95bc019030 con 0x7f95c00f6530 2022-02-02T13:47:11.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.786+0000 7f95b67fc700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 0x7f95ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.786+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f95bc081760 con 0x7f95c00f6530 2022-02-02T13:47:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.786+0000 7f95c55b3700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 0x7f95ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.787+0000 7f95c55b3700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 0x7f95ac0672e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f95b0004e30 tx=0x7f95b0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:11.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:11.791+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f95bc04f860 con 0x7f95c00f6530 2022-02-02T13:47:11.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:11 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2806923943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:47:12.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.005+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f95c006a930 con 0x7f95c00f6530 2022-02-02T13:47:12.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.005+0000 7f95b67fc700 1 -- 172.21.15.33:0/1748816908 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f95c006a930 con 0x7f95c00f6530 2022-02-02T13:47:12.006 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:47:12.006 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:47:12.007 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:47:12.007 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:47:12.007 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:12.007 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:47:12.007 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:47:12.008 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:47:12.008 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:47:12.008 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:47:12.008 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:47:12.009 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:47:12.009 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:47:12.009 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:47:12.009 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:47:12.010 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:47:12.010 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:47:12.010 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:47:12.010 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:47:12.010 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:47:12.011 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:47:12.011 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:47:12.011 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:47:12.011 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:47:12.012 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:47:12.012 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:47:12.012 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:47:12.012 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:47:12.012 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:47:12.013 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:47:12.013 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:47:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:12.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:12.014 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:47:12.014 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:12.014 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:12.014 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:12.014 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:12.015 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 msgr2=0x7f95ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 0x7f95ac0672e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f95b0004e30 tx=0x7f95b0009b30).stop 2022-02-02T13:47:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 msgr2=0x7f95c006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f95bc00c530 tx=0x7f95bc007e10).stop 2022-02-02T13:47:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 shutdown_connections 2022-02-02T13:47:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f95ac064e20 0x7f95ac0672e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95c00f6530 0x7f95c006b9a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 --2- 172.21.15.33:0/1748816908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95c00f77d0 0x7f95c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 >> 172.21.15.33:0/1748816908 conn(0x7f95c00f1c90 msgr2=0x7f95c00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 shutdown_connections 2022-02-02T13:47:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:12.007+0000 7f95c6db6700 1 -- 172.21.15.33:0/1748816908 wait complete. 2022-02-02T13:47:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:47:12.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:11 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2806923943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:47:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:12 smithi033 ceph-mon[101165]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:12 smithi033 ceph-mon[101165]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:12 smithi033 ceph-mon[101165]: pgmap v200: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1748816908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:47:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:12 smithi037 ceph-mon[69017]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:12 smithi037 ceph-mon[69017]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:13.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:12 smithi037 ceph-mon[69017]: pgmap v200: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:13.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1748816908' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:47:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:14 smithi033 ceph-mon[101165]: pgmap v201: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:14 smithi037 ceph-mon[69017]: pgmap v201: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:16 smithi033 ceph-mon[101165]: pgmap v202: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:17.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:16 smithi037 ceph-mon[69017]: pgmap v202: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:18 smithi033 ceph-mon[101165]: pgmap v203: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:18 smithi037 ceph-mon[69017]: pgmap v203: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:21.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:20 smithi033 ceph-mon[101165]: pgmap v204: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:20 smithi037 ceph-mon[69017]: pgmap v204: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:22 smithi033 ceph-mon[101165]: pgmap v205: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:22 smithi037 ceph-mon[69017]: pgmap v205: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:24 smithi033 ceph-mon[101165]: pgmap v206: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:25.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:24 smithi037 ceph-mon[69017]: pgmap v206: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:26 smithi033 ceph-mon[101165]: pgmap v207: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:26 smithi037 ceph-mon[69017]: pgmap v207: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:28 smithi033 ceph-mon[101165]: pgmap v208: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:28 smithi037 ceph-mon[69017]: pgmap v208: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:30 smithi033 ceph-mon[101165]: pgmap v209: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:30 smithi037 ceph-mon[69017]: pgmap v209: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:32 smithi033 ceph-mon[101165]: pgmap v210: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:32 smithi037 ceph-mon[69017]: pgmap v210: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:35.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:34 smithi033 ceph-mon[101165]: pgmap v211: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:34 smithi037 ceph-mon[69017]: pgmap v211: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:36 smithi033 ceph-mon[101165]: pgmap v212: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:36 smithi037 ceph-mon[69017]: pgmap v212: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:38 smithi033 ceph-mon[101165]: pgmap v213: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:38 smithi037 ceph-mon[69017]: pgmap v213: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:40 smithi033 ceph-mon[101165]: pgmap v214: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:40 smithi037 ceph-mon[69017]: pgmap v214: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:42.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.122+0000 7fe943d10700 1 -- 172.21.15.33:0/2567142617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f55c0 msgr2=0x7fe93c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.122+0000 7fe943d10700 1 --2- 172.21.15.33:0/2567142617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f55c0 0x7fe93c0f59e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fe938004660 tx=0x7fe938009b30).stop 2022-02-02T13:47:42.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 -- 172.21.15.33:0/2567142617 shutdown_connections 2022-02-02T13:47:42.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 --2- 172.21.15.33:0/2567142617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f6860 0x7fe93c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 --2- 172.21.15.33:0/2567142617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f55c0 0x7fe93c0f59e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 -- 172.21.15.33:0/2567142617 >> 172.21.15.33:0/2567142617 conn(0x7fe93c0f0d40 msgr2=0x7fe93c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 -- 172.21.15.33:0/2567142617 shutdown_connections 2022-02-02T13:47:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 -- 172.21.15.33:0/2567142617 wait complete. 2022-02-02T13:47:42.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.123+0000 7fe943d10700 1 Processor -- start 2022-02-02T13:47:42.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe943d10700 1 -- start start 2022-02-02T13:47:42.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe943d10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f55c0 0x7fe93c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe943d10700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe943d10700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c0603e0 con 0x7fe93c0f6860 2022-02-02T13:47:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe943d10700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c060520 con 0x7fe93c0f55c0 2022-02-02T13:47:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58134/0 (socket says 172.21.15.33:58134) 2022-02-02T13:47:42.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 -- 172.21.15.33:0/237571477 learned_addr learned my addr 172.21.15.33:0/237571477 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:42.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe941aac700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f55c0 0x7fe93c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 -- 172.21.15.33:0/237571477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f55c0 msgr2=0x7fe93c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f55c0 0x7fe93c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.124+0000 7fe9412ab700 1 -- 172.21.15.33:0/237571477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938005040 con 0x7fe93c0f6860 2022-02-02T13:47:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe9412ab700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe93000c530 tx=0x7fe930007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93000f650 con 0x7fe93c0f6860 2022-02-02T13:47:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe93000fc60 con 0x7fe93c0f6860 2022-02-02T13:47:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c10c720 con 0x7fe93c0f6860 2022-02-02T13:47:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe930012cd0 con 0x7fe93c0f6860 2022-02-02T13:47:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.125+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c10cce0 con 0x7fe93c0f6860 2022-02-02T13:47:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.126+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c045ad0 con 0x7fe93c0f6860 2022-02-02T13:47:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.126+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe930010070 con 0x7fe93c0f6860 2022-02-02T13:47:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.127+0000 7fe92e7fc700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 0x7fe928067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.127+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe9300818d0 con 0x7fe93c0f6860 2022-02-02T13:47:42.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.127+0000 7fe941aac700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 0x7fe928067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.127+0000 7fe941aac700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 0x7fe928067290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe938004e30 tx=0x7fe938009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.131+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe93004f8c0 con 0x7fe93c0f6860 2022-02-02T13:47:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.320+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93c0fdec0 con 0x7fe928064dd0 2022-02-02T13:47:42.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.322+0000 7fe92e7fc700 1 -- 172.21.15.33:0/237571477 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe93c0fdec0 con 0x7fe928064dd0 2022-02-02T13:47:42.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 msgr2=0x7fe928067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 0x7fe928067290 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fe938004e30 tx=0x7fe938009b30).stop 2022-02-02T13:47:42.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 msgr2=0x7fe93c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe93000c530 tx=0x7fe930007e20).stop 2022-02-02T13:47:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 shutdown_connections 2022-02-02T13:47:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe928064dd0 0x7fe928067290 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe93c0f55c0 0x7fe93c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 --2- 172.21.15.33:0/237571477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0f6860 0x7fe93c10c170 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.323+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 >> 172.21.15.33:0/237571477 conn(0x7fe93c0f0d40 msgr2=0x7fe93c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.324+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 shutdown_connections 2022-02-02T13:47:42.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.324+0000 7fe943d10700 1 -- 172.21.15.33:0/237571477 wait complete. 2022-02-02T13:47:42.334 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:47:42.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1641367596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f66d0 msgr2=0x7fd9c40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1641367596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f66d0 0x7fd9c40f6b30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fd9b8004660 tx=0x7fd9b8009b30).stop 2022-02-02T13:47:42.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1641367596 shutdown_connections 2022-02-02T13:47:42.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1641367596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f66d0 0x7fd9c40f6b30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1641367596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c40f5430 0x7fd9c40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1641367596 >> 172.21.15.33:0/1641367596 conn(0x7fd9c40f0b90 msgr2=0x7fd9c40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.425+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1641367596 shutdown_connections 2022-02-02T13:47:42.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.426+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1641367596 wait complete. 2022-02-02T13:47:42.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.426+0000 7fd9c8fbb700 1 Processor -- start 2022-02-02T13:47:42.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.426+0000 7fd9c8fbb700 1 -- start start 2022-02-02T13:47:42.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c8fbb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c8fbb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c40f66d0 0x7fd9c4107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c8fbb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c4107870 con 0x7fd9c40f5430 2022-02-02T13:47:42.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c8fbb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c41080b0 con 0x7fd9c40f66d0 2022-02-02T13:47:42.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58142/0 (socket says 172.21.15.33:58142) 2022-02-02T13:47:42.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 -- 172.21.15.33:0/1942202662 learned_addr learned my addr 172.21.15.33:0/1942202662 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 -- 172.21.15.33:0/1942202662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c40f66d0 msgr2=0x7fd9c4107270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-02-02T13:47:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c40f66d0 0x7fd9c4107270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:47:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 -- 172.21.15.33:0/1942202662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8005040 con 0x7fd9c40f5430 2022-02-02T13:47:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9c37fe700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd9b4002700 tx=0x7fd9b4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.427+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b4009320 con 0x7fd9c40f5430 2022-02-02T13:47:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.428+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9b400f040 con 0x7fd9c40f5430 2022-02-02T13:47:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.428+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c4108390 con 0x7fd9c40f5430 2022-02-02T13:47:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.428+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b4014900 con 0x7fd9c40f5430 2022-02-02T13:47:42.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.428+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c41088d0 con 0x7fd9c40f5430 2022-02-02T13:47:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.429+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c4059100 con 0x7fd9c40f5430 2022-02-02T13:47:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.429+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9b4009480 con 0x7fd9c40f5430 2022-02-02T13:47:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.430+0000 7fd9abfff700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 0x7fd9ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.430+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd9b4081d10 con 0x7fd9c40f5430 2022-02-02T13:47:42.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.430+0000 7fd9c2ffd700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 0x7fd9ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.430+0000 7fd9c2ffd700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 0x7fd9ac0672e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd9b8009f50 tx=0x7fd9b8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.434+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9b404fe80 con 0x7fd9c40f5430 2022-02-02T13:47:42.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.618+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9c40fab10 con 0x7fd9ac064e20 2022-02-02T13:47:42.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.633+0000 7fd9abfff700 1 -- 172.21.15.33:0/1942202662 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd9c40fab10 con 0x7fd9ac064e20 2022-02-02T13:47:42.634 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:47:42.634 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (13m) 5m ago 13m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:47:42.634 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 5m ago 13m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:47:42.634 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (5m) 5m ago 13m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:47:42.635 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (12m) 5m ago 13m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:47:42.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (6m) 5m ago 10m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:47:42.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (7m) 5m ago 10m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:47:42.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (7m) 5m ago 10m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:47:42.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (10m) 5m ago 10m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:47:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (7m) 5m ago 15m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:47:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (7m) 5m ago 13m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:47:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (6m) 5m ago 15m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:47:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (6m) 5m ago 13m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:47:42.637 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (13m) 5m ago 13m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:47:42.637 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (13m) 5m ago 13m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:47:42.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (12m) 5m ago 12m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:47:42.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (12m) 5m ago 12m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:47:42.638 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (12m) 5m ago 12m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:47:42.638 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (11m) 5m ago 11m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:47:42.638 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (11m) 5m ago 11m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:47:42.638 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (11m) 5m ago 11m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:47:42.638 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (12m) 5m ago 13m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:47:42.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 msgr2=0x7fd9ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 0x7fd9ac0672e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fd9b8009f50 tx=0x7fd9b8009b30).stop 2022-02-02T13:47:42.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 msgr2=0x7fd9c4106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fd9b4002700 tx=0x7fd9b4009d80).stop 2022-02-02T13:47:42.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 shutdown_connections 2022-02-02T13:47:42.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd9ac064e20 0x7fd9ac0672e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9c40f5430 0x7fd9c4106d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 --2- 172.21.15.33:0/1942202662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c40f66d0 0x7fd9c4107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 >> 172.21.15.33:0/1942202662 conn(0x7fd9c40f0b90 msgr2=0x7fd9c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 shutdown_connections 2022-02-02T13:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.635+0000 7fd9c8fbb700 1 -- 172.21.15.33:0/1942202662 wait complete. 2022-02-02T13:47:42.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 -- 172.21.15.33:0/2135988827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f55c0 msgr2=0x7efed00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 --2- 172.21.15.33:0/2135988827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f55c0 0x7efed00f59e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efec4004660 tx=0x7efec4009b30).stop 2022-02-02T13:47:42.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 -- 172.21.15.33:0/2135988827 shutdown_connections 2022-02-02T13:47:42.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 --2- 172.21.15.33:0/2135988827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f6860 0x7efed00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 --2- 172.21.15.33:0/2135988827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f55c0 0x7efed00f59e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 -- 172.21.15.33:0/2135988827 >> 172.21.15.33:0/2135988827 conn(0x7efed00f0d40 msgr2=0x7efed00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 -- 172.21.15.33:0/2135988827 shutdown_connections 2022-02-02T13:47:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 -- 172.21.15.33:0/2135988827 wait complete. 2022-02-02T13:47:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.736+0000 7efed803c700 1 Processor -- start 2022-02-02T13:47:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed803c700 1 -- start start 2022-02-02T13:47:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed803c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 0x7efed0109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed803c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed803c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed00603e0 con 0x7efed00f6860 2022-02-02T13:47:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed803c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0060520 con 0x7efed00f55c0 2022-02-02T13:47:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58154/0 (socket says 172.21.15.33:58154) 2022-02-02T13:47:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 -- 172.21.15.33:0/2526251401 learned_addr learned my addr 172.21.15.33:0/2526251401 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed5dd8700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 0x7efed0109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 -- 172.21.15.33:0/2526251401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 msgr2=0x7efed0109c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 0x7efed0109c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 -- 172.21.15.33:0/2526251401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4005040 con 0x7efed00f6860 2022-02-02T13:47:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed5dd8700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 0x7efed0109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:47:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.737+0000 7efed55d7700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7efecc0026d0 tx=0x7efecc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.738+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efecc009320 con 0x7efed00f6860 2022-02-02T13:47:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.738+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efecc00f040 con 0x7efed00f6860 2022-02-02T13:47:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.738+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed010c6b0 con 0x7efed00f6860 2022-02-02T13:47:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.738+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efecc0147e0 con 0x7efed00f6860 2022-02-02T13:47:42.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.738+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed010cc70 con 0x7efed00f6860 2022-02-02T13:47:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.739+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed0045ad0 con 0x7efed00f6860 2022-02-02T13:47:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.739+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efecc009480 con 0x7efed00f6860 2022-02-02T13:47:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.740+0000 7efec27fc700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 0x7efebc06b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.740+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efecc082170 con 0x7efed00f6860 2022-02-02T13:47:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.740+0000 7efed5dd8700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 0x7efebc06b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:42.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.740+0000 7efed5dd8700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 0x7efebc06b6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efec4004e30 tx=0x7efec4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:42.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.744+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efecc050220 con 0x7efed00f6860 2022-02-02T13:47:42.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.988+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efed0027a00 con 0x7efed00f6860 2022-02-02T13:47:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:42 smithi033 ceph-mon[101165]: pgmap v215: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:42.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.989+0000 7efec27fc700 1 -- 172.21.15.33:0/2526251401 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7efecc053840 con 0x7efed00f6860 2022-02-02T13:47:42.990 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:47:42.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:47:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:47:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:47:42.991 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:47:42.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:42.992 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:47:42.992 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:47:42.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:47:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:47:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:47:42.993 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:47:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:47:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:47:42.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:47:42.994 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:47:42.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 msgr2=0x7efebc06b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 0x7efebc06b6a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efec4004e30 tx=0x7efec4009b30).stop 2022-02-02T13:47:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 msgr2=0x7efed010c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7efecc0026d0 tx=0x7efecc009de0).stop 2022-02-02T13:47:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 shutdown_connections 2022-02-02T13:47:42.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc0691e0 0x7efebc06b6a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed00f55c0 0x7efed0109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 --2- 172.21.15.33:0/2526251401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00f6860 0x7efed010c100 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:42.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.990+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 >> 172.21.15.33:0/2526251401 conn(0x7efed00f0d40 msgr2=0x7efed00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.991+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 shutdown_connections 2022-02-02T13:47:42.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:42.991+0000 7efed803c700 1 -- 172.21.15.33:0/2526251401 wait complete. 2022-02-02T13:47:43.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 -- 172.21.15.33:0/39067285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 msgr2=0x7f76400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:43.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 --2- 172.21.15.33:0/39067285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f76400f59e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f763c004660 tx=0x7f763c009b30).stop 2022-02-02T13:47:43.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 -- 172.21.15.33:0/39067285 shutdown_connections 2022-02-02T13:47:43.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 --2- 172.21.15.33:0/39067285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 0x7f76400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 --2- 172.21.15.33:0/39067285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f76400f59e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 -- 172.21.15.33:0/39067285 >> 172.21.15.33:0/39067285 conn(0x7f76400f0d40 msgr2=0x7f76400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:43.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 -- 172.21.15.33:0/39067285 shutdown_connections 2022-02-02T13:47:43.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.092+0000 7f7647e64700 1 -- 172.21.15.33:0/39067285 wait complete. 2022-02-02T13:47:43.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 Processor -- start 2022-02-02T13:47:43.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 -- start start 2022-02-02T13:47:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 0x7f7640109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7640109c00 con 0x7f76400f55c0 2022-02-02T13:47:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7647e64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7640109d40 con 0x7f76400f6860 2022-02-02T13:47:43.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58162/0 (socket says 172.21.15.33:58162) 2022-02-02T13:47:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 -- 172.21.15.33:0/1389080475 learned_addr learned my addr 172.21.15.33:0/1389080475 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:47:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 -- 172.21.15.33:0/1389080475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 msgr2=0x7f7640109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:43.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f76453ff700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 0x7f7640109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 0x7f7640109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.093+0000 7f7645c00700 1 -- 172.21.15.33:0/1389080475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c005040 con 0x7f76400f55c0 2022-02-02T13:47:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f7645c00700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f763c004f60 tx=0x7f763c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:43.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c018070 con 0x7f76400f55c0 2022-02-02T13:47:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f763c007ba0 con 0x7f76400f55c0 2022-02-02T13:47:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764010a680 con 0x7f76400f55c0 2022-02-02T13:47:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f763c01c620 con 0x7f76400f55c0 2022-02-02T13:47:43.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.094+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764010abe0 con 0x7f76400f55c0 2022-02-02T13:47:43.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.095+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7640045ad0 con 0x7f76400f55c0 2022-02-02T13:47:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.095+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f763c01d420 con 0x7f76400f55c0 2022-02-02T13:47:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.096+0000 7f76367fc700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 0x7f762c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:47:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.096+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f763c0838e0 con 0x7f76400f55c0 2022-02-02T13:47:43.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.096+0000 7f76453ff700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 0x7f762c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:47:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.096+0000 7f76453ff700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 0x7f762c067290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f76300049e0 tx=0x7f7630009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:47:43.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.100+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f763c055480 con 0x7f76400f55c0 2022-02-02T13:47:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:42 smithi037 ceph-mon[69017]: pgmap v215: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:43.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.317+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f764010b270 con 0x7f76400f55c0 2022-02-02T13:47:43.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.317+0000 7f76367fc700 1 -- 172.21.15.33:0/1389080475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f763c055070 con 0x7f76400f55c0 2022-02-02T13:47:43.318 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:47:43.318 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:47:43.319 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:47:43.319 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:47:43.319 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:43.319 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:47:43.319 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:47:43.320 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:47:43.320 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:47:43.320 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:47:43.320 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:47:43.321 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:47:43.321 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:47:43.321 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:47:43.321 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:47:43.322 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:47:43.322 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:47:43.322 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:47:43.322 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:47:43.322 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:47:43.323 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:47:43.323 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:47:43.323 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:47:43.323 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:47:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:47:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:47:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:47:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:47:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:47:43.325 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:47:43.325 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:47:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:43.326 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:47:43.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:47:43.326 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:43.326 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:43.326 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:43.327 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:47:43.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 msgr2=0x7f762c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:43.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 0x7f762c067290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f76300049e0 tx=0x7f7630009040).stop 2022-02-02T13:47:43.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 msgr2=0x7f7640109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:47:43.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f763c004f60 tx=0x7f763c009b30).stop 2022-02-02T13:47:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 shutdown_connections 2022-02-02T13:47:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f762c064dd0 0x7f762c067290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76400f55c0 0x7f7640109160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 --2- 172.21.15.33:0/1389080475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400f6860 0x7f7640109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:47:43.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 >> 172.21.15.33:0/1389080475 conn(0x7f76400f0d40 msgr2=0x7f764005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:47:43.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 shutdown_connections 2022-02-02T13:47:43.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:47:43.319+0000 7f7647e64700 1 -- 172.21.15.33:0/1389080475 wait complete. 2022-02-02T13:47:43.331 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:47:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:43 smithi033 ceph-mon[101165]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:44.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:43 smithi033 ceph-mon[101165]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:44.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:43 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2526251401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:47:44.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:43 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1389080475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:47:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:43 smithi037 ceph-mon[69017]: from='client.34360 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:44.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:43 smithi037 ceph-mon[69017]: from='client.34364 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:47:44.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:43 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2526251401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:47:44.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:43 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1389080475' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:47:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:44 smithi033 ceph-mon[101165]: pgmap v216: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:44 smithi037 ceph-mon[69017]: pgmap v216: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:46 smithi033 ceph-mon[101165]: pgmap v217: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:46 smithi037 ceph-mon[69017]: pgmap v217: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:49.160 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:48 smithi037 ceph-mon[69017]: pgmap v218: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:48 smithi033 ceph-mon[101165]: pgmap v218: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:50 smithi033 ceph-mon[101165]: pgmap v219: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:51.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:50 smithi037 ceph-mon[69017]: pgmap v219: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:52 smithi033 ceph-mon[101165]: pgmap v220: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:52 smithi037 ceph-mon[69017]: pgmap v220: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:54 smithi033 ceph-mon[101165]: pgmap v221: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:47:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:47:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:54 smithi037 ceph-mon[69017]: pgmap v221: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:47:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:47:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:56 smithi033 ceph-mon[101165]: pgmap v222: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:56 smithi037 ceph-mon[69017]: pgmap v222: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:59.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:47:58 smithi033 ceph-mon[101165]: pgmap v223: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:47:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:47:58 smithi037 ceph-mon[69017]: pgmap v223: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:00 smithi033 ceph-mon[101165]: pgmap v224: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:00 smithi037 ceph-mon[69017]: pgmap v224: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:02 smithi033 ceph-mon[101165]: pgmap v225: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:02 smithi037 ceph-mon[69017]: pgmap v225: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:04 smithi033 ceph-mon[101165]: pgmap v226: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:48:05.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:48:05.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:48:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:04 smithi037 ceph-mon[69017]: pgmap v226: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:48:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:48:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:48:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:05 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:48:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:05 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:48:06.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:05 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:48:06.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:05 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:48:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:06 smithi033 ceph-mon[101165]: pgmap v227: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:06 smithi037 ceph-mon[69017]: pgmap v227: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:07 smithi033 ceph-mon[101165]: pgmap v228: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:07 smithi037 ceph-mon[69017]: pgmap v228: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:10 smithi033 ceph-mon[101165]: pgmap v229: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:10 smithi037 ceph-mon[69017]: pgmap v229: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:12 smithi033 ceph-mon[101165]: pgmap v230: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:12 smithi037 ceph-mon[69017]: pgmap v230: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:13.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.435+0000 7fb1602be700 1 -- 172.21.15.33:0/824851917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 msgr2=0x7fb1580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.435+0000 7fb1602be700 1 --2- 172.21.15.33:0/824851917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb1580f59e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb154004660 tx=0x7fb154009b30).stop 2022-02-02T13:48:13.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 -- 172.21.15.33:0/824851917 shutdown_connections 2022-02-02T13:48:13.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 --2- 172.21.15.33:0/824851917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 0x7fb1580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 --2- 172.21.15.33:0/824851917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb1580f59e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 -- 172.21.15.33:0/824851917 >> 172.21.15.33:0/824851917 conn(0x7fb1580f0d40 msgr2=0x7fb1580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:13.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 -- 172.21.15.33:0/824851917 shutdown_connections 2022-02-02T13:48:13.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 -- 172.21.15.33:0/824851917 wait complete. 2022-02-02T13:48:13.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 Processor -- start 2022-02-02T13:48:13.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.436+0000 7fb1602be700 1 -- start start 2022-02-02T13:48:13.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb1602be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb1602be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 0x7fb15810e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb1602be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580602b0 con 0x7fb1580f55c0 2022-02-02T13:48:13.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb1602be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580603f0 con 0x7fb1580f6860 2022-02-02T13:48:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58172/0 (socket says 172.21.15.33:58172) 2022-02-02T13:48:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 -- 172.21.15.33:0/2930995719 learned_addr learned my addr 172.21.15.33:0/2930995719 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15d859700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 0x7fb15810e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 -- 172.21.15.33:0/2930995719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 msgr2=0x7fb15810e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 0x7fb15810e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 -- 172.21.15.33:0/2930995719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb154005040 con 0x7fb1580f55c0 2022-02-02T13:48:13.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.437+0000 7fb15e05a700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fb154004f60 tx=0x7fb154009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:13.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.438+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb154018070 con 0x7fb1580f55c0 2022-02-02T13:48:13.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.438+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15810ea80 con 0x7fb1580f55c0 2022-02-02T13:48:13.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.438+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb154009770 con 0x7fb1580f55c0 2022-02-02T13:48:13.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.438+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb15401c3c0 con 0x7fb1580f55c0 2022-02-02T13:48:13.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.438+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15810ee50 con 0x7fb1580f55c0 2022-02-02T13:48:13.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.439+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb158045ad0 con 0x7fb1580f55c0 2022-02-02T13:48:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.439+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb15401d420 con 0x7fb1580f55c0 2022-02-02T13:48:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.440+0000 7fb14effd700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 0x7fb144067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.440+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb1540838a0 con 0x7fb1580f55c0 2022-02-02T13:48:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.440+0000 7fb15d859700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 0x7fb144067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.440+0000 7fb15d859700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 0x7fb144067290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb148007fd0 tx=0x7fb148009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.444+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb154051950 con 0x7fb1580f55c0 2022-02-02T13:48:13.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.632+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1580fded0 con 0x7fb144064dd0 2022-02-02T13:48:13.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.633+0000 7fb14effd700 1 -- 172.21.15.33:0/2930995719 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb1580fded0 con 0x7fb144064dd0 2022-02-02T13:48:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 msgr2=0x7fb144067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 0x7fb144067290 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb148007fd0 tx=0x7fb148009040).stop 2022-02-02T13:48:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 msgr2=0x7fb15810c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fb154004f60 tx=0x7fb154009b30).stop 2022-02-02T13:48:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 shutdown_connections 2022-02-02T13:48:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb144064dd0 0x7fb144067290 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1580f55c0 0x7fb15810c090 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 --2- 172.21.15.33:0/2930995719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1580f6860 0x7fb15810e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 >> 172.21.15.33:0/2930995719 conn(0x7fb1580f0d40 msgr2=0x7fb1580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:13.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.635+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 shutdown_connections 2022-02-02T13:48:13.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.636+0000 7fb1602be700 1 -- 172.21.15.33:0/2930995719 wait complete. 2022-02-02T13:48:13.646 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:48:13.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 -- 172.21.15.33:0/850792174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 msgr2=0x7f001c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 --2- 172.21.15.33:0/850792174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c0f6b30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f0010004660 tx=0x7f0010009b30).stop 2022-02-02T13:48:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 -- 172.21.15.33:0/850792174 shutdown_connections 2022-02-02T13:48:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 --2- 172.21.15.33:0/850792174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c0f6b30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 --2- 172.21.15.33:0/850792174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 0x7f001c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 -- 172.21.15.33:0/850792174 >> 172.21.15.33:0/850792174 conn(0x7f001c0f0b90 msgr2=0x7f001c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 -- 172.21.15.33:0/850792174 shutdown_connections 2022-02-02T13:48:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.738+0000 7f0021801700 1 -- 172.21.15.33:0/850792174 wait complete. 2022-02-02T13:48:13.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 Processor -- start 2022-02-02T13:48:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 -- start start 2022-02-02T13:48:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 0x7f001c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c109970 con 0x7f001c0f66d0 2022-02-02T13:48:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f0021801700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c109ab0 con 0x7f001c0f5430 2022-02-02T13:48:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f001b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f001b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58184/0 (socket says 172.21.15.33:58184) 2022-02-02T13:48:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f001b7fe700 1 -- 172.21.15.33:0/954823259 learned_addr learned my addr 172.21.15.33:0/954823259 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.739+0000 7f001bfff700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 0x7f001c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f001b7fe700 1 -- 172.21.15.33:0/954823259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 msgr2=0x7f001c108ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f001b7fe700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 0x7f001c108ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f001b7fe700 1 -- 172.21.15.33:0/954823259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010005040 con 0x7f001c0f66d0 2022-02-02T13:48:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f001b7fe700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0010009990 tx=0x7f0010009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0010018070 con 0x7f001c0f66d0 2022-02-02T13:48:13.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0010007ba0 con 0x7f001c0f66d0 2022-02-02T13:48:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c10a3f0 con 0x7f001c0f66d0 2022-02-02T13:48:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c10a950 con 0x7f001c0f66d0 2022-02-02T13:48:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.740+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f001001c3c0 con 0x7f001c0f66d0 2022-02-02T13:48:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.741+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c045ad0 con 0x7f001c0f66d0 2022-02-02T13:48:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.741+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f001001c680 con 0x7f001c0f66d0 2022-02-02T13:48:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.742+0000 7f0018ff9700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 0x7f00040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.742+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0010083750 con 0x7f001c0f66d0 2022-02-02T13:48:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.742+0000 7f001bfff700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 0x7f00040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.742+0000 7f001bfff700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 0x7f00040672e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f001c0f6530 tx=0x7f000c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.746+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0010055230 con 0x7f001c0f66d0 2022-02-02T13:48:13.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.928+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f001c0fa910 con 0x7f0004064e20 2022-02-02T13:48:13.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.943+0000 7f0018ff9700 1 -- 172.21.15.33:0/954823259 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f001c0fa910 con 0x7f0004064e20 2022-02-02T13:48:13.944 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:48:13.944 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (13m) 6m ago 14m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:48:13.944 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (6m) 6m ago 14m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:48:13.944 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (6m) 6m ago 13m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:48:13.944 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (13m) 6m ago 14m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:48:13.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (7m) 6m ago 10m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:48:13.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (7m) 6m ago 10m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:48:13.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (8m) 6m ago 10m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:48:13.945 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (10m) 6m ago 10m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:48:13.946 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (8m) 6m ago 15m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:48:13.946 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (7m) 6m ago 13m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:48:13.946 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (7m) 6m ago 15m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:48:13.946 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (7m) 6m ago 13m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:48:13.946 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (14m) 6m ago 14m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:48:13.947 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (13m) 6m ago 13m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:48:13.947 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (13m) 6m ago 13m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:48:13.947 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (12m) 6m ago 12m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:48:13.947 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (12m) 6m ago 12m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:48:13.948 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (12m) 6m ago 12m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:48:13.948 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (12m) 6m ago 12m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:48:13.948 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (11m) 6m ago 11m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:48:13.948 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (13m) 6m ago 14m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:48:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 msgr2=0x7f00040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 0x7f00040672e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f001c0f6530 tx=0x7f000c00b040).stop 2022-02-02T13:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 msgr2=0x7f001c1093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f0010009990 tx=0x7f0010009b30).stop 2022-02-02T13:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 shutdown_connections 2022-02-02T13:48:13.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0004064e20 0x7f00040672e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c0f5430 0x7f001c108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 --2- 172.21.15.33:0/954823259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f001c0f66d0 0x7f001c1093c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:13.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 >> 172.21.15.33:0/954823259 conn(0x7f001c0f0b90 msgr2=0x7f001c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:13.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 shutdown_connections 2022-02-02T13:48:13.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:13.945+0000 7f0021801700 1 -- 172.21.15.33:0/954823259 wait complete. 2022-02-02T13:48:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- 172.21.15.33:0/4181805090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c0f9690 msgr2=0x7fe45c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 --2- 172.21.15.33:0/4181805090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c0f9690 0x7fe45c0fbae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe44c004660 tx=0x7fe44c009b30).stop 2022-02-02T13:48:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- 172.21.15.33:0/4181805090 shutdown_connections 2022-02-02T13:48:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 --2- 172.21.15.33:0/4181805090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c0f9690 0x7fe45c0fbae0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 --2- 172.21.15.33:0/4181805090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c060310 0x7fe45c0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- 172.21.15.33:0/4181805090 >> 172.21.15.33:0/4181805090 conn(0x7fe45c0f0b90 msgr2=0x7fe45c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- 172.21.15.33:0/4181805090 shutdown_connections 2022-02-02T13:48:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- 172.21.15.33:0/4181805090 wait complete. 2022-02-02T13:48:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 Processor -- start 2022-02-02T13:48:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.048+0000 7fe462c01700 1 -- start start 2022-02-02T13:48:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe462c01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe462c01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c0f9690 0x7fe45c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe462c01700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0f5570 con 0x7fe45c060310 2022-02-02T13:48:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe462c01700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0f56b0 con 0x7fe45c0f9690 2022-02-02T13:48:14.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58192/0 (socket says 172.21.15.33:58192) 2022-02-02T13:48:14.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 -- 172.21.15.33:0/685081772 learned_addr learned my addr 172.21.15.33:0/685081772 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:14.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe4613fe700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c0f9690 0x7fe45c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 -- 172.21.15.33:0/685081772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c0f9690 msgr2=0x7fe45c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c0f9690 0x7fe45c0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 -- 172.21.15.33:0/685081772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c005040 con 0x7fe45c060310 2022-02-02T13:48:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe461bff700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe45800c530 tx=0x7fe458007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe45800f650 con 0x7fe45c060310 2022-02-02T13:48:14.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe45800fc60 con 0x7fe45c060310 2022-02-02T13:48:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.049+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe458012c20 con 0x7fe45c060310 2022-02-02T13:48:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.050+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0f5990 con 0x7fe45c060310 2022-02-02T13:48:14.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.050+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c10ed80 con 0x7fe45c060310 2022-02-02T13:48:14.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.051+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c045ad0 con 0x7fe45c060310 2022-02-02T13:48:14.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.051+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe458010070 con 0x7fe45c060310 2022-02-02T13:48:14.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.051+0000 7fe4527fc700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 0x7fe4480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.052+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe458081660 con 0x7fe45c060310 2022-02-02T13:48:14.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.052+0000 7fe4613fe700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 0x7fe4480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.052+0000 7fe4613fe700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 0x7fe4480672e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe44c013690 tx=0x7fe44c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:14.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.056+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe4580477d0 con 0x7fe45c060310 2022-02-02T13:48:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.304+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe45c027a00 con 0x7fe45c060310 2022-02-02T13:48:14.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.305+0000 7fe4527fc700 1 -- 172.21.15.33:0/685081772 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe45804f710 con 0x7fe45c060310 2022-02-02T13:48:14.306 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:48:14.306 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:48:14.306 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:48:14.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:14.307 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:48:14.307 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:48:14.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:14.308 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:48:14.308 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:48:14.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:14.308 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:48:14.308 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:48:14.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:14.309 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:48:14.309 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:48:14.309 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:48:14.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:48:14.310 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:48:14.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 msgr2=0x7fe4480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 0x7fe4480672e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fe44c013690 tx=0x7fe44c009b30).stop 2022-02-02T13:48:14.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 msgr2=0x7fe45c0f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fe45800c530 tx=0x7fe458007e20).stop 2022-02-02T13:48:14.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 shutdown_connections 2022-02-02T13:48:14.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe448064e20 0x7fe4480672e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe45c060310 0x7fe45c0f6b90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 --2- 172.21.15.33:0/685081772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe45c0f9690 0x7fe45c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 >> 172.21.15.33:0/685081772 conn(0x7fe45c0f0b90 msgr2=0x7fe45c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:14.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 shutdown_connections 2022-02-02T13:48:14.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.307+0000 7fe462c01700 1 -- 172.21.15.33:0/685081772 wait complete. 2022-02-02T13:48:14.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 -- 172.21.15.33:0/396703184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 msgr2=0x7fbdb40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/396703184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb40f59e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbd9c004660 tx=0x7fbd9c009b30).stop 2022-02-02T13:48:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 -- 172.21.15.33:0/396703184 shutdown_connections 2022-02-02T13:48:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/396703184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/396703184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb40f59e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 -- 172.21.15.33:0/396703184 >> 172.21.15.33:0/396703184 conn(0x7fbdb40f0d40 msgr2=0x7fbdb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:14.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 -- 172.21.15.33:0/396703184 shutdown_connections 2022-02-02T13:48:14.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 -- 172.21.15.33:0/396703184 wait complete. 2022-02-02T13:48:14.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.409+0000 7fbdb9e73700 1 Processor -- start 2022-02-02T13:48:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb9e73700 1 -- start start 2022-02-02T13:48:14.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb9e73700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb9e73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb9e73700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4107a10 con 0x7fbdb40f55c0 2022-02-02T13:48:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb9e73700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb4107b50 con 0x7fbdb40f6860 2022-02-02T13:48:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58202/0 (socket says 172.21.15.33:58202) 2022-02-02T13:48:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb37fe700 1 -- 172.21.15.33:0/1253359598 learned_addr learned my addr 172.21.15.33:0/1253359598 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb2ffd700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb37fe700 1 -- 172.21.15.33:0/1253359598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 msgr2=0x7fbdb4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.410+0000 7fbdb37fe700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdb37fe700 1 -- 172.21.15.33:0/1253359598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c005040 con 0x7fbdb40f55c0 2022-02-02T13:48:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdb2ffd700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:48:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdb37fe700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbd9c013a70 tx=0x7fbd9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c018070 con 0x7fbdb40f55c0 2022-02-02T13:48:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb4108490 con 0x7fbdb40f55c0 2022-02-02T13:48:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbd9c0097d0 con 0x7fbdb40f55c0 2022-02-02T13:48:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c01c3c0 con 0x7fbdb40f55c0 2022-02-02T13:48:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.411+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb41089f0 con 0x7fbdb40f55c0 2022-02-02T13:48:14.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.412+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb4045ad0 con 0x7fbdb40f55c0 2022-02-02T13:48:14.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.413+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbd9c007ba0 con 0x7fbdb40f55c0 2022-02-02T13:48:14.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.413+0000 7fbdabfff700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 0x7fbda0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:14.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.413+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbd9c083790 con 0x7fbdb40f55c0 2022-02-02T13:48:14.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.413+0000 7fbdb2ffd700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 0x7fbda0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:14.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.414+0000 7fbdb2ffd700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 0x7fbda0067290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbda4009740 tx=0x7fbda4009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:14.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.417+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbd9c055330 con 0x7fbdb40f55c0 2022-02-02T13:48:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.629+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbdb40fef60 con 0x7fbdb40f55c0 2022-02-02T13:48:14.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.629+0000 7fbdabfff700 1 -- 172.21.15.33:0/1253359598 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fbd9c054f20 con 0x7fbdb40f55c0 2022-02-02T13:48:14.630 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:48:14.630 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:48:14.631 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:48:14.631 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:48:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:14.631 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:48:14.632 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:48:14.632 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:48:14.632 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:48:14.632 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:48:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:48:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:48:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:48:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:48:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:48:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:48:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:48:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:48:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:48:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:48:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:48:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:48:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:48:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:48:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:48:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:48:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:48:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:48:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:48:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:48:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:48:14.637 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:14.637 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:14.638 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:48:14.638 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:14.638 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:14.638 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:14.639 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:14.639 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 msgr2=0x7fbda0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 0x7fbda0067290 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fbda4009740 tx=0x7fbda4009be0).stop 2022-02-02T13:48:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 msgr2=0x7fbdb4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fbd9c013a70 tx=0x7fbd9c009b30).stop 2022-02-02T13:48:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 shutdown_connections 2022-02-02T13:48:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbda0064dd0 0x7fbda0067290 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdb40f55c0 0x7fbdb4106f70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 --2- 172.21.15.33:0/1253359598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb40f6860 0x7fbdb4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:14.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 >> 172.21.15.33:0/1253359598 conn(0x7fbdb40f0d40 msgr2=0x7fbdb40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:14.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 shutdown_connections 2022-02-02T13:48:14.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:14.632+0000 7fbdb9e73700 1 -- 172.21.15.33:0/1253359598 wait complete. 2022-02-02T13:48:14.643 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:48:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:14 smithi033 ceph-mon[101165]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:14 smithi033 ceph-mon[101165]: pgmap v231: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:14 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/685081772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:48:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:14 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1253359598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:48:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:14 smithi037 ceph-mon[69017]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:14 smithi037 ceph-mon[69017]: pgmap v231: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:14 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/685081772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:48:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:14 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1253359598' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:48:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:15 smithi033 ceph-mon[101165]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:15 smithi033 ceph-mon[101165]: pgmap v232: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:15 smithi037 ceph-mon[69017]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:15 smithi037 ceph-mon[69017]: pgmap v232: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:18 smithi033 ceph-mon[101165]: pgmap v233: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:18 smithi037 ceph-mon[69017]: pgmap v233: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:20 smithi033 ceph-mon[101165]: pgmap v234: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:20 smithi037 ceph-mon[69017]: pgmap v234: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:21 smithi033 ceph-mon[101165]: pgmap v235: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:21 smithi037 ceph-mon[69017]: pgmap v235: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:23.819 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:23 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-02-02T13:48:24.240 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:23 smithi033 podman[113244]: 2022-02-02T13:48:24.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:24 smithi033 ceph-mon[101165]: pgmap v236: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:24.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:24 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:48:24.991 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:24 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:48:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:24 smithi037 ceph-mon[69017]: pgmap v236: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:26 smithi033 ceph-mon[101165]: pgmap v237: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:26 smithi037 ceph-mon[69017]: pgmap v237: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:28 smithi033 ceph-mon[101165]: pgmap v238: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:28 smithi037 ceph-mon[69017]: pgmap v238: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:29 smithi033 ceph-mon[101165]: pgmap v239: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:29 smithi037 ceph-mon[69017]: pgmap v239: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:31 smithi033 ceph-mon[101165]: pgmap v240: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:31 smithi037 ceph-mon[69017]: pgmap v240: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:33 smithi033 ceph-mon[101165]: pgmap v241: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:33 smithi037 ceph-mon[69017]: pgmap v241: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:34.992 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-02-02T13:48:34.993 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 3. 2022-02-02T13:48:34.993 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:48:34.993 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112245 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.993 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:34.994 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112447 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.994 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:34.994 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112488 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.994 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:34.995 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: Starting Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:48:34.995 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112245 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.995 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:34.995 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112447 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.996 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:34.996 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 112488 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:48:34.996 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:34 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:48:35.490 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:35 smithi033 bash[113370]: 8bac218f6bb48202290d9dcd4d6a9e434934ec971fc4428ae0c63fd78c1c2429 2022-02-02T13:48:35.922 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:35 smithi033 podman[113570]: 2022-02-02T13:48:36.659 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:48:36 smithi033 bash[112245]: time="2022-02-02T13:48:36Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-02-02T13:48:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:36 smithi033 ceph-mon[101165]: pgmap v242: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:36 smithi037 ceph-mon[69017]: pgmap v242: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:37 smithi033 ceph-mon[101165]: pgmap v243: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:37 smithi037 ceph-mon[69017]: pgmap v243: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:39 smithi033 ceph-mon[101165]: pgmap v244: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:39 smithi037 ceph-mon[69017]: pgmap v244: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:41 smithi033 ceph-mon[101165]: pgmap v245: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:41 smithi037 ceph-mon[69017]: pgmap v245: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:43 smithi033 ceph-mon[101165]: pgmap v246: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:44.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:43 smithi037 ceph-mon[69017]: pgmap v246: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:44.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 -- 172.21.15.33:0/3348635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f66e0 msgr2=0x7f38c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:44.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 --2- 172.21.15.33:0/3348635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f66e0 0x7f38c00f6b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f38bc004660 tx=0x7f38bc009b30).stop 2022-02-02T13:48:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 -- 172.21.15.33:0/3348635280 shutdown_connections 2022-02-02T13:48:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 --2- 172.21.15.33:0/3348635280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f7980 0x7f38c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 --2- 172.21.15.33:0/3348635280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f66e0 0x7f38c00f6b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 -- 172.21.15.33:0/3348635280 >> 172.21.15.33:0/3348635280 conn(0x7f38c00f1e40 msgr2=0x7f38c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:44.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 -- 172.21.15.33:0/3348635280 shutdown_connections 2022-02-02T13:48:44.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 -- 172.21.15.33:0/3348635280 wait complete. 2022-02-02T13:48:44.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.752+0000 7f38c870b700 1 Processor -- start 2022-02-02T13:48:44.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c870b700 1 -- start start 2022-02-02T13:48:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c870b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f66e0 0x7f38c0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c870b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c870b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0107a50 con 0x7f38c00f7980 2022-02-02T13:48:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c870b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c0107b90 con 0x7f38c00f66e0 2022-02-02T13:48:44.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:44.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58214/0 (socket says 172.21.15.33:58214) 2022-02-02T13:48:44.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 -- 172.21.15.33:0/2462830157 learned_addr learned my addr 172.21.15.33:0/2462830157 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:44.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c64a7700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f66e0 0x7f38c0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:44.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 -- 172.21.15.33:0/2462830157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f66e0 msgr2=0x7f38c0106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:44.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f66e0 0x7f38c0106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.753+0000 7f38c5ca6700 1 -- 172.21.15.33:0/2462830157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38bc005040 con 0x7f38c00f7980 2022-02-02T13:48:44.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38c5ca6700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f38b40026d0 tx=0x7f38b4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b4009320 con 0x7f38c00f7980 2022-02-02T13:48:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f38b400f040 con 0x7f38c00f7980 2022-02-02T13:48:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c0108530 con 0x7f38c00f7980 2022-02-02T13:48:44.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38b40147e0 con 0x7f38c00f7980 2022-02-02T13:48:44.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.754+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0108af0 con 0x7f38c00f7980 2022-02-02T13:48:44.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.755+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f38b4009480 con 0x7f38c00f7980 2022-02-02T13:48:44.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.755+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0045ad0 con 0x7f38c00f7980 2022-02-02T13:48:44.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.756+0000 7f38b2ffd700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 0x7f38ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:44.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.756+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f38b4082170 con 0x7f38c00f7980 2022-02-02T13:48:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.756+0000 7f38c64a7700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 0x7f38ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.756+0000 7f38c64a7700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 0x7f38ac067290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f38bc004630 tx=0x7f38bc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:44.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.760+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f38b4053c50 con 0x7f38c00f7980 2022-02-02T13:48:44.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.951+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38c0108d70 con 0x7f38ac064dd0 2022-02-02T13:48:44.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.952+0000 7f38b2ffd700 1 -- 172.21.15.33:0/2462830157 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f38c0108d70 con 0x7f38ac064dd0 2022-02-02T13:48:44.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 msgr2=0x7f38ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:44.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 0x7f38ac067290 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f38bc004630 tx=0x7f38bc009b30).stop 2022-02-02T13:48:44.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 msgr2=0x7f38c01074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:44.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f38b40026d0 tx=0x7f38b4009de0).stop 2022-02-02T13:48:44.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 shutdown_connections 2022-02-02T13:48:44.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f38ac064dd0 0x7f38ac067290 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38c00f66e0 0x7f38c0106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 --2- 172.21.15.33:0/2462830157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38c00f7980 0x7f38c01074a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:44.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.954+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 >> 172.21.15.33:0/2462830157 conn(0x7f38c00f1e40 msgr2=0x7f38c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:44.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.955+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 shutdown_connections 2022-02-02T13:48:44.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:44.955+0000 7f38c870b700 1 -- 172.21.15.33:0/2462830157 wait complete. 2022-02-02T13:48:44.965 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:48:45.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 -- 172.21.15.33:0/2474699351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 msgr2=0x7fc3bc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/2474699351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f5850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fc3ac004660 tx=0x7fc3ac009b30).stop 2022-02-02T13:48:45.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 -- 172.21.15.33:0/2474699351 shutdown_connections 2022-02-02T13:48:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/2474699351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/2474699351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f5850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 -- 172.21.15.33:0/2474699351 >> 172.21.15.33:0/2474699351 conn(0x7fc3bc0f0b90 msgr2=0x7fc3bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.056+0000 7fc3bb59e700 1 -- 172.21.15.33:0/2474699351 shutdown_connections 2022-02-02T13:48:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 -- 172.21.15.33:0/2474699351 wait complete. 2022-02-02T13:48:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 Processor -- start 2022-02-02T13:48:45.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 -- start start 2022-02-02T13:48:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0691f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0697f0 con 0x7fc3bc0f5430 2022-02-02T13:48:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3bb59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc10f870 con 0x7fc3bc0f66d0 2022-02-02T13:48:45.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58222/0 (socket says 172.21.15.33:58222) 2022-02-02T13:48:45.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.057+0000 7fc3ba59c700 1 -- 172.21.15.33:0/293209010 learned_addr learned my addr 172.21.15.33:0/293209010 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:45.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3b9d9b700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0691f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3ba59c700 1 -- 172.21.15.33:0/293209010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 msgr2=0x7fc3bc0691f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3ba59c700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0691f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3ba59c700 1 -- 172.21.15.33:0/293209010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac005040 con 0x7fc3bc0f5430 2022-02-02T13:48:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3ba59c700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc3ac000c00 tx=0x7fc3ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac007cf0 con 0x7fc3bc0f5430 2022-02-02T13:48:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc10faf0 con 0x7fc3bc0f5430 2022-02-02T13:48:45.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3ac007e50 con 0x7fc3bc0f5430 2022-02-02T13:48:45.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3ac01a6b0 con 0x7fc3bc0f5430 2022-02-02T13:48:45.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.058+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc10fff0 con 0x7fc3bc0f5430 2022-02-02T13:48:45.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.059+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc059100 con 0x7fc3bc0f5430 2022-02-02T13:48:45.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.060+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc3ac018040 con 0x7fc3bc0f5430 2022-02-02T13:48:45.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.060+0000 7fc3aaffd700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 0x7fc3a40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.060+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc3ac085a20 con 0x7fc3bc0f5430 2022-02-02T13:48:45.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.060+0000 7fc3b9d9b700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 0x7fc3a40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.061+0000 7fc3b9d9b700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 0x7fc3a40672e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc3bc10f4b0 tx=0x7fc3b0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.065+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3ac057500 con 0x7fc3bc0f5430 2022-02-02T13:48:45.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.246+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3bc05f620 con 0x7fc3a4064e20 2022-02-02T13:48:45.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.260+0000 7fc3aaffd700 1 -- 172.21.15.33:0/293209010 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc3bc05f620 con 0x7fc3a4064e20 2022-02-02T13:48:45.260 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:48:45.261 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (14m) 6m ago 15m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:48:45.261 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 6m ago 15m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:48:45.261 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (7m) 6m ago 14m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:48:45.261 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (13m) 6m ago 14m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:48:45.262 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (7m) 6m ago 11m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:48:45.262 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (8m) 6m ago 11m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:48:45.262 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (8m) 6m ago 11m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:48:45.262 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (11m) 6m ago 11m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:48:45.263 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (8m) 6m ago 16m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:48:45.263 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (8m) 6m ago 14m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:48:45.263 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 6m ago 16m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:48:45.263 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (7m) 6m ago 14m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:48:45.263 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (14m) 6m ago 14m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:48:45.264 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (14m) 6m ago 14m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:48:45.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (13m) 6m ago 13m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:48:45.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (13m) 6m ago 13m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:48:45.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (13m) 6m ago 13m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:48:45.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (12m) 6m ago 12m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:48:45.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (12m) 6m ago 12m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:48:45.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (12m) 6m ago 12m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:48:45.265 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (13m) 6m ago 14m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:48:45.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 msgr2=0x7fc3a40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 0x7fc3a40672e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc3bc10f4b0 tx=0x7fc3b0009040).stop 2022-02-02T13:48:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 msgr2=0x7fc3bc068d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc3ac000c00 tx=0x7fc3ac009b30).stop 2022-02-02T13:48:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 shutdown_connections 2022-02-02T13:48:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3a4064e20 0x7fc3a40672e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc068d00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 --2- 172.21.15.33:0/293209010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0691f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 >> 172.21.15.33:0/293209010 conn(0x7fc3bc0f0b90 msgr2=0x7fc3bc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 shutdown_connections 2022-02-02T13:48:45.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.262+0000 7fc3bb59e700 1 -- 172.21.15.33:0/293209010 wait complete. 2022-02-02T13:48:45.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 -- 172.21.15.33:0/498432791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f4bd0 msgr2=0x7fe61c0f4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 --2- 172.21.15.33:0/498432791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c0f4ff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe60c004770 tx=0x7fe60c00ac40).stop 2022-02-02T13:48:45.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 -- 172.21.15.33:0/498432791 shutdown_connections 2022-02-02T13:48:45.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 --2- 172.21.15.33:0/498432791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f5e70 0x7fe61c0f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 --2- 172.21.15.33:0/498432791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c0f4ff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 -- 172.21.15.33:0/498432791 >> 172.21.15.33:0/498432791 conn(0x7fe61c0f0330 msgr2=0x7fe61c0f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 -- 172.21.15.33:0/498432791 shutdown_connections 2022-02-02T13:48:45.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.363+0000 7fe621816700 1 -- 172.21.15.33:0/498432791 wait complete. 2022-02-02T13:48:45.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 Processor -- start 2022-02-02T13:48:45.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 -- start start 2022-02-02T13:48:45.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c104d40 con 0x7fe61c0f5e70 2022-02-02T13:48:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe621816700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61c104e80 con 0x7fe61c0f4bd0 2022-02-02T13:48:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe6127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe6127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58234/0 (socket says 172.21.15.33:58234) 2022-02-02T13:48:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe6127fc700 1 -- 172.21.15.33:0/2415734454 learned_addr learned my addr 172.21.15.33:0/2415734454 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.364+0000 7fe61affd700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe6127fc700 1 -- 172.21.15.33:0/2415734454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f4bd0 msgr2=0x7fe61c106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe6127fc700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe6127fc700 1 -- 172.21.15.33:0/2415734454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c005040 con 0x7fe61c0f5e70 2022-02-02T13:48:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe6127fc700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe60400e7f0 tx=0x7fe60400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6040092e0 con 0x7fe61c0f5e70 2022-02-02T13:48:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe60400f040 con 0x7fe61c0f5e70 2022-02-02T13:48:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61c105160 con 0x7fe61c0f5e70 2022-02-02T13:48:45.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe604014750 con 0x7fe61c0f5e70 2022-02-02T13:48:45.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.365+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61c10ed20 con 0x7fe61c0f5e70 2022-02-02T13:48:45.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.366+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61c045ad0 con 0x7fe61c0f5e70 2022-02-02T13:48:45.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.367+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe60401b030 con 0x7fe61c0f5e70 2022-02-02T13:48:45.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.367+0000 7fe613fff700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 0x7fe6080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.367+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe6040818a0 con 0x7fe61c0f5e70 2022-02-02T13:48:45.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.367+0000 7fe61affd700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 0x7fe6080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.367+0000 7fe61affd700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 0x7fe6080672e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe60c014560 tx=0x7fe60c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.371+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe60404fa00 con 0x7fe61c0f5e70 2022-02-02T13:48:45.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.618+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe61c027a00 con 0x7fe61c0f5e70 2022-02-02T13:48:45.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.619+0000 7fe613fff700 1 -- 172.21.15.33:0/2415734454 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe6040192d0 con 0x7fe61c0f5e70 2022-02-02T13:48:45.619 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:48:45.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:48:45.620 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:48:45.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:45.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:48:45.620 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:48:45.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:45.621 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:48:45.621 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:48:45.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:45.622 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:48:45.622 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:48:45.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:48:45.622 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:48:45.623 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:48:45.623 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:48:45.623 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:48:45.623 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:48:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.620+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 msgr2=0x7fe6080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.620+0000 7fe621816700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 0x7fe6080672e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fe60c014560 tx=0x7fe60c016040).stop 2022-02-02T13:48:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.620+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 msgr2=0x7fe61c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.620+0000 7fe621816700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7fe60400e7f0 tx=0x7fe60400b040).stop 2022-02-02T13:48:45.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 shutdown_connections 2022-02-02T13:48:45.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe608064e20 0x7fe6080672e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe61c0f4bd0 0x7fe61c106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 --2- 172.21.15.33:0/2415734454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe61c0f5e70 0x7fe61c1047e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 >> 172.21.15.33:0/2415734454 conn(0x7fe61c0f0330 msgr2=0x7fe61c0f98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 shutdown_connections 2022-02-02T13:48:45.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.621+0000 7fe621816700 1 -- 172.21.15.33:0/2415734454 wait complete. 2022-02-02T13:48:45.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 -- 172.21.15.33:0/1234435853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f7980 msgr2=0x7fd9500f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 --2- 172.21.15.33:0/1234435853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f7980 0x7fd9500f7de0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fd94c004660 tx=0x7fd94c009b30).stop 2022-02-02T13:48:45.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 -- 172.21.15.33:0/1234435853 shutdown_connections 2022-02-02T13:48:45.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 --2- 172.21.15.33:0/1234435853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f7980 0x7fd9500f7de0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 --2- 172.21.15.33:0/1234435853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f66e0 0x7fd9500f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 -- 172.21.15.33:0/1234435853 >> 172.21.15.33:0/1234435853 conn(0x7fd9500f1e40 msgr2=0x7fd9500f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 -- 172.21.15.33:0/1234435853 shutdown_connections 2022-02-02T13:48:45.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.723+0000 7fd957ad4700 1 -- 172.21.15.33:0/1234435853 wait complete. 2022-02-02T13:48:45.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 Processor -- start 2022-02-02T13:48:45.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 -- start start 2022-02-02T13:48:45.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950107a00 con 0x7fd9500f66e0 2022-02-02T13:48:45.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd957ad4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd950107b40 con 0x7fd9500f7980 2022-02-02T13:48:45.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.724+0000 7fd955870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58242/0 (socket says 172.21.15.33:58242) 2022-02-02T13:48:45.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 -- 172.21.15.33:0/2364563840 learned_addr learned my addr 172.21.15.33:0/2364563840 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:48:45.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd95506f700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 -- 172.21.15.33:0/2364563840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f7980 msgr2=0x7fd950107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 -- 172.21.15.33:0/2364563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c005040 con 0x7fd9500f66e0 2022-02-02T13:48:45.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd955870700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd940002700 tx=0x7fd940009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9400079c0 con 0x7fd9500f66e0 2022-02-02T13:48:45.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9501084e0 con 0x7fd9500f66e0 2022-02-02T13:48:45.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd94000f040 con 0x7fd9500f66e0 2022-02-02T13:48:45.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd940014860 con 0x7fd9500f66e0 2022-02-02T13:48:45.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.725+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd950108aa0 con 0x7fd9500f66e0 2022-02-02T13:48:45.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.726+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd950045ad0 con 0x7fd9500f66e0 2022-02-02T13:48:45.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.727+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd94001b060 con 0x7fd9500f66e0 2022-02-02T13:48:45.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.727+0000 7fd9467fc700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 0x7fd93c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:48:45.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.727+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd940081930 con 0x7fd9500f66e0 2022-02-02T13:48:45.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.727+0000 7fd95506f700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 0x7fd93c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:48:45.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.728+0000 7fd95506f700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 0x7fd93c067290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd94c004630 tx=0x7fd94c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:48:45.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.731+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd940053410 con 0x7fd9500f66e0 2022-02-02T13:48:45.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:45 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2415734454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:48:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.945+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9500ff020 con 0x7fd9500f66e0 2022-02-02T13:48:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.946+0000 7fd9467fc700 1 -- 172.21.15.33:0/2364563840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd940019070 con 0x7fd9500f66e0 2022-02-02T13:48:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:48:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:48:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:48:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:48:45.947 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:48:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:48:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:48:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:48:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:48:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:48:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:48:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:48:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:48:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:48:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:48:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:48:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:48:45.951 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:48:45.951 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:48:45.951 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:48:45.951 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:48:45.951 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:48:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:48:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:48:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:48:45.952 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:48:45.953 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:48:45.953 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:48:45.953 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:48:45.954 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:48:45.954 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:45.954 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:45.955 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:48:45.955 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:48:45.956 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:45.956 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:45.956 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:45.957 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:48:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 msgr2=0x7fd93c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 0x7fd93c067290 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd94c004630 tx=0x7fd94c009b30).stop 2022-02-02T13:48:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 msgr2=0x7fd950106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:48:45.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fd940002700 tx=0x7fd940009d80).stop 2022-02-02T13:48:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 shutdown_connections 2022-02-02T13:48:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd93c064dd0 0x7fd93c067290 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9500f66e0 0x7fd950106f60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 --2- 172.21.15.33:0/2364563840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9500f7980 0x7fd950107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:48:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 >> 172.21.15.33:0/2364563840 conn(0x7fd9500f1e40 msgr2=0x7fd9500fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:48:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 shutdown_connections 2022-02-02T13:48:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:48:45.948+0000 7fd957ad4700 1 -- 172.21.15.33:0/2364563840 wait complete. 2022-02-02T13:48:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:48:46.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:45 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2415734454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:48:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:46 smithi033 ceph-mon[101165]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:46 smithi033 ceph-mon[101165]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:46 smithi033 ceph-mon[101165]: pgmap v247: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2364563840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:48:47.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:46 smithi037 ceph-mon[69017]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:47.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:46 smithi037 ceph-mon[69017]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:48:47.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:46 smithi037 ceph-mon[69017]: pgmap v247: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:47.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2364563840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:48:48.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:47 smithi033 ceph-mon[101165]: pgmap v248: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:47 smithi037 ceph-mon[69017]: pgmap v248: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:49 smithi033 ceph-mon[101165]: pgmap v249: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:49 smithi037 ceph-mon[69017]: pgmap v249: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:51 smithi033 ceph-mon[101165]: pgmap v250: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:51 smithi037 ceph-mon[69017]: pgmap v250: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:54.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:53 smithi033 ceph-mon[101165]: pgmap v251: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:53 smithi037 ceph-mon[69017]: pgmap v251: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:48:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:48:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:48:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:48:56.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:56 smithi033 ceph-mon[101165]: pgmap v252: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:56 smithi037 ceph-mon[69017]: pgmap v252: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:58.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:57 smithi033 ceph-mon[101165]: pgmap v253: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:48:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:57 smithi037 ceph-mon[69017]: pgmap v253: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:48:59 smithi033 ceph-mon[101165]: pgmap v254: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:48:59 smithi037 ceph-mon[69017]: pgmap v254: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:01 smithi033 ceph-mon[101165]: pgmap v255: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:02.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:01 smithi037 ceph-mon[69017]: pgmap v255: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:03 smithi033 ceph-mon[101165]: pgmap v256: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:03 smithi037 ceph-mon[69017]: pgmap v256: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:49:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:49:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:04 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:49:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:49:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:49:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:04 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:49:06.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:06 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:49:06.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:49:06.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:06 smithi033 ceph-mon[101165]: pgmap v257: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:06.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:06 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:49:06.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:49:06.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:06 smithi037 ceph-mon[69017]: pgmap v257: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:07 smithi033 ceph-mon[101165]: pgmap v258: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:07 smithi037 ceph-mon[69017]: pgmap v258: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:09 smithi033 ceph-mon[101165]: pgmap v259: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:09 smithi037 ceph-mon[69017]: pgmap v259: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:11 smithi033 ceph-mon[101165]: pgmap v260: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:12.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:11 smithi037 ceph-mon[69017]: pgmap v260: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:13 smithi033 ceph-mon[101165]: pgmap v261: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:13 smithi037 ceph-mon[69017]: pgmap v261: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:16.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.065+0000 7fa77e42b700 1 -- 172.21.15.33:0/3954641147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f66e0 msgr2=0x7fa7780f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.065+0000 7fa77e42b700 1 --2- 172.21.15.33:0/3954641147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f66e0 0x7fa7780f6b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fa768004660 tx=0x7fa768009b30).stop 2022-02-02T13:49:16.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 -- 172.21.15.33:0/3954641147 shutdown_connections 2022-02-02T13:49:16.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 --2- 172.21.15.33:0/3954641147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f7980 0x7fa7780f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 --2- 172.21.15.33:0/3954641147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f66e0 0x7fa7780f6b00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 -- 172.21.15.33:0/3954641147 >> 172.21.15.33:0/3954641147 conn(0x7fa7780f1e40 msgr2=0x7fa7780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 -- 172.21.15.33:0/3954641147 shutdown_connections 2022-02-02T13:49:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 -- 172.21.15.33:0/3954641147 wait complete. 2022-02-02T13:49:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.066+0000 7fa77e42b700 1 Processor -- start 2022-02-02T13:49:16.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa77e42b700 1 -- start start 2022-02-02T13:49:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa77e42b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f66e0 0x7fa778106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa77e42b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa77e42b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778107a50 con 0x7fa7780f7980 2022-02-02T13:49:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa77e42b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa778107b90 con 0x7fa7780f66e0 2022-02-02T13:49:16.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58254/0 (socket says 172.21.15.33:58254) 2022-02-02T13:49:16.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 -- 172.21.15.33:0/685920029 learned_addr learned my addr 172.21.15.33:0/685920029 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:16.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa777fff700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f66e0 0x7fa778106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 -- 172.21.15.33:0/685920029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f66e0 msgr2=0x7fa778106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f66e0 0x7fa778106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.067+0000 7fa7777fe700 1 -- 172.21.15.33:0/685920029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768005040 con 0x7fa7780f7980 2022-02-02T13:49:16.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa7777fe700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa76c0026d0 tx=0x7fa76c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c0079c0 con 0x7fa7780f7980 2022-02-02T13:49:16.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa778108530 con 0x7fa7780f7980 2022-02-02T13:49:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa76c00f040 con 0x7fa7780f7980 2022-02-02T13:49:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76c0148b0 con 0x7fa7780f7980 2022-02-02T13:49:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.068+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778108af0 con 0x7fa7780f7980 2022-02-02T13:49:16.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.069+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa778045ad0 con 0x7fa7780f7980 2022-02-02T13:49:16.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.069+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa76c007b20 con 0x7fa7780f7980 2022-02-02T13:49:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.070+0000 7fa774ff9700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 0x7fa760067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.070+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa76c081a30 con 0x7fa7780f7980 2022-02-02T13:49:16.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.070+0000 7fa777fff700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 0x7fa760067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.070+0000 7fa777fff700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 0x7fa760067290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa768004630 tx=0x7fa768009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.075+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa76c053510 con 0x7fa7780f7980 2022-02-02T13:49:16.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.265+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa778108d70 con 0x7fa760064dd0 2022-02-02T13:49:16.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.266+0000 7fa774ff9700 1 -- 172.21.15.33:0/685920029 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa778108d70 con 0x7fa760064dd0 2022-02-02T13:49:16.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.268+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 msgr2=0x7fa760067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.268+0000 7fa77e42b700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 0x7fa760067290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fa768004630 tx=0x7fa768009b30).stop 2022-02-02T13:49:16.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.268+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 msgr2=0x7fa7781074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.268+0000 7fa77e42b700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fa76c0026d0 tx=0x7fa76c009de0).stop 2022-02-02T13:49:16.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 shutdown_connections 2022-02-02T13:49:16.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa760064dd0 0x7fa760067290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7780f66e0 0x7fa778106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 --2- 172.21.15.33:0/685920029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7780f7980 0x7fa7781074a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 >> 172.21.15.33:0/685920029 conn(0x7fa7780f1e40 msgr2=0x7fa7780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 shutdown_connections 2022-02-02T13:49:16.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.269+0000 7fa77e42b700 1 -- 172.21.15.33:0/685920029 wait complete. 2022-02-02T13:49:16.281 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:49:16.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 -- 172.21.15.33:0/4190667616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 msgr2=0x7f063c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 --2- 172.21.15.33:0/4190667616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c0f6b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f0638004660 tx=0x7f0638009b30).stop 2022-02-02T13:49:16.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 -- 172.21.15.33:0/4190667616 shutdown_connections 2022-02-02T13:49:16.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 --2- 172.21.15.33:0/4190667616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 --2- 172.21.15.33:0/4190667616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c0f6b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 -- 172.21.15.33:0/4190667616 >> 172.21.15.33:0/4190667616 conn(0x7f063c0f1e40 msgr2=0x7f063c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 -- 172.21.15.33:0/4190667616 shutdown_connections 2022-02-02T13:49:16.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.371+0000 7f0643b39700 1 -- 172.21.15.33:0/4190667616 wait complete. 2022-02-02T13:49:16.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 Processor -- start 2022-02-02T13:49:16.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 -- start start 2022-02-02T13:49:16.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c06a380 con 0x7f063c0f66e0 2022-02-02T13:49:16.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f0643b39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c06a4c0 con 0x7f063c0f7980 2022-02-02T13:49:16.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58260/0 (socket says 172.21.15.33:58260) 2022-02-02T13:49:16.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 -- 172.21.15.33:0/4055121801 learned_addr learned my addr 172.21.15.33:0/4055121801 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:16.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06410d4700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 -- 172.21.15.33:0/4055121801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 msgr2=0x7f063c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 -- 172.21.15.33:0/4055121801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638005040 con 0x7f063c0f66e0 2022-02-02T13:49:16.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06410d4700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:49:16.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.372+0000 7f06418d5700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0638014040 tx=0x7f063800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.373+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0638019070 con 0x7f063c0f66e0 2022-02-02T13:49:16.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.373+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0638007e70 con 0x7f063c0f66e0 2022-02-02T13:49:16.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.373+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0638014d50 con 0x7f063c0f66e0 2022-02-02T13:49:16.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.373+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c06a740 con 0x7f063c0f66e0 2022-02-02T13:49:16.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.373+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c06aca0 con 0x7f063c0f66e0 2022-02-02T13:49:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.374+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c045ad0 con 0x7f063c0f66e0 2022-02-02T13:49:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.374+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0638025070 con 0x7f063c0f66e0 2022-02-02T13:49:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.375+0000 7f062e7fc700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 0x7f0628067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.375+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f06380829c0 con 0x7f063c0f66e0 2022-02-02T13:49:16.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.375+0000 7f06410d4700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 0x7f0628067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.375+0000 7f06410d4700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 0x7f0628067290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0630009170 tx=0x7f063000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.379+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0638050a70 con 0x7f063c0f66e0 2022-02-02T13:49:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.562+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f063c0ff020 con 0x7f0628064dd0 2022-02-02T13:49:16.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.577+0000 7f062e7fc700 1 -- 172.21.15.33:0/4055121801 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f063c0ff020 con 0x7f0628064dd0 2022-02-02T13:49:16.578 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:49:16.578 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (14m) 7m ago 15m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:49:16.580 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (7m) 7m ago 15m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:49:16.580 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (7m) 7m ago 15m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:49:16.581 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (14m) 7m ago 15m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:49:16.581 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (8m) 7m ago 11m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:49:16.582 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (8m) 7m ago 11m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:49:16.583 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (9m) 7m ago 11m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:49:16.583 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (11m) 7m ago 11m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:49:16.584 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (9m) 7m ago 16m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:49:16.585 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (8m) 7m ago 14m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:49:16.585 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (8m) 7m ago 16m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:49:16.585 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (8m) 7m ago 14m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:49:16.586 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (15m) 7m ago 15m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:49:16.586 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (14m) 7m ago 14m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:49:16.586 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (14m) 7m ago 14m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:49:16.587 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (13m) 7m ago 13m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:49:16.587 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (13m) 7m ago 13m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:49:16.587 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (13m) 7m ago 13m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:49:16.587 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (13m) 7m ago 13m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:49:16.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (12m) 7m ago 12m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:49:16.588 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (14m) 7m ago 15m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:49:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.578+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 msgr2=0x7f0628067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.578+0000 7f0643b39700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 0x7f0628067290 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f0630009170 tx=0x7f063000b040).stop 2022-02-02T13:49:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.578+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 msgr2=0x7f063c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f0638014040 tx=0x7f063800b040).stop 2022-02-02T13:49:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 shutdown_connections 2022-02-02T13:49:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0628064dd0 0x7f0628067290 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f063c0f66e0 0x7f063c06b9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 --2- 172.21.15.33:0/4055121801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f063c0f7980 0x7f063c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 >> 172.21.15.33:0/4055121801 conn(0x7f063c0f1e40 msgr2=0x7f063c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 shutdown_connections 2022-02-02T13:49:16.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.579+0000 7f0643b39700 1 -- 172.21.15.33:0/4055121801 wait complete. 2022-02-02T13:49:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 -- 172.21.15.33:0/3146129915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 msgr2=0x7f480c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 --2- 172.21.15.33:0/3146129915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c0f6cc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f4800004660 tx=0x7f4800009b30).stop 2022-02-02T13:49:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 -- 172.21.15.33:0/3146129915 shutdown_connections 2022-02-02T13:49:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 --2- 172.21.15.33:0/3146129915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c0f6cc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 --2- 172.21.15.33:0/3146129915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 0x7f480c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 -- 172.21.15.33:0/3146129915 >> 172.21.15.33:0/3146129915 conn(0x7f480c0f0d40 msgr2=0x7f480c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 -- 172.21.15.33:0/3146129915 shutdown_connections 2022-02-02T13:49:16.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.679+0000 7f4812453700 1 -- 172.21.15.33:0/3146129915 wait complete. 2022-02-02T13:49:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 Processor -- start 2022-02-02T13:49:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 -- start start 2022-02-02T13:49:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 0x7f480c109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c109bb0 con 0x7f480c0f6860 2022-02-02T13:49:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f4812453700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c109cf0 con 0x7f480c0f55c0 2022-02-02T13:49:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f480b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f480b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58272/0 (socket says 172.21.15.33:58272) 2022-02-02T13:49:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.680+0000 7f480b7fe700 1 -- 172.21.15.33:0/3772973450 learned_addr learned my addr 172.21.15.33:0/3772973450 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f480bfff700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 0x7f480c109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f480b7fe700 1 -- 172.21.15.33:0/3772973450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 msgr2=0x7f480c109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f480b7fe700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 0x7f480c109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f480b7fe700 1 -- 172.21.15.33:0/3772973450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800005040 con 0x7f480c0f6860 2022-02-02T13:49:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f480b7fe700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4800000c00 tx=0x7f480000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4800019070 con 0x7f480c0f6860 2022-02-02T13:49:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4800007e70 con 0x7f480c0f6860 2022-02-02T13:49:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c10a630 con 0x7f480c0f6860 2022-02-02T13:49:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4800014d90 con 0x7f480c0f6860 2022-02-02T13:49:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.681+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c10ab90 con 0x7f480c0f6860 2022-02-02T13:49:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.682+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c045ad0 con 0x7f480c0f6860 2022-02-02T13:49:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.683+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4800025070 con 0x7f480c0f6860 2022-02-02T13:49:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.683+0000 7f4808ff9700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 0x7f47f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.683+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f48000829f0 con 0x7f480c0f6860 2022-02-02T13:49:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.683+0000 7f480bfff700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 0x7f47f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.683+0000 7f480bfff700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 0x7f47f4067290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f480c0f66c0 tx=0x7f47fc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.687+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4800084e60 con 0x7f480c0f6860 2022-02-02T13:49:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.929+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f480c10b220 con 0x7f480c0f6860 2022-02-02T13:49:16.930 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:16 smithi033 ceph-mon[101165]: pgmap v262: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:16.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.929+0000 7f4808ff9700 1 -- 172.21.15.33:0/3772973450 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f48000232d0 con 0x7f480c0f6860 2022-02-02T13:49:16.931 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:49:16.931 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:49:16.932 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:49:16.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:16.932 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:49:16.932 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:49:16.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:16.933 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:49:16.934 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:49:16.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:16.934 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:49:16.934 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:49:16.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:16.935 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:49:16.935 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:49:16.936 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:49:16.936 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:49:16.936 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:49:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.931+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 msgr2=0x7f47f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.931+0000 7f4812453700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 0x7f47f4067290 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f480c0f66c0 tx=0x7f47fc00b040).stop 2022-02-02T13:49:16.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.931+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 msgr2=0x7f480c109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.931+0000 7f4812453700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4800000c00 tx=0x7f480000b040).stop 2022-02-02T13:49:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 shutdown_connections 2022-02-02T13:49:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f4064dd0 0x7f47f4067290 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f55c0 0x7f480c109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 --2- 172.21.15.33:0/3772973450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f6860 0x7f480c109600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 >> 172.21.15.33:0/3772973450 conn(0x7f480c0f0d40 msgr2=0x7f480c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 shutdown_connections 2022-02-02T13:49:16.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:16.932+0000 7f4812453700 1 -- 172.21.15.33:0/3772973450 wait complete. 2022-02-02T13:49:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 -- 172.21.15.33:0/3816219116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 msgr2=0x7facb40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 --2- 172.21.15.33:0/3816219116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb40f59e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7faca4004660 tx=0x7faca4009b30).stop 2022-02-02T13:49:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 -- 172.21.15.33:0/3816219116 shutdown_connections 2022-02-02T13:49:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 --2- 172.21.15.33:0/3816219116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 0x7facb40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 --2- 172.21.15.33:0/3816219116 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb40f59e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 -- 172.21.15.33:0/3816219116 >> 172.21.15.33:0/3816219116 conn(0x7facb40f0d40 msgr2=0x7facb40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 -- 172.21.15.33:0/3816219116 shutdown_connections 2022-02-02T13:49:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.033+0000 7facb8f11700 1 -- 172.21.15.33:0/3816219116 wait complete. 2022-02-02T13:49:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 Processor -- start 2022-02-02T13:49:17.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 -- start start 2022-02-02T13:49:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 0x7facb410c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:17.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb40603e0 con 0x7facb40f55c0 2022-02-02T13:49:17.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb8f11700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb4060520 con 0x7facb40f6860 2022-02-02T13:49:17.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:17.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58278/0 (socket says 172.21.15.33:58278) 2022-02-02T13:49:17.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb259c700 1 -- 172.21.15.33:0/1336464392 learned_addr learned my addr 172.21.15.33:0/1336464392 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:17.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.034+0000 7facb1d9b700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 0x7facb410c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:17.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb259c700 1 -- 172.21.15.33:0/1336464392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 msgr2=0x7facb410c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb259c700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 0x7facb410c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb259c700 1 -- 172.21.15.33:0/1336464392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4005040 con 0x7facb40f55c0 2022-02-02T13:49:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb259c700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7faca4013a70 tx=0x7faca4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:17.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca4018070 con 0x7facb40f55c0 2022-02-02T13:49:17.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faca40097d0 con 0x7facb40f55c0 2022-02-02T13:49:17.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb410c650 con 0x7facb40f55c0 2022-02-02T13:49:17.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:16 smithi037 ceph-mon[69017]: pgmap v262: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faca401de80 con 0x7facb40f55c0 2022-02-02T13:49:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.035+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb410cbb0 con 0x7facb40f55c0 2022-02-02T13:49:17.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.036+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb4045ad0 con 0x7facb40f55c0 2022-02-02T13:49:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.037+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faca4007ba0 con 0x7facb40f55c0 2022-02-02T13:49:17.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.038+0000 7facaaffd700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 0x7faca0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:17.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.038+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faca4083bb0 con 0x7facb40f55c0 2022-02-02T13:49:17.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.038+0000 7facb1d9b700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 0x7faca0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:17.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.038+0000 7facb1d9b700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 0x7faca0067290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fac9c004c40 tx=0x7fac9c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:17.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.041+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faca4051da0 con 0x7facb40f55c0 2022-02-02T13:49:17.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.258+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7facb40fdf00 con 0x7facb40f55c0 2022-02-02T13:49:17.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.259+0000 7facaaffd700 1 -- 172.21.15.33:0/1336464392 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7faca40553c0 con 0x7facb40f55c0 2022-02-02T13:49:17.260 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:49:17.260 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:49:17.260 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:49:17.260 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:49:17.261 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:49:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:49:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:49:17.262 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:49:17.263 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:49:17.263 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:49:17.263 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:49:17.263 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:49:17.263 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:49:17.264 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:49:17.264 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:49:17.264 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:49:17.264 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:49:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:49:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:49:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:49:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:49:17.265 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:49:17.266 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:49:17.266 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:49:17.266 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:49:17.266 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:49:17.267 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:49:17.267 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:49:17.267 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:49:17.267 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:49:17.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:17.268 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:17.268 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:49:17.268 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:17.268 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:17.268 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:17.269 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:17.269 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 msgr2=0x7faca0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 0x7faca0067290 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fac9c004c40 tx=0x7fac9c00b040).stop 2022-02-02T13:49:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 msgr2=0x7facb4109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7faca4013a70 tx=0x7faca4009b30).stop 2022-02-02T13:49:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 shutdown_connections 2022-02-02T13:49:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faca0064dd0 0x7faca0067290 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facb40f55c0 0x7facb4109c00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 --2- 172.21.15.33:0/1336464392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facb40f6860 0x7facb410c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 >> 172.21.15.33:0/1336464392 conn(0x7facb40f0d40 msgr2=0x7facb40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 shutdown_connections 2022-02-02T13:49:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:17.262+0000 7facb8f11700 1 -- 172.21.15.33:0/1336464392 wait complete. 2022-02-02T13:49:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:49:17.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:17 smithi037 ceph-mon[69017]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:17.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:17 smithi037 ceph-mon[69017]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:17.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3772973450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:49:17.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1336464392' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:49:17.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:17 smithi033 ceph-mon[101165]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:17.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:17 smithi033 ceph-mon[101165]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:17.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3772973450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:49:17.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1336464392' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:49:18.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:18 smithi033 ceph-mon[101165]: pgmap v263: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:18 smithi037 ceph-mon[69017]: pgmap v263: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:20.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:19 smithi033 ceph-mon[101165]: pgmap v264: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:19 smithi037 ceph-mon[69017]: pgmap v264: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:21 smithi033 ceph-mon[101165]: pgmap v265: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:21 smithi037 ceph-mon[69017]: pgmap v265: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:24.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:23 smithi033 ceph-mon[101165]: pgmap v266: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:23 smithi037 ceph-mon[69017]: pgmap v266: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:26 smithi033 ceph-mon[101165]: pgmap v267: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:26 smithi037 ceph-mon[69017]: pgmap v267: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:27 smithi033 ceph-mon[101165]: pgmap v268: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:27 smithi037 ceph-mon[69017]: pgmap v268: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:29 smithi033 ceph-mon[101165]: pgmap v269: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:29 smithi037 ceph-mon[69017]: pgmap v269: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:31 smithi033 ceph-mon[101165]: pgmap v270: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:31 smithi037 ceph-mon[69017]: pgmap v270: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:33 smithi033 ceph-mon[101165]: pgmap v271: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:33 smithi037 ceph-mon[69017]: pgmap v271: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:36 smithi033 ceph-mon[101165]: pgmap v272: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:36 smithi037 ceph-mon[69017]: pgmap v272: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:37 smithi033 ceph-mon[101165]: pgmap v273: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:37 smithi037 ceph-mon[69017]: pgmap v273: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:39 smithi033 ceph-mon[101165]: pgmap v274: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:39 smithi037 ceph-mon[69017]: pgmap v274: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:41 smithi033 ceph-mon[101165]: pgmap v275: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:41 smithi037 ceph-mon[69017]: pgmap v275: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:43 smithi033 ceph-mon[101165]: pgmap v276: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:43 smithi037 ceph-mon[69017]: pgmap v276: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:46.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:46 smithi033 ceph-mon[101165]: pgmap v277: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:46 smithi037 ceph-mon[69017]: pgmap v277: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:47.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 -- 172.21.15.33:0/1652286467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 msgr2=0x7f8ecc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/1652286467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc0f59e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8ec8004660 tx=0x7f8ec8009b30).stop 2022-02-02T13:49:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 -- 172.21.15.33:0/1652286467 shutdown_connections 2022-02-02T13:49:47.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/1652286467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/1652286467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc0f59e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 -- 172.21.15.33:0/1652286467 >> 172.21.15.33:0/1652286467 conn(0x7f8ecc0f0d40 msgr2=0x7f8ecc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 -- 172.21.15.33:0/1652286467 shutdown_connections 2022-02-02T13:49:47.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.378+0000 7f8ed3b60700 1 -- 172.21.15.33:0/1652286467 wait complete. 2022-02-02T13:49:47.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 Processor -- start 2022-02-02T13:49:47.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 -- start start 2022-02-02T13:49:47.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc107a10 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed3b60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc107b50 con 0x7f8ecc0f6860 2022-02-02T13:49:47.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed18fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed18fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58288/0 (socket says 172.21.15.33:58288) 2022-02-02T13:49:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed18fc700 1 -- 172.21.15.33:0/3698817685 learned_addr learned my addr 172.21.15.33:0/3698817685 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.379+0000 7f8ed10fb700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed18fc700 1 -- 172.21.15.33:0/3698817685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 msgr2=0x7f8ecc107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed18fc700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed18fc700 1 -- 172.21.15.33:0/3698817685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec8005040 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed10fb700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:49:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed18fc700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8ec8004f60 tx=0x7f8ec8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec8018070 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ec8007ba0 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc108490 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec801c620 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.380+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1089f0 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.381+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc045ad0 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.382+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ec801d420 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.382+0000 7f8ec27fc700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 0x7f8eb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.382+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ec80838f0 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.382+0000 7f8ed10fb700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 0x7f8eb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.383+0000 7f8ed10fb700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 0x7f8eb8067290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8ebc0041d0 tx=0x7f8ebc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:47.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.386+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ec80553d0 con 0x7f8ecc0f55c0 2022-02-02T13:49:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.576+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ecc0faca0 con 0x7f8eb8064dd0 2022-02-02T13:49:47.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.577+0000 7f8ec27fc700 1 -- 172.21.15.33:0/3698817685 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8ecc0faca0 con 0x7f8eb8064dd0 2022-02-02T13:49:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 msgr2=0x7f8eb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 0x7f8eb8067290 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f8ebc0041d0 tx=0x7f8ebc009040).stop 2022-02-02T13:49:47.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 msgr2=0x7f8ecc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f8ec8004f60 tx=0x7f8ec8009b30).stop 2022-02-02T13:49:47.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 shutdown_connections 2022-02-02T13:49:47.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb8064dd0 0x7f8eb8067290 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc0f55c0 0x7f8ecc106f70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 --2- 172.21.15.33:0/3698817685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ecc0f6860 0x7f8ecc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 >> 172.21.15.33:0/3698817685 conn(0x7f8ecc0f0d40 msgr2=0x7f8ecc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 shutdown_connections 2022-02-02T13:49:47.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.579+0000 7f8ed3b60700 1 -- 172.21.15.33:0/3698817685 wait complete. 2022-02-02T13:49:47.591 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:49:47.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- 172.21.15.33:0/3649157155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f6860 msgr2=0x7f27680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 --2- 172.21.15.33:0/3649157155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f6860 0x7f27680f6cc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f2758004660 tx=0x7f2758009b30).stop 2022-02-02T13:49:47.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- 172.21.15.33:0/3649157155 shutdown_connections 2022-02-02T13:49:47.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 --2- 172.21.15.33:0/3649157155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f6860 0x7f27680f6cc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 --2- 172.21.15.33:0/3649157155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f55c0 0x7f27680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- 172.21.15.33:0/3649157155 >> 172.21.15.33:0/3649157155 conn(0x7f27680f0d40 msgr2=0x7f27680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:47.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- 172.21.15.33:0/3649157155 shutdown_connections 2022-02-02T13:49:47.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- 172.21.15.33:0/3649157155 wait complete. 2022-02-02T13:49:47.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 Processor -- start 2022-02-02T13:49:47.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.681+0000 7f276d3a2700 1 -- start start 2022-02-02T13:49:47.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f6860 0x7f2768105160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2768105760 con 0x7f27680f55c0 2022-02-02T13:49:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27681058a0 con 0x7f27680f6860 2022-02-02T13:49:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58298/0 (socket says 172.21.15.33:58298) 2022-02-02T13:49:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 -- 172.21.15.33:0/1095229493 learned_addr learned my addr 172.21.15.33:0/1095229493 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f27667fc700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f6860 0x7f2768105160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 -- 172.21.15.33:0/1095229493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f6860 msgr2=0x7f2768105160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f6860 0x7f2768105160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 -- 172.21.15.33:0/1095229493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758005040 con 0x7f27680f55c0 2022-02-02T13:49:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f2766ffd700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f275c002700 tx=0x7f275c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c0079c0 con 0x7f27680f55c0 2022-02-02T13:49:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f275c00f040 con 0x7f27680f55c0 2022-02-02T13:49:47.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2768106210 con 0x7f27680f55c0 2022-02-02T13:49:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f275c014850 con 0x7f27680f55c0 2022-02-02T13:49:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.682+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27681067d0 con 0x7f27680f55c0 2022-02-02T13:49:47.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.684+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2768045ad0 con 0x7f27680f55c0 2022-02-02T13:49:47.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.684+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f275c01b060 con 0x7f27680f55c0 2022-02-02T13:49:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.685+0000 7f274f7fe700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 0x7f2750067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.685+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f275c081900 con 0x7f27680f55c0 2022-02-02T13:49:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.685+0000 7f27667fc700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 0x7f2750067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.685+0000 7f27667fc700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 0x7f2750067290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2758004630 tx=0x7f2758009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:47.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.689+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f275c04f9b0 con 0x7f27680f55c0 2022-02-02T13:49:47.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.871+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27680faaa0 con 0x7f2750064dd0 2022-02-02T13:49:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.886+0000 7f274f7fe700 1 -- 172.21.15.33:0/1095229493 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f27680faaa0 con 0x7f2750064dd0 2022-02-02T13:49:47.887 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:49:47.887 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (15m) 7m ago 16m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:49:47.887 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 7m ago 16m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:49:47.887 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (8m) 7m ago 15m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:49:47.888 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (14m) 7m ago 15m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:49:47.888 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (8m) 7m ago 12m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:49:47.888 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (9m) 7m ago 12m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:49:47.888 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (9m) 7m ago 12m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:49:47.889 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (12m) 7m ago 12m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:49:47.889 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (9m) 7m ago 17m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:49:47.889 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (9m) 7m ago 15m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:49:47.889 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 7m ago 17m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:49:47.890 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (8m) 7m ago 15m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:49:47.890 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (15m) 7m ago 15m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:49:47.890 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (15m) 7m ago 15m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:49:47.890 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (14m) 7m ago 14m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:49:47.891 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (14m) 7m ago 14m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:49:47.891 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (14m) 7m ago 14m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:49:47.891 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (13m) 7m ago 13m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:49:47.891 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (13m) 7m ago 13m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:49:47.892 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (13m) 7m ago 13m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:49:47.892 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (14m) 7m ago 15m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:49:47.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 msgr2=0x7f2750067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 0x7f2750067290 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2758004630 tx=0x7f2758009b30).stop 2022-02-02T13:49:47.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 msgr2=0x7f2768104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f275c002700 tx=0x7f275c009e00).stop 2022-02-02T13:49:47.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 shutdown_connections 2022-02-02T13:49:47.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2750064dd0 0x7f2750067290 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27680f55c0 0x7f2768104c70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 --2- 172.21.15.33:0/1095229493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27680f6860 0x7f2768105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 >> 172.21.15.33:0/1095229493 conn(0x7f27680f0d40 msgr2=0x7f276805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 shutdown_connections 2022-02-02T13:49:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.888+0000 7f276d3a2700 1 -- 172.21.15.33:0/1095229493 wait complete. 2022-02-02T13:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 -- 172.21.15.33:0/585038556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f6a20 msgr2=0x7efdb40f6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 --2- 172.21.15.33:0/585038556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f6a20 0x7efdb40f6e40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7efda4004660 tx=0x7efda4009b30).stop 2022-02-02T13:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 -- 172.21.15.33:0/585038556 shutdown_connections 2022-02-02T13:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 --2- 172.21.15.33:0/585038556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f5720 0x7efdb40f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 --2- 172.21.15.33:0/585038556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f6a20 0x7efdb40f6e40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 -- 172.21.15.33:0/585038556 >> 172.21.15.33:0/585038556 conn(0x7efdb40f0330 msgr2=0x7efdb40f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 -- 172.21.15.33:0/585038556 shutdown_connections 2022-02-02T13:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.990+0000 7efdb972b700 1 -- 172.21.15.33:0/585038556 wait complete. 2022-02-02T13:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 Processor -- start 2022-02-02T13:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 -- start start 2022-02-02T13:49:47.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 0x7efdb4107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4107840 con 0x7efdb40f5720 2022-02-02T13:49:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb972b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb4108050 con 0x7efdb40f6a20 2022-02-02T13:49:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58308/0 (socket says 172.21.15.33:58308) 2022-02-02T13:49:47.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.991+0000 7efdb2ffd700 1 -- 172.21.15.33:0/3918879304 learned_addr learned my addr 172.21.15.33:0/3918879304 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:47.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb27fc700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 0x7efdb4107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:47.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb2ffd700 1 -- 172.21.15.33:0/3918879304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 msgr2=0x7efdb4107240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:47.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb2ffd700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 0x7efdb4107240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:47.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb2ffd700 1 -- 172.21.15.33:0/3918879304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4005040 con 0x7efdb40f5720 2022-02-02T13:49:47.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb27fc700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 0x7efdb4107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:49:47.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb2ffd700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7efda4014040 tx=0x7efda400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:47.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda4019070 con 0x7efdb40f5720 2022-02-02T13:49:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efda4007e70 con 0x7efdb40f5720 2022-02-02T13:49:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb4108270 con 0x7efdb40f5720 2022-02-02T13:49:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efda4014d50 con 0x7efdb40f5720 2022-02-02T13:49:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.992+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb41087d0 con 0x7efdb40f5720 2022-02-02T13:49:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.993+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb4059100 con 0x7efdb40f5720 2022-02-02T13:49:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.993+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efda4025070 con 0x7efdb40f5720 2022-02-02T13:49:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.994+0000 7efd9b7fe700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 0x7efd9c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.994+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efda4082ab0 con 0x7efdb40f5720 2022-02-02T13:49:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.994+0000 7efdb27fc700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 0x7efd9c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.994+0000 7efdb27fc700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 0x7efd9c0672e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efdb40f67f0 tx=0x7efda800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:47.998+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efda4050be0 con 0x7efdb40f5720 2022-02-02T13:49:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.240+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efdb40fddc0 con 0x7efdb40f5720 2022-02-02T13:49:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:47 smithi033 ceph-mon[101165]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:47 smithi033 ceph-mon[101165]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:48.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:47 smithi033 ceph-mon[101165]: pgmap v278: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:48.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.240+0000 7efd9b7fe700 1 -- 172.21.15.33:0/3918879304 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7efda4023070 con 0x7efdb40f5720 2022-02-02T13:49:48.242 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:49:48.243 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:49:48.243 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:49:48.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:48.243 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:49:48.243 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:49:48.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:48.244 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:49:48.244 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:49:48.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:48.245 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:49:48.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:49:48.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:49:48.245 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:49:48.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:49:48.246 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:49:48.246 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:49:48.246 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:49:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.242+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 msgr2=0x7efd9c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.242+0000 7efdb972b700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 0x7efd9c0672e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7efdb40f67f0 tx=0x7efda800b040).stop 2022-02-02T13:49:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.242+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 msgr2=0x7efdb4106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7efda4014040 tx=0x7efda400b040).stop 2022-02-02T13:49:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 shutdown_connections 2022-02-02T13:49:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd9c064e20 0x7efd9c0672e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb40f5720 0x7efdb4106d50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 --2- 172.21.15.33:0/3918879304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb40f6a20 0x7efdb4107240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 >> 172.21.15.33:0/3918879304 conn(0x7efdb40f0330 msgr2=0x7efdb40f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 shutdown_connections 2022-02-02T13:49:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.243+0000 7efdb972b700 1 -- 172.21.15.33:0/3918879304 wait complete. 2022-02-02T13:49:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:47 smithi037 ceph-mon[69017]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:47 smithi037 ceph-mon[69017]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:49:48.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:47 smithi037 ceph-mon[69017]: pgmap v278: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:48.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 -- 172.21.15.33:0/3798317408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 msgr2=0x7f68ac0f7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 --2- 172.21.15.33:0/3798317408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f7b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f68a0004660 tx=0x7f68a0009b30).stop 2022-02-02T13:49:48.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 -- 172.21.15.33:0/3798317408 shutdown_connections 2022-02-02T13:49:48.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 --2- 172.21.15.33:0/3798317408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f7b90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 --2- 172.21.15.33:0/3798317408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 0x7f68ac0f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 -- 172.21.15.33:0/3798317408 >> 172.21.15.33:0/3798317408 conn(0x7f68ac0f0330 msgr2=0x7f68ac0f2750 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:48.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 -- 172.21.15.33:0/3798317408 shutdown_connections 2022-02-02T13:49:48.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.344+0000 7f68b19c6700 1 -- 172.21.15.33:0/3798317408 wait complete. 2022-02-02T13:49:48.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 Processor -- start 2022-02-02T13:49:48.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 -- start start 2022-02-02T13:49:48.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 0x7f68ac0f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:48.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:48.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0f5e80 con 0x7f68ac0f5250 2022-02-02T13:49:48.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68b19c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68ac0f5fc0 con 0x7f68ac0f48b0 2022-02-02T13:49:48.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.345+0000 7f68aa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:48.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58320/0 (socket says 172.21.15.33:58320) 2022-02-02T13:49:48.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 -- 172.21.15.33:0/1752282018 learned_addr learned my addr 172.21.15.33:0/1752282018 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:49:48.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aaffd700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 0x7f68ac0f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 -- 172.21.15.33:0/1752282018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 msgr2=0x7f68ac0f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 0x7f68ac0f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 -- 172.21.15.33:0/1752282018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a0005040 con 0x7f68ac0f5250 2022-02-02T13:49:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68aa7fc700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f68a0004f60 tx=0x7f68a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a0018070 con 0x7f68ac0f5250 2022-02-02T13:49:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68a0009770 con 0x7f68ac0f5250 2022-02-02T13:49:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac0f6240 con 0x7f68ac0f5250 2022-02-02T13:49:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68a001c3c0 con 0x7f68ac0f5250 2022-02-02T13:49:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.346+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68ac0f67a0 con 0x7f68ac0f5250 2022-02-02T13:49:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.347+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68ac045ad0 con 0x7f68ac0f5250 2022-02-02T13:49:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.348+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68a001d420 con 0x7f68ac0f5250 2022-02-02T13:49:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.348+0000 7f68937fe700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 0x7f68940672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:49:48.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.348+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f68a0083890 con 0x7f68ac0f5250 2022-02-02T13:49:48.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.348+0000 7f68aaffd700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 0x7f68940672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:49:48.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.349+0000 7f68aaffd700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 0x7f68940672e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f689c0041d0 tx=0x7f689c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:49:48.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.352+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68a0051a00 con 0x7f68ac0f5250 2022-02-02T13:49:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.564+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f68ac0fef60 con 0x7f68ac0f5250 2022-02-02T13:49:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.565+0000 7f68937fe700 1 -- 172.21.15.33:0/1752282018 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f68a0055020 con 0x7f68ac0f5250 2022-02-02T13:49:48.565 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:49:48.566 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:49:48.566 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:49:48.566 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:49:48.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:48.567 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:49:48.567 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:49:48.567 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:49:48.568 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:49:48.568 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:49:48.568 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:49:48.568 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:49:48.568 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:49:48.569 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:49:48.569 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:49:48.569 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:49:48.570 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:49:48.570 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:49:48.570 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:49:48.571 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:49:48.571 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:49:48.571 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:49:48.571 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:49:48.572 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:49:48.572 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:49:48.572 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:49:48.572 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:49:48.573 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:49:48.573 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:49:48.573 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:49:48.573 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:49:48.573 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:48.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:48.574 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:49:48.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:49:48.574 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:48.574 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:48.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:48.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:49:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 msgr2=0x7f68940672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 0x7f68940672e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f689c0041d0 tx=0x7f689c009040).stop 2022-02-02T13:49:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 msgr2=0x7f68ac0f5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:49:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f68a0004f60 tx=0x7f68a0009b30).stop 2022-02-02T13:49:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 shutdown_connections 2022-02-02T13:49:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6894064e20 0x7f68940672e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68ac0f48b0 0x7f68ac0f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 --2- 172.21.15.33:0/1752282018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68ac0f5250 0x7f68ac0f5920 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:49:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 >> 172.21.15.33:0/1752282018 conn(0x7f68ac0f0330 msgr2=0x7f68ac0fb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:49:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 shutdown_connections 2022-02-02T13:49:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:49:48.568+0000 7f68b19c6700 1 -- 172.21.15.33:0/1752282018 wait complete. 2022-02-02T13:49:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:49:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:48 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3918879304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:49:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:48 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1752282018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:49:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:48 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3918879304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:49:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:48 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1752282018' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:49:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:49 smithi037 ceph-mon[69017]: pgmap v279: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:49 smithi033 ceph-mon[101165]: pgmap v279: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:51 smithi033 ceph-mon[101165]: pgmap v280: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:51 smithi037 ceph-mon[69017]: pgmap v280: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:54.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:53 smithi033 ceph-mon[101165]: pgmap v281: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:53 smithi037 ceph-mon[69017]: pgmap v281: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:49:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:49:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:49:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:49:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:56 smithi033 ceph-mon[101165]: pgmap v282: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:56 smithi037 ceph-mon[69017]: pgmap v282: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:58.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:57 smithi033 ceph-mon[101165]: pgmap v283: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:49:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:57 smithi037 ceph-mon[69017]: pgmap v283: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:00.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:49:59 smithi033 ceph-mon[101165]: pgmap v284: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:00.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 1 osds down; Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:00.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:50:00.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2022-02-02T13:50:00.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:50:00.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:50:00.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T13:50:00.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs has 1 failed mds 2022-02-02T13:50:00.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T13:50:00.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2022-02-02T13:50:00.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] OSD_DOWN: 1 osds down 2022-02-02T13:50:00.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : osd.0 (root=default,host=smithi033) is down 2022-02-02T13:50:00.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] PG_DEGRADED: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized 2022-02-02T13:50:00.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 1.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:00.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:00.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:00.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.2 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:00.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.4 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:00.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.5 is stuck undersized for 7m, current state active+undersized, last acting [3,4] 2022-02-02T13:50:00.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.8 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:00.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.9 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:00.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.c is stuck undersized for 7m, current state active+undersized, last acting [2,3] 2022-02-02T13:50:00.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,3] 2022-02-02T13:50:00.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,5] 2022-02-02T13:50:00.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:00.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.12 is stuck undersized for 7m, current state active+undersized, last acting [3,1] 2022-02-02T13:50:00.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.13 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:00.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,3] 2022-02-02T13:50:00.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.19 is stuck undersized for 7m, current state active+undersized, last acting [4,2] 2022-02-02T13:50:00.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,5] 2022-02-02T13:50:00.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.1d is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:00.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.1e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,5] 2022-02-02T13:50:00.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 2.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:00.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:00.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.3 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:00.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.6 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:00.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.c is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:00.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.11 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:00.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:49:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.12 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:00.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:00.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.17 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,2] 2022-02-02T13:50:00.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.18 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:00.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:00.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : pg 3.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,2] 2022-02-02T13:50:00.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T13:50:00.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T13:50:00.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T13:50:00.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T13:50:00.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T13:50:00.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:00.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T13:50:00.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T13:50:00.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:00.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:00.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Traceback (most recent call last): 2022-02-02T13:50:00.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T13:50:00.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : main() 2022-02-02T13:50:00.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T13:50:00.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : r = ctx.func(ctx) 2022-02-02T13:50:00.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T13:50:00.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : return func(ctx) 2022-02-02T13:50:00.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T13:50:00.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : ports=daemon_ports) 2022-02-02T13:50:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T13:50:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T13:50:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T13:50:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T13:50:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T13:50:00.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T13:50:00.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:00.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 conmon[101141]: 2022-02-02T13:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:49:59 smithi037 ceph-mon[69017]: pgmap v284: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:01.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 1 osds down; Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:50:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: fs cephfs is degraded 2022-02-02T13:50:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:50:01.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:50:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T13:50:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: fs cephfs has 1 failed mds 2022-02-02T13:50:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T13:50:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: fs cephfs is offline because no MDS is active for it. 2022-02-02T13:50:01.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] OSD_DOWN: 1 osds down 2022-02-02T13:50:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: osd.0 (root=default,host=smithi033) is down 2022-02-02T13:50:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] PG_DEGRADED: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized 2022-02-02T13:50:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 1.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.245 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.2 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:01.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.4 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:01.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.5 is stuck undersized for 7m, current state active+undersized, last acting [3,4] 2022-02-02T13:50:01.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.8 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:01.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.9 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:01.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.c is stuck undersized for 7m, current state active+undersized, last acting [2,3] 2022-02-02T13:50:01.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,3] 2022-02-02T13:50:01.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,5] 2022-02-02T13:50:01.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.12 is stuck undersized for 7m, current state active+undersized, last acting [3,1] 2022-02-02T13:50:01.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.13 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:01.248 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,3] 2022-02-02T13:50:01.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.19 is stuck undersized for 7m, current state active+undersized, last acting [4,2] 2022-02-02T13:50:01.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,5] 2022-02-02T13:50:01.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.1d is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:01.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.1e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,5] 2022-02-02T13:50:01.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 2.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.250 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:01.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.3 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:01.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.6 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:01.251 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:01.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.c is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:01.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:01.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:01.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.11 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.12 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.253 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.17 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,2] 2022-02-02T13:50:01.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.18 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:01.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: pg 3.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,2] 2022-02-02T13:50:01.254 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T13:50:01.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T13:50:01.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T13:50:01.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T13:50:01.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T13:50:01.255 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:01.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T13:50:01.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T13:50:01.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:01.256 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:01.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: Traceback (most recent call last): 2022-02-02T13:50:01.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T13:50:01.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: main() 2022-02-02T13:50:01.257 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T13:50:01.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: r = ctx.func(ctx) 2022-02-02T13:50:01.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T13:50:01.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: return func(ctx) 2022-02-02T13:50:01.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T13:50:01.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: ports=daemon_ports) 2022-02-02T13:50:01.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T13:50:01.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T13:50:01.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T13:50:01.259 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T13:50:01.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T13:50:01.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T13:50:01.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:01.260 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:00 smithi033 ceph-mon[101165]: See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 1 osds down; Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T13:50:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: fs cephfs is degraded 2022-02-02T13:50:01.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T13:50:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T13:50:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T13:50:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: fs cephfs has 1 failed mds 2022-02-02T13:50:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T13:50:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: fs cephfs is offline because no MDS is active for it. 2022-02-02T13:50:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] OSD_DOWN: 1 osds down 2022-02-02T13:50:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: osd.0 (root=default,host=smithi033) is down 2022-02-02T13:50:01.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] PG_DEGRADED: Degraded data redundancy: 8641/58314 objects degraded (14.818%), 28 pgs degraded, 34 pgs undersized 2022-02-02T13:50:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 1.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.0 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.2 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.4 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.5 is stuck undersized for 7m, current state active+undersized, last acting [3,4] 2022-02-02T13:50:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.8 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:01.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.9 is stuck undersized for 7m, current state active+undersized, last acting [1,4] 2022-02-02T13:50:01.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.c is stuck undersized for 7m, current state active+undersized, last acting [2,3] 2022-02-02T13:50:01.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,3] 2022-02-02T13:50:01.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,5] 2022-02-02T13:50:01.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.12 is stuck undersized for 7m, current state active+undersized, last acting [3,1] 2022-02-02T13:50:01.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.13 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:01.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,3] 2022-02-02T13:50:01.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.19 is stuck undersized for 7m, current state active+undersized, last acting [4,2] 2022-02-02T13:50:01.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,5] 2022-02-02T13:50:01.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.1d is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,5] 2022-02-02T13:50:01.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.1e is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,5] 2022-02-02T13:50:01.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 2.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.1 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,2] 2022-02-02T13:50:01.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.3 is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:01.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.6 is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:01.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.b is stuck undersized for 7m, current state active+undersized+degraded, last acting [1,4] 2022-02-02T13:50:01.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.c is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:01.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.f is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,3] 2022-02-02T13:50:01.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.10 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,1] 2022-02-02T13:50:01.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.11 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.12 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,1] 2022-02-02T13:50:01.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.15 is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,4] 2022-02-02T13:50:01.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.17 is stuck undersized for 7m, current state active+undersized+degraded, last acting [5,2] 2022-02-02T13:50:01.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.18 is stuck undersized for 7m, current state active+undersized+degraded, last acting [2,1] 2022-02-02T13:50:01.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.1b is stuck undersized for 7m, current state active+undersized+degraded, last acting [4,3] 2022-02-02T13:50:01.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: pg 3.1f is stuck undersized for 7m, current state active+undersized+degraded, last acting [3,2] 2022-02-02T13:50:01.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T13:50:01.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T13:50:01.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T13:50:01.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T13:50:01.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T13:50:01.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T13:50:01.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T13:50:01.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T13:50:01.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:01.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:01.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: Traceback (most recent call last): 2022-02-02T13:50:01.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T13:50:01.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: main() 2022-02-02T13:50:01.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T13:50:01.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: r = ctx.func(ctx) 2022-02-02T13:50:01.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T13:50:01.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: return func(ctx) 2022-02-02T13:50:01.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T13:50:01.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: ports=daemon_ports) 2022-02-02T13:50:01.307 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T13:50:01.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T13:50:01.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T13:50:01.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T13:50:01.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T13:50:01.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T13:50:01.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T13:50:01.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:00 smithi037 ceph-mon[69017]: See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T13:50:02.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:01 smithi037 ceph-mon[69017]: pgmap v285: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:01 smithi033 ceph-mon[101165]: pgmap v285: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:03 smithi033 ceph-mon[101165]: pgmap v286: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:03 smithi037 ceph-mon[69017]: pgmap v286: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:05 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:50:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:05 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:50:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:05 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:50:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:05 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:50:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:05 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:50:05.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:05 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:50:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:06 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:50:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:50:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:06 smithi033 ceph-mon[101165]: pgmap v287: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:06 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:50:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:50:07.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:06 smithi037 ceph-mon[69017]: pgmap v287: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:08 smithi033 ceph-mon[101165]: pgmap v288: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:08 smithi037 ceph-mon[69017]: pgmap v288: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:10 smithi033 ceph-mon[101165]: pgmap v289: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:10 smithi037 ceph-mon[69017]: pgmap v289: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:12 smithi033 ceph-mon[101165]: pgmap v290: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:12 smithi037 ceph-mon[69017]: pgmap v290: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:14 smithi033 ceph-mon[101165]: pgmap v291: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:14 smithi037 ceph-mon[69017]: pgmap v291: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:16 smithi033 ceph-mon[101165]: pgmap v292: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:17.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:16 smithi037 ceph-mon[69017]: pgmap v292: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:17 smithi033 ceph-mon[101165]: pgmap v293: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:17 smithi037 ceph-mon[69017]: pgmap v293: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:18.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 -- 172.21.15.33:0/4247255935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 msgr2=0x7f99200f9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:18.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 --2- 172.21.15.33:0/4247255935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f99200f9350 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f9914004660 tx=0x7f9914009b30).stop 2022-02-02T13:50:18.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 -- 172.21.15.33:0/4247255935 shutdown_connections 2022-02-02T13:50:18.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 --2- 172.21.15.33:0/4247255935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f99200fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 --2- 172.21.15.33:0/4247255935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f99200f9350 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 -- 172.21.15.33:0/4247255935 >> 172.21.15.33:0/4247255935 conn(0x7f99200f0d30 msgr2=0x7f99200f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 -- 172.21.15.33:0/4247255935 shutdown_connections 2022-02-02T13:50:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.686+0000 7f992587d700 1 -- 172.21.15.33:0/4247255935 wait complete. 2022-02-02T13:50:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 Processor -- start 2022-02-02T13:50:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 -- start start 2022-02-02T13:50:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f9920107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:18.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201079c0 con 0x7f9920060370 2022-02-02T13:50:18.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.687+0000 7f992587d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920107b00 con 0x7f99200f9840 2022-02-02T13:50:18.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58328/0 (socket says 172.21.15.33:58328) 2022-02-02T13:50:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 -- 172.21.15.33:0/2454956580 learned_addr learned my addr 172.21.15.33:0/2454956580 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991e7fc700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f9920107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 -- 172.21.15.33:0/2454956580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 msgr2=0x7f9920107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f9920107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 -- 172.21.15.33:0/2454956580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914005040 con 0x7f9920060370 2022-02-02T13:50:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991e7fc700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f9920107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:50:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f991effd700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9914000c00 tx=0x7f991400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9914019070 con 0x7f9920060370 2022-02-02T13:50:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9920108440 con 0x7f9920060370 2022-02-02T13:50:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9914007e70 con 0x7f9920060370 2022-02-02T13:50:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9914014d70 con 0x7f9920060370 2022-02-02T13:50:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.688+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99201089a0 con 0x7f9920060370 2022-02-02T13:50:18.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.689+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920045ad0 con 0x7f9920060370 2022-02-02T13:50:18.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.690+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9914025070 con 0x7f9920060370 2022-02-02T13:50:18.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.690+0000 7f99077fe700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 0x7f9908067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:18.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.691+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9914082a40 con 0x7f9920060370 2022-02-02T13:50:18.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.691+0000 7f991e7fc700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 0x7f9908067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:18.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.691+0000 7f991e7fc700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 0x7f9908067290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9910009fd0 tx=0x7f991000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:18.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.695+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9914054520 con 0x7f9920060370 2022-02-02T13:50:18.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.883+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9920108bc0 con 0x7f9908064dd0 2022-02-02T13:50:18.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.884+0000 7f99077fe700 1 -- 172.21.15.33:0/2454956580 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9920108bc0 con 0x7f9908064dd0 2022-02-02T13:50:18.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 msgr2=0x7f9908067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:18.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 0x7f9908067290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f9910009fd0 tx=0x7f991000b040).stop 2022-02-02T13:50:18.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 msgr2=0x7f9920106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:18.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9914000c00 tx=0x7f991400b040).stop 2022-02-02T13:50:18.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 shutdown_connections 2022-02-02T13:50:18.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9908064dd0 0x7f9908067290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9920060370 0x7f9920106f20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 --2- 172.21.15.33:0/2454956580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99200f9840 0x7f9920107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 >> 172.21.15.33:0/2454956580 conn(0x7f99200f0d30 msgr2=0x7f99200f3120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:18.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 shutdown_connections 2022-02-02T13:50:18.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.886+0000 7f992587d700 1 -- 172.21.15.33:0/2454956580 wait complete. 2022-02-02T13:50:18.896 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:50:18.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 -- 172.21.15.33:0/2788318786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 msgr2=0x7fee640f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:18.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2788318786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 0x7fee640f6b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fee54004660 tx=0x7fee54009b30).stop 2022-02-02T13:50:18.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 -- 172.21.15.33:0/2788318786 shutdown_connections 2022-02-02T13:50:18.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2788318786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee640f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2788318786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 0x7fee640f6b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:18.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 -- 172.21.15.33:0/2788318786 >> 172.21.15.33:0/2788318786 conn(0x7fee640f1e40 msgr2=0x7fee640f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:18.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 -- 172.21.15.33:0/2788318786 shutdown_connections 2022-02-02T13:50:18.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.988+0000 7fee69fd0700 1 -- 172.21.15.33:0/2788318786 wait complete. 2022-02-02T13:50:18.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 Processor -- start 2022-02-02T13:50:18.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 -- start start 2022-02-02T13:50:18.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 0x7fee6406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6406a380 con 0x7fee640f66e0 2022-02-02T13:50:19.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee69fd0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6406a4c0 con 0x7fee640f7980 2022-02-02T13:50:19.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.989+0000 7fee62ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:40824/0 (socket says 172.21.15.33:40824) 2022-02-02T13:50:19.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 -- 172.21.15.33:0/2361199921 learned_addr learned my addr 172.21.15.33:0/2361199921 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:19.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 -- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 msgr2=0x7fee6406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 0x7fee6406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:50:19.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 -- 172.21.15.33:0/2361199921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54005040 con 0x7fee640f7980 2022-02-02T13:50:19.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee62ffd700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fee5800e7f0 tx=0x7fee5800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee580092e0 con 0x7fee640f7980 2022-02-02T13:50:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee5800f040 con 0x7fee640f7980 2022-02-02T13:50:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6406a7a0 con 0x7fee640f7980 2022-02-02T13:50:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6410ef90 con 0x7fee640f7980 2022-02-02T13:50:19.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.990+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee58014750 con 0x7fee640f7980 2022-02-02T13:50:19.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.991+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee44004fa0 con 0x7fee640f7980 2022-02-02T13:50:19.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.992+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee5801b030 con 0x7fee640f7980 2022-02-02T13:50:19.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.993+0000 7fee4bfff700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 0x7fee4c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.993+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee580817f0 con 0x7fee640f7980 2022-02-02T13:50:19.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.993+0000 7fee637fe700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 0x7fee4c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.993+0000 7fee637fe700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 0x7fee4c067270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fee54000c00 tx=0x7fee5400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:18.999+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee5804f950 con 0x7fee640f7980 2022-02-02T13:50:19.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.180+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee44000bc0 con 0x7fee4c064db0 2022-02-02T13:50:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.195+0000 7fee4bfff700 1 -- 172.21.15.33:0/2361199921 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fee44000bc0 con 0x7fee4c064db0 2022-02-02T13:50:19.196 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:50:19.196 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (15m) 8m ago 16m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:50:19.196 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (8m) 8m ago 16m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:50:19.196 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (8m) 8m ago 16m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:50:19.197 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (15m) 8m ago 16m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:50:19.197 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (9m) 8m ago 12m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:50:19.197 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (9m) 8m ago 12m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:50:19.197 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (10m) 8m ago 12m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:50:19.197 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (12m) 8m ago 12m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:50:19.198 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (10m) 8m ago 17m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:50:19.198 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (9m) 8m ago 16m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:50:19.198 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (9m) 8m ago 18m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:50:19.198 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (9m) 8m ago 15m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:50:19.199 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (16m) 8m ago 16m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:50:19.199 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (15m) 8m ago 15m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:50:19.199 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (15m) 8m ago 15m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:50:19.199 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (15m) 8m ago 15m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:50:19.200 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (14m) 8m ago 14m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:50:19.200 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (14m) 8m ago 14m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:50:19.200 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (14m) 8m ago 14m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:50:19.200 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (13m) 8m ago 13m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:50:19.200 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (15m) 8m ago 16m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:50:19.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 msgr2=0x7fee4c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 0x7fee4c067270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fee54000c00 tx=0x7fee5400b040).stop 2022-02-02T13:50:19.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 msgr2=0x7fee64069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fee5800e7f0 tx=0x7fee5800b040).stop 2022-02-02T13:50:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 shutdown_connections 2022-02-02T13:50:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee4c064db0 0x7fee4c067270 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee640f66e0 0x7fee6406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:50:19.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 --2- 172.21.15.33:0/2361199921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee640f7980 0x7fee64069e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 >> 172.21.15.33:0/2361199921 conn(0x7fee640f1e40 msgr2=0x7fee640fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 shutdown_connections 2022-02-02T13:50:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.197+0000 7fee69fd0700 1 -- 172.21.15.33:0/2361199921 wait complete. 2022-02-02T13:50:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:18 smithi033 ceph-mon[101165]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:18 smithi037 ceph-mon[69017]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- 172.21.15.33:0/331067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f55c0 msgr2=0x7f8d5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 --2- 172.21.15.33:0/331067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c0f59e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8d44004660 tx=0x7f8d44009b30).stop 2022-02-02T13:50:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- 172.21.15.33:0/331067 shutdown_connections 2022-02-02T13:50:19.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 --2- 172.21.15.33:0/331067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 --2- 172.21.15.33:0/331067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c0f59e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- 172.21.15.33:0/331067 >> 172.21.15.33:0/331067 conn(0x7f8d5c0f0d40 msgr2=0x7f8d5c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:19.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- 172.21.15.33:0/331067 shutdown_connections 2022-02-02T13:50:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- 172.21.15.33:0/331067 wait complete. 2022-02-02T13:50:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 Processor -- start 2022-02-02T13:50:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.299+0000 7f8d6170b700 1 -- start start 2022-02-02T13:50:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d6170b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c10c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d6170b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d6170b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0602b0 con 0x7f8d5c0f6860 2022-02-02T13:50:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d6170b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0603f0 con 0x7f8d5c0f55c0 2022-02-02T13:50:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58350/0 (socket says 172.21.15.33:58350) 2022-02-02T13:50:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 -- 172.21.15.33:0/412847325 learned_addr learned my addr 172.21.15.33:0/412847325 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5affd700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c10c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 -- 172.21.15.33:0/412847325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f55c0 msgr2=0x7f8d5c10c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c10c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 -- 172.21.15.33:0/412847325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44005040 con 0x7f8d5c0f6860 2022-02-02T13:50:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d5a7fc700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8d4c00e7f0 tx=0x7f8d4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.300+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4c0092e0 con 0x7f8d5c0f6860 2022-02-02T13:50:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.301+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d4c00f040 con 0x7f8d5c0f6860 2022-02-02T13:50:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.301+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c10ea00 con 0x7f8d5c0f6860 2022-02-02T13:50:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.301+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4c014750 con 0x7f8d5c0f6860 2022-02-02T13:50:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.301+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c10ee80 con 0x7f8d5c0f6860 2022-02-02T13:50:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.302+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c045ad0 con 0x7f8d5c0f6860 2022-02-02T13:50:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.302+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d4c01b030 con 0x7f8d5c0f6860 2022-02-02T13:50:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.302+0000 7f8d537fe700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 0x7f8d48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.303+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8d4c0817c0 con 0x7f8d5c0f6860 2022-02-02T13:50:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.303+0000 7f8d5affd700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 0x7f8d48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.303+0000 7f8d5affd700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 0x7f8d48067290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8d44000c00 tx=0x7f8d4400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.307+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d4c04f920 con 0x7f8d5c0f6860 2022-02-02T13:50:19.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.550+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d5c027a00 con 0x7f8d5c0f6860 2022-02-02T13:50:19.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.551+0000 7f8d537fe700 1 -- 172.21.15.33:0/412847325 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8d4c0192d0 con 0x7f8d5c0f6860 2022-02-02T13:50:19.552 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:50:19.552 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:50:19.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:50:19.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:19.553 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:50:19.553 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:50:19.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:19.554 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:50:19.554 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:50:19.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:19.554 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:50:19.554 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:50:19.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:19.555 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:50:19.555 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:50:19.555 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:50:19.556 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:50:19.556 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:50:19.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.552+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 msgr2=0x7f8d48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.552+0000 7f8d6170b700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 0x7f8d48067290 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8d44000c00 tx=0x7f8d4400b040).stop 2022-02-02T13:50:19.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.552+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 msgr2=0x7f8d5c10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.552+0000 7f8d6170b700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f8d4c00e7f0 tx=0x7f8d4c00b040).stop 2022-02-02T13:50:19.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 shutdown_connections 2022-02-02T13:50:19.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d48064dd0 0x7f8d48067290 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d5c0f55c0 0x7f8d5c10c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 --2- 172.21.15.33:0/412847325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d5c0f6860 0x7f8d5c10e510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 >> 172.21.15.33:0/412847325 conn(0x7f8d5c0f0d40 msgr2=0x7f8d5c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 shutdown_connections 2022-02-02T13:50:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.553+0000 7f8d6170b700 1 -- 172.21.15.33:0/412847325 wait complete. 2022-02-02T13:50:19.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.654+0000 7fc67f59e700 1 -- 172.21.15.33:0/2455237083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f66d0 msgr2=0x7fc6800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.654+0000 7fc67f59e700 1 --2- 172.21.15.33:0/2455237083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f66d0 0x7fc6800f6b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc674004660 tx=0x7fc674009b30).stop 2022-02-02T13:50:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- 172.21.15.33:0/2455237083 shutdown_connections 2022-02-02T13:50:19.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 --2- 172.21.15.33:0/2455237083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f66d0 0x7fc6800f6b30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 --2- 172.21.15.33:0/2455237083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f5430 0x7fc6800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- 172.21.15.33:0/2455237083 >> 172.21.15.33:0/2455237083 conn(0x7fc6800f0b90 msgr2=0x7fc6800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:19.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- 172.21.15.33:0/2455237083 shutdown_connections 2022-02-02T13:50:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- 172.21.15.33:0/2455237083 wait complete. 2022-02-02T13:50:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 Processor -- start 2022-02-02T13:50:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- start start 2022-02-02T13:50:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f66d0 0x7fc680107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680107870 con 0x7fc6800f5430 2022-02-02T13:50:19.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.655+0000 7fc67f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6801080b0 con 0x7fc6800f66d0 2022-02-02T13:50:19.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58358/0 (socket says 172.21.15.33:58358) 2022-02-02T13:50:19.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 -- 172.21.15.33:0/3493278998 learned_addr learned my addr 172.21.15.33:0/3493278998 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:19.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67dd9b700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f66d0 0x7fc680107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 -- 172.21.15.33:0/3493278998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f66d0 msgr2=0x7fc680107270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f66d0 0x7fc680107270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 -- 172.21.15.33:0/3493278998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc674005040 con 0x7fc6800f5430 2022-02-02T13:50:19.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67e59c700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc67000c530 tx=0x7fc670007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67000f650 con 0x7fc6800f5430 2022-02-02T13:50:19.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc680108390 con 0x7fc6800f5430 2022-02-02T13:50:19.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc67000fc60 con 0x7fc6800f5430 2022-02-02T13:50:19.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc670012cb0 con 0x7fc6800f5430 2022-02-02T13:50:19.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.656+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6801088d0 con 0x7fc6800f5430 2022-02-02T13:50:19.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.657+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc680059100 con 0x7fc6800f5430 2022-02-02T13:50:19.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.658+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc670019030 con 0x7fc6800f5430 2022-02-02T13:50:19.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.658+0000 7fc66effd700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 0x7fc6680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:19.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.658+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc670081740 con 0x7fc6800f5430 2022-02-02T13:50:19.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.658+0000 7fc67dd9b700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 0x7fc6680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:19.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.659+0000 7fc67dd9b700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 0x7fc6680672e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc674004630 tx=0x7fc674009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:19.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.662+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc67004f7e0 con 0x7fc6800f5430 2022-02-02T13:50:19.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.873+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc680045b50 con 0x7fc6800f5430 2022-02-02T13:50:19.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.874+0000 7fc66effd700 1 -- 172.21.15.33:0/3493278998 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc680045b50 con 0x7fc6800f5430 2022-02-02T13:50:19.875 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:50:19.875 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:50:19.876 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:50:19.876 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:50:19.876 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:19.876 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:50:19.877 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:50:19.877 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:50:19.877 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:50:19.877 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:50:19.878 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:50:19.878 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:50:19.878 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:50:19.878 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:50:19.879 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:50:19.879 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:50:19.879 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:50:19.879 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:50:19.880 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:50:19.880 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:50:19.880 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:50:19.880 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:50:19.881 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:50:19.881 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:50:19.881 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:50:19.881 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:50:19.882 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:50:19.882 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:50:19.882 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:50:19.882 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:50:19.883 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:50:19.883 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:19.883 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:19.884 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:50:19.884 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:19.884 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:19.884 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:19.885 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:19.885 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:19.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 msgr2=0x7fc6680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 0x7fc6680672e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fc674004630 tx=0x7fc674009b30).stop 2022-02-02T13:50:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 msgr2=0x7fc680106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc67000c530 tx=0x7fc670007e10).stop 2022-02-02T13:50:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 shutdown_connections 2022-02-02T13:50:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc668064e20 0x7fc6680672e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6800f5430 0x7fc680106d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 --2- 172.21.15.33:0/3493278998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800f66d0 0x7fc680107270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 >> 172.21.15.33:0/3493278998 conn(0x7fc6800f0b90 msgr2=0x7fc68005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 shutdown_connections 2022-02-02T13:50:19.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:19.876+0000 7fc67f59e700 1 -- 172.21.15.33:0/3493278998 wait complete. 2022-02-02T13:50:19.889 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:50:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:19 smithi033 ceph-mon[101165]: from='client.44329 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:20.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:19 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/412847325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:50:20.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:19 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3493278998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:50:20.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:19 smithi033 ceph-mon[101165]: pgmap v294: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:20.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:19 smithi037 ceph-mon[69017]: from='client.44329 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:20.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:19 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/412847325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:50:20.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:19 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3493278998' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:50:20.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:19 smithi037 ceph-mon[69017]: pgmap v294: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:21 smithi033 ceph-mon[101165]: pgmap v295: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:21 smithi037 ceph-mon[69017]: pgmap v295: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:23 smithi037 ceph-mon[69017]: pgmap v296: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:23 smithi033 ceph-mon[101165]: pgmap v296: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:26.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:26 smithi033 ceph-mon[101165]: pgmap v297: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:26 smithi037 ceph-mon[69017]: pgmap v297: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:27 smithi037 ceph-mon[69017]: pgmap v298: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:27 smithi033 ceph-mon[101165]: pgmap v298: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:29 smithi037 ceph-mon[69017]: pgmap v299: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:29 smithi033 ceph-mon[101165]: pgmap v299: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:31 smithi037 ceph-mon[69017]: pgmap v300: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:31 smithi033 ceph-mon[101165]: pgmap v300: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:33 smithi037 ceph-mon[69017]: pgmap v301: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:33 smithi033 ceph-mon[101165]: pgmap v301: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:35.431 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:34 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-02-02T13:50:35.740 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:35 smithi033 podman[114374]: 2022-02-02T13:50:36.687 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:36 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:50:36.687 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:36 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:50:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:36 smithi033 ceph-mon[101165]: pgmap v302: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:36 smithi037 ceph-mon[69017]: pgmap v302: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:37 smithi037 ceph-mon[69017]: pgmap v303: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:37 smithi033 ceph-mon[101165]: pgmap v303: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:39 smithi037 ceph-mon[69017]: pgmap v304: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:39 smithi033 ceph-mon[101165]: pgmap v304: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:41 smithi037 ceph-mon[69017]: pgmap v305: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:41 smithi033 ceph-mon[101165]: pgmap v305: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:43 smithi037 ceph-mon[69017]: pgmap v306: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:43 smithi033 ceph-mon[101165]: pgmap v306: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:46.796 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:46 smithi033 ceph-mon[101165]: pgmap v307: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:46.796 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-02-02T13:50:46.797 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 4. 2022-02-02T13:50:46.797 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:50:46.797 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113370 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:46.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113570 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:46.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113610 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.798 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:46.799 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: Starting Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c... 2022-02-02T13:50:46.799 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113370 (bash) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.799 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:46.800 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113570 (podman) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.800 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:46.800 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 113610 (conmon) in control group while starting unit. Ignoring. 2022-02-02T13:50:46.800 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-02-02T13:50:47.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:46 smithi037 ceph-mon[69017]: pgmap v307: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:47.210 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:46 smithi033 bash[114496]: 7719c2b60fa1580c47964240f7ee4dd68c2454ca74c74eb2f294b55c17c0a8e8 2022-02-02T13:50:47.490 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:47 smithi033 podman[114696]: 2022-02-02T13:50:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:47 smithi037 ceph-mon[69017]: pgmap v308: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:48.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:47 smithi033 ceph-mon[101165]: pgmap v308: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:48.492 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:50:48 smithi033 bash[113370]: time="2022-02-02T13:50:48Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-02-02T13:50:50.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 -- 172.21.15.33:0/2262749589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 msgr2=0x7f071c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 --2- 172.21.15.33:0/2262749589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c0f7de0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f070c004660 tx=0x7f070c009b30).stop 2022-02-02T13:50:50.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 -- 172.21.15.33:0/2262749589 shutdown_connections 2022-02-02T13:50:50.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 --2- 172.21.15.33:0/2262749589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c0f7de0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 --2- 172.21.15.33:0/2262749589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 -- 172.21.15.33:0/2262749589 >> 172.21.15.33:0/2262749589 conn(0x7f071c0f1e40 msgr2=0x7f071c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.998+0000 7f0723863700 1 -- 172.21.15.33:0/2262749589 shutdown_connections 2022-02-02T13:50:50.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 -- 172.21.15.33:0/2262749589 wait complete. 2022-02-02T13:50:50.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 Processor -- start 2022-02-02T13:50:50.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 -- start start 2022-02-02T13:50:50.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c06a380 con 0x7f071c0f7980 2022-02-02T13:50:50.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0723863700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c06a4c0 con 0x7f071c0f66e0 2022-02-02T13:50:50.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:49.999+0000 7f0720dfe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58370/0 (socket says 172.21.15.33:58370) 2022-02-02T13:50:50.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 -- 172.21.15.33:0/2048241474 learned_addr learned my addr 172.21.15.33:0/2048241474 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:50.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f07215ff700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 -- 172.21.15.33:0/2048241474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 msgr2=0x7f071c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 -- 172.21.15.33:0/2048241474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c005040 con 0x7f071c0f7980 2022-02-02T13:50:50.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f07215ff700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:50:50.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0720dfe700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f070c002040 tx=0x7f070c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f070c019070 con 0x7f071c0f7980 2022-02-02T13:50:50.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f070c007e70 con 0x7f071c0f7980 2022-02-02T13:50:50.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c06a740 con 0x7f071c0f7980 2022-02-02T13:50:50.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.000+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f070c014e30 con 0x7f071c0f7980 2022-02-02T13:50:50.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.001+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c06aca0 con 0x7f071c0f7980 2022-02-02T13:50:50.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.001+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c045ad0 con 0x7f071c0f7980 2022-02-02T13:50:50.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.002+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f070c025070 con 0x7f071c0f7980 2022-02-02T13:50:50.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.003+0000 7f0711ffb700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 0x7f0708067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.003+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f070c082ea0 con 0x7f071c0f7980 2022-02-02T13:50:50.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.003+0000 7f07215ff700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 0x7f0708067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.003+0000 7f07215ff700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 0x7f0708067210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f071c06b730 tx=0x7f071800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.006+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f070c050fd0 con 0x7f071c0f7980 2022-02-02T13:50:50.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.195+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f071c057f10 con 0x7f0708064d50 2022-02-02T13:50:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.196+0000 7f0711ffb700 1 -- 172.21.15.33:0/2048241474 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f071c057f10 con 0x7f0708064d50 2022-02-02T13:50:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 msgr2=0x7f0708067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 0x7f0708067210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f071c06b730 tx=0x7f071800b040).stop 2022-02-02T13:50:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 msgr2=0x7f071c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f070c002040 tx=0x7f070c00b040).stop 2022-02-02T13:50:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 shutdown_connections 2022-02-02T13:50:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0708064d50 0x7f0708067210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f071c0f66e0 0x7f071c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 --2- 172.21.15.33:0/2048241474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f071c0f7980 0x7f071c069e20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 >> 172.21.15.33:0/2048241474 conn(0x7f071c0f1e40 msgr2=0x7f071c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 shutdown_connections 2022-02-02T13:50:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.198+0000 7f0723863700 1 -- 172.21.15.33:0/2048241474 wait complete. 2022-02-02T13:50:50.208 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:50:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:49 smithi037 ceph-mon[69017]: pgmap v309: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 -- 172.21.15.33:0/1637117861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f55c0 msgr2=0x7f43700f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 --2- 172.21.15.33:0/1637117861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f55c0 0x7f43700f59e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f4358004660 tx=0x7f4358009b30).stop 2022-02-02T13:50:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 -- 172.21.15.33:0/1637117861 shutdown_connections 2022-02-02T13:50:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 --2- 172.21.15.33:0/1637117861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f6860 0x7f43700f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 --2- 172.21.15.33:0/1637117861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f55c0 0x7f43700f59e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 -- 172.21.15.33:0/1637117861 >> 172.21.15.33:0/1637117861 conn(0x7f43700f0d40 msgr2=0x7f43700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.303 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:49 smithi033 ceph-mon[101165]: pgmap v309: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 -- 172.21.15.33:0/1637117861 shutdown_connections 2022-02-02T13:50:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.301+0000 7f4375c73700 1 -- 172.21.15.33:0/1637117861 wait complete. 2022-02-02T13:50:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 Processor -- start 2022-02-02T13:50:50.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 -- start start 2022-02-02T13:50:50.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f55c0 0x7f4370105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370106950 con 0x7f43700f6860 2022-02-02T13:50:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f4375c73700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4370107160 con 0x7f43700f55c0 2022-02-02T13:50:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f436effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f436effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58380/0 (socket says 172.21.15.33:58380) 2022-02-02T13:50:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f436effd700 1 -- 172.21.15.33:0/845505101 learned_addr learned my addr 172.21.15.33:0/845505101 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.302+0000 7f436f7fe700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f55c0 0x7f4370105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f436effd700 1 -- 172.21.15.33:0/845505101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f55c0 msgr2=0x7f4370105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f436effd700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f55c0 0x7f4370105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f436effd700 1 -- 172.21.15.33:0/845505101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358005040 con 0x7f43700f6860 2022-02-02T13:50:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f436effd700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f436000f970 tx=0x7f4360009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4360009500 con 0x7f43700f6860 2022-02-02T13:50:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4370107380 con 0x7f43700f6860 2022-02-02T13:50:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4360009660 con 0x7f43700f6860 2022-02-02T13:50:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f436000de60 con 0x7f43700f6860 2022-02-02T13:50:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.303+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4370107910 con 0x7f43700f6860 2022-02-02T13:50:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.304+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4370045ad0 con 0x7f43700f6860 2022-02-02T13:50:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.305+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f436000e040 con 0x7f43700f6860 2022-02-02T13:50:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.305+0000 7f4367fff700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 0x7f435c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.305+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4360084890 con 0x7f43700f6860 2022-02-02T13:50:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.305+0000 7f436f7fe700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 0x7f435c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.306+0000 7f436f7fe700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 0x7f435c067270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4370105bd0 tx=0x7f4358009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.309+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4360052940 con 0x7f43700f6860 2022-02-02T13:50:50.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.490+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43700ff8a0 con 0x7f435c064db0 2022-02-02T13:50:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.505+0000 7f4367fff700 1 -- 172.21.15.33:0/845505101 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f43700ff8a0 con 0x7f435c064db0 2022-02-02T13:50:50.505 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:50:50.505 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (16m) 8m ago 17m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:50:50.505 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (9m) 8m ago 17m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:50:50.506 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (9m) 9m ago 16m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:50:50.506 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (15m) 8m ago 16m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:50:50.506 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (9m) 8m ago 13m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:50:50.506 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (10m) 8m ago 13m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:50:50.507 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (11m) 9m ago 13m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:50:50.507 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (13m) 9m ago 13m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:50:50.507 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (10m) 8m ago 18m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:50:50.507 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (10m) 9m ago 16m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:50:50.508 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (10m) 8m ago 18m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:50:50.508 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (9m) 9m ago 16m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:50:50.508 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (16m) 8m ago 16m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:50:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (16m) 9m ago 16m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:50:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (15m) 8m ago 15m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:50:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (15m) 8m ago 15m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:50:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (15m) 8m ago 15m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:50:50.509 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (15m) 9m ago 14m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:50:50.510 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (14m) 9m ago 14m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:50:50.510 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (14m) 9m ago 14m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:50:50.510 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (15m) 8m ago 16m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:50:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.506+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 msgr2=0x7f435c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.506+0000 7f4375c73700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 0x7f435c067270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f4370105bd0 tx=0x7f4358009b30).stop 2022-02-02T13:50:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.506+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 msgr2=0x7f4370106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.506+0000 7f4375c73700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f436000f970 tx=0x7f4360009e00).stop 2022-02-02T13:50:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 shutdown_connections 2022-02-02T13:50:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f435c064db0 0x7f435c067270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43700f55c0 0x7f4370105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 --2- 172.21.15.33:0/845505101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43700f6860 0x7f4370106350 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 >> 172.21.15.33:0/845505101 conn(0x7f43700f0d40 msgr2=0x7f43700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 shutdown_connections 2022-02-02T13:50:50.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.507+0000 7f4375c73700 1 -- 172.21.15.33:0/845505101 wait complete. 2022-02-02T13:50:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 -- 172.21.15.33:0/2559489987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 msgr2=0x7fc3980f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/2559489987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f6b30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fc384004660 tx=0x7fc384009b30).stop 2022-02-02T13:50:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 -- 172.21.15.33:0/2559489987 shutdown_connections 2022-02-02T13:50:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/2559489987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f6b30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/2559489987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 0x7fc3980f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.607+0000 7fc39dbbe700 1 -- 172.21.15.33:0/2559489987 >> 172.21.15.33:0/2559489987 conn(0x7fc3980f0b90 msgr2=0x7fc3980f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.608+0000 7fc39dbbe700 1 -- 172.21.15.33:0/2559489987 shutdown_connections 2022-02-02T13:50:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.608+0000 7fc39dbbe700 1 -- 172.21.15.33:0/2559489987 wait complete. 2022-02-02T13:50:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.608+0000 7fc39dbbe700 1 Processor -- start 2022-02-02T13:50:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.608+0000 7fc39dbbe700 1 -- start start 2022-02-02T13:50:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc39dbbe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 0x7fc3980f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc39dbbe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc39dbbe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980f8790 con 0x7fc3980f66d0 2022-02-02T13:50:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc39dbbe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3980f88d0 con 0x7fc3980f5430 2022-02-02T13:50:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58390/0 (socket says 172.21.15.33:58390) 2022-02-02T13:50:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 -- 172.21.15.33:0/1511016525 learned_addr learned my addr 172.21.15.33:0/1511016525 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc39cbbc700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 0x7fc3980f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 -- 172.21.15.33:0/1511016525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 msgr2=0x7fc3980f9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 0x7fc3980f9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 -- 172.21.15.33:0/1511016525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc384005040 con 0x7fc3980f66d0 2022-02-02T13:50:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc397fff700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc384009990 tx=0x7fc384009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc384018070 con 0x7fc3980f66d0 2022-02-02T13:50:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.609+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc384007ba0 con 0x7fc3980f66d0 2022-02-02T13:50:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.610+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3980f8b50 con 0x7fc3980f66d0 2022-02-02T13:50:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.610+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc38401c3c0 con 0x7fc3980f66d0 2022-02-02T13:50:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.610+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3980f90b0 con 0x7fc3980f66d0 2022-02-02T13:50:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.611+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc378004fa0 con 0x7fc3980f66d0 2022-02-02T13:50:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.611+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc38401c680 con 0x7fc3980f66d0 2022-02-02T13:50:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.612+0000 7fc3957fa700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 0x7fc3880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.612+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc384083730 con 0x7fc3980f66d0 2022-02-02T13:50:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.612+0000 7fc39cbbc700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 0x7fc3880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.612+0000 7fc39cbbc700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 0x7fc3880672e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc3980f9b40 tx=0x7fc38c009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.616+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3840518a0 con 0x7fc3980f66d0 2022-02-02T13:50:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.861+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc378005e80 con 0x7fc3980f66d0 2022-02-02T13:50:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.861+0000 7fc3957fa700 1 -- 172.21.15.33:0/1511016525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc384054ec0 con 0x7fc3980f66d0 2022-02-02T13:50:50.863 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:50:50.863 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:50:50.864 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:50:50.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:50.864 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:50:50.865 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:50:50.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:50.866 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:50:50.866 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:50:50.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:50.867 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:50:50.867 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:50:50.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:50:50.869 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:50:50.870 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:50:50.870 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:50:50.870 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:50:50.871 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:50:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 msgr2=0x7fc3880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 0x7fc3880672e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fc3980f9b40 tx=0x7fc38c009c00).stop 2022-02-02T13:50:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 msgr2=0x7fc3980f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fc384009990 tx=0x7fc384009b30).stop 2022-02-02T13:50:50.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 shutdown_connections 2022-02-02T13:50:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc388064e20 0x7fc3880672e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3980f5430 0x7fc3980f9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 --2- 172.21.15.33:0/1511016525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3980f66d0 0x7fc3980f8230 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 >> 172.21.15.33:0/1511016525 conn(0x7fc3980f0b90 msgr2=0x7fc39805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 shutdown_connections 2022-02-02T13:50:50.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.863+0000 7fc39dbbe700 1 -- 172.21.15.33:0/1511016525 wait complete. 2022-02-02T13:50:50.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 -- 172.21.15.33:0/2910919384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 msgr2=0x7f64300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 --2- 172.21.15.33:0/2910919384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64300f6cc0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f6420004660 tx=0x7f6420009b30).stop 2022-02-02T13:50:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 -- 172.21.15.33:0/2910919384 shutdown_connections 2022-02-02T13:50:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 --2- 172.21.15.33:0/2910919384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64300f6cc0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 --2- 172.21.15.33:0/2910919384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 0x7f64300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 -- 172.21.15.33:0/2910919384 >> 172.21.15.33:0/2910919384 conn(0x7f64300f0d40 msgr2=0x7f64300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 -- 172.21.15.33:0/2910919384 shutdown_connections 2022-02-02T13:50:50.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.965+0000 7f64355c0700 1 -- 172.21.15.33:0/2910919384 wait complete. 2022-02-02T13:50:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 Processor -- start 2022-02-02T13:50:50.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 -- start start 2022-02-02T13:50:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 0x7f6430106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430107990 con 0x7f64300f6860 2022-02-02T13:50:50.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f64355c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430107ad0 con 0x7f64300f55c0 2022-02-02T13:50:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58400/0 (socket says 172.21.15.33:58400) 2022-02-02T13:50:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 -- 172.21.15.33:0/1020128678 learned_addr learned my addr 172.21.15.33:0/1020128678 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:50:50.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642effd700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 0x7f6430106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 -- 172.21.15.33:0/1020128678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 msgr2=0x7f6430106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 0x7f6430106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:50.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 -- 172.21.15.33:0/1020128678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420005040 con 0x7f64300f6860 2022-02-02T13:50:50.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.966+0000 7f642e7fc700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6420000c00 tx=0x7f642000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.967+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6420019070 con 0x7f64300f6860 2022-02-02T13:50:50.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.967+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6430108410 con 0x7f64300f6860 2022-02-02T13:50:50.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.967+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6420007e70 con 0x7f64300f6860 2022-02-02T13:50:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.967+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6420014d90 con 0x7f64300f6860 2022-02-02T13:50:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.967+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6430108970 con 0x7f64300f6860 2022-02-02T13:50:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.968+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6430045ad0 con 0x7f64300f6860 2022-02-02T13:50:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.968+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6420025070 con 0x7f64300f6860 2022-02-02T13:50:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.969+0000 7f64177fe700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 0x7f6418067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:50:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.969+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6420082a60 con 0x7f64300f6860 2022-02-02T13:50:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.969+0000 7f642effd700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 0x7f6418067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:50:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.969+0000 7f642effd700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 0x7f6418067290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f64300f66c0 tx=0x7f642400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:50:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:50.973+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6420054540 con 0x7f64300f6860 2022-02-02T13:50:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.189+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64300fdd80 con 0x7f64300f6860 2022-02-02T13:50:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.189+0000 7f64177fe700 1 -- 172.21.15.33:0/1020128678 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6420023020 con 0x7f64300f6860 2022-02-02T13:50:51.190 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:50:51.191 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:50:51.191 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:50:51.191 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:50:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:51.192 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:50:51.192 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:50:51.192 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:50:51.192 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:50:51.193 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:50:51.193 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:50:51.193 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:50:51.193 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:50:51.194 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:50:51.194 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:50:51.194 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:50:51.194 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:50:51.194 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:50:51.195 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:50:51.195 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:50:51.195 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:50:51.195 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:50:51.196 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:50:51.196 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:50:51.196 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:50:51.196 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:50:51.197 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:50:51.197 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:50:51.197 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:50:51.197 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:50:51.197 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:50:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:51.198 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:50:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:50:51.199 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:51.199 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:51.199 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:51.199 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:50:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.191+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 msgr2=0x7f6418067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.191+0000 7f64355c0700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 0x7f6418067290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f64300f66c0 tx=0x7f642400b040).stop 2022-02-02T13:50:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.191+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 msgr2=0x7f64301073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:50:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.191+0000 7f64355c0700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6420000c00 tx=0x7f642000b040).stop 2022-02-02T13:50:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.191+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 shutdown_connections 2022-02-02T13:50:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6418064dd0 0x7f6418067290 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64300f55c0 0x7f6430106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 --2- 172.21.15.33:0/1020128678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64300f6860 0x7f64301073e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:50:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 >> 172.21.15.33:0/1020128678 conn(0x7f64300f0d40 msgr2=0x7f643005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:50:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 shutdown_connections 2022-02-02T13:50:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:50:51.192+0000 7f64355c0700 1 -- 172.21.15.33:0/1020128678 wait complete. 2022-02-02T13:50:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:50:51.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:51 smithi033 ceph-mon[101165]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:51 smithi033 ceph-mon[101165]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1511016525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:50:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1020128678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:50:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:51 smithi037 ceph-mon[69017]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:51 smithi037 ceph-mon[69017]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:50:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1511016525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:50:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1020128678' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:50:52.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:52 smithi033 ceph-mon[101165]: pgmap v310: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:53.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:52 smithi037 ceph-mon[69017]: pgmap v310: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:53 smithi037 ceph-mon[69017]: pgmap v311: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:54.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:53 smithi033 ceph-mon[101165]: pgmap v311: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:50:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:50:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:50:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:50:56.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:56 smithi033 ceph-mon[101165]: pgmap v312: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:57.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:56 smithi037 ceph-mon[69017]: pgmap v312: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:57 smithi037 ceph-mon[69017]: pgmap v313: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:50:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:57 smithi033 ceph-mon[101165]: pgmap v313: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:50:59 smithi037 ceph-mon[69017]: pgmap v314: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:50:59 smithi033 ceph-mon[101165]: pgmap v314: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:02.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:01 smithi037 ceph-mon[69017]: pgmap v315: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:01 smithi033 ceph-mon[101165]: pgmap v315: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:04 smithi037 ceph-mon[69017]: pgmap v316: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:04 smithi033 ceph-mon[101165]: pgmap v316: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:06.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:51:06.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:51:06.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:51:06.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:51:06.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: pgmap v317: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:06.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:51:06.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:51:06.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:51:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:51:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:51:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:51:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:51:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: pgmap v317: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:07.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:51:07.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T13:51:07.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:51:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:07 smithi037 ceph-mon[69017]: pgmap v318: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:07 smithi033 ceph-mon[101165]: pgmap v318: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:09 smithi037 ceph-mon[69017]: pgmap v319: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:09 smithi033 ceph-mon[101165]: pgmap v319: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:12.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:12 smithi037 ceph-mon[69017]: pgmap v320: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:11 smithi033 ceph-mon[101165]: pgmap v320: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:14 smithi037 ceph-mon[69017]: pgmap v321: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:14.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:14 smithi033 ceph-mon[101165]: pgmap v321: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:16 smithi033 ceph-mon[101165]: pgmap v322: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:17.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:16 smithi037 ceph-mon[69017]: pgmap v322: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:18 smithi037 ceph-mon[69017]: pgmap v323: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:18 smithi033 ceph-mon[101165]: pgmap v323: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:20 smithi037 ceph-mon[69017]: pgmap v324: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:20 smithi033 ceph-mon[101165]: pgmap v324: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:21.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- 172.21.15.33:0/2840125047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f7980 msgr2=0x7fd6200f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 --2- 172.21.15.33:0/2840125047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f7980 0x7fd6200f7de0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fd608004660 tx=0x7fd608009b30).stop 2022-02-02T13:51:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- 172.21.15.33:0/2840125047 shutdown_connections 2022-02-02T13:51:21.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 --2- 172.21.15.33:0/2840125047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f7980 0x7fd6200f7de0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 --2- 172.21.15.33:0/2840125047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f66e0 0x7fd6200f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- 172.21.15.33:0/2840125047 >> 172.21.15.33:0/2840125047 conn(0x7fd6200f1e40 msgr2=0x7fd6200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- 172.21.15.33:0/2840125047 shutdown_connections 2022-02-02T13:51:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- 172.21.15.33:0/2840125047 wait complete. 2022-02-02T13:51:21.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 Processor -- start 2022-02-02T13:51:21.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.310+0000 7fd625e24700 1 -- start start 2022-02-02T13:51:21.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd625e24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd625e24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f7980 0x7fd620107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd625e24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620107a00 con 0x7fd6200f66e0 2022-02-02T13:51:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd625e24700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620107b40 con 0x7fd6200f7980 2022-02-02T13:51:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58408/0 (socket says 172.21.15.33:58408) 2022-02-02T13:51:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 -- 172.21.15.33:0/2144678704 learned_addr learned my addr 172.21.15.33:0/2144678704 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:21.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd616ffd700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f7980 0x7fd620107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 -- 172.21.15.33:0/2144678704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f7980 msgr2=0x7fd620107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f7980 0x7fd620107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 -- 172.21.15.33:0/2144678704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd608005040 con 0x7fd6200f66e0 2022-02-02T13:51:21.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61f7fe700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd61000c530 tx=0x7fd610007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.311+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd61000f650 con 0x7fd6200f66e0 2022-02-02T13:51:21.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.312+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6201084e0 con 0x7fd6200f66e0 2022-02-02T13:51:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.312+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd61000fc60 con 0x7fd6200f66e0 2022-02-02T13:51:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.312+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd610012d20 con 0x7fd6200f66e0 2022-02-02T13:51:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.312+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd620108aa0 con 0x7fd6200f66e0 2022-02-02T13:51:21.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.313+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd620045ad0 con 0x7fd6200f66e0 2022-02-02T13:51:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.313+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd610019030 con 0x7fd6200f66e0 2022-02-02T13:51:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.314+0000 7fd61cff9700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 0x7fd60c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.314+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd610081760 con 0x7fd6200f66e0 2022-02-02T13:51:21.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.314+0000 7fd616ffd700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 0x7fd60c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.314+0000 7fd616ffd700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 0x7fd60c067290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd608004e30 tx=0x7fd608009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.318+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd610053290 con 0x7fd6200f66e0 2022-02-02T13:51:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.510+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6200fefe0 con 0x7fd60c064dd0 2022-02-02T13:51:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.512+0000 7fd61cff9700 1 -- 172.21.15.33:0/2144678704 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd6200fefe0 con 0x7fd60c064dd0 2022-02-02T13:51:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 msgr2=0x7fd60c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 0x7fd60c067290 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd608004e30 tx=0x7fd608009b30).stop 2022-02-02T13:51:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 msgr2=0x7fd620106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fd61000c530 tx=0x7fd610007e10).stop 2022-02-02T13:51:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 shutdown_connections 2022-02-02T13:51:21.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd60c064dd0 0x7fd60c067290 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6200f66e0 0x7fd620106f60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 --2- 172.21.15.33:0/2144678704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6200f7980 0x7fd620107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.513+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 >> 172.21.15.33:0/2144678704 conn(0x7fd6200f1e40 msgr2=0x7fd6200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:21.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.514+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 shutdown_connections 2022-02-02T13:51:21.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.514+0000 7fd625e24700 1 -- 172.21.15.33:0/2144678704 wait complete. 2022-02-02T13:51:21.524 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:51:21.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 -- 172.21.15.33:0/3352930352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 msgr2=0x7ff13c0f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 --2- 172.21.15.33:0/3352930352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c0f6ae0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7ff12c004660 tx=0x7ff12c009b30).stop 2022-02-02T13:51:21.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 -- 172.21.15.33:0/3352930352 shutdown_connections 2022-02-02T13:51:21.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 --2- 172.21.15.33:0/3352930352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 0x7ff13c0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 --2- 172.21.15.33:0/3352930352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c0f6ae0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 -- 172.21.15.33:0/3352930352 >> 172.21.15.33:0/3352930352 conn(0x7ff13c0f1e20 msgr2=0x7ff13c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 -- 172.21.15.33:0/3352930352 shutdown_connections 2022-02-02T13:51:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.615+0000 7ff141862700 1 -- 172.21.15.33:0/3352930352 wait complete. 2022-02-02T13:51:21.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 Processor -- start 2022-02-02T13:51:21.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 -- start start 2022-02-02T13:51:21.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 0x7ff13c107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1079b0 con 0x7ff13c0f66c0 2022-02-02T13:51:21.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff141862700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c107af0 con 0x7ff13c0f7960 2022-02-02T13:51:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff13affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff13affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58416/0 (socket says 172.21.15.33:58416) 2022-02-02T13:51:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff13affd700 1 -- 172.21.15.33:0/884142192 learned_addr learned my addr 172.21.15.33:0/884142192 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.616+0000 7ff13a7fc700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 0x7ff13c107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff13affd700 1 -- 172.21.15.33:0/884142192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 msgr2=0x7ff13c107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff13affd700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 0x7ff13c107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff13affd700 1 -- 172.21.15.33:0/884142192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c005040 con 0x7ff13c0f66c0 2022-02-02T13:51:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff13affd700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff12c014040 tx=0x7ff12c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12c019070 con 0x7ff13c0f66c0 2022-02-02T13:51:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c108430 con 0x7ff13c0f66c0 2022-02-02T13:51:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff12c007e70 con 0x7ff13c0f66c0 2022-02-02T13:51:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff12c014d10 con 0x7ff13c0f66c0 2022-02-02T13:51:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.617+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c108990 con 0x7ff13c0f66c0 2022-02-02T13:51:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.618+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c045ad0 con 0x7ff13c0f66c0 2022-02-02T13:51:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.619+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff12c025070 con 0x7ff13c0f66c0 2022-02-02T13:51:21.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.619+0000 7ff1337fe700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 0x7ff128067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.619+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff12c082b50 con 0x7ff13c0f66c0 2022-02-02T13:51:21.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.619+0000 7ff13a7fc700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 0x7ff128067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.620+0000 7ff13a7fc700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 0x7ff128067290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff124009fd0 tx=0x7ff12400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.624+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff12c054570 con 0x7ff13c0f66c0 2022-02-02T13:51:21.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.805+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff13c0ff000 con 0x7ff128064dd0 2022-02-02T13:51:21.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.819+0000 7ff1337fe700 1 -- 172.21.15.33:0/884142192 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff13c0ff000 con 0x7ff128064dd0 2022-02-02T13:51:21.821 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:51:21.821 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (16m) 9m ago 17m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:51:21.821 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (9m) 9m ago 17m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:51:21.822 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (9m) 9m ago 17m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:51:21.822 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (16m) 9m ago 17m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:51:21.823 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (10m) 9m ago 13m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:51:21.823 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (10m) 9m ago 13m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:51:21.824 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (11m) 9m ago 13m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:51:21.824 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (13m) 9m ago 13m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:51:21.825 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (11m) 9m ago 18m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:51:21.825 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (10m) 9m ago 17m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:51:21.825 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (10m) 9m ago 19m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:51:21.826 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (10m) 9m ago 17m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:51:21.826 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (17m) 9m ago 17m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:51:21.827 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (16m) 9m ago 16m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:51:21.827 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (16m) 9m ago 16m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:51:21.828 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (16m) 9m ago 16m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:51:21.828 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (15m) 9m ago 15m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:51:21.829 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (15m) 9m ago 15m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:51:21.829 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (15m) 9m ago 15m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:51:21.829 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (14m) 9m ago 14m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:51:21.830 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (16m) 9m ago 17m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:51:21.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 msgr2=0x7ff128067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 0x7ff128067290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7ff124009fd0 tx=0x7ff12400b040).stop 2022-02-02T13:51:21.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 msgr2=0x7ff13c106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7ff12c014040 tx=0x7ff12c00b040).stop 2022-02-02T13:51:21.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 shutdown_connections 2022-02-02T13:51:21.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff128064dd0 0x7ff128067290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff13c0f66c0 0x7ff13c106f10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 --2- 172.21.15.33:0/884142192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff13c0f7960 0x7ff13c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 >> 172.21.15.33:0/884142192 conn(0x7ff13c0f1e20 msgr2=0x7ff13c0fb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:21.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.821+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 shutdown_connections 2022-02-02T13:51:21.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.822+0000 7ff141862700 1 -- 172.21.15.33:0/884142192 wait complete. 2022-02-02T13:51:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/1302681614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 msgr2=0x7f2d380f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/1302681614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d380f6b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f2d2c004660 tx=0x7f2d2c009b30).stop 2022-02-02T13:51:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/1302681614 shutdown_connections 2022-02-02T13:51:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/1302681614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d380f6b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/1302681614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 0x7f2d380f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/1302681614 >> 172.21.15.33:0/1302681614 conn(0x7f2d380f0b90 msgr2=0x7f2d380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/1302681614 shutdown_connections 2022-02-02T13:51:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.923+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/1302681614 wait complete. 2022-02-02T13:51:21.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 Processor -- start 2022-02-02T13:51:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 -- start start 2022-02-02T13:51:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 0x7f2d38106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d38107870 con 0x7f2d380f66d0 2022-02-02T13:51:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3f4d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d381080b0 con 0x7f2d380f5430 2022-02-02T13:51:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3dcce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3dcce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58428/0 (socket says 172.21.15.33:58428) 2022-02-02T13:51:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.924+0000 7f2d3dcce700 1 -- 172.21.15.33:0/328146813 learned_addr learned my addr 172.21.15.33:0/328146813 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3e4cf700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 0x7f2d38106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3dcce700 1 -- 172.21.15.33:0/328146813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 msgr2=0x7f2d38106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3dcce700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 0x7f2d38106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:21.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3dcce700 1 -- 172.21.15.33:0/328146813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c005040 con 0x7f2d380f66d0 2022-02-02T13:51:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3dcce700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2d2c009990 tx=0x7f2d2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2c018070 con 0x7f2d380f66d0 2022-02-02T13:51:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d38108330 con 0x7f2d380f66d0 2022-02-02T13:51:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d38108810 con 0x7f2d380f66d0 2022-02-02T13:51:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d2c007ba0 con 0x7f2d380f66d0 2022-02-02T13:51:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.925+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d2c01c3c0 con 0x7f2d380f66d0 2022-02-02T13:51:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.927+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d2c01d420 con 0x7f2d380f66d0 2022-02-02T13:51:21.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.927+0000 7f2d2affd700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 0x7f2d240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:21.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.927+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2d2c083710 con 0x7f2d380f66d0 2022-02-02T13:51:21.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.927+0000 7f2d3e4cf700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 0x7f2d240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:21.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.927+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d38059100 con 0x7f2d380f66d0 2022-02-02T13:51:21.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.928+0000 7f2d3e4cf700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 0x7f2d240672e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2d38107b40 tx=0x7f2d3400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:21.932+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d2c051020 con 0x7f2d380f66d0 2022-02-02T13:51:22.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.177+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d380fdd50 con 0x7f2d380f66d0 2022-02-02T13:51:22.178 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:22 smithi033 ceph-mon[101165]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:22.178 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:22 smithi033 ceph-mon[101165]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:22.178 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:22 smithi033 ceph-mon[101165]: pgmap v325: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:22.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.177+0000 7f2d2affd700 1 -- 172.21.15.33:0/328146813 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2d2c051820 con 0x7f2d380f66d0 2022-02-02T13:51:22.179 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:51:22.179 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:51:22.180 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:51:22.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:22.180 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:51:22.180 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:51:22.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:22.181 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:51:22.181 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:51:22.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:22.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:51:22.182 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:51:22.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:22.182 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:51:22.183 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:51:22.183 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:51:22.185 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:51:22.185 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:51:22.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 msgr2=0x7f2d240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 0x7f2d240672e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f2d38107b40 tx=0x7f2d3400b040).stop 2022-02-02T13:51:22.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 msgr2=0x7f2d38107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2d2c009990 tx=0x7f2d2c009b30).stop 2022-02-02T13:51:22.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 shutdown_connections 2022-02-02T13:51:22.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d24064e20 0x7f2d240672e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d380f5430 0x7f2d38106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 --2- 172.21.15.33:0/328146813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d380f66d0 0x7f2d38107270 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 >> 172.21.15.33:0/328146813 conn(0x7f2d380f0b90 msgr2=0x7f2d3805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 shutdown_connections 2022-02-02T13:51:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.179+0000 7f2d3f4d1700 1 -- 172.21.15.33:0/328146813 wait complete. 2022-02-02T13:51:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 -- 172.21.15.33:0/3552362815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f4bc0 msgr2=0x7f708c0f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 --2- 172.21.15.33:0/3552362815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f4bc0 0x7f708c0f4fe0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f7088004660 tx=0x7f7088009b30).stop 2022-02-02T13:51:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 -- 172.21.15.33:0/3552362815 shutdown_connections 2022-02-02T13:51:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 --2- 172.21.15.33:0/3552362815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f5e60 0x7f708c0f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 --2- 172.21.15.33:0/3552362815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f4bc0 0x7f708c0f4fe0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 -- 172.21.15.33:0/3552362815 >> 172.21.15.33:0/3552362815 conn(0x7f708c0f0320 msgr2=0x7f708c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.280+0000 7f7093478700 1 -- 172.21.15.33:0/3552362815 shutdown_connections 2022-02-02T13:51:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 -- 172.21.15.33:0/3552362815 wait complete. 2022-02-02T13:51:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 Processor -- start 2022-02-02T13:51:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 -- start start 2022-02-02T13:51:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f4bc0 0x7f708c105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c1067f0 con 0x7f708c0f5e60 2022-02-02T13:51:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7093478700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c106ff0 con 0x7f708c0f4bc0 2022-02-02T13:51:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7091c75700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7091c75700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58438/0 (socket says 172.21.15.33:58438) 2022-02-02T13:51:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.281+0000 7f7091c75700 1 -- 172.21.15.33:0/2249812071 learned_addr learned my addr 172.21.15.33:0/2249812071 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7092476700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f4bc0 0x7f708c105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7091c75700 1 -- 172.21.15.33:0/2249812071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f4bc0 msgr2=0x7f708c105d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7091c75700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f4bc0 0x7f708c105d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7091c75700 1 -- 172.21.15.33:0/2249812071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7088005040 con 0x7f708c0f5e60 2022-02-02T13:51:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7091c75700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f707c00f940 tx=0x7f707c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f707c009500 con 0x7f708c0f5e60 2022-02-02T13:51:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c107270 con 0x7f708c0f5e60 2022-02-02T13:51:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f707c009660 con 0x7f708c0f5e60 2022-02-02T13:51:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f707c00de30 con 0x7f708c0f5e60 2022-02-02T13:51:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.282+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c1077e0 con 0x7f708c0f5e60 2022-02-02T13:51:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.283+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074004fa0 con 0x7f708c0f5e60 2022-02-02T13:51:22.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.284+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f707c00e040 con 0x7f708c0f5e60 2022-02-02T13:51:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.284+0000 7f7082ffd700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 0x7f70780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.284+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f707c0843a0 con 0x7f708c0f5e60 2022-02-02T13:51:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.284+0000 7f7092476700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 0x7f70780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.284+0000 7f7092476700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 0x7f70780672e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7088004630 tx=0x7f7088009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:22.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.288+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f707c055e80 con 0x7f708c0f5e60 2022-02-02T13:51:22.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:22 smithi037 ceph-mon[69017]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:22.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:22 smithi037 ceph-mon[69017]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:22.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:22 smithi037 ceph-mon[69017]: pgmap v325: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:22.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.502+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7074005e80 con 0x7f708c0f5e60 2022-02-02T13:51:22.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.502+0000 7f7082ffd700 1 -- 172.21.15.33:0/2249812071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f707c055a70 con 0x7f708c0f5e60 2022-02-02T13:51:22.503 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:51:22.504 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:51:22.504 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:51:22.504 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:51:22.504 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:51:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:51:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:51:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:51:22.505 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:51:22.506 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:51:22.506 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:51:22.506 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:51:22.506 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:51:22.507 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:51:22.507 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:51:22.507 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:51:22.507 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:51:22.507 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:51:22.508 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:51:22.508 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:51:22.508 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:51:22.508 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:51:22.509 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:51:22.509 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:51:22.509 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:51:22.509 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:51:22.509 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:51:22.510 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:51:22.510 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:51:22.510 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:51:22.510 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:22.511 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:22.511 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:51:22.511 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:22.511 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:22.511 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:22.512 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:22.512 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:22.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 msgr2=0x7f70780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 0x7f70780672e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f7088004630 tx=0x7f7088009b30).stop 2022-02-02T13:51:22.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 msgr2=0x7f708c106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:22.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f707c00f940 tx=0x7f707c009de0).stop 2022-02-02T13:51:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 shutdown_connections 2022-02-02T13:51:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7078064e20 0x7f70780672e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f708c0f4bc0 0x7f708c105d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 --2- 172.21.15.33:0/2249812071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f708c0f5e60 0x7f708c106240 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:22.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.504+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 >> 172.21.15.33:0/2249812071 conn(0x7f708c0f0320 msgr2=0x7f708c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.505+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 shutdown_connections 2022-02-02T13:51:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:22.505+0000 7f7093478700 1 -- 172.21.15.33:0/2249812071 wait complete. 2022-02-02T13:51:22.516 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:51:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/328146813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:51:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2249812071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:51:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/328146813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:51:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2249812071' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:51:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:24 smithi037 ceph-mon[69017]: pgmap v326: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:24 smithi033 ceph-mon[101165]: pgmap v326: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:26.995 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:26 smithi033 ceph-mon[101165]: pgmap v327: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:26 smithi037 ceph-mon[69017]: pgmap v327: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:28 smithi037 ceph-mon[69017]: pgmap v328: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:28 smithi033 ceph-mon[101165]: pgmap v328: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:30 smithi037 ceph-mon[69017]: pgmap v329: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:30 smithi033 ceph-mon[101165]: pgmap v329: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:32 smithi037 ceph-mon[69017]: pgmap v330: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:32 smithi033 ceph-mon[101165]: pgmap v330: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:34 smithi037 ceph-mon[69017]: pgmap v331: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:34 smithi033 ceph-mon[101165]: pgmap v331: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:36 smithi033 ceph-mon[101165]: pgmap v332: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:36 smithi037 ceph-mon[69017]: pgmap v332: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:38 smithi037 ceph-mon[69017]: pgmap v333: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:38 smithi033 ceph-mon[101165]: pgmap v333: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:40 smithi037 ceph-mon[69017]: pgmap v334: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:40 smithi033 ceph-mon[101165]: pgmap v334: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:42 smithi037 ceph-mon[69017]: pgmap v335: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:42 smithi033 ceph-mon[101165]: pgmap v335: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:44 smithi037 ceph-mon[69017]: pgmap v336: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:44 smithi033 ceph-mon[101165]: pgmap v336: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:47.795 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:47 smithi037 ceph-mon[69017]: pgmap v337: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:47.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:47 smithi033 ceph-mon[101165]: pgmap v337: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:49.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:49 smithi033 ceph-mon[101165]: pgmap v338: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:50.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:49 smithi037 ceph-mon[69017]: pgmap v338: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:51.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:51 smithi033 ceph-mon[101165]: pgmap v339: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:52.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:51 smithi037 ceph-mon[69017]: pgmap v339: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 -- 172.21.15.33:0/1547393557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 msgr2=0x7fc2480f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 --2- 172.21.15.33:0/1547393557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc2480f6920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fc23c004660 tx=0x7fc23c009b30).stop 2022-02-02T13:51:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 -- 172.21.15.33:0/1547393557 shutdown_connections 2022-02-02T13:51:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 --2- 172.21.15.33:0/1547393557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc2480f6920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 --2- 172.21.15.33:0/1547393557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 0x7fc2480f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 -- 172.21.15.33:0/1547393557 >> 172.21.15.33:0/1547393557 conn(0x7fc2480f0de0 msgr2=0x7fc2480f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.620+0000 7fc24d95e700 1 -- 172.21.15.33:0/1547393557 shutdown_connections 2022-02-02T13:51:52.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.621+0000 7fc24d95e700 1 -- 172.21.15.33:0/1547393557 wait complete. 2022-02-02T13:51:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.621+0000 7fc24d95e700 1 Processor -- start 2022-02-02T13:51:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.621+0000 7fc24d95e700 1 -- start start 2022-02-02T13:51:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc24d95e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 0x7fc248102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc24d95e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc24d95e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248103910 con 0x7fc2480f5ef0 2022-02-02T13:51:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc24d95e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248103a50 con 0x7fc2480f55e0 2022-02-02T13:51:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58448/0 (socket says 172.21.15.33:58448) 2022-02-02T13:51:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 -- 172.21.15.33:0/3625581334 learned_addr learned my addr 172.21.15.33:0/3625581334 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc246ffd700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 0x7fc248102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 -- 172.21.15.33:0/3625581334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 msgr2=0x7fc248102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 0x7fc248102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 -- 172.21.15.33:0/3625581334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c005040 con 0x7fc2480f5ef0 2022-02-02T13:51:52.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc2467fc700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc23c002040 tx=0x7fc23c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23c019070 con 0x7fc2480f5ef0 2022-02-02T13:51:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.622+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc248104360 con 0x7fc2480f5ef0 2022-02-02T13:51:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.623+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc23c007e70 con 0x7fc2480f5ef0 2022-02-02T13:51:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.623+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2481048c0 con 0x7fc2480f5ef0 2022-02-02T13:51:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.623+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc23c014db0 con 0x7fc2480f5ef0 2022-02-02T13:51:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.623+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc248045ad0 con 0x7fc2480f5ef0 2022-02-02T13:51:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.624+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc23c025070 con 0x7fc2480f5ef0 2022-02-02T13:51:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.624+0000 7fc22f7fe700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 0x7fc230067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.625+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc23c082a40 con 0x7fc2480f5ef0 2022-02-02T13:51:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.625+0000 7fc246ffd700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 0x7fc230067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.625+0000 7fc246ffd700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 0x7fc230067210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc248102bb0 tx=0x7fc23800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:52.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.629+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc23c050a90 con 0x7fc2480f5ef0 2022-02-02T13:51:52.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.817+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2480fab60 con 0x7fc230064d50 2022-02-02T13:51:52.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.818+0000 7fc22f7fe700 1 -- 172.21.15.33:0/3625581334 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc2480fab60 con 0x7fc230064d50 2022-02-02T13:51:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 msgr2=0x7fc230067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 0x7fc230067210 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc248102bb0 tx=0x7fc23800b040).stop 2022-02-02T13:51:52.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 msgr2=0x7fc248103310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fc23c002040 tx=0x7fc23c00b040).stop 2022-02-02T13:51:52.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 shutdown_connections 2022-02-02T13:51:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc230064d50 0x7fc230067210 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2480f55e0 0x7fc248102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 --2- 172.21.15.33:0/3625581334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2480f5ef0 0x7fc248103310 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 >> 172.21.15.33:0/3625581334 conn(0x7fc2480f0de0 msgr2=0x7fc24805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:52.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 shutdown_connections 2022-02-02T13:51:52.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.820+0000 7fc24d95e700 1 -- 172.21.15.33:0/3625581334 wait complete. 2022-02-02T13:51:52.832 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:51:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 -- 172.21.15.33:0/2776159802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f66e0 msgr2=0x7f06200f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 --2- 172.21.15.33:0/2776159802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f66e0 0x7f06200f6b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f061c004660 tx=0x7f061c009b30).stop 2022-02-02T13:51:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 -- 172.21.15.33:0/2776159802 shutdown_connections 2022-02-02T13:51:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 --2- 172.21.15.33:0/2776159802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f7980 0x7f06200f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 --2- 172.21.15.33:0/2776159802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f66e0 0x7f06200f6b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 -- 172.21.15.33:0/2776159802 >> 172.21.15.33:0/2776159802 conn(0x7f06200f1e40 msgr2=0x7f06200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 -- 172.21.15.33:0/2776159802 shutdown_connections 2022-02-02T13:51:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.922+0000 7f0628428700 1 -- 172.21.15.33:0/2776159802 wait complete. 2022-02-02T13:51:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 Processor -- start 2022-02-02T13:51:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 -- start start 2022-02-02T13:51:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f66e0 0x7f0620106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620107a50 con 0x7f06200f7980 2022-02-02T13:51:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f0628428700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620107b90 con 0x7f06200f66e0 2022-02-02T13:51:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f06259c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f06259c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58458/0 (socket says 172.21.15.33:58458) 2022-02-02T13:51:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.923+0000 7f06259c3700 1 -- 172.21.15.33:0/1862970794 learned_addr learned my addr 172.21.15.33:0/1862970794 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f06261c4700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f66e0 0x7f0620106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f06259c3700 1 -- 172.21.15.33:0/1862970794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f66e0 msgr2=0x7f0620106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f06259c3700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f66e0 0x7f0620106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f06259c3700 1 -- 172.21.15.33:0/1862970794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c005040 con 0x7f06200f7980 2022-02-02T13:51:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f06259c3700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f06100026d0 tx=0x7f0610009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06100079c0 con 0x7f06200f7980 2022-02-02T13:51:52.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f061000f040 con 0x7f06200f7980 2022-02-02T13:51:52.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0620108530 con 0x7f06200f7980 2022-02-02T13:51:52.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06100148b0 con 0x7f06200f7980 2022-02-02T13:51:52.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.924+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0620108af0 con 0x7f06200f7980 2022-02-02T13:51:52.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.925+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0620045ad0 con 0x7f06200f7980 2022-02-02T13:51:52.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.926+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0610007b20 con 0x7f06200f7980 2022-02-02T13:51:52.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.926+0000 7f0616ffd700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 0x7f060c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:52.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.927+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0610081e40 con 0x7f06200f7980 2022-02-02T13:51:52.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.927+0000 7f06261c4700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 0x7f060c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:52.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.927+0000 7f06261c4700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 0x7f060c067290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f061c004630 tx=0x7f061c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:52.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:52.930+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0610053920 con 0x7f06200f7980 2022-02-02T13:51:53.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.115+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0620108dc0 con 0x7f060c064dd0 2022-02-02T13:51:53.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.129+0000 7f0616ffd700 1 -- 172.21.15.33:0/1862970794 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0620108dc0 con 0x7f060c064dd0 2022-02-02T13:51:53.129 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:51:53.130 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (17m) 10m ago 18m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:51:53.130 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (10m) 10m ago 18m 7264k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:51:53.130 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (10m) 10m ago 17m 7184k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:51:53.130 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (17m) 10m ago 17m 40.8M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:51:53.131 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (10m) 10m ago 14m 13.2M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:51:53.131 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (11m) 10m ago 14m 14.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:51:53.131 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (12m) 10m ago 14m 16.8M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:51:53.131 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (14m) 10m ago 14m 15.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:51:53.132 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (11m) 10m ago 19m 460M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:51:53.132 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (11m) 10m ago 17m 416M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:51:53.132 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (11m) 10m ago 19m 75.3M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:51:53.132 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (10m) 10m ago 17m 64.1M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:51:53.132 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (17m) 10m ago 17m 18.1M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:51:53.133 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (17m) 10m ago 17m 18.3M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:51:53.133 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (16m) 10m ago 16m 357M 4096M 16.2.4 8d91d370c2b8 fc0740f9c960 2022-02-02T13:51:53.133 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (16m) 10m ago 16m 366M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:51:53.133 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (16m) 10m ago 16m 276M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:51:53.134 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (16m) 10m ago 16m 432M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:51:53.134 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (15m) 10m ago 15m 344M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:51:53.134 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (15m) 10m ago 15m 387M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:51:53.134 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (16m) 10m ago 17m 49.5M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:51:53.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 msgr2=0x7f060c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 0x7f060c067290 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f061c004630 tx=0x7f061c009b30).stop 2022-02-02T13:51:53.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 msgr2=0x7f06201074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f06100026d0 tx=0x7f0610009de0).stop 2022-02-02T13:51:53.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 shutdown_connections 2022-02-02T13:51:53.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f060c064dd0 0x7f060c067290 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06200f66e0 0x7f0620106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 --2- 172.21.15.33:0/1862970794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06200f7980 0x7f06201074a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 >> 172.21.15.33:0/1862970794 conn(0x7f06200f1e40 msgr2=0x7f06200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:53.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 shutdown_connections 2022-02-02T13:51:53.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.131+0000 7f0628428700 1 -- 172.21.15.33:0/1862970794 wait complete. 2022-02-02T13:51:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 -- 172.21.15.33:0/347451171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f55c0 msgr2=0x7f19400f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 --2- 172.21.15.33:0/347451171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f55c0 0x7f19400f59e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f1930004660 tx=0x7f1930009b30).stop 2022-02-02T13:51:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 -- 172.21.15.33:0/347451171 shutdown_connections 2022-02-02T13:51:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 --2- 172.21.15.33:0/347451171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f6860 0x7f19400f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 --2- 172.21.15.33:0/347451171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f55c0 0x7f19400f59e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.231+0000 7f194488b700 1 -- 172.21.15.33:0/347451171 >> 172.21.15.33:0/347451171 conn(0x7f19400f0d40 msgr2=0x7f19400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.232+0000 7f194488b700 1 -- 172.21.15.33:0/347451171 shutdown_connections 2022-02-02T13:51:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.232+0000 7f194488b700 1 -- 172.21.15.33:0/347451171 wait complete. 2022-02-02T13:51:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.232+0000 7f194488b700 1 Processor -- start 2022-02-02T13:51:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.232+0000 7f194488b700 1 -- start start 2022-02-02T13:51:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.232+0000 7f194488b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f55c0 0x7f1940106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f194488b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f194488b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940107990 con 0x7f19400f6860 2022-02-02T13:51:53.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f194488b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940107ad0 con 0x7f19400f55c0 2022-02-02T13:51:53.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58468/0 (socket says 172.21.15.33:58468) 2022-02-02T13:51:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 -- 172.21.15.33:0/975909697 learned_addr learned my addr 172.21.15.33:0/975909697 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193e59c700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f55c0 0x7f1940106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 -- 172.21.15.33:0/975909697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f55c0 msgr2=0x7f1940106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f55c0 0x7f1940106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 -- 172.21.15.33:0/975909697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1930005040 con 0x7f19400f6860 2022-02-02T13:51:53.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f193dd9b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f1928002700 tx=0x7f1928009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:53.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1928009320 con 0x7f19400f6860 2022-02-02T13:51:53.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f192800f040 con 0x7f19400f6860 2022-02-02T13:51:53.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1928014870 con 0x7f19400f6860 2022-02-02T13:51:53.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.233+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1940108470 con 0x7f19400f6860 2022-02-02T13:51:53.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.234+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1940108a30 con 0x7f19400f6860 2022-02-02T13:51:53.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.234+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1940045ad0 con 0x7f19400f6860 2022-02-02T13:51:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.235+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1928009480 con 0x7f19400f6860 2022-02-02T13:51:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.236+0000 7f1936ffd700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 0x7f192c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.236+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1928081fd0 con 0x7f19400f6860 2022-02-02T13:51:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.236+0000 7f193e59c700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 0x7f192c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.236+0000 7f193e59c700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 0x7f192c067290 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1930004630 tx=0x7f1930009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:53.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.239+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1928053be0 con 0x7f19400f6860 2022-02-02T13:51:53.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.487+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1940109120 con 0x7f19400f6860 2022-02-02T13:51:53.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.488+0000 7f1936ffd700 1 -- 172.21.15.33:0/975909697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f19280537d0 con 0x7f19400f6860 2022-02-02T13:51:53.488 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:51:53.489 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:51:53.489 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:51:53.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:53.489 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:51:53.489 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:51:53.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:53.490 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:51:53.490 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:51:53.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:53.491 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:51:53.491 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:51:53.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:51:53.491 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:51:53.492 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:51:53.492 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:51:53.492 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:51:53.492 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:51:53.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.489+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 msgr2=0x7f192c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.489+0000 7f194488b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 0x7f192c067290 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1930004630 tx=0x7f1930009b30).stop 2022-02-02T13:51:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.489+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 msgr2=0x7f19401073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.489+0000 7f194488b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f1928002700 tx=0x7f1928009e00).stop 2022-02-02T13:51:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 shutdown_connections 2022-02-02T13:51:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f192c064dd0 0x7f192c067290 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19400f55c0 0x7f1940106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 --2- 172.21.15.33:0/975909697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19400f6860 0x7f19401073e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 >> 172.21.15.33:0/975909697 conn(0x7f19400f0d40 msgr2=0x7f194005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 shutdown_connections 2022-02-02T13:51:53.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.490+0000 7f194488b700 1 -- 172.21.15.33:0/975909697 wait complete. 2022-02-02T13:51:53.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 -- 172.21.15.33:0/3414811113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f7980 msgr2=0x7fac940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 --2- 172.21.15.33:0/3414811113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f7980 0x7fac940f7de0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fac80004660 tx=0x7fac80009b30).stop 2022-02-02T13:51:53.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 -- 172.21.15.33:0/3414811113 shutdown_connections 2022-02-02T13:51:53.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 --2- 172.21.15.33:0/3414811113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f7980 0x7fac940f7de0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 --2- 172.21.15.33:0/3414811113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac940f66e0 0x7fac940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 -- 172.21.15.33:0/3414811113 >> 172.21.15.33:0/3414811113 conn(0x7fac940f1e40 msgr2=0x7fac940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:53.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 -- 172.21.15.33:0/3414811113 shutdown_connections 2022-02-02T13:51:53.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.591+0000 7fac9ae39700 1 -- 172.21.15.33:0/3414811113 wait complete. 2022-02-02T13:51:53.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 Processor -- start 2022-02-02T13:51:53.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 -- start start 2022-02-02T13:51:53.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac940f7980 0x7fac94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9406a380 con 0x7fac940f66e0 2022-02-02T13:51:53.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac9ae39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9406a4c0 con 0x7fac940f7980 2022-02-02T13:51:53.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:53.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58476/0 (socket says 172.21.15.33:58476) 2022-02-02T13:51:53.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 -- 172.21.15.33:0/2686767755 learned_addr learned my addr 172.21.15.33:0/2686767755 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:51:53.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 -- 172.21.15.33:0/2686767755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac940f7980 msgr2=0x7fac94069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac940f7980 0x7fac94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:51:53.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.592+0000 7fac98bd5700 1 -- 172.21.15.33:0/2686767755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac80005040 con 0x7fac940f66e0 2022-02-02T13:51:53.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac98bd5700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fac88002700 tx=0x7fac88009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:53.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac88009320 con 0x7fac940f66e0 2022-02-02T13:51:53.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9406a7a0 con 0x7fac940f66e0 2022-02-02T13:51:53.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac8800f040 con 0x7fac940f66e0 2022-02-02T13:51:53.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac88014900 con 0x7fac940f66e0 2022-02-02T13:51:53.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.593+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9410ef90 con 0x7fac940f66e0 2022-02-02T13:51:53.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.594+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac94045ad0 con 0x7fac940f66e0 2022-02-02T13:51:53.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.594+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fac88009480 con 0x7fac940f66e0 2022-02-02T13:51:53.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.595+0000 7fac917fa700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 0x7fac84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:51:53.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.595+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fac88081d10 con 0x7fac940f66e0 2022-02-02T13:51:53.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.595+0000 7fac93fff700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 0x7fac84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:51:53.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.595+0000 7fac93fff700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 0x7fac84067290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fac80004e30 tx=0x7fac80009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:51:53.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.599+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fac8804fe80 con 0x7fac940f66e0 2022-02-02T13:51:53.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:53 smithi033 ceph-mon[101165]: pgmap v340: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:53.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:53 smithi033 ceph-mon[101165]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:53.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:53 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/975909697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:51:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.812+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac940ff020 con 0x7fac940f66e0 2022-02-02T13:51:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.813+0000 7fac917fa700 1 -- 172.21.15.33:0/2686767755 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fac880534a0 con 0x7fac940f66e0 2022-02-02T13:51:53.814 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:51:53.814 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:51:53.814 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:51:53.815 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:51:53.815 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:53.815 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:51:53.816 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:51:53.816 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:51:53.816 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:51:53.816 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:51:53.817 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:51:53.817 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:51:53.817 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:51:53.817 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:51:53.817 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:51:53.818 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:51:53.818 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:51:53.818 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:51:53.818 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:51:53.819 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:51:53.819 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:51:53.820 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:51:53.820 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:51:53.820 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:51:53.820 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:51:53.821 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:51:53.821 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:51:53.821 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:51:53.821 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:51:53.822 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:51:53.822 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:51:53.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:53.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:51:53.823 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:51:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:53.823 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:53.824 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:51:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 msgr2=0x7fac84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 0x7fac84067290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fac80004e30 tx=0x7fac80009b30).stop 2022-02-02T13:51:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 msgr2=0x7fac9406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:51:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fac88002700 tx=0x7fac88009d80).stop 2022-02-02T13:51:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 shutdown_connections 2022-02-02T13:51:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac84064dd0 0x7fac84067290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac940f66e0 0x7fac9406b9a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:51:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 --2- 172.21.15.33:0/2686767755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac940f7980 0x7fac94069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:51:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 >> 172.21.15.33:0/2686767755 conn(0x7fac940f1e40 msgr2=0x7fac940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:51:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 shutdown_connections 2022-02-02T13:51:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:51:53.815+0000 7fac9ae39700 1 -- 172.21.15.33:0/2686767755 wait complete. 2022-02-02T13:51:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:51:54.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:53 smithi037 ceph-mon[69017]: pgmap v340: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:54.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:53 smithi037 ceph-mon[69017]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:54.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:53 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/975909697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:51:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:54 smithi033 ceph-mon[101165]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2686767755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:51:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:51:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:51:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:54 smithi037 ceph-mon[69017]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:51:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2686767755' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:51:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:51:55.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:51:55.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:55 smithi033 ceph-mon[101165]: pgmap v341: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:56.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:55 smithi037 ceph-mon[69017]: pgmap v341: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:57 smithi037 ceph-mon[69017]: pgmap v342: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:57.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:57 smithi033 ceph-mon[101165]: pgmap v342: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:51:59.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:51:59 smithi033 ceph-mon[101165]: pgmap v343: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:51:59 smithi037 ceph-mon[69017]: pgmap v343: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:00 smithi033 ceph-mon[101165]: Marking osd.0 out (has been down for 600 seconds) 2022-02-02T13:52:00.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:00 smithi033 ceph-mon[101165]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T13:52:00.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:00 smithi033 ceph-mon[101165]: osdmap e56: 6 total, 5 up, 5 in 2022-02-02T13:52:01.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:00 smithi037 ceph-mon[69017]: Marking osd.0 out (has been down for 600 seconds) 2022-02-02T13:52:01.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:00 smithi037 ceph-mon[69017]: Health check cleared: OSD_DOWN (was: 1 osds down) 2022-02-02T13:52:01.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:00 smithi037 ceph-mon[69017]: osdmap e56: 6 total, 5 up, 5 in 2022-02-02T13:52:01.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:01 smithi033 ceph-mon[101165]: pgmap v344: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:01 smithi033 ceph-mon[101165]: osdmap e57: 6 total, 5 up, 5 in 2022-02-02T13:52:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:01 smithi037 ceph-mon[69017]: pgmap v344: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:01 smithi037 ceph-mon[69017]: osdmap e57: 6 total, 5 up, 5 in 2022-02-02T13:52:03.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:03 smithi033 ceph-mon[101165]: pgmap v347: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 926 MiB used, 446 GiB / 447 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:03.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:03 smithi033 ceph-mon[101165]: osdmap e58: 6 total, 5 up, 5 in 2022-02-02T13:52:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:03 smithi037 ceph-mon[69017]: pgmap v347: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 926 MiB used, 446 GiB / 447 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:03 smithi037 ceph-mon[69017]: osdmap e58: 6 total, 5 up, 5 in 2022-02-02T13:52:05.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:04 smithi037 ceph-mon[69017]: osdmap e59: 6 total, 5 up, 5 in 2022-02-02T13:52:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:04 smithi033 ceph-mon[101165]: osdmap e59: 6 total, 5 up, 5 in 2022-02-02T13:52:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:05 smithi037 ceph-mon[69017]: pgmap v350: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 926 MiB used, 446 GiB / 447 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:05 smithi037 ceph-mon[69017]: osdmap e60: 6 total, 5 up, 5 in 2022-02-02T13:52:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:05 smithi033 ceph-mon[101165]: pgmap v350: 65 pgs: 28 active+undersized+degraded, 6 active+undersized, 31 active+clean; 261 MiB data, 926 MiB used, 446 GiB / 447 GiB avail; 8641/58314 objects degraded (14.818%) 2022-02-02T13:52:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:05 smithi033 ceph-mon[101165]: osdmap e60: 6 total, 5 up, 5 in 2022-02-02T13:52:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:06 smithi037 ceph-mon[69017]: osdmap e61: 6 total, 5 up, 5 in 2022-02-02T13:52:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:52:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:52:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:06 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:52:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:06 smithi033 ceph-mon[101165]: osdmap e61: 6 total, 5 up, 5 in 2022-02-02T13:52:07.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:52:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:52:07.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:06 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:52:08.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:07 smithi037 ceph-mon[69017]: pgmap v353: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%); 19 MiB/s, 2 keys/s, 501 objects/s recovering 2022-02-02T13:52:08.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:07 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:52:08.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:07 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 6634/58314 objects degraded (11.376%), 13 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:08.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:07 smithi037 ceph-mon[69017]: osdmap e62: 6 total, 5 up, 5 in 2022-02-02T13:52:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:07 smithi033 ceph-mon[101165]: pgmap v353: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%); 19 MiB/s, 2 keys/s, 501 objects/s recovering 2022-02-02T13:52:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:07 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:52:08.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:07 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 6634/58314 objects degraded (11.376%), 13 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:08.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:07 smithi033 ceph-mon[101165]: osdmap e62: 6 total, 5 up, 5 in 2022-02-02T13:52:09.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:08 smithi037 ceph-mon[69017]: osdmap e63: 6 total, 5 up, 5 in 2022-02-02T13:52:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:08 smithi033 ceph-mon[101165]: osdmap e63: 6 total, 5 up, 5 in 2022-02-02T13:52:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:09 smithi037 ceph-mon[69017]: pgmap v356: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%); 19 MiB/s, 2 keys/s, 501 objects/s recovering 2022-02-02T13:52:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:09 smithi037 ceph-mon[69017]: osdmap e64: 6 total, 5 up, 5 in 2022-02-02T13:52:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:09 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:09 smithi033 ceph-mon[101165]: pgmap v356: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%); 19 MiB/s, 2 keys/s, 501 objects/s recovering 2022-02-02T13:52:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:09 smithi033 ceph-mon[101165]: osdmap e64: 6 total, 5 up, 5 in 2022-02-02T13:52:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:09 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:11.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:11 smithi033 ceph-mon[101165]: pgmap v358: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%) 2022-02-02T13:52:11.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:11 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:11.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:11 smithi037 ceph-mon[69017]: pgmap v358: 65 pgs: 11 active+recovery_wait+undersized+degraded+remapped, 2 peering, 2 active+recovering+undersized+degraded+remapped, 50 active+clean; 261 MiB data, 1022 MiB used, 446 GiB / 447 GiB avail; 6634/58314 objects degraded (11.376%) 2022-02-02T13:52:11.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:11 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:12 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5428/58314 objects degraded (9.308%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:12.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:12 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5428/58314 objects degraded (9.308%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:13 smithi033 ceph-mon[101165]: pgmap v359: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5428/58314 objects degraded (9.308%); 2.2 MiB/s, 200 objects/s recovering 2022-02-02T13:52:14.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:14.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:13 smithi037 ceph-mon[69017]: pgmap v359: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5428/58314 objects degraded (9.308%); 2.2 MiB/s, 200 objects/s recovering 2022-02-02T13:52:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:14 smithi033 ceph-mon[101165]: pgmap v360: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5428/58314 objects degraded (9.308%); 2.0 MiB/s, 185 objects/s recovering 2022-02-02T13:52:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:14 smithi033 ceph-mon[101165]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:52:15.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:14 smithi037 ceph-mon[69017]: pgmap v360: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5428/58314 objects degraded (9.308%); 2.0 MiB/s, 185 objects/s recovering 2022-02-02T13:52:15.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:14 smithi037 ceph-mon[69017]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2022-02-02T13:52:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:16 smithi033 ceph-mon[101165]: pgmap v361: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.8 MiB/s, 168 objects/s recovering 2022-02-02T13:52:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:16 smithi037 ceph-mon[69017]: pgmap v361: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.8 MiB/s, 168 objects/s recovering 2022-02-02T13:52:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:18 smithi033 ceph-mon[101165]: pgmap v362: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.4 MiB/s, 136 objects/s recovering 2022-02-02T13:52:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:18 smithi037 ceph-mon[69017]: pgmap v362: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.4 MiB/s, 136 objects/s recovering 2022-02-02T13:52:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:20 smithi033 ceph-mon[101165]: pgmap v363: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.3 MiB/s, 120 objects/s recovering 2022-02-02T13:52:21.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:20 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5370/58314 objects degraded (9.209%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:20 smithi037 ceph-mon[69017]: pgmap v363: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5370/58314 objects degraded (9.209%); 1.3 MiB/s, 120 objects/s recovering 2022-02-02T13:52:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:20 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5370/58314 objects degraded (9.209%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:22 smithi033 ceph-mon[101165]: pgmap v364: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5312/58314 objects degraded (9.109%); 1.2 MiB/s, 117 objects/s recovering 2022-02-02T13:52:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:22 smithi037 ceph-mon[69017]: pgmap v364: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5312/58314 objects degraded (9.109%); 1.2 MiB/s, 117 objects/s recovering 2022-02-02T13:52:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/2618251960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 msgr2=0x7fa6b00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/2618251960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b00f6cc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa698004660 tx=0x7fa698009b30).stop 2022-02-02T13:52:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/2618251960 shutdown_connections 2022-02-02T13:52:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/2618251960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b00f6cc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/2618251960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/2618251960 >> 172.21.15.33:0/2618251960 conn(0x7fa6b00f0d40 msgr2=0x7fa6b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/2618251960 shutdown_connections 2022-02-02T13:52:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.928+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/2618251960 wait complete. 2022-02-02T13:52:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.929+0000 7fa6b5dcf700 1 Processor -- start 2022-02-02T13:52:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6b5dcf700 1 -- start start 2022-02-02T13:52:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6b5dcf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b0109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6b5dcf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6b5dcf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0060420 con 0x7fa6b00f6860 2022-02-02T13:52:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6b5dcf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0060560 con 0x7fa6b00f55c0 2022-02-02T13:52:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b0109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58488/0 (socket says 172.21.15.33:58488) 2022-02-02T13:52:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 -- 172.21.15.33:0/3248418885 learned_addr learned my addr 172.21.15.33:0/3248418885 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 -- 172.21.15.33:0/3248418885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 msgr2=0x7fa6b0109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:23.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b0109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:23.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 -- 172.21.15.33:0/3248418885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698005040 con 0x7fa6b00f6860 2022-02-02T13:52:23.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6af7fe700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b0109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:52:23.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.930+0000 7fa6aeffd700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fa698000c00 tx=0x7fa69800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:23.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.931+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa698019070 con 0x7fa6b00f6860 2022-02-02T13:52:23.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.931+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b010c630 con 0x7fa6b00f6860 2022-02-02T13:52:23.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.931+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa698007e70 con 0x7fa6b00f6860 2022-02-02T13:52:23.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.931+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa698014ce0 con 0x7fa6b00f6860 2022-02-02T13:52:23.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.931+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b010cb60 con 0x7fa6b00f6860 2022-02-02T13:52:23.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.932+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00f49b0 con 0x7fa6b00f6860 2022-02-02T13:52:23.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.932+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa698025070 con 0x7fa6b00f6860 2022-02-02T13:52:23.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.932+0000 7fa6a7fff700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 0x7fa69c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:23.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.933+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7fa698082a50 con 0x7fa6b00f6860 2022-02-02T13:52:23.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.933+0000 7fa6af7fe700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 0x7fa69c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:23.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.933+0000 7fa6af7fe700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 0x7fa69c067290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa6b00600a0 tx=0x7fa6a000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:23.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:23.937+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa698050ae0 con 0x7fa6b00f6860 2022-02-02T13:52:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.126+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6b00fdf00 con 0x7fa69c064dd0 2022-02-02T13:52:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.127+0000 7fa6a7fff700 1 -- 172.21.15.33:0/3248418885 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa6b00fdf00 con 0x7fa69c064dd0 2022-02-02T13:52:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 msgr2=0x7fa69c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 0x7fa69c067290 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa6b00600a0 tx=0x7fa6a000b040).stop 2022-02-02T13:52:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 msgr2=0x7fa6b010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fa698000c00 tx=0x7fa69800b040).stop 2022-02-02T13:52:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 shutdown_connections 2022-02-02T13:52:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa69c064dd0 0x7fa69c067290 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6b00f55c0 0x7fa6b0109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 --2- 172.21.15.33:0/3248418885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6b00f6860 0x7fa6b010c080 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 >> 172.21.15.33:0/3248418885 conn(0x7fa6b00f0d40 msgr2=0x7fa6b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 shutdown_connections 2022-02-02T13:52:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.129+0000 7fa6b5dcf700 1 -- 172.21.15.33:0/3248418885 wait complete. 2022-02-02T13:52:24.140 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:52:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 -- 172.21.15.33:0/3367446790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 msgr2=0x7f00840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 --2- 172.21.15.33:0/3367446790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f00840f7c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f00740045a0 tx=0x7f0074009b30).stop 2022-02-02T13:52:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 -- 172.21.15.33:0/3367446790 shutdown_connections 2022-02-02T13:52:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 --2- 172.21.15.33:0/3367446790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f00840f7c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 --2- 172.21.15.33:0/3367446790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f00840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.232+0000 7f008a7b5700 1 -- 172.21.15.33:0/3367446790 >> 172.21.15.33:0/3367446790 conn(0x7f00840f1c90 msgr2=0x7f00840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 -- 172.21.15.33:0/3367446790 shutdown_connections 2022-02-02T13:52:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 -- 172.21.15.33:0/3367446790 wait complete. 2022-02-02T13:52:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 Processor -- start 2022-02-02T13:52:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 -- start start 2022-02-02T13:52:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f008406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008406a380 con 0x7f00840f6530 2022-02-02T13:52:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.233+0000 7f008a7b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008406a4c0 con 0x7f00840f77d0 2022-02-02T13:52:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f00897b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f008406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:40982/0 (socket says 172.21.15.33:40982) 2022-02-02T13:52:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 -- 172.21.15.33:0/1000221507 learned_addr learned my addr 172.21.15.33:0/1000221507 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 -- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 msgr2=0x7f008406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f008406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 -- 172.21.15.33:0/1000221507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080005040 con 0x7f00840f77d0 2022-02-02T13:52:24.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f00897b3700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f008406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:52:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0088fb2700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f00740134f0 tx=0x7f007400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007400e070 con 0x7f00840f77d0 2022-02-02T13:52:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0074005040 con 0x7f00840f77d0 2022-02-02T13:52:24.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00740097d0 con 0x7f00840f77d0 2022-02-02T13:52:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.234+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0074019070 con 0x7f00840f77d0 2022-02-02T13:52:24.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.235+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008406aa90 con 0x7f00840f77d0 2022-02-02T13:52:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084059100 con 0x7f00840f77d0 2022-02-02T13:52:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0074025070 con 0x7f00840f77d0 2022-02-02T13:52:24.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f0079ffb700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 0x7f00700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f0074082830 con 0x7f00840f77d0 2022-02-02T13:52:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f00897b3700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 0x7f00700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.236+0000 7f00897b3700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 0x7f00700672e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f008406b730 tx=0x7f008000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.241+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00740507e0 con 0x7f00840f77d0 2022-02-02T13:52:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.423+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f00840fed60 con 0x7f0070064e20 2022-02-02T13:52:24.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.438+0000 7f0079ffb700 1 -- 172.21.15.33:0/1000221507 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f00840fed60 con 0x7f0070064e20 2022-02-02T13:52:24.439 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:52:24.439 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (17m) 11s ago 18m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:52:24.439 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (10m) 11s ago 18m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:52:24.439 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (10m) 14s ago 18m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:52:24.440 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (17m) 11s ago 18m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:52:24.440 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (11m) 11s ago 14m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:52:24.440 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (11m) 11s ago 14m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:52:24.440 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (12m) 14s ago 14m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:52:24.440 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (14m) 14s ago 14m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:52:24.441 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (12m) 11s ago 20m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:52:24.441 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (11m) 14s ago 18m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:52:24.441 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (11m) 11s ago 20m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:52:24.441 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (11m) 14s ago 18m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:52:24.442 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (18m) 11s ago 18m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:52:24.442 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (17m) 14s ago 17m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:52:24.442 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 11s ago 17m - 4096M 2022-02-02T13:52:24.442 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (17m) 11s ago 17m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:52:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (16m) 11s ago 16m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:52:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (16m) 14s ago 16m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:52:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (16m) 14s ago 16m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:52:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (16m) 14s ago 16m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:52:24.443 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (17m) 11s ago 18m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:52:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 msgr2=0x7f00700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 0x7f00700672e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f008406b730 tx=0x7f008000b040).stop 2022-02-02T13:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 msgr2=0x7f0084069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f00740134f0 tx=0x7f007400b040).stop 2022-02-02T13:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 shutdown_connections 2022-02-02T13:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064e20 0x7f00700672e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00840f6530 0x7f008406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 --2- 172.21.15.33:0/1000221507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f77d0 0x7f0084069e20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.441+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 >> 172.21.15.33:0/1000221507 conn(0x7f00840f1c90 msgr2=0x7f00840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.442+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 shutdown_connections 2022-02-02T13:52:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.442+0000 7f008a7b5700 1 -- 172.21.15.33:0/1000221507 wait complete. 2022-02-02T13:52:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 -- 172.21.15.33:0/4255163866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f6860 msgr2=0x7f31940f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 --2- 172.21.15.33:0/4255163866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f6860 0x7f31940f6cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f31840045a0 tx=0x7f3184009b30).stop 2022-02-02T13:52:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 -- 172.21.15.33:0/4255163866 shutdown_connections 2022-02-02T13:52:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 --2- 172.21.15.33:0/4255163866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f6860 0x7f31940f6cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 --2- 172.21.15.33:0/4255163866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f55c0 0x7f31940f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 -- 172.21.15.33:0/4255163866 >> 172.21.15.33:0/4255163866 conn(0x7f31940f0d40 msgr2=0x7f31940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 -- 172.21.15.33:0/4255163866 shutdown_connections 2022-02-02T13:52:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.542+0000 7f319c741700 1 -- 172.21.15.33:0/4255163866 wait complete. 2022-02-02T13:52:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 Processor -- start 2022-02-02T13:52:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 -- start start 2022-02-02T13:52:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f55c0 0x7f3194109b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3194060420 con 0x7f31940f6860 2022-02-02T13:52:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319c741700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3194060560 con 0x7f31940f55c0 2022-02-02T13:52:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f3199cdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f3199cdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58508/0 (socket says 172.21.15.33:58508) 2022-02-02T13:52:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f3199cdc700 1 -- 172.21.15.33:0/1347574685 learned_addr learned my addr 172.21.15.33:0/1347574685 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.543+0000 7f319a4dd700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f55c0 0x7f3194109b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f3199cdc700 1 -- 172.21.15.33:0/1347574685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f55c0 msgr2=0x7f3194109b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f3199cdc700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f55c0 0x7f3194109b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f3199cdc700 1 -- 172.21.15.33:0/1347574685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184005040 con 0x7f31940f6860 2022-02-02T13:52:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f3199cdc700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f31840134f0 tx=0x7f318400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f318400e070 con 0x7f31940f6860 2022-02-02T13:52:24.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319410c610 con 0x7f31940f6860 2022-02-02T13:52:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f31840097d0 con 0x7f31940f6860 2022-02-02T13:52:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319410cac0 con 0x7f31940f6860 2022-02-02T13:52:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.544+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3184019070 con 0x7f31940f6860 2022-02-02T13:52:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.545+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3194045ad0 con 0x7f31940f6860 2022-02-02T13:52:24.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.546+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3184025070 con 0x7f31940f6860 2022-02-02T13:52:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.546+0000 7f318affd700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 0x7f3180067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.546+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f3184082910 con 0x7f31940f6860 2022-02-02T13:52:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.546+0000 7f319a4dd700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 0x7f3180067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.547+0000 7f319a4dd700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 0x7f3180067290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f31940600a0 tx=0x7f319000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.550+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f31840508c0 con 0x7f31940f6860 2022-02-02T13:52:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.794+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3194027a00 con 0x7f31940f6860 2022-02-02T13:52:24.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.794+0000 7f318affd700 1 -- 172.21.15.33:0/1347574685 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3184023070 con 0x7f31940f6860 2022-02-02T13:52:24.850 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:52:24.850 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:52:24.851 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:52:24.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:24.851 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:52:24.852 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:52:24.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:24.852 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:52:24.852 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:52:24.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:24.853 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:52:24.853 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:52:24.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:24.853 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:52:24.853 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:52:24.854 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:52:24.854 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:52:24.854 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:52:24.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.796+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 msgr2=0x7f3180067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.796+0000 7f319c741700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 0x7f3180067290 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f31940600a0 tx=0x7f319000b040).stop 2022-02-02T13:52:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.796+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 msgr2=0x7f319410c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.796+0000 7f319c741700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f31840134f0 tx=0x7f318400b040).stop 2022-02-02T13:52:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 shutdown_connections 2022-02-02T13:52:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3180064dd0 0x7f3180067290 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31940f55c0 0x7f3194109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 --2- 172.21.15.33:0/1347574685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31940f6860 0x7f319410c060 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 >> 172.21.15.33:0/1347574685 conn(0x7f31940f0d40 msgr2=0x7f31940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 shutdown_connections 2022-02-02T13:52:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.797+0000 7f319c741700 1 -- 172.21.15.33:0/1347574685 wait complete. 2022-02-02T13:52:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 -- 172.21.15.33:0/65986995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 msgr2=0x7f4a140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/65986995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a140f6cc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4a08004660 tx=0x7f4a08009b30).stop 2022-02-02T13:52:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 -- 172.21.15.33:0/65986995 shutdown_connections 2022-02-02T13:52:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/65986995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a140f6cc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/65986995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 -- 172.21.15.33:0/65986995 >> 172.21.15.33:0/65986995 conn(0x7f4a140f0d40 msgr2=0x7f4a140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:24.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 -- 172.21.15.33:0/65986995 shutdown_connections 2022-02-02T13:52:24.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.898+0000 7f4a1b42c700 1 -- 172.21.15.33:0/65986995 wait complete. 2022-02-02T13:52:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 Processor -- start 2022-02-02T13:52:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 -- start start 2022-02-02T13:52:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a14109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14109bb0 con 0x7f4a140f6860 2022-02-02T13:52:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a1b42c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14109cf0 con 0x7f4a140f55c0 2022-02-02T13:52:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a189c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a191c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a14109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a189c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58516/0 (socket says 172.21.15.33:58516) 2022-02-02T13:52:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a189c7700 1 -- 172.21.15.33:0/2279776864 learned_addr learned my addr 172.21.15.33:0/2279776864 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a191c8700 1 -- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 msgr2=0x7f4a14109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a191c8700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a191c8700 1 -- 172.21.15.33:0/2279776864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a08005040 con 0x7f4a140f55c0 2022-02-02T13:52:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.899+0000 7f4a189c7700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:52:24.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a191c8700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a14109110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4a140f66c0 tx=0x7f4a1000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a100092e0 con 0x7f4a140f55c0 2022-02-02T13:52:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a1000f040 con 0x7f4a140f55c0 2022-02-02T13:52:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1410a690 con 0x7f4a140f55c0 2022-02-02T13:52:24.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a100147a0 con 0x7f4a140f55c0 2022-02-02T13:52:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.900+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1410ac50 con 0x7f4a140f55c0 2022-02-02T13:52:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.901+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a14045ad0 con 0x7f4a140f55c0 2022-02-02T13:52:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.901+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a1001b030 con 0x7f4a140f55c0 2022-02-02T13:52:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.901+0000 7f4a05ffb700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 0x7f4a00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:24.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.902+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f4a10081a10 con 0x7f4a140f55c0 2022-02-02T13:52:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.902+0000 7f4a189c7700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 0x7f4a00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:24.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.902+0000 7f4a189c7700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 0x7f4a00067290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a08005010 tx=0x7f4a08016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:24.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:24.906+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a100533f0 con 0x7f4a140f55c0 2022-02-02T13:52:25.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.118+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a1410f780 con 0x7f4a140f55c0 2022-02-02T13:52:25.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:24 smithi033 ceph-mon[101165]: pgmap v365: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5312/58314 objects degraded (9.109%); 27 KiB/s, 10 objects/s recovering 2022-02-02T13:52:25.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:24 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:25.120 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:24 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1347574685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:52:25.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.119+0000 7f4a05ffb700 1 -- 172.21.15.33:0/2279776864 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4a10019070 con 0x7f4a140f55c0 2022-02-02T13:52:25.120 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:52:25.121 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:52:25.121 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:52:25.122 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:52:25.122 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:25.122 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:52:25.123 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:52:25.123 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:52:25.123 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:52:25.123 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:52:25.124 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:52:25.124 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:52:25.124 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:52:25.124 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:52:25.125 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:52:25.125 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:52:25.125 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:52:25.125 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:52:25.125 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:52:25.126 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:52:25.126 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:52:25.126 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:52:25.127 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:52:25.127 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:52:25.127 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:52:25.127 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:52:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:52:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:52:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:52:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:52:25.128 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:52:25.129 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:25.129 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:25.129 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:52:25.129 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:25.129 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:25.130 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:25.130 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:25.130 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.121+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 msgr2=0x7f4a00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.121+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 0x7f4a00067290 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f4a08005010 tx=0x7f4a08016040).stop 2022-02-02T13:52:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.121+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 msgr2=0x7f4a14109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.121+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a14109110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f4a140f66c0 tx=0x7f4a1000b040).stop 2022-02-02T13:52:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 shutdown_connections 2022-02-02T13:52:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a00064dd0 0x7f4a00067290 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a140f55c0 0x7f4a14109110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 --2- 172.21.15.33:0/2279776864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a140f6860 0x7f4a14109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 >> 172.21.15.33:0/2279776864 conn(0x7f4a140f0d40 msgr2=0x7f4a1405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 shutdown_connections 2022-02-02T13:52:25.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:25.122+0000 7f4a1b42c700 1 -- 172.21.15.33:0/2279776864 wait complete. 2022-02-02T13:52:25.134 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:52:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:24 smithi037 ceph-mon[69017]: pgmap v365: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5312/58314 objects degraded (9.109%); 27 KiB/s, 10 objects/s recovering 2022-02-02T13:52:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:24 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:52:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:24 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1347574685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:52:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:25 smithi033 ceph-mon[101165]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:25 smithi033 ceph-mon[101165]: from='client.44387 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2279776864' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:52:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:25 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5312/58314 objects degraded (9.109%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:25 smithi037 ceph-mon[69017]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:25 smithi037 ceph-mon[69017]: from='client.44387 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:26.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2279776864' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:52:26.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:25 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5312/58314 objects degraded (9.109%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:26 smithi033 ceph-mon[101165]: pgmap v366: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 40 KiB/s, 14 objects/s recovering 2022-02-02T13:52:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:26 smithi037 ceph-mon[69017]: pgmap v366: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 40 KiB/s, 14 objects/s recovering 2022-02-02T13:52:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:28 smithi033 ceph-mon[101165]: pgmap v367: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:52:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:28 smithi037 ceph-mon[69017]: pgmap v367: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:52:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:30 smithi033 ceph-mon[101165]: pgmap v368: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:52:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:30 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5253/58314 objects degraded (9.008%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:30 smithi037 ceph-mon[69017]: pgmap v368: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5253/58314 objects degraded (9.008%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:52:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:30 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5253/58314 objects degraded (9.008%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:32 smithi033 ceph-mon[101165]: pgmap v369: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5195/58314 objects degraded (8.909%); 48 KiB/s, 14 objects/s recovering 2022-02-02T13:52:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:32 smithi037 ceph-mon[69017]: pgmap v369: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5195/58314 objects degraded (8.909%); 48 KiB/s, 14 objects/s recovering 2022-02-02T13:52:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:34 smithi033 ceph-mon[101165]: pgmap v370: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5195/58314 objects degraded (8.909%); 33 KiB/s, 9 objects/s recovering 2022-02-02T13:52:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:34 smithi037 ceph-mon[69017]: pgmap v370: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5195/58314 objects degraded (8.909%); 33 KiB/s, 9 objects/s recovering 2022-02-02T13:52:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:35 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5195/58314 objects degraded (8.909%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:35 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5195/58314 objects degraded (8.909%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:36 smithi033 ceph-mon[101165]: pgmap v371: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 52 KiB/s, 14 objects/s recovering 2022-02-02T13:52:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:36 smithi037 ceph-mon[69017]: pgmap v371: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 52 KiB/s, 14 objects/s recovering 2022-02-02T13:52:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:38 smithi033 ceph-mon[101165]: pgmap v372: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 38 KiB/s, 9 objects/s recovering 2022-02-02T13:52:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:38 smithi037 ceph-mon[69017]: pgmap v372: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 38 KiB/s, 9 objects/s recovering 2022-02-02T13:52:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:40 smithi033 ceph-mon[101165]: pgmap v373: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 38 KiB/s, 9 objects/s recovering 2022-02-02T13:52:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:40 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5137/58314 objects degraded (8.809%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:40 smithi037 ceph-mon[69017]: pgmap v373: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5137/58314 objects degraded (8.809%); 38 KiB/s, 9 objects/s recovering 2022-02-02T13:52:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:40 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5137/58314 objects degraded (8.809%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:42 smithi033 ceph-mon[101165]: pgmap v374: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5079/58314 objects degraded (8.710%); 56 KiB/s, 14 objects/s recovering 2022-02-02T13:52:43.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:42 smithi037 ceph-mon[69017]: pgmap v374: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5079/58314 objects degraded (8.710%); 56 KiB/s, 14 objects/s recovering 2022-02-02T13:52:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:44 smithi033 ceph-mon[101165]: pgmap v375: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5079/58314 objects degraded (8.710%); 37 KiB/s, 9 objects/s recovering 2022-02-02T13:52:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:44 smithi037 ceph-mon[69017]: pgmap v375: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5079/58314 objects degraded (8.710%); 37 KiB/s, 9 objects/s recovering 2022-02-02T13:52:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:45 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5079/58314 objects degraded (8.710%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:45 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5079/58314 objects degraded (8.710%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:47.071 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:46 smithi033 ceph-mon[101165]: pgmap v376: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 73 KiB/s, 14 objects/s recovering 2022-02-02T13:52:47.072 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:46 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-02-02T13:52:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:46 smithi037 ceph-mon[69017]: pgmap v376: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 73 KiB/s, 14 objects/s recovering 2022-02-02T13:52:47.490 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:47 smithi033 podman[117317]: 2022-02-02T13:52:48.240 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:47 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:52:48.241 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:47 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:52:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:48 smithi033 ceph-mon[101165]: pgmap v377: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 54 KiB/s, 9 objects/s recovering 2022-02-02T13:52:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:48 smithi037 ceph-mon[69017]: pgmap v377: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 54 KiB/s, 9 objects/s recovering 2022-02-02T13:52:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:50 smithi033 ceph-mon[101165]: pgmap v378: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 54 KiB/s, 9 objects/s recovering 2022-02-02T13:52:51.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:50 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 5021/58314 objects degraded (8.610%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:50 smithi037 ceph-mon[69017]: pgmap v378: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 5021/58314 objects degraded (8.610%); 54 KiB/s, 9 objects/s recovering 2022-02-02T13:52:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:50 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 5021/58314 objects degraded (8.610%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:52 smithi033 ceph-mon[101165]: pgmap v379: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4962/58314 objects degraded (8.509%); 77 KiB/s, 14 objects/s recovering 2022-02-02T13:52:53.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:52 smithi037 ceph-mon[69017]: pgmap v379: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4962/58314 objects degraded (8.509%); 77 KiB/s, 14 objects/s recovering 2022-02-02T13:52:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:54 smithi033 ceph-mon[101165]: pgmap v380: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4962/58314 objects degraded (8.509%); 59 KiB/s, 9 objects/s recovering 2022-02-02T13:52:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:52:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:52:55.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 -- 172.21.15.33:0/846182534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 msgr2=0x7f8c200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 --2- 172.21.15.33:0/846182534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c200f59e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f8c10004660 tx=0x7f8c10009b30).stop 2022-02-02T13:52:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 -- 172.21.15.33:0/846182534 shutdown_connections 2022-02-02T13:52:55.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 --2- 172.21.15.33:0/846182534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 --2- 172.21.15.33:0/846182534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c200f59e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 -- 172.21.15.33:0/846182534 >> 172.21.15.33:0/846182534 conn(0x7f8c200f0d40 msgr2=0x7f8c200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 -- 172.21.15.33:0/846182534 shutdown_connections 2022-02-02T13:52:55.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 -- 172.21.15.33:0/846182534 wait complete. 2022-02-02T13:52:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.240+0000 7f8c25b00700 1 Processor -- start 2022-02-02T13:52:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c25b00700 1 -- start start 2022-02-02T13:52:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c25b00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c25b00700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c2010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c25b00700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2010df90 con 0x7f8c200f55c0 2022-02-02T13:52:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c25b00700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2010e0d0 con 0x7f8c200f6860 2022-02-02T13:52:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58524/0 (socket says 172.21.15.33:58524) 2022-02-02T13:52:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 -- 172.21.15.33:0/3137158033 learned_addr learned my addr 172.21.15.33:0/3137158033 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1effd700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c2010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 -- 172.21.15.33:0/3137158033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 msgr2=0x7f8c2010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c2010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1f7fe700 1 -- 172.21.15.33:0/3137158033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10005040 con 0x7f8c200f55c0 2022-02-02T13:52:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.241+0000 7f8c1effd700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c2010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:52:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c1f7fe700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8c10014040 tx=0x7f8c1000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c10019070 con 0x7f8c200f55c0 2022-02-02T13:52:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2010ea10 con 0x7f8c200f55c0 2022-02-02T13:52:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2010ef70 con 0x7f8c200f55c0 2022-02-02T13:52:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c10007e70 con 0x7f8c200f55c0 2022-02-02T13:52:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.242+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c10014c10 con 0x7f8c200f55c0 2022-02-02T13:52:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.243+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00004fa0 con 0x7f8c200f55c0 2022-02-02T13:52:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.243+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c10014d70 con 0x7f8c200f55c0 2022-02-02T13:52:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.244+0000 7f8c07fff700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 0x7f8c08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.244+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f8c10082b70 con 0x7f8c200f55c0 2022-02-02T13:52:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.244+0000 7f8c1effd700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 0x7f8c08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.244+0000 7f8c1effd700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 0x7f8c08067290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8c14009fd0 tx=0x7f8c1400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.248+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c10054610 con 0x7f8c200f55c0 2022-02-02T13:52:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:54 smithi037 ceph-mon[69017]: pgmap v380: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4962/58314 objects degraded (8.509%); 59 KiB/s, 9 objects/s recovering 2022-02-02T13:52:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:52:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:52:55.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.438+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c00000bc0 con 0x7f8c08064dd0 2022-02-02T13:52:55.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.439+0000 7f8c07fff700 1 -- 172.21.15.33:0/3137158033 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8c00000bc0 con 0x7f8c08064dd0 2022-02-02T13:52:55.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 msgr2=0x7f8c08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 0x7f8c08067290 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f8c14009fd0 tx=0x7f8c1400b040).stop 2022-02-02T13:52:55.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 msgr2=0x7f8c2010d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f8c10014040 tx=0x7f8c1000b040).stop 2022-02-02T13:52:55.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 shutdown_connections 2022-02-02T13:52:55.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c08064dd0 0x7f8c08067290 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c200f55c0 0x7f8c2010d4f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 --2- 172.21.15.33:0/3137158033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c200f6860 0x7f8c2010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 >> 172.21.15.33:0/3137158033 conn(0x7f8c200f0d40 msgr2=0x7f8c2005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 shutdown_connections 2022-02-02T13:52:55.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.441+0000 7f8c25b00700 1 -- 172.21.15.33:0/3137158033 wait complete. 2022-02-02T13:52:55.451 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:52:55.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 -- 172.21.15.33:0/3809874045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 msgr2=0x7f81540f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 --2- 172.21.15.33:0/3809874045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f81540f7de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f8150004660 tx=0x7f8150009b30).stop 2022-02-02T13:52:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 -- 172.21.15.33:0/3809874045 shutdown_connections 2022-02-02T13:52:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 --2- 172.21.15.33:0/3809874045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f81540f7de0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 --2- 172.21.15.33:0/3809874045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f81540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.545+0000 7f815c5dd700 1 -- 172.21.15.33:0/3809874045 >> 172.21.15.33:0/3809874045 conn(0x7f81540f1e40 msgr2=0x7f81540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.546+0000 7f815c5dd700 1 -- 172.21.15.33:0/3809874045 shutdown_connections 2022-02-02T13:52:55.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.546+0000 7f815c5dd700 1 -- 172.21.15.33:0/3809874045 wait complete. 2022-02-02T13:52:55.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.546+0000 7f815c5dd700 1 Processor -- start 2022-02-02T13:52:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.546+0000 7f815c5dd700 1 -- start start 2022-02-02T13:52:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815c5dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815c5dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f8154107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815c5dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81541079b0 con 0x7f81540f7980 2022-02-02T13:52:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815c5dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8154107af0 con 0x7f81540f66e0 2022-02-02T13:52:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f8159b78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f8154107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815a379700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815a379700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:41018/0 (socket says 172.21.15.33:41018) 2022-02-02T13:52:55.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815a379700 1 -- 172.21.15.33:0/11773080 learned_addr learned my addr 172.21.15.33:0/11773080 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:55.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f8159b78700 1 -- 172.21.15.33:0/11773080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 msgr2=0x7f8154106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f8159b78700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f8159b78700 1 -- 172.21.15.33:0/11773080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8150005040 con 0x7f81540f7980 2022-02-02T13:52:55.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f815a379700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:52:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f8159b78700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f8154107400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8150011000 tx=0x7f815000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.547+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8150019070 con 0x7f81540f7980 2022-02-02T13:52:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.548+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8154108430 con 0x7f81540f7980 2022-02-02T13:52:55.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.548+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8150007e70 con 0x7f81540f7980 2022-02-02T13:52:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.548+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154108990 con 0x7f81540f7980 2022-02-02T13:52:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.548+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8150014c70 con 0x7f81540f7980 2022-02-02T13:52:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.549+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c004fa0 con 0x7f81540f7980 2022-02-02T13:52:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.549+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8150025070 con 0x7f81540f7980 2022-02-02T13:52:55.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.550+0000 7f814affd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 0x7f8140067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.550+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f81500829d0 con 0x7f81540f7980 2022-02-02T13:52:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.550+0000 7f815a379700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 0x7f8140067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.550+0000 7f815a379700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 0x7f8140067290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f81440041d0 tx=0x7f814400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.554+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8150054350 con 0x7f81540f7980 2022-02-02T13:52:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.735+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f813c000bc0 con 0x7f8140064dd0 2022-02-02T13:52:55.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.749+0000 7f814affd700 1 -- 172.21.15.33:0/11773080 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f813c000bc0 con 0x7f8140064dd0 2022-02-02T13:52:55.750 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:52:55.750 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (18m) 42s ago 19m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:52:55.750 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (11m) 42s ago 19m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:52:55.750 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (11m) 45s ago 18m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:52:55.751 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (18m) 42s ago 18m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:52:55.751 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (11m) 42s ago 15m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:52:55.751 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (12m) 42s ago 15m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:52:55.751 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (13m) 45s ago 15m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:52:55.752 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (15m) 45s ago 15m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:52:55.752 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (12m) 42s ago 20m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:52:55.752 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (12m) 45s ago 18m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:52:55.752 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (12m) 42s ago 20m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:52:55.753 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (11m) 45s ago 18m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:52:55.753 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (18m) 42s ago 18m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:52:55.753 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (18m) 45s ago 18m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:52:55.753 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 42s ago 17m - 4096M 2022-02-02T13:52:55.753 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (17m) 42s ago 17m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:52:55.754 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (17m) 42s ago 17m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:52:55.754 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (17m) 45s ago 17m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:52:55.754 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (16m) 45s ago 16m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:52:55.754 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (16m) 45s ago 16m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:52:55.755 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (18m) 42s ago 18m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 msgr2=0x7f8140067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 0x7f8140067290 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f81440041d0 tx=0x7f814400b040).stop 2022-02-02T13:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 msgr2=0x7f8154107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f8154107400 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f8150011000 tx=0x7f815000b040).stop 2022-02-02T13:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 shutdown_connections 2022-02-02T13:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8140064dd0 0x7f8140067290 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81540f66e0 0x7f8154106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 --2- 172.21.15.33:0/11773080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81540f7980 0x7f8154107400 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 >> 172.21.15.33:0/11773080 conn(0x7f81540f1e40 msgr2=0x7f81540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 shutdown_connections 2022-02-02T13:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.751+0000 7f815c5dd700 1 -- 172.21.15.33:0/11773080 wait complete. 2022-02-02T13:52:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 -- 172.21.15.33:0/3429260743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f6860 msgr2=0x7f0aec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 --2- 172.21.15.33:0/3429260743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f6860 0x7f0aec0f6cc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f0adc004660 tx=0x7f0adc009b30).stop 2022-02-02T13:52:55.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 -- 172.21.15.33:0/3429260743 shutdown_connections 2022-02-02T13:52:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 --2- 172.21.15.33:0/3429260743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f6860 0x7f0aec0f6cc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 --2- 172.21.15.33:0/3429260743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f55c0 0x7f0aec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 -- 172.21.15.33:0/3429260743 >> 172.21.15.33:0/3429260743 conn(0x7f0aec0f0d40 msgr2=0x7f0aec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 -- 172.21.15.33:0/3429260743 shutdown_connections 2022-02-02T13:52:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.852+0000 7f0af38a0700 1 -- 172.21.15.33:0/3429260743 wait complete. 2022-02-02T13:52:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 Processor -- start 2022-02-02T13:52:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 -- start start 2022-02-02T13:52:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 0x7f0aec106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec106920 con 0x7f0aec0f55c0 2022-02-02T13:52:55.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af38a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec107130 con 0x7f0aec0f6860 2022-02-02T13:52:55.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af163c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af163c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58544/0 (socket says 172.21.15.33:58544) 2022-02-02T13:52:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af163c700 1 -- 172.21.15.33:0/2874359776 learned_addr learned my addr 172.21.15.33:0/2874359776 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.853+0000 7f0af0e3b700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 0x7f0aec106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af163c700 1 -- 172.21.15.33:0/2874359776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 msgr2=0x7f0aec106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af163c700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 0x7f0aec106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af163c700 1 -- 172.21.15.33:0/2874359776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0adc005040 con 0x7f0aec0f55c0 2022-02-02T13:52:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af0e3b700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 0x7f0aec106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:52:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af163c700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0ae800e7c0 tx=0x7f0ae800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae80092e0 con 0x7f0aec0f55c0 2022-02-02T13:52:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec107330 con 0x7f0aec0f55c0 2022-02-02T13:52:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ae800f040 con 0x7f0aec0f55c0 2022-02-02T13:52:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ae8014770 con 0x7f0aec0f55c0 2022-02-02T13:52:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.854+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1078f0 con 0x7f0aec0f55c0 2022-02-02T13:52:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.855+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec045ad0 con 0x7f0aec0f55c0 2022-02-02T13:52:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.856+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ae801b030 con 0x7f0aec0f55c0 2022-02-02T13:52:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.856+0000 7f0ae1ffb700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 0x7f0ad8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:55.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.856+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f0ae8081ca0 con 0x7f0aec0f55c0 2022-02-02T13:52:55.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.856+0000 7f0af0e3b700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 0x7f0ad8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:55.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.857+0000 7f0af0e3b700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 0x7f0ad8067290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0adc004d80 tx=0x7f0adc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:55.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:55.860+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ae8086070 con 0x7f0aec0f55c0 2022-02-02T13:52:56.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.108+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0aec0ff790 con 0x7f0aec0f55c0 2022-02-02T13:52:56.109 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:55 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 4962/58314 objects degraded (8.509%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:56.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.109+0000 7f0ae1ffb700 1 -- 172.21.15.33:0/2874359776 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0ae80192d0 con 0x7f0aec0f55c0 2022-02-02T13:52:56.110 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:52:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:52:56.111 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:52:56.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:56.113 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:52:56.113 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:52:56.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:56.114 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:52:56.114 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:52:56.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:56.115 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:52:56.115 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:52:56.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:52:56.116 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:52:56.116 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:52:56.116 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:52:56.117 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:52:56.117 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:52:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 msgr2=0x7f0ad8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 0x7f0ad8067290 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f0adc004d80 tx=0x7f0adc00b040).stop 2022-02-02T13:52:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 msgr2=0x7f0aec105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f0ae800e7c0 tx=0x7f0ae800b040).stop 2022-02-02T13:52:56.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 shutdown_connections 2022-02-02T13:52:56.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ad8064dd0 0x7f0ad8067290 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0aec0f55c0 0x7f0aec105e30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 --2- 172.21.15.33:0/2874359776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0aec0f6860 0x7f0aec106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 >> 172.21.15.33:0/2874359776 conn(0x7f0aec0f0d40 msgr2=0x7f0aec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:56.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 shutdown_connections 2022-02-02T13:52:56.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.111+0000 7f0af38a0700 1 -- 172.21.15.33:0/2874359776 wait complete. 2022-02-02T13:52:56.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 -- 172.21.15.33:0/1862655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f55c0 msgr2=0x7f4fd00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/1862655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f55c0 0x7f4fd00f59e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f4fc0004660 tx=0x7f4fc0009b30).stop 2022-02-02T13:52:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 -- 172.21.15.33:0/1862655490 shutdown_connections 2022-02-02T13:52:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/1862655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f6860 0x7f4fd00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/1862655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f55c0 0x7f4fd00f59e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 -- 172.21.15.33:0/1862655490 >> 172.21.15.33:0/1862655490 conn(0x7f4fd00f0d40 msgr2=0x7f4fd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:56.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 -- 172.21.15.33:0/1862655490 shutdown_connections 2022-02-02T13:52:56.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.212+0000 7f4fd48e3700 1 -- 172.21.15.33:0/1862655490 wait complete. 2022-02-02T13:52:56.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 Processor -- start 2022-02-02T13:52:56.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 -- start start 2022-02-02T13:52:56.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f55c0 0x7f4fd0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:56.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:56.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0107990 con 0x7f4fd00f6860 2022-02-02T13:52:56.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fd48e3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd0107ad0 con 0x7f4fd00f55c0 2022-02-02T13:52:56.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58556/0 (socket says 172.21.15.33:58556) 2022-02-02T13:52:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 -- 172.21.15.33:0/2322123428 learned_addr learned my addr 172.21.15.33:0/2322123428 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:52:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fce59c700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f55c0 0x7f4fd0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:56.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 -- 172.21.15.33:0/2322123428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f55c0 msgr2=0x7f4fd0106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f55c0 0x7f4fd0106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 -- 172.21.15.33:0/2322123428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc0005040 con 0x7f4fd00f6860 2022-02-02T13:52:56.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.213+0000 7f4fcdd9b700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f4fb800e7f0 tx=0x7f4fb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:56.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.214+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fb80092e0 con 0x7f4fd00f6860 2022-02-02T13:52:56.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.214+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fb800f040 con 0x7f4fd00f6860 2022-02-02T13:52:56.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.214+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd0108470 con 0x7f4fd00f6860 2022-02-02T13:52:56.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.214+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fb8014750 con 0x7f4fd00f6860 2022-02-02T13:52:56.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.214+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd0108a30 con 0x7f4fd00f6860 2022-02-02T13:52:56.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.215+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd0045ad0 con 0x7f4fd00f6860 2022-02-02T13:52:56.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.215+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4fb801b030 con 0x7f4fd00f6860 2022-02-02T13:52:56.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.215+0000 7f4fc6ffd700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 0x7f4fbc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:52:56.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.215+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f4fb8081880 con 0x7f4fd00f6860 2022-02-02T13:52:56.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.216+0000 7f4fce59c700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 0x7f4fbc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:52:56.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.216+0000 7f4fce59c700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 0x7f4fbc067290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4fc0004d80 tx=0x7f4fc0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:52:56.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.220+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4fb8053310 con 0x7f4fd00f6860 2022-02-02T13:52:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:55 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 4962/58314 objects degraded (8.509%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:52:56.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.433+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4fd01090c0 con 0x7f4fd00f6860 2022-02-02T13:52:56.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.433+0000 7f4fc6ffd700 1 -- 172.21.15.33:0/2322123428 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4fb8019020 con 0x7f4fd00f6860 2022-02-02T13:52:56.434 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:52:56.434 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:52:56.435 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:52:56.435 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:52:56.435 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:56.435 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:52:56.435 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:52:56.436 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:52:56.436 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:52:56.436 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:52:56.436 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:52:56.437 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:52:56.437 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:52:56.437 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:52:56.437 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:52:56.437 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:52:56.438 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:52:56.438 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:52:56.438 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:52:56.438 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:52:56.439 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:52:56.439 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:52:56.439 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:52:56.439 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:52:56.440 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:52:56.440 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:52:56.440 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:52:56.441 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:52:56.441 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:52:56.441 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:52:56.442 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:52:56.442 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:56.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:56.443 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:52:56.444 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:52:56.444 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:56.444 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:56.444 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:56.445 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:52:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 msgr2=0x7f4fbc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 0x7f4fbc067290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f4fc0004d80 tx=0x7f4fc0016040).stop 2022-02-02T13:52:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 msgr2=0x7f4fd01073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:52:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f4fb800e7f0 tx=0x7f4fb800b040).stop 2022-02-02T13:52:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 shutdown_connections 2022-02-02T13:52:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fbc064dd0 0x7f4fbc067290 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd00f55c0 0x7f4fd0106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 --2- 172.21.15.33:0/2322123428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fd00f6860 0x7f4fd01073e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:52:56.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 >> 172.21.15.33:0/2322123428 conn(0x7f4fd00f0d40 msgr2=0x7f4fd005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:52:56.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.435+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 shutdown_connections 2022-02-02T13:52:56.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:52:56.436+0000 7f4fd48e3700 1 -- 172.21.15.33:0/2322123428 wait complete. 2022-02-02T13:52:56.448 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:52:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:56 smithi033 ceph-mon[101165]: pgmap v381: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 88 KiB/s, 14 objects/s recovering 2022-02-02T13:52:57.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:56 smithi033 ceph-mon[101165]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:57.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:56 smithi033 ceph-mon[101165]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:57.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:56 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2874359776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:52:57.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:56 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2322123428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:52:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:56 smithi037 ceph-mon[69017]: pgmap v381: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 88 KiB/s, 14 objects/s recovering 2022-02-02T13:52:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:56 smithi037 ceph-mon[69017]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:56 smithi037 ceph-mon[69017]: from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:52:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:56 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2874359776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:52:57.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:56 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2322123428' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:52:58.490 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-02-02T13:52:58.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 5. 2022-02-02T13:52:58.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: Stopped Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:52:58.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Start request repeated too quickly. 2022-02-02T13:52:58.491 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-02-02T13:52:58.492 INFO:journalctl@ceph.osd.0.smithi033.stdout:Feb 02 13:52:57 smithi033 systemd[1]: Failed to start Ceph osd.0 for 7b277774-842c-11ec-8c35-001a4aab830c. 2022-02-02T13:52:59.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:52:58 smithi033 ceph-mon[101165]: pgmap v382: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 52 KiB/s, 9 objects/s recovering 2022-02-02T13:52:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:52:58 smithi037 ceph-mon[69017]: pgmap v382: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 52 KiB/s, 9 objects/s recovering 2022-02-02T13:53:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:00 smithi033 ceph-mon[101165]: pgmap v383: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 52 KiB/s, 9 objects/s recovering 2022-02-02T13:53:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:00 smithi033 ceph-mon[101165]: osdmap e65: 6 total, 5 up, 5 in 2022-02-02T13:53:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:00 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 4904/58314 objects degraded (8.410%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:53:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:00 smithi033 ceph-mon[101165]: osdmap e66: 6 total, 5 up, 5 in 2022-02-02T13:53:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:00 smithi037 ceph-mon[69017]: pgmap v383: 65 pgs: 8 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4904/58314 objects degraded (8.410%); 52 KiB/s, 9 objects/s recovering 2022-02-02T13:53:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:00 smithi037 ceph-mon[69017]: osdmap e65: 6 total, 5 up, 5 in 2022-02-02T13:53:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:00 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 4904/58314 objects degraded (8.410%), 9 pgs degraded (PG_DEGRADED) 2022-02-02T13:53:01.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:00 smithi037 ceph-mon[69017]: osdmap e66: 6 total, 5 up, 5 in 2022-02-02T13:53:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:02 smithi033 ceph-mon[101165]: pgmap v386: 65 pgs: 1 peering, 7 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4457/58314 objects degraded (7.643%); 1.3 MiB/s, 63 objects/s recovering 2022-02-02T13:53:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:02 smithi033 ceph-mon[101165]: osdmap e67: 6 total, 5 up, 5 in 2022-02-02T13:53:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:02 smithi037 ceph-mon[69017]: pgmap v386: 65 pgs: 1 peering, 7 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4457/58314 objects degraded (7.643%); 1.3 MiB/s, 63 objects/s recovering 2022-02-02T13:53:03.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:02 smithi037 ceph-mon[69017]: osdmap e67: 6 total, 5 up, 5 in 2022-02-02T13:53:04.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:03 smithi037 ceph-mon[69017]: osdmap e68: 6 total, 5 up, 5 in 2022-02-02T13:53:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:03 smithi033 ceph-mon[101165]: osdmap e68: 6 total, 5 up, 5 in 2022-02-02T13:53:05.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:04 smithi037 ceph-mon[69017]: pgmap v389: 65 pgs: 1 peering, 7 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4457/58314 objects degraded (7.643%); 2.5 MiB/s, 111 objects/s recovering 2022-02-02T13:53:05.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:04 smithi037 ceph-mon[69017]: osdmap e69: 6 total, 5 up, 5 in 2022-02-02T13:53:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:04 smithi033 ceph-mon[101165]: pgmap v389: 65 pgs: 1 peering, 7 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 56 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 4457/58314 objects degraded (7.643%); 2.5 MiB/s, 111 objects/s recovering 2022-02-02T13:53:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:04 smithi033 ceph-mon[101165]: osdmap e69: 6 total, 5 up, 5 in 2022-02-02T13:53:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:05 smithi037 ceph-mon[69017]: osdmap e70: 6 total, 5 up, 5 in 2022-02-02T13:53:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:05 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 4457/58314 objects degraded (7.643%), 8 pgs degraded, 8 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:05 smithi037 ceph-mon[69017]: osdmap e71: 6 total, 5 up, 5 in 2022-02-02T13:53:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:05 smithi033 ceph-mon[101165]: osdmap e70: 6 total, 5 up, 5 in 2022-02-02T13:53:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:05 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 4457/58314 objects degraded (7.643%), 8 pgs degraded, 8 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:05 smithi033 ceph-mon[101165]: osdmap e71: 6 total, 5 up, 5 in 2022-02-02T13:53:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:06 smithi037 ceph-mon[69017]: pgmap v392: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 3.3 MiB/s, 659 objects/s recovering 2022-02-02T13:53:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:06 smithi037 ceph-mon[69017]: osdmap e72: 6 total, 5 up, 5 in 2022-02-02T13:53:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:06 smithi033 ceph-mon[101165]: pgmap v392: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 3.3 MiB/s, 659 objects/s recovering 2022-02-02T13:53:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:06 smithi033 ceph-mon[101165]: osdmap e72: 6 total, 5 up, 5 in 2022-02-02T13:53:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:08 smithi037 ceph-mon[69017]: pgmap v395: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 3.3 MiB/s, 659 objects/s recovering 2022-02-02T13:53:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:08 smithi033 ceph-mon[101165]: pgmap v395: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 3.3 MiB/s, 659 objects/s recovering 2022-02-02T13:53:11.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:10 smithi037 ceph-mon[69017]: pgmap v396: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 2.4 MiB/s, 479 objects/s recovering 2022-02-02T13:53:11.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:10 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1817/58314 objects degraded (3.116%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:10 smithi033 ceph-mon[101165]: pgmap v396: 65 pgs: 1 active+undersized+remapped, 1 peering, 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 60 active+clean; 261 MiB data, 1.0 GiB used, 446 GiB / 447 GiB avail; 1817/58314 objects degraded (3.116%); 2.4 MiB/s, 479 objects/s recovering 2022-02-02T13:53:11.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:10 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1817/58314 objects degraded (3.116%), 3 pgs degraded, 4 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:12 smithi037 ceph-mon[69017]: pgmap v397: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 2.1 MiB/s, 414 objects/s recovering 2022-02-02T13:53:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:12 smithi033 ceph-mon[101165]: pgmap v397: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 2.1 MiB/s, 414 objects/s recovering 2022-02-02T13:53:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:53:13.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:53:13.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:53:13.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:53:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:53:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:53:14.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:53:14.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:53:15.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:14 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:53:15.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:14 smithi037 ceph-mon[69017]: pgmap v398: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 26 KiB/s, 7 objects/s recovering 2022-02-02T13:53:15.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:14 smithi037 ceph-mon[69017]: pgmap v399: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 26 KiB/s, 7 objects/s recovering 2022-02-02T13:53:15.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:14 smithi037 ceph-mon[69017]: pgmap v400: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 30 KiB/s, 8 objects/s recovering 2022-02-02T13:53:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:14 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:53:15.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:14 smithi033 ceph-mon[101165]: pgmap v398: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 26 KiB/s, 7 objects/s recovering 2022-02-02T13:53:15.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:14 smithi033 ceph-mon[101165]: pgmap v399: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 26 KiB/s, 7 objects/s recovering 2022-02-02T13:53:15.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:14 smithi033 ceph-mon[101165]: pgmap v400: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1759/58314 objects degraded (3.016%); 30 KiB/s, 8 objects/s recovering 2022-02-02T13:53:16.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:15 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1759/58314 objects degraded (3.016%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:15 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1759/58314 objects degraded (3.016%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:16 smithi037 ceph-mon[69017]: pgmap v401: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 91 KiB/s, 13 objects/s recovering 2022-02-02T13:53:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:16 smithi033 ceph-mon[101165]: pgmap v401: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 91 KiB/s, 13 objects/s recovering 2022-02-02T13:53:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:18 smithi037 ceph-mon[69017]: pgmap v402: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 91 KiB/s, 13 objects/s recovering 2022-02-02T13:53:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:18 smithi033 ceph-mon[101165]: pgmap v402: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 91 KiB/s, 13 objects/s recovering 2022-02-02T13:53:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:20 smithi037 ceph-mon[69017]: pgmap v403: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 66 KiB/s, 6 objects/s recovering 2022-02-02T13:53:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:20 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1701/58314 objects degraded (2.917%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:20 smithi033 ceph-mon[101165]: pgmap v403: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1701/58314 objects degraded (2.917%); 66 KiB/s, 6 objects/s recovering 2022-02-02T13:53:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:20 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1701/58314 objects degraded (2.917%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:22 smithi037 ceph-mon[69017]: pgmap v404: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1643/58314 objects degraded (2.818%); 88 KiB/s, 13 objects/s recovering 2022-02-02T13:53:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:22 smithi033 ceph-mon[101165]: pgmap v404: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1643/58314 objects degraded (2.818%); 88 KiB/s, 13 objects/s recovering 2022-02-02T13:53:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:24 smithi037 ceph-mon[69017]: pgmap v405: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1643/58314 objects degraded (2.818%); 74 KiB/s, 11 objects/s recovering 2022-02-02T13:53:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:24 smithi033 ceph-mon[101165]: pgmap v405: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1643/58314 objects degraded (2.818%); 74 KiB/s, 11 objects/s recovering 2022-02-02T13:53:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:25 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1643/58314 objects degraded (2.818%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:26.309 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:25 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1643/58314 objects degraded (2.818%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:26.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/3500894267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f6860 msgr2=0x7f7c740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/3500894267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f6860 0x7f7c740f6cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f7c68004660 tx=0x7f7c68009b30).stop 2022-02-02T13:53:26.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/3500894267 shutdown_connections 2022-02-02T13:53:26.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/3500894267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f6860 0x7f7c740f6cc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/3500894267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f55c0 0x7f7c740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/3500894267 >> 172.21.15.33:0/3500894267 conn(0x7f7c740f0d40 msgr2=0x7f7c740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:26.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/3500894267 shutdown_connections 2022-02-02T13:53:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/3500894267 wait complete. 2022-02-02T13:53:26.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 Processor -- start 2022-02-02T13:53:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.553+0000 7f7c7c5fe700 1 -- start start 2022-02-02T13:53:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7c5fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7c5fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 0x7f7c7410e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7c5fe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740602d0 con 0x7f7c740f55c0 2022-02-02T13:53:26.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7c5fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74060410 con 0x7f7c740f6860 2022-02-02T13:53:26.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58562/0 (socket says 172.21.15.33:58562) 2022-02-02T13:53:26.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 -- 172.21.15.33:0/2262691322 learned_addr learned my addr 172.21.15.33:0/2262691322 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:26.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c79b99700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 0x7f7c7410e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 -- 172.21.15.33:0/2262691322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 msgr2=0x7f7c7410e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 0x7f7c7410e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 -- 172.21.15.33:0/2262691322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68005040 con 0x7f7c740f55c0 2022-02-02T13:53:26.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c79b99700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 0x7f7c7410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:53:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.554+0000 7f7c7a39a700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7c7000e7c0 tx=0x7f7c7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.555+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c700092e0 con 0x7f7c740f55c0 2022-02-02T13:53:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.555+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c7000f040 con 0x7f7c740f55c0 2022-02-02T13:53:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.555+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7410e9b0 con 0x7f7c740f55c0 2022-02-02T13:53:26.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.555+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c700147e0 con 0x7f7c740f55c0 2022-02-02T13:53:26.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.555+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7410ee30 con 0x7f7c740f55c0 2022-02-02T13:53:26.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.556+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c74045ad0 con 0x7f7c740f55c0 2022-02-02T13:53:26.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.556+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c7001b030 con 0x7f7c740f55c0 2022-02-02T13:53:26.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.557+0000 7f7c66ffd700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.557+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f7c70081a00 con 0x7f7c740f55c0 2022-02-02T13:53:26.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.557+0000 7f7c79b99700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.557+0000 7f7c79b99700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 0x7f7c60067290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7c68005010 tx=0x7f7c68016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:26.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.561+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c7004fa60 con 0x7f7c740f55c0 2022-02-02T13:53:26.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.750+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c740fdf40 con 0x7f7c60064dd0 2022-02-02T13:53:26.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.751+0000 7f7c66ffd700 1 -- 172.21.15.33:0/2262691322 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f7c740fdf40 con 0x7f7c60064dd0 2022-02-02T13:53:26.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 msgr2=0x7f7c60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 0x7f7c60067290 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f7c68005010 tx=0x7f7c68016040).stop 2022-02-02T13:53:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 msgr2=0x7f7c7410bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f7c7000e7c0 tx=0x7f7c7000b040).stop 2022-02-02T13:53:26.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 shutdown_connections 2022-02-02T13:53:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7c60064dd0 0x7f7c60067290 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c740f55c0 0x7f7c7410bfc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 --2- 172.21.15.33:0/2262691322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c740f6860 0x7f7c7410e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.753+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 >> 172.21.15.33:0/2262691322 conn(0x7f7c740f0d40 msgr2=0x7f7c740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.754+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 shutdown_connections 2022-02-02T13:53:26.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.754+0000 7f7c7c5fe700 1 -- 172.21.15.33:0/2262691322 wait complete. 2022-02-02T13:53:26.763 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:53:26.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 -- 172.21.15.33:0/813769253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 msgr2=0x7f80080f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 --2- 172.21.15.33:0/813769253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f80080f59e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f7ffc004660 tx=0x7f7ffc009b30).stop 2022-02-02T13:53:26.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 -- 172.21.15.33:0/813769253 shutdown_connections 2022-02-02T13:53:26.857 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:26 smithi033 ceph-mon[101165]: pgmap v406: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 89 KiB/s, 14 objects/s recovering 2022-02-02T13:53:26.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 --2- 172.21.15.33:0/813769253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f80080f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 --2- 172.21.15.33:0/813769253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f80080f59e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 -- 172.21.15.33:0/813769253 >> 172.21.15.33:0/813769253 conn(0x7f80080f0d40 msgr2=0x7f80080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:26.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 -- 172.21.15.33:0/813769253 shutdown_connections 2022-02-02T13:53:26.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.855+0000 7f800ec3f700 1 -- 172.21.15.33:0/813769253 wait complete. 2022-02-02T13:53:26.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 Processor -- start 2022-02-02T13:53:26.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 -- start start 2022-02-02T13:53:26.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f800810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080603e0 con 0x7f80080f55c0 2022-02-02T13:53:26.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800ec3f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8008060520 con 0x7f80080f6860 2022-02-02T13:53:26.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800c9db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800c9db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58572/0 (socket says 172.21.15.33:58572) 2022-02-02T13:53:26.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f800c9db700 1 -- 172.21.15.33:0/3876269433 learned_addr learned my addr 172.21.15.33:0/3876269433 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:26.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.856+0000 7f8007fff700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f800810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f8007fff700 1 -- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 msgr2=0x7f8008109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:26.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f8007fff700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:26.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f8007fff700 1 -- 172.21.15.33:0/3876269433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4005040 con 0x7f80080f6860 2022-02-02T13:53:26.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f800c9db700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:53:26.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f8007fff700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f800810c0f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7ff40048a0 tx=0x7f7ff4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:26.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff400e030 con 0x7f80080f6860 2022-02-02T13:53:26.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7ff400f040 con 0x7f80080f6860 2022-02-02T13:53:26.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc005040 con 0x7f80080f6860 2022-02-02T13:53:26.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff4014740 con 0x7f80080f6860 2022-02-02T13:53:26.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.857+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800810cad0 con 0x7f80080f6860 2022-02-02T13:53:26.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.858+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7ff4014a00 con 0x7f80080f6860 2022-02-02T13:53:26.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.858+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8008045ad0 con 0x7f80080f6860 2022-02-02T13:53:26.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.859+0000 7f80057fa700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 0x7f7ff8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:26.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.859+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f7ff4082190 con 0x7f80080f6860 2022-02-02T13:53:26.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.859+0000 7f800c9db700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 0x7f7ff8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:26.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.859+0000 7f800c9db700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 0x7f7ff8067290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7ffc009880 tx=0x7f7ffc016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:26.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:26.863+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7ff4050390 con 0x7f80080f6860 2022-02-02T13:53:27.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.048+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8008057f10 con 0x7f7ff8064dd0 2022-02-02T13:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.062+0000 7f80057fa700 1 -- 172.21.15.33:0/3876269433 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8008057f10 con 0x7f7ff8064dd0 2022-02-02T13:53:27.063 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:53:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (18m) 74s ago 19m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:53:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (11m) 74s ago 19m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:53:27.064 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (11m) 76s ago 19m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:53:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (18m) 74s ago 19m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:53:27.066 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (12m) 74s ago 15m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:53:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (12m) 74s ago 15m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:53:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (13m) 76s ago 15m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:53:27.067 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (15m) 76s ago 15m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:53:27.068 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (13m) 74s ago 21m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:53:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (12m) 76s ago 19m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:53:27.069 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (12m) 74s ago 21m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:53:27.070 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (12m) 76s ago 19m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:53:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (19m) 74s ago 19m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:53:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (18m) 76s ago 18m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:53:27.071 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 74s ago 18m - 4096M 2022-02-02T13:53:27.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (18m) 74s ago 18m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:53:27.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (17m) 74s ago 17m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:53:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (17m) 76s ago 17m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:53:27.073 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (17m) 76s ago 17m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:53:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (17m) 76s ago 17m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:53:27.074 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (18m) 74s ago 19m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:53:27.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 msgr2=0x7f7ff8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 0x7f7ff8067290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f7ffc009880 tx=0x7f7ffc016040).stop 2022-02-02T13:53:27.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 msgr2=0x7f800810c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f800810c0f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7ff40048a0 tx=0x7f7ff4009b30).stop 2022-02-02T13:53:27.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 shutdown_connections 2022-02-02T13:53:27.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ff8064dd0 0x7f7ff8067290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80080f55c0 0x7f8008109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 --2- 172.21.15.33:0/3876269433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80080f6860 0x7f800810c0f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.064+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 >> 172.21.15.33:0/3876269433 conn(0x7f80080f0d40 msgr2=0x7f80080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.065+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 shutdown_connections 2022-02-02T13:53:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.065+0000 7f800ec3f700 1 -- 172.21.15.33:0/3876269433 wait complete. 2022-02-02T13:53:27.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.164+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/501954302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f99e0 msgr2=0x7fc7a40f9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.164+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/501954302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f99e0 0x7fc7a40f9e40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc7940045a0 tx=0x7fc794009b30).stop 2022-02-02T13:53:27.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/501954302 shutdown_connections 2022-02-02T13:53:27.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/501954302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f99e0 0x7fc7a40f9e40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/501954302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f8740 0x7fc7a40f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/501954302 >> 172.21.15.33:0/501954302 conn(0x7fc7a40f40e0 msgr2=0x7fc7a40f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:27.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/501954302 shutdown_connections 2022-02-02T13:53:27.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/501954302 wait complete. 2022-02-02T13:53:27.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 Processor -- start 2022-02-02T13:53:27.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.165+0000 7fc7ab2e7700 1 -- start start 2022-02-02T13:53:27.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7ab2e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f8740 0x7fc7a406c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7ab2e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7ab2e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a406cdb0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7ab2e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a406cef0 con 0x7fc7a40f8740 2022-02-02T13:53:27.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:27.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58582/0 (socket says 172.21.15.33:58582) 2022-02-02T13:53:27.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 -- 172.21.15.33:0/3245746525 learned_addr learned my addr 172.21.15.33:0/3245746525 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:27.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 -- 172.21.15.33:0/3245746525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f8740 msgr2=0x7fc7a406c2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T13:53:27.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f8740 0x7fc7a406c2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:53:27.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 -- 172.21.15.33:0/3245746525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc794005040 con 0x7fc7a40f99e0 2022-02-02T13:53:27.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7a9ae4700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fc7940134f0 tx=0x7fc79400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:27.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc79400e070 con 0x7fc7a40f99e0 2022-02-02T13:53:27.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a406d800 con 0x7fc7a40f99e0 2022-02-02T13:53:27.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc794007ba0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.166+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc794019070 con 0x7fc7a40f99e0 2022-02-02T13:53:27.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.167+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a406dce0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.167+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7a4045ad0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.168+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc794025070 con 0x7fc7a40f99e0 2022-02-02T13:53:27.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.169+0000 7fc79affd700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 0x7fc7900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.169+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fc7940827f0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.169+0000 7fc7aa2e5700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 0x7fc7900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:27.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.169+0000 7fc7aa2e5700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 0x7fc7900672e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc7a406c050 tx=0x7fc7a000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:27.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.173+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7940507f0 con 0x7fc7a40f99e0 2022-02-02T13:53:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:26 smithi037 ceph-mon[69017]: pgmap v406: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 89 KiB/s, 14 objects/s recovering 2022-02-02T13:53:27.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.416+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7a406e910 con 0x7fc7a40f99e0 2022-02-02T13:53:27.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.416+0000 7fc79affd700 1 -- 172.21.15.33:0/3245746525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc794023070 con 0x7fc7a40f99e0 2022-02-02T13:53:27.417 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:53:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:53:27.417 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:53:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:53:27.418 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:53:27.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:53:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:53:27.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:53:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:53:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:53:27.421 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:53:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:53:27.422 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:53:27.422 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:53:27.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 msgr2=0x7fc7900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 0x7fc7900672e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc7a406c050 tx=0x7fc7a000b040).stop 2022-02-02T13:53:27.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 msgr2=0x7fc7a406c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fc7940134f0 tx=0x7fc79400b040).stop 2022-02-02T13:53:27.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 shutdown_connections 2022-02-02T13:53:27.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc790064e20 0x7fc7900672e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a40f8740 0x7fc7a406c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T13:53:27.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 --2- 172.21.15.33:0/3245746525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7a40f99e0 0x7fc7a406c7b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 >> 172.21.15.33:0/3245746525 conn(0x7fc7a40f40e0 msgr2=0x7fc7a40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:27.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 shutdown_connections 2022-02-02T13:53:27.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.419+0000 7fc7ab2e7700 1 -- 172.21.15.33:0/3245746525 wait complete. 2022-02-02T13:53:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 -- 172.21.15.33:0/1860803677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f6860 msgr2=0x7fa7300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 --2- 172.21.15.33:0/1860803677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f6860 0x7fa7300f6cc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fa718004660 tx=0x7fa718009b30).stop 2022-02-02T13:53:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 -- 172.21.15.33:0/1860803677 shutdown_connections 2022-02-02T13:53:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 --2- 172.21.15.33:0/1860803677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f6860 0x7fa7300f6cc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 --2- 172.21.15.33:0/1860803677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f55c0 0x7fa7300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 -- 172.21.15.33:0/1860803677 >> 172.21.15.33:0/1860803677 conn(0x7fa7300f0d40 msgr2=0x7fa7300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 -- 172.21.15.33:0/1860803677 shutdown_connections 2022-02-02T13:53:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 -- 172.21.15.33:0/1860803677 wait complete. 2022-02-02T13:53:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.521+0000 7fa734ee3700 1 Processor -- start 2022-02-02T13:53:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa734ee3700 1 -- start start 2022-02-02T13:53:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa734ee3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa734ee3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f6860 0x7fa730106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa734ee3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730106920 con 0x7fa7300f55c0 2022-02-02T13:53:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa734ee3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730107130 con 0x7fa7300f6860 2022-02-02T13:53:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:27.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58590/0 (socket says 172.21.15.33:58590) 2022-02-02T13:53:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 -- 172.21.15.33:0/2985167406 learned_addr learned my addr 172.21.15.33:0/2985167406 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f6860 0x7fa730106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 -- 172.21.15.33:0/2985167406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f6860 msgr2=0x7fa730106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f6860 0x7fa730106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 -- 172.21.15.33:0/2985167406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718005040 con 0x7fa7300f55c0 2022-02-02T13:53:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa72e59c700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa72000e7c0 tx=0x7fa72000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.522+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7200092e0 con 0x7fa7300f55c0 2022-02-02T13:53:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.523+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa72000f040 con 0x7fa7300f55c0 2022-02-02T13:53:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.523+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7301073b0 con 0x7fa7300f55c0 2022-02-02T13:53:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.523+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7200147e0 con 0x7fa7300f55c0 2022-02-02T13:53:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.523+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa730107970 con 0x7fa7300f55c0 2022-02-02T13:53:27.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.523+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7300f49b0 con 0x7fa7300f55c0 2022-02-02T13:53:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.524+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa72001b030 con 0x7fa7300f55c0 2022-02-02T13:53:27.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.524+0000 7fa726ffd700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.524+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fa720081aa0 con 0x7fa7300f55c0 2022-02-02T13:53:27.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.524+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.525+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa718005010 tx=0x7fa718016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:27.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.529+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa72004fb00 con 0x7fa7300f55c0 2022-02-02T13:53:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.743+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa7300ff790 con 0x7fa7300f55c0 2022-02-02T13:53:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.743+0000 7fa726ffd700 1 -- 172.21.15.33:0/2985167406 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa720019070 con 0x7fa7300f55c0 2022-02-02T13:53:27.744 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:53:27.744 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:53:27.744 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:53:27.744 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:53:27.745 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:27.745 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:53:27.745 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:53:27.745 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:53:27.746 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:53:27.746 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:53:27.746 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:53:27.746 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:53:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:53:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:53:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:53:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:53:27.747 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:53:27.748 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:53:27.748 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:53:27.748 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:53:27.748 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:53:27.749 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:53:27.749 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:53:27.749 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:53:27.749 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:53:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:53:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:53:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:53:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:53:27.750 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:53:27.751 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:53:27.751 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:27.751 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:27.751 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:53:27.752 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:27.752 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:27.752 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:27.752 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:27.752 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 msgr2=0x7fa71c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa718005010 tx=0x7fa718016040).stop 2022-02-02T13:53:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 msgr2=0x7fa730105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:27.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa72000e7c0 tx=0x7fa72000b040).stop 2022-02-02T13:53:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 shutdown_connections 2022-02-02T13:53:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f55c0 0x7fa730105e30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 --2- 172.21.15.33:0/2985167406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f6860 0x7fa730106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 >> 172.21.15.33:0/2985167406 conn(0x7fa7300f0d40 msgr2=0x7fa7300fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 shutdown_connections 2022-02-02T13:53:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:27.745+0000 7fa734ee3700 1 -- 172.21.15.33:0/2985167406 wait complete. 2022-02-02T13:53:27.756 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:53:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:27 smithi033 ceph-mon[101165]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:53:28.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:27 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3245746525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:53:28.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:27 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2985167406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:53:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:27 smithi037 ceph-mon[69017]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:53:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:27 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3245746525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:53:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:27 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2985167406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:53:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:28 smithi033 ceph-mon[101165]: from='client.44419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:53:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:28 smithi033 ceph-mon[101165]: pgmap v407: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:28 smithi037 ceph-mon[69017]: from='client.44419 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:53:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:28 smithi037 ceph-mon[69017]: pgmap v407: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:30 smithi033 ceph-mon[101165]: pgmap v408: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:30 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1584/58314 objects degraded (2.716%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:30 smithi037 ceph-mon[69017]: pgmap v408: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1584/58314 objects degraded (2.716%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:30 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1584/58314 objects degraded (2.716%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:32 smithi033 ceph-mon[101165]: pgmap v409: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1526/58314 objects degraded (2.617%); 58 KiB/s, 14 objects/s recovering 2022-02-02T13:53:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:32 smithi037 ceph-mon[69017]: pgmap v409: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1526/58314 objects degraded (2.617%); 58 KiB/s, 14 objects/s recovering 2022-02-02T13:53:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:34 smithi033 ceph-mon[101165]: pgmap v410: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1526/58314 objects degraded (2.617%); 42 KiB/s, 9 objects/s recovering 2022-02-02T13:53:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:34 smithi037 ceph-mon[69017]: pgmap v410: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1526/58314 objects degraded (2.617%); 42 KiB/s, 9 objects/s recovering 2022-02-02T13:53:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:35 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1526/58314 objects degraded (2.617%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:36.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:35 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1526/58314 objects degraded (2.617%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:36 smithi033 ceph-mon[101165]: pgmap v411: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 71 KiB/s, 14 objects/s recovering 2022-02-02T13:53:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:36 smithi037 ceph-mon[69017]: pgmap v411: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 71 KiB/s, 14 objects/s recovering 2022-02-02T13:53:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:38 smithi033 ceph-mon[101165]: pgmap v412: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:53:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:38 smithi037 ceph-mon[69017]: pgmap v412: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:53:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:40 smithi033 ceph-mon[101165]: pgmap v413: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:53:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:40 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1468/58314 objects degraded (2.517%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:40 smithi037 ceph-mon[69017]: pgmap v413: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1468/58314 objects degraded (2.517%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:53:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:40 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1468/58314 objects degraded (2.517%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:42 smithi033 ceph-mon[101165]: pgmap v414: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1410/58314 objects degraded (2.418%); 58 KiB/s, 14 objects/s recovering 2022-02-02T13:53:43.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:42 smithi037 ceph-mon[69017]: pgmap v414: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1410/58314 objects degraded (2.418%); 58 KiB/s, 14 objects/s recovering 2022-02-02T13:53:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:44 smithi033 ceph-mon[101165]: pgmap v415: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1410/58314 objects degraded (2.418%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:44 smithi037 ceph-mon[69017]: pgmap v415: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1410/58314 objects degraded (2.418%); 43 KiB/s, 9 objects/s recovering 2022-02-02T13:53:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:45 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1410/58314 objects degraded (2.418%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:46.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:45 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1410/58314 objects degraded (2.418%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:46 smithi033 ceph-mon[101165]: pgmap v416: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 57 KiB/s, 14 objects/s recovering 2022-02-02T13:53:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:46 smithi037 ceph-mon[69017]: pgmap v416: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 57 KiB/s, 14 objects/s recovering 2022-02-02T13:53:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:48 smithi033 ceph-mon[101165]: pgmap v417: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 28 KiB/s, 9 objects/s recovering 2022-02-02T13:53:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:48 smithi037 ceph-mon[69017]: pgmap v417: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 28 KiB/s, 9 objects/s recovering 2022-02-02T13:53:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:50 smithi033 ceph-mon[101165]: pgmap v418: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 28 KiB/s, 9 objects/s recovering 2022-02-02T13:53:51.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:50 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1352/58314 objects degraded (2.318%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:50 smithi037 ceph-mon[69017]: pgmap v418: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1352/58314 objects degraded (2.318%); 28 KiB/s, 9 objects/s recovering 2022-02-02T13:53:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:50 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1352/58314 objects degraded (2.318%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:52 smithi033 ceph-mon[101165]: pgmap v419: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1294/58314 objects degraded (2.219%); 48 KiB/s, 14 objects/s recovering 2022-02-02T13:53:53.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:52 smithi037 ceph-mon[69017]: pgmap v419: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1294/58314 objects degraded (2.219%); 48 KiB/s, 14 objects/s recovering 2022-02-02T13:53:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:54 smithi033 ceph-mon[101165]: pgmap v420: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1294/58314 objects degraded (2.219%); 33 KiB/s, 9 objects/s recovering 2022-02-02T13:53:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:54 smithi033 ceph-mon[101165]: osdmap e73: 6 total, 5 up, 5 in 2022-02-02T13:53:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:53:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:53:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:54 smithi037 ceph-mon[69017]: pgmap v420: 65 pgs: 2 active+recovery_wait+undersized+degraded+remapped, 1 active+recovering+undersized+degraded+remapped, 62 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 1294/58314 objects degraded (2.219%); 33 KiB/s, 9 objects/s recovering 2022-02-02T13:53:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:54 smithi037 ceph-mon[69017]: osdmap e73: 6 total, 5 up, 5 in 2022-02-02T13:53:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:53:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:53:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:55 smithi033 ceph-mon[101165]: osdmap e74: 6 total, 5 up, 5 in 2022-02-02T13:53:56.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:55 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 1294/58314 objects degraded (2.219%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:55 smithi037 ceph-mon[69017]: osdmap e74: 6 total, 5 up, 5 in 2022-02-02T13:53:56.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:55 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 1294/58314 objects degraded (2.219%), 3 pgs degraded, 3 pgs undersized (PG_DEGRADED) 2022-02-02T13:53:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:56 smithi033 ceph-mon[101165]: pgmap v423: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 569 KiB/s, 92 objects/s recovering 2022-02-02T13:53:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:56 smithi033 ceph-mon[101165]: osdmap e75: 6 total, 5 up, 5 in 2022-02-02T13:53:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:56 smithi037 ceph-mon[69017]: pgmap v423: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 569 KiB/s, 92 objects/s recovering 2022-02-02T13:53:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:56 smithi037 ceph-mon[69017]: osdmap e75: 6 total, 5 up, 5 in 2022-02-02T13:53:57.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.859+0000 7f858ce58700 1 -- 172.21.15.33:0/1302592993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 msgr2=0x7f85880fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:57.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.859+0000 7f858ce58700 1 --2- 172.21.15.33:0/1302592993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880fbc90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f8570004660 tx=0x7f8570009b30).stop 2022-02-02T13:53:57.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 -- 172.21.15.33:0/1302592993 shutdown_connections 2022-02-02T13:53:57.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 --2- 172.21.15.33:0/1302592993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880fbc90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:57.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 --2- 172.21.15.33:0/1302592993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:57.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 -- 172.21.15.33:0/1302592993 >> 172.21.15.33:0/1302592993 conn(0x7f85880f0d40 msgr2=0x7f85880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:57.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 -- 172.21.15.33:0/1302592993 shutdown_connections 2022-02-02T13:53:57.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 -- 172.21.15.33:0/1302592993 wait complete. 2022-02-02T13:53:57.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 Processor -- start 2022-02-02T13:53:57.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.860+0000 7f858ce58700 1 -- start start 2022-02-02T13:53:57.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858ce58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:57.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858ce58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:57.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858ce58700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858810ab70 con 0x7f85880f98a0 2022-02-02T13:53:57.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858ce58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858810acb0 con 0x7f8588060290 2022-02-02T13:53:57.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:57.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58602/0 (socket says 172.21.15.33:58602) 2022-02-02T13:53:57.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 -- 172.21.15.33:0/1259033480 learned_addr learned my addr 172.21.15.33:0/1259033480 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:57.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858659c700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:57.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 -- 172.21.15.33:0/1259033480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 msgr2=0x7f85880f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:57.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:57.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 -- 172.21.15.33:0/1259033480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570005040 con 0x7f85880f98a0 2022-02-02T13:53:57.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f858659c700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:53:57.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.861+0000 7f8585d9b700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f8570014040 tx=0x7f857000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:57.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.862+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8570019070 con 0x7f85880f98a0 2022-02-02T13:53:57.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.862+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8570007e70 con 0x7f85880f98a0 2022-02-02T13:53:57.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.862+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85880f5770 con 0x7f85880f98a0 2022-02-02T13:53:57.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.862+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8570014d10 con 0x7f85880f98a0 2022-02-02T13:53:57.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.862+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85880f5cd0 con 0x7f85880f98a0 2022-02-02T13:53:57.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.864+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8588045ad0 con 0x7f85880f98a0 2022-02-02T13:53:57.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.864+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8570025070 con 0x7f85880f98a0 2022-02-02T13:53:57.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.864+0000 7f857effd700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 0x7f8574067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:57.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.864+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7f85700829b0 con 0x7f85880f98a0 2022-02-02T13:53:57.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.864+0000 7f858659c700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 0x7f8574067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:57.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.865+0000 7f858659c700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 0x7f8574067290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f85880f6b30 tx=0x7f857800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:57.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:57.869+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8570050a40 con 0x7f85880f98a0 2022-02-02T13:53:58.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.056+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85880ff030 con 0x7f8574064dd0 2022-02-02T13:53:58.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.057+0000 7f857effd700 1 -- 172.21.15.33:0/1259033480 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f857800f040 con 0x7f8574064dd0 2022-02-02T13:53:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 msgr2=0x7f8574067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 0x7f8574067290 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f85880f6b30 tx=0x7f857800b040).stop 2022-02-02T13:53:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 msgr2=0x7f85880f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f8570014040 tx=0x7f857000b040).stop 2022-02-02T13:53:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 shutdown_connections 2022-02-02T13:53:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8574064dd0 0x7f8574067290 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8588060290 0x7f85880f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 --2- 172.21.15.33:0/1259033480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85880f98a0 0x7f85880f5220 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 >> 172.21.15.33:0/1259033480 conn(0x7f85880f0d40 msgr2=0x7f85880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 shutdown_connections 2022-02-02T13:53:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.059+0000 7f858ce58700 1 -- 172.21.15.33:0/1259033480 wait complete. 2022-02-02T13:53:58.069 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:53:58.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 -- 172.21.15.33:0/4048233278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f5430 msgr2=0x7f00d80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 --2- 172.21.15.33:0/4048233278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f5430 0x7f00d80f5850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f00d4004660 tx=0x7f00d4009b30).stop 2022-02-02T13:53:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 -- 172.21.15.33:0/4048233278 shutdown_connections 2022-02-02T13:53:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 --2- 172.21.15.33:0/4048233278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f66d0 0x7f00d80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 --2- 172.21.15.33:0/4048233278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f5430 0x7f00d80f5850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.160+0000 7f00dee3c700 1 -- 172.21.15.33:0/4048233278 >> 172.21.15.33:0/4048233278 conn(0x7f00d80f0b90 msgr2=0x7f00d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 -- 172.21.15.33:0/4048233278 shutdown_connections 2022-02-02T13:53:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 -- 172.21.15.33:0/4048233278 wait complete. 2022-02-02T13:53:58.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 Processor -- start 2022-02-02T13:53:58.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 -- start start 2022-02-02T13:53:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 0x7f00d810be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 0x7f00d810e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80602b0 con 0x7f00d80f66d0 2022-02-02T13:53:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dee3c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d80603f0 con 0x7f00d80f5430 2022-02-02T13:53:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.161+0000 7f00dd639700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 0x7f00d810e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dd639700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 0x7f00d810e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58612/0 (socket says 172.21.15.33:58612) 2022-02-02T13:53:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dd639700 1 -- 172.21.15.33:0/2168455295 learned_addr learned my addr 172.21.15.33:0/2168455295 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dde3a700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 0x7f00d810be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dde3a700 1 -- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 msgr2=0x7f00d810e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dde3a700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 0x7f00d810e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dde3a700 1 -- 172.21.15.33:0/2168455295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c8005040 con 0x7f00d80f5430 2022-02-02T13:53:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dde3a700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 0x7f00d810be40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f00d80f6530 tx=0x7f00d400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d4019070 con 0x7f00d80f5430 2022-02-02T13:53:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4005040 con 0x7f00d80f5430 2022-02-02T13:53:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00d4007e70 con 0x7f00d80f5430 2022-02-02T13:53:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d4014c20 con 0x7f00d80f5430 2022-02-02T13:53:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.162+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d810ea70 con 0x7f00d80f5430 2022-02-02T13:53:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.163+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d8045ad0 con 0x7f00d80f5430 2022-02-02T13:53:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.163+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f00d4025070 con 0x7f00d80f5430 2022-02-02T13:53:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.164+0000 7f00ce7fc700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 0x7f00c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.164+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7f00d40828d0 con 0x7f00d80f5430 2022-02-02T13:53:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.164+0000 7f00dd639700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 0x7f00c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.164+0000 7f00dd639700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 0x7f00c40672e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f00c8009fd0 tx=0x7f00c800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.168+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00d4050900 con 0x7f00d80f5430 2022-02-02T13:53:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.350+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d8057f10 con 0x7f00c4064e20 2022-02-02T13:53:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.365+0000 7f00ce7fc700 1 -- 172.21.15.33:0/2168455295 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f00d8057f10 con 0x7f00c4064e20 2022-02-02T13:53:58.365 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:53:58.366 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (19m) 105s ago 20m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:53:58.366 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (12m) 105s ago 20m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:53:58.366 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (12m) 108s ago 19m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:53:58.366 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (19m) 105s ago 20m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:53:58.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (12m) 105s ago 16m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:53:58.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (13m) 105s ago 16m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:53:58.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (14m) 108s ago 16m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:53:58.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (16m) 108s ago 16m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:53:58.368 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (13m) 105s ago 21m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:53:58.368 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (13m) 108s ago 19m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:53:58.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (13m) 105s ago 21m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:53:58.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (12m) 108s ago 19m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:53:58.368 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (19m) 105s ago 19m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:53:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (19m) 108s ago 19m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:53:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 105s ago 18m - 4096M 2022-02-02T13:53:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (18m) 105s ago 18m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:53:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (18m) 105s ago 18m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:53:58.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (18m) 108s ago 18m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:53:58.370 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (17m) 108s ago 17m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:53:58.370 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (17m) 108s ago 17m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:53:58.370 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (19m) 105s ago 19m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:53:58.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 msgr2=0x7f00c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 0x7f00c40672e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f00c8009fd0 tx=0x7f00c800b040).stop 2022-02-02T13:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 msgr2=0x7f00d810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 0x7f00d810be40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f00d80f6530 tx=0x7f00d400b040).stop 2022-02-02T13:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 shutdown_connections 2022-02-02T13:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00c4064e20 0x7f00c40672e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d80f5430 0x7f00d810be40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 --2- 172.21.15.33:0/2168455295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d80f66d0 0x7f00d810e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 >> 172.21.15.33:0/2168455295 conn(0x7f00d80f0b90 msgr2=0x7f00d80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 shutdown_connections 2022-02-02T13:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.367+0000 7f00dee3c700 1 -- 172.21.15.33:0/2168455295 wait complete. 2022-02-02T13:53:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 -- 172.21.15.33:0/3927756936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 msgr2=0x7fef140f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 --2- 172.21.15.33:0/3927756936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f9110 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fef04004660 tx=0x7fef04009b30).stop 2022-02-02T13:53:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 -- 172.21.15.33:0/3927756936 shutdown_connections 2022-02-02T13:53:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 --2- 172.21.15.33:0/3927756936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 0x7fef140fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 --2- 172.21.15.33:0/3927756936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f9110 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.467+0000 7fef189e9700 1 -- 172.21.15.33:0/3927756936 >> 172.21.15.33:0/3927756936 conn(0x7fef140f0b90 msgr2=0x7fef140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.468+0000 7fef189e9700 1 -- 172.21.15.33:0/3927756936 shutdown_connections 2022-02-02T13:53:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.468+0000 7fef189e9700 1 -- 172.21.15.33:0/3927756936 wait complete. 2022-02-02T13:53:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.468+0000 7fef189e9700 1 Processor -- start 2022-02-02T13:53:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.468+0000 7fef189e9700 1 -- start start 2022-02-02T13:53:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef189e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef189e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 0x7fef140f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef189e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140f5570 con 0x7fef14060310 2022-02-02T13:53:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef189e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef140f56b0 con 0x7fef140f9690 2022-02-02T13:53:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58620/0 (socket says 172.21.15.33:58620) 2022-02-02T13:53:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 -- 172.21.15.33:0/2047994756 learned_addr learned my addr 172.21.15.33:0/2047994756 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef12ffd700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 0x7fef140f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 -- 172.21.15.33:0/2047994756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 msgr2=0x7fef140f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 0x7fef140f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 -- 172.21.15.33:0/2047994756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08005040 con 0x7fef14060310 2022-02-02T13:53:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.469+0000 7fef137fe700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fef04000c00 tx=0x7fef0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.470+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef04019070 con 0x7fef14060310 2022-02-02T13:53:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.470+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef04005040 con 0x7fef14060310 2022-02-02T13:53:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.470+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fef04007e70 con 0x7fef14060310 2022-02-02T13:53:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.470+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef04014ce0 con 0x7fef14060310 2022-02-02T13:53:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.470+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef140f5d00 con 0x7fef14060310 2022-02-02T13:53:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.471+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fef04025070 con 0x7fef14060310 2022-02-02T13:53:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.472+0000 7feefbfff700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 0x7feefc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.472+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7fef04082a10 con 0x7fef14060310 2022-02-02T13:53:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.472+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef14059100 con 0x7fef14060310 2022-02-02T13:53:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.472+0000 7fef12ffd700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 0x7feefc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.472+0000 7fef12ffd700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 0x7feefc0672e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef140600e0 tx=0x7fef0800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.477+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fef04023070 con 0x7fef14060310 2022-02-02T13:53:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.719+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fef140fed10 con 0x7fef14060310 2022-02-02T13:53:58.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.719+0000 7feefbfff700 1 -- 172.21.15.33:0/2047994756 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fef04050aa0 con 0x7fef14060310 2022-02-02T13:53:58.720 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:53:58.720 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:53:58.720 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:53:58.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:58.721 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:53:58.721 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:53:58.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:58.721 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:53:58.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:53:58.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:58.722 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:53:58.722 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:53:58.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:53:58.723 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:53:58.723 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:53:58.723 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:53:58.724 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:53:58.724 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:53:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 msgr2=0x7feefc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 0x7feefc0672e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef140600e0 tx=0x7fef0800b040).stop 2022-02-02T13:53:58.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 msgr2=0x7fef140f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7fef04000c00 tx=0x7fef0400b040).stop 2022-02-02T13:53:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 shutdown_connections 2022-02-02T13:53:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feefc064e20 0x7feefc0672e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef14060310 0x7fef140f6b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 --2- 172.21.15.33:0/2047994756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef140f9690 0x7fef140f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 >> 172.21.15.33:0/2047994756 conn(0x7fef140f0b90 msgr2=0x7fef140f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 shutdown_connections 2022-02-02T13:53:58.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.721+0000 7fef189e9700 1 -- 172.21.15.33:0/2047994756 wait complete. 2022-02-02T13:53:58.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 -- 172.21.15.33:0/389650492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f6860 msgr2=0x7fdfa80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 --2- 172.21.15.33:0/389650492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f6860 0x7fdfa80f6cc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fdf94004660 tx=0x7fdf94009b30).stop 2022-02-02T13:53:58.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 -- 172.21.15.33:0/389650492 shutdown_connections 2022-02-02T13:53:58.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 --2- 172.21.15.33:0/389650492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f6860 0x7fdfa80f6cc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 --2- 172.21.15.33:0/389650492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f55c0 0x7fdfa80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 -- 172.21.15.33:0/389650492 >> 172.21.15.33:0/389650492 conn(0x7fdfa80f0d40 msgr2=0x7fdfa80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:58.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 -- 172.21.15.33:0/389650492 shutdown_connections 2022-02-02T13:53:58.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.822+0000 7fdfaf159700 1 -- 172.21.15.33:0/389650492 wait complete. 2022-02-02T13:53:58.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 Processor -- start 2022-02-02T13:53:58.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 -- start start 2022-02-02T13:53:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f6860 0x7fdfa8106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa8106920 con 0x7fdfa80f55c0 2022-02-02T13:53:58.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfaf159700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa8107130 con 0x7fdfa80f6860 2022-02-02T13:53:58.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58630/0 (socket says 172.21.15.33:58630) 2022-02-02T13:53:58.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 -- 172.21.15.33:0/3975980440 learned_addr learned my addr 172.21.15.33:0/3975980440 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:53:58.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfa7fff700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f6860 0x7fdfa8106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 -- 172.21.15.33:0/3975980440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f6860 msgr2=0x7fdfa8106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:58.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f6860 0x7fdfa8106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:58.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.823+0000 7fdfacef5700 1 -- 172.21.15.33:0/3975980440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c005040 con 0x7fdfa80f55c0 2022-02-02T13:53:58.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfacef5700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fdf9c0048a0 tx=0x7fdf9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9c00e030 con 0x7fdfa80f55c0 2022-02-02T13:53:58.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94005040 con 0x7fdfa80f55c0 2022-02-02T13:53:58.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf9c00f040 con 0x7fdfa80f55c0 2022-02-02T13:53:58.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9c014730 con 0x7fdfa80f55c0 2022-02-02T13:53:58.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.824+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa81077e0 con 0x7fdfa80f55c0 2022-02-02T13:53:58.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.825+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa8045ad0 con 0x7fdfa80f55c0 2022-02-02T13:53:58.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.825+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf9c010500 con 0x7fdfa80f55c0 2022-02-02T13:53:58.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.826+0000 7fdfa57fa700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 0x7fdf98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:53:58.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.826+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7fdf9c0820a0 con 0x7fdfa80f55c0 2022-02-02T13:53:58.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.826+0000 7fdfa7fff700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 0x7fdf98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:53:58.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.826+0000 7fdfa7fff700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 0x7fdf98067290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdf94005010 tx=0x7fdf94016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:53:58.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:58.830+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf9c050130 con 0x7fdfa80f55c0 2022-02-02T13:53:58.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:58 smithi033 ceph-mon[101165]: pgmap v425: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 720 KiB/s, 113 objects/s recovering 2022-02-02T13:53:58.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:58 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2047994756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:53:59.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.043+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdfa80fdf00 con 0x7fdfa80f55c0 2022-02-02T13:53:59.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.043+0000 7fdfa57fa700 1 -- 172.21.15.33:0/3975980440 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fdf9c053750 con 0x7fdfa80f55c0 2022-02-02T13:53:59.044 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:53:59.044 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:53:59.044 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:53:59.045 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:53:59.045 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:59.045 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:53:59.045 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:53:59.046 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:53:59.046 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:53:59.046 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:53:59.046 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:53:59.046 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:53:59.047 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:53:59.047 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:53:59.047 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:53:59.047 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:53:59.048 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:53:59.048 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:53:59.048 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:53:59.048 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:53:59.048 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:53:59.049 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:53:59.049 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:53:59.049 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:53:59.049 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:53:59.051 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:53:59.051 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:59.051 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:59.051 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:53:59.052 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:53:59.052 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:59.052 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:59.052 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:59.052 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:53:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 msgr2=0x7fdf98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 0x7fdf98067290 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fdf94005010 tx=0x7fdf94016040).stop 2022-02-02T13:53:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 msgr2=0x7fdfa8105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:53:59.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fdf9c0048a0 tx=0x7fdf9c009b30).stop 2022-02-02T13:53:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 shutdown_connections 2022-02-02T13:53:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf98064dd0 0x7fdf98067290 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa80f55c0 0x7fdfa8105e30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 --2- 172.21.15.33:0/3975980440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa80f6860 0x7fdfa8106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:53:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.045+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 >> 172.21.15.33:0/3975980440 conn(0x7fdfa80f0d40 msgr2=0x7fdfa80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:53:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.046+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 shutdown_connections 2022-02-02T13:53:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:53:59.046+0000 7fdfaf159700 1 -- 172.21.15.33:0/3975980440 wait complete. 2022-02-02T13:53:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:53:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:58 smithi037 ceph-mon[69017]: pgmap v425: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 720 KiB/s, 113 objects/s recovering 2022-02-02T13:53:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:58 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2047994756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:54:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:59 smithi033 ceph-mon[101165]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:00.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:59 smithi033 ceph-mon[101165]: from='client.44433 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:00.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:53:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3975980440' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:54:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:59 smithi037 ceph-mon[69017]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:59 smithi037 ceph-mon[69017]: from='client.44433 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:53:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3975980440' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:54:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:00 smithi033 ceph-mon[101165]: pgmap v426: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 720 KiB/s, 113 objects/s recovering 2022-02-02T13:54:01.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:00 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 611/58314 objects degraded (1.048%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:00 smithi037 ceph-mon[69017]: pgmap v426: 65 pgs: 1 peering, 1 active+recovering+undersized+degraded+remapped, 63 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 611/58314 objects degraded (1.048%); 720 KiB/s, 113 objects/s recovering 2022-02-02T13:54:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:00 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 611/58314 objects degraded (1.048%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:02 smithi033 ceph-mon[101165]: pgmap v427: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 553/58314 objects degraded (0.948%); 569 KiB/s, 94 objects/s recovering 2022-02-02T13:54:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:02 smithi037 ceph-mon[69017]: pgmap v427: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 553/58314 objects degraded (0.948%); 569 KiB/s, 94 objects/s recovering 2022-02-02T13:54:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:04 smithi033 ceph-mon[101165]: pgmap v428: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 553/58314 objects degraded (0.948%); 505 KiB/s, 83 objects/s recovering 2022-02-02T13:54:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:04 smithi037 ceph-mon[69017]: pgmap v428: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 553/58314 objects degraded (0.948%); 505 KiB/s, 83 objects/s recovering 2022-02-02T13:54:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:05 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 553/58314 objects degraded (0.948%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:06.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:05 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 553/58314 objects degraded (0.948%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:06 smithi033 ceph-mon[101165]: pgmap v429: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 36 KiB/s, 11 objects/s recovering 2022-02-02T13:54:07.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:06 smithi037 ceph-mon[69017]: pgmap v429: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 36 KiB/s, 11 objects/s recovering 2022-02-02T13:54:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:08 smithi033 ceph-mon[101165]: pgmap v430: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 30 KiB/s, 9 objects/s recovering 2022-02-02T13:54:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:08 smithi037 ceph-mon[69017]: pgmap v430: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 30 KiB/s, 9 objects/s recovering 2022-02-02T13:54:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:10 smithi033 ceph-mon[101165]: pgmap v431: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 30 KiB/s, 9 objects/s recovering 2022-02-02T13:54:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:10 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 495/58314 objects degraded (0.849%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:10 smithi037 ceph-mon[69017]: pgmap v431: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 495/58314 objects degraded (0.849%); 30 KiB/s, 9 objects/s recovering 2022-02-02T13:54:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:10 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 495/58314 objects degraded (0.849%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:12 smithi033 ceph-mon[101165]: pgmap v432: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 43 KiB/s, 14 objects/s recovering 2022-02-02T13:54:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:12 smithi037 ceph-mon[69017]: pgmap v432: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 43 KiB/s, 14 objects/s recovering 2022-02-02T13:54:14.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:54:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:54:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:13 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:54:14.129 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:54:14.129 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:54:14.129 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:13 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:54:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:14 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:54:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:14 smithi033 ceph-mon[101165]: pgmap v433: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:54:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:15.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:14 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:54:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:14 smithi037 ceph-mon[69017]: pgmap v433: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 29 KiB/s, 9 objects/s recovering 2022-02-02T13:54:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:15 smithi033 ceph-mon[101165]: pgmap v434: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 32 KiB/s, 10 objects/s recovering 2022-02-02T13:54:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:15 smithi033 ceph-mon[101165]: pgmap v435: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 18 KiB/s, 6 objects/s recovering 2022-02-02T13:54:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:15 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 437/58314 objects degraded (0.749%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:16.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:15 smithi037 ceph-mon[69017]: pgmap v434: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 32 KiB/s, 10 objects/s recovering 2022-02-02T13:54:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:15 smithi037 ceph-mon[69017]: pgmap v435: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 437/58314 objects degraded (0.749%); 18 KiB/s, 6 objects/s recovering 2022-02-02T13:54:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:15 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 437/58314 objects degraded (0.749%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:17 smithi033 ceph-mon[101165]: pgmap v436: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 379/58314 objects degraded (0.650%); 36 KiB/s, 13 objects/s recovering 2022-02-02T13:54:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:17 smithi037 ceph-mon[69017]: pgmap v436: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 379/58314 objects degraded (0.650%); 36 KiB/s, 13 objects/s recovering 2022-02-02T13:54:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:19 smithi033 ceph-mon[101165]: pgmap v437: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 379/58314 objects degraded (0.650%); 36 KiB/s, 13 objects/s recovering 2022-02-02T13:54:20.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:19 smithi037 ceph-mon[69017]: pgmap v437: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 379/58314 objects degraded (0.650%); 36 KiB/s, 13 objects/s recovering 2022-02-02T13:54:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:20 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 379/58314 objects degraded (0.650%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:21.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:20 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 379/58314 objects degraded (0.650%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:21 smithi033 ceph-mon[101165]: pgmap v438: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 47 KiB/s, 13 objects/s recovering 2022-02-02T13:54:22.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:21 smithi037 ceph-mon[69017]: pgmap v438: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 47 KiB/s, 13 objects/s recovering 2022-02-02T13:54:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:23 smithi033 ceph-mon[101165]: pgmap v439: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 47 KiB/s, 13 objects/s recovering 2022-02-02T13:54:24.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:23 smithi037 ceph-mon[69017]: pgmap v439: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 47 KiB/s, 13 objects/s recovering 2022-02-02T13:54:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:25 smithi033 ceph-mon[101165]: pgmap v440: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 42 KiB/s, 11 objects/s recovering 2022-02-02T13:54:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:25 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 320/58314 objects degraded (0.549%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:25 smithi037 ceph-mon[69017]: pgmap v440: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 320/58314 objects degraded (0.549%); 42 KiB/s, 11 objects/s recovering 2022-02-02T13:54:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:25 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 320/58314 objects degraded (0.549%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:27 smithi033 ceph-mon[101165]: pgmap v441: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 262/58314 objects degraded (0.449%); 53 KiB/s, 14 objects/s recovering 2022-02-02T13:54:28.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:27 smithi037 ceph-mon[69017]: pgmap v441: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 262/58314 objects degraded (0.449%); 53 KiB/s, 14 objects/s recovering 2022-02-02T13:54:29.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/413032652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f6860 msgr2=0x7fc2b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/413032652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f6860 0x7fc2b40f6cc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fc29c004660 tx=0x7fc29c009b30).stop 2022-02-02T13:54:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/413032652 shutdown_connections 2022-02-02T13:54:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/413032652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f6860 0x7fc2b40f6cc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/413032652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f55c0 0x7fc2b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/413032652 >> 172.21.15.33:0/413032652 conn(0x7fc2b40f0d40 msgr2=0x7fc2b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/413032652 shutdown_connections 2022-02-02T13:54:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.162+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/413032652 wait complete. 2022-02-02T13:54:29.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 Processor -- start 2022-02-02T13:54:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 -- start start 2022-02-02T13:54:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 0x7fc2b410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b40603e0 con 0x7fc2b40f55c0 2022-02-02T13:54:29.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b8e6f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b4060520 con 0x7fc2b40f6860 2022-02-02T13:54:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58640/0 (socket says 172.21.15.33:58640) 2022-02-02T13:54:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 -- 172.21.15.33:0/1654546923 learned_addr learned my addr 172.21.15.33:0/1654546923 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:54:29.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b1d9b700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 0x7fc2b410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 -- 172.21.15.33:0/1654546923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 msgr2=0x7fc2b410c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 0x7fc2b410c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.163+0000 7fc2b259c700 1 -- 172.21.15.33:0/1654546923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c005040 con 0x7fc2b40f55c0 2022-02-02T13:54:29.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2b1d9b700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 0x7fc2b410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:54:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2b259c700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc2a400eb70 tx=0x7fc2a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a40092e0 con 0x7fc2b40f55c0 2022-02-02T13:54:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc2a400f040 con 0x7fc2b40f55c0 2022-02-02T13:54:29.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b410c670 con 0x7fc2b40f55c0 2022-02-02T13:54:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b410cc30 con 0x7fc2b40f55c0 2022-02-02T13:54:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.164+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a400c8a0 con 0x7fc2b40f55c0 2022-02-02T13:54:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.166+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc2a401b030 con 0x7fc2b40f55c0 2022-02-02T13:54:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.166+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b4045ad0 con 0x7fc2b40f55c0 2022-02-02T13:54:29.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.166+0000 7fc2aaffd700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 0x7fc2a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.166+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7fc2a4081a90 con 0x7fc2b40f55c0 2022-02-02T13:54:29.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.166+0000 7fc2b1d9b700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 0x7fc2a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.167+0000 7fc2b1d9b700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 0x7fc2a0067290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc29c005010 tx=0x7fc29c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.171+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc2a404fbd0 con 0x7fc2b40f55c0 2022-02-02T13:54:29.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.357+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2b40fddf0 con 0x7fc2a0064dd0 2022-02-02T13:54:29.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.359+0000 7fc2aaffd700 1 -- 172.21.15.33:0/1654546923 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc2b40fddf0 con 0x7fc2a0064dd0 2022-02-02T13:54:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 msgr2=0x7fc2a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 0x7fc2a0067290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fc29c005010 tx=0x7fc29c016040).stop 2022-02-02T13:54:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 msgr2=0x7fc2b4109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc2a400eb70 tx=0x7fc2a400b040).stop 2022-02-02T13:54:29.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 shutdown_connections 2022-02-02T13:54:29.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2a0064dd0 0x7fc2a0067290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2b40f55c0 0x7fc2b4109bc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 --2- 172.21.15.33:0/1654546923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2b40f6860 0x7fc2b410c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 >> 172.21.15.33:0/1654546923 conn(0x7fc2b40f0d40 msgr2=0x7fc2b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 shutdown_connections 2022-02-02T13:54:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.361+0000 7fc2b8e6f700 1 -- 172.21.15.33:0/1654546923 wait complete. 2022-02-02T13:54:29.370 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:54:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 -- 172.21.15.33:0/3907037425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 msgr2=0x7f9eb00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 --2- 172.21.15.33:0/3907037425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb00f6cc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f9ea40045a0 tx=0x7f9ea4009b30).stop 2022-02-02T13:54:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 -- 172.21.15.33:0/3907037425 shutdown_connections 2022-02-02T13:54:29.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 --2- 172.21.15.33:0/3907037425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb00f6cc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 --2- 172.21.15.33:0/3907037425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 -- 172.21.15.33:0/3907037425 >> 172.21.15.33:0/3907037425 conn(0x7f9eb00f0d40 msgr2=0x7f9eb00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 -- 172.21.15.33:0/3907037425 shutdown_connections 2022-02-02T13:54:29.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.462+0000 7f9eb5194700 1 -- 172.21.15.33:0/3907037425 wait complete. 2022-02-02T13:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 Processor -- start 2022-02-02T13:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 -- start start 2022-02-02T13:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb0105e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb0106300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0106900 con 0x7f9eb00f55c0 2022-02-02T13:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eb5194700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb0107110 con 0x7f9eb00f6860 2022-02-02T13:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eaed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb0105e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb0106300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eaed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb0105e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58650/0 (socket says 172.21.15.33:58650) 2022-02-02T13:54:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.463+0000 7f9eaed9d700 1 -- 172.21.15.33:0/71982424 learned_addr learned my addr 172.21.15.33:0/71982424 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:54:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eae59c700 1 -- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 msgr2=0x7f9eb0105e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eae59c700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb0105e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eae59c700 1 -- 172.21.15.33:0/71982424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4005040 con 0x7f9eb00f6860 2022-02-02T13:54:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eae59c700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb0106300 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9ea4000c00 tx=0x7f9ea400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea400e070 con 0x7f9eb00f6860 2022-02-02T13:54:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb0107330 con 0x7f9eb00f6860 2022-02-02T13:54:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9ea4007e70 con 0x7f9eb00f6860 2022-02-02T13:54:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ea4019070 con 0x7f9eb00f6860 2022-02-02T13:54:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.464+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb0107810 con 0x7f9eb00f6860 2022-02-02T13:54:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.465+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb00f49b0 con 0x7f9eb00f6860 2022-02-02T13:54:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.465+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9ea4025070 con 0x7f9eb00f6860 2022-02-02T13:54:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.466+0000 7f9e977fe700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 0x7f9e98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.466+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7f9ea4082540 con 0x7f9eb00f6860 2022-02-02T13:54:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.466+0000 7f9eaed9d700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 0x7f9e98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.466+0000 7f9eaed9d700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 0x7f9e98067290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9eb0105b80 tx=0x7f9ea000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.470+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9ea4050570 con 0x7f9eb00f6860 2022-02-02T13:54:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.652+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9eb00fdf10 con 0x7f9e98064dd0 2022-02-02T13:54:29.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.666+0000 7f9e977fe700 1 -- 172.21.15.33:0/71982424 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9eb00fdf10 con 0x7f9e98064dd0 2022-02-02T13:54:29.668 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:54:29.673 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (19m) 2m ago 20m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:54:29.674 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (12m) 2m ago 20m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:54:29.674 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (12m) 2m ago 20m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:54:29.674 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (19m) 2m ago 20m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:54:29.674 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (13m) 2m ago 16m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:54:29.675 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (13m) 2m ago 16m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:54:29.675 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (14m) 2m ago 17m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:54:29.676 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (16m) 2m ago 16m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:54:29.676 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (14m) 2m ago 22m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:54:29.676 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (13m) 2m ago 20m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:54:29.677 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (13m) 2m ago 22m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:54:29.677 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (13m) 2m ago 20m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:54:29.677 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (20m) 2m ago 20m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:54:29.677 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (20m) 2m ago 20m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:54:29.677 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 2m ago 19m - 4096M 2022-02-02T13:54:29.678 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (19m) 2m ago 19m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:54:29.678 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (18m) 2m ago 18m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:54:29.678 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (18m) 2m ago 18m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:54:29.678 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (18m) 2m ago 18m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:54:29.679 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (18m) 2m ago 18m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:54:29.679 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (19m) 2m ago 20m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:54:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 msgr2=0x7f9e98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 0x7f9e98067290 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9eb0105b80 tx=0x7f9ea000b040).stop 2022-02-02T13:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 msgr2=0x7f9eb0106300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb0106300 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9ea4000c00 tx=0x7f9ea400b040).stop 2022-02-02T13:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 shutdown_connections 2022-02-02T13:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e98064dd0 0x7f9e98067290 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9eb00f55c0 0x7f9eb0105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 --2- 172.21.15.33:0/71982424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9eb00f6860 0x7f9eb0106300 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 >> 172.21.15.33:0/71982424 conn(0x7f9eb00f0d40 msgr2=0x7f9eb00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 shutdown_connections 2022-02-02T13:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.668+0000 7f9eb5194700 1 -- 172.21.15.33:0/71982424 wait complete. 2022-02-02T13:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 -- 172.21.15.33:0/1346199979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40fbbf0 msgr2=0x7f44b40fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/1346199979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40fbbf0 0x7f44b40fdfe0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f449c004660 tx=0x7f449c009b30).stop 2022-02-02T13:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 -- 172.21.15.33:0/1346199979 shutdown_connections 2022-02-02T13:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/1346199979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40fbbf0 0x7f44b40fdfe0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/1346199979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40602b0 0x7f44b40fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 -- 172.21.15.33:0/1346199979 >> 172.21.15.33:0/1346199979 conn(0x7f44b40f0d40 msgr2=0x7f44b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 -- 172.21.15.33:0/1346199979 shutdown_connections 2022-02-02T13:54:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.769+0000 7f44b8ca0700 1 -- 172.21.15.33:0/1346199979 wait complete. 2022-02-02T13:54:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 Processor -- start 2022-02-02T13:54:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 -- start start 2022-02-02T13:54:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 0x7f44b41095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4109b80 con 0x7f44b40602b0 2022-02-02T13:54:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b8ca0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b4109cc0 con 0x7f44b40fbbf0 2022-02-02T13:54:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58660/0 (socket says 172.21.15.33:58660) 2022-02-02T13:54:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b259c700 1 -- 172.21.15.33:0/3445478596 learned_addr learned my addr 172.21.15.33:0/3445478596 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:54:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.770+0000 7f44b1d9b700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 0x7f44b41095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b259c700 1 -- 172.21.15.33:0/3445478596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 msgr2=0x7f44b41095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:29.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b259c700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 0x7f44b41095d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:29.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b259c700 1 -- 172.21.15.33:0/3445478596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c005040 con 0x7f44b40602b0 2022-02-02T13:54:29.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b1d9b700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 0x7f44b41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:54:29.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b259c700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f44a400e7f0 tx=0x7f44a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a40092e0 con 0x7f44b40602b0 2022-02-02T13:54:29.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f44a400f040 con 0x7f44b40602b0 2022-02-02T13:54:29.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b410a660 con 0x7f44b40602b0 2022-02-02T13:54:29.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a4014750 con 0x7f44b40602b0 2022-02-02T13:54:29.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.771+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b410ac20 con 0x7f44b40602b0 2022-02-02T13:54:29.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.772+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b4045ad0 con 0x7f44b40602b0 2022-02-02T13:54:29.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.773+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f44a401b030 con 0x7f44b40602b0 2022-02-02T13:54:29.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.773+0000 7f44aaffd700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 0x7f44a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:29.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.773+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7f44a40818a0 con 0x7f44b40602b0 2022-02-02T13:54:29.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.773+0000 7f44b1d9b700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 0x7f44a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:29.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.773+0000 7f44b1d9b700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 0x7f44a0067290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f449c004d80 tx=0x7f449c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:29.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:29.777+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f44a4053410 con 0x7f44b40602b0 2022-02-02T13:54:30.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.023+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f44b4027a00 con 0x7f44b40602b0 2022-02-02T13:54:30.023 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:29 smithi033 ceph-mon[101165]: pgmap v442: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 262/58314 objects degraded (0.449%); 40 KiB/s, 9 objects/s recovering 2022-02-02T13:54:30.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.023+0000 7f44aaffd700 1 -- 172.21.15.33:0/3445478596 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f44a4053000 con 0x7f44b40602b0 2022-02-02T13:54:30.024 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:54:30.024 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:54:30.024 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:54:30.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:54:30.025 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:54:30.025 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:54:30.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:54:30.026 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:54:30.026 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:54:30.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:54:30.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:54:30.026 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:54:30.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:54:30.027 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:54:30.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:54:30.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:54:30.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:54:30.028 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:54:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 msgr2=0x7f44a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 0x7f44a0067290 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f449c004d80 tx=0x7f449c016040).stop 2022-02-02T13:54:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 msgr2=0x7f44b41090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f44a400e7f0 tx=0x7f44a400b040).stop 2022-02-02T13:54:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 shutdown_connections 2022-02-02T13:54:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44a0064dd0 0x7f44a0067290 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44b40602b0 0x7f44b41090e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 --2- 172.21.15.33:0/3445478596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44b40fbbf0 0x7f44b41095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 >> 172.21.15.33:0/3445478596 conn(0x7f44b40f0d40 msgr2=0x7f44b40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 shutdown_connections 2022-02-02T13:54:30.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.026+0000 7f44b8ca0700 1 -- 172.21.15.33:0/3445478596 wait complete. 2022-02-02T13:54:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 -- 172.21.15.33:0/1397091438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 msgr2=0x7f29440f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 --2- 172.21.15.33:0/1397091438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f29440f5850 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f2940004660 tx=0x7f2940009b30).stop 2022-02-02T13:54:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 -- 172.21.15.33:0/1397091438 shutdown_connections 2022-02-02T13:54:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 --2- 172.21.15.33:0/1397091438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 0x7f29440f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 --2- 172.21.15.33:0/1397091438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f29440f5850 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 -- 172.21.15.33:0/1397091438 >> 172.21.15.33:0/1397091438 conn(0x7f29440f0b90 msgr2=0x7f29440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 -- 172.21.15.33:0/1397091438 shutdown_connections 2022-02-02T13:54:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.127+0000 7f294ad9e700 1 -- 172.21.15.33:0/1397091438 wait complete. 2022-02-02T13:54:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.128+0000 7f294ad9e700 1 Processor -- start 2022-02-02T13:54:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.128+0000 7f294ad9e700 1 -- start start 2022-02-02T13:54:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.128+0000 7f294ad9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:30.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.128+0000 7f294ad9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 0x7f294410bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f294ad9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29440603e0 con 0x7f29440f5430 2022-02-02T13:54:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f294ad9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944060520 con 0x7f29440f66d0 2022-02-02T13:54:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:30.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58670/0 (socket says 172.21.15.33:58670) 2022-02-02T13:54:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 -- 172.21.15.33:0/3510495050 learned_addr learned my addr 172.21.15.33:0/3510495050 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:54:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f294959b700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 0x7f294410bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 -- 172.21.15.33:0/3510495050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 msgr2=0x7f294410bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 0x7f294410bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 -- 172.21.15.33:0/3510495050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940005040 con 0x7f29440f5430 2022-02-02T13:54:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f2949d9c700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f2940014040 tx=0x7f294000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2940019070 con 0x7f29440f5430 2022-02-02T13:54:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2940007e70 con 0x7f29440f5430 2022-02-02T13:54:30.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294410c470 con 0x7f29440f5430 2022-02-02T13:54:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2940014d10 con 0x7f29440f5430 2022-02-02T13:54:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.129+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294410c9d0 con 0x7f29440f5430 2022-02-02T13:54:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.130+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2944045ad0 con 0x7f29440f5430 2022-02-02T13:54:30.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.131+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2940025070 con 0x7f29440f5430 2022-02-02T13:54:30.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.131+0000 7f29367fc700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 0x7f29300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:54:30.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.131+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6662+0+0 (secure 0 0 0) 0x7f2940082ab0 con 0x7f29440f5430 2022-02-02T13:54:30.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.131+0000 7f294959b700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 0x7f29300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:54:30.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.132+0000 7f294959b700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 0x7f29300672e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2938009fd0 tx=0x7f293800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:54:30.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.135+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2940050b40 con 0x7f29440f5430 2022-02-02T13:54:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:29 smithi037 ceph-mon[69017]: pgmap v442: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 262/58314 objects degraded (0.449%); 40 KiB/s, 9 objects/s recovering 2022-02-02T13:54:30.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.354+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f29440fdd30 con 0x7f29440f5430 2022-02-02T13:54:30.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.354+0000 7f29367fc700 1 -- 172.21.15.33:0/3510495050 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2940023030 con 0x7f29440f5430 2022-02-02T13:54:30.355 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:54:30.355 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:54:30.355 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:54:30.356 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:54:30.356 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:54:30.356 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:54:30.356 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:54:30.357 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:54:30.357 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:54:30.357 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:54:30.357 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:54:30.357 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:54:30.358 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:54:30.358 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:54:30.358 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:54:30.358 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:54:30.359 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:54:30.359 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:54:30.359 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:54:30.359 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:54:30.359 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:54:30.360 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:54:30.360 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:54:30.360 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:54:30.360 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:54:30.360 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:54:30.361 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:54:30.361 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:54:30.361 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:54:30.362 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:54:30.362 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:54:30.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:54:30.362 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:54:30.362 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:54:30.363 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:54:30.363 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:54:30.363 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:54:30.363 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:54:30.364 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:54:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.356+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 msgr2=0x7f29300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.356+0000 7f294ad9e700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 0x7f29300672e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2938009fd0 tx=0x7f293800b040).stop 2022-02-02T13:54:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.356+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 msgr2=0x7f2944109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:54:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.356+0000 7f294ad9e700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f2940014040 tx=0x7f294000b040).stop 2022-02-02T13:54:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 shutdown_connections 2022-02-02T13:54:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2930064e20 0x7f29300672e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29440f5430 0x7f2944109a20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 --2- 172.21.15.33:0/3510495050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29440f66d0 0x7f294410bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:54:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 >> 172.21.15.33:0/3510495050 conn(0x7f29440f0b90 msgr2=0x7f29440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:54:30.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 shutdown_connections 2022-02-02T13:54:30.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:54:30.357+0000 7f294ad9e700 1 -- 172.21.15.33:0/3510495050 wait complete. 2022-02-02T13:54:30.367 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:54:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:30 smithi033 ceph-mon[101165]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:30 smithi033 ceph-mon[101165]: from='client.44449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:31.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3445478596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:54:31.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3510495050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:54:31.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:30 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 262/58314 objects degraded (0.449%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:30 smithi037 ceph-mon[69017]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:30 smithi037 ceph-mon[69017]: from='client.44449 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:54:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3445478596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:54:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3510495050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:54:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:30 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 262/58314 objects degraded (0.449%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:31 smithi033 ceph-mon[101165]: pgmap v443: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 98 KiB/s, 14 objects/s recovering 2022-02-02T13:54:32.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:31 smithi037 ceph-mon[69017]: pgmap v443: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 98 KiB/s, 14 objects/s recovering 2022-02-02T13:54:34.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:33 smithi033 ceph-mon[101165]: pgmap v444: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 76 KiB/s, 9 objects/s recovering 2022-02-02T13:54:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:33 smithi037 ceph-mon[69017]: pgmap v444: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 76 KiB/s, 9 objects/s recovering 2022-02-02T13:54:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:35 smithi033 ceph-mon[101165]: pgmap v445: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 76 KiB/s, 9 objects/s recovering 2022-02-02T13:54:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:35 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 204/58314 objects degraded (0.350%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:36.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:35 smithi037 ceph-mon[69017]: pgmap v445: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 204/58314 objects degraded (0.350%); 76 KiB/s, 9 objects/s recovering 2022-02-02T13:54:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:35 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 204/58314 objects degraded (0.350%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:37 smithi033 ceph-mon[101165]: pgmap v446: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 146/58314 objects degraded (0.250%); 102 KiB/s, 14 objects/s recovering 2022-02-02T13:54:38.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:37 smithi037 ceph-mon[69017]: pgmap v446: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 146/58314 objects degraded (0.250%); 102 KiB/s, 14 objects/s recovering 2022-02-02T13:54:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:39 smithi033 ceph-mon[101165]: pgmap v447: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 146/58314 objects degraded (0.250%); 84 KiB/s, 9 objects/s recovering 2022-02-02T13:54:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:39 smithi037 ceph-mon[69017]: pgmap v447: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 146/58314 objects degraded (0.250%); 84 KiB/s, 9 objects/s recovering 2022-02-02T13:54:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:40 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 146/58314 objects degraded (0.250%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:40 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 146/58314 objects degraded (0.250%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:41 smithi033 ceph-mon[101165]: pgmap v448: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 102 KiB/s, 14 objects/s recovering 2022-02-02T13:54:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:41 smithi037 ceph-mon[69017]: pgmap v448: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 102 KiB/s, 14 objects/s recovering 2022-02-02T13:54:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:43 smithi033 ceph-mon[101165]: pgmap v449: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:54:44.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:43 smithi037 ceph-mon[69017]: pgmap v449: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:54:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:45 smithi033 ceph-mon[101165]: pgmap v450: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:54:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:45 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 88/58314 objects degraded (0.151%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:45 smithi037 ceph-mon[69017]: pgmap v450: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 88/58314 objects degraded (0.151%); 44 KiB/s, 9 objects/s recovering 2022-02-02T13:54:46.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:45 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 88/58314 objects degraded (0.151%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:48.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:47 smithi033 ceph-mon[101165]: pgmap v451: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 29/58314 objects degraded (0.050%); 72 KiB/s, 14 objects/s recovering 2022-02-02T13:54:48.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:47 smithi037 ceph-mon[69017]: pgmap v451: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 29/58314 objects degraded (0.050%); 72 KiB/s, 14 objects/s recovering 2022-02-02T13:54:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:48 smithi033 ceph-mon[101165]: osdmap e76: 6 total, 5 up, 5 in 2022-02-02T13:54:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:48 smithi037 ceph-mon[69017]: osdmap e76: 6 total, 5 up, 5 in 2022-02-02T13:54:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:49 smithi033 ceph-mon[101165]: pgmap v453: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 29/58314 objects degraded (0.050%); 55 KiB/s, 11 objects/s recovering 2022-02-02T13:54:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:49 smithi033 ceph-mon[101165]: osdmap e77: 6 total, 5 up, 5 in 2022-02-02T13:54:50.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:49 smithi037 ceph-mon[69017]: pgmap v453: 65 pgs: 1 active+recovering+undersized+degraded+remapped, 64 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 29/58314 objects degraded (0.050%); 55 KiB/s, 11 objects/s recovering 2022-02-02T13:54:50.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:49 smithi037 ceph-mon[69017]: osdmap e77: 6 total, 5 up, 5 in 2022-02-02T13:54:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:50 smithi033 ceph-mon[101165]: Health check update: Degraded data redundancy: 29/58314 objects degraded (0.050%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:50 smithi037 ceph-mon[69017]: Health check update: Degraded data redundancy: 29/58314 objects degraded (0.050%), 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2022-02-02T13:54:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:51 smithi033 ceph-mon[101165]: pgmap v455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 57 KiB/s, 10 objects/s recovering 2022-02-02T13:54:52.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:51 smithi033 ceph-mon[101165]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/58314 objects degraded (0.050%), 1 pg degraded, 1 pg undersized) 2022-02-02T13:54:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:51 smithi037 ceph-mon[69017]: pgmap v455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 57 KiB/s, 10 objects/s recovering 2022-02-02T13:54:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:51 smithi037 ceph-mon[69017]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/58314 objects degraded (0.050%), 1 pg degraded, 1 pg undersized) 2022-02-02T13:54:54.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:53 smithi033 ceph-mon[101165]: pgmap v456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 57 KiB/s, 10 objects/s recovering 2022-02-02T13:54:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:53 smithi037 ceph-mon[69017]: pgmap v456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 57 KiB/s, 10 objects/s recovering 2022-02-02T13:54:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:54:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:54:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:55 smithi033 ceph-mon[101165]: pgmap v457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 15 KiB/s, 3 objects/s recovering 2022-02-02T13:54:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:54:55.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:54:55.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:54:55.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:55 smithi037 ceph-mon[69017]: pgmap v457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 15 KiB/s, 3 objects/s recovering 2022-02-02T13:54:58.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:57 smithi037 ceph-mon[69017]: pgmap v458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 14 KiB/s, 3 objects/s recovering 2022-02-02T13:54:58.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:57 smithi033 ceph-mon[101165]: pgmap v458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 14 KiB/s, 3 objects/s recovering 2022-02-02T13:55:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:59 smithi037 ceph-mon[69017]: pgmap v459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 12 KiB/s, 2 objects/s recovering 2022-02-02T13:55:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:54:59 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:59 smithi033 ceph-mon[101165]: pgmap v459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 12 KiB/s, 2 objects/s recovering 2022-02-02T13:55:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:54:59 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:00.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- 172.21.15.33:0/2869404916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 msgr2=0x7fe4440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/2869404916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe4440f6cc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fe434004660 tx=0x7fe434009b30).stop 2022-02-02T13:55:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- 172.21.15.33:0/2869404916 shutdown_connections 2022-02-02T13:55:00.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/2869404916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe4440f6cc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/2869404916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 0x7fe4440f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- 172.21.15.33:0/2869404916 >> 172.21.15.33:0/2869404916 conn(0x7fe4440f0d40 msgr2=0x7fe4440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- 172.21.15.33:0/2869404916 shutdown_connections 2022-02-02T13:55:00.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- 172.21.15.33:0/2869404916 wait complete. 2022-02-02T13:55:00.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 Processor -- start 2022-02-02T13:55:00.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.474+0000 7fe44bf1d700 1 -- start start 2022-02-02T13:55:00.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe44bf1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 0x7fe444109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe44bf1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe44bf1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440603e0 con 0x7fe4440f6860 2022-02-02T13:55:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe44bf1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444060520 con 0x7fe4440f55c0 2022-02-02T13:55:00.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58686/0 (socket says 172.21.15.33:58686) 2022-02-02T13:55:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 -- 172.21.15.33:0/3711093172 learned_addr learned my addr 172.21.15.33:0/3711093172 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe449cb9700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 0x7fe444109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 -- 172.21.15.33:0/3711093172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 msgr2=0x7fe444109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 0x7fe444109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 -- 172.21.15.33:0/3711093172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434005040 con 0x7fe4440f6860 2022-02-02T13:55:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe4494b8700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe434000c00 tx=0x7fe43400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:00.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.475+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe434019070 con 0x7fe4440f6860 2022-02-02T13:55:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.476+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44410c610 con 0x7fe4440f6860 2022-02-02T13:55:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.476+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe434007e70 con 0x7fe4440f6860 2022-02-02T13:55:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.476+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe434014d90 con 0x7fe4440f6860 2022-02-02T13:55:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.476+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44410cb70 con 0x7fe4440f6860 2022-02-02T13:55:00.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.477+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe444045ad0 con 0x7fe4440f6860 2022-02-02T13:55:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.477+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe434025070 con 0x7fe4440f6860 2022-02-02T13:55:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.477+0000 7fe43a7fc700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.478+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe434082a60 con 0x7fe4440f6860 2022-02-02T13:55:00.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.478+0000 7fe449cb9700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.478+0000 7fe449cb9700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 0x7fe430067290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe444060060 tx=0x7fe44000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:00.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.482+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe434050b10 con 0x7fe4440f6860 2022-02-02T13:55:00.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.671+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4440fdf00 con 0x7fe430064dd0 2022-02-02T13:55:00.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.672+0000 7fe43a7fc700 1 -- 172.21.15.33:0/3711093172 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe4440fdf00 con 0x7fe430064dd0 2022-02-02T13:55:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 msgr2=0x7fe430067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 0x7fe430067290 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe444060060 tx=0x7fe44000b040).stop 2022-02-02T13:55:00.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 msgr2=0x7fe44410c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fe434000c00 tx=0x7fe43400b040).stop 2022-02-02T13:55:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 shutdown_connections 2022-02-02T13:55:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe430064dd0 0x7fe430067290 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4440f55c0 0x7fe444109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 --2- 172.21.15.33:0/3711093172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4440f6860 0x7fe44410c0c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 >> 172.21.15.33:0/3711093172 conn(0x7fe4440f0d40 msgr2=0x7fe4440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 shutdown_connections 2022-02-02T13:55:00.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.674+0000 7fe44bf1d700 1 -- 172.21.15.33:0/3711093172 wait complete. 2022-02-02T13:55:00.683 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:55:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 -- 172.21.15.33:0/2766606054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f6530 msgr2=0x7ff3940f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 --2- 172.21.15.33:0/2766606054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f6530 0x7ff3940f6950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7ff384004660 tx=0x7ff384009b30).stop 2022-02-02T13:55:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 -- 172.21.15.33:0/2766606054 shutdown_connections 2022-02-02T13:55:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 --2- 172.21.15.33:0/2766606054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f77d0 0x7ff3940f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 --2- 172.21.15.33:0/2766606054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f6530 0x7ff3940f6950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 -- 172.21.15.33:0/2766606054 >> 172.21.15.33:0/2766606054 conn(0x7ff3940f1c90 msgr2=0x7ff3940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 -- 172.21.15.33:0/2766606054 shutdown_connections 2022-02-02T13:55:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.776+0000 7ff398ede700 1 -- 172.21.15.33:0/2766606054 wait complete. 2022-02-02T13:55:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 Processor -- start 2022-02-02T13:55:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 -- start start 2022-02-02T13:55:00.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f6530 0x7ff39406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39406a380 con 0x7ff3940f77d0 2022-02-02T13:55:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff398ede700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39406a4c0 con 0x7ff3940f6530 2022-02-02T13:55:00.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff392ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58696/0 (socket says 172.21.15.33:58696) 2022-02-02T13:55:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.777+0000 7ff392ffd700 1 -- 172.21.15.33:0/1186664094 learned_addr learned my addr 172.21.15.33:0/1186664094 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff3937fe700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f6530 0x7ff39406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff392ffd700 1 -- 172.21.15.33:0/1186664094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f6530 msgr2=0x7ff39406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff392ffd700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f6530 0x7ff39406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff392ffd700 1 -- 172.21.15.33:0/1186664094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384005040 con 0x7ff3940f77d0 2022-02-02T13:55:00.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff392ffd700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff38800c790 tx=0x7ff388007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff388002590 con 0x7ff3940f77d0 2022-02-02T13:55:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff388002ba0 con 0x7ff3940f77d0 2022-02-02T13:55:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff39406a7a0 con 0x7ff3940f77d0 2022-02-02T13:55:00.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff388013d90 con 0x7ff3940f77d0 2022-02-02T13:55:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.778+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39410edc0 con 0x7ff3940f77d0 2022-02-02T13:55:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.779+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff394045ad0 con 0x7ff3940f77d0 2022-02-02T13:55:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.780+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff38801a060 con 0x7ff3940f77d0 2022-02-02T13:55:00.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.780+0000 7ff37bfff700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 0x7ff37c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.780+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff388081c50 con 0x7ff3940f77d0 2022-02-02T13:55:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.780+0000 7ff3937fe700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 0x7ff37c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.781+0000 7ff3937fe700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 0x7ff37c0672e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff384013690 tx=0x7ff384009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.784+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff38804fca0 con 0x7ff3940f77d0 2022-02-02T13:55:00.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.966+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3940fed60 con 0x7ff37c064e20 2022-02-02T13:55:00.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.981+0000 7ff37bfff700 1 -- 172.21.15.33:0/1186664094 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff3940fed60 con 0x7ff37c064e20 2022-02-02T13:55:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:55:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (20m) 2m ago 21m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:55:00.981 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (13m) 2m ago 21m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:55:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (13m) 2m ago 20m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:55:00.982 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (20m) 2m ago 21m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:55:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (13m) 2m ago 17m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:55:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (14m) 2m ago 17m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:55:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (15m) 2m ago 17m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:55:00.983 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (17m) 2m ago 17m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:55:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (14m) 2m ago 22m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:55:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (14m) 2m ago 20m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:55:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (14m) 2m ago 22m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:55:00.984 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (13m) 2m ago 20m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:55:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (21m) 2m ago 21m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:55:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (20m) 2m ago 20m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:55:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 2m ago 20m - 4096M 2022-02-02T13:55:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (19m) 2m ago 19m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:55:00.985 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (19m) 2m ago 19m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:55:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (19m) 2m ago 19m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:55:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (18m) 2m ago 18m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:55:00.986 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (18m) 2m ago 18m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:55:00.987 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (20m) 2m ago 20m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:55:00.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 msgr2=0x7ff37c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 0x7ff37c0672e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7ff384013690 tx=0x7ff384009b30).stop 2022-02-02T13:55:00.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 msgr2=0x7ff394069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7ff38800c790 tx=0x7ff388007d70).stop 2022-02-02T13:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 shutdown_connections 2022-02-02T13:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff37c064e20 0x7ff37c0672e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3940f6530 0x7ff39406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 --2- 172.21.15.33:0/1186664094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3940f77d0 0x7ff394069e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.982+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 >> 172.21.15.33:0/1186664094 conn(0x7ff3940f1c90 msgr2=0x7ff3940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.983+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 shutdown_connections 2022-02-02T13:55:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:00.983+0000 7ff398ede700 1 -- 172.21.15.33:0/1186664094 wait complete. 2022-02-02T13:55:01.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 -- 172.21.15.33:0/874188760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f6860 msgr2=0x7f4bbc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 --2- 172.21.15.33:0/874188760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc0f6cc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f4bac004660 tx=0x7f4bac009b30).stop 2022-02-02T13:55:01.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 -- 172.21.15.33:0/874188760 shutdown_connections 2022-02-02T13:55:01.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 --2- 172.21.15.33:0/874188760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc0f6cc0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 --2- 172.21.15.33:0/874188760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 -- 172.21.15.33:0/874188760 >> 172.21.15.33:0/874188760 conn(0x7f4bbc0f0d40 msgr2=0x7f4bbc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:01.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.082+0000 7f4bc359f700 1 -- 172.21.15.33:0/874188760 shutdown_connections 2022-02-02T13:55:01.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.083+0000 7f4bc359f700 1 -- 172.21.15.33:0/874188760 wait complete. 2022-02-02T13:55:01.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.083+0000 7f4bc359f700 1 Processor -- start 2022-02-02T13:55:01.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.083+0000 7f4bc359f700 1 -- start start 2022-02-02T13:55:01.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.083+0000 7f4bc359f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc359f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc359f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc106920 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc359f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc107130 con 0x7f4bbc0f6860 2022-02-02T13:55:01.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58702/0 (socket says 172.21.15.33:58702) 2022-02-02T13:55:01.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 -- 172.21.15.33:0/1795741698 learned_addr learned my addr 172.21.15.33:0/1795741698 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:01.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc0b3a700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 -- 172.21.15.33:0/1795741698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 msgr2=0x7f4bbc106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 -- 172.21.15.33:0/1795741698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac005040 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc0b3a700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:55:01.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bc133b700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f4bb800e7c0 tx=0x7f4bb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:01.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb80092e0 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4bb800f040 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.084+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb8014750 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.085+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc1073b0 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.085+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc107920 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.086+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc0f49b0 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.086+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4bb801b030 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.087+0000 7f4bb1ffb700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 0x7f4ba8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.087+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4bb8081bd0 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.087+0000 7f4bc0b3a700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 0x7f4ba8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.087+0000 7f4bc0b3a700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 0x7f4ba8067290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4bac004d80 tx=0x7f4bac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.091+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4bb804fc00 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.334+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4bbc0fde20 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.335+0000 7f4bb1ffb700 1 -- 172.21.15.33:0/1795741698 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4bb8019020 con 0x7f4bbc0f55c0 2022-02-02T13:55:01.336 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:55:01.337 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:55:01.337 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:55:01.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:01.338 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:55:01.339 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:55:01.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:55:01.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:55:01.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:01.341 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:55:01.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:55:01.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:01.343 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:55:01.343 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:55:01.343 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:55:01.344 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:55:01.344 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:55:01.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 msgr2=0x7f4ba8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 0x7f4ba8067290 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f4bac004d80 tx=0x7f4bac00b040).stop 2022-02-02T13:55:01.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 msgr2=0x7f4bbc105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f4bb800e7c0 tx=0x7f4bb800b040).stop 2022-02-02T13:55:01.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 shutdown_connections 2022-02-02T13:55:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba8064dd0 0x7f4ba8067290 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bbc0f55c0 0x7f4bbc105e30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 --2- 172.21.15.33:0/1795741698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bbc0f6860 0x7f4bbc106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 >> 172.21.15.33:0/1795741698 conn(0x7f4bbc0f0d40 msgr2=0x7f4bbc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 shutdown_connections 2022-02-02T13:55:01.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.337+0000 7f4bc359f700 1 -- 172.21.15.33:0/1795741698 wait complete. 2022-02-02T13:55:01.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 -- 172.21.15.33:0/4228052489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 msgr2=0x7f65540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 --2- 172.21.15.33:0/4228052489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f65540f6cc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f6540004660 tx=0x7f6540009b30).stop 2022-02-02T13:55:01.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 -- 172.21.15.33:0/4228052489 shutdown_connections 2022-02-02T13:55:01.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 --2- 172.21.15.33:0/4228052489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f65540f6cc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 --2- 172.21.15.33:0/4228052489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 0x7f65540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 -- 172.21.15.33:0/4228052489 >> 172.21.15.33:0/4228052489 conn(0x7f65540f0d40 msgr2=0x7f65540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 -- 172.21.15.33:0/4228052489 shutdown_connections 2022-02-02T13:55:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.438+0000 7f655aed7700 1 -- 172.21.15.33:0/4228052489 wait complete. 2022-02-02T13:55:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 Processor -- start 2022-02-02T13:55:01.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 -- start start 2022-02-02T13:55:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 0x7f6554109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6554060420 con 0x7f65540f6860 2022-02-02T13:55:01.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f655aed7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6554060560 con 0x7f65540f55c0 2022-02-02T13:55:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58714/0 (socket says 172.21.15.33:58714) 2022-02-02T13:55:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 -- 172.21.15.33:0/2798924743 learned_addr learned my addr 172.21.15.33:0/2798924743 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6558c73700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 0x7f6554109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 -- 172.21.15.33:0/2798924743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 msgr2=0x7f6554109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 0x7f6554109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.439+0000 7f6553fff700 1 -- 172.21.15.33:0/2798924743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540005040 con 0x7f65540f6860 2022-02-02T13:55:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f6553fff700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6540000c00 tx=0x7f654000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:01.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6540019070 con 0x7f65540f6860 2022-02-02T13:55:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655410c630 con 0x7f65540f6860 2022-02-02T13:55:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6540007e70 con 0x7f65540f6860 2022-02-02T13:55:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6540014ce0 con 0x7f65540f6860 2022-02-02T13:55:01.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.440+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655410cb60 con 0x7f65540f6860 2022-02-02T13:55:01.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.441+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6534004fa0 con 0x7f65540f6860 2022-02-02T13:55:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.441+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6540025070 con 0x7f65540f6860 2022-02-02T13:55:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.442+0000 7f65517fa700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.442+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6540082950 con 0x7f65540f6860 2022-02-02T13:55:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.442+0000 7f6558c73700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:01.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.442+0000 7f6558c73700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 0x7f6544067290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f65540600a0 tx=0x7f654800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:01.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.446+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6540050a00 con 0x7f65540f6860 2022-02-02T13:55:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.657+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6534005e80 con 0x7f65540f6860 2022-02-02T13:55:01.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.658+0000 7f65517fa700 1 -- 172.21.15.33:0/2798924743 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6540023020 con 0x7f65540f6860 2022-02-02T13:55:01.658 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:55:01.659 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:55:01.659 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:55:01.659 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:55:01.659 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:01.660 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:55:01.660 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:55:01.660 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:55:01.660 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:55:01.660 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:55:01.661 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:55:01.661 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:55:01.661 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:55:01.661 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:55:01.662 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:55:01.662 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:55:01.662 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:55:01.662 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:55:01.662 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:55:01.663 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:55:01.663 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:55:01.663 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:55:01.663 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:55:01.664 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:55:01.664 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:55:01.664 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:55:01.664 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:55:01.664 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:55:01.665 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:55:01.665 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:55:01.665 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:55:01.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:01.666 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:01.666 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:55:01.666 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:01.666 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:01.666 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:01.667 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:01.667 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 msgr2=0x7f6544067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 0x7f6544067290 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f65540600a0 tx=0x7f654800b040).stop 2022-02-02T13:55:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 msgr2=0x7f655410c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f6540000c00 tx=0x7f654000b040).stop 2022-02-02T13:55:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 shutdown_connections 2022-02-02T13:55:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6544064dd0 0x7f6544067290 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65540f55c0 0x7f6554109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 --2- 172.21.15.33:0/2798924743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65540f6860 0x7f655410c080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 >> 172.21.15.33:0/2798924743 conn(0x7f65540f0d40 msgr2=0x7f65540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 shutdown_connections 2022-02-02T13:55:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:01.660+0000 7f655aed7700 1 -- 172.21.15.33:0/2798924743 wait complete. 2022-02-02T13:55:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:55:01.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:01 smithi033 ceph-mon[101165]: pgmap v460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 10 KiB/s, 2 objects/s recovering 2022-02-02T13:55:01.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:01 smithi033 ceph-mon[101165]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:01 smithi033 ceph-mon[101165]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:01 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1795741698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:55:01.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:01 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2798924743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:55:02.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:01 smithi037 ceph-mon[69017]: pgmap v460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail; 10 KiB/s, 2 objects/s recovering 2022-02-02T13:55:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:01 smithi037 ceph-mon[69017]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:01 smithi037 ceph-mon[69017]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:02.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:01 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1795741698' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:55:02.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:01 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2798924743' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:55:04.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:03 smithi037 ceph-mon[69017]: pgmap v461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:03 smithi033 ceph-mon[101165]: pgmap v461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:06.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:05 smithi037 ceph-mon[69017]: pgmap v462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:06.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:05 smithi033 ceph-mon[101165]: pgmap v462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:08.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:07 smithi037 ceph-mon[69017]: pgmap v463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:07 smithi033 ceph-mon[101165]: pgmap v463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:10.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:09 smithi037 ceph-mon[69017]: pgmap v464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:09 smithi033 ceph-mon[101165]: pgmap v464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:12.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:11 smithi037 ceph-mon[69017]: pgmap v465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:11 smithi033 ceph-mon[101165]: pgmap v465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:14.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:13 smithi037 ceph-mon[69017]: pgmap v466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:13 smithi033 ceph-mon[101165]: pgmap v466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:14.987 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:55:14.988 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:55:14.988 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:14 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:55:14.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:55:14.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:55:14.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:14 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:55:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:15 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:55:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:15 smithi033 ceph-mon[101165]: pgmap v467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:15 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:55:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:15 smithi037 ceph-mon[69017]: pgmap v467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:16.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:55:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:16 smithi033 ceph-mon[101165]: pgmap v468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:16 smithi033 ceph-mon[101165]: pgmap v469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:16 smithi037 ceph-mon[69017]: pgmap v468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:16 smithi037 ceph-mon[69017]: pgmap v469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:18 smithi033 ceph-mon[101165]: pgmap v470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:19.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:18 smithi037 ceph-mon[69017]: pgmap v470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:20 smithi033 ceph-mon[101165]: pgmap v471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:20 smithi037 ceph-mon[69017]: pgmap v471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:22 smithi033 ceph-mon[101165]: pgmap v472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:23.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:22 smithi037 ceph-mon[69017]: pgmap v472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:24 smithi033 ceph-mon[101165]: pgmap v473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:24 smithi037 ceph-mon[69017]: pgmap v473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:26 smithi033 ceph-mon[101165]: pgmap v474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:26 smithi037 ceph-mon[69017]: pgmap v474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:28 smithi033 ceph-mon[101165]: pgmap v475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:29.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:28 smithi037 ceph-mon[69017]: pgmap v475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:30 smithi033 ceph-mon[101165]: pgmap v476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:30 smithi037 ceph-mon[69017]: pgmap v476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 -- 172.21.15.33:0/1669965995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f66e0 msgr2=0x7f6e100f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:31.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 --2- 172.21.15.33:0/1669965995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f66e0 0x7f6e100f6b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f6e000099e0 tx=0x7f6e00004d10).stop 2022-02-02T13:55:31.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 -- 172.21.15.33:0/1669965995 shutdown_connections 2022-02-02T13:55:31.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 --2- 172.21.15.33:0/1669965995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f7980 0x7f6e100f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T13:55:31.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 --2- 172.21.15.33:0/1669965995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f66e0 0x7f6e100f6b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:31.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 -- 172.21.15.33:0/1669965995 >> 172.21.15.33:0/1669965995 conn(0x7f6e100f1e40 msgr2=0x7f6e100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:31.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 -- 172.21.15.33:0/1669965995 shutdown_connections 2022-02-02T13:55:31.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.777+0000 7f6e14d35700 1 -- 172.21.15.33:0/1669965995 wait complete. 2022-02-02T13:55:31.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 Processor -- start 2022-02-02T13:55:31.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 -- start start 2022-02-02T13:55:31.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 0x7f6e1006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:31.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 0x7f6e10069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:31.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1006a410 con 0x7f6e100f7980 2022-02-02T13:55:31.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e14d35700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1006a550 con 0x7f6e100f66e0 2022-02-02T13:55:31.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e0e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 0x7f6e1006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:31.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e0dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 0x7f6e10069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:31.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e0e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 0x7f6e1006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:41206/0 (socket says 172.21.15.33:41206) 2022-02-02T13:55:31.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.778+0000 7f6e0e59c700 1 -- 172.21.15.33:0/2422897874 learned_addr learned my addr 172.21.15.33:0/2422897874 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:31.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e0dd9b700 1 -- 172.21.15.33:0/2422897874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 msgr2=0x7f6e1006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:31.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e0dd9b700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 0x7f6e1006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:31.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e0dd9b700 1 -- 172.21.15.33:0/2422897874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00009640 con 0x7f6e100f7980 2022-02-02T13:55:31.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e0dd9b700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 0x7f6e10069e20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6e04009360 tx=0x7f6e04006e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:31.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e04013640 con 0x7f6e100f7980 2022-02-02T13:55:31.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e04013c50 con 0x7f6e100f7980 2022-02-02T13:55:31.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1006a830 con 0x7f6e100f7980 2022-02-02T13:55:31.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e04012bc0 con 0x7f6e100f7980 2022-02-02T13:55:31.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.779+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1010f150 con 0x7f6e100f7980 2022-02-02T13:55:31.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.780+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10045ad0 con 0x7f6e100f7980 2022-02-02T13:55:31.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.781+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e0401a060 con 0x7f6e100f7980 2022-02-02T13:55:31.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.782+0000 7f6dfeffd700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 0x7f6df8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:31.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.782+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e04081f10 con 0x7f6e100f7980 2022-02-02T13:55:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.782+0000 7f6e0e59c700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 0x7f6df8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.782+0000 7f6e0e59c700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 0x7f6df8067290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6e00003380 tx=0x7f6e00004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.785+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e0404ff00 con 0x7f6e100f7980 2022-02-02T13:55:31.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.978+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e10057f10 con 0x7f6df8064dd0 2022-02-02T13:55:31.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.979+0000 7f6dfeffd700 1 -- 172.21.15.33:0/2422897874 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6e10057f10 con 0x7f6df8064dd0 2022-02-02T13:55:31.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 msgr2=0x7f6df8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:31.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 0x7f6df8067290 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f6e00003380 tx=0x7f6e00004d10).stop 2022-02-02T13:55:31.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 msgr2=0x7f6e10069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:31.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 0x7f6e10069e20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f6e04009360 tx=0x7f6e04006e30).stop 2022-02-02T13:55:31.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 shutdown_connections 2022-02-02T13:55:31.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6df8064dd0 0x7f6df8067290 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:31.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100f66e0 0x7f6e1006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:31.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 --2- 172.21.15.33:0/2422897874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e100f7980 0x7f6e10069e20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:31.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 >> 172.21.15.33:0/2422897874 conn(0x7f6e100f1e40 msgr2=0x7f6e100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:31.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 shutdown_connections 2022-02-02T13:55:31.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:31.981+0000 7f6e14d35700 1 -- 172.21.15.33:0/2422897874 wait complete. 2022-02-02T13:55:31.991 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:55:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 -- 172.21.15.33:0/3522952031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1140f9690 msgr2=0x7fa1140fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 --2- 172.21.15.33:0/3522952031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1140f9690 0x7fa1140fbae0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa100004660 tx=0x7fa100009b30).stop 2022-02-02T13:55:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 -- 172.21.15.33:0/3522952031 shutdown_connections 2022-02-02T13:55:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 --2- 172.21.15.33:0/3522952031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1140f9690 0x7fa1140fbae0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 --2- 172.21.15.33:0/3522952031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa114060310 0x7fa1140f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.082+0000 7fa119851700 1 -- 172.21.15.33:0/3522952031 >> 172.21.15.33:0/3522952031 conn(0x7fa1140f0b90 msgr2=0x7fa1140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.083+0000 7fa119851700 1 -- 172.21.15.33:0/3522952031 shutdown_connections 2022-02-02T13:55:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.083+0000 7fa119851700 1 -- 172.21.15.33:0/3522952031 wait complete. 2022-02-02T13:55:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.083+0000 7fa119851700 1 Processor -- start 2022-02-02T13:55:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.083+0000 7fa119851700 1 -- start start 2022-02-02T13:55:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa119851700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa119851700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1140f9690 0x7fa114107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa119851700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa114107890 con 0x7fa114060310 2022-02-02T13:55:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa119851700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1141080d0 con 0x7fa1140f9690 2022-02-02T13:55:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58732/0 (socket says 172.21.15.33:58732) 2022-02-02T13:55:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 -- 172.21.15.33:0/2565353300 learned_addr learned my addr 172.21.15.33:0/2565353300 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa113fff700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1140f9690 0x7fa114107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 -- 172.21.15.33:0/2565353300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1140f9690 msgr2=0x7fa114107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1140f9690 0x7fa114107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.084+0000 7fa11884f700 1 -- 172.21.15.33:0/2565353300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100005040 con 0x7fa114060310 2022-02-02T13:55:32.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa11884f700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa1080026d0 tx=0x7fa108009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1080079c0 con 0x7fa114060310 2022-02-02T13:55:32.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa10800f040 con 0x7fa114060310 2022-02-02T13:55:32.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1080148b0 con 0x7fa114060310 2022-02-02T13:55:32.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1141083b0 con 0x7fa114060310 2022-02-02T13:55:32.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.085+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1141088a0 con 0x7fa114060310 2022-02-02T13:55:32.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.086+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa114059100 con 0x7fa114060310 2022-02-02T13:55:32.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.087+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa108007b20 con 0x7fa114060310 2022-02-02T13:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.087+0000 7fa1117fa700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 0x7fa1040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.087+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa1080819e0 con 0x7fa114060310 2022-02-02T13:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.087+0000 7fa113fff700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 0x7fa1040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.087+0000 7fa113fff700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 0x7fa1040672e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa114106b30 tx=0x7fa100009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.091+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa10804fa90 con 0x7fa114060310 2022-02-02T13:55:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.273+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1140fee00 con 0x7fa104064e20 2022-02-02T13:55:32.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.287+0000 7fa1117fa700 1 -- 172.21.15.33:0/2565353300 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa1140fee00 con 0x7fa104064e20 2022-02-02T13:55:32.287 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:55:32.288 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (20m) 3m ago 21m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:55:32.288 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (13m) 3m ago 21m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:55:32.288 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (13m) 3m ago 21m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:55:32.289 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (20m) 3m ago 21m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:55:32.289 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (14m) 3m ago 18m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:55:32.289 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (14m) 3m ago 17m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:55:32.289 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (15m) 3m ago 18m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:55:32.290 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (17m) 3m ago 17m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:55:32.290 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (15m) 3m ago 23m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:55:32.290 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (14m) 3m ago 21m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:55:32.291 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (14m) 3m ago 23m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:55:32.291 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (14m) 3m ago 21m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:55:32.291 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (21m) 3m ago 21m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:55:32.291 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (21m) 3m ago 21m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:55:32.292 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 20m - 4096M 2022-02-02T13:55:32.292 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (20m) 3m ago 20m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:55:32.292 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (19m) 3m ago 19m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:55:32.292 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (19m) 3m ago 19m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:55:32.293 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (19m) 3m ago 19m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:55:32.293 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (19m) 3m ago 19m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:55:32.293 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (20m) 3m ago 21m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:55:32.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 msgr2=0x7fa1040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 0x7fa1040672e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7fa114106b30 tx=0x7fa100009b30).stop 2022-02-02T13:55:32.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 msgr2=0x7fa114106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa1080026d0 tx=0x7fa108009de0).stop 2022-02-02T13:55:32.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 shutdown_connections 2022-02-02T13:55:32.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa104064e20 0x7fa1040672e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa114060310 0x7fa114106da0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 --2- 172.21.15.33:0/2565353300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1140f9690 0x7fa114107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 >> 172.21.15.33:0/2565353300 conn(0x7fa1140f0b90 msgr2=0x7fa1140f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 shutdown_connections 2022-02-02T13:55:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.289+0000 7fa119851700 1 -- 172.21.15.33:0/2565353300 wait complete. 2022-02-02T13:55:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 -- 172.21.15.33:0/4269295378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f66d0 msgr2=0x7fe63c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 --2- 172.21.15.33:0/4269295378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f66d0 0x7fe63c0f6b30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fe630004660 tx=0x7fe630009b30).stop 2022-02-02T13:55:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 -- 172.21.15.33:0/4269295378 shutdown_connections 2022-02-02T13:55:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 --2- 172.21.15.33:0/4269295378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f66d0 0x7fe63c0f6b30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 --2- 172.21.15.33:0/4269295378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f5430 0x7fe63c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 -- 172.21.15.33:0/4269295378 >> 172.21.15.33:0/4269295378 conn(0x7fe63c0f0b90 msgr2=0x7fe63c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 -- 172.21.15.33:0/4269295378 shutdown_connections 2022-02-02T13:55:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.389+0000 7fe64117f700 1 -- 172.21.15.33:0/4269295378 wait complete. 2022-02-02T13:55:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 Processor -- start 2022-02-02T13:55:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 -- start start 2022-02-02T13:55:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f66d0 0x7fe63c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c106760 con 0x7fe63c0f5430 2022-02-02T13:55:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.390+0000 7fe64117f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c106f60 con 0x7fe63c0f66d0 2022-02-02T13:55:32.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58742/0 (socket says 172.21.15.33:58742) 2022-02-02T13:55:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 -- 172.21.15.33:0/1228773628 learned_addr learned my addr 172.21.15.33:0/1228773628 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63b7fe700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f66d0 0x7fe63c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 -- 172.21.15.33:0/1228773628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f66d0 msgr2=0x7fe63c1061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f66d0 0x7fe63c1061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 -- 172.21.15.33:0/1228773628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630005040 con 0x7fe63c0f5430 2022-02-02T13:55:32.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe63bfff700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe62c002700 tx=0x7fe62c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62c009320 con 0x7fe63c0f5430 2022-02-02T13:55:32.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c107240 con 0x7fe63c0f5430 2022-02-02T13:55:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe62c00f040 con 0x7fe63c0f5430 2022-02-02T13:55:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62c014900 con 0x7fe63c0f5430 2022-02-02T13:55:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.391+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c107800 con 0x7fe63c0f5430 2022-02-02T13:55:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.392+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c059100 con 0x7fe63c0f5430 2022-02-02T13:55:32.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.393+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe62c009480 con 0x7fe63c0f5430 2022-02-02T13:55:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.393+0000 7fe638ff9700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 0x7fe6240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.393+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe62c081d10 con 0x7fe63c0f5430 2022-02-02T13:55:32.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.393+0000 7fe63b7fe700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 0x7fe6240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.394+0000 7fe63b7fe700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 0x7fe6240672e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fe630004e30 tx=0x7fe630009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.398+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe62c0538b0 con 0x7fe63c0f5430 2022-02-02T13:55:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.642+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe63c0008d0 con 0x7fe63c0f5430 2022-02-02T13:55:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.643+0000 7fe638ff9700 1 -- 172.21.15.33:0/1228773628 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe62c0534a0 con 0x7fe63c0f5430 2022-02-02T13:55:32.643 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:55:32.643 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:55:32.644 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:55:32.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:32.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:55:32.644 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:55:32.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:32.645 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:55:32.645 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:55:32.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:32.645 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:55:32.646 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:55:32.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:55:32.646 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:55:32.646 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:55:32.646 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:55:32.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:55:32.647 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:55:32.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 msgr2=0x7fe6240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 0x7fe6240672e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fe630004e30 tx=0x7fe630009b30).stop 2022-02-02T13:55:32.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 msgr2=0x7fe63c105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe62c002700 tx=0x7fe62c009d80).stop 2022-02-02T13:55:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 shutdown_connections 2022-02-02T13:55:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe624064e20 0x7fe6240672e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe63c0f5430 0x7fe63c105cc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 --2- 172.21.15.33:0/1228773628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0f66d0 0x7fe63c1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 >> 172.21.15.33:0/1228773628 conn(0x7fe63c0f0b90 msgr2=0x7fe63c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 shutdown_connections 2022-02-02T13:55:32.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.645+0000 7fe64117f700 1 -- 172.21.15.33:0/1228773628 wait complete. 2022-02-02T13:55:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 -- 172.21.15.33:0/1956747766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f5430 msgr2=0x7f14240f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1956747766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f5430 0x7f14240f5850 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1420004660 tx=0x7f1420009b30).stop 2022-02-02T13:55:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 -- 172.21.15.33:0/1956747766 shutdown_connections 2022-02-02T13:55:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1956747766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f66d0 0x7f14240f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1956747766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f5430 0x7f14240f5850 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 -- 172.21.15.33:0/1956747766 >> 172.21.15.33:0/1956747766 conn(0x7f14240f0b90 msgr2=0x7f14240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.745+0000 7f142aeb8700 1 -- 172.21.15.33:0/1956747766 shutdown_connections 2022-02-02T13:55:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 -- 172.21.15.33:0/1956747766 wait complete. 2022-02-02T13:55:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 Processor -- start 2022-02-02T13:55:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 -- start start 2022-02-02T13:55:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f5430 0x7f1424108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1424109a40 con 0x7f14240f66d0 2022-02-02T13:55:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f142aeb8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1424109b80 con 0x7f14240f5430 2022-02-02T13:55:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f14296b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f14296b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58754/0 (socket says 172.21.15.33:58754) 2022-02-02T13:55:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f14296b5700 1 -- 172.21.15.33:0/1967149824 learned_addr learned my addr 172.21.15.33:0/1967149824 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:55:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.746+0000 7f1429eb6700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f5430 0x7f1424108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f14296b5700 1 -- 172.21.15.33:0/1967149824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f5430 msgr2=0x7f1424108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f14296b5700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f5430 0x7f1424108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f14296b5700 1 -- 172.21.15.33:0/1967149824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420005040 con 0x7f14240f66d0 2022-02-02T13:55:32.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f14296b5700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f14140026d0 tx=0x7f1414009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14140079c0 con 0x7f14240f66d0 2022-02-02T13:55:32.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f142410a520 con 0x7f14240f66d0 2022-02-02T13:55:32.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f141400f040 con 0x7f14240f66d0 2022-02-02T13:55:32.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14140148b0 con 0x7f14240f66d0 2022-02-02T13:55:32.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.747+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142410aae0 con 0x7f14240f66d0 2022-02-02T13:55:32.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.748+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1424045ad0 con 0x7f14240f66d0 2022-02-02T13:55:32.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.749+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1414007b20 con 0x7f14240f66d0 2022-02-02T13:55:32.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.749+0000 7f141a7fc700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 0x7f14100672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:55:32.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.749+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1414081a30 con 0x7f14240f66d0 2022-02-02T13:55:32.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.749+0000 7f1429eb6700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 0x7f14100672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:55:32.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.749+0000 7f1429eb6700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 0x7f14100672e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1420004630 tx=0x7f1420009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:55:32.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.753+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1414053510 con 0x7f14240f66d0 2022-02-02T13:55:32.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.969+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f142410b180 con 0x7f14240f66d0 2022-02-02T13:55:32.969 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:32 smithi033 ceph-mon[101165]: pgmap v477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:32.970 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:32 smithi033 ceph-mon[101165]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:32.970 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:32 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1228773628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:55:32.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.969+0000 7f141a7fc700 1 -- 172.21.15.33:0/1967149824 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1414053100 con 0x7f14240f66d0 2022-02-02T13:55:32.971 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:55:32.971 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:55:32.971 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:55:32.972 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:55:32.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:32.972 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:55:32.972 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:55:32.972 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:55:32.973 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:55:32.973 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:55:32.973 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:55:32.973 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:55:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:55:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:55:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:55:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:55:32.974 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:55:32.975 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:55:32.975 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:55:32.975 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:55:32.975 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:55:32.975 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:55:32.976 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:55:32.976 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:55:32.976 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:55:32.976 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:55:32.977 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:55:32.977 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:55:32.977 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:55:32.977 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:55:32.977 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:55:32.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:32.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:32.978 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:55:32.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:55:32.978 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:32.979 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:32.979 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:32.979 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:55:32.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 msgr2=0x7f14100672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 0x7f14100672e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f1420004630 tx=0x7f1420009b30).stop 2022-02-02T13:55:32.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 msgr2=0x7f1424109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:55:32.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f14140026d0 tx=0x7f1414009de0).stop 2022-02-02T13:55:32.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 shutdown_connections 2022-02-02T13:55:32.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1410064e20 0x7f14100672e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14240f5430 0x7f1424108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 --2- 172.21.15.33:0/1967149824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14240f66d0 0x7f1424109490 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:55:32.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 >> 172.21.15.33:0/1967149824 conn(0x7f14240f0b90 msgr2=0x7f142405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:55:32.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 shutdown_connections 2022-02-02T13:55:32.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:55:32.971+0000 7f142aeb8700 1 -- 172.21.15.33:0/1967149824 wait complete. 2022-02-02T13:55:32.983 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:55:33.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:32 smithi037 ceph-mon[69017]: pgmap v477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:32 smithi037 ceph-mon[69017]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:32 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1228773628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:55:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:33 smithi033 ceph-mon[101165]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:34.296 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1967149824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:55:34.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:33 smithi037 ceph-mon[69017]: from='client.34602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:55:34.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1967149824' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:55:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:34 smithi033 ceph-mon[101165]: pgmap v478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:34 smithi037 ceph-mon[69017]: pgmap v478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:36 smithi033 ceph-mon[101165]: pgmap v479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:36 smithi037 ceph-mon[69017]: pgmap v479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:38 smithi033 ceph-mon[101165]: pgmap v480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:39.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:38 smithi037 ceph-mon[69017]: pgmap v480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:40 smithi033 ceph-mon[101165]: pgmap v481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:40 smithi037 ceph-mon[69017]: pgmap v481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:42 smithi033 ceph-mon[101165]: pgmap v482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:42 smithi037 ceph-mon[69017]: pgmap v482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:44 smithi033 ceph-mon[101165]: pgmap v483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:45.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:44 smithi037 ceph-mon[69017]: pgmap v483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:46 smithi033 ceph-mon[101165]: pgmap v484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:46 smithi037 ceph-mon[69017]: pgmap v484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:48 smithi033 ceph-mon[101165]: pgmap v485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:48 smithi037 ceph-mon[69017]: pgmap v485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:50 smithi033 ceph-mon[101165]: pgmap v486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:50 smithi037 ceph-mon[69017]: pgmap v486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:52 smithi033 ceph-mon[101165]: pgmap v487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:52 smithi037 ceph-mon[69017]: pgmap v487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:54 smithi033 ceph-mon[101165]: pgmap v488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:55:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:55:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:54 smithi037 ceph-mon[69017]: pgmap v488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:55:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:55:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:56 smithi033 ceph-mon[101165]: pgmap v489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:57.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:56 smithi037 ceph-mon[69017]: pgmap v489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:55:58 smithi033 ceph-mon[101165]: pgmap v490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:55:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:55:58 smithi037 ceph-mon[69017]: pgmap v490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:00 smithi033 ceph-mon[101165]: pgmap v491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:00 smithi037 ceph-mon[69017]: pgmap v491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:03.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 -- 172.21.15.33:0/3722196611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f6860 msgr2=0x7fb13c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 --2- 172.21.15.33:0/3722196611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f6860 0x7fb13c0f6cc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fb130004660 tx=0x7fb130009b30).stop 2022-02-02T13:56:03.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 -- 172.21.15.33:0/3722196611 shutdown_connections 2022-02-02T13:56:03.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 --2- 172.21.15.33:0/3722196611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f6860 0x7fb13c0f6cc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 --2- 172.21.15.33:0/3722196611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f55c0 0x7fb13c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 -- 172.21.15.33:0/3722196611 >> 172.21.15.33:0/3722196611 conn(0x7fb13c0f0d40 msgr2=0x7fb13c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 -- 172.21.15.33:0/3722196611 shutdown_connections 2022-02-02T13:56:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.086+0000 7fb141f1b700 1 -- 172.21.15.33:0/3722196611 wait complete. 2022-02-02T13:56:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 Processor -- start 2022-02-02T13:56:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 -- start start 2022-02-02T13:56:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f6860 0x7fb13c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0603c0 con 0x7fb13c0f55c0 2022-02-02T13:56:03.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb141f1b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c060500 con 0x7fb13c0f6860 2022-02-02T13:56:03.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb13b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.087+0000 7fb13b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58774/0 (socket says 172.21.15.33:58774) 2022-02-02T13:56:03.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13b7fe700 1 -- 172.21.15.33:0/2760097997 learned_addr learned my addr 172.21.15.33:0/2760097997 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:03.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13affd700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f6860 0x7fb13c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13b7fe700 1 -- 172.21.15.33:0/2760097997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f6860 msgr2=0x7fb13c10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13b7fe700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f6860 0x7fb13c10c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13b7fe700 1 -- 172.21.15.33:0/2760097997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb130005040 con 0x7fb13c0f55c0 2022-02-02T13:56:03.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb13b7fe700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb12c002700 tx=0x7fb12c009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb12c0079c0 con 0x7fb13c0f55c0 2022-02-02T13:56:03.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c10c690 con 0x7fb13c0f55c0 2022-02-02T13:56:03.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb12c00f040 con 0x7fb13c0f55c0 2022-02-02T13:56:03.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb12c014850 con 0x7fb13c0f55c0 2022-02-02T13:56:03.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.088+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c10cc20 con 0x7fb13c0f55c0 2022-02-02T13:56:03.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.089+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c004fa0 con 0x7fb13c0f55c0 2022-02-02T13:56:03.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.090+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb12c01b060 con 0x7fb13c0f55c0 2022-02-02T13:56:03.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.090+0000 7fb123fff700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 0x7fb124067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.090+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb12c081a00 con 0x7fb13c0f55c0 2022-02-02T13:56:03.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.090+0000 7fb13affd700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 0x7fb124067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.091+0000 7fb13affd700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 0x7fb124067290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fb130004630 tx=0x7fb130009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.095+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb12c04f9f0 con 0x7fb13c0f55c0 2022-02-02T13:56:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:02 smithi033 ceph-mon[101165]: pgmap v492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:03.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.286+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb11c000bc0 con 0x7fb124064dd0 2022-02-02T13:56:03.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.287+0000 7fb123fff700 1 -- 172.21.15.33:0/2760097997 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb11c000bc0 con 0x7fb124064dd0 2022-02-02T13:56:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 msgr2=0x7fb124067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 0x7fb124067290 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fb130004630 tx=0x7fb130009b30).stop 2022-02-02T13:56:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 msgr2=0x7fb13c109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fb12c002700 tx=0x7fb12c009e00).stop 2022-02-02T13:56:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 shutdown_connections 2022-02-02T13:56:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb124064dd0 0x7fb124067290 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb13c0f55c0 0x7fb13c109be0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 --2- 172.21.15.33:0/2760097997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb13c0f6860 0x7fb13c10c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.289+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 >> 172.21.15.33:0/2760097997 conn(0x7fb13c0f0d40 msgr2=0x7fb13c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.290+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 shutdown_connections 2022-02-02T13:56:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.290+0000 7fb141f1b700 1 -- 172.21.15.33:0/2760097997 wait complete. 2022-02-02T13:56:03.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:02 smithi037 ceph-mon[69017]: pgmap v492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:03.299 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:56:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- 172.21.15.33:0/447214072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 msgr2=0x7fafe80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 --2- 172.21.15.33:0/447214072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe80f6b30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fafdc004660 tx=0x7fafdc009b30).stop 2022-02-02T13:56:03.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- 172.21.15.33:0/447214072 shutdown_connections 2022-02-02T13:56:03.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 --2- 172.21.15.33:0/447214072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe80f6b30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 --2- 172.21.15.33:0/447214072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- 172.21.15.33:0/447214072 >> 172.21.15.33:0/447214072 conn(0x7fafe80f0b90 msgr2=0x7fafe80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- 172.21.15.33:0/447214072 shutdown_connections 2022-02-02T13:56:03.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- 172.21.15.33:0/447214072 wait complete. 2022-02-02T13:56:03.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 Processor -- start 2022-02-02T13:56:03.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.391+0000 7fafe759e700 1 -- start start 2022-02-02T13:56:03.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe8109a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80603c0 con 0x7fafe80f66d0 2022-02-02T13:56:03.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8060500 con 0x7fafe80f5430 2022-02-02T13:56:03.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58786/0 (socket says 172.21.15.33:58786) 2022-02-02T13:56:03.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 -- 172.21.15.33:0/16000371 learned_addr learned my addr 172.21.15.33:0/16000371 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:03.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe659c700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe8109a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 -- 172.21.15.33:0/16000371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 msgr2=0x7fafe8109a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe8109a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 -- 172.21.15.33:0/16000371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafdc005040 con 0x7fafe80f66d0 2022-02-02T13:56:03.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe659c700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe8109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:56:03.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafe5d9b700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fafdc009990 tx=0x7fafdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafdc018070 con 0x7fafe80f66d0 2022-02-02T13:56:03.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.392+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafdc007ba0 con 0x7fafe80f66d0 2022-02-02T13:56:03.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.393+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe810c4c0 con 0x7fafe80f66d0 2022-02-02T13:56:03.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.393+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafdc01c3c0 con 0x7fafe80f66d0 2022-02-02T13:56:03.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.393+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe810c9f0 con 0x7fafe80f66d0 2022-02-02T13:56:03.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.394+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe8045ad0 con 0x7fafe80f66d0 2022-02-02T13:56:03.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.394+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fafdc01d420 con 0x7fafe80f66d0 2022-02-02T13:56:03.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.394+0000 7fafd6ffd700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 0x7fafd00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.395+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fafdc083780 con 0x7fafe80f66d0 2022-02-02T13:56:03.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.395+0000 7fafe659c700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 0x7fafd00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.395+0000 7fafe659c700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 0x7fafd00672e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fafd8009fd0 tx=0x7fafd800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.399+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fafdc0517d0 con 0x7fafe80f66d0 2022-02-02T13:56:03.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.583+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fafe8057f10 con 0x7fafd0064e20 2022-02-02T13:56:03.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.598+0000 7fafd6ffd700 1 -- 172.21.15.33:0/16000371 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fafe8057f10 con 0x7fafd0064e20 2022-02-02T13:56:03.598 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:56:03.599 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (21m) 3m ago 22m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:56:03.599 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (14m) 3m ago 22m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:56:03.600 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (14m) 3m ago 21m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:56:03.600 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (21m) 3m ago 22m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:56:03.600 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (14m) 3m ago 18m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:56:03.601 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (15m) 3m ago 18m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:56:03.602 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (16m) 3m ago 18m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:56:03.603 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (18m) 3m ago 18m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:56:03.603 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (15m) 3m ago 23m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:56:03.604 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (15m) 3m ago 21m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:56:03.604 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (15m) 3m ago 23m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:56:03.605 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (14m) 3m ago 21m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:56:03.605 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (22m) 3m ago 22m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:56:03.606 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (21m) 3m ago 21m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:56:03.606 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 21m - 4096M 2022-02-02T13:56:03.607 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (20m) 3m ago 20m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:56:03.607 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (20m) 3m ago 20m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:56:03.607 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (20m) 3m ago 20m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:56:03.608 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (19m) 3m ago 19m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:56:03.609 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (19m) 3m ago 19m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:56:03.609 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (21m) 3m ago 21m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 msgr2=0x7fafd00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 0x7fafd00672e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fafd8009fd0 tx=0x7fafd800b040).stop 2022-02-02T13:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 msgr2=0x7fafe810bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fafdc009990 tx=0x7fafdc009b30).stop 2022-02-02T13:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 shutdown_connections 2022-02-02T13:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafd0064e20 0x7fafd00672e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe80f5430 0x7fafe8109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 --2- 172.21.15.33:0/16000371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafe80f66d0 0x7fafe810bf70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 >> 172.21.15.33:0/16000371 conn(0x7fafe80f0b90 msgr2=0x7fafe80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 shutdown_connections 2022-02-02T13:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.600+0000 7fafe759e700 1 -- 172.21.15.33:0/16000371 wait complete. 2022-02-02T13:56:03.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 -- 172.21.15.33:0/82798755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f6860 msgr2=0x7fb4600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 --2- 172.21.15.33:0/82798755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f6860 0x7fb4600f6cc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fb454004660 tx=0x7fb454009b30).stop 2022-02-02T13:56:03.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 -- 172.21.15.33:0/82798755 shutdown_connections 2022-02-02T13:56:03.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 --2- 172.21.15.33:0/82798755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f6860 0x7fb4600f6cc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 --2- 172.21.15.33:0/82798755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f55c0 0x7fb4600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 -- 172.21.15.33:0/82798755 >> 172.21.15.33:0/82798755 conn(0x7fb4600f0d40 msgr2=0x7fb4600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 -- 172.21.15.33:0/82798755 shutdown_connections 2022-02-02T13:56:03.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.700+0000 7fb4684cc700 1 -- 172.21.15.33:0/82798755 wait complete. 2022-02-02T13:56:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 Processor -- start 2022-02-02T13:56:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 -- start start 2022-02-02T13:56:03.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f6860 0x7fb46010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4600603c0 con 0x7fb4600f55c0 2022-02-02T13:56:03.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb4684cc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460060500 con 0x7fb4600f6860 2022-02-02T13:56:03.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58794/0 (socket says 172.21.15.33:58794) 2022-02-02T13:56:03.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 -- 172.21.15.33:0/271127190 learned_addr learned my addr 172.21.15.33:0/271127190 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:03.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb465a67700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f6860 0x7fb46010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 -- 172.21.15.33:0/271127190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f6860 msgr2=0x7fb46010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f6860 0x7fb46010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.701+0000 7fb466268700 1 -- 172.21.15.33:0/271127190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454005040 con 0x7fb4600f55c0 2022-02-02T13:56:03.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb466268700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb45c002700 tx=0x7fb45c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c0079c0 con 0x7fb4600f55c0 2022-02-02T13:56:03.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb45c00f040 con 0x7fb4600f55c0 2022-02-02T13:56:03.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46010c720 con 0x7fb4600f55c0 2022-02-02T13:56:03.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb45c014860 con 0x7fb4600f55c0 2022-02-02T13:56:03.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.702+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46010ccb0 con 0x7fb4600f55c0 2022-02-02T13:56:03.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.703+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb460045ad0 con 0x7fb4600f55c0 2022-02-02T13:56:03.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.703+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb45c01b060 con 0x7fb4600f55c0 2022-02-02T13:56:03.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.704+0000 7fb452ffd700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 0x7fb44c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:03.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.704+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb45c081860 con 0x7fb4600f55c0 2022-02-02T13:56:03.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.704+0000 7fb465a67700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 0x7fb44c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:03.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.704+0000 7fb465a67700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 0x7fb44c067290 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb454004630 tx=0x7fb454009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.708+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb45c04f910 con 0x7fb4600f55c0 2022-02-02T13:56:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.953+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4600fde80 con 0x7fb4600f55c0 2022-02-02T13:56:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.954+0000 7fb452ffd700 1 -- 172.21.15.33:0/271127190 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb45c0192d0 con 0x7fb4600f55c0 2022-02-02T13:56:03.956 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:56:03.956 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:56:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:56:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:56:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:56:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:56:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:56:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:56:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:56:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:56:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:56:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:56:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:56:03.960 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:56:03.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 msgr2=0x7fb44c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 0x7fb44c067290 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb454004630 tx=0x7fb454009b30).stop 2022-02-02T13:56:03.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 msgr2=0x7fb460109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:03.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fb45c002700 tx=0x7fb45c009d80).stop 2022-02-02T13:56:03.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 shutdown_connections 2022-02-02T13:56:03.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb44c064dd0 0x7fb44c067290 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4600f55c0 0x7fb460109c70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 --2- 172.21.15.33:0/271127190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4600f6860 0x7fb46010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:03.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 >> 172.21.15.33:0/271127190 conn(0x7fb4600f0d40 msgr2=0x7fb4600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:03.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 shutdown_connections 2022-02-02T13:56:03.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:03.956+0000 7fb4684cc700 1 -- 172.21.15.33:0/271127190 wait complete. 2022-02-02T13:56:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 -- 172.21.15.33:0/3525395843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f6860 msgr2=0x7f30980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 --2- 172.21.15.33:0/3525395843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f6860 0x7f30980f6cc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f3088004660 tx=0x7f3088009b30).stop 2022-02-02T13:56:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 -- 172.21.15.33:0/3525395843 shutdown_connections 2022-02-02T13:56:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 --2- 172.21.15.33:0/3525395843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f6860 0x7f30980f6cc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 --2- 172.21.15.33:0/3525395843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f55c0 0x7f30980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 -- 172.21.15.33:0/3525395843 >> 172.21.15.33:0/3525395843 conn(0x7f30980f0d40 msgr2=0x7f30980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 -- 172.21.15.33:0/3525395843 shutdown_connections 2022-02-02T13:56:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.057+0000 7f309d418700 1 -- 172.21.15.33:0/3525395843 wait complete. 2022-02-02T13:56:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 Processor -- start 2022-02-02T13:56:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 -- start start 2022-02-02T13:56:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 0x7f30980f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980f8920 con 0x7f30980f55c0 2022-02-02T13:56:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f309d418700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980f8a60 con 0x7f30980f6860 2022-02-02T13:56:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58804/0 (socket says 172.21.15.33:58804) 2022-02-02T13:56:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 -- 172.21.15.33:0/604331635 learned_addr learned my addr 172.21.15.33:0/604331635 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:04.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f30967fc700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 0x7f30980f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 -- 172.21.15.33:0/604331635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 msgr2=0x7f30980f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 0x7f30980f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 -- 172.21.15.33:0/604331635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3088005040 con 0x7f30980f55c0 2022-02-02T13:56:04.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f30967fc700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 0x7f30980f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:56:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.058+0000 7f3096ffd700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f308c002700 tx=0x7f308c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.059+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c009320 con 0x7f30980f55c0 2022-02-02T13:56:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.059+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f308c00f040 con 0x7f30980f55c0 2022-02-02T13:56:04.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.059+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980f8d40 con 0x7f30980f55c0 2022-02-02T13:56:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.059+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f308c014900 con 0x7f30980f55c0 2022-02-02T13:56:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.059+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309810efa0 con 0x7f30980f55c0 2022-02-02T13:56:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.060+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3098045ad0 con 0x7f30980f55c0 2022-02-02T13:56:04.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.060+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f308c009480 con 0x7f30980f55c0 2022-02-02T13:56:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.061+0000 7f307f7fe700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 0x7f3080067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.061+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f308c081c30 con 0x7f30980f55c0 2022-02-02T13:56:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.061+0000 7f30967fc700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 0x7f3080067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:04.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.061+0000 7f30967fc700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 0x7f3080067290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3088004630 tx=0x7f3088009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:04.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.065+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f308c04fce0 con 0x7f30980f55c0 2022-02-02T13:56:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.277+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f309810f790 con 0x7f30980f55c0 2022-02-02T13:56:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.278+0000 7f307f7fe700 1 -- 172.21.15.33:0/604331635 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f308c053300 con 0x7f30980f55c0 2022-02-02T13:56:04.278 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:56:04.279 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:56:04.279 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:56:04.279 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:56:04.279 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:56:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:56:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:56:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:56:04.280 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:56:04.281 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:56:04.281 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:56:04.281 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:56:04.281 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:56:04.282 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:56:04.282 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:56:04.282 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:56:04.282 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:56:04.283 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:56:04.283 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:56:04.283 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:56:04.283 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:56:04.283 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:56:04.284 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:56:04.284 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:56:04.284 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:56:04.285 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:56:04.285 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:56:04.285 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:56:04.285 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:56:04.285 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:56:04.286 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:04.286 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:04.286 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:56:04.286 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:04.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:04.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:04.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:04.287 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:04.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 msgr2=0x7f3080067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:04.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 0x7f3080067290 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3088004630 tx=0x7f3088009b30).stop 2022-02-02T13:56:04.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 msgr2=0x7f30980f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:04.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f308c002700 tx=0x7f308c009d80).stop 2022-02-02T13:56:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 shutdown_connections 2022-02-02T13:56:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3080064dd0 0x7f3080067290 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30980f55c0 0x7f30980f9f40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 --2- 172.21.15.33:0/604331635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30980f6860 0x7f30980f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 >> 172.21.15.33:0/604331635 conn(0x7f30980f0d40 msgr2=0x7f309805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 shutdown_connections 2022-02-02T13:56:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:04.280+0000 7f309d418700 1 -- 172.21.15.33:0/604331635 wait complete. 2022-02-02T13:56:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:56:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:04 smithi033 ceph-mon[101165]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:04 smithi033 ceph-mon[101165]: pgmap v493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:04 smithi033 ceph-mon[101165]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/271127190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:56:05.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/604331635' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:56:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:04 smithi037 ceph-mon[69017]: from='client.34614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:04 smithi037 ceph-mon[69017]: pgmap v493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:04 smithi037 ceph-mon[69017]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/271127190' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:56:05.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/604331635' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:56:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:06 smithi033 ceph-mon[101165]: pgmap v494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:06 smithi037 ceph-mon[69017]: pgmap v494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:08 smithi033 ceph-mon[101165]: pgmap v495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:08 smithi037 ceph-mon[69017]: pgmap v495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:10 smithi033 ceph-mon[101165]: pgmap v496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:10 smithi037 ceph-mon[69017]: pgmap v496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:12 smithi033 ceph-mon[101165]: pgmap v497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:12 smithi037 ceph-mon[69017]: pgmap v497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:14 smithi033 ceph-mon[101165]: pgmap v498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:15.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:14 smithi037 ceph-mon[69017]: pgmap v498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:56:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:56:16.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:15 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:56:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:56:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:56:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:15 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:56:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:16 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:56:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:16 smithi033 ceph-mon[101165]: pgmap v499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:16 smithi033 ceph-mon[101165]: pgmap v500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:16 smithi033 ceph-mon[101165]: pgmap v501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:56:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:16 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:56:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:16 smithi037 ceph-mon[69017]: pgmap v499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:16 smithi037 ceph-mon[69017]: pgmap v500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:16 smithi037 ceph-mon[69017]: pgmap v501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:17.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:56:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:18 smithi033 ceph-mon[101165]: pgmap v502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:19.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:18 smithi037 ceph-mon[69017]: pgmap v502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:20 smithi033 ceph-mon[101165]: pgmap v503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:20 smithi037 ceph-mon[69017]: pgmap v503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:23.249 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:22 smithi033 ceph-mon[101165]: pgmap v504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:23.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:22 smithi037 ceph-mon[69017]: pgmap v504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:24 smithi033 ceph-mon[101165]: pgmap v505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:24 smithi037 ceph-mon[69017]: pgmap v505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:27.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:26 smithi037 ceph-mon[69017]: pgmap v506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:26 smithi033 ceph-mon[101165]: pgmap v506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:28 smithi033 ceph-mon[101165]: pgmap v507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:28 smithi037 ceph-mon[69017]: pgmap v507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:30 smithi033 ceph-mon[101165]: pgmap v508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:31.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:30 smithi037 ceph-mon[69017]: pgmap v508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:32 smithi033 ceph-mon[101165]: pgmap v509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:32 smithi037 ceph-mon[69017]: pgmap v509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:34.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 -- 172.21.15.33:0/3023815198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00602b0 msgr2=0x7f3fe00f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3023815198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00602b0 0x7f3fe00f9300 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f3fdc004660 tx=0x7f3fdc009b30).stop 2022-02-02T13:56:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 -- 172.21.15.33:0/3023815198 shutdown_connections 2022-02-02T13:56:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3023815198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00f9880 0x7f3fe00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3023815198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00602b0 0x7f3fe00f9300 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 -- 172.21.15.33:0/3023815198 >> 172.21.15.33:0/3023815198 conn(0x7f3fe00f0d40 msgr2=0x7f3fe00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 -- 172.21.15.33:0/3023815198 shutdown_connections 2022-02-02T13:56:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.396+0000 7f3fe7991700 1 -- 172.21.15.33:0/3023815198 wait complete. 2022-02-02T13:56:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 Processor -- start 2022-02-02T13:56:34.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 -- start start 2022-02-02T13:56:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 0x7f3fe0106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0107950 con 0x7f3fe00f9880 2022-02-02T13:56:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe7991700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0107a90 con 0x7f3fe00602b0 2022-02-02T13:56:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe4f2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe4f2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58818/0 (socket says 172.21.15.33:58818) 2022-02-02T13:56:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe4f2c700 1 -- 172.21.15.33:0/3074804777 learned_addr learned my addr 172.21.15.33:0/3074804777 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:34.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe572d700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 0x7f3fe0106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe4f2c700 1 -- 172.21.15.33:0/3074804777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 msgr2=0x7f3fe0106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.397+0000 7f3fe4f2c700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 0x7f3fe0106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fe4f2c700 1 -- 172.21.15.33:0/3074804777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc005040 con 0x7f3fe00f9880 2022-02-02T13:56:34.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fe572d700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 0x7f3fe0106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:56:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fe4f2c700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3fd00026d0 tx=0x7f3fd0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd0009320 con 0x7f3fe00f9880 2022-02-02T13:56:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fd000f040 con 0x7f3fe00f9880 2022-02-02T13:56:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe0108430 con 0x7f3fe00f9880 2022-02-02T13:56:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd0014870 con 0x7f3fe00f9880 2022-02-02T13:56:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.398+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe01089f0 con 0x7f3fe00f9880 2022-02-02T13:56:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.399+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe0045ad0 con 0x7f3fe00f9880 2022-02-02T13:56:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.400+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fd0009480 con 0x7f3fe00f9880 2022-02-02T13:56:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.400+0000 7f3fd5ffb700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 0x7f3fcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.400+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3fd0081d20 con 0x7f3fe00f9880 2022-02-02T13:56:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.400+0000 7f3fe572d700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 0x7f3fcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.401+0000 7f3fe572d700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 0x7f3fcc067290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3fdc004630 tx=0x7f3fdc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:34.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.405+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fd0053800 con 0x7f3fe00f9880 2022-02-02T13:56:34.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.593+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe0108cc0 con 0x7f3fcc064dd0 2022-02-02T13:56:34.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.595+0000 7f3fd5ffb700 1 -- 172.21.15.33:0/3074804777 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3fe0108cc0 con 0x7f3fcc064dd0 2022-02-02T13:56:34.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.596+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 msgr2=0x7f3fcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.596+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 0x7f3fcc067290 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f3fdc004630 tx=0x7f3fdc009b30).stop 2022-02-02T13:56:34.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.596+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 msgr2=0x7f3fe01073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.596+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f3fd00026d0 tx=0x7f3fd0009e00).stop 2022-02-02T13:56:34.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 shutdown_connections 2022-02-02T13:56:34.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fcc064dd0 0x7f3fcc067290 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe00602b0 0x7f3fe0106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 --2- 172.21.15.33:0/3074804777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fe00f9880 0x7f3fe01073a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 >> 172.21.15.33:0/3074804777 conn(0x7f3fe00f0d40 msgr2=0x7f3fe00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:34.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 shutdown_connections 2022-02-02T13:56:34.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.597+0000 7f3fe7991700 1 -- 172.21.15.33:0/3074804777 wait complete. 2022-02-02T13:56:34.606 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:56:34.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 -- 172.21.15.33:0/2542289176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f6860 msgr2=0x7f52d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 --2- 172.21.15.33:0/2542289176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f6860 0x7f52d80f6cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f52cc004660 tx=0x7f52cc009b30).stop 2022-02-02T13:56:34.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 -- 172.21.15.33:0/2542289176 shutdown_connections 2022-02-02T13:56:34.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 --2- 172.21.15.33:0/2542289176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f6860 0x7f52d80f6cc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 --2- 172.21.15.33:0/2542289176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f55c0 0x7f52d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 -- 172.21.15.33:0/2542289176 >> 172.21.15.33:0/2542289176 conn(0x7f52d80f0d40 msgr2=0x7f52d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:34.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 -- 172.21.15.33:0/2542289176 shutdown_connections 2022-02-02T13:56:34.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.698+0000 7f52df8be700 1 -- 172.21.15.33:0/2542289176 wait complete. 2022-02-02T13:56:34.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 Processor -- start 2022-02-02T13:56:34.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 -- start start 2022-02-02T13:56:34.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 0x7f52d810c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80603e0 con 0x7f52d80f55c0 2022-02-02T13:56:34.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52df8be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8060520 con 0x7f52d80f6860 2022-02-02T13:56:34.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52dd65a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52dd65a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58826/0 (socket says 172.21.15.33:58826) 2022-02-02T13:56:34.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.699+0000 7f52dd65a700 1 -- 172.21.15.33:0/3915832912 learned_addr learned my addr 172.21.15.33:0/3915832912 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:34.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dce59700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 0x7f52d810c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dd65a700 1 -- 172.21.15.33:0/3915832912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 msgr2=0x7f52d810c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dd65a700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 0x7f52d810c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dd65a700 1 -- 172.21.15.33:0/3915832912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc005040 con 0x7f52d80f55c0 2022-02-02T13:56:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dce59700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 0x7f52d810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:56:34.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52dd65a700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f52d4002700 tx=0x7f52d4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:34.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d4009320 con 0x7f52d80f55c0 2022-02-02T13:56:34.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d810c700 con 0x7f52d80f55c0 2022-02-02T13:56:34.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52d400f040 con 0x7f52d80f55c0 2022-02-02T13:56:34.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52d4014900 con 0x7f52d80f55c0 2022-02-02T13:56:34.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.700+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d810ccc0 con 0x7f52d80f55c0 2022-02-02T13:56:34.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.701+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d8045ad0 con 0x7f52d80f55c0 2022-02-02T13:56:34.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.702+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52d4009480 con 0x7f52d80f55c0 2022-02-02T13:56:34.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.703+0000 7f52c9ffb700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 0x7f52c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.703+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f52d4081d10 con 0x7f52d80f55c0 2022-02-02T13:56:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.703+0000 7f52dce59700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 0x7f52c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.703+0000 7f52dce59700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 0x7f52c4067290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f52cc004630 tx=0x7f52cc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:34.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.707+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52d404fe80 con 0x7f52d80f55c0 2022-02-02T13:56:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.889+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f52d80fdef0 con 0x7f52c4064dd0 2022-02-02T13:56:34.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.904+0000 7f52c9ffb700 1 -- 172.21.15.33:0/3915832912 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f52d80fdef0 con 0x7f52c4064dd0 2022-02-02T13:56:34.904 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:56:34.904 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (21m) 4m ago 22m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:56:34.904 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (14m) 4m ago 22m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:56:34.904 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (14m) 4m ago 22m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:56:34.905 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (21m) 4m ago 22m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:56:34.905 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (15m) 4m ago 19m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:56:34.905 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (16m) 4m ago 18m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:56:34.905 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (16m) 4m ago 19m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:56:34.906 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (19m) 4m ago 19m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:56:34.906 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (16m) 4m ago 24m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:56:34.906 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (16m) 4m ago 22m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:56:34.906 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (15m) 4m ago 24m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:56:34.907 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (15m) 4m ago 22m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:56:34.907 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (22m) 4m ago 22m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:56:34.907 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (22m) 4m ago 22m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:56:34.907 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 21m - 4096M 2022-02-02T13:56:34.907 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (21m) 4m ago 21m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:56:34.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (20m) 4m ago 20m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:56:34.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (20m) 4m ago 20m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:56:34.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (20m) 4m ago 20m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:56:34.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (20m) 4m ago 20m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:56:34.909 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (21m) 4m ago 22m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:56:34.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.905+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 msgr2=0x7f52c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.905+0000 7f52df8be700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 0x7f52c4067290 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f52cc004630 tx=0x7f52cc009b30).stop 2022-02-02T13:56:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.905+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 msgr2=0x7f52d8109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f52d4002700 tx=0x7f52d4009d80).stop 2022-02-02T13:56:34.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 shutdown_connections 2022-02-02T13:56:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52c4064dd0 0x7f52c4067290 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52d80f55c0 0x7f52d8109c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 --2- 172.21.15.33:0/3915832912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52d80f6860 0x7f52d810c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:34.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 >> 172.21.15.33:0/3915832912 conn(0x7f52d80f0d40 msgr2=0x7f52d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 shutdown_connections 2022-02-02T13:56:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:34.906+0000 7f52df8be700 1 -- 172.21.15.33:0/3915832912 wait complete. 2022-02-02T13:56:35.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 -- 172.21.15.33:0/2713753616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f5460 msgr2=0x7f39840f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 --2- 172.21.15.33:0/2713753616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f5460 0x7f39840f5880 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f3974004660 tx=0x7f3974009b30).stop 2022-02-02T13:56:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 -- 172.21.15.33:0/2713753616 shutdown_connections 2022-02-02T13:56:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 --2- 172.21.15.33:0/2713753616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f6700 0x7f39840f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 --2- 172.21.15.33:0/2713753616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f5460 0x7f39840f5880 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 -- 172.21.15.33:0/2713753616 >> 172.21.15.33:0/2713753616 conn(0x7f39840f0bc0 msgr2=0x7f39840f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 -- 172.21.15.33:0/2713753616 shutdown_connections 2022-02-02T13:56:35.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.006+0000 7f3989a12700 1 -- 172.21.15.33:0/2713753616 wait complete. 2022-02-02T13:56:35.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 Processor -- start 2022-02-02T13:56:35.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 -- start start 2022-02-02T13:56:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f5460 0x7f3984105d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3984106860 con 0x7f39840f6700 2022-02-02T13:56:35.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.007+0000 7f3989a12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3984107070 con 0x7f39840f5460 2022-02-02T13:56:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58838/0 (socket says 172.21.15.33:58838) 2022-02-02T13:56:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 -- 172.21.15.33:0/2501303308 learned_addr learned my addr 172.21.15.33:0/2501303308 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f3982ffd700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f5460 0x7f3984105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 -- 172.21.15.33:0/2501303308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f5460 msgr2=0x7f3984105d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f5460 0x7f3984105d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 -- 172.21.15.33:0/2501303308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974005040 con 0x7f39840f6700 2022-02-02T13:56:35.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397a7fc700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f396c00f940 tx=0x7f396c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:35.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c009500 con 0x7f39840f6700 2022-02-02T13:56:35.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3984107290 con 0x7f39840f6700 2022-02-02T13:56:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f396c009660 con 0x7f39840f6700 2022-02-02T13:56:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396c00de30 con 0x7f39840f6700 2022-02-02T13:56:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.008+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984107820 con 0x7f39840f6700 2022-02-02T13:56:35.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.009+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3984059100 con 0x7f39840f6700 2022-02-02T13:56:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.010+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f396c00e040 con 0x7f39840f6700 2022-02-02T13:56:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.010+0000 7f397bfff700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 0x7f39700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.010+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f396c084450 con 0x7f39840f6700 2022-02-02T13:56:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.010+0000 7f3982ffd700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 0x7f39700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.011+0000 7f3982ffd700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 0x7f39700672e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3974013690 tx=0x7f3974009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:35.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.015+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f396c052500 con 0x7f39840f6700 2022-02-02T13:56:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:34 smithi033 ceph-mon[101165]: pgmap v510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:35.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.259+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3984045ad0 con 0x7f39840f6700 2022-02-02T13:56:35.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.260+0000 7f397bfff700 1 -- 172.21.15.33:0/2501303308 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f396c055b20 con 0x7f39840f6700 2022-02-02T13:56:35.261 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:56:35.261 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:56:35.261 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:56:35.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:35.262 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:56:35.262 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:56:35.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:35.263 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:56:35.263 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:56:35.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:35.263 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:56:35.263 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:56:35.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:56:35.264 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:56:35.264 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:56:35.264 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:56:35.264 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:56:35.265 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:56:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 msgr2=0x7f39700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 0x7f39700672e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f3974013690 tx=0x7f3974009b30).stop 2022-02-02T13:56:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 msgr2=0x7f3984106260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f396c00f940 tx=0x7f396c009de0).stop 2022-02-02T13:56:35.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 shutdown_connections 2022-02-02T13:56:35.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3970064e20 0x7f39700672e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39840f5460 0x7f3984105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 --2- 172.21.15.33:0/2501303308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840f6700 0x7f3984106260 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 >> 172.21.15.33:0/2501303308 conn(0x7f39840f0bc0 msgr2=0x7f39840fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:35.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.262+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 shutdown_connections 2022-02-02T13:56:35.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.263+0000 7f3989a12700 1 -- 172.21.15.33:0/2501303308 wait complete. 2022-02-02T13:56:35.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:34 smithi037 ceph-mon[69017]: pgmap v510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 -- 172.21.15.33:0/3635332405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 msgr2=0x7f33a80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 --2- 172.21.15.33:0/3635332405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f59e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f3398004660 tx=0x7f3398009b30).stop 2022-02-02T13:56:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 -- 172.21.15.33:0/3635332405 shutdown_connections 2022-02-02T13:56:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 --2- 172.21.15.33:0/3635332405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 0x7f33a80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 --2- 172.21.15.33:0/3635332405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f59e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 -- 172.21.15.33:0/3635332405 >> 172.21.15.33:0/3635332405 conn(0x7f33a80f0d40 msgr2=0x7f33a80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 -- 172.21.15.33:0/3635332405 shutdown_connections 2022-02-02T13:56:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.363+0000 7f33ae60e700 1 -- 172.21.15.33:0/3635332405 wait complete. 2022-02-02T13:56:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 Processor -- start 2022-02-02T13:56:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 -- start start 2022-02-02T13:56:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 0x7f33a80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80f8100 con 0x7f33a80f55c0 2022-02-02T13:56:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33ae60e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a80f8240 con 0x7f33a80f6860 2022-02-02T13:56:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58846/0 (socket says 172.21.15.33:58846) 2022-02-02T13:56:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33a7fff700 1 -- 172.21.15.33:0/4078617039 learned_addr learned my addr 172.21.15.33:0/4078617039 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:56:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.364+0000 7f33a77fe700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 0x7f33a80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a7fff700 1 -- 172.21.15.33:0/4078617039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 msgr2=0x7f33a80f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a7fff700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 0x7f33a80f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a7fff700 1 -- 172.21.15.33:0/4078617039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398005040 con 0x7f33a80f55c0 2022-02-02T13:56:35.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a7fff700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3398013a70 tx=0x7f3398009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:35.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3398018070 con 0x7f33a80f55c0 2022-02-02T13:56:35.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33980097d0 con 0x7f33a80f55c0 2022-02-02T13:56:35.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a80f84c0 con 0x7f33a80f55c0 2022-02-02T13:56:35.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f339801de80 con 0x7f33a80f55c0 2022-02-02T13:56:35.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.365+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a80f8a20 con 0x7f33a80f55c0 2022-02-02T13:56:35.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.366+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3388004fa0 con 0x7f33a80f55c0 2022-02-02T13:56:35.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.367+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3398007ba0 con 0x7f33a80f55c0 2022-02-02T13:56:35.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.367+0000 7f33a4ff9700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 0x7f3390067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:56:35.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.367+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f33980835a0 con 0x7f33a80f55c0 2022-02-02T13:56:35.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.367+0000 7f33a77fe700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 0x7f3390067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:56:35.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.368+0000 7f33a77fe700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 0x7f3390067290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f339c004e20 tx=0x7f339c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:56:35.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.371+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f33980517c0 con 0x7f33a80f55c0 2022-02-02T13:56:35.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.585+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3388005e80 con 0x7f33a80f55c0 2022-02-02T13:56:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.586+0000 7f33a4ff9700 1 -- 172.21.15.33:0/4078617039 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f3398054de0 con 0x7f33a80f55c0 2022-02-02T13:56:35.593 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:56:35.593 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:56:35.593 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:56:35.594 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:56:35.594 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:35.594 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:56:35.594 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:56:35.595 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:56:35.595 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:56:35.595 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:56:35.596 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:56:35.596 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:56:35.596 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:56:35.596 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:56:35.597 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:56:35.597 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:56:35.597 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:56:35.597 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:56:35.597 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:56:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:56:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:56:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:56:35.598 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:56:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:56:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:56:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:56:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:56:35.599 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:56:35.600 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:56:35.600 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:56:35.600 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:56:35.600 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:35.601 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:35.601 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:56:35.602 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:56:35.602 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:35.602 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:35.602 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:35.603 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:56:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 msgr2=0x7f3390067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 0x7f3390067290 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f339c004e20 tx=0x7f339c00b040).stop 2022-02-02T13:56:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 msgr2=0x7f33a80f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:56:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f3398013a70 tx=0x7f3398009b30).stop 2022-02-02T13:56:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 shutdown_connections 2022-02-02T13:56:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3390064dd0 0x7f3390067290 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33a80f55c0 0x7f33a80f9720 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 --2- 172.21.15.33:0/4078617039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a80f6860 0x7f33a80f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:56:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 >> 172.21.15.33:0/4078617039 conn(0x7f33a80f0d40 msgr2=0x7f33a805fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:56:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 shutdown_connections 2022-02-02T13:56:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:56:35.588+0000 7f33ae60e700 1 -- 172.21.15.33:0/4078617039 wait complete. 2022-02-02T13:56:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:56:36.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:35 smithi033 ceph-mon[101165]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:36.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:35 smithi033 ceph-mon[101165]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:36.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:35 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2501303308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:56:36.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:35 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4078617039' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:56:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:35 smithi037 ceph-mon[69017]: from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:35 smithi037 ceph-mon[69017]: from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:56:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:35 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2501303308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:56:36.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:35 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4078617039' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:56:37.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:36 smithi037 ceph-mon[69017]: pgmap v511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:37.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:36 smithi033 ceph-mon[101165]: pgmap v511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:38 smithi037 ceph-mon[69017]: pgmap v512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:38 smithi033 ceph-mon[101165]: pgmap v512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:40 smithi037 ceph-mon[69017]: pgmap v513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:41.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:40 smithi033 ceph-mon[101165]: pgmap v513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:43 smithi037 ceph-mon[69017]: pgmap v514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:43 smithi033 ceph-mon[101165]: pgmap v514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:45.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:45 smithi037 ceph-mon[69017]: pgmap v515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:45 smithi033 ceph-mon[101165]: pgmap v515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:46 smithi037 ceph-mon[69017]: pgmap v516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:46 smithi033 ceph-mon[101165]: pgmap v516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:48 smithi033 ceph-mon[101165]: pgmap v517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:48 smithi037 ceph-mon[69017]: pgmap v517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:50 smithi037 ceph-mon[69017]: pgmap v518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:50 smithi033 ceph-mon[101165]: pgmap v518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:52 smithi037 ceph-mon[69017]: pgmap v519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:52 smithi033 ceph-mon[101165]: pgmap v519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:54 smithi037 ceph-mon[69017]: pgmap v520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:56:55.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:56:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:54 smithi033 ceph-mon[101165]: pgmap v520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:56:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:56:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:56 smithi037 ceph-mon[69017]: pgmap v521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:56 smithi033 ceph-mon[101165]: pgmap v521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:56:58 smithi037 ceph-mon[69017]: pgmap v522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:56:59.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:56:58 smithi033 ceph-mon[101165]: pgmap v522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:00 smithi037 ceph-mon[69017]: pgmap v523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:00 smithi033 ceph-mon[101165]: pgmap v523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:03.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:02 smithi037 ceph-mon[69017]: pgmap v524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:02 smithi033 ceph-mon[101165]: pgmap v524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:05 smithi037 ceph-mon[69017]: pgmap v525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:05 smithi033 ceph-mon[101165]: pgmap v525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:05.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- 172.21.15.33:0/3738433968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 msgr2=0x7fad980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:05.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/3738433968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad980f6cc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fad84004660 tx=0x7fad84009b30).stop 2022-02-02T13:57:05.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- 172.21.15.33:0/3738433968 shutdown_connections 2022-02-02T13:57:05.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/3738433968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad980f6cc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/3738433968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 0x7fad980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- 172.21.15.33:0/3738433968 >> 172.21.15.33:0/3738433968 conn(0x7fad980f0d40 msgr2=0x7fad980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:05.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- 172.21.15.33:0/3738433968 shutdown_connections 2022-02-02T13:57:05.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- 172.21.15.33:0/3738433968 wait complete. 2022-02-02T13:57:05.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 Processor -- start 2022-02-02T13:57:05.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.704+0000 7fad9ef4a700 1 -- start start 2022-02-02T13:57:05.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad9ef4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 0x7fad98106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:05.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad9ef4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:05.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad9ef4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98107a10 con 0x7fad980f6860 2022-02-02T13:57:05.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad9ef4a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad98107b50 con 0x7fad980f55c0 2022-02-02T13:57:05.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:05.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58858/0 (socket says 172.21.15.33:58858) 2022-02-02T13:57:05.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 -- 172.21.15.33:0/2828283271 learned_addr learned my addr 172.21.15.33:0/2828283271 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:05.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad9cce6700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 0x7fad98106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:05.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 -- 172.21.15.33:0/2828283271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 msgr2=0x7fad98106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:05.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 0x7fad98106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 -- 172.21.15.33:0/2828283271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84005040 con 0x7fad980f6860 2022-02-02T13:57:05.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.705+0000 7fad97fff700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fad84009830 tx=0x7fad84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:05.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.706+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad84018070 con 0x7fad980f6860 2022-02-02T13:57:05.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.706+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad84007ba0 con 0x7fad980f6860 2022-02-02T13:57:05.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.706+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98108490 con 0x7fad980f6860 2022-02-02T13:57:05.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.706+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad981089f0 con 0x7fad980f6860 2022-02-02T13:57:05.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.706+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad8401c3c0 con 0x7fad980f6860 2022-02-02T13:57:05.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.707+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad78004fa0 con 0x7fad980f6860 2022-02-02T13:57:05.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.707+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad8401d420 con 0x7fad980f6860 2022-02-02T13:57:05.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.708+0000 7fad957fa700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 0x7fad88067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:05.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.708+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fad84083500 con 0x7fad980f6860 2022-02-02T13:57:05.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.708+0000 7fad9cce6700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 0x7fad88067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:05.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.708+0000 7fad9cce6700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 0x7fad88067270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fad980f66c0 tx=0x7fad8c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:05.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.712+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad840550a0 con 0x7fad980f6860 2022-02-02T13:57:05.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.903+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad78000bc0 con 0x7fad88064db0 2022-02-02T13:57:05.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.905+0000 7fad957fa700 1 -- 172.21.15.33:0/2828283271 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fad78000bc0 con 0x7fad88064db0 2022-02-02T13:57:05.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.906+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 msgr2=0x7fad88067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:05.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.906+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 0x7fad88067270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fad980f66c0 tx=0x7fad8c00b040).stop 2022-02-02T13:57:05.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.906+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 msgr2=0x7fad98107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:05.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.906+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fad84009830 tx=0x7fad84009b30).stop 2022-02-02T13:57:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 shutdown_connections 2022-02-02T13:57:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad88064db0 0x7fad88067270 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad980f55c0 0x7fad98106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 --2- 172.21.15.33:0/2828283271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad980f6860 0x7fad98107460 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:05.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 >> 172.21.15.33:0/2828283271 conn(0x7fad980f0d40 msgr2=0x7fad9805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:05.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 shutdown_connections 2022-02-02T13:57:05.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:05.907+0000 7fad9ef4a700 1 -- 172.21.15.33:0/2828283271 wait complete. 2022-02-02T13:57:05.916 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:57:06.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 -- 172.21.15.33:0/1106960049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 msgr2=0x7fd98c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 --2- 172.21.15.33:0/1106960049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c0f5850 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fd97c004660 tx=0x7fd97c009b30).stop 2022-02-02T13:57:06.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 -- 172.21.15.33:0/1106960049 shutdown_connections 2022-02-02T13:57:06.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 --2- 172.21.15.33:0/1106960049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 0x7fd98c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 --2- 172.21.15.33:0/1106960049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c0f5850 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 -- 172.21.15.33:0/1106960049 >> 172.21.15.33:0/1106960049 conn(0x7fd98c0f0b90 msgr2=0x7fd98c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 -- 172.21.15.33:0/1106960049 shutdown_connections 2022-02-02T13:57:06.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.009+0000 7fd990d3f700 1 -- 172.21.15.33:0/1106960049 wait complete. 2022-02-02T13:57:06.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 Processor -- start 2022-02-02T13:57:06.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 -- start start 2022-02-02T13:57:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 0x7fd98c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c0603e0 con 0x7fd98c0f5430 2022-02-02T13:57:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd990d3f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98c060520 con 0x7fd98c0f66d0 2022-02-02T13:57:06.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd98b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58866/0 (socket says 172.21.15.33:58866) 2022-02-02T13:57:06.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd98b7fe700 1 -- 172.21.15.33:0/2035906497 learned_addr learned my addr 172.21.15.33:0/2035906497 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:06.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.010+0000 7fd98affd700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 0x7fd98c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd98b7fe700 1 -- 172.21.15.33:0/2035906497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 msgr2=0x7fd98c10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd98b7fe700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 0x7fd98c10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd98b7fe700 1 -- 172.21.15.33:0/2035906497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c005040 con 0x7fd98c0f5430 2022-02-02T13:57:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd98b7fe700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd97c004f60 tx=0x7fd97c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c018070 con 0x7fd98c0f5430 2022-02-02T13:57:06.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd97c009770 con 0x7fd98c0f5430 2022-02-02T13:57:06.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd97c01c3c0 con 0x7fd98c0f5430 2022-02-02T13:57:06.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98c10c4e0 con 0x7fd98c0f5430 2022-02-02T13:57:06.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.011+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98c10c9f0 con 0x7fd98c0f5430 2022-02-02T13:57:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.012+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd98c045ad0 con 0x7fd98c0f5430 2022-02-02T13:57:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.013+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd97c01d420 con 0x7fd98c0f5430 2022-02-02T13:57:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.013+0000 7fd973fff700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 0x7fd9740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.013+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd97c083890 con 0x7fd98c0f5430 2022-02-02T13:57:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.013+0000 7fd98affd700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 0x7fd9740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.013+0000 7fd98affd700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 0x7fd9740672e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd9800041d0 tx=0x7fd980009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.017+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd97c051a00 con 0x7fd98c0f5430 2022-02-02T13:57:06.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.201+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd98c0fdda0 con 0x7fd974064e20 2022-02-02T13:57:06.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.215+0000 7fd973fff700 1 -- 172.21.15.33:0/2035906497 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd980004700 con 0x7fd974064e20 2022-02-02T13:57:06.215 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:57:06.215 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (22m) 4m ago 23m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:57:06.215 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (15m) 4m ago 23m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:57:06.216 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (15m) 4m ago 22m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:57:06.216 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (22m) 4m ago 23m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:57:06.216 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (15m) 4m ago 19m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:57:06.216 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (16m) 4m ago 19m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:57:06.217 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (17m) 4m ago 19m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:57:06.217 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (19m) 4m ago 19m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:57:06.217 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (17m) 4m ago 24m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:57:06.217 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (16m) 4m ago 22m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:57:06.217 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (16m) 4m ago 24m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:57:06.218 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (15m) 4m ago 22m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:57:06.218 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (23m) 4m ago 23m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:57:06.218 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (22m) 4m ago 22m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:57:06.218 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 22m - 4096M 2022-02-02T13:57:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (21m) 4m ago 21m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:57:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (21m) 4m ago 21m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:57:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (21m) 4m ago 21m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:57:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (20m) 4m ago 20m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:57:06.219 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (20m) 4m ago 20m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:57:06.220 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (22m) 4m ago 22m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:57:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 msgr2=0x7fd9740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 0x7fd9740672e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fd9800041d0 tx=0x7fd980009040).stop 2022-02-02T13:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 msgr2=0x7fd98c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd97c004f60 tx=0x7fd97c009b30).stop 2022-02-02T13:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 shutdown_connections 2022-02-02T13:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd974064e20 0x7fd9740672e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd98c0f5430 0x7fd98c109a90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 --2- 172.21.15.33:0/2035906497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd98c0f66d0 0x7fd98c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 >> 172.21.15.33:0/2035906497 conn(0x7fd98c0f0b90 msgr2=0x7fd98c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 shutdown_connections 2022-02-02T13:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.218+0000 7fd990d3f700 1 -- 172.21.15.33:0/2035906497 wait complete. 2022-02-02T13:57:06.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 -- 172.21.15.33:0/3056559418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e800f9850 msgr2=0x7f8e800fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 --2- 172.21.15.33:0/3056559418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e800f9850 0x7f8e800fbc80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f8e6c004660 tx=0x7f8e6c009b30).stop 2022-02-02T13:57:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 -- 172.21.15.33:0/3056559418 shutdown_connections 2022-02-02T13:57:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 --2- 172.21.15.33:0/3056559418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e800f9850 0x7f8e800fbc80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 --2- 172.21.15.33:0/3056559418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e80060250 0x7f8e800f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 -- 172.21.15.33:0/3056559418 >> 172.21.15.33:0/3056559418 conn(0x7f8e800f0d40 msgr2=0x7f8e800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 -- 172.21.15.33:0/3056559418 shutdown_connections 2022-02-02T13:57:06.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 -- 172.21.15.33:0/3056559418 wait complete. 2022-02-02T13:57:06.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.318+0000 7f8e86f63700 1 Processor -- start 2022-02-02T13:57:06.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e86f63700 1 -- start start 2022-02-02T13:57:06.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e86f63700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e86f63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800f9850 0x7f8e80107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e86f63700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80107a10 con 0x7f8e80060250 2022-02-02T13:57:06.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e86f63700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80107b50 con 0x7f8e800f9850 2022-02-02T13:57:06.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58876/0 (socket says 172.21.15.33:58876) 2022-02-02T13:57:06.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 -- 172.21.15.33:0/2692017147 learned_addr learned my addr 172.21.15.33:0/2692017147 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:06.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e7ffff700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800f9850 0x7f8e80107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 -- 172.21.15.33:0/2692017147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800f9850 msgr2=0x7f8e80107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800f9850 0x7f8e80107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.319+0000 7f8e84cff700 1 -- 172.21.15.33:0/2692017147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c005040 con 0x7f8e80060250 2022-02-02T13:57:06.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e84cff700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f8e740026d0 tx=0x7f8e74009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e74009320 con 0x7f8e80060250 2022-02-02T13:57:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e7400f040 con 0x7f8e80060250 2022-02-02T13:57:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e801084f0 con 0x7f8e80060250 2022-02-02T13:57:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e740147e0 con 0x7f8e80060250 2022-02-02T13:57:06.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.320+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e80108ab0 con 0x7f8e80060250 2022-02-02T13:57:06.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.321+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e80045ad0 con 0x7f8e80060250 2022-02-02T13:57:06.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.321+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8e74009480 con 0x7f8e80060250 2022-02-02T13:57:06.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.322+0000 7f8e7d7fa700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 0x7f8e70067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.322+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8e74082170 con 0x7f8e80060250 2022-02-02T13:57:06.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.322+0000 7f8e7ffff700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 0x7f8e70067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.323+0000 7f8e7ffff700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 0x7f8e70067270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8e6c009830 tx=0x7f8e6c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.326+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8e74053c50 con 0x7f8e80060250 2022-02-02T13:57:06.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.571+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8e80027a00 con 0x7f8e80060250 2022-02-02T13:57:06.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.572+0000 7f8e7d7fa700 1 -- 172.21.15.33:0/2692017147 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8e74053840 con 0x7f8e80060250 2022-02-02T13:57:06.572 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:57:06.573 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:57:06.573 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:57:06.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:06.573 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:57:06.573 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:57:06.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:06.574 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:57:06.574 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:57:06.574 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:06.575 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:57:06.575 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:57:06.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:06.575 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:57:06.575 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:57:06.576 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:57:06.576 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:57:06.576 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:57:06.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 msgr2=0x7f8e70067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 0x7f8e70067270 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f8e6c009830 tx=0x7f8e6c009b30).stop 2022-02-02T13:57:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 msgr2=0x7f8e80106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f8e740026d0 tx=0x7f8e74009de0).stop 2022-02-02T13:57:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 shutdown_connections 2022-02-02T13:57:06.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e70064db0 0x7f8e70067270 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e80060250 0x7f8e80106f70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 --2- 172.21.15.33:0/2692017147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e800f9850 0x7f8e80107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 >> 172.21.15.33:0/2692017147 conn(0x7f8e800f0d40 msgr2=0x7f8e800f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 shutdown_connections 2022-02-02T13:57:06.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.574+0000 7f8e86f63700 1 -- 172.21.15.33:0/2692017147 wait complete. 2022-02-02T13:57:06.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- 172.21.15.33:0/2233670760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 msgr2=0x7ff2640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 --2- 172.21.15.33:0/2233670760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff2640f7c30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7ff254004660 tx=0x7ff254009b30).stop 2022-02-02T13:57:06.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- 172.21.15.33:0/2233670760 shutdown_connections 2022-02-02T13:57:06.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 --2- 172.21.15.33:0/2233670760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff2640f7c30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 --2- 172.21.15.33:0/2233670760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 0x7ff2640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- 172.21.15.33:0/2233670760 >> 172.21.15.33:0/2233670760 conn(0x7ff2640f1c90 msgr2=0x7ff2640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- 172.21.15.33:0/2233670760 shutdown_connections 2022-02-02T13:57:06.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- 172.21.15.33:0/2233670760 wait complete. 2022-02-02T13:57:06.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 Processor -- start 2022-02-02T13:57:06.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.676+0000 7ff269002700 1 -- start start 2022-02-02T13:57:06.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff269002700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 0x7ff264106d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff269002700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff269002700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2641077f0 con 0x7ff2640f77d0 2022-02-02T13:57:06.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff269002700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264107ff0 con 0x7ff2640f6530 2022-02-02T13:57:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58888/0 (socket says 172.21.15.33:58888) 2022-02-02T13:57:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 -- 172.21.15.33:0/1666907077 learned_addr learned my addr 172.21.15.33:0/1666907077 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff263fff700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 0x7ff264106d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 -- 172.21.15.33:0/1666907077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 msgr2=0x7ff264106d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 0x7ff264106d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 -- 172.21.15.33:0/1666907077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254005040 con 0x7ff2640f77d0 2022-02-02T13:57:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff2637fe700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7ff254009990 tx=0x7ff254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff254018070 con 0x7ff2640f77d0 2022-02-02T13:57:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff254007ba0 con 0x7ff2640f77d0 2022-02-02T13:57:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff264108270 con 0x7ff2640f77d0 2022-02-02T13:57:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.677+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25401c3c0 con 0x7ff2640f77d0 2022-02-02T13:57:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.678+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2641087d0 con 0x7ff2640f77d0 2022-02-02T13:57:06.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.678+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff264059100 con 0x7ff2640f77d0 2022-02-02T13:57:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.680+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff25401d420 con 0x7ff2640f77d0 2022-02-02T13:57:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.680+0000 7ff260ff9700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 0x7ff2500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.680+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff254083980 con 0x7ff2640f77d0 2022-02-02T13:57:06.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.680+0000 7ff263fff700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 0x7ff2500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.681+0000 7ff263fff700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 0x7ff2500672e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff2640f7630 tx=0x7ff24c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:06.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.684+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff254055460 con 0x7ff2640f77d0 2022-02-02T13:57:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.897+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff264045ad0 con 0x7ff2640f77d0 2022-02-02T13:57:06.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:06 smithi033 ceph-mon[101165]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:06.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:06 smithi033 ceph-mon[101165]: pgmap v526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:06.898 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:06 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2692017147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:57:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.898+0000 7ff260ff9700 1 -- 172.21.15.33:0/1666907077 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff254055050 con 0x7ff2640f77d0 2022-02-02T13:57:06.899 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:57:06.899 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:57:06.900 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:57:06.900 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:57:06.900 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:06.900 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:57:06.901 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:57:06.901 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:57:06.901 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:57:06.901 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:57:06.901 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:57:06.902 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:57:06.902 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:57:06.902 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:57:06.902 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:57:06.903 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:57:06.903 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:57:06.903 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:57:06.903 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:57:06.903 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:57:06.904 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:57:06.904 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:57:06.904 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:57:06.904 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:57:06.905 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:57:06.905 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:57:06.905 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:57:06.905 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:57:06.906 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:57:06.906 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:57:06.906 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:57:06.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:06.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:06.907 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:57:06.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:06.907 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:06.907 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:06.908 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:06.908 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 msgr2=0x7ff2500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 0x7ff2500672e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7ff2640f7630 tx=0x7ff24c00b040).stop 2022-02-02T13:57:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 msgr2=0x7ff264107240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7ff254009990 tx=0x7ff254009b30).stop 2022-02-02T13:57:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 shutdown_connections 2022-02-02T13:57:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff250064e20 0x7ff2500672e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2640f6530 0x7ff264106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 --2- 172.21.15.33:0/1666907077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2640f77d0 0x7ff264107240 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.901+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 >> 172.21.15.33:0/1666907077 conn(0x7ff2640f1c90 msgr2=0x7ff2640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.902+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 shutdown_connections 2022-02-02T13:57:06.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:06.902+0000 7ff269002700 1 -- 172.21.15.33:0/1666907077 wait complete. 2022-02-02T13:57:06.918 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:57:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:06 smithi037 ceph-mon[69017]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:06 smithi037 ceph-mon[69017]: pgmap v526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:07.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:06 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2692017147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:57:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:07 smithi033 ceph-mon[101165]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1666907077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:57:08.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:07 smithi037 ceph-mon[69017]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1666907077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:57:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:08 smithi033 ceph-mon[101165]: pgmap v527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:08 smithi037 ceph-mon[69017]: pgmap v527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:10 smithi037 ceph-mon[69017]: pgmap v528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:11.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:10 smithi033 ceph-mon[101165]: pgmap v528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:12 smithi037 ceph-mon[69017]: pgmap v529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:12 smithi033 ceph-mon[101165]: pgmap v529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:15 smithi037 ceph-mon[69017]: pgmap v530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:15 smithi033 ceph-mon[101165]: pgmap v530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:57:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:57:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:57:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:57:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: pgmap v531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:57:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:57:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:57:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:57:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:57:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: pgmap v531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:17.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:57:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:17 smithi033 ceph-mon[101165]: pgmap v532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:17 smithi033 ceph-mon[101165]: pgmap v533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:17 smithi037 ceph-mon[69017]: pgmap v532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:17 smithi037 ceph-mon[69017]: pgmap v533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:19 smithi033 ceph-mon[101165]: pgmap v534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:19 smithi037 ceph-mon[69017]: pgmap v534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:21 smithi033 ceph-mon[101165]: pgmap v535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:21 smithi037 ceph-mon[69017]: pgmap v535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:23 smithi033 ceph-mon[101165]: pgmap v536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:23 smithi037 ceph-mon[69017]: pgmap v536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:25 smithi033 ceph-mon[101165]: pgmap v537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:25 smithi037 ceph-mon[69017]: pgmap v537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:27 smithi033 ceph-mon[101165]: pgmap v538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:28.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:27 smithi037 ceph-mon[69017]: pgmap v538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:29 smithi033 ceph-mon[101165]: pgmap v539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:30.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:29 smithi037 ceph-mon[69017]: pgmap v539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:31 smithi033 ceph-mon[101165]: pgmap v540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:32.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:31 smithi037 ceph-mon[69017]: pgmap v540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:33 smithi033 ceph-mon[101165]: pgmap v541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:33 smithi037 ceph-mon[69017]: pgmap v541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:35 smithi033 ceph-mon[101165]: pgmap v542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:35 smithi037 ceph-mon[69017]: pgmap v542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:37.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 -- 172.21.15.33:0/1608166556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f7980 msgr2=0x7fe1800f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 --2- 172.21.15.33:0/1608166556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f7980 0x7fe1800f7de0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fe174004660 tx=0x7fe174009b30).stop 2022-02-02T13:57:37.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 -- 172.21.15.33:0/1608166556 shutdown_connections 2022-02-02T13:57:37.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 --2- 172.21.15.33:0/1608166556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f7980 0x7fe1800f7de0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 --2- 172.21.15.33:0/1608166556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f66e0 0x7fe1800f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.018+0000 7fe186458700 1 -- 172.21.15.33:0/1608166556 >> 172.21.15.33:0/1608166556 conn(0x7fe1800f1e40 msgr2=0x7fe1800f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.019+0000 7fe186458700 1 -- 172.21.15.33:0/1608166556 shutdown_connections 2022-02-02T13:57:37.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.019+0000 7fe186458700 1 -- 172.21.15.33:0/1608166556 wait complete. 2022-02-02T13:57:37.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.019+0000 7fe186458700 1 Processor -- start 2022-02-02T13:57:37.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.019+0000 7fe186458700 1 -- start start 2022-02-02T13:57:37.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe186458700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe186458700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f7980 0x7fe180069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe186458700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18006a380 con 0x7fe1800f66e0 2022-02-02T13:57:37.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe186458700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18006a4c0 con 0x7fe1800f7980 2022-02-02T13:57:37.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58896/0 (socket says 172.21.15.33:58896) 2022-02-02T13:57:37.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 -- 172.21.15.33:0/286911813 learned_addr learned my addr 172.21.15.33:0/286911813 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:37.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17f7fe700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f7980 0x7fe180069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 -- 172.21.15.33:0/286911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f7980 msgr2=0x7fe180069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f7980 0x7fe180069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 -- 172.21.15.33:0/286911813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174005040 con 0x7fe1800f66e0 2022-02-02T13:57:37.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17ffff700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe170002700 tx=0x7fe170009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1700079c0 con 0x7fe1800f66e0 2022-02-02T13:57:37.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe17000f040 con 0x7fe1800f66e0 2022-02-02T13:57:37.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.020+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe170014860 con 0x7fe1800f66e0 2022-02-02T13:57:37.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.021+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18006a7a0 con 0x7fe1800f66e0 2022-02-02T13:57:37.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.021+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18010ef90 con 0x7fe1800f66e0 2022-02-02T13:57:37.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.022+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe180045ad0 con 0x7fe1800f66e0 2022-02-02T13:57:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.022+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe17001b060 con 0x7fe1800f66e0 2022-02-02T13:57:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.022+0000 7fe17cff9700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 0x7fe168067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.023+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe170081930 con 0x7fe1800f66e0 2022-02-02T13:57:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.023+0000 7fe17f7fe700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 0x7fe168067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.023+0000 7fe17f7fe700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 0x7fe168067290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe174004630 tx=0x7fe174009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.027+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe17004f9e0 con 0x7fe1800f66e0 2022-02-02T13:57:37.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.218+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1800ff050 con 0x7fe168064dd0 2022-02-02T13:57:37.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.220+0000 7fe17cff9700 1 -- 172.21.15.33:0/286911813 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe174019040 con 0x7fe168064dd0 2022-02-02T13:57:37.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 msgr2=0x7fe168067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 0x7fe168067290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe174004630 tx=0x7fe174009b30).stop 2022-02-02T13:57:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 msgr2=0x7fe18006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fe170002700 tx=0x7fe170009d80).stop 2022-02-02T13:57:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 shutdown_connections 2022-02-02T13:57:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe168064dd0 0x7fe168067290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1800f66e0 0x7fe18006b9a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 --2- 172.21.15.33:0/286911813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1800f7980 0x7fe180069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.221+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 >> 172.21.15.33:0/286911813 conn(0x7fe1800f1e40 msgr2=0x7fe1800fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.222+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 shutdown_connections 2022-02-02T13:57:37.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.222+0000 7fe186458700 1 -- 172.21.15.33:0/286911813 wait complete. 2022-02-02T13:57:37.231 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:57:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 -- 172.21.15.33:0/3287606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 msgr2=0x7f19200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 --2- 172.21.15.33:0/3287606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f19200f6cc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f1914004660 tx=0x7f1914009b30).stop 2022-02-02T13:57:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 -- 172.21.15.33:0/3287606209 shutdown_connections 2022-02-02T13:57:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 --2- 172.21.15.33:0/3287606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f19200f6cc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 --2- 172.21.15.33:0/3287606209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 0x7f19200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 -- 172.21.15.33:0/3287606209 >> 172.21.15.33:0/3287606209 conn(0x7f19200f0d40 msgr2=0x7f19200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 -- 172.21.15.33:0/3287606209 shutdown_connections 2022-02-02T13:57:37.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.322+0000 7f19268f9700 1 -- 172.21.15.33:0/3287606209 wait complete. 2022-02-02T13:57:37.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.323+0000 7f19268f9700 1 Processor -- start 2022-02-02T13:57:37.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.323+0000 7f19268f9700 1 -- start start 2022-02-02T13:57:37.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.323+0000 7f19268f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 0x7f1920109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.323+0000 7f19268f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f19268f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200603c0 con 0x7f19200f6860 2022-02-02T13:57:37.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f19268f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1920060500 con 0x7f19200f55c0 2022-02-02T13:57:37.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 0x7f1920109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58908/0 (socket says 172.21.15.33:58908) 2022-02-02T13:57:37.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 -- 172.21.15.33:0/3248282684 learned_addr learned my addr 172.21.15.33:0/3248282684 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:37.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 -- 172.21.15.33:0/3248282684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 msgr2=0x7f1920109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 0x7f1920109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 -- 172.21.15.33:0/3248282684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914005040 con 0x7f19200f6860 2022-02-02T13:57:37.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191f7fe700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1914009990 tx=0x7f1914009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1914018070 con 0x7f19200f6860 2022-02-02T13:57:37.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192010c6c0 con 0x7f19200f6860 2022-02-02T13:57:37.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1914007ba0 con 0x7f19200f6860 2022-02-02T13:57:37.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.324+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f191401c3c0 con 0x7f19200f6860 2022-02-02T13:57:37.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.325+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192010cbf0 con 0x7f19200f6860 2022-02-02T13:57:37.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.325+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1920045ad0 con 0x7f19200f6860 2022-02-02T13:57:37.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.326+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f191401d420 con 0x7f19200f6860 2022-02-02T13:57:37.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.326+0000 7f191cff9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 0x7f1908067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.327+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1914083710 con 0x7f19200f6860 2022-02-02T13:57:37.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.327+0000 7f191ffff700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 0x7f1908067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.327+0000 7f191ffff700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 0x7f1908067290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1920060040 tx=0x7f191000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.331+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1914051820 con 0x7f19200f6860 2022-02-02T13:57:37.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.514+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19200fdec0 con 0x7f1908064dd0 2022-02-02T13:57:37.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.528+0000 7f191cff9700 1 -- 172.21.15.33:0/3248282684 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f19200fdec0 con 0x7f1908064dd0 2022-02-02T13:57:37.528 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:57:37.529 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (22m) 5m ago 23m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:57:37.529 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (15m) 5m ago 23m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:57:37.529 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (15m) 5m ago 23m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:57:37.529 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (22m) 5m ago 23m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:57:37.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (16m) 5m ago 20m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:57:37.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (17m) 5m ago 20m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:57:37.531 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (17m) 5m ago 20m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:57:37.531 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (20m) 5m ago 20m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:57:37.531 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (17m) 5m ago 25m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:57:37.531 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (17m) 5m ago 23m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:57:37.532 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (16m) 5m ago 25m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:57:37.532 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (16m) 5m ago 23m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:57:37.532 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (23m) 5m ago 23m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:57:37.533 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (23m) 5m ago 23m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:57:37.533 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 22m - 4096M 2022-02-02T13:57:37.534 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (22m) 5m ago 22m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:57:37.534 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (22m) 5m ago 22m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:57:37.534 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (21m) 5m ago 21m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:57:37.534 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (21m) 5m ago 21m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:57:37.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (21m) 5m ago 21m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:57:37.535 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (22m) 5m ago 23m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:57:37.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 msgr2=0x7f1908067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 0x7f1908067290 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f1920060040 tx=0x7f191000b040).stop 2022-02-02T13:57:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 msgr2=0x7f192010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1914009990 tx=0x7f1914009b30).stop 2022-02-02T13:57:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 shutdown_connections 2022-02-02T13:57:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1908064dd0 0x7f1908067290 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19200f55c0 0x7f1920109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 --2- 172.21.15.33:0/3248282684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19200f6860 0x7f192010c170 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 >> 172.21.15.33:0/3248282684 conn(0x7f19200f0d40 msgr2=0x7f19200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 shutdown_connections 2022-02-02T13:57:37.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.530+0000 7f19268f9700 1 -- 172.21.15.33:0/3248282684 wait complete. 2022-02-02T13:57:37.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.630+0000 7f22e98b3700 1 -- 172.21.15.33:0/892933442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 msgr2=0x7f22e40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.630+0000 7f22e98b3700 1 --2- 172.21.15.33:0/892933442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f6b30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f22d0004660 tx=0x7f22d0009b30).stop 2022-02-02T13:57:37.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 -- 172.21.15.33:0/892933442 shutdown_connections 2022-02-02T13:57:37.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 --2- 172.21.15.33:0/892933442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f6b30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 --2- 172.21.15.33:0/892933442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 0x7f22e40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 -- 172.21.15.33:0/892933442 >> 172.21.15.33:0/892933442 conn(0x7f22e40f0b90 msgr2=0x7f22e40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 -- 172.21.15.33:0/892933442 shutdown_connections 2022-02-02T13:57:37.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 -- 172.21.15.33:0/892933442 wait complete. 2022-02-02T13:57:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 Processor -- start 2022-02-02T13:57:37.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.631+0000 7f22e98b3700 1 -- start start 2022-02-02T13:57:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e98b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 0x7f22e40f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e98b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e98b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40f7f70 con 0x7f22e40f66d0 2022-02-02T13:57:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e98b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40f80b0 con 0x7f22e40f5430 2022-02-02T13:57:37.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58918/0 (socket says 172.21.15.33:58918) 2022-02-02T13:57:37.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 -- 172.21.15.33:0/1733127082 learned_addr learned my addr 172.21.15.33:0/1733127082 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:37.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e88b1700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 0x7f22e40f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 -- 172.21.15.33:0/1733127082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 msgr2=0x7f22e40f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 0x7f22e40f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 -- 172.21.15.33:0/1733127082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d0005040 con 0x7f22e40f66d0 2022-02-02T13:57:37.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.632+0000 7f22e3fff700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f22d0009990 tx=0x7f22d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.633+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d0018070 con 0x7f22e40f66d0 2022-02-02T13:57:37.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.633+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22d0007ba0 con 0x7f22e40f66d0 2022-02-02T13:57:37.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.633+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22d001c3c0 con 0x7f22e40f66d0 2022-02-02T13:57:37.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.633+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e40f8330 con 0x7f22e40f66d0 2022-02-02T13:57:37.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.633+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e40f8840 con 0x7f22e40f66d0 2022-02-02T13:57:37.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.634+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e4045ad0 con 0x7f22e40f66d0 2022-02-02T13:57:37.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.636+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22d001d420 con 0x7f22e40f66d0 2022-02-02T13:57:37.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.637+0000 7f22e17fa700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 0x7f22d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:37.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.637+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f22d0083980 con 0x7f22e40f66d0 2022-02-02T13:57:37.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.637+0000 7f22e88b1700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 0x7f22d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:37.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.637+0000 7f22e88b1700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 0x7f22d40672e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f22e40f9320 tx=0x7f22d800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:37.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.640+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22d0051a30 con 0x7f22e40f66d0 2022-02-02T13:57:37.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.887+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22e40fdbf0 con 0x7f22e40f66d0 2022-02-02T13:57:37.889 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:37 smithi033 ceph-mon[101165]: pgmap v543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:37.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.888+0000 7f22e17fa700 1 -- 172.21.15.33:0/1733127082 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f22d0055050 con 0x7f22e40f66d0 2022-02-02T13:57:37.890 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:57:37.890 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:57:37.890 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:57:37.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:37.891 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:57:37.892 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:57:37.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:37.892 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:57:37.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:57:37.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:37.893 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:57:37.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:57:37.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:57:37.894 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:57:37.894 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:57:37.894 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:57:37.895 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:57:37.896 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:57:37.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 msgr2=0x7f22d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 0x7f22d40672e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f22e40f9320 tx=0x7f22d800b040).stop 2022-02-02T13:57:37.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 msgr2=0x7f22e40f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f22d0009990 tx=0x7f22d0009b30).stop 2022-02-02T13:57:37.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 shutdown_connections 2022-02-02T13:57:37.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22d4064e20 0x7f22d40672e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22e40f5430 0x7f22e40f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 --2- 172.21.15.33:0/1733127082 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22e40f66d0 0x7f22e40f7a10 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 >> 172.21.15.33:0/1733127082 conn(0x7f22e40f0b90 msgr2=0x7f22e405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 shutdown_connections 2022-02-02T13:57:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.890+0000 7f22e98b3700 1 -- 172.21.15.33:0/1733127082 wait complete. 2022-02-02T13:57:37.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 -- 172.21.15.33:0/794492147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f66e0 msgr2=0x7f36440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:37.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 --2- 172.21.15.33:0/794492147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f66e0 0x7f36440f6b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f3638004660 tx=0x7f3638009b30).stop 2022-02-02T13:57:37.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 -- 172.21.15.33:0/794492147 shutdown_connections 2022-02-02T13:57:37.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 --2- 172.21.15.33:0/794492147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f7980 0x7f36440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 --2- 172.21.15.33:0/794492147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f66e0 0x7f36440f6b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:37.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 -- 172.21.15.33:0/794492147 >> 172.21.15.33:0/794492147 conn(0x7f36440f1e40 msgr2=0x7f36440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:37.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 -- 172.21.15.33:0/794492147 shutdown_connections 2022-02-02T13:57:37.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.992+0000 7f36495d3700 1 -- 172.21.15.33:0/794492147 wait complete. 2022-02-02T13:57:37.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 Processor -- start 2022-02-02T13:57:37.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 -- start start 2022-02-02T13:57:38.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f66e0 0x7f3644106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:38.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:38.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644107a50 con 0x7f36440f7980 2022-02-02T13:57:38.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36495d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3644107b90 con 0x7f36440f66e0 2022-02-02T13:57:38.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:38.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58928/0 (socket says 172.21.15.33:58928) 2022-02-02T13:57:38.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 -- 172.21.15.33:0/438404623 learned_addr learned my addr 172.21.15.33:0/438404623 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:57:38.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f3642ffd700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f66e0 0x7f3644106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:38.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 -- 172.21.15.33:0/438404623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f66e0 msgr2=0x7f3644106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:38.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f66e0 0x7f3644106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:38.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.993+0000 7f36427fc700 1 -- 172.21.15.33:0/438404623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638005040 con 0x7f36440f7980 2022-02-02T13:57:38.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f36427fc700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f36340026d0 tx=0x7f3634009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:38.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36340079c0 con 0x7f36440f7980 2022-02-02T13:57:38.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3644108530 con 0x7f36440f7980 2022-02-02T13:57:38.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f363400f040 con 0x7f36440f7980 2022-02-02T13:57:38.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f36340148b0 con 0x7f36440f7980 2022-02-02T13:57:38.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.994+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3644108af0 con 0x7f36440f7980 2022-02-02T13:57:38.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.995+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3644045ad0 con 0x7f36440f7980 2022-02-02T13:57:38.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.995+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3634007b20 con 0x7f36440f7980 2022-02-02T13:57:38.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.996+0000 7f362b7fe700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 0x7f362c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:57:38.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.996+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3634081a30 con 0x7f36440f7980 2022-02-02T13:57:38.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.996+0000 7f3642ffd700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 0x7f362c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:57:38.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:37.996+0000 7f3642ffd700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 0x7f362c067290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3638004630 tx=0x7f3638009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:57:38.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.000+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3634053510 con 0x7f36440f7980 2022-02-02T13:57:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.212+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3644027a00 con 0x7f36440f7980 2022-02-02T13:57:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.213+0000 7f362b7fe700 1 -- 172.21.15.33:0/438404623 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f3634053100 con 0x7f36440f7980 2022-02-02T13:57:38.223 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:57:38.223 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:57:38.224 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:57:38.224 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:57:38.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:38.225 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:57:38.226 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:57:38.226 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:57:38.227 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:57:38.228 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:57:38.228 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:57:38.229 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:57:38.229 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:57:38.230 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:57:38.231 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:57:38.231 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:57:38.232 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:57:38.232 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:57:38.233 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:57:38.233 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:57:38.234 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:57:38.234 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:57:38.235 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:57:38.235 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:57:38.235 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:57:38.236 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:57:38.236 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:57:38.237 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:57:38.238 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:57:38.238 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:57:38.239 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:57:38.240 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:38.240 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:38.241 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:57:38.241 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:57:38.242 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:38.242 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:38.243 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:38.243 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:57:38.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 msgr2=0x7f362c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:38.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 0x7f362c067290 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f3638004630 tx=0x7f3638009b30).stop 2022-02-02T13:57:38.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 msgr2=0x7f36441074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:57:38.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f36340026d0 tx=0x7f3634009de0).stop 2022-02-02T13:57:38.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 shutdown_connections 2022-02-02T13:57:38.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f362c064dd0 0x7f362c067290 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:38.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36440f66e0 0x7f3644106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:38.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 --2- 172.21.15.33:0/438404623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36440f7980 0x7f36441074a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:57:38.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 >> 172.21.15.33:0/438404623 conn(0x7f36440f1e40 msgr2=0x7f36440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:57:38.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 shutdown_connections 2022-02-02T13:57:38.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:57:38.215+0000 7f36495d3700 1 -- 172.21.15.33:0/438404623 wait complete. 2022-02-02T13:57:38.252 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:57:38.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:37 smithi037 ceph-mon[69017]: pgmap v543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:38 smithi033 ceph-mon[101165]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:38 smithi033 ceph-mon[101165]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1733127082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:57:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/438404623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:57:39.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:38 smithi037 ceph-mon[69017]: from='client.34662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:38 smithi037 ceph-mon[69017]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:57:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1733127082' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:57:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/438404623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:57:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:39 smithi033 ceph-mon[101165]: pgmap v544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:39 smithi037 ceph-mon[69017]: pgmap v544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:41 smithi033 ceph-mon[101165]: pgmap v545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:41 smithi037 ceph-mon[69017]: pgmap v545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:43 smithi033 ceph-mon[101165]: pgmap v546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:43 smithi037 ceph-mon[69017]: pgmap v546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:45 smithi033 ceph-mon[101165]: pgmap v547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:45 smithi037 ceph-mon[69017]: pgmap v547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:48.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:47 smithi033 ceph-mon[101165]: pgmap v548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:47 smithi037 ceph-mon[69017]: pgmap v548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:49 smithi033 ceph-mon[101165]: pgmap v549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:49 smithi037 ceph-mon[69017]: pgmap v549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:51 smithi033 ceph-mon[101165]: pgmap v550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:51 smithi037 ceph-mon[69017]: pgmap v550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:54.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:53 smithi033 ceph-mon[101165]: pgmap v551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:53 smithi037 ceph-mon[69017]: pgmap v551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:57:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:57:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:57:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:57:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:55 smithi033 ceph-mon[101165]: pgmap v552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:55 smithi037 ceph-mon[69017]: pgmap v552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:58.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:57 smithi033 ceph-mon[101165]: pgmap v553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:57:58.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:57 smithi037 ceph-mon[69017]: pgmap v553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:57:59 smithi033 ceph-mon[101165]: pgmap v554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:57:59 smithi037 ceph-mon[69017]: pgmap v554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:02.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:01 smithi033 ceph-mon[101165]: pgmap v555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:02.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:01 smithi037 ceph-mon[69017]: pgmap v555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:03 smithi033 ceph-mon[101165]: pgmap v556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:04.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:03 smithi037 ceph-mon[69017]: pgmap v556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:05 smithi033 ceph-mon[101165]: pgmap v557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:06.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:05 smithi037 ceph-mon[69017]: pgmap v557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:07 smithi033 ceph-mon[101165]: pgmap v558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:08.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:07 smithi037 ceph-mon[69017]: pgmap v558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:08.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- 172.21.15.33:0/2646372347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 msgr2=0x7f96180f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 --2- 172.21.15.33:0/2646372347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f96180f6cc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f9608004660 tx=0x7f9608009b30).stop 2022-02-02T13:58:08.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- 172.21.15.33:0/2646372347 shutdown_connections 2022-02-02T13:58:08.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 --2- 172.21.15.33:0/2646372347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f96180f6cc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 --2- 172.21.15.33:0/2646372347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f96180f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- 172.21.15.33:0/2646372347 >> 172.21.15.33:0/2646372347 conn(0x7f96180f0d40 msgr2=0x7f96180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:08.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- 172.21.15.33:0/2646372347 shutdown_connections 2022-02-02T13:58:08.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- 172.21.15.33:0/2646372347 wait complete. 2022-02-02T13:58:08.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 Processor -- start 2022-02-02T13:58:08.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.332+0000 7f9620727700 1 -- start start 2022-02-02T13:58:08.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f9620727700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f961810c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f9620727700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f9620727700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180602b0 con 0x7f96180f6860 2022-02-02T13:58:08.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f9620727700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180603f0 con 0x7f96180f55c0 2022-02-02T13:58:08.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58938/0 (socket says 172.21.15.33:58938) 2022-02-02T13:58:08.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 -- 172.21.15.33:0/1646302376 learned_addr learned my addr 172.21.15.33:0/1646302376 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:08.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961e4c3700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f961810c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 -- 172.21.15.33:0/1646302376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 msgr2=0x7f961810c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f961810c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 -- 172.21.15.33:0/1646302376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608005040 con 0x7f96180f6860 2022-02-02T13:58:08.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961e4c3700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f961810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:58:08.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.333+0000 7f961dcc2700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f9608009990 tx=0x7f9608009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.334+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608018070 con 0x7f96180f6860 2022-02-02T13:58:08.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.334+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961810ea60 con 0x7f96180f6860 2022-02-02T13:58:08.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.334+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9608007ba0 con 0x7f96180f6860 2022-02-02T13:58:08.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.334+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960801c3c0 con 0x7f96180f6860 2022-02-02T13:58:08.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.334+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961810ee30 con 0x7f96180f6860 2022-02-02T13:58:08.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.335+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9618045ad0 con 0x7f96180f6860 2022-02-02T13:58:08.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.335+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f960801d420 con 0x7f96180f6860 2022-02-02T13:58:08.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.335+0000 7f960effd700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 0x7f9604067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.336+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f96080836f0 con 0x7f96180f6860 2022-02-02T13:58:08.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.336+0000 7f961e4c3700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 0x7f9604067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.336+0000 7f961e4c3700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 0x7f9604067290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9618060040 tx=0x7f961400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.340+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9608051860 con 0x7f96180f6860 2022-02-02T13:58:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.528+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9618057f10 con 0x7f9604064dd0 2022-02-02T13:58:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.529+0000 7f960effd700 1 -- 172.21.15.33:0/1646302376 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9618057f10 con 0x7f9604064dd0 2022-02-02T13:58:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 msgr2=0x7f9604067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 0x7f9604067290 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f9618060040 tx=0x7f961400b040).stop 2022-02-02T13:58:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 msgr2=0x7f961810e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f9608009990 tx=0x7f9608009b30).stop 2022-02-02T13:58:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 shutdown_connections 2022-02-02T13:58:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9604064dd0 0x7f9604067290 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96180f55c0 0x7f961810c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 --2- 172.21.15.33:0/1646302376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96180f6860 0x7f961810e570 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 >> 172.21.15.33:0/1646302376 conn(0x7f96180f0d40 msgr2=0x7f96180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 shutdown_connections 2022-02-02T13:58:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.531+0000 7f9620727700 1 -- 172.21.15.33:0/1646302376 wait complete. 2022-02-02T13:58:08.541 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:58:08.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- 172.21.15.33:0/1243417045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 msgr2=0x7f428c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 --2- 172.21.15.33:0/1243417045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c0f6cc0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f4288004660 tx=0x7f4288009b30).stop 2022-02-02T13:58:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- 172.21.15.33:0/1243417045 shutdown_connections 2022-02-02T13:58:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 --2- 172.21.15.33:0/1243417045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c0f6cc0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 --2- 172.21.15.33:0/1243417045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 0x7f428c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- 172.21.15.33:0/1243417045 >> 172.21.15.33:0/1243417045 conn(0x7f428c0f0d40 msgr2=0x7f428c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:08.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- 172.21.15.33:0/1243417045 shutdown_connections 2022-02-02T13:58:08.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- 172.21.15.33:0/1243417045 wait complete. 2022-02-02T13:58:08.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 Processor -- start 2022-02-02T13:58:08.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.633+0000 7f42934e6700 1 -- start start 2022-02-02T13:58:08.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f42934e6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 0x7f428c109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f42934e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f42934e6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0603e0 con 0x7f428c0f6860 2022-02-02T13:58:08.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f42934e6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c060520 con 0x7f428c0f55c0 2022-02-02T13:58:08.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58948/0 (socket says 172.21.15.33:58948) 2022-02-02T13:58:08.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 -- 172.21.15.33:0/615215922 learned_addr learned my addr 172.21.15.33:0/615215922 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:08.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4291282700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 0x7f428c109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 -- 172.21.15.33:0/615215922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 msgr2=0x7f428c109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 0x7f428c109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 -- 172.21.15.33:0/615215922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4288005040 con 0x7f428c0f6860 2022-02-02T13:58:08.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.634+0000 7f4290a81700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4288009990 tx=0x7f4288009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.635+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4288018070 con 0x7f428c0f6860 2022-02-02T13:58:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.635+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4288007ba0 con 0x7f428c0f6860 2022-02-02T13:58:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.635+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c10c6a0 con 0x7f428c0f6860 2022-02-02T13:58:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.635+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f428801c3c0 con 0x7f428c0f6860 2022-02-02T13:58:08.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.635+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c10cc00 con 0x7f428c0f6860 2022-02-02T13:58:08.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.637+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c045ad0 con 0x7f428c0f6860 2022-02-02T13:58:08.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.637+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f428801d420 con 0x7f428c0f6860 2022-02-02T13:58:08.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.637+0000 7f4281ffb700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 0x7f4278067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.637+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4288083270 con 0x7f428c0f6860 2022-02-02T13:58:08.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.638+0000 7f4291282700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 0x7f4278067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.638+0000 7f4291282700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 0x7f4278067290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f428c060060 tx=0x7f427c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.642+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4288051320 con 0x7f428c0f6860 2022-02-02T13:58:08.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.823+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f428c0fde90 con 0x7f4278064dd0 2022-02-02T13:58:08.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.837+0000 7f4281ffb700 1 -- 172.21.15.33:0/615215922 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f428c0fde90 con 0x7f4278064dd0 2022-02-02T13:58:08.837 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:58:08.838 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (23m) 5m ago 24m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:58:08.838 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (16m) 5m ago 24m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:58:08.838 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (16m) 5m ago 23m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:58:08.838 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (23m) 5m ago 24m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:58:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (16m) 5m ago 20m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:58:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (17m) 5m ago 20m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:58:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (18m) 5m ago 20m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:58:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (20m) 5m ago 20m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:58:08.839 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (18m) 5m ago 25m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:58:08.840 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (17m) 5m ago 23m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:58:08.840 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (17m) 5m ago 25m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:58:08.840 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (17m) 5m ago 23m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:58:08.840 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (24m) 5m ago 24m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:58:08.841 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (23m) 5m ago 23m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:58:08.841 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 23m - 4096M 2022-02-02T13:58:08.841 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (22m) 5m ago 22m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:58:08.841 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (22m) 5m ago 22m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:58:08.842 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (22m) 5m ago 22m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:58:08.842 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (22m) 5m ago 22m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:58:08.842 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (21m) 5m ago 21m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:58:08.842 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (23m) 5m ago 24m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:58:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 msgr2=0x7f4278067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 0x7f4278067290 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f428c060060 tx=0x7f427c00b040).stop 2022-02-02T13:58:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 msgr2=0x7f428c10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f4288009990 tx=0x7f4288009b30).stop 2022-02-02T13:58:08.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 shutdown_connections 2022-02-02T13:58:08.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4278064dd0 0x7f4278067290 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0f55c0 0x7f428c109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 --2- 172.21.15.33:0/615215922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f428c0f6860 0x7f428c10c150 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.839+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 >> 172.21.15.33:0/615215922 conn(0x7f428c0f0d40 msgr2=0x7f428c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:08.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.840+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 shutdown_connections 2022-02-02T13:58:08.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.840+0000 7f42934e6700 1 -- 172.21.15.33:0/615215922 wait complete. 2022-02-02T13:58:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.939+0000 7f95a70a7700 1 -- 172.21.15.33:0/198552549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f66d0 msgr2=0x7f95a00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.939+0000 7f95a70a7700 1 --2- 172.21.15.33:0/198552549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f66d0 0x7f95a00f6b30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9590004660 tx=0x7f9590009b30).stop 2022-02-02T13:58:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 -- 172.21.15.33:0/198552549 shutdown_connections 2022-02-02T13:58:08.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 --2- 172.21.15.33:0/198552549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f66d0 0x7f95a00f6b30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 --2- 172.21.15.33:0/198552549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f5430 0x7f95a00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 -- 172.21.15.33:0/198552549 >> 172.21.15.33:0/198552549 conn(0x7f95a00f0b90 msgr2=0x7f95a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:08.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 -- 172.21.15.33:0/198552549 shutdown_connections 2022-02-02T13:58:08.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 -- 172.21.15.33:0/198552549 wait complete. 2022-02-02T13:58:08.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 Processor -- start 2022-02-02T13:58:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.940+0000 7f95a70a7700 1 -- start start 2022-02-02T13:58:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0106670 con 0x7f95a00f5430 2022-02-02T13:58:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01067b0 con 0x7f95a00f66d0 2022-02-02T13:58:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58956/0 (socket says 172.21.15.33:58956) 2022-02-02T13:58:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 -- 172.21.15.33:0/2156470444 learned_addr learned my addr 172.21.15.33:0/2156470444 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:08.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a58a4700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 -- 172.21.15.33:0/2156470444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 msgr2=0x7f95a01060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:08.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:08.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 -- 172.21.15.33:0/2156470444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590005040 con 0x7f95a00f5430 2022-02-02T13:58:08.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a58a4700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:58:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a60a5700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f959c00e7c0 tx=0x7f959c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c0092e0 con 0x7f95a00f5430 2022-02-02T13:58:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a0107150 con 0x7f95a00f5430 2022-02-02T13:58:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f959c00f040 con 0x7f95a00f5430 2022-02-02T13:58:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c014750 con 0x7f95a00f5430 2022-02-02T13:58:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.941+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a0107710 con 0x7f95a00f5430 2022-02-02T13:58:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.942+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0045ad0 con 0x7f95a00f5430 2022-02-02T13:58:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.943+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f959c01b030 con 0x7f95a00f5430 2022-02-02T13:58:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.943+0000 7f9596ffd700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 0x7f958c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.943+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f959c081920 con 0x7f95a00f5430 2022-02-02T13:58:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.944+0000 7f95a58a4700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 0x7f958c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.944+0000 7f95a58a4700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 0x7f958c0672e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f95900043d0 tx=0x7f959000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:08.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:08.948+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f959c0534b0 con 0x7f95a00f5430 2022-02-02T13:58:09.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.189+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95a00008d0 con 0x7f95a00f5430 2022-02-02T13:58:09.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.190+0000 7f9596ffd700 1 -- 172.21.15.33:0/2156470444 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f959c0530a0 con 0x7f95a00f5430 2022-02-02T13:58:09.190 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:58:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:58:09.190 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:58:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:58:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:58:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:09.191 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:58:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:58:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:58:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:58:09.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:58:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:58:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:58:09.193 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:58:09.194 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:58:09.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.191+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 msgr2=0x7f958c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.191+0000 7f95a70a7700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 0x7f958c0672e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f95900043d0 tx=0x7f959000b040).stop 2022-02-02T13:58:09.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.191+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 msgr2=0x7f95a0105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.191+0000 7f95a70a7700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f959c00e7c0 tx=0x7f959c00b040).stop 2022-02-02T13:58:09.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 shutdown_connections 2022-02-02T13:58:09.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f958c064e20 0x7f958c0672e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95a00f5430 0x7f95a0105bd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 --2- 172.21.15.33:0/2156470444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00f66d0 0x7f95a01060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 >> 172.21.15.33:0/2156470444 conn(0x7f95a00f0b90 msgr2=0x7f95a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:09.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 shutdown_connections 2022-02-02T13:58:09.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.192+0000 7f95a70a7700 1 -- 172.21.15.33:0/2156470444 wait complete. 2022-02-02T13:58:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 -- 172.21.15.33:0/1541531495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f7980 msgr2=0x7f5b180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/1541531495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f7980 0x7f5b180f7de0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f5b08004660 tx=0x7f5b08009b30).stop 2022-02-02T13:58:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 -- 172.21.15.33:0/1541531495 shutdown_connections 2022-02-02T13:58:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/1541531495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f7980 0x7f5b180f7de0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/1541531495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f66e0 0x7f5b180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 -- 172.21.15.33:0/1541531495 >> 172.21.15.33:0/1541531495 conn(0x7f5b180f1e40 msgr2=0x7f5b180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 -- 172.21.15.33:0/1541531495 shutdown_connections 2022-02-02T13:58:09.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.304+0000 7f5b1f98a700 1 -- 172.21.15.33:0/1541531495 wait complete. 2022-02-02T13:58:09.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 Processor -- start 2022-02-02T13:58:09.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 -- start start 2022-02-02T13:58:09.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:09.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 0x7f5b18107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:09.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18107a00 con 0x7f5b180f66e0 2022-02-02T13:58:09.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1f98a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18107b40 con 0x7f5b180f7980 2022-02-02T13:58:09.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1d726700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:09.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.305+0000 7f5b1d726700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58966/0 (socket says 172.21.15.33:58966) 2022-02-02T13:58:09.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1d726700 1 -- 172.21.15.33:0/3096790848 learned_addr learned my addr 172.21.15.33:0/3096790848 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:09.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1cf25700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 0x7f5b18107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:09.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1cf25700 1 -- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 msgr2=0x7f5b18106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1cf25700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1cf25700 1 -- 172.21.15.33:0/3096790848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08005040 con 0x7f5b180f7980 2022-02-02T13:58:09.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1d726700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:58:09.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1cf25700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 0x7f5b18107450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f5b08009830 tx=0x7f5b08009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:09.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b08018070 con 0x7f5b180f7980 2022-02-02T13:58:09.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b08007ba0 con 0x7f5b180f7980 2022-02-02T13:58:09.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18108480 con 0x7f5b180f7980 2022-02-02T13:58:09.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.306+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0801de60 con 0x7f5b180f7980 2022-02-02T13:58:09.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.307+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b181089e0 con 0x7f5b180f7980 2022-02-02T13:58:09.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.307+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18045ad0 con 0x7f5b180f7980 2022-02-02T13:58:09.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.308+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b08007d10 con 0x7f5b180f7980 2022-02-02T13:58:09.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.308+0000 7f5b0dffb700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 0x7f5b04067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:09.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.308+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5b08083590 con 0x7f5b180f7980 2022-02-02T13:58:09.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.308+0000 7f5b1d726700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 0x7f5b04067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:09.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.309+0000 7f5b1d726700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 0x7f5b04067270 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5b140102e0 tx=0x7f5b1400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:09.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.313+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b080550d0 con 0x7f5b180f7980 2022-02-02T13:58:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.531+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5b180ff020 con 0x7f5b180f7980 2022-02-02T13:58:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.532+0000 7f5b0dffb700 1 -- 172.21.15.33:0/3096790848 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f5b08054cc0 con 0x7f5b180f7980 2022-02-02T13:58:09.532 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:58:09.532 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:58:09.533 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:58:09.533 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:58:09.533 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:09.534 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:58:09.534 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:58:09.534 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:58:09.534 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:58:09.535 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:58:09.535 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:58:09.535 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:58:09.535 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:58:09.535 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:58:09.536 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:58:09.536 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:58:09.536 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:58:09.536 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:58:09.537 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:58:09.537 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:58:09.537 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:58:09.537 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:58:09.537 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:58:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:58:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:58:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:58:09.538 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:58:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:58:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:58:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:58:09.539 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:58:09.540 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:09.540 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:09.540 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:58:09.540 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:09.541 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:09.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 msgr2=0x7f5b04067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 0x7f5b04067270 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5b140102e0 tx=0x7f5b1400b040).stop 2022-02-02T13:58:09.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 msgr2=0x7f5b18107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 0x7f5b18107450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f5b08009830 tx=0x7f5b08009b30).stop 2022-02-02T13:58:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 shutdown_connections 2022-02-02T13:58:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b04064db0 0x7f5b04067270 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b180f66e0 0x7f5b18106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 --2- 172.21.15.33:0/3096790848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b180f7980 0x7f5b18107450 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 >> 172.21.15.33:0/3096790848 conn(0x7f5b180f1e40 msgr2=0x7f5b180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:09.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 shutdown_connections 2022-02-02T13:58:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:09.534+0000 7f5b1f98a700 1 -- 172.21.15.33:0/3096790848 wait complete. 2022-02-02T13:58:09.546 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:58:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:09 smithi033 ceph-mon[101165]: pgmap v559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:09 smithi033 ceph-mon[101165]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:09 smithi033 ceph-mon[101165]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2156470444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:58:10.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3096790848' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:58:10.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:09 smithi037 ceph-mon[69017]: pgmap v559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:09 smithi037 ceph-mon[69017]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:09 smithi037 ceph-mon[69017]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2156470444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:58:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3096790848' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:58:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:11 smithi033 ceph-mon[101165]: pgmap v560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:12.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:11 smithi037 ceph-mon[69017]: pgmap v560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:13 smithi033 ceph-mon[101165]: pgmap v561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:14.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:13 smithi037 ceph-mon[69017]: pgmap v561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:15 smithi033 ceph-mon[101165]: pgmap v562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:15 smithi037 ceph-mon[69017]: pgmap v562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:58:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:58:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:58:17.244 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:58:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:58:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:58:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:58:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:58:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:17 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:58:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:17 smithi033 ceph-mon[101165]: pgmap v563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:17 smithi033 ceph-mon[101165]: pgmap v564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:17 smithi033 ceph-mon[101165]: pgmap v565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:17 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:58:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:17 smithi037 ceph-mon[69017]: pgmap v563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:17 smithi037 ceph-mon[69017]: pgmap v564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:17 smithi037 ceph-mon[69017]: pgmap v565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:19 smithi033 ceph-mon[101165]: pgmap v566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:20.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:19 smithi037 ceph-mon[69017]: pgmap v566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:21 smithi033 ceph-mon[101165]: pgmap v567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:22.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:21 smithi037 ceph-mon[69017]: pgmap v567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:23 smithi033 ceph-mon[101165]: pgmap v568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:23 smithi037 ceph-mon[69017]: pgmap v568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:25 smithi033 ceph-mon[101165]: pgmap v569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:25 smithi037 ceph-mon[69017]: pgmap v569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:27 smithi033 ceph-mon[101165]: pgmap v570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:27 smithi037 ceph-mon[69017]: pgmap v570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:29 smithi033 ceph-mon[101165]: pgmap v571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:30.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:29 smithi037 ceph-mon[69017]: pgmap v571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:31 smithi033 ceph-mon[101165]: pgmap v572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:32.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:31 smithi037 ceph-mon[69017]: pgmap v572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:33 smithi033 ceph-mon[101165]: pgmap v573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:34.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:33 smithi037 ceph-mon[69017]: pgmap v573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:35 smithi033 ceph-mon[101165]: pgmap v574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:36.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:35 smithi037 ceph-mon[69017]: pgmap v574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:37 smithi033 ceph-mon[101165]: pgmap v575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:38.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:37 smithi037 ceph-mon[69017]: pgmap v575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 -- 172.21.15.33:0/2029119059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f55c0 msgr2=0x7f04880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 --2- 172.21.15.33:0/2029119059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f55c0 0x7f04880f59e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f0478004660 tx=0x7f0478009b30).stop 2022-02-02T13:58:39.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 -- 172.21.15.33:0/2029119059 shutdown_connections 2022-02-02T13:58:39.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 --2- 172.21.15.33:0/2029119059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f6860 0x7f04880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 --2- 172.21.15.33:0/2029119059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f55c0 0x7f04880f59e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 -- 172.21.15.33:0/2029119059 >> 172.21.15.33:0/2029119059 conn(0x7f04880f0d40 msgr2=0x7f04880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:39.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 -- 172.21.15.33:0/2029119059 shutdown_connections 2022-02-02T13:58:39.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.649+0000 7f048fd91700 1 -- 172.21.15.33:0/2029119059 wait complete. 2022-02-02T13:58:39.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 Processor -- start 2022-02-02T13:58:39.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 -- start start 2022-02-02T13:58:39.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 0x7f0488106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488107990 con 0x7f04880f6860 2022-02-02T13:58:39.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048fd91700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488107ad0 con 0x7f04880f55c0 2022-02-02T13:58:39.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048d32c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048d32c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58978/0 (socket says 172.21.15.33:58978) 2022-02-02T13:58:39.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.650+0000 7f048d32c700 1 -- 172.21.15.33:0/173863867 learned_addr learned my addr 172.21.15.33:0/173863867 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:39.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048db2d700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 0x7f0488106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048d32c700 1 -- 172.21.15.33:0/173863867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 msgr2=0x7f0488106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048d32c700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 0x7f0488106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048d32c700 1 -- 172.21.15.33:0/173863867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478005040 con 0x7f04880f6860 2022-02-02T13:58:39.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048db2d700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 0x7f0488106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T13:58:39.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048d32c700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f048400e7f0 tx=0x7f048400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:39.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04840092e0 con 0x7f04880f6860 2022-02-02T13:58:39.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f048400f040 con 0x7f04880f6860 2022-02-02T13:58:39.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0488108470 con 0x7f04880f6860 2022-02-02T13:58:39.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0484014750 con 0x7f04880f6860 2022-02-02T13:58:39.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.651+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0488108a30 con 0x7f04880f6860 2022-02-02T13:58:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.652+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0488045ad0 con 0x7f04880f6860 2022-02-02T13:58:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.653+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f048401b030 con 0x7f04880f6860 2022-02-02T13:58:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.653+0000 7f047e7fc700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 0x7f0474067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.653+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0484081830 con 0x7f04880f6860 2022-02-02T13:58:39.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.653+0000 7f048db2d700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 0x7f0474067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.654+0000 7f048db2d700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 0x7f0474067290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0478005010 tx=0x7f047800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:39.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.658+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f04840533c0 con 0x7f04880f6860 2022-02-02T13:58:39.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.846+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f04880faca0 con 0x7f0474064dd0 2022-02-02T13:58:39.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.847+0000 7f047e7fc700 1 -- 172.21.15.33:0/173863867 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f04880faca0 con 0x7f0474064dd0 2022-02-02T13:58:39.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 msgr2=0x7f0474067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 0x7f0474067290 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0478005010 tx=0x7f047800b040).stop 2022-02-02T13:58:39.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 msgr2=0x7f04881073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f048400e7f0 tx=0x7f048400b040).stop 2022-02-02T13:58:39.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 shutdown_connections 2022-02-02T13:58:39.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0474064dd0 0x7f0474067290 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04880f55c0 0x7f0488106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 --2- 172.21.15.33:0/173863867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04880f6860 0x7f04881073e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 >> 172.21.15.33:0/173863867 conn(0x7f04880f0d40 msgr2=0x7f048805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:39.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 shutdown_connections 2022-02-02T13:58:39.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.849+0000 7f048fd91700 1 -- 172.21.15.33:0/173863867 wait complete. 2022-02-02T13:58:39.858 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:58:39.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 -- 172.21.15.33:0/682304649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 msgr2=0x7f9b440f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 --2- 172.21.15.33:0/682304649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b440f6920 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f9b2c004660 tx=0x7f9b2c009b30).stop 2022-02-02T13:58:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 -- 172.21.15.33:0/682304649 shutdown_connections 2022-02-02T13:58:39.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 --2- 172.21.15.33:0/682304649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b440f6920 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 --2- 172.21.15.33:0/682304649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 0x7f9b440f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 -- 172.21.15.33:0/682304649 >> 172.21.15.33:0/682304649 conn(0x7f9b440f0de0 msgr2=0x7f9b440f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 -- 172.21.15.33:0/682304649 shutdown_connections 2022-02-02T13:58:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.951+0000 7f9b49633700 1 -- 172.21.15.33:0/682304649 wait complete. 2022-02-02T13:58:39.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 Processor -- start 2022-02-02T13:58:39.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 -- start start 2022-02-02T13:58:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 0x7f9b4410c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440603d0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.952+0000 7f9b49633700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b44060510 con 0x7f9b440f55e0 2022-02-02T13:58:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58988/0 (socket says 172.21.15.33:58988) 2022-02-02T13:58:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 -- 172.21.15.33:0/735225735 learned_addr learned my addr 172.21.15.33:0/735225735 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b42ffd700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 0x7f9b4410c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 -- 172.21.15.33:0/735225735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 msgr2=0x7f9b4410c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:39.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 0x7f9b4410c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:39.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 -- 172.21.15.33:0/735225735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c005040 con 0x7f9b440f5ef0 2022-02-02T13:58:39.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b427fc700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9b2c009990 tx=0x7f9b2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:39.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2c018070 con 0x7f9b440f5ef0 2022-02-02T13:58:39.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4410eaa0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b2c007ba0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b2c01c620 con 0x7f9b440f5ef0 2022-02-02T13:58:39.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.953+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4410ee70 con 0x7f9b440f5ef0 2022-02-02T13:58:39.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.954+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b44045ad0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.955+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b2c01c8e0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.956+0000 7f9b3b7fe700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 0x7f9b30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.956+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9b2c083ae0 con 0x7f9b440f5ef0 2022-02-02T13:58:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.956+0000 7f9b42ffd700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 0x7f9b30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:39.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.956+0000 7f9b42ffd700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 0x7f9b30067290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b340041d0 tx=0x7f9b34009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:39.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:39.959+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b2c051c50 con 0x7f9b440f5ef0 2022-02-02T13:58:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.141+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b44057f10 con 0x7f9b30064dd0 2022-02-02T13:58:40.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.155+0000 7f9b3b7fe700 1 -- 172.21.15.33:0/735225735 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9b44057f10 con 0x7f9b30064dd0 2022-02-02T13:58:40.155 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:58:40.156 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (23m) 6m ago 24m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:58:40.156 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (16m) 6m ago 24m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:58:40.156 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (16m) 6m ago 24m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:58:40.156 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (23m) 6m ago 24m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:58:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (17m) 6m ago 21m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:58:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (18m) 6m ago 21m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:58:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (18m) 6m ago 21m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:58:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (21m) 6m ago 21m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:58:40.157 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (18m) 6m ago 26m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:58:40.158 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (18m) 6m ago 24m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:58:40.158 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (17m) 6m ago 26m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:58:40.158 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (17m) 6m ago 24m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:58:40.158 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (24m) 6m ago 24m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:58:40.159 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (24m) 6m ago 24m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:58:40.159 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 23m - 4096M 2022-02-02T13:58:40.159 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (23m) 6m ago 23m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:58:40.159 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (23m) 6m ago 23m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:58:40.159 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (22m) 6m ago 22m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:58:40.160 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (22m) 6m ago 22m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:58:40.160 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (22m) 6m ago 22m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:58:40.160 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (23m) 6m ago 24m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:58:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 msgr2=0x7f9b30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 0x7f9b30067290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f9b340041d0 tx=0x7f9b34009040).stop 2022-02-02T13:58:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 msgr2=0x7f9b4410e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f9b2c009990 tx=0x7f9b2c009b30).stop 2022-02-02T13:58:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 shutdown_connections 2022-02-02T13:58:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b30064dd0 0x7f9b30067290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b440f55e0 0x7f9b4410c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 --2- 172.21.15.33:0/735225735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b440f5ef0 0x7f9b4410e5b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.157+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 >> 172.21.15.33:0/735225735 conn(0x7f9b440f0de0 msgr2=0x7f9b440fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:40.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.158+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 shutdown_connections 2022-02-02T13:58:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.158+0000 7f9b49633700 1 -- 172.21.15.33:0/735225735 wait complete. 2022-02-02T13:58:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:39 smithi033 ceph-mon[101165]: pgmap v576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 -- 172.21.15.33:0/1857983927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 msgr2=0x7f986c0f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 --2- 172.21.15.33:0/1857983927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c0f6ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f9854004660 tx=0x7f9854009b30).stop 2022-02-02T13:58:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 -- 172.21.15.33:0/1857983927 shutdown_connections 2022-02-02T13:58:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 --2- 172.21.15.33:0/1857983927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c0f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 --2- 172.21.15.33:0/1857983927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c0f6ac0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 -- 172.21.15.33:0/1857983927 >> 172.21.15.33:0/1857983927 conn(0x7f986c0f1e00 msgr2=0x7f986c0f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 -- 172.21.15.33:0/1857983927 shutdown_connections 2022-02-02T13:58:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.259+0000 7f98714f0700 1 -- 172.21.15.33:0/1857983927 wait complete. 2022-02-02T13:58:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 Processor -- start 2022-02-02T13:58:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 -- start start 2022-02-02T13:58:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c1073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c107970 con 0x7f986c0f66a0 2022-02-02T13:58:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f98714f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c107ab0 con 0x7f986c0f7940 2022-02-02T13:58:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58996/0 (socket says 172.21.15.33:58996) 2022-02-02T13:58:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 -- 172.21.15.33:0/2889872568 learned_addr learned my addr 172.21.15.33:0/2889872568 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986a7fc700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c1073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 -- 172.21.15.33:0/2889872568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 msgr2=0x7f986c1073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c1073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 -- 172.21.15.33:0/2889872568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854005040 con 0x7f986c0f66a0 2022-02-02T13:58:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986a7fc700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:58:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.260+0000 7f986affd700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f9854000c00 tx=0x7f9854009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.261+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9854018070 con 0x7f986c0f66a0 2022-02-02T13:58:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.261+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c1083f0 con 0x7f986c0f66a0 2022-02-02T13:58:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.261+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9854007d70 con 0x7f986c0f66a0 2022-02-02T13:58:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.261+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985401c620 con 0x7f986c0f66a0 2022-02-02T13:58:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.261+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c108950 con 0x7f986c0f66a0 2022-02-02T13:58:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.262+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9850004fa0 con 0x7f986c0f66a0 2022-02-02T13:58:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.262+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f985401c860 con 0x7f986c0f66a0 2022-02-02T13:58:40.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.263+0000 7f98637fe700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 0x7f98580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.263+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9854083810 con 0x7f986c0f66a0 2022-02-02T13:58:40.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.263+0000 7f986a7fc700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 0x7f98580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.263+0000 7f986a7fc700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 0x7f98580672e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f985c0041d0 tx=0x7f985c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:40.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.267+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f98540553b0 con 0x7f986c0f66a0 2022-02-02T13:58:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:39 smithi037 ceph-mon[69017]: pgmap v576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.513+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9850005e80 con 0x7f986c0f66a0 2022-02-02T13:58:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.514+0000 7f98637fe700 1 -- 172.21.15.33:0/2889872568 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9854054fa0 con 0x7f986c0f66a0 2022-02-02T13:58:40.515 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:58:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:58:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:58:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:40.515 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:58:40.516 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:58:40.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:40.516 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:58:40.516 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:58:40.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:40.517 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:58:40.517 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:58:40.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:58:40.520 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:58:40.520 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:58:40.520 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:58:40.521 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:58:40.521 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:58:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 msgr2=0x7f98580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 0x7f98580672e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f985c0041d0 tx=0x7f985c009040).stop 2022-02-02T13:58:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 msgr2=0x7f986c106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f9854000c00 tx=0x7f9854009b30).stop 2022-02-02T13:58:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 shutdown_connections 2022-02-02T13:58:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9858064e20 0x7f98580672e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f986c0f66a0 0x7f986c106ed0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 --2- 172.21.15.33:0/2889872568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986c0f7940 0x7f986c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 >> 172.21.15.33:0/2889872568 conn(0x7f986c0f1e00 msgr2=0x7f986c0fb390 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 shutdown_connections 2022-02-02T13:58:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.516+0000 7f98714f0700 1 -- 172.21.15.33:0/2889872568 wait complete. 2022-02-02T13:58:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 -- 172.21.15.33:0/525295104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f55c0 msgr2=0x7fc0b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/525295104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f55c0 0x7fc0b80f59e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7fc0a8004660 tx=0x7fc0a8009b30).stop 2022-02-02T13:58:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 -- 172.21.15.33:0/525295104 shutdown_connections 2022-02-02T13:58:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/525295104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f6860 0x7fc0b80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/525295104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f55c0 0x7fc0b80f59e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 -- 172.21.15.33:0/525295104 >> 172.21.15.33:0/525295104 conn(0x7fc0b80f0d20 msgr2=0x7fc0b80f3140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 -- 172.21.15.33:0/525295104 shutdown_connections 2022-02-02T13:58:40.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.617+0000 7fc0bf4da700 1 -- 172.21.15.33:0/525295104 wait complete. 2022-02-02T13:58:40.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 Processor -- start 2022-02-02T13:58:40.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 -- start start 2022-02-02T13:58:40.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f55c0 0x7fc0b81091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8109c60 con 0x7fc0b80f6860 2022-02-02T13:58:40.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bf4da700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b8109da0 con 0x7fc0b80f55c0 2022-02-02T13:58:40.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bca75700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bca75700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59008/0 (socket says 172.21.15.33:59008) 2022-02-02T13:58:40.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bca75700 1 -- 172.21.15.33:0/2134029546 learned_addr learned my addr 172.21.15.33:0/2134029546 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:58:40.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.618+0000 7fc0bd276700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f55c0 0x7fc0b81091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bca75700 1 -- 172.21.15.33:0/2134029546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f55c0 msgr2=0x7fc0b81091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bca75700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f55c0 0x7fc0b81091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bca75700 1 -- 172.21.15.33:0/2134029546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8005040 con 0x7fc0b80f6860 2022-02-02T13:58:40.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bca75700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc0b400c530 tx=0x7fc0b4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:40.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0b400f650 con 0x7fc0b80f6860 2022-02-02T13:58:40.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b810a740 con 0x7fc0b80f6860 2022-02-02T13:58:40.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0b400fc60 con 0x7fc0b80f6860 2022-02-02T13:58:40.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0b4012cd0 con 0x7fc0b80f6860 2022-02-02T13:58:40.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.619+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b810ad00 con 0x7fc0b80f6860 2022-02-02T13:58:40.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.620+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b8045ad0 con 0x7fc0b80f6860 2022-02-02T13:58:40.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.621+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc0b4010070 con 0x7fc0b80f6860 2022-02-02T13:58:40.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.621+0000 7fc0adffb700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 0x7fc0a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:58:40.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.621+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc0b4081800 con 0x7fc0b80f6860 2022-02-02T13:58:40.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.621+0000 7fc0bd276700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 0x7fc0a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:58:40.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.622+0000 7fc0bd276700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 0x7fc0a4067290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fc0a8004e30 tx=0x7fc0a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:58:40.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.625+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc0b40532e0 con 0x7fc0b80f6860 2022-02-02T13:58:40.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.837+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc0b810b340 con 0x7fc0b80f6860 2022-02-02T13:58:40.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.838+0000 7fc0adffb700 1 -- 172.21.15.33:0/2134029546 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc0b4052ed0 con 0x7fc0b80f6860 2022-02-02T13:58:40.838 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:58:40.838 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:58:40.838 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:58:40.839 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:58:40.839 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:40.839 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:58:40.839 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:58:40.839 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:58:40.840 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:58:40.840 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:58:40.840 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:58:40.840 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:58:40.841 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:58:40.841 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:58:40.841 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:58:40.841 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:58:40.841 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:58:40.842 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:58:40.842 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:58:40.842 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:58:40.843 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:58:40.843 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:58:40.843 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:58:40.843 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:58:40.843 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:58:40.844 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:58:40.844 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:58:40.844 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:58:40.844 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:58:40.845 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:58:40.845 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:58:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:40.845 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:40.845 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:58:40.846 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:58:40.846 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:40.846 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:40.846 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:40.847 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:58:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 msgr2=0x7fc0a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 0x7fc0a4067290 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fc0a8004e30 tx=0x7fc0a8009b30).stop 2022-02-02T13:58:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 msgr2=0x7fc0b81096b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:58:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fc0b400c530 tx=0x7fc0b4007e20).stop 2022-02-02T13:58:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 shutdown_connections 2022-02-02T13:58:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0a4064dd0 0x7fc0a4067290 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0b80f55c0 0x7fc0b81091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 --2- 172.21.15.33:0/2134029546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b80f6860 0x7fc0b81096b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:58:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 >> 172.21.15.33:0/2134029546 conn(0x7fc0b80f0d20 msgr2=0x7fc0b805ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:58:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 shutdown_connections 2022-02-02T13:58:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:58:40.840+0000 7fc0bf4da700 1 -- 172.21.15.33:0/2134029546 wait complete. 2022-02-02T13:58:40.850 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:58:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:40 smithi033 ceph-mon[101165]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:40 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2889872568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:58:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:40 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2134029546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:58:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:40 smithi037 ceph-mon[69017]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:40 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2889872568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:58:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:40 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2134029546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:58:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:41 smithi033 ceph-mon[101165]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:41 smithi033 ceph-mon[101165]: pgmap v577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:41 smithi037 ceph-mon[69017]: from='client.34698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:58:42.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:41 smithi037 ceph-mon[69017]: pgmap v577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:43 smithi033 ceph-mon[101165]: pgmap v578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:44.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:43 smithi037 ceph-mon[69017]: pgmap v578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:45 smithi033 ceph-mon[101165]: pgmap v579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:45 smithi037 ceph-mon[69017]: pgmap v579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:48.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:47 smithi033 ceph-mon[101165]: pgmap v580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:47 smithi037 ceph-mon[69017]: pgmap v580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:50.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:49 smithi033 ceph-mon[101165]: pgmap v581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:50.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:49 smithi037 ceph-mon[69017]: pgmap v581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:51 smithi033 ceph-mon[101165]: pgmap v582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:51 smithi037 ceph-mon[69017]: pgmap v582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:54.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:53 smithi033 ceph-mon[101165]: pgmap v583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:54.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:53 smithi037 ceph-mon[69017]: pgmap v583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:58:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:58:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:58:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:58:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:55 smithi033 ceph-mon[101165]: pgmap v584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:55 smithi037 ceph-mon[69017]: pgmap v584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:58.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:57 smithi033 ceph-mon[101165]: pgmap v585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:58:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:57 smithi037 ceph-mon[69017]: pgmap v585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:58:59 smithi033 ceph-mon[101165]: pgmap v586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:58:59 smithi037 ceph-mon[69017]: pgmap v586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:01 smithi033 ceph-mon[101165]: pgmap v587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:02.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:01 smithi037 ceph-mon[69017]: pgmap v587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:04.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:03 smithi033 ceph-mon[101165]: pgmap v588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:04.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:03 smithi037 ceph-mon[69017]: pgmap v588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:05 smithi033 ceph-mon[101165]: pgmap v589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:06.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:05 smithi037 ceph-mon[69017]: pgmap v589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:07 smithi033 ceph-mon[101165]: pgmap v590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:08.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:07 smithi037 ceph-mon[69017]: pgmap v590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:09 smithi033 ceph-mon[101165]: pgmap v591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:10.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:09 smithi037 ceph-mon[69017]: pgmap v591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:10.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2155271290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 msgr2=0x7f0d180f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2155271290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d180f59e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f0d08004660 tx=0x7f0d08009b30).stop 2022-02-02T13:59:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2155271290 shutdown_connections 2022-02-02T13:59:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2155271290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 0x7f0d180f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2155271290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d180f59e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:10.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2155271290 >> 172.21.15.33:0/2155271290 conn(0x7f0d180f0d40 msgr2=0x7f0d180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2155271290 shutdown_connections 2022-02-02T13:59:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.956+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2155271290 wait complete. 2022-02-02T13:59:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 Processor -- start 2022-02-02T13:59:10.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 -- start start 2022-02-02T13:59:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 0x7f0d1810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:10.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180602b0 con 0x7f0d180f55c0 2022-02-02T13:59:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.957+0000 7f0d1ec22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180603f0 con 0x7f0d180f6860 2022-02-02T13:59:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59016/0 (socket says 172.21.15.33:59016) 2022-02-02T13:59:10.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 -- 172.21.15.33:0/2644280227 learned_addr learned my addr 172.21.15.33:0/2644280227 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 0x7f0d1810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 -- 172.21.15.33:0/2644280227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 msgr2=0x7f0d1810e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 0x7f0d1810e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 -- 172.21.15.33:0/2644280227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08005040 con 0x7f0d180f55c0 2022-02-02T13:59:10.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1c9be700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0d08014040 tx=0x7f0d0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:10.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d08019070 con 0x7f0d180f55c0 2022-02-02T13:59:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d08007e70 con 0x7f0d180f55c0 2022-02-02T13:59:10.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d1810ea00 con 0x7f0d180f55c0 2022-02-02T13:59:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.958+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d08014d10 con 0x7f0d180f55c0 2022-02-02T13:59:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.959+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d1810edd0 con 0x7f0d180f55c0 2022-02-02T13:59:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.960+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d18045ad0 con 0x7f0d180f55c0 2022-02-02T13:59:10.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.960+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d08025070 con 0x7f0d180f55c0 2022-02-02T13:59:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.960+0000 7f0d157fa700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 0x7f0d04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.961+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0d08082980 con 0x7f0d180f55c0 2022-02-02T13:59:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.961+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 0x7f0d04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.961+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 0x7f0d04067290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0d00009fd0 tx=0x7f0d0000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:10.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:10.965+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d08050af0 con 0x7f0d180f55c0 2022-02-02T13:59:11.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.155+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d18057f10 con 0x7f0d04064dd0 2022-02-02T13:59:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.156+0000 7f0d157fa700 1 -- 172.21.15.33:0/2644280227 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f0d18057f10 con 0x7f0d04064dd0 2022-02-02T13:59:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 msgr2=0x7f0d04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 0x7f0d04067290 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f0d00009fd0 tx=0x7f0d0000b040).stop 2022-02-02T13:59:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 msgr2=0x7f0d1810c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f0d08014040 tx=0x7f0d0800b040).stop 2022-02-02T13:59:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 shutdown_connections 2022-02-02T13:59:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d04064dd0 0x7f0d04067290 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180f55c0 0x7f0d1810c010 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 --2- 172.21.15.33:0/2644280227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d180f6860 0x7f0d1810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 >> 172.21.15.33:0/2644280227 conn(0x7f0d180f0d40 msgr2=0x7f0d180fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 shutdown_connections 2022-02-02T13:59:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.158+0000 7f0d1ec22700 1 -- 172.21.15.33:0/2644280227 wait complete. 2022-02-02T13:59:11.168 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:59:11.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/3401270573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f6860 msgr2=0x7fd8d80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/3401270573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f6860 0x7fd8d80f6cc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fd8c0004660 tx=0x7fd8c0009b30).stop 2022-02-02T13:59:11.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/3401270573 shutdown_connections 2022-02-02T13:59:11.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/3401270573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f6860 0x7fd8d80f6cc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/3401270573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f55c0 0x7fd8d80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/3401270573 >> 172.21.15.33:0/3401270573 conn(0x7fd8d80f0d40 msgr2=0x7fd8d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/3401270573 shutdown_connections 2022-02-02T13:59:11.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.259+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/3401270573 wait complete. 2022-02-02T13:59:11.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 Processor -- start 2022-02-02T13:59:11.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 -- start start 2022-02-02T13:59:11.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f6860 0x7fd8d810e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80602b0 con 0x7fd8d80f55c0 2022-02-02T13:59:11.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8dd2a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80603f0 con 0x7fd8d80f6860 2022-02-02T13:59:11.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59026/0 (socket says 172.21.15.33:59026) 2022-02-02T13:59:11.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 -- 172.21.15.33:0/251011677 learned_addr learned my addr 172.21.15.33:0/251011677 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:11.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d67fc700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f6860 0x7fd8d810e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 -- 172.21.15.33:0/251011677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f6860 msgr2=0x7fd8d810e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f6860 0x7fd8d810e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.260+0000 7fd8d6ffd700 1 -- 172.21.15.33:0/251011677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0005040 con 0x7fd8d80f55c0 2022-02-02T13:59:11.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8d6ffd700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd8c8002700 tx=0x7fd8c8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c80079c0 con 0x7fd8d80f55c0 2022-02-02T13:59:11.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8c800f040 con 0x7fd8d80f55c0 2022-02-02T13:59:11.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d810ea70 con 0x7fd8d80f55c0 2022-02-02T13:59:11.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c8014860 con 0x7fd8d80f55c0 2022-02-02T13:59:11.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.261+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d810eef0 con 0x7fd8d80f55c0 2022-02-02T13:59:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.262+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d8045ad0 con 0x7fd8d80f55c0 2022-02-02T13:59:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.262+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8c801b060 con 0x7fd8d80f55c0 2022-02-02T13:59:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.263+0000 7fd8cf7fe700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 0x7fd8c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.263+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd8c8081940 con 0x7fd8d80f55c0 2022-02-02T13:59:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.263+0000 7fd8d67fc700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 0x7fd8c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.263+0000 7fd8d67fc700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 0x7fd8c4067290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd8c0004630 tx=0x7fd8c0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.267+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8c804f9f0 con 0x7fd8d80f55c0 2022-02-02T13:59:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.450+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8d8057f10 con 0x7fd8c4064dd0 2022-02-02T13:59:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.464+0000 7fd8cf7fe700 1 -- 172.21.15.33:0/251011677 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd8d8057f10 con 0x7fd8c4064dd0 2022-02-02T13:59:11.465 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:59:11.465 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (24m) 6m ago 25m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:59:11.465 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (17m) 6m ago 25m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:59:11.465 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (17m) 7m ago 24m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:59:11.466 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (24m) 6m ago 25m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:59:11.466 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (17m) 6m ago 21m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:59:11.466 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (18m) 6m ago 21m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:59:11.466 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (19m) 7m ago 21m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:59:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (21m) 7m ago 21m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:59:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (19m) 6m ago 26m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:59:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (18m) 7m ago 24m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:59:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (18m) 6m ago 26m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:59:11.467 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (18m) 7m ago 24m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:59:11.468 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (25m) 6m ago 25m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:59:11.468 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (24m) 7m ago 24m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:59:11.468 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 24m - 4096M 2022-02-02T13:59:11.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (23m) 6m ago 23m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:59:11.469 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (23m) 6m ago 23m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:59:11.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (23m) 7m ago 23m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:59:11.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (23m) 7m ago 23m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:59:11.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (22m) 7m ago 22m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:59:11.470 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (24m) 6m ago 25m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:59:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.466+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 msgr2=0x7fd8c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.466+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 0x7fd8c4067290 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fd8c0004630 tx=0x7fd8c0009b30).stop 2022-02-02T13:59:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 msgr2=0x7fd8d810c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd8c8002700 tx=0x7fd8c8009d80).stop 2022-02-02T13:59:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 shutdown_connections 2022-02-02T13:59:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c4064dd0 0x7fd8c4067290 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8d80f55c0 0x7fd8d810c080 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 --2- 172.21.15.33:0/251011677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d80f6860 0x7fd8d810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 >> 172.21.15.33:0/251011677 conn(0x7fd8d80f0d40 msgr2=0x7fd8d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 shutdown_connections 2022-02-02T13:59:11.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.467+0000 7fd8dd2a1700 1 -- 172.21.15.33:0/251011677 wait complete. 2022-02-02T13:59:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 -- 172.21.15.33:0/1235836684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f7980 msgr2=0x7f57ac0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 --2- 172.21.15.33:0/1235836684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f7980 0x7f57ac0f7de0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f57a8004660 tx=0x7f57a8009b30).stop 2022-02-02T13:59:11.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 -- 172.21.15.33:0/1235836684 shutdown_connections 2022-02-02T13:59:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 --2- 172.21.15.33:0/1235836684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f7980 0x7f57ac0f7de0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 --2- 172.21.15.33:0/1235836684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f66e0 0x7f57ac0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 -- 172.21.15.33:0/1235836684 >> 172.21.15.33:0/1235836684 conn(0x7f57ac0f1e40 msgr2=0x7f57ac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 -- 172.21.15.33:0/1235836684 shutdown_connections 2022-02-02T13:59:11.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.567+0000 7f57b35e7700 1 -- 172.21.15.33:0/1235836684 wait complete. 2022-02-02T13:59:11.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 Processor -- start 2022-02-02T13:59:11.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 -- start start 2022-02-02T13:59:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 0x7f57ac069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06a380 con 0x7f57ac0f66e0 2022-02-02T13:59:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b35e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac06a4c0 con 0x7f57ac0f7980 2022-02-02T13:59:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b1383700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b1383700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59036/0 (socket says 172.21.15.33:59036) 2022-02-02T13:59:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b1383700 1 -- 172.21.15.33:0/511548311 learned_addr learned my addr 172.21.15.33:0/511548311 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b0b82700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 0x7f57ac069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b1383700 1 -- 172.21.15.33:0/511548311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 msgr2=0x7f57ac069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.568+0000 7f57b1383700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 0x7f57ac069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57b1383700 1 -- 172.21.15.33:0/511548311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a8005040 con 0x7f57ac0f66e0 2022-02-02T13:59:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57b0b82700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 0x7f57ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T13:59:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57b1383700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f579c002700 tx=0x7f579c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f579c009320 con 0x7f57ac0f66e0 2022-02-02T13:59:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f579c00f040 con 0x7f57ac0f66e0 2022-02-02T13:59:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac06a7a0 con 0x7f57ac0f66e0 2022-02-02T13:59:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f579c014900 con 0x7f57ac0f66e0 2022-02-02T13:59:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.569+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac10ef90 con 0x7f57ac0f66e0 2022-02-02T13:59:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.570+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac045ad0 con 0x7f57ac0f66e0 2022-02-02T13:59:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.570+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f579c009480 con 0x7f57ac0f66e0 2022-02-02T13:59:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.571+0000 7f57a1ffb700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 0x7f5798067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.571+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f579c081c30 con 0x7f57ac0f66e0 2022-02-02T13:59:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.571+0000 7f57b0b82700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 0x7f5798067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.571+0000 7f57b0b82700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 0x7f5798067290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f57a8009da0 tx=0x7f57a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.575+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f579c04fda0 con 0x7f57ac0f66e0 2022-02-02T13:59:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.818+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57ac0fef70 con 0x7f57ac0f66e0 2022-02-02T13:59:11.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.818+0000 7f57a1ffb700 1 -- 172.21.15.33:0/511548311 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f579c0533c0 con 0x7f57ac0f66e0 2022-02-02T13:59:11.819 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:59:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:59:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:59:11.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:59:11.820 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:59:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:59:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:59:11.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:59:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:59:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:11.822 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:59:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:59:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:59:11.823 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:59:11.823 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:59:11.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 msgr2=0x7f5798067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 0x7f5798067290 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f57a8009da0 tx=0x7f57a8009b30).stop 2022-02-02T13:59:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 msgr2=0x7f57ac06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f579c002700 tx=0x7f579c009d80).stop 2022-02-02T13:59:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 shutdown_connections 2022-02-02T13:59:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5798064dd0 0x7f5798067290 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57ac0f66e0 0x7f57ac06b9a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 --2- 172.21.15.33:0/511548311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57ac0f7980 0x7f57ac069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 >> 172.21.15.33:0/511548311 conn(0x7f57ac0f1e40 msgr2=0x7f57ac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 shutdown_connections 2022-02-02T13:59:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.820+0000 7f57b35e7700 1 -- 172.21.15.33:0/511548311 wait complete. 2022-02-02T13:59:11.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 -- 172.21.15.33:0/438701737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 msgr2=0x7f37c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 --2- 172.21.15.33:0/438701737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c00f6b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f37bc004660 tx=0x7f37bc009b30).stop 2022-02-02T13:59:11.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 -- 172.21.15.33:0/438701737 shutdown_connections 2022-02-02T13:59:11.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 --2- 172.21.15.33:0/438701737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 0x7f37c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 --2- 172.21.15.33:0/438701737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c00f6b00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 -- 172.21.15.33:0/438701737 >> 172.21.15.33:0/438701737 conn(0x7f37c00f1e40 msgr2=0x7f37c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:11.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 -- 172.21.15.33:0/438701737 shutdown_connections 2022-02-02T13:59:11.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 -- 172.21.15.33:0/438701737 wait complete. 2022-02-02T13:59:11.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.922+0000 7f37c83c8700 1 Processor -- start 2022-02-02T13:59:11.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c83c8700 1 -- start start 2022-02-02T13:59:11.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c83c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c83c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 0x7f37c01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c83c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0107a50 con 0x7f37c00f66e0 2022-02-02T13:59:11.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c83c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0107b90 con 0x7f37c00f7980 2022-02-02T13:59:11.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59046/0 (socket says 172.21.15.33:59046) 2022-02-02T13:59:11.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 -- 172.21.15.33:0/3768686097 learned_addr learned my addr 172.21.15.33:0/3768686097 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:11.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c5963700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 0x7f37c01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 -- 172.21.15.33:0/3768686097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 msgr2=0x7f37c01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 0x7f37c01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 -- 172.21.15.33:0/3768686097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc005040 con 0x7f37c00f66e0 2022-02-02T13:59:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37c6164700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f37bc004f60 tx=0x7f37bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.923+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37bc018070 con 0x7f37c00f66e0 2022-02-02T13:59:11.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.924+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37bc007ba0 con 0x7f37c00f66e0 2022-02-02T13:59:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.924+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c01084d0 con 0x7f37c00f66e0 2022-02-02T13:59:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.924+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37bc01c620 con 0x7f37c00f66e0 2022-02-02T13:59:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.924+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0108a30 con 0x7f37c00f66e0 2022-02-02T13:59:11.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.925+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0045ad0 con 0x7f37c00f66e0 2022-02-02T13:59:11.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.925+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f37bc01d420 con 0x7f37c00f66e0 2022-02-02T13:59:11.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.925+0000 7f37b6ffd700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:11.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.926+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f37bc0838f0 con 0x7f37c00f66e0 2022-02-02T13:59:11.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.926+0000 7f37c5963700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:11.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.926+0000 7f37c5963700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f37b00041d0 tx=0x7f37b0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:11.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:11.930+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37bc0553d0 con 0x7f37c00f66e0 2022-02-02T13:59:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.146+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f37c0027a00 con 0x7f37c00f66e0 2022-02-02T13:59:12.146 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:11 smithi033 ceph-mon[101165]: pgmap v592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.146+0000 7f37b6ffd700 1 -- 172.21.15.33:0/3768686097 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f37bc054fc0 con 0x7f37c00f66e0 2022-02-02T13:59:12.147 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:59:12.147 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:59:12.147 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:59:12.148 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:59:12.148 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:12.148 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:59:12.148 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:59:12.149 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:59:12.149 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:59:12.149 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:59:12.149 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:59:12.167 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:59:12.167 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:59:12.167 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:59:12.167 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:59:12.168 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:59:12.168 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:59:12.168 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:59:12.168 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:59:12.169 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:59:12.169 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:59:12.169 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:59:12.169 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:59:12.169 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:59:12.170 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:59:12.170 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:59:12.170 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:59:12.172 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:59:12.172 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:59:12.172 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:59:12.173 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:59:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:12.173 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:12.173 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:59:12.174 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:12.174 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:12.174 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:12.175 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:12.175 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:12.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 msgr2=0x7f37ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:12.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f37b00041d0 tx=0x7f37b0009040).stop 2022-02-02T13:59:12.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 msgr2=0x7f37c0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:12.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f37bc004f60 tx=0x7f37bc009b30).stop 2022-02-02T13:59:12.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 shutdown_connections 2022-02-02T13:59:12.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:12.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f66e0 0x7f37c0106fb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 --2- 172.21.15.33:0/3768686097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f7980 0x7f37c01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 >> 172.21.15.33:0/3768686097 conn(0x7f37c00f1e40 msgr2=0x7f37c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 shutdown_connections 2022-02-02T13:59:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:12.148+0000 7f37c83c8700 1 -- 172.21.15.33:0/3768686097 wait complete. 2022-02-02T13:59:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:59:12.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:11 smithi037 ceph-mon[69017]: pgmap v592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:12 smithi033 ceph-mon[101165]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:12 smithi033 ceph-mon[101165]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/511548311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:59:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3768686097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:59:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:12 smithi037 ceph-mon[69017]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:12 smithi037 ceph-mon[69017]: from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/511548311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:59:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3768686097' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:59:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:13 smithi033 ceph-mon[101165]: pgmap v593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:14.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:13 smithi037 ceph-mon[69017]: pgmap v593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:15 smithi033 ceph-mon[101165]: pgmap v594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:16.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:15 smithi037 ceph-mon[69017]: pgmap v594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:59:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:59:17.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:16 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:59:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T13:59:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T13:59:17.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:16 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T13:59:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:17 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:59:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:17 smithi033 ceph-mon[101165]: pgmap v595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:59:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:17 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T13:59:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:17 smithi037 ceph-mon[69017]: pgmap v595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T13:59:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:18 smithi033 ceph-mon[101165]: pgmap v596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:18 smithi033 ceph-mon[101165]: pgmap v597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:18 smithi037 ceph-mon[69017]: pgmap v596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:18 smithi037 ceph-mon[69017]: pgmap v597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:20 smithi033 ceph-mon[101165]: pgmap v598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:21.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:20 smithi037 ceph-mon[69017]: pgmap v598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:23.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:22 smithi033 ceph-mon[101165]: pgmap v599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:22 smithi037 ceph-mon[69017]: pgmap v599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:24 smithi033 ceph-mon[101165]: pgmap v600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:24 smithi037 ceph-mon[69017]: pgmap v600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:26 smithi033 ceph-mon[101165]: pgmap v601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:26 smithi037 ceph-mon[69017]: pgmap v601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:28 smithi033 ceph-mon[101165]: pgmap v602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:29.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:28 smithi037 ceph-mon[69017]: pgmap v602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:30 smithi033 ceph-mon[101165]: pgmap v603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:30 smithi037 ceph-mon[69017]: pgmap v603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:32 smithi033 ceph-mon[101165]: pgmap v604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:32 smithi037 ceph-mon[69017]: pgmap v604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:35.252 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:34 smithi033 ceph-mon[101165]: pgmap v605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:35.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:34 smithi037 ceph-mon[69017]: pgmap v605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:37.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:36 smithi037 ceph-mon[69017]: pgmap v606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:37.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:36 smithi033 ceph-mon[101165]: pgmap v606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:39.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:38 smithi037 ceph-mon[69017]: pgmap v607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:38 smithi033 ceph-mon[101165]: pgmap v607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:41.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:41 smithi037 ceph-mon[69017]: pgmap v608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:40 smithi033 ceph-mon[101165]: pgmap v608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:42.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 -- 172.21.15.33:0/2974871316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f66e0 msgr2=0x7f83280f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 --2- 172.21.15.33:0/2974871316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f66e0 0x7f83280f6b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8318004660 tx=0x7f8318009b30).stop 2022-02-02T13:59:42.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 -- 172.21.15.33:0/2974871316 shutdown_connections 2022-02-02T13:59:42.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 --2- 172.21.15.33:0/2974871316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f6ff0 0x7f83280f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 --2- 172.21.15.33:0/2974871316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f66e0 0x7f83280f6b00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 -- 172.21.15.33:0/2974871316 >> 172.21.15.33:0/2974871316 conn(0x7f83280f1f00 msgr2=0x7f83280f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:42.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 -- 172.21.15.33:0/2974871316 shutdown_connections 2022-02-02T13:59:42.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.265+0000 7f832d306700 1 -- 172.21.15.33:0/2974871316 wait complete. 2022-02-02T13:59:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 Processor -- start 2022-02-02T13:59:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 -- start start 2022-02-02T13:59:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f66e0 0x7f832806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832806a380 con 0x7f83280f6ff0 2022-02-02T13:59:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f832d306700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832806a4c0 con 0x7f83280f66e0 2022-02-02T13:59:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59058/0 (socket says 172.21.15.33:59058) 2022-02-02T13:59:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 -- 172.21.15.33:0/1511252664 learned_addr learned my addr 172.21.15.33:0/1511252664 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f8326ffd700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f66e0 0x7f832806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 -- 172.21.15.33:0/1511252664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f66e0 msgr2=0x7f832806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f66e0 0x7f832806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.266+0000 7f83267fc700 1 -- 172.21.15.33:0/1511252664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318005040 con 0x7f83280f6ff0 2022-02-02T13:59:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f83267fc700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f831c0026d0 tx=0x7f831c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831c0079c0 con 0x7f83280f6ff0 2022-02-02T13:59:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f831c00f040 con 0x7f83280f6ff0 2022-02-02T13:59:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831c0148b0 con 0x7f83280f6ff0 2022-02-02T13:59:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832806a7a0 con 0x7f83280f6ff0 2022-02-02T13:59:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.267+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832810ef90 con 0x7f83280f6ff0 2022-02-02T13:59:42.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.268+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8328045ad0 con 0x7f83280f6ff0 2022-02-02T13:59:42.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.268+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f831c007b20 con 0x7f83280f6ff0 2022-02-02T13:59:42.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.269+0000 7f830f7fe700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 0x7f8310067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.269+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f831c081910 con 0x7f83280f6ff0 2022-02-02T13:59:42.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.269+0000 7f8326ffd700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 0x7f8310067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.269+0000 7f8326ffd700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 0x7f8310067270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f8318013690 tx=0x7f8318009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.273+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f831c04f9c0 con 0x7f83280f6ff0 2022-02-02T13:59:42.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.463+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83280ff010 con 0x7f8310064db0 2022-02-02T13:59:42.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.464+0000 7f830f7fe700 1 -- 172.21.15.33:0/1511252664 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f83280ff010 con 0x7f8310064db0 2022-02-02T13:59:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 msgr2=0x7f8310067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 0x7f8310067270 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f8318013690 tx=0x7f8318009b30).stop 2022-02-02T13:59:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 msgr2=0x7f8328069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f831c0026d0 tx=0x7f831c009de0).stop 2022-02-02T13:59:42.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 shutdown_connections 2022-02-02T13:59:42.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8310064db0 0x7f8310067270 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83280f66e0 0x7f832806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 --2- 172.21.15.33:0/1511252664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83280f6ff0 0x7f8328069e20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 >> 172.21.15.33:0/1511252664 conn(0x7f83280f1f00 msgr2=0x7f83280fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:42.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 shutdown_connections 2022-02-02T13:59:42.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.466+0000 7f832d306700 1 -- 172.21.15.33:0/1511252664 wait complete. 2022-02-02T13:59:42.476 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T13:59:42.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 -- 172.21.15.33:0/4023368160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f55c0 msgr2=0x7f6fa80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/4023368160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f55c0 0x7f6fa80f59e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f6fa4004660 tx=0x7f6fa4009b30).stop 2022-02-02T13:59:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 -- 172.21.15.33:0/4023368160 shutdown_connections 2022-02-02T13:59:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/4023368160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f6860 0x7f6fa80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/4023368160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f55c0 0x7f6fa80f59e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 -- 172.21.15.33:0/4023368160 >> 172.21.15.33:0/4023368160 conn(0x7f6fa80f0d40 msgr2=0x7f6fa80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:42.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.567+0000 7f6fb02c6700 1 -- 172.21.15.33:0/4023368160 shutdown_connections 2022-02-02T13:59:42.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.568+0000 7f6fb02c6700 1 -- 172.21.15.33:0/4023368160 wait complete. 2022-02-02T13:59:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.568+0000 7f6fb02c6700 1 Processor -- start 2022-02-02T13:59:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.568+0000 7f6fb02c6700 1 -- start start 2022-02-02T13:59:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fb02c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 0x7f6fa810c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fb02c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fb02c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80602b0 con 0x7f6fa80f6860 2022-02-02T13:59:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fb02c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa80603f0 con 0x7f6fa80f55c0 2022-02-02T13:59:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59068/0 (socket says 172.21.15.33:59068) 2022-02-02T13:59:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 -- 172.21.15.33:0/3295054790 learned_addr learned my addr 172.21.15.33:0/3295054790 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:42.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fae062700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 0x7f6fa810c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 -- 172.21.15.33:0/3295054790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 msgr2=0x7f6fa810c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 0x7f6fa810c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 -- 172.21.15.33:0/3295054790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa4005040 con 0x7f6fa80f6860 2022-02-02T13:59:42.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fae062700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 0x7f6fa810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T13:59:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.569+0000 7f6fad861700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6f9c00e7f0 tx=0x7f6f9c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.570+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c0092e0 con 0x7f6fa80f6860 2022-02-02T13:59:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.570+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6f9c00f040 con 0x7f6fa80f6860 2022-02-02T13:59:42.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.570+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f9c014750 con 0x7f6fa80f6860 2022-02-02T13:59:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.570+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa810ea00 con 0x7f6fa80f6860 2022-02-02T13:59:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.570+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa810ee80 con 0x7f6fa80f6860 2022-02-02T13:59:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.571+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa8045ad0 con 0x7f6fa80f6860 2022-02-02T13:59:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.571+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6f9c01b030 con 0x7f6fa80f6860 2022-02-02T13:59:42.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.572+0000 7f6f9affd700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 0x7f6f94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.572+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6f9c081870 con 0x7f6fa80f6860 2022-02-02T13:59:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.572+0000 7f6fae062700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 0x7f6f94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.572+0000 7f6fae062700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 0x7f6f94067290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6fa4000c00 tx=0x7f6fa4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.576+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6f9c04f9d0 con 0x7f6fa80f6860 2022-02-02T13:59:42.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.757+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fa8057f10 con 0x7f6f94064dd0 2022-02-02T13:59:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.771+0000 7f6f9affd700 1 -- 172.21.15.33:0/3295054790 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6fa8057f10 con 0x7f6f94064dd0 2022-02-02T13:59:42.771 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T13:59:42.772 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (25m) 7m ago 26m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T13:59:42.772 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (18m) 7m ago 25m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T13:59:42.772 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (17m) 7m ago 25m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T13:59:42.772 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (24m) 7m ago 25m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T13:59:42.773 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (18m) 7m ago 22m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T13:59:42.773 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (19m) 7m ago 22m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T13:59:42.773 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (19m) 7m ago 22m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T13:59:42.773 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (22m) 7m ago 22m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T13:59:42.774 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (19m) 7m ago 27m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T13:59:42.774 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (19m) 7m ago 25m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T13:59:42.774 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (18m) 7m ago 27m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T13:59:42.774 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (18m) 7m ago 25m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T13:59:42.774 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (25m) 7m ago 25m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T13:59:42.775 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (25m) 7m ago 25m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T13:59:42.775 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 7m ago 24m - 4096M 2022-02-02T13:59:42.775 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (24m) 7m ago 24m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T13:59:42.775 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (24m) 7m ago 24m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T13:59:42.776 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (23m) 7m ago 23m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T13:59:42.776 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (23m) 7m ago 23m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T13:59:42.776 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (23m) 7m ago 23m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T13:59:42.776 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (24m) 7m ago 25m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T13:59:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 msgr2=0x7f6f94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 0x7f6f94067290 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f6fa4000c00 tx=0x7f6fa4016040).stop 2022-02-02T13:59:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 msgr2=0x7f6fa810e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f6f9c00e7f0 tx=0x7f6f9c00b040).stop 2022-02-02T13:59:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 shutdown_connections 2022-02-02T13:59:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6f94064dd0 0x7f6f94067290 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fa80f55c0 0x7f6fa810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 --2- 172.21.15.33:0/3295054790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6fa80f6860 0x7f6fa810e510 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.773+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 >> 172.21.15.33:0/3295054790 conn(0x7f6fa80f0d40 msgr2=0x7f6fa80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.774+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 shutdown_connections 2022-02-02T13:59:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.774+0000 7f6fb02c6700 1 -- 172.21.15.33:0/3295054790 wait complete. 2022-02-02T13:59:42.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 -- 172.21.15.33:0/3937647468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f6860 msgr2=0x7f37340f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 --2- 172.21.15.33:0/3937647468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f6860 0x7f37340f6cc0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f3720004660 tx=0x7f3720009b30).stop 2022-02-02T13:59:42.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 -- 172.21.15.33:0/3937647468 shutdown_connections 2022-02-02T13:59:42.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 --2- 172.21.15.33:0/3937647468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f6860 0x7f37340f6cc0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 --2- 172.21.15.33:0/3937647468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f55c0 0x7f37340f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 -- 172.21.15.33:0/3937647468 >> 172.21.15.33:0/3937647468 conn(0x7f37340f0d40 msgr2=0x7f37340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:42.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.873+0000 7f373afb4700 1 -- 172.21.15.33:0/3937647468 shutdown_connections 2022-02-02T13:59:42.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.874+0000 7f373afb4700 1 -- 172.21.15.33:0/3937647468 wait complete. 2022-02-02T13:59:42.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.874+0000 7f373afb4700 1 Processor -- start 2022-02-02T13:59:42.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.874+0000 7f373afb4700 1 -- start start 2022-02-02T13:59:42.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f373afb4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f373afb4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f6860 0x7f3734107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f373afb4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734107a10 con 0x7f37340f55c0 2022-02-02T13:59:42.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f373afb4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3734107b50 con 0x7f37340f6860 2022-02-02T13:59:42.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59076/0 (socket says 172.21.15.33:59076) 2022-02-02T13:59:42.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 -- 172.21.15.33:0/1463151321 learned_addr learned my addr 172.21.15.33:0/1463151321 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:42.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3733fff700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f6860 0x7f3734107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 -- 172.21.15.33:0/1463151321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f6860 msgr2=0x7f3734107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:42.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f6860 0x7f3734107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:42.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.875+0000 7f3738d50700 1 -- 172.21.15.33:0/1463151321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3720005040 con 0x7f37340f55c0 2022-02-02T13:59:42.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f3738d50700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3728002700 tx=0x7f3728009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37280079c0 con 0x7f37340f55c0 2022-02-02T13:59:42.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f372800f040 con 0x7f37340f55c0 2022-02-02T13:59:42.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37341084f0 con 0x7f37340f55c0 2022-02-02T13:59:42.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3728014860 con 0x7f37340f55c0 2022-02-02T13:59:42.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.876+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3734108ab0 con 0x7f37340f55c0 2022-02-02T13:59:42.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.877+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3734045ad0 con 0x7f37340f55c0 2022-02-02T13:59:42.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.877+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f372801b060 con 0x7f37340f55c0 2022-02-02T13:59:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.878+0000 7f37317fa700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 0x7f3724067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.878+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3728081840 con 0x7f37340f55c0 2022-02-02T13:59:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.878+0000 7f3733fff700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 0x7f3724067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.878+0000 7f3733fff700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 0x7f3724067290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3720004630 tx=0x7f3720009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:42.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:42.882+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3728053320 con 0x7f37340f55c0 2022-02-02T13:59:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.126+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f37340f7ab0 con 0x7f37340f55c0 2022-02-02T13:59:43.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:43 smithi033 ceph-mon[101165]: pgmap v609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.127+0000 7f37317fa700 1 -- 172.21.15.33:0/1463151321 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f37280192d0 con 0x7f37340f55c0 2022-02-02T13:59:43.128 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T13:59:43.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T13:59:43.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:59:43.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:43.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T13:59:43.129 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T13:59:43.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:43.129 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T13:59:43.129 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T13:59:43.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:43.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T13:59:43.130 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T13:59:43.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T13:59:43.131 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T13:59:43.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T13:59:43.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T13:59:43.131 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T13:59:43.132 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T13:59:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 msgr2=0x7f3724067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 0x7f3724067290 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f3720004630 tx=0x7f3720009b30).stop 2022-02-02T13:59:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 msgr2=0x7f3734106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f3728002700 tx=0x7f3728009d80).stop 2022-02-02T13:59:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 shutdown_connections 2022-02-02T13:59:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3724064dd0 0x7f3724067290 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37340f55c0 0x7f3734106f70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 --2- 172.21.15.33:0/1463151321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37340f6860 0x7f3734107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 >> 172.21.15.33:0/1463151321 conn(0x7f37340f0d40 msgr2=0x7f373405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 shutdown_connections 2022-02-02T13:59:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.129+0000 7f373afb4700 1 -- 172.21.15.33:0/1463151321 wait complete. 2022-02-02T13:59:43.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- 172.21.15.33:0/486588755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f5430 msgr2=0x7f4eec0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/486588755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f5430 0x7f4eec0f5850 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f4ee0004660 tx=0x7f4ee0009b30).stop 2022-02-02T13:59:43.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- 172.21.15.33:0/486588755 shutdown_connections 2022-02-02T13:59:43.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/486588755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f66d0 0x7f4eec0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/486588755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f5430 0x7f4eec0f5850 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- 172.21.15.33:0/486588755 >> 172.21.15.33:0/486588755 conn(0x7f4eec0f0b90 msgr2=0x7f4eec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:43.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- 172.21.15.33:0/486588755 shutdown_connections 2022-02-02T13:59:43.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- 172.21.15.33:0/486588755 wait complete. 2022-02-02T13:59:43.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 Processor -- start 2022-02-02T13:59:43.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.230+0000 7f4eeb59e700 1 -- start start 2022-02-02T13:59:43.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4eeb59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f5430 0x7f4eec109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:43.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4eeb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:43.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4eeb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec0603e0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4eeb59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eec060520 con 0x7f4eec0f5430 2022-02-02T13:59:43.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:43.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59088/0 (socket says 172.21.15.33:59088) 2022-02-02T13:59:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 -- 172.21.15.33:0/3145254275 learned_addr learned my addr 172.21.15.33:0/3145254275 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T13:59:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4eea59c700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f5430 0x7f4eec109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 -- 172.21.15.33:0/3145254275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f5430 msgr2=0x7f4eec109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f5430 0x7f4eec109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 -- 172.21.15.33:0/3145254275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0005040 con 0x7f4eec0f66d0 2022-02-02T13:59:43.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4ee9d9b700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4edc0026d0 tx=0x7f4edc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.231+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4edc0079c0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.232+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4edc00f040 con 0x7f4eec0f66d0 2022-02-02T13:59:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.232+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eec10c540 con 0x7f4eec0f66d0 2022-02-02T13:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.232+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4edc0148b0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.232+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eec10cb00 con 0x7f4eec0f66d0 2022-02-02T13:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.233+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eec045ad0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.233+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4edc007b20 con 0x7f4eec0f66d0 2022-02-02T13:59:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.234+0000 7f4edaffd700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 0x7f4ed40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T13:59:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.234+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4edc0819e0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.234+0000 7f4eea59c700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 0x7f4ed40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T13:59:43.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.234+0000 7f4eea59c700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 0x7f4ed40672e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f4ee0013690 tx=0x7f4ee0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T13:59:43.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.238+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4edc04fa90 con 0x7f4eec0f66d0 2022-02-02T13:59:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:43 smithi037 ceph-mon[69017]: pgmap v609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:43.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.450+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4eec027a00 con 0x7f4eec0f66d0 2022-02-02T13:59:43.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.451+0000 7f4edaffd700 1 -- 172.21.15.33:0/3145254275 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4edc0530b0 con 0x7f4eec0f66d0 2022-02-02T13:59:43.451 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T13:59:43.452 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T13:59:43.452 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:59:43.452 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T13:59:43.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:43.452 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T13:59:43.453 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T13:59:43.453 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T13:59:43.453 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T13:59:43.453 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T13:59:43.454 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T13:59:43.454 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T13:59:43.454 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T13:59:43.454 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T13:59:43.455 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T13:59:43.455 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T13:59:43.455 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T13:59:43.455 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T13:59:43.456 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T13:59:43.456 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T13:59:43.456 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T13:59:43.456 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T13:59:43.457 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T13:59:43.457 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T13:59:43.457 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T13:59:43.457 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T13:59:43.457 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T13:59:43.458 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T13:59:43.458 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T13:59:43.458 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T13:59:43.459 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T13:59:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:43.459 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T13:59:43.459 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T13:59:43.460 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:43.460 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:43.460 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:43.460 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T13:59:43.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 msgr2=0x7f4ed40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 0x7f4ed40672e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f4ee0013690 tx=0x7f4ee0009b30).stop 2022-02-02T13:59:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 msgr2=0x7f4eec10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T13:59:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4edc0026d0 tx=0x7f4edc009de0).stop 2022-02-02T13:59:43.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 shutdown_connections 2022-02-02T13:59:43.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064e20 0x7f4ed40672e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4eec0f5430 0x7f4eec109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 --2- 172.21.15.33:0/3145254275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4eec0f66d0 0x7f4eec10bf90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T13:59:43.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 >> 172.21.15.33:0/3145254275 conn(0x7f4eec0f0b90 msgr2=0x7f4eec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T13:59:43.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 shutdown_connections 2022-02-02T13:59:43.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T13:59:43.453+0000 7f4eeb59e700 1 -- 172.21.15.33:0/3145254275 wait complete. 2022-02-02T13:59:43.464 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T13:59:44.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:44 smithi037 ceph-mon[69017]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:44.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:44 smithi037 ceph-mon[69017]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:44.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1463151321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:59:44.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3145254275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:59:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:44 smithi033 ceph-mon[101165]: from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:44 smithi033 ceph-mon[101165]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T13:59:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1463151321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T13:59:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3145254275' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T13:59:45.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:45 smithi037 ceph-mon[69017]: pgmap v610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:45 smithi033 ceph-mon[101165]: pgmap v610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:47 smithi037 ceph-mon[69017]: pgmap v611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:47 smithi033 ceph-mon[101165]: pgmap v611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:49 smithi037 ceph-mon[69017]: pgmap v612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:49 smithi033 ceph-mon[101165]: pgmap v612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:51.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:51 smithi037 ceph-mon[69017]: pgmap v613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:51 smithi033 ceph-mon[101165]: pgmap v613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:53 smithi037 ceph-mon[69017]: pgmap v614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:53 smithi033 ceph-mon[101165]: pgmap v614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:55.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:55 smithi037 ceph-mon[69017]: pgmap v615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:55.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:59:55.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:59:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:55 smithi033 ceph-mon[101165]: pgmap v615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T13:59:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T13:59:57.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:57 smithi037 ceph-mon[69017]: pgmap v616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:57 smithi033 ceph-mon[101165]: pgmap v616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 13:59:59 smithi037 ceph-mon[69017]: pgmap v617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T13:59:59.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 13:59:59 smithi033 ceph-mon[101165]: pgmap v617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: Health detail: HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T14:00:00.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: daemon osd.0 on smithi033 is in error state 2022-02-02T14:00:00.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T14:00:00.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: fs cephfs is degraded 2022-02-02T14:00:00.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T14:00:00.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T14:00:00.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T14:00:00.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: fs cephfs has 1 failed mds 2022-02-02T14:00:00.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T14:00:00.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: fs cephfs is offline because no MDS is active for it. 2022-02-02T14:00:00.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T14:00:00.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T14:00:00.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T14:00:00.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T14:00:00.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T14:00:00.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T14:00:00.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T14:00:00.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:00.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: Traceback (most recent call last): 2022-02-02T14:00:00.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T14:00:00.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: main() 2022-02-02T14:00:00.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T14:00:00.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: r = ctx.func(ctx) 2022-02-02T14:00:00.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T14:00:00.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: return func(ctx) 2022-02-02T14:00:00.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T14:00:00.300 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: ports=daemon_ports) 2022-02-02T14:00:00.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T14:00:00.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T14:00:00.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T14:00:00.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T14:00:00.301 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T14:00:00.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T14:00:00.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.302 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:00 smithi037 ceph-mon[69017]: See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:00.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T14:00:00.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : daemon osd.0 on smithi033 is in error state 2022-02-02T14:00:00.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T14:00:00.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2022-02-02T14:00:00.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T14:00:00.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2022-02-02T14:00:00.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T14:00:00.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs has 1 failed mds 2022-02-02T14:00:00.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T14:00:00.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2022-02-02T14:00:00.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T14:00:00.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T14:00:00.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T14:00:00.494 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T14:00:00.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T14:00:00.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T14:00:00.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T14:00:00.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T14:00:00.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:00.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T14:00:00.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : Traceback (most recent call last): 2022-02-02T14:00:00.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T14:00:00.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : main() 2022-02-02T14:00:00.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T14:00:00.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : r = ctx.func(ctx) 2022-02-02T14:00:00.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T14:00:00.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : return func(ctx) 2022-02-02T14:00:00.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T14:00:00.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : ports=daemon_ports) 2022-02-02T14:00:00.498 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T14:00:00.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T14:00:00.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T14:00:00.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T14:00:00.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T14:00:00.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T14:00:00.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 conmon[101141]: 2022-02-02T13:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:00.500 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: Health detail: HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] CEPHADM_FAILED_DAEMON: 1 failed cephadm daemon(s) 2022-02-02T14:00:00.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: daemon osd.0 on smithi033 is in error state 2022-02-02T14:00:00.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-02-02T14:00:00.501 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: fs cephfs is degraded 2022-02-02T14:00:00.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2022-02-02T14:00:00.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: fs cephfs has deprecated feature inline_data enabled. 2022-02-02T14:00:00.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] FS_WITH_FAILED_MDS: 1 filesystem has a failed mds daemon 2022-02-02T14:00:00.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: fs cephfs has 1 failed mds 2022-02-02T14:00:00.502 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2022-02-02T14:00:00.503 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: fs cephfs is offline because no MDS is active for it. 2022-02-02T14:00:00.503 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] RECENT_CRASH: 4 daemons have recently crashed 2022-02-02T14:00:00.503 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:39:53.699304Z 2022-02-02T14:00:00.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.kvxxkv crashed on host smithi033 at 2022-02-02T13:40:22.281340Z 2022-02-02T14:00:00.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi033.cdqmmc crashed on host smithi033 at 2022-02-02T13:40:36.282734Z 2022-02-02T14:00:00.504 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: mds.cephfs.smithi037.lqirod crashed on host smithi037 at 2022-02-02T13:39:35.700188Z 2022-02-02T14:00:00.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:00:00.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr: Redeploy daemon osd.0 ... 2022-02-02T14:00:00.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: Non-zero exit code 1 from systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0 2022-02-02T14:00:00.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: systemctl: stderr Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: systemctl: stderr See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:00.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: Traceback (most recent call last): 2022-02-02T14:00:00.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8631, in 2022-02-02T14:00:00.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: main() 2022-02-02T14:00:00.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 8619, in main 2022-02-02T14:00:00.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: r = ctx.func(ctx) 2022-02-02T14:00:00.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1938, in _default_image 2022-02-02T14:00:00.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: return func(ctx) 2022-02-02T14:00:00.507 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 5288, in command_deploy 2022-02-02T14:00:00.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: ports=daemon_ports) 2022-02-02T14:00:00.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 2898, in deploy_daemon 2022-02-02T14:00:00.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: c, osd_fsid=osd_fsid, ports=ports) 2022-02-02T14:00:00.508 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 3143, in deploy_daemon_units 2022-02-02T14:00:00.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-02-02T14:00:00.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: File "/var/lib/ceph/7b277774-842c-11ec-8c35-001a4aab830c/cephadm.18761eff630cc288dafa6edf4eb60b501e1edf50c107e8956c0efa746577daff", line 1615, in call_throws 2022-02-02T14:00:00.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-02-02T14:00:00.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: RuntimeError: Failed command: systemctl start ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0: Job for ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-02-02T14:00:00.509 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:00 smithi033 ceph-mon[101165]: See "systemctl status ceph-7b277774-842c-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-02-02T14:00:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:01 smithi037 ceph-mon[69017]: pgmap v618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:01 smithi033 ceph-mon[101165]: pgmap v618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:03 smithi037 ceph-mon[69017]: pgmap v619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:03 smithi033 ceph-mon[101165]: pgmap v619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:05 smithi033 ceph-mon[101165]: pgmap v620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:05 smithi037 ceph-mon[69017]: pgmap v620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:07.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:07 smithi037 ceph-mon[69017]: pgmap v621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:07.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:07 smithi033 ceph-mon[101165]: pgmap v621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:08 smithi033 ceph-mon[101165]: pgmap v622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:08 smithi037 ceph-mon[69017]: pgmap v622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:10.747 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:10 smithi033 ceph-mon[101165]: pgmap v623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:10.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:10 smithi037 ceph-mon[69017]: pgmap v623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:12 smithi033 ceph-mon[101165]: pgmap v624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:13.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:12 smithi037 ceph-mon[69017]: pgmap v624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:13.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.569+0000 7f4149910700 1 -- 172.21.15.33:0/2036979372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 msgr2=0x7f41440f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.569+0000 7f4149910700 1 --2- 172.21.15.33:0/2036979372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f41440f6fd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f4134004660 tx=0x7f4134009b30).stop 2022-02-02T14:00:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.569+0000 7f4149910700 1 -- 172.21.15.33:0/2036979372 shutdown_connections 2022-02-02T14:00:13.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.569+0000 7f4149910700 1 --2- 172.21.15.33:0/2036979372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 0x7f41440f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 --2- 172.21.15.33:0/2036979372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f41440f6fd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 -- 172.21.15.33:0/2036979372 >> 172.21.15.33:0/2036979372 conn(0x7f41440f04c0 msgr2=0x7f41440f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 -- 172.21.15.33:0/2036979372 shutdown_connections 2022-02-02T14:00:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 -- 172.21.15.33:0/2036979372 wait complete. 2022-02-02T14:00:13.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 Processor -- start 2022-02-02T14:00:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.570+0000 7f4149910700 1 -- start start 2022-02-02T14:00:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f4149910700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 0x7f4144106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f4149910700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f4149910700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144107a10 con 0x7f41440f6bb0 2022-02-02T14:00:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f4149910700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144107b50 con 0x7f41440f58b0 2022-02-02T14:00:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59098/0 (socket says 172.21.15.33:59098) 2022-02-02T14:00:13.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 -- 172.21.15.33:0/228109880 learned_addr learned my addr 172.21.15.33:0/228109880 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:13.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f4142ffd700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 0x7f4144106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 -- 172.21.15.33:0/228109880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 msgr2=0x7f4144106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 0x7f4144106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 -- 172.21.15.33:0/228109880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134005040 con 0x7f41440f6bb0 2022-02-02T14:00:13.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.571+0000 7f41427fc700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f413800c530 tx=0x7f4138007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:13.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.572+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f413800f650 con 0x7f41440f6bb0 2022-02-02T14:00:13.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.572+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f413800fc60 con 0x7f41440f6bb0 2022-02-02T14:00:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.572+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41441084f0 con 0x7f41440f6bb0 2022-02-02T14:00:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.572+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4138012cb0 con 0x7f41440f6bb0 2022-02-02T14:00:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.572+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4144108ab0 con 0x7f41440f6bb0 2022-02-02T14:00:13.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.573+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4144045ad0 con 0x7f41440f6bb0 2022-02-02T14:00:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.573+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4138019030 con 0x7f41440f6bb0 2022-02-02T14:00:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.574+0000 7f412b7fe700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.574+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4138081680 con 0x7f41440f6bb0 2022-02-02T14:00:13.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.574+0000 7f4142ffd700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.574+0000 7f4142ffd700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 0x7f412c067290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4134004630 tx=0x7f4134009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:13.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.578+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4138053210 con 0x7f41440f6bb0 2022-02-02T14:00:13.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.769+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41440fad00 con 0x7f412c064dd0 2022-02-02T14:00:13.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.770+0000 7f412b7fe700 1 -- 172.21.15.33:0/228109880 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f41440fad00 con 0x7f412c064dd0 2022-02-02T14:00:13.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 msgr2=0x7f412c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 0x7f412c067290 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f4134004630 tx=0x7f4134009b30).stop 2022-02-02T14:00:13.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 msgr2=0x7f4144107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f413800c530 tx=0x7f4138007e10).stop 2022-02-02T14:00:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 shutdown_connections 2022-02-02T14:00:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f412c064dd0 0x7f412c067290 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41440f58b0 0x7f4144106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 --2- 172.21.15.33:0/228109880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41440f6bb0 0x7f4144107460 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 >> 172.21.15.33:0/228109880 conn(0x7f41440f04c0 msgr2=0x7f41440f4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 shutdown_connections 2022-02-02T14:00:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.772+0000 7f4149910700 1 -- 172.21.15.33:0/228109880 wait complete. 2022-02-02T14:00:13.782 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:00:13.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 -- 172.21.15.33:0/1359334181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 msgr2=0x7f10a00fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 --2- 172.21.15.33:0/1359334181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00fbae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f1090004660 tx=0x7f1090009b30).stop 2022-02-02T14:00:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 -- 172.21.15.33:0/1359334181 shutdown_connections 2022-02-02T14:00:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 --2- 172.21.15.33:0/1359334181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00fbae0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 --2- 172.21.15.33:0/1359334181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 0x7f10a00f9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.874+0000 7f10a63f3700 1 -- 172.21.15.33:0/1359334181 >> 172.21.15.33:0/1359334181 conn(0x7f10a00f0b90 msgr2=0x7f10a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.876+0000 7f10a63f3700 1 -- 172.21.15.33:0/1359334181 shutdown_connections 2022-02-02T14:00:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.876+0000 7f10a63f3700 1 -- 172.21.15.33:0/1359334181 wait complete. 2022-02-02T14:00:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 Processor -- start 2022-02-02T14:00:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 -- start start 2022-02-02T14:00:13.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 0x7f10a00f6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00f55b0 con 0x7f10a00f96d0 2022-02-02T14:00:13.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a63f3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a00f56f0 con 0x7f10a00602d0 2022-02-02T14:00:13.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59108/0 (socket says 172.21.15.33:59108) 2022-02-02T14:00:13.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 -- 172.21.15.33:0/535095786 learned_addr learned my addr 172.21.15.33:0/535095786 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:13.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a53f1700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 0x7f10a00f6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 -- 172.21.15.33:0/535095786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 msgr2=0x7f10a00f6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:13.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 0x7f10a00f6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:13.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 -- 172.21.15.33:0/535095786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090005040 con 0x7f10a00f96d0 2022-02-02T14:00:13.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.877+0000 7f10a4bf0700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1090013a70 tx=0x7f1090009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:13.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.878+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1090018070 con 0x7f10a00f96d0 2022-02-02T14:00:13.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.878+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a00f5970 con 0x7f10a00f96d0 2022-02-02T14:00:13.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.878+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f10900097d0 con 0x7f10a00f96d0 2022-02-02T14:00:13.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.878+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f109001c3c0 con 0x7f10a00f96d0 2022-02-02T14:00:13.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.878+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a00f5ed0 con 0x7f10a00f96d0 2022-02-02T14:00:13.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.879+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a0045ad0 con 0x7f10a00f96d0 2022-02-02T14:00:13.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.879+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f109001c680 con 0x7f10a00f96d0 2022-02-02T14:00:13.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.880+0000 7f1095ffb700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 0x7f108c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.880+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1090083750 con 0x7f10a00f96d0 2022-02-02T14:00:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.880+0000 7f10a53f1700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 0x7f108c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.880+0000 7f10a53f1700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 0x7f108c0672e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f10a00f6960 tx=0x7f109c009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:13.884+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1090051950 con 0x7f10a00f96d0 2022-02-02T14:00:14.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.067+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f10a00fee00 con 0x7f108c064e20 2022-02-02T14:00:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.081+0000 7f1095ffb700 1 -- 172.21.15.33:0/535095786 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f10a00fee00 con 0x7f108c064e20 2022-02-02T14:00:14.081 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:00:14.081 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (25m) 8m ago 26m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:00:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (18m) 8m ago 26m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:00:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (18m) 8m ago 25m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:00:14.082 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (25m) 8m ago 26m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:00:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (19m) 8m ago 22m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:00:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (19m) 8m ago 22m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:00:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (20m) 8m ago 22m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:00:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (22m) 8m ago 22m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:00:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (20m) 8m ago 27m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:00:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (19m) 8m ago 25m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:00:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (19m) 8m ago 27m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:00:14.084 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (19m) 8m ago 25m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:00:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (26m) 8m ago 26m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:00:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (25m) 8m ago 25m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:00:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8m ago 25m - 4096M 2022-02-02T14:00:14.085 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (24m) 8m ago 24m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:00:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (24m) 8m ago 24m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:00:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (24m) 8m ago 24m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:00:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (24m) 8m ago 24m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:00:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (23m) 8m ago 23m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:00:14.086 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (25m) 8m ago 26m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:00:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 msgr2=0x7f108c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 0x7f108c0672e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f10a00f6960 tx=0x7f109c009be0).stop 2022-02-02T14:00:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 msgr2=0x7f10a00f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f1090013a70 tx=0x7f1090009b30).stop 2022-02-02T14:00:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 shutdown_connections 2022-02-02T14:00:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f108c064e20 0x7f108c0672e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10a00602d0 0x7f10a00f6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 --2- 172.21.15.33:0/535095786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10a00f96d0 0x7f10a00f5050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 >> 172.21.15.33:0/535095786 conn(0x7f10a00f0b90 msgr2=0x7f10a00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:14.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 shutdown_connections 2022-02-02T14:00:14.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.083+0000 7f10a63f3700 1 -- 172.21.15.33:0/535095786 wait complete. 2022-02-02T14:00:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 -- 172.21.15.33:0/1653630496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 msgr2=0x7feffc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 --2- 172.21.15.33:0/1653630496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc0f59e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7feff0004660 tx=0x7feff0009b30).stop 2022-02-02T14:00:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 -- 172.21.15.33:0/1653630496 shutdown_connections 2022-02-02T14:00:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 --2- 172.21.15.33:0/1653630496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 0x7feffc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 --2- 172.21.15.33:0/1653630496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc0f59e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 -- 172.21.15.33:0/1653630496 >> 172.21.15.33:0/1653630496 conn(0x7feffc0f0d40 msgr2=0x7feffc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 -- 172.21.15.33:0/1653630496 shutdown_connections 2022-02-02T14:00:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.183+0000 7ff0031e9700 1 -- 172.21.15.33:0/1653630496 wait complete. 2022-02-02T14:00:14.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 Processor -- start 2022-02-02T14:00:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 -- start start 2022-02-02T14:00:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 0x7feffc106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc106910 con 0x7feffc0f55c0 2022-02-02T14:00:14.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff0031e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc106a50 con 0x7feffc0f6860 2022-02-02T14:00:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59116/0 (socket says 172.21.15.33:59116) 2022-02-02T14:00:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 -- 172.21.15.33:0/2599318421 learned_addr learned my addr 172.21.15.33:0/2599318421 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:14.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7feffbfff700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 0x7feffc106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 -- 172.21.15.33:0/2599318421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 msgr2=0x7feffc106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 0x7feffc106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.184+0000 7ff000f85700 1 -- 172.21.15.33:0/2599318421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0005040 con 0x7feffc0f55c0 2022-02-02T14:00:14.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7ff000f85700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7feff0000c00 tx=0x7feff0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff001a070 con 0x7feffc0f55c0 2022-02-02T14:00:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feff0012a80 con 0x7feffc0f55c0 2022-02-02T14:00:14.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc107390 con 0x7feffc0f55c0 2022-02-02T14:00:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff001f8c0 con 0x7feffc0f55c0 2022-02-02T14:00:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.185+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc1078f0 con 0x7feffc0f55c0 2022-02-02T14:00:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.186+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc045ad0 con 0x7feffc0f55c0 2022-02-02T14:00:14.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.187+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feff0012bf0 con 0x7feffc0f55c0 2022-02-02T14:00:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.187+0000 7feff97fa700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 0x7fefec067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.187+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feff0085dd0 con 0x7feffc0f55c0 2022-02-02T14:00:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.187+0000 7feffbfff700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 0x7fefec067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.188+0000 7feffbfff700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 0x7fefec067270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fefe8007fd0 tx=0x7fefe8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:14.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.191+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feff0057910 con 0x7feffc0f55c0 2022-02-02T14:00:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.439+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feffc0fde80 con 0x7feffc0f55c0 2022-02-02T14:00:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.439+0000 7feff97fa700 1 -- 172.21.15.33:0/2599318421 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7feff0057500 con 0x7feffc0f55c0 2022-02-02T14:00:14.440 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:00:14.440 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:00:14.440 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:00:14.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:14.441 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:00:14.441 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:00:14.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:14.441 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:00:14.441 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:00:14.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:14.442 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:00:14.442 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:00:14.442 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:14.443 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:00:14.443 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:00:14.443 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:00:14.443 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:00:14.443 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:00:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 msgr2=0x7fefec067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 0x7fefec067270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fefe8007fd0 tx=0x7fefe8009040).stop 2022-02-02T14:00:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 msgr2=0x7feffc105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7feff0000c00 tx=0x7feff0009b30).stop 2022-02-02T14:00:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 shutdown_connections 2022-02-02T14:00:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fefec064db0 0x7fefec067270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feffc0f55c0 0x7feffc105e70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 --2- 172.21.15.33:0/2599318421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feffc0f6860 0x7feffc106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 >> 172.21.15.33:0/2599318421 conn(0x7feffc0f0d40 msgr2=0x7feffc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 shutdown_connections 2022-02-02T14:00:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.441+0000 7ff0031e9700 1 -- 172.21.15.33:0/2599318421 wait complete. 2022-02-02T14:00:14.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3353471370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e80f96a0 msgr2=0x7f21e80fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3353471370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e80f96a0 0x7f21e80fbaf0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f21dc004660 tx=0x7f21dc009b30).stop 2022-02-02T14:00:14.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3353471370 shutdown_connections 2022-02-02T14:00:14.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3353471370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e80f96a0 0x7f21e80fbaf0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3353471370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e8060270 0x7f21e80f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3353471370 >> 172.21.15.33:0/3353471370 conn(0x7f21e80f0b90 msgr2=0x7f21e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:14.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3353471370 shutdown_connections 2022-02-02T14:00:14.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.542+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3353471370 wait complete. 2022-02-02T14:00:14.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 Processor -- start 2022-02-02T14:00:14.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 -- start start 2022-02-02T14:00:14.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e80f96a0 0x7f21e8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e8107880 con 0x7f21e8060270 2022-02-02T14:00:14.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21ed1c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e81080c0 con 0x7f21e80f96a0 2022-02-02T14:00:14.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21e7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21e7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59126/0 (socket says 172.21.15.33:59126) 2022-02-02T14:00:14.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.543+0000 7f21e7fff700 1 -- 172.21.15.33:0/3675272730 learned_addr learned my addr 172.21.15.33:0/3675272730 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:14.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e77fe700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e80f96a0 0x7f21e8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e7fff700 1 -- 172.21.15.33:0/3675272730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e80f96a0 msgr2=0x7f21e8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e7fff700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e80f96a0 0x7f21e8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e7fff700 1 -- 172.21.15.33:0/3675272730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc005040 con 0x7f21e8060270 2022-02-02T14:00:14.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e7fff700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f21d800c530 tx=0x7f21d8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:14.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d800f650 con 0x7f21e8060270 2022-02-02T14:00:14.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21d800fc60 con 0x7f21e8060270 2022-02-02T14:00:14.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d8012c20 con 0x7f21e8060270 2022-02-02T14:00:14.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e81083a0 con 0x7f21e8060270 2022-02-02T14:00:14.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.544+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e81088e0 con 0x7f21e8060270 2022-02-02T14:00:14.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.545+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e8059100 con 0x7f21e8060270 2022-02-02T14:00:14.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.546+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21d8010070 con 0x7f21e8060270 2022-02-02T14:00:14.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.546+0000 7f21e4ff9700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 0x7f21d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:14.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.546+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f21d8081660 con 0x7f21e8060270 2022-02-02T14:00:14.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.546+0000 7f21e77fe700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 0x7f21d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:14.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.547+0000 7f21e77fe700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 0x7f21d00672e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f21e8106b20 tx=0x7f21dc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:14.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.550+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21d80477d0 con 0x7f21e8060270 2022-02-02T14:00:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.764+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21e80fee00 con 0x7f21e8060270 2022-02-02T14:00:14.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.765+0000 7f21e4ff9700 1 -- 172.21.15.33:0/3675272730 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f21d804f710 con 0x7f21e8060270 2022-02-02T14:00:14.765 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:00:14.766 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:00:14.766 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:00:14.766 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:00:14.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:14.767 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:00:14.767 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:00:14.767 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:00:14.767 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:00:14.767 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:00:14.768 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:00:14.768 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:00:14.768 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:00:14.768 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:00:14.769 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:00:14.769 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:00:14.769 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:00:14.769 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:00:14.769 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:00:14.770 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:00:14.770 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:00:14.770 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:00:14.770 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:00:14.771 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:00:14.771 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:00:14.771 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:00:14.771 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:00:14.771 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:00:14.772 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:00:14.772 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:00:14.772 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:00:14.772 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:14.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:14.773 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:00:14.773 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:14.773 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:14.773 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:14.774 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:14.774 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 msgr2=0x7f21d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 0x7f21d00672e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f21e8106b20 tx=0x7f21dc009b30).stop 2022-02-02T14:00:14.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 msgr2=0x7f21e8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:14.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f21d800c530 tx=0x7f21d8007e20).stop 2022-02-02T14:00:14.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 shutdown_connections 2022-02-02T14:00:14.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21d0064e20 0x7f21d00672e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21e8060270 0x7f21e8106d90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 --2- 172.21.15.33:0/3675272730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21e80f96a0 0x7f21e8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 >> 172.21.15.33:0/3675272730 conn(0x7f21e80f0b90 msgr2=0x7f21e80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 shutdown_connections 2022-02-02T14:00:14.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:14.768+0000 7f21ed1c7700 1 -- 172.21.15.33:0/3675272730 wait complete. 2022-02-02T14:00:14.779 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:00:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:14 smithi033 ceph-mon[101165]: pgmap v625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:14 smithi033 ceph-mon[101165]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:14 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2599318421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:00:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:14 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3675272730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:00:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:14 smithi037 ceph-mon[69017]: pgmap v625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:14 smithi037 ceph-mon[69017]: from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:14 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2599318421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:00:15.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:14 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3675272730' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:00:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:15 smithi033 ceph-mon[101165]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:16.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:15 smithi037 ceph-mon[69017]: from='client.34746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:17.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:16 smithi033 ceph-mon[101165]: pgmap v626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:16 smithi037 ceph-mon[69017]: pgmap v626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:00:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:00:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:00:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:00:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:00:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:00:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:00:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:00:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:18 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:00:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:18 smithi033 ceph-mon[101165]: pgmap v627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:18 smithi033 ceph-mon[101165]: pgmap v628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:18 smithi033 ceph-mon[101165]: pgmap v629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:19.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:18 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:00:19.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:18 smithi037 ceph-mon[69017]: pgmap v627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:19.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:18 smithi037 ceph-mon[69017]: pgmap v628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:19.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:18 smithi037 ceph-mon[69017]: pgmap v629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:21.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:20 smithi033 ceph-mon[101165]: pgmap v630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:21.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:20 smithi037 ceph-mon[69017]: pgmap v630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:23.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:22 smithi033 ceph-mon[101165]: pgmap v631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:23.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:22 smithi037 ceph-mon[69017]: pgmap v631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:24 smithi033 ceph-mon[101165]: pgmap v632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:25.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:24 smithi037 ceph-mon[69017]: pgmap v632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:26 smithi033 ceph-mon[101165]: pgmap v633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:26 smithi037 ceph-mon[69017]: pgmap v633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:28 smithi033 ceph-mon[101165]: pgmap v634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:28 smithi037 ceph-mon[69017]: pgmap v634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:30 smithi033 ceph-mon[101165]: pgmap v635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:30 smithi037 ceph-mon[69017]: pgmap v635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:32 smithi033 ceph-mon[101165]: pgmap v636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:32 smithi037 ceph-mon[69017]: pgmap v636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:34 smithi033 ceph-mon[101165]: pgmap v637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:35.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:34 smithi037 ceph-mon[69017]: pgmap v637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:36 smithi033 ceph-mon[101165]: pgmap v638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:37.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:36 smithi037 ceph-mon[69017]: pgmap v638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:38 smithi033 ceph-mon[101165]: pgmap v639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:39.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:38 smithi037 ceph-mon[69017]: pgmap v639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:40 smithi033 ceph-mon[101165]: pgmap v640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:40 smithi037 ceph-mon[69017]: pgmap v640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:42 smithi033 ceph-mon[101165]: pgmap v641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:43.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:42 smithi037 ceph-mon[69017]: pgmap v641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:44.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 -- 172.21.15.33:0/2903916431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f66e0 msgr2=0x7f20c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:44.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 --2- 172.21.15.33:0/2903916431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f66e0 0x7f20c00f6b00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f20b0004660 tx=0x7f20b0009b30).stop 2022-02-02T14:00:44.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 -- 172.21.15.33:0/2903916431 shutdown_connections 2022-02-02T14:00:44.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 --2- 172.21.15.33:0/2903916431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f7980 0x7f20c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:44.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 --2- 172.21.15.33:0/2903916431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f66e0 0x7f20c00f6b00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:44.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 -- 172.21.15.33:0/2903916431 >> 172.21.15.33:0/2903916431 conn(0x7f20c00f1e40 msgr2=0x7f20c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:44.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 -- 172.21.15.33:0/2903916431 shutdown_connections 2022-02-02T14:00:44.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.883+0000 7f20c773a700 1 -- 172.21.15.33:0/2903916431 wait complete. 2022-02-02T14:00:44.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 Processor -- start 2022-02-02T14:00:44.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 -- start start 2022-02-02T14:00:44.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 0x7f20c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:44.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c006a380 con 0x7f20c00f7980 2022-02-02T14:00:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c773a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c006a4c0 con 0x7f20c00f66e0 2022-02-02T14:00:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c4cd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c4cd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59138/0 (socket says 172.21.15.33:59138) 2022-02-02T14:00:44.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.884+0000 7f20c4cd5700 1 -- 172.21.15.33:0/2065869255 learned_addr learned my addr 172.21.15.33:0/2065869255 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c54d6700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 0x7f20c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c4cd5700 1 -- 172.21.15.33:0/2065869255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 msgr2=0x7f20c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c4cd5700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 0x7f20c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:44.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c4cd5700 1 -- 172.21.15.33:0/2065869255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b0005040 con 0x7f20c00f7980 2022-02-02T14:00:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c54d6700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 0x7f20c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:00:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c4cd5700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f20bc00e7f0 tx=0x7f20bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20bc0092e0 con 0x7f20c00f7980 2022-02-02T14:00:44.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f20bc00f040 con 0x7f20c00f7980 2022-02-02T14:00:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20c006a7a0 con 0x7f20c00f7980 2022-02-02T14:00:44.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.885+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20bc014750 con 0x7f20c00f7980 2022-02-02T14:00:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.886+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20c010ef90 con 0x7f20c00f7980 2022-02-02T14:00:44.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.886+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20c0045ad0 con 0x7f20c00f7980 2022-02-02T14:00:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.887+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f20bc01b030 con 0x7f20c00f7980 2022-02-02T14:00:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.887+0000 7f20b5ffb700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 0x7f20ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.887+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f20bc081870 con 0x7f20c00f7980 2022-02-02T14:00:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.887+0000 7f20c54d6700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 0x7f20ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:44.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.888+0000 7f20c54d6700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 0x7f20ac067290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f20b0000c00 tx=0x7f20b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:44.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:44.892+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f20bc053400 con 0x7f20c00f7980 2022-02-02T14:00:45.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.084+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f20c00ff010 con 0x7f20ac064dd0 2022-02-02T14:00:45.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.085+0000 7f20b5ffb700 1 -- 172.21.15.33:0/2065869255 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f20c00ff010 con 0x7f20ac064dd0 2022-02-02T14:00:45.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 msgr2=0x7f20ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 0x7f20ac067290 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f20b0000c00 tx=0x7f20b000b040).stop 2022-02-02T14:00:45.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 msgr2=0x7f20c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f20bc00e7f0 tx=0x7f20bc00b040).stop 2022-02-02T14:00:45.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 shutdown_connections 2022-02-02T14:00:45.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f20ac064dd0 0x7f20ac067290 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20c00f66e0 0x7f20c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 --2- 172.21.15.33:0/2065869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20c00f7980 0x7f20c0069e20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 >> 172.21.15.33:0/2065869255 conn(0x7f20c00f1e40 msgr2=0x7f20c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 shutdown_connections 2022-02-02T14:00:45.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.087+0000 7f20c773a700 1 -- 172.21.15.33:0/2065869255 wait complete. 2022-02-02T14:00:45.096 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:00:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 -- 172.21.15.33:0/1904446695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 msgr2=0x7ff8040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 --2- 172.21.15.33:0/1904446695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff8040f7de0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7ff7f4004660 tx=0x7ff7f4009b30).stop 2022-02-02T14:00:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 -- 172.21.15.33:0/1904446695 shutdown_connections 2022-02-02T14:00:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 --2- 172.21.15.33:0/1904446695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff8040f7de0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 --2- 172.21.15.33:0/1904446695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 0x7ff8040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 -- 172.21.15.33:0/1904446695 >> 172.21.15.33:0/1904446695 conn(0x7ff8040f1e40 msgr2=0x7ff8040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 -- 172.21.15.33:0/1904446695 shutdown_connections 2022-02-02T14:00:45.190 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:44 smithi033 ceph-mon[101165]: pgmap v642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:45.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.188+0000 7ff8089c0700 1 -- 172.21.15.33:0/1904446695 wait complete. 2022-02-02T14:00:45.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 Processor -- start 2022-02-02T14:00:45.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 -- start start 2022-02-02T14:00:45.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 0x7ff80406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80406a380 con 0x7ff8040f7980 2022-02-02T14:00:45.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff8089c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80406a4c0 con 0x7ff8040f66e0 2022-02-02T14:00:45.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff801d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff801d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59148/0 (socket says 172.21.15.33:59148) 2022-02-02T14:00:45.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.189+0000 7ff801d9b700 1 -- 172.21.15.33:0/2817337934 learned_addr learned my addr 172.21.15.33:0/2817337934 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:45.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff80259c700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 0x7ff80406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff801d9b700 1 -- 172.21.15.33:0/2817337934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 msgr2=0x7ff80406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff801d9b700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 0x7ff80406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff801d9b700 1 -- 172.21.15.33:0/2817337934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4005040 con 0x7ff8040f7980 2022-02-02T14:00:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff801d9b700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff7f4009830 tx=0x7ff7f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f4018070 con 0x7ff8040f7980 2022-02-02T14:00:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7f4007ba0 con 0x7ff8040f7980 2022-02-02T14:00:45.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80406a740 con 0x7ff8040f7980 2022-02-02T14:00:45.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80406aca0 con 0x7ff8040f7980 2022-02-02T14:00:45.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.190+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f401c620 con 0x7ff8040f7980 2022-02-02T14:00:45.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.191+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e8004fa0 con 0x7ff8040f7980 2022-02-02T14:00:45.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.192+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff7f401c8a0 con 0x7ff8040f7980 2022-02-02T14:00:45.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.192+0000 7ff7faffd700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 0x7ff7f0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.192+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff7f4083770 con 0x7ff8040f7980 2022-02-02T14:00:45.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.192+0000 7ff80259c700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 0x7ff7f0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.192+0000 7ff80259c700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 0x7ff7f0067270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff80406b730 tx=0x7ff7ec009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.196+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff7f40518e0 con 0x7ff8040f7980 2022-02-02T14:00:45.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:44 smithi037 ceph-mon[69017]: pgmap v642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.378+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7e8000bc0 con 0x7ff7f0064db0 2022-02-02T14:00:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.393+0000 7ff7faffd700 1 -- 172.21.15.33:0/2817337934 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff7e8000bc0 con 0x7ff7f0064db0 2022-02-02T14:00:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:00:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (26m) 8m ago 27m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:00:45.393 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (19m) 8m ago 27m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:00:45.394 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (19m) 8m ago 26m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:00:45.394 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (25m) 8m ago 26m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:00:45.394 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (19m) 8m ago 23m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:00:45.394 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (20m) 8m ago 23m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:00:45.395 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (20m) 8m ago 23m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:00:45.395 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (23m) 8m ago 23m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:00:45.395 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (20m) 8m ago 28m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:00:45.395 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (20m) 8m ago 26m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:00:45.396 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (20m) 8m ago 28m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:00:45.396 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (19m) 8m ago 26m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:00:45.396 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (26m) 8m ago 26m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:00:45.396 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (26m) 8m ago 26m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:00:45.396 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8m ago 25m - 4096M 2022-02-02T14:00:45.397 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (25m) 8m ago 25m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:00:45.397 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (25m) 8m ago 25m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:00:45.397 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (24m) 8m ago 24m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:00:45.397 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (24m) 8m ago 24m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:00:45.398 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (24m) 8m ago 24m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:00:45.398 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (25m) 8m ago 26m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:00:45.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 msgr2=0x7ff7f0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 0x7ff7f0067270 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7ff80406b730 tx=0x7ff7ec009c80).stop 2022-02-02T14:00:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 msgr2=0x7ff804069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff7f4009830 tx=0x7ff7f4009b30).stop 2022-02-02T14:00:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 shutdown_connections 2022-02-02T14:00:45.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff7f0064db0 0x7ff7f0067270 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8040f66e0 0x7ff80406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 --2- 172.21.15.33:0/2817337934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8040f7980 0x7ff804069e20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.395+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 >> 172.21.15.33:0/2817337934 conn(0x7ff8040f1e40 msgr2=0x7ff8040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.396+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 shutdown_connections 2022-02-02T14:00:45.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.396+0000 7ff8089c0700 1 -- 172.21.15.33:0/2817337934 wait complete. 2022-02-02T14:00:45.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 -- 172.21.15.33:0/2023383379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 msgr2=0x7ff4d40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 --2- 172.21.15.33:0/2023383379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d40f6b30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7ff4c4004660 tx=0x7ff4c4009b30).stop 2022-02-02T14:00:45.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 -- 172.21.15.33:0/2023383379 shutdown_connections 2022-02-02T14:00:45.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 --2- 172.21.15.33:0/2023383379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d40f6b30 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 --2- 172.21.15.33:0/2023383379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 0x7ff4d40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.499+0000 7ff4dade2700 1 -- 172.21.15.33:0/2023383379 >> 172.21.15.33:0/2023383379 conn(0x7ff4d40f0b90 msgr2=0x7ff4d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 -- 172.21.15.33:0/2023383379 shutdown_connections 2022-02-02T14:00:45.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 -- 172.21.15.33:0/2023383379 wait complete. 2022-02-02T14:00:45.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 Processor -- start 2022-02-02T14:00:45.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 -- start start 2022-02-02T14:00:45.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 0x7ff4d4109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40603c0 con 0x7ff4d40f66d0 2022-02-02T14:00:45.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4dade2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4060500 con 0x7ff4d40f5430 2022-02-02T14:00:45.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4d95df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4d95df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59158/0 (socket says 172.21.15.33:59158) 2022-02-02T14:00:45.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.500+0000 7ff4d95df700 1 -- 172.21.15.33:0/3750696298 learned_addr learned my addr 172.21.15.33:0/3750696298 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:45.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4d9de0700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 0x7ff4d4109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4d95df700 1 -- 172.21.15.33:0/3750696298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 msgr2=0x7ff4d4109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4d95df700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 0x7ff4d4109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4d95df700 1 -- 172.21.15.33:0/3750696298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4005040 con 0x7ff4d40f66d0 2022-02-02T14:00:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4d95df700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff4c4009da0 tx=0x7ff4c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c4018070 con 0x7ff4d40f66d0 2022-02-02T14:00:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4c4007cf0 con 0x7ff4d40f66d0 2022-02-02T14:00:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d410c490 con 0x7ff4d40f66d0 2022-02-02T14:00:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c401c620 con 0x7ff4d40f66d0 2022-02-02T14:00:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.501+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d410c9c0 con 0x7ff4d40f66d0 2022-02-02T14:00:45.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.502+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d4059100 con 0x7ff4d40f66d0 2022-02-02T14:00:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.503+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4c401d420 con 0x7ff4d40f66d0 2022-02-02T14:00:45.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.503+0000 7ff4ca7fc700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 0x7ff4c00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.503+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff4c40839a0 con 0x7ff4d40f66d0 2022-02-02T14:00:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.503+0000 7ff4d9de0700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 0x7ff4c00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.504+0000 7ff4d9de0700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 0x7ff4c00672e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff4d4060040 tx=0x7ff4d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.507+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4c4051b10 con 0x7ff4d40f66d0 2022-02-02T14:00:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.751+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff4d4045ad0 con 0x7ff4d40f66d0 2022-02-02T14:00:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.751+0000 7ff4ca7fc700 1 -- 172.21.15.33:0/3750696298 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff4c4055130 con 0x7ff4d40f66d0 2022-02-02T14:00:45.761 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:00:45.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:00:45.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:00:45.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:45.771 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:00:45.771 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:00:45.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:45.772 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:00:45.772 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:00:45.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:45.773 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:00:45.774 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:00:45.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:00:45.775 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:00:45.775 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:00:45.775 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:00:45.776 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:00:45.776 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:00:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 msgr2=0x7ff4c00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 0x7ff4c00672e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7ff4d4060040 tx=0x7ff4d0009040).stop 2022-02-02T14:00:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 msgr2=0x7ff4d410bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7ff4c4009da0 tx=0x7ff4c4009b30).stop 2022-02-02T14:00:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 shutdown_connections 2022-02-02T14:00:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064e20 0x7ff4c00672e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f5430 0x7ff4d4109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 --2- 172.21.15.33:0/3750696298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f66d0 0x7ff4d410bf40 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 >> 172.21.15.33:0/3750696298 conn(0x7ff4d40f0b90 msgr2=0x7ff4d40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 shutdown_connections 2022-02-02T14:00:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.754+0000 7ff4dade2700 1 -- 172.21.15.33:0/3750696298 wait complete. 2022-02-02T14:00:45.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.855+0000 7f703e448700 1 -- 172.21.15.33:0/2110246761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f7980 msgr2=0x7f70380f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.855+0000 7f703e448700 1 --2- 172.21.15.33:0/2110246761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f7980 0x7f70380f7de0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f702c004660 tx=0x7f702c009b30).stop 2022-02-02T14:00:45.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.855+0000 7f703e448700 1 -- 172.21.15.33:0/2110246761 shutdown_connections 2022-02-02T14:00:45.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.855+0000 7f703e448700 1 --2- 172.21.15.33:0/2110246761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f7980 0x7f70380f7de0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 --2- 172.21.15.33:0/2110246761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f66e0 0x7f70380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- 172.21.15.33:0/2110246761 >> 172.21.15.33:0/2110246761 conn(0x7f70380f1e40 msgr2=0x7f70380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- 172.21.15.33:0/2110246761 shutdown_connections 2022-02-02T14:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- 172.21.15.33:0/2110246761 wait complete. 2022-02-02T14:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 Processor -- start 2022-02-02T14:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- start start 2022-02-02T14:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f7980 0x7f7038069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703806a380 con 0x7f70380f66e0 2022-02-02T14:00:45.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.856+0000 7f703e448700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703806a4c0 con 0x7f70380f7980 2022-02-02T14:00:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59166/0 (socket says 172.21.15.33:59166) 2022-02-02T14:00:45.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 -- 172.21.15.33:0/830168771 learned_addr learned my addr 172.21.15.33:0/830168771 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:00:45.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f70377fe700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f7980 0x7f7038069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 -- 172.21.15.33:0/830168771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f7980 msgr2=0x7f7038069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:45.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f7980 0x7f7038069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:45.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 -- 172.21.15.33:0/830168771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c005040 con 0x7f70380f66e0 2022-02-02T14:00:45.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7037fff700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f702800c530 tx=0x7f7028007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f702800f650 con 0x7f70380f66e0 2022-02-02T14:00:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703806a7a0 con 0x7f70380f66e0 2022-02-02T14:00:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f702800fc60 con 0x7f70380f66e0 2022-02-02T14:00:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7028012d20 con 0x7f70380f66e0 2022-02-02T14:00:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.857+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703810ef90 con 0x7f70380f66e0 2022-02-02T14:00:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.859+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7038045ad0 con 0x7f70380f66e0 2022-02-02T14:00:45.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.859+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7028019030 con 0x7f70380f66e0 2022-02-02T14:00:45.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.859+0000 7f7034ff9700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 0x7f7020067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:00:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.859+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7028081700 con 0x7f70380f66e0 2022-02-02T14:00:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.859+0000 7f70377fe700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 0x7f7020067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:00:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.860+0000 7f70377fe700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 0x7f7020067290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f702c004e30 tx=0x7f702c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:00:45.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:45.864+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f702804f800 con 0x7f70380f66e0 2022-02-02T14:00:46.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.080+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70380ff020 con 0x7f70380f66e0 2022-02-02T14:00:46.080 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:45 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3750696298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:00:46.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.080+0000 7f7034ff9700 1 -- 172.21.15.33:0/830168771 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7028052e20 con 0x7f70380f66e0 2022-02-02T14:00:46.081 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:00:46.081 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:00:46.082 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:00:46.082 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:00:46.082 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:46.082 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:00:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:00:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:00:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:00:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:00:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:00:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:00:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:00:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:00:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:00:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:00:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:00:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:00:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:00:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:00:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:00:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:00:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:00:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:00:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:00:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:00:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:00:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:00:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:00:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:00:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:00:46.088 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:46.088 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:46.089 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:00:46.089 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:00:46.090 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:46.090 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:46.091 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:46.091 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:00:46.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 msgr2=0x7f7020067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:46.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 0x7f7020067290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f702c004e30 tx=0x7f702c009b30).stop 2022-02-02T14:00:46.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 msgr2=0x7f703806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:00:46.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f702800c530 tx=0x7f7028007e10).stop 2022-02-02T14:00:46.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 shutdown_connections 2022-02-02T14:00:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7020064dd0 0x7f7020067290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70380f66e0 0x7f703806b9a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 --2- 172.21.15.33:0/830168771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70380f7980 0x7f7038069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:00:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.082+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 >> 172.21.15.33:0/830168771 conn(0x7f70380f1e40 msgr2=0x7f70380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:00:46.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.083+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 shutdown_connections 2022-02-02T14:00:46.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:00:46.083+0000 7f703e448700 1 -- 172.21.15.33:0/830168771 wait complete. 2022-02-02T14:00:46.096 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:00:46.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:45 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3750696298' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:00:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:46 smithi033 ceph-mon[101165]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:46 smithi033 ceph-mon[101165]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:47.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:46 smithi033 ceph-mon[101165]: pgmap v643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:47.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/830168771' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:00:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:46 smithi037 ceph-mon[69017]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:46 smithi037 ceph-mon[69017]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:00:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:46 smithi037 ceph-mon[69017]: pgmap v643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/830168771' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:00:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:48 smithi033 ceph-mon[101165]: pgmap v644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:48 smithi037 ceph-mon[69017]: pgmap v644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:50 smithi033 ceph-mon[101165]: pgmap v645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:51.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:50 smithi037 ceph-mon[69017]: pgmap v645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:52 smithi033 ceph-mon[101165]: pgmap v646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:53.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:52 smithi037 ceph-mon[69017]: pgmap v646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:54 smithi033 ceph-mon[101165]: pgmap v647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:00:55.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:00:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:54 smithi037 ceph-mon[69017]: pgmap v647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:00:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:00:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:56 smithi033 ceph-mon[101165]: pgmap v648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:56 smithi037 ceph-mon[69017]: pgmap v648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:00:58 smithi033 ceph-mon[101165]: pgmap v649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:00:59.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:00:58 smithi037 ceph-mon[69017]: pgmap v649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:00 smithi033 ceph-mon[101165]: pgmap v650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:01.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:00 smithi037 ceph-mon[69017]: pgmap v650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:03.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:02 smithi033 ceph-mon[101165]: pgmap v651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:03.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:02 smithi037 ceph-mon[69017]: pgmap v651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:04 smithi033 ceph-mon[101165]: pgmap v652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:04 smithi037 ceph-mon[69017]: pgmap v652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:07.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:06 smithi033 ceph-mon[101165]: pgmap v653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:06 smithi037 ceph-mon[69017]: pgmap v653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:08 smithi033 ceph-mon[101165]: pgmap v654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:09.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:08 smithi037 ceph-mon[69017]: pgmap v654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:10 smithi033 ceph-mon[101165]: pgmap v655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:11.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:10 smithi037 ceph-mon[69017]: pgmap v655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:13.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:12 smithi033 ceph-mon[101165]: pgmap v656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:12 smithi037 ceph-mon[69017]: pgmap v656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:14 smithi033 ceph-mon[101165]: pgmap v657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:14 smithi037 ceph-mon[69017]: pgmap v657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 -- 172.21.15.33:0/3495641320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f6860 msgr2=0x7fd6ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/3495641320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac0f6cc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fd694004660 tx=0x7fd694009b30).stop 2022-02-02T14:01:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 -- 172.21.15.33:0/3495641320 shutdown_connections 2022-02-02T14:01:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/3495641320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac0f6cc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/3495641320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 -- 172.21.15.33:0/3495641320 >> 172.21.15.33:0/3495641320 conn(0x7fd6ac0f0d40 msgr2=0x7fd6ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 -- 172.21.15.33:0/3495641320 shutdown_connections 2022-02-02T14:01:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.199+0000 7fd6b0a42700 1 -- 172.21.15.33:0/3495641320 wait complete. 2022-02-02T14:01:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 Processor -- start 2022-02-02T14:01:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 -- start start 2022-02-02T14:01:16.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac107640 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.200+0000 7fd6b0a42700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac10e580 con 0x7fd6ac0f6860 2022-02-02T14:01:16.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59176/0 (socket says 172.21.15.33:59176) 2022-02-02T14:01:16.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 -- 172.21.15.33:0/785250167 learned_addr learned my addr 172.21.15.33:0/785250167 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:16.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6a9d9b700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 -- 172.21.15.33:0/785250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f6860 msgr2=0x7fd6ac10e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac10e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 -- 172.21.15.33:0/785250167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694005040 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6aa59c700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fd69c00e7c0 tx=0x7fd69c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd69c0092e0 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac10e860 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd69c00f040 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd69c0147e0 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.201+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac10ee20 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.202+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac045ad0 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.203+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd69c01b030 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.203+0000 7fd6a2ffd700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 0x7fd698067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.204+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd69c081b10 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.204+0000 7fd6a9d9b700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 0x7fd698067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.204+0000 7fd6a9d9b700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 0x7fd698067290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd694005010 tx=0x7fd694016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.208+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd69c053530 con 0x7fd6ac0f55c0 2022-02-02T14:01:16.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.396+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6ac057f10 con 0x7fd698064dd0 2022-02-02T14:01:16.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.398+0000 7fd6a2ffd700 1 -- 172.21.15.33:0/785250167 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd6ac057f10 con 0x7fd698064dd0 2022-02-02T14:01:16.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.399+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 msgr2=0x7fd698067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.399+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 0x7fd698067290 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fd694005010 tx=0x7fd694016040).stop 2022-02-02T14:01:16.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.399+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 msgr2=0x7fd6ac10bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.399+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fd69c00e7c0 tx=0x7fd69c00b040).stop 2022-02-02T14:01:16.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 shutdown_connections 2022-02-02T14:01:16.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd698064dd0 0x7fd698067290 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6ac0f55c0 0x7fd6ac10bb90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 --2- 172.21.15.33:0/785250167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6ac0f6860 0x7fd6ac10e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 >> 172.21.15.33:0/785250167 conn(0x7fd6ac0f0d40 msgr2=0x7fd6ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:16.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 shutdown_connections 2022-02-02T14:01:16.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.400+0000 7fd6b0a42700 1 -- 172.21.15.33:0/785250167 wait complete. 2022-02-02T14:01:16.413 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:01:16.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 -- 172.21.15.33:0/2680864648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 msgr2=0x7f0e040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 --2- 172.21.15.33:0/2680864648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e040f6b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f0e00004660 tx=0x7f0e00009b30).stop 2022-02-02T14:01:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 -- 172.21.15.33:0/2680864648 shutdown_connections 2022-02-02T14:01:16.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 --2- 172.21.15.33:0/2680864648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 0x7f0e040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 --2- 172.21.15.33:0/2680864648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e040f6b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 -- 172.21.15.33:0/2680864648 >> 172.21.15.33:0/2680864648 conn(0x7f0e040f1e40 msgr2=0x7f0e040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 -- 172.21.15.33:0/2680864648 shutdown_connections 2022-02-02T14:01:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.501+0000 7f0e0c166700 1 -- 172.21.15.33:0/2680864648 wait complete. 2022-02-02T14:01:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 Processor -- start 2022-02-02T14:01:16.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 -- start start 2022-02-02T14:01:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 0x7f0e04107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04107a00 con 0x7f0e040f66e0 2022-02-02T14:01:16.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e0c166700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e04107b40 con 0x7f0e040f7980 2022-02-02T14:01:16.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59186/0 (socket says 172.21.15.33:59186) 2022-02-02T14:01:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 -- 172.21.15.33:0/3965325065 learned_addr learned my addr 172.21.15.33:0/3965325065 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:16.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09701700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 0x7f0e04107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 -- 172.21.15.33:0/3965325065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 msgr2=0x7f0e04107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 0x7f0e04107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.502+0000 7f0e09f02700 1 -- 172.21.15.33:0/3965325065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e00005040 con 0x7f0e040f66e0 2022-02-02T14:01:16.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0e09f02700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f0e00014040 tx=0x7f0e0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e00019070 con 0x7f0e040f66e0 2022-02-02T14:01:16.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e00007e70 con 0x7f0e040f66e0 2022-02-02T14:01:16.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e04108480 con 0x7f0e040f66e0 2022-02-02T14:01:16.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e00014d10 con 0x7f0e040f66e0 2022-02-02T14:01:16.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.503+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e041089e0 con 0x7f0e040f66e0 2022-02-02T14:01:16.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.504+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e04045ad0 con 0x7f0e040f66e0 2022-02-02T14:01:16.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.504+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e00025070 con 0x7f0e040f66e0 2022-02-02T14:01:16.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.505+0000 7f0df67fc700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 0x7f0df0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.505+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e00082990 con 0x7f0e040f66e0 2022-02-02T14:01:16.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.505+0000 7f0e09701700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 0x7f0df0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.505+0000 7f0e09701700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 0x7f0df0067290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0df8009fd0 tx=0x7f0df800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.509+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e00054470 con 0x7f0e040f66e0 2022-02-02T14:01:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.693+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e040ff020 con 0x7f0df0064dd0 2022-02-02T14:01:16.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.708+0000 7f0df67fc700 1 -- 172.21.15.33:0/3965325065 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0e040ff020 con 0x7f0df0064dd0 2022-02-02T14:01:16.710 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:01:16.710 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (26m) 9m ago 27m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:01:16.711 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (19m) 9m ago 27m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:01:16.711 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (19m) 9m ago 27m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:01:16.712 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (26m) 9m ago 27m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:01:16.712 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (20m) 9m ago 23m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:01:16.712 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (20m) 9m ago 23m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:01:16.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (21m) 9m ago 23m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:01:16.713 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (23m) 9m ago 23m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:01:16.714 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (21m) 9m ago 28m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:01:16.714 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (20m) 9m ago 27m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:01:16.715 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (20m) 9m ago 28m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:01:16.715 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (20m) 9m ago 26m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:01:16.716 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (27m) 9m ago 27m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:01:16.716 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (26m) 9m ago 26m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:01:16.716 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 26m - 4096M 2022-02-02T14:01:16.717 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (25m) 9m ago 25m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:01:16.717 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (25m) 9m ago 25m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:01:16.718 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (25m) 9m ago 25m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:01:16.718 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (25m) 9m ago 25m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:01:16.719 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (24m) 9m ago 24m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:01:16.719 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (26m) 9m ago 27m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:01:16.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 msgr2=0x7f0df0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 0x7f0df0067290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f0df8009fd0 tx=0x7f0df800b040).stop 2022-02-02T14:01:16.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 msgr2=0x7f0e04106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f0e00014040 tx=0x7f0e0000b040).stop 2022-02-02T14:01:16.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 shutdown_connections 2022-02-02T14:01:16.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0df0064dd0 0x7f0df0067290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e040f66e0 0x7f0e04106f60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 --2- 172.21.15.33:0/3965325065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e040f7980 0x7f0e04107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 >> 172.21.15.33:0/3965325065 conn(0x7f0e040f1e40 msgr2=0x7f0e040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:16.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 shutdown_connections 2022-02-02T14:01:16.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.710+0000 7f0e0c166700 1 -- 172.21.15.33:0/3965325065 wait complete. 2022-02-02T14:01:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.809+0000 7f1e8359e700 1 -- 172.21.15.33:0/3732303820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 msgr2=0x7f1e840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.809+0000 7f1e8359e700 1 --2- 172.21.15.33:0/3732303820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e840f5850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f1e74004660 tx=0x7f1e74009b30).stop 2022-02-02T14:01:16.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 -- 172.21.15.33:0/3732303820 shutdown_connections 2022-02-02T14:01:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 --2- 172.21.15.33:0/3732303820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 0x7f1e840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 --2- 172.21.15.33:0/3732303820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e840f5850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 -- 172.21.15.33:0/3732303820 >> 172.21.15.33:0/3732303820 conn(0x7f1e840f0b90 msgr2=0x7f1e840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:16.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 -- 172.21.15.33:0/3732303820 shutdown_connections 2022-02-02T14:01:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 -- 172.21.15.33:0/3732303820 wait complete. 2022-02-02T14:01:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 Processor -- start 2022-02-02T14:01:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.810+0000 7f1e8359e700 1 -- start start 2022-02-02T14:01:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 0x7f1e8410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840603e0 con 0x7f1e840f5430 2022-02-02T14:01:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e84060520 con 0x7f1e840f66d0 2022-02-02T14:01:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59196/0 (socket says 172.21.15.33:59196) 2022-02-02T14:01:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 -- 172.21.15.33:0/2376777934 learned_addr learned my addr 172.21.15.33:0/2376777934 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e81d9b700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 0x7f1e8410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 -- 172.21.15.33:0/2376777934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 msgr2=0x7f1e8410bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 0x7f1e8410bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 -- 172.21.15.33:0/2376777934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74005040 con 0x7f1e840f5430 2022-02-02T14:01:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e8259c700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f1e74004f60 tx=0x7f1e74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e74018070 con 0x7f1e840f5430 2022-02-02T14:01:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.811+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e74009770 con 0x7f1e840f5430 2022-02-02T14:01:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.812+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8410c4e0 con 0x7f1e840f5430 2022-02-02T14:01:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.812+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e7401c3c0 con 0x7f1e840f5430 2022-02-02T14:01:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.812+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8410ca40 con 0x7f1e840f5430 2022-02-02T14:01:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.813+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e84045ad0 con 0x7f1e840f5430 2022-02-02T14:01:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.813+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e7401d420 con 0x7f1e840f5430 2022-02-02T14:01:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.814+0000 7f1e72ffd700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 0x7f1e6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.814+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1e74083f40 con 0x7f1e840f5430 2022-02-02T14:01:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.814+0000 7f1e81d9b700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 0x7f1e6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:16.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.815+0000 7f1e81d9b700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 0x7f1e6c0672e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f1e780041d0 tx=0x7f1e78009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:16.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:16.818+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e74052070 con 0x7f1e840f5430 2022-02-02T14:01:17.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.063+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e840fdcf0 con 0x7f1e840f5430 2022-02-02T14:01:17.064 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:16 smithi033 ceph-mon[101165]: pgmap v658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.063+0000 7f1e72ffd700 1 -- 172.21.15.33:0/2376777934 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f1e74055690 con 0x7f1e840f5430 2022-02-02T14:01:17.065 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:01:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:01:17.065 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:01:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:01:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:01:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:17.066 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:01:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:01:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:17.067 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:01:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:01:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:01:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:01:17.068 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:01:17.069 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:01:17.069 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:01:17.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 msgr2=0x7f1e6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 0x7f1e6c0672e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f1e780041d0 tx=0x7f1e78009040).stop 2022-02-02T14:01:17.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 msgr2=0x7f1e84109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f1e74004f60 tx=0x7f1e74009b30).stop 2022-02-02T14:01:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 shutdown_connections 2022-02-02T14:01:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064e20 0x7f1e6c0672e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e840f5430 0x7f1e84109a90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 --2- 172.21.15.33:0/2376777934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e840f66d0 0x7f1e8410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 >> 172.21.15.33:0/2376777934 conn(0x7f1e840f0b90 msgr2=0x7f1e840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 shutdown_connections 2022-02-02T14:01:17.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.065+0000 7f1e8359e700 1 -- 172.21.15.33:0/2376777934 wait complete. 2022-02-02T14:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 -- 172.21.15.33:0/2935050376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 msgr2=0x7f6bbc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/2935050376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc0f59e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f6bb8004660 tx=0x7f6bb8009b30).stop 2022-02-02T14:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 -- 172.21.15.33:0/2935050376 shutdown_connections 2022-02-02T14:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/2935050376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 0x7f6bbc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/2935050376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc0f59e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 -- 172.21.15.33:0/2935050376 >> 172.21.15.33:0/2935050376 conn(0x7f6bbc0f0d40 msgr2=0x7f6bbc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 -- 172.21.15.33:0/2935050376 shutdown_connections 2022-02-02T14:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.166+0000 7f6bc33a3700 1 -- 172.21.15.33:0/2935050376 wait complete. 2022-02-02T14:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 Processor -- start 2022-02-02T14:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 -- start start 2022-02-02T14:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 0x7f6bbc107480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc107ac0 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc33a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc108370 con 0x7f6bbc0f6860 2022-02-02T14:01:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59206/0 (socket says 172.21.15.33:59206) 2022-02-02T14:01:17.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 -- 172.21.15.33:0/4185165497 learned_addr learned my addr 172.21.15.33:0/4185165497 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc093e700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 0x7f6bbc107480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 -- 172.21.15.33:0/4185165497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 msgr2=0x7f6bbc107480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 0x7f6bbc107480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 -- 172.21.15.33:0/4185165497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8005040 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.167+0000 7f6bc113f700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6bb8004f60 tx=0x7f6bb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.168+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb8018070 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.168+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6bb8007ba0 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.168+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc1085f0 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.168+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bb801c620 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.168+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc108b50 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.169+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0f49b0 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.169+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6bb801c8e0 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.170+0000 7f6badffb700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 0x7f6ba8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:17.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.170+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6bb8083990 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.170+0000 7f6bc093e700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 0x7f6ba8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:17.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.170+0000 7f6bc093e700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 0x7f6ba8067290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6bb000b790 tx=0x7f6bb0008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:17.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.174+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6bb8055470 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:16 smithi037 ceph-mon[69017]: pgmap v658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.388+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6bbc0fdf80 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.388+0000 7f6badffb700 1 -- 172.21.15.33:0/4185165497 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6bb8055060 con 0x7f6bbc0f55c0 2022-02-02T14:01:17.390 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:01:17.390 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:01:17.390 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:01:17.391 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:01:17.391 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:17.391 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:01:17.392 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:01:17.392 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:01:17.393 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:01:17.393 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:01:17.393 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:01:17.393 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:01:17.394 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:01:17.395 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:01:17.395 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:01:17.396 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:01:17.396 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:01:17.396 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:01:17.396 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:01:17.397 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:01:17.397 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:01:17.397 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:01:17.397 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:01:17.398 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:01:17.398 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:01:17.398 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:01:17.399 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:01:17.399 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:01:17.399 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:01:17.399 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:01:17.400 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:01:17.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:17.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:17.400 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:01:17.401 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:17.401 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:17.401 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:17.401 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:17.401 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.390+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 msgr2=0x7f6ba8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.390+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 0x7f6ba8067290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f6bb000b790 tx=0x7f6bb0008040).stop 2022-02-02T14:01:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.390+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 msgr2=0x7f6bbc106f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.390+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f6bb8004f60 tx=0x7f6bb8009b30).stop 2022-02-02T14:01:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 shutdown_connections 2022-02-02T14:01:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ba8064dd0 0x7f6ba8067290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bbc0f55c0 0x7f6bbc106f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 --2- 172.21.15.33:0/4185165497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc0f6860 0x7f6bbc107480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 >> 172.21.15.33:0/4185165497 conn(0x7f6bbc0f0d40 msgr2=0x7f6bbc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 shutdown_connections 2022-02-02T14:01:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:17.391+0000 7f6bc33a3700 1 -- 172.21.15.33:0/4185165497 wait complete. 2022-02-02T14:01:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:01:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2376777934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:01:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4185165497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:01:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:01:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:01:18.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:17 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:01:18.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2376777934' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:01:18.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4185165497' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:01:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:01:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:01:18.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:17 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:01:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:18 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:01:19.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:18 smithi033 ceph-mon[101165]: pgmap v659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:01:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:01:19.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:18 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:01:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:18 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:01:19.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:18 smithi037 ceph-mon[69017]: pgmap v659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:19.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:01:19.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:01:19.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:18 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:01:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:19 smithi033 ceph-mon[101165]: pgmap v660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:19 smithi033 ceph-mon[101165]: pgmap v661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:19 smithi037 ceph-mon[69017]: pgmap v660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:20.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:19 smithi037 ceph-mon[69017]: pgmap v661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:21 smithi033 ceph-mon[101165]: pgmap v662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:22.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:21 smithi037 ceph-mon[69017]: pgmap v662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:23 smithi033 ceph-mon[101165]: pgmap v663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:24.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:23 smithi037 ceph-mon[69017]: pgmap v663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:25 smithi033 ceph-mon[101165]: pgmap v664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:25 smithi037 ceph-mon[69017]: pgmap v664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:27 smithi033 ceph-mon[101165]: pgmap v665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:27 smithi037 ceph-mon[69017]: pgmap v665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:29 smithi033 ceph-mon[101165]: pgmap v666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:29 smithi037 ceph-mon[69017]: pgmap v666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:32.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:31 smithi033 ceph-mon[101165]: pgmap v667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:32.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:31 smithi037 ceph-mon[69017]: pgmap v667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:33 smithi033 ceph-mon[101165]: pgmap v668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:33 smithi037 ceph-mon[69017]: pgmap v668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:35 smithi033 ceph-mon[101165]: pgmap v669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:35 smithi037 ceph-mon[69017]: pgmap v669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:37 smithi033 ceph-mon[101165]: pgmap v670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:37 smithi037 ceph-mon[69017]: pgmap v670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:40.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:39 smithi033 ceph-mon[101165]: pgmap v671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:39 smithi037 ceph-mon[69017]: pgmap v671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:41 smithi037 ceph-mon[69017]: pgmap v672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:41 smithi033 ceph-mon[101165]: pgmap v672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:44.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:43 smithi037 ceph-mon[69017]: pgmap v673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:44.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:43 smithi033 ceph-mon[101165]: pgmap v673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:45 smithi033 ceph-mon[101165]: pgmap v674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:45 smithi037 ceph-mon[69017]: pgmap v674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:47.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- 172.21.15.33:0/4118660752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 msgr2=0x7ff4d80f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 --2- 172.21.15.33:0/4118660752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d80f7de0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7ff4c4004660 tx=0x7ff4c4009b30).stop 2022-02-02T14:01:47.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- 172.21.15.33:0/4118660752 shutdown_connections 2022-02-02T14:01:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 --2- 172.21.15.33:0/4118660752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d80f7de0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 --2- 172.21.15.33:0/4118660752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 0x7ff4d80f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- 172.21.15.33:0/4118660752 >> 172.21.15.33:0/4118660752 conn(0x7ff4d80f1e40 msgr2=0x7ff4d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- 172.21.15.33:0/4118660752 shutdown_connections 2022-02-02T14:01:47.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- 172.21.15.33:0/4118660752 wait complete. 2022-02-02T14:01:47.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 Processor -- start 2022-02-02T14:01:47.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.508+0000 7ff4dece1700 1 -- start start 2022-02-02T14:01:47.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4dece1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 0x7ff4d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4dece1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4dece1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d806a380 con 0x7ff4d80f7980 2022-02-02T14:01:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4dece1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d806a4c0 con 0x7ff4d80f66e0 2022-02-02T14:01:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59218/0 (socket says 172.21.15.33:59218) 2022-02-02T14:01:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 -- 172.21.15.33:0/2658070622 learned_addr learned my addr 172.21.15.33:0/2658070622 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:47.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4dca7d700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 0x7ff4d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 -- 172.21.15.33:0/2658070622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 msgr2=0x7ff4d806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 0x7ff4d806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.509+0000 7ff4d7fff700 1 -- 172.21.15.33:0/2658070622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c4005040 con 0x7ff4d80f7980 2022-02-02T14:01:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4d7fff700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff4c4009990 tx=0x7ff4c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c4018070 con 0x7ff4d80f7980 2022-02-02T14:01:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4c4007ba0 con 0x7ff4d80f7980 2022-02-02T14:01:47.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d806a740 con 0x7ff4d80f7980 2022-02-02T14:01:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c401c3c0 con 0x7ff4d80f7980 2022-02-02T14:01:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.510+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d806aca0 con 0x7ff4d80f7980 2022-02-02T14:01:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.511+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d8045ad0 con 0x7ff4d80f7980 2022-02-02T14:01:47.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.512+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4c401d420 con 0x7ff4d80f7980 2022-02-02T14:01:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.512+0000 7ff4d57fa700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 0x7ff4c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.512+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff4c4083680 con 0x7ff4d80f7980 2022-02-02T14:01:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.512+0000 7ff4dca7d700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 0x7ff4c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.512+0000 7ff4dca7d700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 0x7ff4c8067290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff4d806b730 tx=0x7ff4cc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:47.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.516+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4c4051730 con 0x7ff4d80f7980 2022-02-02T14:01:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.705+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4d8057f10 con 0x7ff4c8064dd0 2022-02-02T14:01:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.706+0000 7ff4d57fa700 1 -- 172.21.15.33:0/2658070622 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff4d8057f10 con 0x7ff4c8064dd0 2022-02-02T14:01:47.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.708+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 msgr2=0x7ff4c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.708+0000 7ff4dece1700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 0x7ff4c8067290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7ff4d806b730 tx=0x7ff4cc00b040).stop 2022-02-02T14:01:47.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.708+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 msgr2=0x7ff4d8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.708+0000 7ff4dece1700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7ff4c4009990 tx=0x7ff4c4009b30).stop 2022-02-02T14:01:47.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 shutdown_connections 2022-02-02T14:01:47.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c8064dd0 0x7ff4c8067290 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d80f66e0 0x7ff4d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 --2- 172.21.15.33:0/2658070622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d80f7980 0x7ff4d8069e20 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 >> 172.21.15.33:0/2658070622 conn(0x7ff4d80f1e40 msgr2=0x7ff4d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 shutdown_connections 2022-02-02T14:01:47.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.709+0000 7ff4dece1700 1 -- 172.21.15.33:0/2658070622 wait complete. 2022-02-02T14:01:47.718 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:01:47.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 -- 172.21.15.33:0/2197562977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 msgr2=0x7f1e780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/2197562977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e780f6cc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1e60004660 tx=0x7f1e60009b30).stop 2022-02-02T14:01:47.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 -- 172.21.15.33:0/2197562977 shutdown_connections 2022-02-02T14:01:47.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/2197562977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e780f6cc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/2197562977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 0x7f1e780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:01:47.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 -- 172.21.15.33:0/2197562977 >> 172.21.15.33:0/2197562977 conn(0x7f1e780f0d40 msgr2=0x7f1e780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:47.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 -- 172.21.15.33:0/2197562977 shutdown_connections 2022-02-02T14:01:47.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.810+0000 7f1e7d03a700 1 -- 172.21.15.33:0/2197562977 wait complete. 2022-02-02T14:01:47.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 Processor -- start 2022-02-02T14:01:47.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 -- start start 2022-02-02T14:01:47.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 0x7f1e78109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780604b0 con 0x7f1e780f6860 2022-02-02T14:01:47.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7d03a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780605f0 con 0x7f1e780f55c0 2022-02-02T14:01:47.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59226/0 (socket says 172.21.15.33:59226) 2022-02-02T14:01:47.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 -- 172.21.15.33:0/3798363317 learned_addr learned my addr 172.21.15.33:0/3798363317 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:47.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e76d9d700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 0x7f1e78109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 -- 172.21.15.33:0/3798363317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 msgr2=0x7f1e78109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:47.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 0x7f1e78109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:47.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.811+0000 7f1e7659c700 1 -- 172.21.15.33:0/3798363317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60005040 con 0x7f1e780f6860 2022-02-02T14:01:47.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e7659c700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1e60009990 tx=0x7f1e60009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:47.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e60018070 con 0x7f1e780f6860 2022-02-02T14:01:47.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7810c770 con 0x7f1e780f6860 2022-02-02T14:01:47.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e60007ba0 con 0x7f1e780f6860 2022-02-02T14:01:47.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6001c620 con 0x7f1e780f6860 2022-02-02T14:01:47.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.812+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7810ccd0 con 0x7f1e780f6860 2022-02-02T14:01:47.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.813+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e78045ad0 con 0x7f1e780f6860 2022-02-02T14:01:47.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.814+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e6001c8e0 con 0x7f1e780f6860 2022-02-02T14:01:47.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.814+0000 7f1e6f7fe700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 0x7f1e64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:47.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.814+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1e600838e0 con 0x7f1e780f6860 2022-02-02T14:01:47.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.814+0000 7f1e76d9d700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 0x7f1e64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:47.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.815+0000 7f1e76d9d700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 0x7f1e64067290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f1e780600a0 tx=0x7f1e68008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:47.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:47.818+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e60051990 con 0x7f1e780f6860 2022-02-02T14:01:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.000+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e780fdfd0 con 0x7f1e64064dd0 2022-02-02T14:01:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.015+0000 7f1e6f7fe700 1 -- 172.21.15.33:0/3798363317 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1e6800b5f0 con 0x7f1e64064dd0 2022-02-02T14:01:48.015 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:01:48.015 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (27m) 9m ago 28m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:01:48.015 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (20m) 9m ago 28m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:01:48.015 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (20m) 9m ago 27m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:01:48.020 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (26m) 9m ago 27m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:01:48.020 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (20m) 9m ago 24m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:01:48.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (21m) 9m ago 24m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:01:48.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (21m) 9m ago 24m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:01:48.021 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (24m) 9m ago 24m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:01:48.021 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (21m) 9m ago 29m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:01:48.022 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (21m) 9m ago 27m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:01:48.022 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (21m) 9m ago 29m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:01:48.022 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (20m) 9m ago 27m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:01:48.023 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (27m) 9m ago 27m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:01:48.023 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (27m) 9m ago 27m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:01:48.023 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 26m - 4096M 2022-02-02T14:01:48.023 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (26m) 9m ago 26m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:01:48.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (26m) 9m ago 26m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:01:48.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (25m) 9m ago 25m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:01:48.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (25m) 9m ago 25m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:01:48.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (25m) 9m ago 25m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:01:48.024 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (26m) 9m ago 27m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:01:48.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 msgr2=0x7f1e64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 0x7f1e64067290 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f1e780600a0 tx=0x7f1e68008040).stop 2022-02-02T14:01:48.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 msgr2=0x7f1e7810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1e60009990 tx=0x7f1e60009b30).stop 2022-02-02T14:01:48.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 shutdown_connections 2022-02-02T14:01:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e64064dd0 0x7f1e64067290 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780f55c0 0x7f1e78109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 --2- 172.21.15.33:0/3798363317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e780f6860 0x7f1e7810c170 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 >> 172.21.15.33:0/3798363317 conn(0x7f1e780f0d40 msgr2=0x7f1e780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 shutdown_connections 2022-02-02T14:01:48.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.017+0000 7f1e7d03a700 1 -- 172.21.15.33:0/3798363317 wait complete. 2022-02-02T14:01:48.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 -- 172.21.15.33:0/24048442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 msgr2=0x7f06d006a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 --2- 172.21.15.33:0/24048442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d006a7d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f06c4004660 tx=0x7f06c4009b30).stop 2022-02-02T14:01:48.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 -- 172.21.15.33:0/24048442 shutdown_connections 2022-02-02T14:01:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 --2- 172.21.15.33:0/24048442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d006a7d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 --2- 172.21.15.33:0/24048442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 0x7f06d0069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.117+0000 7f06d6583700 1 -- 172.21.15.33:0/24048442 >> 172.21.15.33:0/24048442 conn(0x7f06d00f1e40 msgr2=0x7f06d00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:48.119 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:48 smithi033 ceph-mon[101165]: pgmap v675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:48.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 -- 172.21.15.33:0/24048442 shutdown_connections 2022-02-02T14:01:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 -- 172.21.15.33:0/24048442 wait complete. 2022-02-02T14:01:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 Processor -- start 2022-02-02T14:01:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 -- start start 2022-02-02T14:01:48.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 0x7f06d0109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0109be0 con 0x7f06d006a350 2022-02-02T14:01:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.118+0000 7f06d6583700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d0109d20 con 0x7f06d006b960 2022-02-02T14:01:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59234/0 (socket says 172.21.15.33:59234) 2022-02-02T14:01:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 -- 172.21.15.33:0/498359315 learned_addr learned my addr 172.21.15.33:0/498359315 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cf7fe700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 0x7f06d0109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 -- 172.21.15.33:0/498359315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 msgr2=0x7f06d0109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 0x7f06d0109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 -- 172.21.15.33:0/498359315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c4005040 con 0x7f06d006a350 2022-02-02T14:01:48.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06cffff700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f06c000c530 tx=0x7f06c0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:48.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c000f650 con 0x7f06d006a350 2022-02-02T14:01:48.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06c000fc60 con 0x7f06d006a350 2022-02-02T14:01:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.119+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d010a6c0 con 0x7f06d006a350 2022-02-02T14:01:48.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.120+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c0012c20 con 0x7f06d006a350 2022-02-02T14:01:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.120+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d010ac80 con 0x7f06d006a350 2022-02-02T14:01:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.121+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d0045ad0 con 0x7f06d006a350 2022-02-02T14:01:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.121+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06c0010070 con 0x7f06d006a350 2022-02-02T14:01:48.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.121+0000 7f06ccff9700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 0x7f06b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.121+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f06c0081760 con 0x7f06d006a350 2022-02-02T14:01:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.122+0000 7f06cf7fe700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 0x7f06b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.122+0000 7f06cf7fe700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 0x7f06b8067290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f06c4004630 tx=0x7f06c4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:48.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.126+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06c0053240 con 0x7f06d006a350 2022-02-02T14:01:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:48 smithi037 ceph-mon[69017]: pgmap v675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:48.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.374+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f06d0101160 con 0x7f06d006a350 2022-02-02T14:01:48.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.374+0000 7f06ccff9700 1 -- 172.21.15.33:0/498359315 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f06c0052e30 con 0x7f06d006a350 2022-02-02T14:01:48.375 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:01:48.375 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:01:48.375 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:01:48.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:48.376 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:01:48.376 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:01:48.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:48.376 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:01:48.377 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:01:48.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:48.377 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:01:48.377 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:01:48.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:01:48.378 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:01:48.378 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:01:48.378 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:01:48.379 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:01:48.379 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:01:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 msgr2=0x7f06b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 0x7f06b8067290 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f06c4004630 tx=0x7f06c4009b30).stop 2022-02-02T14:01:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 msgr2=0x7f06d0109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f06c000c530 tx=0x7f06c0007e20).stop 2022-02-02T14:01:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 shutdown_connections 2022-02-02T14:01:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06b8064dd0 0x7f06b8067290 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d006a350 0x7f06d0109140 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 --2- 172.21.15.33:0/498359315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d006b960 0x7f06d0109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 >> 172.21.15.33:0/498359315 conn(0x7f06d00f1e40 msgr2=0x7f06d00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 shutdown_connections 2022-02-02T14:01:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.376+0000 7f06d6583700 1 -- 172.21.15.33:0/498359315 wait complete. 2022-02-02T14:01:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 -- 172.21.15.33:0/587822957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f66d0 msgr2=0x7f0e500f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 --2- 172.21.15.33:0/587822957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f66d0 0x7f0e500f6b30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f0e3c004660 tx=0x7f0e3c009b30).stop 2022-02-02T14:01:48.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 -- 172.21.15.33:0/587822957 shutdown_connections 2022-02-02T14:01:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 --2- 172.21.15.33:0/587822957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f66d0 0x7f0e500f6b30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 --2- 172.21.15.33:0/587822957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f5430 0x7f0e500f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:01:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 -- 172.21.15.33:0/587822957 >> 172.21.15.33:0/587822957 conn(0x7f0e500f0b90 msgr2=0x7f0e500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:48.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 -- 172.21.15.33:0/587822957 shutdown_connections 2022-02-02T14:01:48.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.478+0000 7f0e55d38700 1 -- 172.21.15.33:0/587822957 wait complete. 2022-02-02T14:01:48.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 Processor -- start 2022-02-02T14:01:48.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 -- start start 2022-02-02T14:01:48.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f66d0 0x7f0e501072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50107980 con 0x7f0e500f5430 2022-02-02T14:01:48.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e55d38700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e50108100 con 0x7f0e500f66d0 2022-02-02T14:01:48.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.479+0000 7f0e54d36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59244/0 (socket says 172.21.15.33:59244) 2022-02-02T14:01:48.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 -- 172.21.15.33:0/922561157 learned_addr learned my addr 172.21.15.33:0/922561157 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:01:48.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e4ffff700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f66d0 0x7f0e501072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 -- 172.21.15.33:0/922561157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f66d0 msgr2=0x7f0e501072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f66d0 0x7f0e501072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 -- 172.21.15.33:0/922561157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c005040 con 0x7f0e500f5430 2022-02-02T14:01:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e54d36700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f0e440093f0 tx=0x7f0e44006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e44013640 con 0x7f0e500f5430 2022-02-02T14:01:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e44013c50 con 0x7f0e500f5430 2022-02-02T14:01:48.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e44012c70 con 0x7f0e500f5430 2022-02-02T14:01:48.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e50108380 con 0x7f0e500f5430 2022-02-02T14:01:48.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.480+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e50108940 con 0x7f0e500f5430 2022-02-02T14:01:48.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.481+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e50045ad0 con 0x7f0e500f5430 2022-02-02T14:01:48.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.482+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e4401a060 con 0x7f0e500f5430 2022-02-02T14:01:48.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.482+0000 7f0e4d7fa700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 0x7f0e400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:01:48.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.482+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e44081aa0 con 0x7f0e500f5430 2022-02-02T14:01:48.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.482+0000 7f0e4ffff700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 0x7f0e400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:01:48.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.483+0000 7f0e4ffff700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 0x7f0e400672e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0e3c004630 tx=0x7f0e3c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:01:48.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.486+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e4404faf0 con 0x7f0e500f5430 2022-02-02T14:01:48.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.702+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e500fdc90 con 0x7f0e500f5430 2022-02-02T14:01:48.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.703+0000 7f0e4d7fa700 1 -- 172.21.15.33:0/922561157 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0e44018750 con 0x7f0e500f5430 2022-02-02T14:01:48.703 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:01:48.703 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:01:48.703 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:01:48.704 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:01:48.704 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:48.704 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:01:48.704 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:01:48.705 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:01:48.705 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:01:48.705 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:01:48.705 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:01:48.706 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:01:48.706 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:01:48.706 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:01:48.706 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:01:48.706 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:01:48.707 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:01:48.707 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:01:48.707 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:01:48.707 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:01:48.708 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:01:48.708 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:01:48.708 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:01:48.709 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:01:48.709 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:01:48.709 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:01:48.709 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:01:48.710 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:01:48.710 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:01:48.710 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:01:48.710 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:01:48.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:48.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:48.711 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:01:48.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:01:48.712 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:48.713 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:48.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:48.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:01:48.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.705+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 msgr2=0x7f0e400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.705+0000 7f0e55d38700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 0x7f0e400672e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f0e3c004630 tx=0x7f0e3c009b30).stop 2022-02-02T14:01:48.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.705+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 msgr2=0x7f0e50106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:01:48.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.705+0000 7f0e55d38700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f0e440093f0 tx=0x7f0e44006ec0).stop 2022-02-02T14:01:48.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 shutdown_connections 2022-02-02T14:01:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e40064e20 0x7f0e400672e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e500f5430 0x7f0e50106e00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 --2- 172.21.15.33:0/922561157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e500f66d0 0x7f0e501072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:01:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 >> 172.21.15.33:0/922561157 conn(0x7f0e500f0b90 msgr2=0x7f0e5005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:01:48.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 shutdown_connections 2022-02-02T14:01:48.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:01:48.706+0000 7f0e55d38700 1 -- 172.21.15.33:0/922561157 wait complete. 2022-02-02T14:01:48.721 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:01:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:49 smithi037 ceph-mon[69017]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:49 smithi037 ceph-mon[69017]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/498359315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:01:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/922561157' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:01:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:49 smithi033 ceph-mon[101165]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:49 smithi033 ceph-mon[101165]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:01:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/498359315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:01:49.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/922561157' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:01:50.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:50 smithi037 ceph-mon[69017]: pgmap v676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:50 smithi033 ceph-mon[101165]: pgmap v676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:52.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:52 smithi037 ceph-mon[69017]: pgmap v677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:52 smithi033 ceph-mon[101165]: pgmap v677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:54.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:54 smithi037 ceph-mon[69017]: pgmap v678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:54 smithi033 ceph-mon[101165]: pgmap v678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:01:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:01:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:01:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:01:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:56 smithi033 ceph-mon[101165]: pgmap v679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:56 smithi037 ceph-mon[69017]: pgmap v679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:58.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:01:58 smithi037 ceph-mon[69017]: pgmap v680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:01:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:01:58 smithi033 ceph-mon[101165]: pgmap v680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:00 smithi037 ceph-mon[69017]: pgmap v681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:00.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:00 smithi033 ceph-mon[101165]: pgmap v681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:02.294 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:02 smithi037 ceph-mon[69017]: pgmap v682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:02 smithi033 ceph-mon[101165]: pgmap v682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:04.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:04 smithi037 ceph-mon[69017]: pgmap v683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:04 smithi033 ceph-mon[101165]: pgmap v683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:06 smithi033 ceph-mon[101165]: pgmap v684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:06.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:06 smithi037 ceph-mon[69017]: pgmap v684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:08 smithi033 ceph-mon[101165]: pgmap v685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:08.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:08 smithi037 ceph-mon[69017]: pgmap v685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:10 smithi033 ceph-mon[101165]: pgmap v686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:10 smithi037 ceph-mon[69017]: pgmap v686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:12.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:12 smithi033 ceph-mon[101165]: pgmap v687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:12 smithi037 ceph-mon[69017]: pgmap v687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:14 smithi033 ceph-mon[101165]: pgmap v688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:14.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:14 smithi037 ceph-mon[69017]: pgmap v688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:16 smithi033 ceph-mon[101165]: pgmap v689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:16 smithi037 ceph-mon[69017]: pgmap v689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:18.363 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:18 smithi037 ceph-mon[69017]: pgmap v690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:18.375 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:18 smithi033 ceph-mon[101165]: pgmap v690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 -- 172.21.15.33:0/818808357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880602b0 msgr2=0x7f81880fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 --2- 172.21.15.33:0/818808357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880602b0 0x7f81880fb700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f8178004660 tx=0x7f8178009b30).stop 2022-02-02T14:02:18.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 -- 172.21.15.33:0/818808357 shutdown_connections 2022-02-02T14:02:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 --2- 172.21.15.33:0/818808357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880fbbf0 0x7f81880fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 --2- 172.21.15.33:0/818808357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880602b0 0x7f81880fb700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 -- 172.21.15.33:0/818808357 >> 172.21.15.33:0/818808357 conn(0x7f81880f0d40 msgr2=0x7f81880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 -- 172.21.15.33:0/818808357 shutdown_connections 2022-02-02T14:02:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.812+0000 7f818d3f1700 1 -- 172.21.15.33:0/818808357 wait complete. 2022-02-02T14:02:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 Processor -- start 2022-02-02T14:02:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 -- start start 2022-02-02T14:02:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 0x7f8188109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188109bf0 con 0x7f81880fbbf0 2022-02-02T14:02:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f818d3f1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8188109d30 con 0x7f81880602b0 2022-02-02T14:02:18.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f81867fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.813+0000 7f81867fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59256/0 (socket says 172.21.15.33:59256) 2022-02-02T14:02:18.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f81867fc700 1 -- 172.21.15.33:0/3974815222 learned_addr learned my addr 172.21.15.33:0/3974815222 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f8186ffd700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 0x7f8188109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:18.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f81867fc700 1 -- 172.21.15.33:0/3974815222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 msgr2=0x7f8188109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f81867fc700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 0x7f8188109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:18.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f81867fc700 1 -- 172.21.15.33:0/3974815222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178005040 con 0x7f81880fbbf0 2022-02-02T14:02:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f8186ffd700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 0x7f8188109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:02:18.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f81867fc700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f817c00c790 tx=0x7f817c007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c013630 con 0x7f81880fbbf0 2022-02-02T14:02:18.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818810a6d0 con 0x7f81880fbbf0 2022-02-02T14:02:18.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f817c013c40 con 0x7f81880fbbf0 2022-02-02T14:02:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f817c002b80 con 0x7f81880fbbf0 2022-02-02T14:02:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.814+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f818810ac90 con 0x7f81880fbbf0 2022-02-02T14:02:18.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.815+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8188045ad0 con 0x7f81880fbbf0 2022-02-02T14:02:18.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.816+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f817c01a060 con 0x7f81880fbbf0 2022-02-02T14:02:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.816+0000 7f816f7fe700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 0x7f8170067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.816+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f817c081c30 con 0x7f81880fbbf0 2022-02-02T14:02:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.816+0000 7f8186ffd700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 0x7f8170067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:18.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.817+0000 7f8186ffd700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 0x7f8170067290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8178004630 tx=0x7f8178009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:18.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:18.820+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f817c053710 con 0x7f81880fbbf0 2022-02-02T14:02:19.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.040+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8188101210 con 0x7f8170064dd0 2022-02-02T14:02:19.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.042+0000 7f816f7fe700 1 -- 172.21.15.33:0/3974815222 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8188101210 con 0x7f8170064dd0 2022-02-02T14:02:19.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.043+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 msgr2=0x7f8170067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.043+0000 7f818d3f1700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 0x7f8170067290 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f8178004630 tx=0x7f8178009b30).stop 2022-02-02T14:02:19.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 msgr2=0x7f8188109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f817c00c790 tx=0x7f817c007d40).stop 2022-02-02T14:02:19.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 shutdown_connections 2022-02-02T14:02:19.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8170064dd0 0x7f8170067290 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81880602b0 0x7f8188109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 --2- 172.21.15.33:0/3974815222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81880fbbf0 0x7f8188109640 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 >> 172.21.15.33:0/3974815222 conn(0x7f81880f0d40 msgr2=0x7f81880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 shutdown_connections 2022-02-02T14:02:19.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.044+0000 7f818d3f1700 1 -- 172.21.15.33:0/3974815222 wait complete. 2022-02-02T14:02:19.055 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:02:19.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 -- 172.21.15.33:0/3687424142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 msgr2=0x7f75200f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 --2- 172.21.15.33:0/3687424142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f75200f5850 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f75100045a0 tx=0x7f7510009b30).stop 2022-02-02T14:02:19.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 -- 172.21.15.33:0/3687424142 shutdown_connections 2022-02-02T14:02:19.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 --2- 172.21.15.33:0/3687424142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 0x7f75200f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 --2- 172.21.15.33:0/3687424142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f75200f5850 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 -- 172.21.15.33:0/3687424142 >> 172.21.15.33:0/3687424142 conn(0x7f75200f0b90 msgr2=0x7f75200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 -- 172.21.15.33:0/3687424142 shutdown_connections 2022-02-02T14:02:19.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:19 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:02:19.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:19 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:02:19.160 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:19 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:02:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.149+0000 7f7524c5f700 1 -- 172.21.15.33:0/3687424142 wait complete. 2022-02-02T14:02:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 Processor -- start 2022-02-02T14:02:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 -- start start 2022-02-02T14:02:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 0x7f752010e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200602b0 con 0x7f75200f66d0 2022-02-02T14:02:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f7524c5f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200603f0 con 0x7f75200f5430 2022-02-02T14:02:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f751effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 0x7f752010e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f751f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f751f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:41748/0 (socket says 172.21.15.33:41748) 2022-02-02T14:02:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.150+0000 7f751f7fe700 1 -- 172.21.15.33:0/2810561813 learned_addr learned my addr 172.21.15.33:0/2810561813 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f751f7fe700 1 -- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 msgr2=0x7f752010e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f751f7fe700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 0x7f752010e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f751f7fe700 1 -- 172.21.15.33:0/2810561813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7510005040 con 0x7f75200f5430 2022-02-02T14:02:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f751f7fe700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f75100096f0 tx=0x7f751000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7510019070 con 0x7f75200f5430 2022-02-02T14:02:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7510007e70 con 0x7f75200f5430 2022-02-02T14:02:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752010e830 con 0x7f75200f5430 2022-02-02T14:02:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7510014d40 con 0x7f75200f5430 2022-02-02T14:02:19.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.151+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752010ec00 con 0x7f75200f5430 2022-02-02T14:02:19.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.152+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7520059100 con 0x7f75200f5430 2022-02-02T14:02:19.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.153+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7510025070 con 0x7f75200f5430 2022-02-02T14:02:19.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.153+0000 7f7507fff700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 0x7f75080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.153+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7510082950 con 0x7f75200f5430 2022-02-02T14:02:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.153+0000 7f751effd700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 0x7f75080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.154+0000 7f751effd700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 0x7f75080672e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f7514004c60 tx=0x7f751400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.158+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7510050ae0 con 0x7f75200f5430 2022-02-02T14:02:19.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.344+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75200fdcf0 con 0x7f7508064e20 2022-02-02T14:02:19.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.359+0000 7f7507fff700 1 -- 172.21.15.33:0/2810561813 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f75200fdcf0 con 0x7f7508064e20 2022-02-02T14:02:19.361 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:02:19.361 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (27m) 10m ago 28m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:02:19.362 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (20m) 10m ago 28m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:02:19.362 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (20m) 10m ago 28m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:02:19.363 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (27m) 10m ago 28m 41.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:02:19.363 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (21m) 10m ago 24m 16.8M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:02:19.364 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (21m) 10m ago 24m 17.9M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:02:19.364 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (22m) 10m ago 24m 19.9M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:02:19.364 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (24m) 10m ago 24m 18.5M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:02:19.366 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (22m) 10m ago 29m 481M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:02:19.367 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (21m) 10m ago 28m 421M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:02:19.367 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (21m) 10m ago 30m 109M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:02:19.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (21m) 10m ago 27m 70.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:02:19.368 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (28m) 10m ago 28m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:02:19.372 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (27m) 10m ago 27m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:02:19.373 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 10m ago 27m - 4096M 2022-02-02T14:02:19.373 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (27m) 10m ago 27m 566M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:02:19.374 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (26m) 10m ago 26m 381M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:02:19.374 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (26m) 10m ago 26m 557M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:02:19.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (26m) 10m ago 26m 392M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:02:19.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (25m) 10m ago 25m 539M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:02:19.375 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (27m) 10m ago 28m 51.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:02:19.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 msgr2=0x7f75080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 0x7f75080672e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f7514004c60 tx=0x7f751400b040).stop 2022-02-02T14:02:19.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 msgr2=0x7f752010be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f75100096f0 tx=0x7f751000b040).stop 2022-02-02T14:02:19.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 shutdown_connections 2022-02-02T14:02:19.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7508064e20 0x7f75080672e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75200f5430 0x7f752010be40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 --2- 172.21.15.33:0/2810561813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75200f66d0 0x7f752010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 >> 172.21.15.33:0/2810561813 conn(0x7f75200f0b90 msgr2=0x7f75200fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 shutdown_connections 2022-02-02T14:02:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.362+0000 7f7524c5f700 1 -- 172.21.15.33:0/2810561813 wait complete. 2022-02-02T14:02:19.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 -- 172.21.15.33:0/4164811410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 msgr2=0x7f177c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 --2- 172.21.15.33:0/4164811410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c0f7de0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f1770004660 tx=0x7f1770009b30).stop 2022-02-02T14:02:19.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 -- 172.21.15.33:0/4164811410 shutdown_connections 2022-02-02T14:02:19.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 --2- 172.21.15.33:0/4164811410 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c0f7de0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 --2- 172.21.15.33:0/4164811410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f177c0f66e0 0x7f177c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 -- 172.21.15.33:0/4164811410 >> 172.21.15.33:0/4164811410 conn(0x7f177c0f1e40 msgr2=0x7f177c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 -- 172.21.15.33:0/4164811410 shutdown_connections 2022-02-02T14:02:19.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.472+0000 7f1780e98700 1 -- 172.21.15.33:0/4164811410 wait complete. 2022-02-02T14:02:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 Processor -- start 2022-02-02T14:02:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 -- start start 2022-02-02T14:02:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f177c0f66e0 0x7f177c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c10ab70 con 0x7f177c0f7980 2022-02-02T14:02:19.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1780e98700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c10acb0 con 0x7f177c0f66e0 2022-02-02T14:02:19.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1779d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1779d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59274/0 (socket says 172.21.15.33:59274) 2022-02-02T14:02:19.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1779d9b700 1 -- 172.21.15.33:0/1396035171 learned_addr learned my addr 172.21.15.33:0/1396035171 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:19.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.473+0000 7f1779d9b700 1 -- 172.21.15.33:0/1396035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f177c0f66e0 msgr2=0x7f177c06b9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T14:02:19.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f1779d9b700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f177c0f66e0 0x7f177c06b9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:02:19.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f1779d9b700 1 -- 172.21.15.33:0/1396035171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1770005040 con 0x7f177c0f7980 2022-02-02T14:02:19.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f1779d9b700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f1770002040 tx=0x7f177000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1770019070 con 0x7f177c0f7980 2022-02-02T14:02:19.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c06a370 con 0x7f177c0f7980 2022-02-02T14:02:19.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1770007e70 con 0x7f177c0f7980 2022-02-02T14:02:19.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1770014e30 con 0x7f177c0f7980 2022-02-02T14:02:19.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.474+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c06a8d0 con 0x7f177c0f7980 2022-02-02T14:02:19.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.475+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c045ad0 con 0x7f177c0f7980 2022-02-02T14:02:19.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.476+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1770025070 con 0x7f177c0f7980 2022-02-02T14:02:19.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.476+0000 7f176affd700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 0x7f1764067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.476+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1770082af0 con 0x7f177c0f7980 2022-02-02T14:02:19.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.476+0000 7f177a59c700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 0x7f1764067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.477+0000 7f177a59c700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 0x7f1764067210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f177c06b730 tx=0x7f176c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.483+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1770050b40 con 0x7f177c0f7980 2022-02-02T14:02:19.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:19 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:02:19.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:19 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:02:19.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:19 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:02:19.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.733+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f177c0feea0 con 0x7f177c0f7980 2022-02-02T14:02:19.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.733+0000 7f176affd700 1 -- 172.21.15.33:0/1396035171 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f17700232d0 con 0x7f177c0f7980 2022-02-02T14:02:19.734 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:02:19.735 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:02:19.735 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:02:19.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:19.735 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:02:19.736 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:02:19.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:19.736 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:02:19.736 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:02:19.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:19.737 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:02:19.737 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:02:19.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:19.737 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:02:19.737 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:02:19.738 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:02:19.738 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:02:19.738 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:02:19.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.735+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 msgr2=0x7f1764067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.735+0000 7f1780e98700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 0x7f1764067210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f177c06b730 tx=0x7f176c00b040).stop 2022-02-02T14:02:19.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.735+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 msgr2=0x7f177c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.735+0000 7f1780e98700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f1770002040 tx=0x7f177000b040).stop 2022-02-02T14:02:19.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 shutdown_connections 2022-02-02T14:02:19.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1764064d50 0x7f1764067210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f177c0f66e0 0x7f177c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:02:19.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 --2- 172.21.15.33:0/1396035171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f177c0f7980 0x7f177c069e20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 >> 172.21.15.33:0/1396035171 conn(0x7f177c0f1e40 msgr2=0x7f177c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 shutdown_connections 2022-02-02T14:02:19.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.736+0000 7f1780e98700 1 -- 172.21.15.33:0/1396035171 wait complete. 2022-02-02T14:02:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- 172.21.15.33:0/289013517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 msgr2=0x7f20900f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 --2- 172.21.15.33:0/289013517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f20900f6950 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f208c004660 tx=0x7f208c009b30).stop 2022-02-02T14:02:19.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- 172.21.15.33:0/289013517 shutdown_connections 2022-02-02T14:02:19.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 --2- 172.21.15.33:0/289013517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 0x7f20900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 --2- 172.21.15.33:0/289013517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f20900f6950 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- 172.21.15.33:0/289013517 >> 172.21.15.33:0/289013517 conn(0x7f20900f1c90 msgr2=0x7f20900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:19.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- 172.21.15.33:0/289013517 shutdown_connections 2022-02-02T14:02:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- 172.21.15.33:0/289013517 wait complete. 2022-02-02T14:02:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 Processor -- start 2022-02-02T14:02:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.845+0000 7f209639f700 1 -- start start 2022-02-02T14:02:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209639f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209639f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 0x7f20901072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209639f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20901078f0 con 0x7f20900f6530 2022-02-02T14:02:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209639f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2090108100 con 0x7f20900f77d0 2022-02-02T14:02:19.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59284/0 (socket says 172.21.15.33:59284) 2022-02-02T14:02:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 -- 172.21.15.33:0/2645613677 learned_addr learned my addr 172.21.15.33:0/2645613677 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f2094b9c700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 0x7f20901072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 -- 172.21.15.33:0/2645613677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 msgr2=0x7f20901072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:19.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 0x7f20901072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:19.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 -- 172.21.15.33:0/2645613677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c005040 con 0x7f20900f6530 2022-02-02T14:02:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209539d700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f208c009830 tx=0x7f208c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208c018070 con 0x7f20900f6530 2022-02-02T14:02:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f208c007ba0 con 0x7f20900f6530 2022-02-02T14:02:19.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f208c01de60 con 0x7f20900f6530 2022-02-02T14:02:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.846+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2090108320 con 0x7f20900f6530 2022-02-02T14:02:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.847+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2090108880 con 0x7f20900f6530 2022-02-02T14:02:19.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.848+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2090059100 con 0x7f20900f6530 2022-02-02T14:02:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.848+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f208c007d10 con 0x7f20900f6530 2022-02-02T14:02:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.848+0000 7f2085ffb700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 0x7f207c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.848+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f208c083590 con 0x7f20900f6530 2022-02-02T14:02:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.849+0000 7f2094b9c700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 0x7f207c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.849+0000 7f2094b9c700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 0x7f207c0672e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2080004c40 tx=0x7f208000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:19.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:19.853+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f208c0516a0 con 0x7f20900f6530 2022-02-02T14:02:20.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.067+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20900008d0 con 0x7f20900f6530 2022-02-02T14:02:20.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.067+0000 7f2085ffb700 1 -- 172.21.15.33:0/2645613677 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f208c054cc0 con 0x7f20900f6530 2022-02-02T14:02:20.069 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:02:20.070 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:02:20.070 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:02:20.071 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:02:20.071 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:20.071 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:02:20.072 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:02:20.072 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:02:20.073 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:02:20.073 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:02:20.074 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:02:20.074 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:02:20.075 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:02:20.075 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:02:20.075 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:02:20.076 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:02:20.076 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:02:20.077 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:02:20.077 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:02:20.078 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:02:20.078 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:02:20.078 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:02:20.079 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:02:20.079 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:02:20.080 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:02:20.080 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:02:20.081 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:02:20.081 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:02:20.081 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:02:20.082 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:02:20.082 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:02:20.083 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:20.083 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:20.084 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:02:20.084 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:20.085 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:20.085 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:20.085 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:20.086 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:20.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 msgr2=0x7f207c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:20.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 0x7f207c0672e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f2080004c40 tx=0x7f208000b040).stop 2022-02-02T14:02:20.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 msgr2=0x7f2090106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:20.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f208c009830 tx=0x7f208c009b30).stop 2022-02-02T14:02:20.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 shutdown_connections 2022-02-02T14:02:20.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f207c064e20 0x7f207c0672e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:20.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20900f6530 0x7f2090106e00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:20.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 --2- 172.21.15.33:0/2645613677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20900f77d0 0x7f20901072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:20.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 >> 172.21.15.33:0/2645613677 conn(0x7f20900f1c90 msgr2=0x7f20900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:20.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 shutdown_connections 2022-02-02T14:02:20.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:20.071+0000 7f209639f700 1 -- 172.21.15.33:0/2645613677 wait complete. 2022-02-02T14:02:20.092 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:02:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:20 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:02:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:20 smithi033 ceph-mon[101165]: pgmap v691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:20 smithi033 ceph-mon[101165]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:20.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1396035171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:02:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:20 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:02:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:20 smithi037 ceph-mon[69017]: pgmap v691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:20 smithi037 ceph-mon[69017]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1396035171' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:02:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:21 smithi033 ceph-mon[101165]: from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:21 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2645613677' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:02:21.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:21 smithi037 ceph-mon[69017]: from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:21.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:21 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2645613677' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:02:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:22 smithi033 ceph-mon[101165]: pgmap v692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:22.524 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:22 smithi037 ceph-mon[69017]: pgmap v692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:23 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:23 smithi033 ceph-mon[101165]: pgmap v693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:23 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:23 smithi037 ceph-mon[69017]: pgmap v693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:26 smithi033 ceph-mon[101165]: pgmap v694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:26 smithi037 ceph-mon[69017]: pgmap v694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:02:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:27 smithi037 ceph-mon[69017]: pgmap v695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:27 smithi037 ceph-mon[69017]: pgmap v696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:27.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:27 smithi033 ceph-mon[101165]: pgmap v695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:27.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:27 smithi033 ceph-mon[101165]: pgmap v696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:29.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:29 smithi037 ceph-mon[69017]: pgmap v697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:29 smithi033 ceph-mon[101165]: pgmap v697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:31 smithi037 ceph-mon[69017]: pgmap v698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:31 smithi033 ceph-mon[101165]: pgmap v698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:33 smithi033 ceph-mon[101165]: pgmap v699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:33.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:33 smithi037 ceph-mon[69017]: pgmap v699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:35.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:35 smithi033 ceph-mon[101165]: pgmap v700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:35.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:35 smithi037 ceph-mon[69017]: pgmap v700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:37.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:37 smithi037 ceph-mon[69017]: pgmap v701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:37.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:37 smithi033 ceph-mon[101165]: pgmap v701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:39 smithi033 ceph-mon[101165]: pgmap v702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:39.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:39 smithi037 ceph-mon[69017]: pgmap v702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:41 smithi033 ceph-mon[101165]: pgmap v703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:41.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:41 smithi037 ceph-mon[69017]: pgmap v703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:43 smithi033 ceph-mon[101165]: pgmap v704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:43.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:43 smithi037 ceph-mon[69017]: pgmap v704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:45 smithi033 ceph-mon[101165]: pgmap v705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:45.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:45 smithi037 ceph-mon[69017]: pgmap v705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:47.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:47 smithi037 ceph-mon[69017]: pgmap v706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:47 smithi033 ceph-mon[101165]: pgmap v706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:49 smithi033 ceph-mon[101165]: pgmap v707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:49.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:49 smithi037 ceph-mon[69017]: pgmap v707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:50.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- 172.21.15.33:0/2734563867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 msgr2=0x7f4e5c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2734563867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c0f5850 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f4e58004660 tx=0x7f4e58009b30).stop 2022-02-02T14:02:50.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- 172.21.15.33:0/2734563867 shutdown_connections 2022-02-02T14:02:50.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2734563867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e5c0f66d0 0x7f4e5c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2734563867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c0f5850 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- 172.21.15.33:0/2734563867 >> 172.21.15.33:0/2734563867 conn(0x7f4e5c0f0b90 msgr2=0x7f4e5c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- 172.21.15.33:0/2734563867 shutdown_connections 2022-02-02T14:02:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- 172.21.15.33:0/2734563867 wait complete. 2022-02-02T14:02:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 Processor -- start 2022-02-02T14:02:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.190+0000 7f4e62d48700 1 -- start start 2022-02-02T14:02:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e62d48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e62d48700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e5c0f66d0 0x7f4e5c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e62d48700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c107880 con 0x7f4e5c0f5430 2022-02-02T14:02:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e62d48700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c1080c0 con 0x7f4e5c0f66d0 2022-02-02T14:02:50.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59294/0 (socket says 172.21.15.33:59294) 2022-02-02T14:02:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 -- 172.21.15.33:0/2055614254 learned_addr learned my addr 172.21.15.33:0/2055614254 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 -- 172.21.15.33:0/2055614254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e5c0f66d0 msgr2=0x7f4e5c107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e5c0f66d0 0x7f4e5c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:02:50.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 -- 172.21.15.33:0/2055614254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58005040 con 0x7f4e5c0f5430 2022-02-02T14:02:50.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e61d46700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4e58014040 tx=0x7f4e5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.191+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e58019070 con 0x7f4e5c0f5430 2022-02-02T14:02:50.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.192+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4e58007e70 con 0x7f4e5c0f5430 2022-02-02T14:02:50.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.192+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e58014d50 con 0x7f4e5c0f5430 2022-02-02T14:02:50.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.192+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c108340 con 0x7f4e5c0f5430 2022-02-02T14:02:50.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.192+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c1087d0 con 0x7f4e5c0f5430 2022-02-02T14:02:50.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.193+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c059100 con 0x7f4e5c0f5430 2022-02-02T14:02:50.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.193+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4e58025070 con 0x7f4e5c0f5430 2022-02-02T14:02:50.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.194+0000 7f4e527fc700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 0x7f4e480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.194+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4e58082ab0 con 0x7f4e5c0f5430 2022-02-02T14:02:50.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.194+0000 7f4e61545700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 0x7f4e480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.194+0000 7f4e61545700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 0x7f4e480672e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4e5c106b20 tx=0x7f4e4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.198+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4e58050c20 con 0x7f4e5c0f5430 2022-02-02T14:02:50.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.385+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e5c05fd30 con 0x7f4e48064e20 2022-02-02T14:02:50.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.387+0000 7f4e527fc700 1 -- 172.21.15.33:0/2055614254 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4e5c05fd30 con 0x7f4e48064e20 2022-02-02T14:02:50.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.388+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 msgr2=0x7f4e480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.388+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 0x7f4e480672e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f4e5c106b20 tx=0x7f4e4c00b040).stop 2022-02-02T14:02:50.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.388+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 msgr2=0x7f4e5c106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.388+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f4e58014040 tx=0x7f4e5800b040).stop 2022-02-02T14:02:50.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 shutdown_connections 2022-02-02T14:02:50.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4e48064e20 0x7f4e480672e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e5c0f5430 0x7f4e5c106d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 --2- 172.21.15.33:0/2055614254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e5c0f66d0 0x7f4e5c107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:02:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 >> 172.21.15.33:0/2055614254 conn(0x7f4e5c0f0b90 msgr2=0x7f4e5c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 shutdown_connections 2022-02-02T14:02:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.389+0000 7f4e62d48700 1 -- 172.21.15.33:0/2055614254 wait complete. 2022-02-02T14:02:50.398 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:02:50.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/1901735344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f6860 msgr2=0x7ff4d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/1901735344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f6860 0x7ff4d40f6cc0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7ff4c8004660 tx=0x7ff4c8009b30).stop 2022-02-02T14:02:50.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/1901735344 shutdown_connections 2022-02-02T14:02:50.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/1901735344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f6860 0x7ff4d40f6cc0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/1901735344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f55c0 0x7ff4d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/1901735344 >> 172.21.15.33:0/1901735344 conn(0x7ff4d40f0d40 msgr2=0x7ff4d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/1901735344 shutdown_connections 2022-02-02T14:02:50.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.490+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/1901735344 wait complete. 2022-02-02T14:02:50.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 Processor -- start 2022-02-02T14:02:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 -- start start 2022-02-02T14:02:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f6860 0x7ff4d410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d40603c0 con 0x7ff4d40f55c0 2022-02-02T14:02:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4dbf0c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d4060500 con 0x7ff4d40f6860 2022-02-02T14:02:50.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4d9ca8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4d9ca8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59304/0 (socket says 172.21.15.33:59304) 2022-02-02T14:02:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4d9ca8700 1 -- 172.21.15.33:0/141704692 learned_addr learned my addr 172.21.15.33:0/141704692 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4d94a7700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f6860 0x7ff4d410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.491+0000 7ff4d9ca8700 1 -- 172.21.15.33:0/141704692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f6860 msgr2=0x7ff4d410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4d9ca8700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f6860 0x7ff4d410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4d9ca8700 1 -- 172.21.15.33:0/141704692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c8005040 con 0x7ff4d40f55c0 2022-02-02T14:02:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4d9ca8700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff4d0002700 tx=0x7ff4d0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d00079c0 con 0x7ff4d40f55c0 2022-02-02T14:02:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d410c720 con 0x7ff4d40f55c0 2022-02-02T14:02:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d410ccb0 con 0x7ff4d40f55c0 2022-02-02T14:02:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff4d000f040 con 0x7ff4d40f55c0 2022-02-02T14:02:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.492+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4d0014860 con 0x7ff4d40f55c0 2022-02-02T14:02:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.493+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc004fa0 con 0x7ff4d40f55c0 2022-02-02T14:02:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.494+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff4d001b060 con 0x7ff4d40f55c0 2022-02-02T14:02:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.494+0000 7ff4c67fc700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 0x7ff4c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.494+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff4d00818b0 con 0x7ff4d40f55c0 2022-02-02T14:02:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.494+0000 7ff4d94a7700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 0x7ff4c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.495+0000 7ff4d94a7700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 0x7ff4c0067290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ff4c8004630 tx=0x7ff4c8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.498+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4d004f900 con 0x7ff4d40f55c0 2022-02-02T14:02:50.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.680+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4bc000bc0 con 0x7ff4c0064dd0 2022-02-02T14:02:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.694+0000 7ff4c67fc700 1 -- 172.21.15.33:0/141704692 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff4bc000bc0 con 0x7ff4c0064dd0 2022-02-02T14:02:50.694 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:02:50.695 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (28m) 25s ago 29m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:02:50.695 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (21m) 25s ago 29m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:02:50.695 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (21m) 28s ago 28m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:02:50.696 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (27m) 25s ago 28m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:02:50.696 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (21m) 25s ago 25m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:02:50.697 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (22m) 25s ago 25m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:02:50.697 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (23m) 28s ago 25m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:02:50.698 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (25m) 28s ago 25m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:02:50.698 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (22m) 25s ago 30m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:02:50.698 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (22m) 28s ago 28m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:02:50.699 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (22m) 25s ago 30m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:02:50.699 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (21m) 28s ago 28m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:02:50.700 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (28m) 25s ago 28m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:02:50.700 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (28m) 28s ago 28m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:02:50.701 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 25s ago 27m - 4096M 2022-02-02T14:02:50.701 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (27m) 25s ago 27m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:02:50.701 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (27m) 25s ago 27m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:02:50.701 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (27m) 28s ago 27m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:02:50.702 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (26m) 28s ago 26m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:02:50.702 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (26m) 28s ago 26m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:02:50.702 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (27m) 25s ago 28m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:02:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 msgr2=0x7ff4c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 0x7ff4c0067290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7ff4c8004630 tx=0x7ff4c8009b30).stop 2022-02-02T14:02:50.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 msgr2=0x7ff4d4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7ff4d0002700 tx=0x7ff4d0009d80).stop 2022-02-02T14:02:50.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 shutdown_connections 2022-02-02T14:02:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff4c0064dd0 0x7ff4c0067290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4d40f55c0 0x7ff4d4109c70 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 --2- 172.21.15.33:0/141704692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4d40f6860 0x7ff4d410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 >> 172.21.15.33:0/141704692 conn(0x7ff4d40f0d40 msgr2=0x7ff4d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 shutdown_connections 2022-02-02T14:02:50.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.696+0000 7ff4dbf0c700 1 -- 172.21.15.33:0/141704692 wait complete. 2022-02-02T14:02:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.796+0000 7f27274d4700 1 -- 172.21.15.33:0/1014470068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 msgr2=0x7f27200f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.796+0000 7f27274d4700 1 --2- 172.21.15.33:0/1014470068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f27200f5860 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f271c004660 tx=0x7f271c009b30).stop 2022-02-02T14:02:50.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 -- 172.21.15.33:0/1014470068 shutdown_connections 2022-02-02T14:02:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 --2- 172.21.15.33:0/1014470068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f27200f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 --2- 172.21.15.33:0/1014470068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f27200f5860 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 -- 172.21.15.33:0/1014470068 >> 172.21.15.33:0/1014470068 conn(0x7f27200f0ba0 msgr2=0x7f27200f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 -- 172.21.15.33:0/1014470068 shutdown_connections 2022-02-02T14:02:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 -- 172.21.15.33:0/1014470068 wait complete. 2022-02-02T14:02:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 Processor -- start 2022-02-02T14:02:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.797+0000 7f27274d4700 1 -- start start 2022-02-02T14:02:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27274d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27274d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f2720107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27274d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720107920 con 0x7f27200f5440 2022-02-02T14:02:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27274d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2720108130 con 0x7f27200f66e0 2022-02-02T14:02:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59314/0 (socket says 172.21.15.33:59314) 2022-02-02T14:02:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 -- 172.21.15.33:0/3887655490 learned_addr learned my addr 172.21.15.33:0/3887655490 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f2725cd1700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f2720107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 -- 172.21.15.33:0/3887655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 msgr2=0x7f2720107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f2720107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 -- 172.21.15.33:0/3887655490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c005040 con 0x7f27200f5440 2022-02-02T14:02:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f2725cd1700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f2720107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:02:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f27264d2700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f271c009830 tx=0x7f271c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c018070 con 0x7f27200f5440 2022-02-02T14:02:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f271c007ba0 con 0x7f27200f5440 2022-02-02T14:02:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.798+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f271c01c620 con 0x7f27200f5440 2022-02-02T14:02:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.799+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2720108350 con 0x7f27200f5440 2022-02-02T14:02:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.799+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27201088b0 con 0x7f27200f5440 2022-02-02T14:02:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.800+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2720059100 con 0x7f27200f5440 2022-02-02T14:02:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.800+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f271c007d10 con 0x7f27200f5440 2022-02-02T14:02:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.800+0000 7f2716ffd700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 0x7f270c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.801+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f271c083830 con 0x7f27200f5440 2022-02-02T14:02:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.801+0000 7f2725cd1700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 0x7f270c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.801+0000 7f2725cd1700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 0x7f270c0672e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2710009fd0 tx=0x7f271000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:50.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:50.805+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f271c0519a0 con 0x7f27200f5440 2022-02-02T14:02:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.054+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f272010d370 con 0x7f27200f5440 2022-02-02T14:02:51.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.055+0000 7f2716ffd700 1 -- 172.21.15.33:0/3887655490 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f271c054fc0 con 0x7f27200f5440 2022-02-02T14:02:51.055 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:02:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:02:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:02:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:02:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:02:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:02:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:02:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:02:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:02:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:02:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:02:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:02:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:02:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:02:51.059 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:02:51.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.056+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 msgr2=0x7f270c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.056+0000 7f27274d4700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 0x7f270c0672e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f2710009fd0 tx=0x7f271000b040).stop 2022-02-02T14:02:51.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.056+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 msgr2=0x7f2720106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.056+0000 7f27274d4700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f271c009830 tx=0x7f271c009b30).stop 2022-02-02T14:02:51.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 shutdown_connections 2022-02-02T14:02:51.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f270c064e20 0x7f270c0672e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27200f5440 0x7f2720106e30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 --2- 172.21.15.33:0/3887655490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27200f66e0 0x7f2720107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 >> 172.21.15.33:0/3887655490 conn(0x7f27200f0ba0 msgr2=0x7f272005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:51.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 shutdown_connections 2022-02-02T14:02:51.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.057+0000 7f27274d4700 1 -- 172.21.15.33:0/3887655490 wait complete. 2022-02-02T14:02:51.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 -- 172.21.15.33:0/585394419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 msgr2=0x7f0d540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 --2- 172.21.15.33:0/585394419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d540f59e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f0d44004660 tx=0x7f0d44009b30).stop 2022-02-02T14:02:51.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 -- 172.21.15.33:0/585394419 shutdown_connections 2022-02-02T14:02:51.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 --2- 172.21.15.33:0/585394419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 0x7f0d540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 --2- 172.21.15.33:0/585394419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d540f59e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 -- 172.21.15.33:0/585394419 >> 172.21.15.33:0/585394419 conn(0x7f0d540f0d40 msgr2=0x7f0d540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 -- 172.21.15.33:0/585394419 shutdown_connections 2022-02-02T14:02:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.158+0000 7f0d5a594700 1 -- 172.21.15.33:0/585394419 wait complete. 2022-02-02T14:02:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 Processor -- start 2022-02-02T14:02:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 -- start start 2022-02-02T14:02:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 0x7f0d5410c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d540603e0 con 0x7f0d540f55c0 2022-02-02T14:02:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.159+0000 7f0d5a594700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54060520 con 0x7f0d540f6860 2022-02-02T14:02:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59324/0 (socket says 172.21.15.33:59324) 2022-02-02T14:02:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 -- 172.21.15.33:0/3820848832 learned_addr learned my addr 172.21.15.33:0/3820848832 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:02:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d537fe700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 0x7f0d5410c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 -- 172.21.15.33:0/3820848832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 msgr2=0x7f0d5410c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 0x7f0d5410c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 -- 172.21.15.33:0/3820848832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44005040 con 0x7f0d540f55c0 2022-02-02T14:02:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d53fff700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0d44013a70 tx=0x7f0d44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44018070 con 0x7f0d540f55c0 2022-02-02T14:02:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d440097d0 con 0x7f0d540f55c0 2022-02-02T14:02:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4401de80 con 0x7f0d540f55c0 2022-02-02T14:02:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d5410c640 con 0x7f0d540f55c0 2022-02-02T14:02:51.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.160+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5410cba0 con 0x7f0d540f55c0 2022-02-02T14:02:51.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.161+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54045ad0 con 0x7f0d540f55c0 2022-02-02T14:02:51.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.162+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d44007ba0 con 0x7f0d540f55c0 2022-02-02T14:02:51.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.162+0000 7f0d50ff9700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 0x7f0d3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:02:51.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.162+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0d440835f0 con 0x7f0d540f55c0 2022-02-02T14:02:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.162+0000 7f0d537fe700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 0x7f0d3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:02:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.163+0000 7f0d537fe700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 0x7f0d3c067290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0d48004ce0 tx=0x7f0d4800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:02:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.166+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d44051810 con 0x7f0d540f55c0 2022-02-02T14:02:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.378+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0d540fdec0 con 0x7f0d540f55c0 2022-02-02T14:02:51.378 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:51 smithi033 ceph-mon[101165]: pgmap v708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:51.379 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3887655490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:02:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.379+0000 7f0d50ff9700 1 -- 172.21.15.33:0/3820848832 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0d44054e30 con 0x7f0d540f55c0 2022-02-02T14:02:51.380 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:02:51.380 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:02:51.380 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:02:51.381 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:02:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:51.381 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:02:51.381 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:02:51.382 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:02:51.382 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:02:51.382 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:02:51.382 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:02:51.383 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:02:51.383 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:02:51.383 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:02:51.383 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:02:51.383 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:02:51.384 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:02:51.384 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:02:51.384 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:02:51.384 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:02:51.384 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:02:51.385 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:02:51.385 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:02:51.385 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:02:51.386 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:02:51.386 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:02:51.387 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:02:51.387 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:02:51.387 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:02:51.388 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:02:51.388 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:02:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:51.389 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:02:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:02:51.389 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:51.390 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:51.390 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:51.390 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:02:51.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 msgr2=0x7f0d3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 0x7f0d3c067290 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f0d48004ce0 tx=0x7f0d4800b040).stop 2022-02-02T14:02:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 msgr2=0x7f0d54109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:02:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f0d44013a70 tx=0x7f0d44009b30).stop 2022-02-02T14:02:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 shutdown_connections 2022-02-02T14:02:51.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d3c064dd0 0x7f0d3c067290 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d540f55c0 0x7f0d54109bf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 --2- 172.21.15.33:0/3820848832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d540f6860 0x7f0d5410c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:02:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.381+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 >> 172.21.15.33:0/3820848832 conn(0x7f0d540f0d40 msgr2=0x7f0d540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:02:51.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.382+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 shutdown_connections 2022-02-02T14:02:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:02:51.382+0000 7f0d5a594700 1 -- 172.21.15.33:0/3820848832 wait complete. 2022-02-02T14:02:51.403 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:02:51.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:51 smithi037 ceph-mon[69017]: pgmap v708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:51.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3887655490' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:02:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:52 smithi033 ceph-mon[101165]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:52 smithi033 ceph-mon[101165]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3820848832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:02:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:52 smithi037 ceph-mon[69017]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:52 smithi037 ceph-mon[69017]: from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:02:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3820848832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:02:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:53 smithi033 ceph-mon[101165]: pgmap v709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:53.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:53 smithi037 ceph-mon[69017]: pgmap v709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:54 smithi033 ceph-mon[101165]: pgmap v710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:54.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:54 smithi037 ceph-mon[69017]: pgmap v710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:02:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:02:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:02:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:02:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:56 smithi033 ceph-mon[101165]: pgmap v711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:56 smithi037 ceph-mon[69017]: pgmap v711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:02:58 smithi033 ceph-mon[101165]: pgmap v712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:02:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:02:58 smithi037 ceph-mon[69017]: pgmap v712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:01.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:00 smithi033 ceph-mon[101165]: pgmap v713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:01.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:00 smithi037 ceph-mon[69017]: pgmap v713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:03.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:02 smithi033 ceph-mon[101165]: pgmap v714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:03.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:02 smithi037 ceph-mon[69017]: pgmap v714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:05.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:04 smithi033 ceph-mon[101165]: pgmap v715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:04 smithi037 ceph-mon[69017]: pgmap v715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:07.247 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:06 smithi033 ceph-mon[101165]: pgmap v716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:06 smithi037 ceph-mon[69017]: pgmap v716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:09.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:08 smithi033 ceph-mon[101165]: pgmap v717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:08 smithi037 ceph-mon[69017]: pgmap v717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:11.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:10 smithi033 ceph-mon[101165]: pgmap v718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:10 smithi037 ceph-mon[69017]: pgmap v718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:13.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:12 smithi033 ceph-mon[101165]: pgmap v719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:12 smithi037 ceph-mon[69017]: pgmap v719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:15.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:14 smithi033 ceph-mon[101165]: pgmap v720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:15.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:14 smithi037 ceph-mon[69017]: pgmap v720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:16 smithi033 ceph-mon[101165]: pgmap v721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:16 smithi037 ceph-mon[69017]: pgmap v721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:19.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:18 smithi033 ceph-mon[101165]: pgmap v722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:19.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:18 smithi037 ceph-mon[69017]: pgmap v722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:21.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:20 smithi033 ceph-mon[101165]: pgmap v723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:21.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:20 smithi037 ceph-mon[69017]: pgmap v723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:21.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 -- 172.21.15.33:0/3397248386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 msgr2=0x7fcf580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/3397248386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf580f6cc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fcf40004660 tx=0x7fcf40009b30).stop 2022-02-02T14:03:21.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 -- 172.21.15.33:0/3397248386 shutdown_connections 2022-02-02T14:03:21.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/3397248386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf580f6cc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/3397248386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 0x7fcf580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 -- 172.21.15.33:0/3397248386 >> 172.21.15.33:0/3397248386 conn(0x7fcf580f0d40 msgr2=0x7fcf580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 -- 172.21.15.33:0/3397248386 shutdown_connections 2022-02-02T14:03:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.501+0000 7fcf5db4d700 1 -- 172.21.15.33:0/3397248386 wait complete. 2022-02-02T14:03:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 Processor -- start 2022-02-02T14:03:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 -- start start 2022-02-02T14:03:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 0x7fcf58109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58060420 con 0x7fcf580f6860 2022-02-02T14:03:21.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf5db4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58060560 con 0x7fcf580f55c0 2022-02-02T14:03:21.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf56ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf56ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59336/0 (socket says 172.21.15.33:59336) 2022-02-02T14:03:21.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf56ffd700 1 -- 172.21.15.33:0/1602999211 learned_addr learned my addr 172.21.15.33:0/1602999211 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:21.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.502+0000 7fcf577fe700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 0x7fcf58109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf56ffd700 1 -- 172.21.15.33:0/1602999211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 msgr2=0x7fcf58109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf56ffd700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 0x7fcf58109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf56ffd700 1 -- 172.21.15.33:0/1602999211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40005040 con 0x7fcf580f6860 2022-02-02T14:03:21.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf56ffd700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fcf40009990 tx=0x7fcf40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:21.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf40018070 con 0x7fcf580f6860 2022-02-02T14:03:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf40007ba0 con 0x7fcf580f6860 2022-02-02T14:03:21.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5810c6c0 con 0x7fcf580f6860 2022-02-02T14:03:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf4001c3c0 con 0x7fcf580f6860 2022-02-02T14:03:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.503+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5810cbf0 con 0x7fcf580f6860 2022-02-02T14:03:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.504+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c004fa0 con 0x7fcf580f6860 2022-02-02T14:03:21.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.504+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf4001c680 con 0x7fcf580f6860 2022-02-02T14:03:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.505+0000 7fcf4ffff700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 0x7fcf44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.505+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcf400836a0 con 0x7fcf580f6860 2022-02-02T14:03:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.505+0000 7fcf577fe700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 0x7fcf44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.506+0000 7fcf577fe700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 0x7fcf44067290 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fcf580600a0 tx=0x7fcf4800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:21.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.509+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf40051750 con 0x7fcf580f6860 2022-02-02T14:03:21.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.697+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf3c000bc0 con 0x7fcf44064dd0 2022-02-02T14:03:21.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.698+0000 7fcf4ffff700 1 -- 172.21.15.33:0/1602999211 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fcf3c000bc0 con 0x7fcf44064dd0 2022-02-02T14:03:21.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 msgr2=0x7fcf44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 0x7fcf44067290 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fcf580600a0 tx=0x7fcf4800b040).stop 2022-02-02T14:03:21.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 msgr2=0x7fcf5810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fcf40009990 tx=0x7fcf40009b30).stop 2022-02-02T14:03:21.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 shutdown_connections 2022-02-02T14:03:21.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf44064dd0 0x7fcf44067290 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf580f55c0 0x7fcf58109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 --2- 172.21.15.33:0/1602999211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf580f6860 0x7fcf5810c110 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 >> 172.21.15.33:0/1602999211 conn(0x7fcf580f0d40 msgr2=0x7fcf580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:21.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 shutdown_connections 2022-02-02T14:03:21.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.700+0000 7fcf5db4d700 1 -- 172.21.15.33:0/1602999211 wait complete. 2022-02-02T14:03:21.711 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:03:21.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 -- 172.21.15.33:0/1758252294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 msgr2=0x7fd6b80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/1758252294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b80f6b00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fd6ac004660 tx=0x7fd6ac009b30).stop 2022-02-02T14:03:21.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 -- 172.21.15.33:0/1758252294 shutdown_connections 2022-02-02T14:03:21.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/1758252294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 0x7fd6b80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/1758252294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b80f6b00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 -- 172.21.15.33:0/1758252294 >> 172.21.15.33:0/1758252294 conn(0x7fd6b80f1e40 msgr2=0x7fd6b80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:21.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 -- 172.21.15.33:0/1758252294 shutdown_connections 2022-02-02T14:03:21.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.802+0000 7fd6c02d6700 1 -- 172.21.15.33:0/1758252294 wait complete. 2022-02-02T14:03:21.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 Processor -- start 2022-02-02T14:03:21.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 -- start start 2022-02-02T14:03:21.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 0x7fd6b81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8107a50 con 0x7fd6b80f66e0 2022-02-02T14:03:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6c02d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8107b90 con 0x7fd6b80f7980 2022-02-02T14:03:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.803+0000 7fd6be072700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59344/0 (socket says 172.21.15.33:59344) 2022-02-02T14:03:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 -- 172.21.15.33:0/2472582035 learned_addr learned my addr 172.21.15.33:0/2472582035 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6bd871700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 0x7fd6b81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 -- 172.21.15.33:0/2472582035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 msgr2=0x7fd6b81074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 0x7fd6b81074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 -- 172.21.15.33:0/2472582035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac005040 con 0x7fd6b80f66e0 2022-02-02T14:03:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6be072700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd6ac004f60 tx=0x7fd6ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac018070 con 0x7fd6b80f66e0 2022-02-02T14:03:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6ac009770 con 0x7fd6b80f66e0 2022-02-02T14:03:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac01c3c0 con 0x7fd6b80f66e0 2022-02-02T14:03:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b81084d0 con 0x7fd6b80f66e0 2022-02-02T14:03:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.804+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b8108a30 con 0x7fd6b80f66e0 2022-02-02T14:03:21.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.805+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8045ad0 con 0x7fd6b80f66e0 2022-02-02T14:03:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.807+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6ac01d420 con 0x7fd6b80f66e0 2022-02-02T14:03:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.807+0000 7fd6aaffd700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.807+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd6ac083a80 con 0x7fd6b80f66e0 2022-02-02T14:03:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.807+0000 7fd6bd871700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.807+0000 7fd6bd871700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd6b40041d0 tx=0x7fd6b4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.811+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6ac055500 con 0x7fd6b80f66e0 2022-02-02T14:03:21.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:21.993+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6b80008d0 con 0x7fd6a4064dd0 2022-02-02T14:03:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.008+0000 7fd6aaffd700 1 -- 172.21.15.33:0/2472582035 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd6b80008d0 con 0x7fd6a4064dd0 2022-02-02T14:03:22.009 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:03:22.009 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (28m) 56s ago 29m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:03:22.009 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (21m) 56s ago 29m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:03:22.009 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (21m) 59s ago 29m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:03:22.010 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (28m) 56s ago 29m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:03:22.010 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (22m) 56s ago 25m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:03:22.010 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (22m) 56s ago 25m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:03:22.010 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (23m) 59s ago 25m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:03:22.011 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (25m) 59s ago 25m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:03:22.011 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (23m) 56s ago 30m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:03:22.011 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (22m) 59s ago 29m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:03:22.011 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (22m) 56s ago 31m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:03:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (22m) 59s ago 29m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:03:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (29m) 56s ago 29m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:03:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (28m) 59s ago 28m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:03:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 56s ago 28m - 4096M 2022-02-02T14:03:22.012 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (28m) 56s ago 28m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:03:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (27m) 56s ago 27m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:03:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (27m) 59s ago 27m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:03:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (27m) 59s ago 27m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:03:22.013 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (26m) 59s ago 26m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:03:22.014 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (28m) 56s ago 29m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:03:22.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 msgr2=0x7fd6a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fd6b40041d0 tx=0x7fd6b4009040).stop 2022-02-02T14:03:22.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 msgr2=0x7fd6b8106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fd6ac004f60 tx=0x7fd6ac009b30).stop 2022-02-02T14:03:22.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 shutdown_connections 2022-02-02T14:03:22.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6b80f66e0 0x7fd6b8106fb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 --2- 172.21.15.33:0/2472582035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6b80f7980 0x7fd6b81074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 >> 172.21.15.33:0/2472582035 conn(0x7fd6b80f1e40 msgr2=0x7fd6b80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:22.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 shutdown_connections 2022-02-02T14:03:22.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.010+0000 7fd6c02d6700 1 -- 172.21.15.33:0/2472582035 wait complete. 2022-02-02T14:03:22.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 -- 172.21.15.33:0/854787108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f77d0 msgr2=0x7fa0cc0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/854787108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc0f7c30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fa0c0004660 tx=0x7fa0c0009b30).stop 2022-02-02T14:03:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 -- 172.21.15.33:0/854787108 shutdown_connections 2022-02-02T14:03:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/854787108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc0f7c30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/854787108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.109+0000 7fa0d16fb700 1 -- 172.21.15.33:0/854787108 >> 172.21.15.33:0/854787108 conn(0x7fa0cc0f1c90 msgr2=0x7fa0cc0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:22.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.110+0000 7fa0d16fb700 1 -- 172.21.15.33:0/854787108 shutdown_connections 2022-02-02T14:03:22.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.110+0000 7fa0d16fb700 1 -- 172.21.15.33:0/854787108 wait complete. 2022-02-02T14:03:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.110+0000 7fa0d16fb700 1 Processor -- start 2022-02-02T14:03:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.110+0000 7fa0d16fb700 1 -- start start 2022-02-02T14:03:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0d16fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0d16fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0d16fb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc107880 con 0x7fa0cc0f6530 2022-02-02T14:03:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0d16fb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0cc108090 con 0x7fa0cc0f77d0 2022-02-02T14:03:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59354/0 (socket says 172.21.15.33:59354) 2022-02-02T14:03:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 -- 172.21.15.33:0/1272271196 learned_addr learned my addr 172.21.15.33:0/1272271196 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cb7fe700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 -- 172.21.15.33:0/1272271196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f77d0 msgr2=0x7fa0cc107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 -- 172.21.15.33:0/1272271196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c0005040 con 0x7fa0cc0f6530 2022-02-02T14:03:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.111+0000 7fa0cbfff700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fa0bc002700 tx=0x7fa0bc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.112+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc0079c0 con 0x7fa0cc0f6530 2022-02-02T14:03:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.112+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0bc00f040 con 0x7fa0cc0f6530 2022-02-02T14:03:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.112+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0cc108310 con 0x7fa0cc0f6530 2022-02-02T14:03:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.112+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc014860 con 0x7fa0cc0f6530 2022-02-02T14:03:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.112+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0cc1088d0 con 0x7fa0cc0f6530 2022-02-02T14:03:22.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.113+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0cc059100 con 0x7fa0cc0f6530 2022-02-02T14:03:22.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.114+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa0bc01b060 con 0x7fa0cc0f6530 2022-02-02T14:03:22.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.114+0000 7fa0c8ff9700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 0x7fa0b40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.114+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa0bc081930 con 0x7fa0cc0f6530 2022-02-02T14:03:22.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.114+0000 7fa0cb7fe700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 0x7fa0b40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.114+0000 7fa0cb7fe700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 0x7fa0b40672e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa0c0004630 tx=0x7fa0c0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:22.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.118+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa0bc04f9e0 con 0x7fa0cc0f6530 2022-02-02T14:03:22.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.363+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0cc045ad0 con 0x7fa0cc0f6530 2022-02-02T14:03:22.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.364+0000 7fa0c8ff9700 1 -- 172.21.15.33:0/1272271196 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa0bc0192d0 con 0x7fa0cc0f6530 2022-02-02T14:03:22.366 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:03:22.366 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:03:22.366 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:03:22.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:22.367 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:03:22.367 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:03:22.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:22.367 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:03:22.368 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:03:22.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:22.368 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:03:22.368 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:03:22.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:22.369 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:03:22.369 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:03:22.369 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:03:22.369 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:03:22.370 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:03:22.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.366+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 msgr2=0x7fa0b40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.366+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 0x7fa0b40672e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fa0c0004630 tx=0x7fa0c0009b30).stop 2022-02-02T14:03:22.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.366+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 msgr2=0x7fa0cc106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.366+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fa0bc002700 tx=0x7fa0bc009d80).stop 2022-02-02T14:03:22.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 shutdown_connections 2022-02-02T14:03:22.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0b4064e20 0x7fa0b40672e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0cc0f6530 0x7fa0cc106d90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 --2- 172.21.15.33:0/1272271196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0cc0f77d0 0x7fa0cc107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 >> 172.21.15.33:0/1272271196 conn(0x7fa0cc0f1c90 msgr2=0x7fa0cc0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:22.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 shutdown_connections 2022-02-02T14:03:22.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.367+0000 7fa0d16fb700 1 -- 172.21.15.33:0/1272271196 wait complete. 2022-02-02T14:03:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- 172.21.15.33:0/2727684231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f6860 msgr2=0x7fd66c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 --2- 172.21.15.33:0/2727684231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f6860 0x7fd66c0f6cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fd660004660 tx=0x7fd660009b30).stop 2022-02-02T14:03:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- 172.21.15.33:0/2727684231 shutdown_connections 2022-02-02T14:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 --2- 172.21.15.33:0/2727684231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f6860 0x7fd66c0f6cc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 --2- 172.21.15.33:0/2727684231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f55c0 0x7fd66c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- 172.21.15.33:0/2727684231 >> 172.21.15.33:0/2727684231 conn(0x7fd66c0f0d40 msgr2=0x7fd66c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- 172.21.15.33:0/2727684231 shutdown_connections 2022-02-02T14:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- 172.21.15.33:0/2727684231 wait complete. 2022-02-02T14:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 Processor -- start 2022-02-02T14:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.468+0000 7fd670e1d700 1 -- start start 2022-02-02T14:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f6860 0x7fd66c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c1069b0 con 0x7fd66c0f55c0 2022-02-02T14:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c1071c0 con 0x7fd66c0f6860 2022-02-02T14:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59364/0 (socket says 172.21.15.33:59364) 2022-02-02T14:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 -- 172.21.15.33:0/1454779540 learned_addr learned my addr 172.21.15.33:0/1454779540 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd669d9b700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f6860 0x7fd66c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 -- 172.21.15.33:0/1454779540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f6860 msgr2=0x7fd66c1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f6860 0x7fd66c1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 -- 172.21.15.33:0/1454779540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660005040 con 0x7fd66c0f55c0 2022-02-02T14:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd66a59c700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fd65c002700 tx=0x7fd65c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd65c009320 con 0x7fd66c0f55c0 2022-02-02T14:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd65c00f040 con 0x7fd66c0f55c0 2022-02-02T14:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c1073e0 con 0x7fd66c0f55c0 2022-02-02T14:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd65c014900 con 0x7fd66c0f55c0 2022-02-02T14:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.469+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c107970 con 0x7fd66c0f55c0 2022-02-02T14:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.471+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66c0f49b0 con 0x7fd66c0f55c0 2022-02-02T14:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.471+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd65c009480 con 0x7fd66c0f55c0 2022-02-02T14:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.471+0000 7fd65affd700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 0x7fd654067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.471+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd65c081c30 con 0x7fd66c0f55c0 2022-02-02T14:03:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.471+0000 7fd669d9b700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 0x7fd654067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.472+0000 7fd669d9b700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 0x7fd654067290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd660004630 tx=0x7fd660009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.475+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd65c04fce0 con 0x7fd66c0f55c0 2022-02-02T14:03:22.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.687+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd66c0ff830 con 0x7fd66c0f55c0 2022-02-02T14:03:22.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.687+0000 7fd65affd700 1 -- 172.21.15.33:0/1454779540 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd65c053300 con 0x7fd66c0f55c0 2022-02-02T14:03:22.689 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:03:22.689 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:03:22.689 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:03:22.689 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:03:22.690 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:22.690 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:03:22.690 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:03:22.690 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:03:22.691 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:03:22.691 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:03:22.691 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:03:22.691 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:03:22.691 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:03:22.692 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:03:22.692 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:03:22.692 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:03:22.692 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:03:22.693 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:03:22.693 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:03:22.693 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:03:22.693 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:03:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:03:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:03:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:03:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:03:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:03:22.695 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:03:22.695 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:03:22.695 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:03:22.695 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:03:22.695 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:03:22.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:22.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:22.696 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:03:22.697 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:22.697 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:22.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 msgr2=0x7fd654067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 0x7fd654067290 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd660004630 tx=0x7fd660009b30).stop 2022-02-02T14:03:22.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 msgr2=0x7fd66c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:22.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fd65c002700 tx=0x7fd65c009d80).stop 2022-02-02T14:03:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 shutdown_connections 2022-02-02T14:03:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd654064dd0 0x7fd654067290 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd66c0f55c0 0x7fd66c105ec0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 --2- 172.21.15.33:0/1454779540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd66c0f6860 0x7fd66c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:22.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 >> 172.21.15.33:0/1454779540 conn(0x7fd66c0f0d40 msgr2=0x7fd66c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:22.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 shutdown_connections 2022-02-02T14:03:22.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:22.691+0000 7fd670e1d700 1 -- 172.21.15.33:0/1454779540 wait complete. 2022-02-02T14:03:22.701 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:03:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:22 smithi033 ceph-mon[101165]: pgmap v724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:22 smithi033 ceph-mon[101165]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:22 smithi033 ceph-mon[101165]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:22.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:22 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1272271196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:03:22.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:22 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1454779540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:03:23.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:22 smithi037 ceph-mon[69017]: pgmap v724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:22 smithi037 ceph-mon[69017]: from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:22 smithi037 ceph-mon[69017]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:22 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1272271196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:03:23.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:22 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1454779540' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:03:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:24 smithi033 ceph-mon[101165]: pgmap v725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:25.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:24 smithi037 ceph-mon[69017]: pgmap v725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:25 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:03:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:25 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:03:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:25 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:03:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:25 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:03:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:25 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:03:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:25 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:03:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:26 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:03:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:26 smithi033 ceph-mon[101165]: pgmap v726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:26 smithi033 ceph-mon[101165]: pgmap v727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:26 smithi033 ceph-mon[101165]: pgmap v728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:03:27.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:26 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:03:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:26 smithi037 ceph-mon[69017]: pgmap v726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:26 smithi037 ceph-mon[69017]: pgmap v727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:26 smithi037 ceph-mon[69017]: pgmap v728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:27.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:03:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:28 smithi033 ceph-mon[101165]: pgmap v729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:29.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:28 smithi037 ceph-mon[69017]: pgmap v729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:30 smithi033 ceph-mon[101165]: pgmap v730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:30 smithi037 ceph-mon[69017]: pgmap v730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:32 smithi033 ceph-mon[101165]: pgmap v731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:33.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:32 smithi037 ceph-mon[69017]: pgmap v731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:34 smithi033 ceph-mon[101165]: pgmap v732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:35.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:34 smithi037 ceph-mon[69017]: pgmap v732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:36 smithi033 ceph-mon[101165]: pgmap v733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:37.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:36 smithi037 ceph-mon[69017]: pgmap v733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:39 smithi037 ceph-mon[69017]: pgmap v734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:39 smithi033 ceph-mon[101165]: pgmap v734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:41 smithi037 ceph-mon[69017]: pgmap v735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:41 smithi033 ceph-mon[101165]: pgmap v735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:43.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:43 smithi037 ceph-mon[69017]: pgmap v736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:43 smithi033 ceph-mon[101165]: pgmap v736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:45.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:45 smithi037 ceph-mon[69017]: pgmap v737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:45.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:45 smithi033 ceph-mon[101165]: pgmap v737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:46 smithi033 ceph-mon[101165]: pgmap v738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:46 smithi037 ceph-mon[69017]: pgmap v738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:49.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:49 smithi037 ceph-mon[69017]: pgmap v739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:49 smithi033 ceph-mon[101165]: pgmap v739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:51.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:51 smithi037 ceph-mon[69017]: pgmap v740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:51 smithi033 ceph-mon[101165]: pgmap v740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 -- 172.21.15.33:0/467196620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f55c0 msgr2=0x7faa040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 --2- 172.21.15.33:0/467196620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f55c0 0x7faa040f59e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fa9f4004660 tx=0x7fa9f4009b30).stop 2022-02-02T14:03:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 -- 172.21.15.33:0/467196620 shutdown_connections 2022-02-02T14:03:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 --2- 172.21.15.33:0/467196620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f6860 0x7faa040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 --2- 172.21.15.33:0/467196620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f55c0 0x7faa040f59e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 -- 172.21.15.33:0/467196620 >> 172.21.15.33:0/467196620 conn(0x7faa040f0d40 msgr2=0x7faa040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 -- 172.21.15.33:0/467196620 shutdown_connections 2022-02-02T14:03:52.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 -- 172.21.15.33:0/467196620 wait complete. 2022-02-02T14:03:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.808+0000 7faa09f46700 1 Processor -- start 2022-02-02T14:03:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa09f46700 1 -- start start 2022-02-02T14:03:52.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa09f46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f55c0 0x7faa040f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:52.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa09f46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:52.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa09f46700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040f8920 con 0x7faa040f6860 2022-02-02T14:03:52.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa09f46700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa040f8a60 con 0x7faa040f55c0 2022-02-02T14:03:52.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59376/0 (socket says 172.21.15.33:59376) 2022-02-02T14:03:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa02ffd700 1 -- 172.21.15.33:0/3877290097 learned_addr learned my addr 172.21.15.33:0/3877290097 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.809+0000 7faa037fe700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f55c0 0x7faa040f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:52.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa02ffd700 1 -- 172.21.15.33:0/3877290097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f55c0 msgr2=0x7faa040f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa02ffd700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f55c0 0x7faa040f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa02ffd700 1 -- 172.21.15.33:0/3877290097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4005040 con 0x7faa040f6860 2022-02-02T14:03:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa02ffd700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa9f800c790 tx=0x7fa9f8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f8002590 con 0x7faa040f6860 2022-02-02T14:03:52.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa040f8d40 con 0x7faa040f6860 2022-02-02T14:03:52.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9f8002ba0 con 0x7faa040f6860 2022-02-02T14:03:52.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f8013d90 con 0x7faa040f6860 2022-02-02T14:03:52.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.810+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0410efa0 con 0x7faa040f6860 2022-02-02T14:03:52.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.811+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa04045ad0 con 0x7faa040f6860 2022-02-02T14:03:52.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.812+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa9f801a060 con 0x7faa040f6860 2022-02-02T14:03:52.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.812+0000 7fa9ebfff700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:52.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.812+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa9f8081d10 con 0x7faa040f6860 2022-02-02T14:03:52.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.812+0000 7faa037fe700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:52.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.813+0000 7faa037fe700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa9f4013690 tx=0x7fa9f4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:52.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:52.817+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa9f804fd60 con 0x7faa040f6860 2022-02-02T14:03:53.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.003+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa0405fd30 con 0x7fa9ec064dd0 2022-02-02T14:03:53.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.004+0000 7fa9ebfff700 1 -- 172.21.15.33:0/3877290097 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7faa0405fd30 con 0x7fa9ec064dd0 2022-02-02T14:03:53.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 msgr2=0x7fa9ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fa9f4013690 tx=0x7fa9f4009b30).stop 2022-02-02T14:03:53.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 msgr2=0x7faa040f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa9f800c790 tx=0x7fa9f8007d70).stop 2022-02-02T14:03:53.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 shutdown_connections 2022-02-02T14:03:53.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f55c0 0x7faa040f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 --2- 172.21.15.33:0/3877290097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f6860 0x7faa040f83c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 >> 172.21.15.33:0/3877290097 conn(0x7faa040f0d40 msgr2=0x7faa0405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 shutdown_connections 2022-02-02T14:03:53.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.006+0000 7faa09f46700 1 -- 172.21.15.33:0/3877290097 wait complete. 2022-02-02T14:03:53.016 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:03:53.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 -- 172.21.15.33:0/2171800304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 msgr2=0x7f4f2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/2171800304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c0f59e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f4f28004660 tx=0x7f4f28009b30).stop 2022-02-02T14:03:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 -- 172.21.15.33:0/2171800304 shutdown_connections 2022-02-02T14:03:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/2171800304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 0x7f4f2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/2171800304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c0f59e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 -- 172.21.15.33:0/2171800304 >> 172.21.15.33:0/2171800304 conn(0x7f4f2c0f0d40 msgr2=0x7f4f2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.109 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:53 smithi033 ceph-mon[101165]: pgmap v741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.107+0000 7f4f33e4d700 1 -- 172.21.15.33:0/2171800304 shutdown_connections 2022-02-02T14:03:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.108+0000 7f4f33e4d700 1 -- 172.21.15.33:0/2171800304 wait complete. 2022-02-02T14:03:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.108+0000 7f4f33e4d700 1 Processor -- start 2022-02-02T14:03:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.108+0000 7f4f33e4d700 1 -- start start 2022-02-02T14:03:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f33e4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f33e4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 0x7f4f2c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f33e4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c107a10 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f33e4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c107b50 con 0x7f4f2c0f6860 2022-02-02T14:03:53.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59384/0 (socket says 172.21.15.33:59384) 2022-02-02T14:03:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 -- 172.21.15.33:0/4157486403 learned_addr learned my addr 172.21.15.33:0/4157486403 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f313e8700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 0x7f4f2c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 -- 172.21.15.33:0/4157486403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 msgr2=0x7f4f2c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 0x7f4f2c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 -- 172.21.15.33:0/4157486403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28005040 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f31be9700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f4f28004f60 tx=0x7f4f28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f28018070 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f28009770 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.109+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2801c3c0 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.110+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c108490 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.110+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1089f0 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.111+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c045ad0 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.111+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f2801d420 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.111+0000 7f4f1e7fc700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 0x7f4f18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.112+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f280837d0 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.112+0000 7f4f313e8700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 0x7f4f18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.112+0000 7f4f313e8700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 0x7f4f18067290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4f20007fd0 tx=0x7f4f20009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.116+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f280552b0 con 0x7f4f2c0f55c0 2022-02-02T14:03:53.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:53 smithi037 ceph-mon[69017]: pgmap v741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:53.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.297+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f2c0fdf40 con 0x7f4f18064dd0 2022-02-02T14:03:53.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.311+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4157486403 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4f2c0fdf40 con 0x7f4f18064dd0 2022-02-02T14:03:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:03:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (29m) 88s ago 30m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:03:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (22m) 88s ago 30m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:03:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (22m) 91s ago 29m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:03:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (29m) 88s ago 29m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:03:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (22m) 88s ago 26m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:03:53.312 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (23m) 88s ago 26m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:03:53.313 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (24m) 91s ago 26m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:03:53.313 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (26m) 91s ago 26m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:03:53.313 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (23m) 88s ago 31m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:03:53.313 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (23m) 91s ago 29m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:03:53.314 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (23m) 88s ago 31m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:03:53.314 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (22m) 91s ago 29m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:03:53.314 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (29m) 88s ago 29m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:03:53.315 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (29m) 91s ago 29m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:03:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 88s ago 28m - 4096M 2022-02-02T14:03:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (28m) 88s ago 28m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:03:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (28m) 88s ago 28m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:03:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (28m) 91s ago 28m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:03:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (27m) 91s ago 27m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:03:53.317 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (27m) 91s ago 27m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:03:53.317 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (28m) 88s ago 29m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:03:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 msgr2=0x7f4f18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 0x7f4f18067290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f4f20007fd0 tx=0x7f4f20009040).stop 2022-02-02T14:03:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 msgr2=0x7f4f2c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f4f28004f60 tx=0x7f4f28009b30).stop 2022-02-02T14:03:53.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 shutdown_connections 2022-02-02T14:03:53.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f18064dd0 0x7f4f18067290 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f2c0f55c0 0x7f4f2c106f70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 --2- 172.21.15.33:0/4157486403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f2c0f6860 0x7f4f2c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.313+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 >> 172.21.15.33:0/4157486403 conn(0x7f4f2c0f0d40 msgr2=0x7f4f2c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.314+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 shutdown_connections 2022-02-02T14:03:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.314+0000 7f4f33e4d700 1 -- 172.21.15.33:0/4157486403 wait complete. 2022-02-02T14:03:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 -- 172.21.15.33:0/3436515936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 msgr2=0x7f78440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 --2- 172.21.15.33:0/3436515936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f78440f59e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f7834004660 tx=0x7f7834009b30).stop 2022-02-02T14:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 -- 172.21.15.33:0/3436515936 shutdown_connections 2022-02-02T14:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 --2- 172.21.15.33:0/3436515936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 0x7f78440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 --2- 172.21.15.33:0/3436515936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f78440f59e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 -- 172.21.15.33:0/3436515936 >> 172.21.15.33:0/3436515936 conn(0x7f78440f0d40 msgr2=0x7f78440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 -- 172.21.15.33:0/3436515936 shutdown_connections 2022-02-02T14:03:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.413+0000 7f7849627700 1 -- 172.21.15.33:0/3436515936 wait complete. 2022-02-02T14:03:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 Processor -- start 2022-02-02T14:03:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 -- start start 2022-02-02T14:03:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 0x7f784410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440603c0 con 0x7f78440f55c0 2022-02-02T14:03:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7849627700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7844060500 con 0x7f78440f6860 2022-02-02T14:03:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7842ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7842ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59394/0 (socket says 172.21.15.33:59394) 2022-02-02T14:03:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f7842ffd700 1 -- 172.21.15.33:0/2109649975 learned_addr learned my addr 172.21.15.33:0/2109649975 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.414+0000 7f78427fc700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 0x7f784410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7842ffd700 1 -- 172.21.15.33:0/2109649975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 msgr2=0x7f784410c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7842ffd700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 0x7f784410c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7842ffd700 1 -- 172.21.15.33:0/2109649975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7834005040 con 0x7f78440f55c0 2022-02-02T14:03:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7842ffd700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f7834013a70 tx=0x7f7834009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7834018070 con 0x7f78440f55c0 2022-02-02T14:03:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f78340097d0 con 0x7f78440f55c0 2022-02-02T14:03:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f783401de80 con 0x7f78440f55c0 2022-02-02T14:03:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784410c6e0 con 0x7f78440f55c0 2022-02-02T14:03:53.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.415+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784410cc10 con 0x7f78440f55c0 2022-02-02T14:03:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.416+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78440f49b0 con 0x7f78440f55c0 2022-02-02T14:03:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.417+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f783401d420 con 0x7f78440f55c0 2022-02-02T14:03:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.417+0000 7f783b7fe700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 0x7f7830067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.417+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f78340835e0 con 0x7f78440f55c0 2022-02-02T14:03:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.417+0000 7f78427fc700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 0x7f7830067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.418+0000 7f78427fc700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 0x7f7830067290 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f782c004c40 tx=0x7f782c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.421+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7834051800 con 0x7f78440f55c0 2022-02-02T14:03:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.663+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78440fde90 con 0x7f78440f55c0 2022-02-02T14:03:53.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.664+0000 7f783b7fe700 1 -- 172.21.15.33:0/2109649975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7834054e20 con 0x7f78440f55c0 2022-02-02T14:03:53.665 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:03:53.665 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:03:53.666 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:03:53.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:03:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:03:53.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:03:53.669 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:03:53.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 msgr2=0x7f7830067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 0x7f7830067290 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f782c004c40 tx=0x7f782c00b040).stop 2022-02-02T14:03:53.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 msgr2=0x7f7844109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f7834013a70 tx=0x7f7834009b30).stop 2022-02-02T14:03:53.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 shutdown_connections 2022-02-02T14:03:53.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7830064dd0 0x7f7830067290 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78440f55c0 0x7f7844109c90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 --2- 172.21.15.33:0/2109649975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78440f6860 0x7f784410c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 >> 172.21.15.33:0/2109649975 conn(0x7f78440f0d40 msgr2=0x7f78440fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 shutdown_connections 2022-02-02T14:03:53.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.666+0000 7f7849627700 1 -- 172.21.15.33:0/2109649975 wait complete. 2022-02-02T14:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 -- 172.21.15.33:0/1306945904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 msgr2=0x7f4cb80f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/1306945904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb80f5880 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f4ca80046e0 tx=0x7f4ca8009b30).stop 2022-02-02T14:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 -- 172.21.15.33:0/1306945904 shutdown_connections 2022-02-02T14:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/1306945904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb80f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/1306945904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb80f5880 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.767+0000 7f4cbd84d700 1 -- 172.21.15.33:0/1306945904 >> 172.21.15.33:0/1306945904 conn(0x7f4cb80f0bc0 msgr2=0x7f4cb80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:53.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 -- 172.21.15.33:0/1306945904 shutdown_connections 2022-02-02T14:03:53.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 -- 172.21.15.33:0/1306945904 wait complete. 2022-02-02T14:03:53.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 Processor -- start 2022-02-02T14:03:53.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 -- start start 2022-02-02T14:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb8105030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb81055e0 con 0x7f4cb80f5460 2022-02-02T14:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.768+0000 7f4cbd84d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb8105720 con 0x7f4cb80f6700 2022-02-02T14:03:53.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59404/0 (socket says 172.21.15.33:59404) 2022-02-02T14:03:53.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 -- 172.21.15.33:0/654820290 learned_addr learned my addr 172.21.15.33:0/654820290 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:03:53.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb67fc700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb8105030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 -- 172.21.15.33:0/654820290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 msgr2=0x7f4cb8105030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:53.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb8105030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:53.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 -- 172.21.15.33:0/654820290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac005040 con 0x7f4cb80f5460 2022-02-02T14:03:53.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb67fc700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb8105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:03:53.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cb6ffd700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f4ca80117e0 tx=0x7f4ca8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca8007c70 con 0x7f4cb80f5460 2022-02-02T14:03:53.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ca8007dd0 con 0x7f4cb80f5460 2022-02-02T14:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ca8023610 con 0x7f4cb80f5460 2022-02-02T14:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca8005040 con 0x7f4cb80f5460 2022-02-02T14:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.769+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb8106430 con 0x7f4cb80f5460 2022-02-02T14:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.770+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb8045ad0 con 0x7f4cb80f5460 2022-02-02T14:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.771+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ca802b070 con 0x7f4cb80f5460 2022-02-02T14:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.771+0000 7f4c9f7fe700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 0x7f4ca00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.771+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ca80857d0 con 0x7f4cb80f5460 2022-02-02T14:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.771+0000 7f4cb67fc700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 0x7f4ca00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.772+0000 7f4cb67fc700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 0x7f4ca00672e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4cac009da0 tx=0x7f4cac009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.775+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ca80572b0 con 0x7f4cb80f5460 2022-02-02T14:03:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.991+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4cb80fe9e0 con 0x7f4cb80f5460 2022-02-02T14:03:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.992+0000 7f4c9f7fe700 1 -- 172.21.15.33:0/654820290 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4ca8016750 con 0x7f4cb80f5460 2022-02-02T14:03:53.993 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:03:53.993 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:03:53.994 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:03:53.994 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:03:53.994 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:53.995 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:03:53.995 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:03:53.995 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:03:53.995 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:03:53.995 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:03:53.996 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:03:53.996 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:03:53.996 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:03:53.996 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:03:53.997 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:03:53.997 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:03:53.997 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:03:53.997 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:03:53.998 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:03:53.998 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:03:53.998 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:03:53.998 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:03:53.999 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:03:53.999 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:03:53.999 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:03:53.999 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:03:54.000 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:03:54.000 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:03:54.000 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:03:54.000 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:03:54.001 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:03:54.001 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:54.001 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:54.001 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:03:54.001 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:03:54.002 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:54.002 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:54.002 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:54.002 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:03:54.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.993+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 msgr2=0x7f4ca00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.993+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 0x7f4ca00672e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4cac009da0 tx=0x7f4cac009b30).stop 2022-02-02T14:03:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.993+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 msgr2=0x7f4cb8104b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:03:54.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.993+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f4ca80117e0 tx=0x7f4ca8009b30).stop 2022-02-02T14:03:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 shutdown_connections 2022-02-02T14:03:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ca0064e20 0x7f4ca00672e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cb80f5460 0x7f4cb8104b40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 --2- 172.21.15.33:0/654820290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cb80f6700 0x7f4cb8105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:03:54.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 >> 172.21.15.33:0/654820290 conn(0x7f4cb80f0bc0 msgr2=0x7f4cb80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:03:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 shutdown_connections 2022-02-02T14:03:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:03:53.994+0000 7f4cbd84d700 1 -- 172.21.15.33:0/654820290 wait complete. 2022-02-02T14:03:54.006 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:03:54.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:54 smithi037 ceph-mon[69017]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2109649975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:03:54.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/654820290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:03:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:54 smithi033 ceph-mon[101165]: from='client.34854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2109649975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:03:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/654820290' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:03:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:55 smithi037 ceph-mon[69017]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:55 smithi037 ceph-mon[69017]: pgmap v742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:03:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:03:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:55 smithi033 ceph-mon[101165]: from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:03:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:55 smithi033 ceph-mon[101165]: pgmap v742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:03:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:03:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:56 smithi033 ceph-mon[101165]: pgmap v743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:57.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:56 smithi037 ceph-mon[69017]: pgmap v743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:03:59 smithi037 ceph-mon[69017]: pgmap v744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:03:59.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:03:59 smithi033 ceph-mon[101165]: pgmap v744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:01 smithi037 ceph-mon[69017]: pgmap v745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:01 smithi033 ceph-mon[101165]: pgmap v745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:03.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:03 smithi037 ceph-mon[69017]: pgmap v746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:03 smithi033 ceph-mon[101165]: pgmap v746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:05 smithi037 ceph-mon[69017]: pgmap v747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:05 smithi033 ceph-mon[101165]: pgmap v747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:06 smithi033 ceph-mon[101165]: pgmap v748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:06 smithi037 ceph-mon[69017]: pgmap v748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:09 smithi037 ceph-mon[69017]: pgmap v749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:09.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:09 smithi033 ceph-mon[101165]: pgmap v749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:11 smithi037 ceph-mon[69017]: pgmap v750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:11.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:11 smithi033 ceph-mon[101165]: pgmap v750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:13 smithi037 ceph-mon[69017]: pgmap v751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:13 smithi033 ceph-mon[101165]: pgmap v751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:15.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:15 smithi037 ceph-mon[69017]: pgmap v752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:15.493 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:15 smithi033 ceph-mon[101165]: pgmap v752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:17.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:16 smithi033 ceph-mon[101165]: pgmap v753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:16 smithi037 ceph-mon[69017]: pgmap v753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:19.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:19 smithi037 ceph-mon[69017]: pgmap v754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:19.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:19 smithi033 ceph-mon[101165]: pgmap v754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:21.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:21 smithi037 ceph-mon[69017]: pgmap v755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:21 smithi033 ceph-mon[101165]: pgmap v755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:23.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:23 smithi037 ceph-mon[69017]: pgmap v756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:23 smithi033 ceph-mon[101165]: pgmap v756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 -- 172.21.15.33:0/1645071488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f6860 msgr2=0x7fda8c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 --2- 172.21.15.33:0/1645071488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f6860 0x7fda8c0f6cc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fda80004660 tx=0x7fda80009b30).stop 2022-02-02T14:04:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 -- 172.21.15.33:0/1645071488 shutdown_connections 2022-02-02T14:04:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 --2- 172.21.15.33:0/1645071488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f6860 0x7fda8c0f6cc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 --2- 172.21.15.33:0/1645071488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f55c0 0x7fda8c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 -- 172.21.15.33:0/1645071488 >> 172.21.15.33:0/1645071488 conn(0x7fda8c0f0d40 msgr2=0x7fda8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.108+0000 7fda91c1e700 1 -- 172.21.15.33:0/1645071488 shutdown_connections 2022-02-02T14:04:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.109+0000 7fda91c1e700 1 -- 172.21.15.33:0/1645071488 wait complete. 2022-02-02T14:04:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.109+0000 7fda91c1e700 1 Processor -- start 2022-02-02T14:04:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.109+0000 7fda91c1e700 1 -- start start 2022-02-02T14:04:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda91c1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda91c1e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f6860 0x7fda8c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda91c1e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c107a10 con 0x7fda8c0f55c0 2022-02-02T14:04:24.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda91c1e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c107b50 con 0x7fda8c0f6860 2022-02-02T14:04:24.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59414/0 (socket says 172.21.15.33:59414) 2022-02-02T14:04:24.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 -- 172.21.15.33:0/312734236 learned_addr learned my addr 172.21.15.33:0/312734236 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:24.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8affd700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f6860 0x7fda8c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 -- 172.21.15.33:0/312734236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f6860 msgr2=0x7fda8c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f6860 0x7fda8c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 -- 172.21.15.33:0/312734236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda80005040 con 0x7fda8c0f55c0 2022-02-02T14:04:24.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda8b7fe700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fda7c002700 tx=0x7fda7c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7c009320 con 0x7fda8c0f55c0 2022-02-02T14:04:24.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda8c1084f0 con 0x7fda8c0f55c0 2022-02-02T14:04:24.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.110+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda7c00f040 con 0x7fda8c0f55c0 2022-02-02T14:04:24.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.111+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7c014900 con 0x7fda8c0f55c0 2022-02-02T14:04:24.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.111+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c108ab0 con 0x7fda8c0f55c0 2022-02-02T14:04:24.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.112+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda7c009480 con 0x7fda8c0f55c0 2022-02-02T14:04:24.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.112+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c045ad0 con 0x7fda8c0f55c0 2022-02-02T14:04:24.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.113+0000 7fda73fff700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.113+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fda7c081d10 con 0x7fda8c0f55c0 2022-02-02T14:04:24.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.113+0000 7fda8affd700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.113+0000 7fda8affd700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 0x7fda74067290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fda80004630 tx=0x7fda80009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.117+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda7c0538b0 con 0x7fda8c0f55c0 2022-02-02T14:04:24.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.312+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda8c0faca0 con 0x7fda74064dd0 2022-02-02T14:04:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.313+0000 7fda73fff700 1 -- 172.21.15.33:0/312734236 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fda8c0faca0 con 0x7fda74064dd0 2022-02-02T14:04:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 msgr2=0x7fda74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 0x7fda74067290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fda80004630 tx=0x7fda80009b30).stop 2022-02-02T14:04:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 msgr2=0x7fda8c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fda7c002700 tx=0x7fda7c009d80).stop 2022-02-02T14:04:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 shutdown_connections 2022-02-02T14:04:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda74064dd0 0x7fda74067290 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda8c0f55c0 0x7fda8c106f70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 --2- 172.21.15.33:0/312734236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda8c0f6860 0x7fda8c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 >> 172.21.15.33:0/312734236 conn(0x7fda8c0f0d40 msgr2=0x7fda8c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 shutdown_connections 2022-02-02T14:04:24.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.315+0000 7fda91c1e700 1 -- 172.21.15.33:0/312734236 wait complete. 2022-02-02T14:04:24.325 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:04:24.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.415+0000 7f08ebfff700 1 -- 172.21.15.33:0/2801238915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f66d0 msgr2=0x7f08ec0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.415+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2801238915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f66d0 0x7f08ec0f6b30 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f08dc004660 tx=0x7f08dc009b30).stop 2022-02-02T14:04:24.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 -- 172.21.15.33:0/2801238915 shutdown_connections 2022-02-02T14:04:24.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2801238915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f66d0 0x7f08ec0f6b30 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2801238915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f5430 0x7f08ec0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 -- 172.21.15.33:0/2801238915 >> 172.21.15.33:0/2801238915 conn(0x7f08ec0f0b90 msgr2=0x7f08ec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 -- 172.21.15.33:0/2801238915 shutdown_connections 2022-02-02T14:04:24.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.416+0000 7f08ebfff700 1 -- 172.21.15.33:0/2801238915 wait complete. 2022-02-02T14:04:24.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 Processor -- start 2022-02-02T14:04:24.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 -- start start 2022-02-02T14:04:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f66d0 0x7f08ec1060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec106670 con 0x7f08ec0f5430 2022-02-02T14:04:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ebfff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec1067b0 con 0x7f08ec0f66d0 2022-02-02T14:04:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59424/0 (socket says 172.21.15.33:59424) 2022-02-02T14:04:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 -- 172.21.15.33:0/2963974891 learned_addr learned my addr 172.21.15.33:0/2963974891 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08ea7fc700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f66d0 0x7f08ec1060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 -- 172.21.15.33:0/2963974891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f66d0 msgr2=0x7f08ec1060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f66d0 0x7f08ec1060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.417+0000 7f08eaffd700 1 -- 172.21.15.33:0/2963974891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc005040 con 0x7f08ec0f5430 2022-02-02T14:04:24.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08eaffd700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f08e000f970 tx=0x7f08e0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e0009500 con 0x7f08ec0f5430 2022-02-02T14:04:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08e0009660 con 0x7f08ec0f5430 2022-02-02T14:04:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e000de20 con 0x7f08ec0f5430 2022-02-02T14:04:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec107150 con 0x7f08ec0f5430 2022-02-02T14:04:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.418+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec107710 con 0x7f08ec0f5430 2022-02-02T14:04:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.419+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec045ad0 con 0x7f08ec0f5430 2022-02-02T14:04:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.419+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f08e000e040 con 0x7f08ec0f5430 2022-02-02T14:04:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.420+0000 7f08d37fe700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 0x7f08d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.420+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f08e00841d0 con 0x7f08ec0f5430 2022-02-02T14:04:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.420+0000 7f08ea7fc700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 0x7f08d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.420+0000 7f08ea7fc700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 0x7f08d40672e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f08dc004630 tx=0x7f08dc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.424+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08e0055cb0 con 0x7f08ec0f5430 2022-02-02T14:04:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.608+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f08ec0ff650 con 0x7f08d4064e20 2022-02-02T14:04:24.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.622+0000 7f08d37fe700 1 -- 172.21.15.33:0/2963974891 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f08ec0ff650 con 0x7f08d4064e20 2022-02-02T14:04:24.623 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:04:24.624 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (29m) 119s ago 30m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:04:24.624 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (22m) 119s ago 30m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:04:24.624 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (22m) 2m ago 30m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:04:24.625 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (29m) 119s ago 30m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:04:24.625 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (23m) 119s ago 26m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:04:24.625 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (23m) 119s ago 26m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:04:24.625 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (24m) 2m ago 26m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:04:24.625 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (26m) 2m ago 26m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:04:24.626 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (24m) 119s ago 32m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:04:24.626 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (23m) 2m ago 30m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:04:24.628 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (23m) 119s ago 32m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:04:24.628 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (23m) 2m ago 30m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:04:24.630 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (30m) 119s ago 30m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:04:24.630 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (29m) 2m ago 29m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:04:24.631 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 119s ago 29m - 4096M 2022-02-02T14:04:24.631 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (29m) 119s ago 29m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:04:24.632 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (28m) 119s ago 28m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:04:24.632 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (28m) 2m ago 28m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:04:24.632 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (28m) 2m ago 28m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:04:24.632 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (28m) 2m ago 28m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:04:24.633 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (29m) 119s ago 30m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:04:24.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 msgr2=0x7f08d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 0x7f08d40672e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f08dc004630 tx=0x7f08dc009b30).stop 2022-02-02T14:04:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 msgr2=0x7f08ec105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f08e000f970 tx=0x7f08e0009e00).stop 2022-02-02T14:04:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 shutdown_connections 2022-02-02T14:04:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f08d4064e20 0x7f08d40672e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08ec0f5430 0x7f08ec105bd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 --2- 172.21.15.33:0/2963974891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08ec0f66d0 0x7f08ec1060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 >> 172.21.15.33:0/2963974891 conn(0x7f08ec0f0b90 msgr2=0x7f08ec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 shutdown_connections 2022-02-02T14:04:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.624+0000 7f08ebfff700 1 -- 172.21.15.33:0/2963974891 wait complete. 2022-02-02T14:04:24.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 -- 172.21.15.33:0/482852744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 msgr2=0x7fb95c0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 --2- 172.21.15.33:0/482852744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c0f6b60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fb94c004660 tx=0x7fb94c009b30).stop 2022-02-02T14:04:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 -- 172.21.15.33:0/482852744 shutdown_connections 2022-02-02T14:04:24.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 --2- 172.21.15.33:0/482852744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c0f6b60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 --2- 172.21.15.33:0/482852744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 -- 172.21.15.33:0/482852744 >> 172.21.15.33:0/482852744 conn(0x7fb95c0f0bc0 msgr2=0x7fb95c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 -- 172.21.15.33:0/482852744 shutdown_connections 2022-02-02T14:04:24.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 -- 172.21.15.33:0/482852744 wait complete. 2022-02-02T14:04:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.725+0000 7fb961e61700 1 Processor -- start 2022-02-02T14:04:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb961e61700 1 -- start start 2022-02-02T14:04:24.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb961e61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb961e61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb961e61700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c1078f0 con 0x7fb95c0f6700 2022-02-02T14:04:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb961e61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c108100 con 0x7fb95c0f5460 2022-02-02T14:04:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59436/0 (socket says 172.21.15.33:59436) 2022-02-02T14:04:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 -- 172.21.15.33:0/3536524775 learned_addr learned my addr 172.21.15.33:0/3536524775 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95b7fe700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 -- 172.21.15.33:0/3536524775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 msgr2=0x7fb95c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95affd700 1 -- 172.21.15.33:0/3536524775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c005040 con 0x7fb95c0f6700 2022-02-02T14:04:24.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.726+0000 7fb95b7fe700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:04:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb95affd700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb94c009990 tx=0x7fb94c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb94c018070 con 0x7fb95c0f6700 2022-02-02T14:04:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb94c007ba0 con 0x7fb95c0f6700 2022-02-02T14:04:24.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c108320 con 0x7fb95c0f6700 2022-02-02T14:04:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb94c01c3c0 con 0x7fb95c0f6700 2022-02-02T14:04:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.727+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c108880 con 0x7fb95c0f6700 2022-02-02T14:04:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.728+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c059100 con 0x7fb95c0f6700 2022-02-02T14:04:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.728+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb94c01d420 con 0x7fb95c0f6700 2022-02-02T14:04:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.729+0000 7fb943fff700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 0x7fb9440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.729+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb94c0836d0 con 0x7fb95c0f6700 2022-02-02T14:04:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.729+0000 7fb95b7fe700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 0x7fb9440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.729+0000 7fb95b7fe700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 0x7fb9440672e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb95c106b70 tx=0x7fb950009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:24.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.734+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb94c051720 con 0x7fb95c0f6700 2022-02-02T14:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.980+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb95c10d340 con 0x7fb95c0f6700 2022-02-02T14:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.981+0000 7fb943fff700 1 -- 172.21.15.33:0/3536524775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb94c054d40 con 0x7fb95c0f6700 2022-02-02T14:04:24.982 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:04:24.982 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:04:24.982 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:04:24.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:24.983 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:04:24.983 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:04:24.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:24.983 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:04:24.984 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:04:24.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:24.984 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:04:24.984 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:04:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:04:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:04:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:04:24.985 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:04:24.986 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:04:24.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.982+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 msgr2=0x7fb9440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 0x7fb9440672e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fb95c106b70 tx=0x7fb950009c00).stop 2022-02-02T14:04:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 msgr2=0x7fb95c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb94c009990 tx=0x7fb94c009b30).stop 2022-02-02T14:04:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 shutdown_connections 2022-02-02T14:04:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb944064e20 0x7fb9440672e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb95c0f5460 0x7fb95c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 --2- 172.21.15.33:0/3536524775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb95c0f6700 0x7fb95c1072f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 >> 172.21.15.33:0/3536524775 conn(0x7fb95c0f0bc0 msgr2=0x7fb95c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 shutdown_connections 2022-02-02T14:04:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:24.983+0000 7fb961e61700 1 -- 172.21.15.33:0/3536524775 wait complete. 2022-02-02T14:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.083+0000 7f0e62d44700 1 -- 172.21.15.33:0/3930676460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f55c0 msgr2=0x7f0e5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.083+0000 7f0e62d44700 1 --2- 172.21.15.33:0/3930676460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c0f59e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f0e50004660 tx=0x7f0e50009b30).stop 2022-02-02T14:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 -- 172.21.15.33:0/3930676460 shutdown_connections 2022-02-02T14:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 --2- 172.21.15.33:0/3930676460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 --2- 172.21.15.33:0/3930676460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c0f59e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 -- 172.21.15.33:0/3930676460 >> 172.21.15.33:0/3930676460 conn(0x7f0e5c0f0d40 msgr2=0x7f0e5c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 -- 172.21.15.33:0/3930676460 shutdown_connections 2022-02-02T14:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 -- 172.21.15.33:0/3930676460 wait complete. 2022-02-02T14:04:25.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 Processor -- start 2022-02-02T14:04:25.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.084+0000 7f0e62d44700 1 -- start start 2022-02-02T14:04:25.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e62d44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:25.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e62d44700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:25.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e62d44700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0603e0 con 0x7f0e5c0f6860 2022-02-02T14:04:25.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e62d44700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c060520 con 0x7f0e5c0f55c0 2022-02-02T14:04:25.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:25.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59446/0 (socket says 172.21.15.33:59446) 2022-02-02T14:04:25.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 -- 172.21.15.33:0/337032884 learned_addr learned my addr 172.21.15.33:0/337032884 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:25.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e60ae0700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:25.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 -- 172.21.15.33:0/337032884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f55c0 msgr2=0x7f0e5c109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:25.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 -- 172.21.15.33:0/337032884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50005040 con 0x7f0e5c0f6860 2022-02-02T14:04:25.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e5bfff700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f0e48002700 tx=0x7f0e48009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e48009320 con 0x7f0e5c0f6860 2022-02-02T14:04:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e4800f040 con 0x7f0e5c0f6860 2022-02-02T14:04:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c10c6a0 con 0x7f0e5c0f6860 2022-02-02T14:04:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.085+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e48014870 con 0x7f0e5c0f6860 2022-02-02T14:04:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.086+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c10cc60 con 0x7f0e5c0f6860 2022-02-02T14:04:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.086+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c045ad0 con 0x7f0e5c0f6860 2022-02-02T14:04:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.087+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e48009480 con 0x7f0e5c0f6860 2022-02-02T14:04:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.087+0000 7f0e597fa700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 0x7f0e4c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.087+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e48081d50 con 0x7f0e5c0f6860 2022-02-02T14:04:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.087+0000 7f0e60ae0700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 0x7f0e4c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.088+0000 7f0e60ae0700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 0x7f0e4c067290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0e50013690 tx=0x7f0e50009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:25.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.092+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e4804fe00 con 0x7f0e5c0f6860 2022-02-02T14:04:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:25 smithi033 ceph-mon[101165]: pgmap v757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:25.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3536524775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:04:25.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:25 smithi037 ceph-mon[69017]: pgmap v757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:25.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3536524775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:04:25.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.306+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0e5c027a00 con 0x7f0e5c0f6860 2022-02-02T14:04:25.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.307+0000 7f0e597fa700 1 -- 172.21.15.33:0/337032884 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0e48053420 con 0x7f0e5c0f6860 2022-02-02T14:04:25.308 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:04:25.308 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:04:25.308 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:04:25.309 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:04:25.309 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:25.309 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:04:25.309 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:04:25.310 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:04:25.310 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:04:25.310 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:04:25.311 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:04:25.311 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:04:25.311 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:04:25.311 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:04:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:04:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:04:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:04:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:04:25.312 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:04:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:04:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:04:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:04:25.313 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:04:25.314 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:04:25.314 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:04:25.314 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:04:25.314 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:04:25.316 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:04:25.316 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:04:25.317 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:04:25.317 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:04:25.318 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:25.318 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:25.318 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:04:25.319 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:25.320 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:25.320 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:25.321 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:25.321 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:25.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 msgr2=0x7f0e4c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:25.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 0x7f0e4c067290 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f0e50013690 tx=0x7f0e50009b30).stop 2022-02-02T14:04:25.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 msgr2=0x7f0e5c10c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:25.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f0e48002700 tx=0x7f0e48009e00).stop 2022-02-02T14:04:25.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 shutdown_connections 2022-02-02T14:04:25.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e4c064dd0 0x7f0e4c067290 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e5c0f55c0 0x7f0e5c109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 --2- 172.21.15.33:0/337032884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e5c0f6860 0x7f0e5c10c0f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:25.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 >> 172.21.15.33:0/337032884 conn(0x7f0e5c0f0d40 msgr2=0x7f0e5c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:25.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 shutdown_connections 2022-02-02T14:04:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:25.309+0000 7f0e62d44700 1 -- 172.21.15.33:0/337032884 wait complete. 2022-02-02T14:04:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:04:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/337032884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:04:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:04:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:04:26.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:04:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/337032884' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:04:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:04:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:04:26.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:04:27.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:27 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:04:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:27 smithi033 ceph-mon[101165]: pgmap v758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:27.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:04:27.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:04:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:27 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:04:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:27 smithi037 ceph-mon[69017]: pgmap v758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:04:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:04:28.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:28 smithi037 ceph-mon[69017]: pgmap v759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:28 smithi037 ceph-mon[69017]: pgmap v760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:28 smithi033 ceph-mon[101165]: pgmap v759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:28 smithi033 ceph-mon[101165]: pgmap v760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:30 smithi037 ceph-mon[69017]: pgmap v761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:30 smithi033 ceph-mon[101165]: pgmap v761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:32 smithi033 ceph-mon[101165]: pgmap v762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:32 smithi037 ceph-mon[69017]: pgmap v762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:34 smithi033 ceph-mon[101165]: pgmap v763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:34 smithi037 ceph-mon[69017]: pgmap v763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:36.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:36 smithi033 ceph-mon[101165]: pgmap v764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:36 smithi037 ceph-mon[69017]: pgmap v764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:38 smithi033 ceph-mon[101165]: pgmap v765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:38 smithi037 ceph-mon[69017]: pgmap v765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:40 smithi033 ceph-mon[101165]: pgmap v766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:40 smithi037 ceph-mon[69017]: pgmap v766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:42 smithi033 ceph-mon[101165]: pgmap v767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:42 smithi037 ceph-mon[69017]: pgmap v767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:44 smithi033 ceph-mon[101165]: pgmap v768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:44 smithi037 ceph-mon[69017]: pgmap v768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:46 smithi033 ceph-mon[101165]: pgmap v769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:46 smithi037 ceph-mon[69017]: pgmap v769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:48 smithi033 ceph-mon[101165]: pgmap v770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:48 smithi037 ceph-mon[69017]: pgmap v770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:50 smithi033 ceph-mon[101165]: pgmap v771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:50 smithi037 ceph-mon[69017]: pgmap v771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:52 smithi033 ceph-mon[101165]: pgmap v772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:52 smithi037 ceph-mon[69017]: pgmap v772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:54 smithi033 ceph-mon[101165]: pgmap v773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:54 smithi037 ceph-mon[69017]: pgmap v773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:55.427 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:04:55.428 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:04:55.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- 172.21.15.33:0/4008903849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 msgr2=0x7fb4b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/4008903849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b00f59e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fb4a0004660 tx=0x7fb4a0009b30).stop 2022-02-02T14:04:55.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- 172.21.15.33:0/4008903849 shutdown_connections 2022-02-02T14:04:55.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/4008903849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 0x7fb4b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/4008903849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b00f59e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- 172.21.15.33:0/4008903849 >> 172.21.15.33:0/4008903849 conn(0x7fb4b00f0d40 msgr2=0x7fb4b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:55.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- 172.21.15.33:0/4008903849 shutdown_connections 2022-02-02T14:04:55.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- 172.21.15.33:0/4008903849 wait complete. 2022-02-02T14:04:55.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 Processor -- start 2022-02-02T14:04:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.427+0000 7fb4b48fc700 1 -- start start 2022-02-02T14:04:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4b48fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4b48fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 0x7fb4b010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4b48fc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00602b0 con 0x7fb4b00f55c0 2022-02-02T14:04:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4b48fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b00603f0 con 0x7fb4b00f6860 2022-02-02T14:04:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59458/0 (socket says 172.21.15.33:59458) 2022-02-02T14:04:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 -- 172.21.15.33:0/2444854301 learned_addr learned my addr 172.21.15.33:0/2444854301 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4add9b700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 0x7fb4b010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 -- 172.21.15.33:0/2444854301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 msgr2=0x7fb4b010e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 0x7fb4b010e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 -- 172.21.15.33:0/2444854301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a0005040 con 0x7fb4b00f55c0 2022-02-02T14:04:55.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4ae59c700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fb4a0013a70 tx=0x7fb4a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:55.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a0018070 con 0x7fb4b00f55c0 2022-02-02T14:04:55.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb4a00097d0 con 0x7fb4b00f55c0 2022-02-02T14:04:55.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b010ea80 con 0x7fb4b00f55c0 2022-02-02T14:04:55.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.428+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4a001de80 con 0x7fb4b00f55c0 2022-02-02T14:04:55.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.429+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b010ee50 con 0x7fb4b00f55c0 2022-02-02T14:04:55.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.429+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b0045ad0 con 0x7fb4b00f55c0 2022-02-02T14:04:55.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.430+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb4a0007ba0 con 0x7fb4b00f55c0 2022-02-02T14:04:55.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.430+0000 7fb49effd700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 0x7fb498067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.430+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb4a0083690 con 0x7fb4b00f55c0 2022-02-02T14:04:55.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.431+0000 7fb4add9b700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 0x7fb498067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.431+0000 7fb4add9b700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 0x7fb498067290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb4a4004c40 tx=0x7fb4a400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:55.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.435+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb4a0051740 con 0x7fb4b00f55c0 2022-02-02T14:04:55.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:04:55.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:04:55.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.627+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4b0057f10 con 0x7fb498064dd0 2022-02-02T14:04:55.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.628+0000 7fb49effd700 1 -- 172.21.15.33:0/2444854301 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb4b0057f10 con 0x7fb498064dd0 2022-02-02T14:04:55.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 msgr2=0x7fb498067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 0x7fb498067290 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb4a4004c40 tx=0x7fb4a400b040).stop 2022-02-02T14:04:55.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 msgr2=0x7fb4b010c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fb4a0013a70 tx=0x7fb4a0009b30).stop 2022-02-02T14:04:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 shutdown_connections 2022-02-02T14:04:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb498064dd0 0x7fb498067290 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4b00f55c0 0x7fb4b010c090 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 --2- 172.21.15.33:0/2444854301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b00f6860 0x7fb4b010e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 >> 172.21.15.33:0/2444854301 conn(0x7fb4b00f0d40 msgr2=0x7fb4b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 shutdown_connections 2022-02-02T14:04:55.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.630+0000 7fb4b48fc700 1 -- 172.21.15.33:0/2444854301 wait complete. 2022-02-02T14:04:55.639 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:04:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 -- 172.21.15.33:0/1802121167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f55c0 msgr2=0x7f3f4c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1802121167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c0f59e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f3f3c004660 tx=0x7f3f3c009b30).stop 2022-02-02T14:04:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 -- 172.21.15.33:0/1802121167 shutdown_connections 2022-02-02T14:04:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1802121167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1802121167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c0f59e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 -- 172.21.15.33:0/1802121167 >> 172.21.15.33:0/1802121167 conn(0x7f3f4c0f0d40 msgr2=0x7f3f4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 -- 172.21.15.33:0/1802121167 shutdown_connections 2022-02-02T14:04:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 -- 172.21.15.33:0/1802121167 wait complete. 2022-02-02T14:04:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.731+0000 7f3f51e22700 1 Processor -- start 2022-02-02T14:04:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f51e22700 1 -- start start 2022-02-02T14:04:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f51e22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f51e22700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f51e22700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c107a10 con 0x7f3f4c0f6860 2022-02-02T14:04:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f51e22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c107b50 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59470/0 (socket says 172.21.15.33:59470) 2022-02-02T14:04:55.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f4affd700 1 -- 172.21.15.33:0/1359520140 learned_addr learned my addr 172.21.15.33:0/1359520140 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:55.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.732+0000 7f3f4b7fe700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f4b7fe700 1 -- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 msgr2=0x7f3f4c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f4b7fe700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f4b7fe700 1 -- 172.21.15.33:0/1359520140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c005040 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f4affd700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:04:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f4b7fe700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c106f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3f3c000c00 tx=0x7f3f3c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c018070 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f3c0097d0 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f4c108490 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f3c01ddb0 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.733+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c1089f0 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.735+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c045ad0 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.735+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f3c007ca0 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.735+0000 7f3f33fff700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:55.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.735+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f3c083730 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.735+0000 7f3f4affd700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:55.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.736+0000 7f3f4affd700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 0x7f3f34067290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f3f400041d0 tx=0x7f3f4000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:55.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.740+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f3c055150 con 0x7f3f4c0f55c0 2022-02-02T14:04:55.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.922+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f4c0fdf40 con 0x7f3f34064dd0 2022-02-02T14:04:55.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.937+0000 7f3f33fff700 1 -- 172.21.15.33:0/1359520140 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3f4c0fdf40 con 0x7f3f34064dd0 2022-02-02T14:04:55.937 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:04:55.937 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (30m) 2m ago 31m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:04:55.938 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (23m) 2m ago 31m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:04:55.938 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (23m) 2m ago 30m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:04:55.938 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (30m) 2m ago 30m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:04:55.938 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (23m) 2m ago 27m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:04:55.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (24m) 2m ago 27m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:04:55.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (25m) 2m ago 27m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:04:55.939 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (27m) 2m ago 27m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:04:55.939 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (24m) 2m ago 32m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:04:55.940 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (24m) 2m ago 30m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:04:55.940 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (24m) 2m ago 32m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:04:55.940 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (23m) 2m ago 30m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:04:55.941 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (30m) 2m ago 30m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:04:55.949 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (30m) 2m ago 30m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:04:55.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 2m ago 29m - 4096M 2022-02-02T14:04:55.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (29m) 2m ago 29m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:04:55.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (29m) 2m ago 29m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:04:55.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (29m) 2m ago 29m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:04:55.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (28m) 2m ago 28m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:04:55.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (28m) 2m ago 28m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:04:55.951 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (30m) 2m ago 30m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:04:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 msgr2=0x7f3f34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 0x7f3f34067290 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f3f400041d0 tx=0x7f3f4000b040).stop 2022-02-02T14:04:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 msgr2=0x7f3f4c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c106f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3f3c000c00 tx=0x7f3f3c009b30).stop 2022-02-02T14:04:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 shutdown_connections 2022-02-02T14:04:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f34064dd0 0x7f3f34067290 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f4c0f55c0 0x7f3f4c106f70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 --2- 172.21.15.33:0/1359520140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f4c0f6860 0x7f3f4c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 >> 172.21.15.33:0/1359520140 conn(0x7f3f4c0f0d40 msgr2=0x7f3f4c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 shutdown_connections 2022-02-02T14:04:55.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:55.939+0000 7f3f51e22700 1 -- 172.21.15.33:0/1359520140 wait complete. 2022-02-02T14:04:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- 172.21.15.33:0/913128670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 msgr2=0x7ff7b40f5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 --2- 172.21.15.33:0/913128670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b40f5860 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7ff7a4004660 tx=0x7ff7a4009b30).stop 2022-02-02T14:04:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- 172.21.15.33:0/913128670 shutdown_connections 2022-02-02T14:04:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 --2- 172.21.15.33:0/913128670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 0x7ff7b40f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 --2- 172.21.15.33:0/913128670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b40f5860 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- 172.21.15.33:0/913128670 >> 172.21.15.33:0/913128670 conn(0x7ff7b40f0ba0 msgr2=0x7ff7b40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- 172.21.15.33:0/913128670 shutdown_connections 2022-02-02T14:04:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- 172.21.15.33:0/913128670 wait complete. 2022-02-02T14:04:56.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 Processor -- start 2022-02-02T14:04:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.040+0000 7ff7b359e700 1 -- start start 2022-02-02T14:04:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 0x7ff7b410e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40602b0 con 0x7ff7b40f5440 2022-02-02T14:04:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40603f0 con 0x7ff7b40f66e0 2022-02-02T14:04:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59478/0 (socket says 172.21.15.33:59478) 2022-02-02T14:04:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 -- 172.21.15.33:0/215659495 learned_addr learned my addr 172.21.15.33:0/215659495 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b1d9b700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 0x7ff7b410e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 -- 172.21.15.33:0/215659495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 msgr2=0x7ff7b410e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 0x7ff7b410e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 -- 172.21.15.33:0/215659495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a4005040 con 0x7ff7b40f5440 2022-02-02T14:04:56.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b259c700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7ff7a4014040 tx=0x7ff7a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a4019070 con 0x7ff7b40f5440 2022-02-02T14:04:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff7a4007e70 con 0x7ff7b40f5440 2022-02-02T14:04:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b410e840 con 0x7ff7b40f5440 2022-02-02T14:04:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b410ec10 con 0x7ff7b40f5440 2022-02-02T14:04:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.041+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a4014d10 con 0x7ff7b40f5440 2022-02-02T14:04:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.042+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff798004fa0 con 0x7ff7b40f5440 2022-02-02T14:04:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.043+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff7a4025070 con 0x7ff7b40f5440 2022-02-02T14:04:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.043+0000 7ff7a2ffd700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 0x7ff79c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.043+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff7a4082940 con 0x7ff7b40f5440 2022-02-02T14:04:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.043+0000 7ff7b1d9b700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 0x7ff79c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.044+0000 7ff7b1d9b700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 0x7ff79c0672e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff7a8009fd0 tx=0x7ff7a800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.048+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff7a4050ab0 con 0x7ff7b40f5440 2022-02-02T14:04:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.294+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff798005e80 con 0x7ff7b40f5440 2022-02-02T14:04:56.294 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:56 smithi033 ceph-mon[101165]: pgmap v774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:56.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.294+0000 7ff7a2ffd700 1 -- 172.21.15.33:0/215659495 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff7a4023070 con 0x7ff7b40f5440 2022-02-02T14:04:56.296 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:04:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:04:56.296 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:04:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:04:56.297 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:04:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:56.298 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:04:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:04:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:56.299 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:04:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:04:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:04:56.300 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:04:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:04:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:04:56.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:04:56.301 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:04:56.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 msgr2=0x7ff79c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 0x7ff79c0672e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7ff7a8009fd0 tx=0x7ff7a800b040).stop 2022-02-02T14:04:56.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 msgr2=0x7ff7b410be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7ff7a4014040 tx=0x7ff7a400b040).stop 2022-02-02T14:04:56.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 shutdown_connections 2022-02-02T14:04:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff79c064e20 0x7ff79c0672e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7b40f5440 0x7ff7b410be50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 --2- 172.21.15.33:0/215659495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7b40f66e0 0x7ff7b410e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 >> 172.21.15.33:0/215659495 conn(0x7ff7b40f0ba0 msgr2=0x7ff7b40fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:56.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 shutdown_connections 2022-02-02T14:04:56.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.296+0000 7ff7b359e700 1 -- 172.21.15.33:0/215659495 wait complete. 2022-02-02T14:04:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 -- 172.21.15.33:0/2962517576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 msgr2=0x7fa10c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 --2- 172.21.15.33:0/2962517576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c0f6cc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa100004660 tx=0x7fa100009b30).stop 2022-02-02T14:04:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 -- 172.21.15.33:0/2962517576 shutdown_connections 2022-02-02T14:04:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 --2- 172.21.15.33:0/2962517576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c0f6cc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 --2- 172.21.15.33:0/2962517576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 0x7fa10c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 -- 172.21.15.33:0/2962517576 >> 172.21.15.33:0/2962517576 conn(0x7fa10c0f0d40 msgr2=0x7fa10c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 -- 172.21.15.33:0/2962517576 shutdown_connections 2022-02-02T14:04:56.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.397+0000 7fa112bef700 1 -- 172.21.15.33:0/2962517576 wait complete. 2022-02-02T14:04:56.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 Processor -- start 2022-02-02T14:04:56.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 -- start start 2022-02-02T14:04:56.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 0x7fa10c109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c0603e0 con 0x7fa10c0f6860 2022-02-02T14:04:56.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa112bef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa10c060520 con 0x7fa10c0f55c0 2022-02-02T14:04:56.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa10bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa10bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59490/0 (socket says 172.21.15.33:59490) 2022-02-02T14:04:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa10bfff700 1 -- 172.21.15.33:0/2550886323 learned_addr learned my addr 172.21.15.33:0/2550886323 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:04:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.398+0000 7fa11098b700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 0x7fa10c109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa10bfff700 1 -- 172.21.15.33:0/2550886323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 msgr2=0x7fa10c109bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa10bfff700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 0x7fa10c109bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa10bfff700 1 -- 172.21.15.33:0/2550886323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa100005040 con 0x7fa10c0f6860 2022-02-02T14:04:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa10bfff700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa100000c00 tx=0x7fa10000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100019070 con 0x7fa10c0f6860 2022-02-02T14:04:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10c10c610 con 0x7fa10c0f6860 2022-02-02T14:04:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa100007e70 con 0x7fa10c0f6860 2022-02-02T14:04:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa100014ce0 con 0x7fa10c0f6860 2022-02-02T14:04:56.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.399+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10c10cb70 con 0x7fa10c0f6860 2022-02-02T14:04:56.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.400+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10c045ad0 con 0x7fa10c0f6860 2022-02-02T14:04:56.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.401+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa100025070 con 0x7fa10c0f6860 2022-02-02T14:04:56.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.401+0000 7fa1097fa700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 0x7fa0f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:04:56.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.401+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa100082a10 con 0x7fa10c0f6860 2022-02-02T14:04:56.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.401+0000 7fa11098b700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 0x7fa0f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:04:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.402+0000 7fa11098b700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 0x7fa0f4067290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa10c060060 tx=0x7fa0fc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:04:56.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.405+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa100050ac0 con 0x7fa10c0f6860 2022-02-02T14:04:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:56 smithi037 ceph-mon[69017]: pgmap v774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:56.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.615+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa10c027a00 con 0x7fa10c0f6860 2022-02-02T14:04:56.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.616+0000 7fa1097fa700 1 -- 172.21.15.33:0/2550886323 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa100023020 con 0x7fa10c0f6860 2022-02-02T14:04:56.617 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:04:56.617 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:04:56.618 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:04:56.618 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:04:56.619 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:56.619 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:04:56.620 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:04:56.620 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:04:56.621 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:04:56.621 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:04:56.621 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:04:56.622 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:04:56.622 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:04:56.623 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:04:56.624 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:04:56.624 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:04:56.625 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:04:56.625 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:04:56.626 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:04:56.626 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:04:56.626 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:04:56.627 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:04:56.627 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:04:56.627 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:04:56.628 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:04:56.628 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:04:56.628 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:04:56.629 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:04:56.629 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:04:56.629 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:04:56.630 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:04:56.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:56.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:56.631 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:04:56.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:04:56.631 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:56.631 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:56.632 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:56.632 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:04:56.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 msgr2=0x7fa0f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 0x7fa0f4067290 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fa10c060060 tx=0x7fa0fc00b040).stop 2022-02-02T14:04:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 msgr2=0x7fa10c10c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:04:56.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fa100000c00 tx=0x7fa10000b040).stop 2022-02-02T14:04:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 shutdown_connections 2022-02-02T14:04:56.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0f4064dd0 0x7fa0f4067290 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa10c0f55c0 0x7fa10c109bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 --2- 172.21.15.33:0/2550886323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa10c0f6860 0x7fa10c10c0c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:04:56.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 >> 172.21.15.33:0/2550886323 conn(0x7fa10c0f0d40 msgr2=0x7fa10c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:04:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 shutdown_connections 2022-02-02T14:04:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:04:56.618+0000 7fa112bef700 1 -- 172.21.15.33:0/2550886323 wait complete. 2022-02-02T14:04:56.639 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:04:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:57 smithi037 ceph-mon[69017]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:57 smithi037 ceph-mon[69017]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:57.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/215659495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:04:57.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2550886323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:04:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:57 smithi033 ceph-mon[101165]: from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:57 smithi033 ceph-mon[101165]: from='client.44709 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:04:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/215659495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:04:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2550886323' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:04:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:04:58 smithi033 ceph-mon[101165]: pgmap v775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:04:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:04:58 smithi037 ceph-mon[69017]: pgmap v775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:00 smithi033 ceph-mon[101165]: pgmap v776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:00 smithi037 ceph-mon[69017]: pgmap v776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:02 smithi033 ceph-mon[101165]: pgmap v777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:02 smithi037 ceph-mon[69017]: pgmap v777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:04 smithi033 ceph-mon[101165]: pgmap v778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:04 smithi037 ceph-mon[69017]: pgmap v778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:05 smithi033 ceph-mon[101165]: pgmap v779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:05.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:05 smithi037 ceph-mon[69017]: pgmap v779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:07 smithi033 ceph-mon[101165]: pgmap v780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:08.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:07 smithi037 ceph-mon[69017]: pgmap v780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:10.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:09 smithi033 ceph-mon[101165]: pgmap v781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:10.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:09 smithi037 ceph-mon[69017]: pgmap v781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:11 smithi033 ceph-mon[101165]: pgmap v782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:12.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:11 smithi037 ceph-mon[69017]: pgmap v782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:13 smithi033 ceph-mon[101165]: pgmap v783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:14.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:13 smithi037 ceph-mon[69017]: pgmap v783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:15 smithi033 ceph-mon[101165]: pgmap v784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:16.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:15 smithi037 ceph-mon[69017]: pgmap v784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:17 smithi033 ceph-mon[101165]: pgmap v785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:18.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:17 smithi037 ceph-mon[69017]: pgmap v785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:19 smithi033 ceph-mon[101165]: pgmap v786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:20.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:19 smithi037 ceph-mon[69017]: pgmap v786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:21 smithi033 ceph-mon[101165]: pgmap v787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:22.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:21 smithi037 ceph-mon[69017]: pgmap v787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:23 smithi033 ceph-mon[101165]: pgmap v788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:24.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:23 smithi037 ceph-mon[69017]: pgmap v788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:25 smithi033 ceph-mon[101165]: pgmap v789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:25 smithi037 ceph-mon[69017]: pgmap v789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:26.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 -- 172.21.15.33:0/3983928063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f55c0 msgr2=0x7f9b840f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:26.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 --2- 172.21.15.33:0/3983928063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f55c0 0x7f9b840f59e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f9b74004660 tx=0x7f9b74009b30).stop 2022-02-02T14:05:26.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 -- 172.21.15.33:0/3983928063 shutdown_connections 2022-02-02T14:05:26.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 --2- 172.21.15.33:0/3983928063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f6860 0x7f9b840f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 --2- 172.21.15.33:0/3983928063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f55c0 0x7f9b840f59e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.733+0000 7f9b88825700 1 -- 172.21.15.33:0/3983928063 >> 172.21.15.33:0/3983928063 conn(0x7f9b840f0d40 msgr2=0x7f9b840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:26.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.734+0000 7f9b88825700 1 -- 172.21.15.33:0/3983928063 shutdown_connections 2022-02-02T14:05:26.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.734+0000 7f9b88825700 1 -- 172.21.15.33:0/3983928063 wait complete. 2022-02-02T14:05:26.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.734+0000 7f9b88825700 1 Processor -- start 2022-02-02T14:05:26.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.734+0000 7f9b88825700 1 -- start start 2022-02-02T14:05:26.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f55c0 0x7f9b84109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:26.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:26.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840603c0 con 0x7f9b840f6860 2022-02-02T14:05:26.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b84060500 con 0x7f9b840f55c0 2022-02-02T14:05:26.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:26.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59500/0 (socket says 172.21.15.33:59500) 2022-02-02T14:05:26.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 -- 172.21.15.33:0/1288720095 learned_addr learned my addr 172.21.15.33:0/1288720095 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:26.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b8259c700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f55c0 0x7f9b84109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:26.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 -- 172.21.15.33:0/1288720095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f55c0 msgr2=0x7f9b84109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:26.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f55c0 0x7f9b84109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 -- 172.21.15.33:0/1288720095 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74005040 con 0x7f9b840f6860 2022-02-02T14:05:26.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b81d9b700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9b780026d0 tx=0x7f9b78009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:26.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b780079c0 con 0x7f9b840f6860 2022-02-02T14:05:26.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9b7800f040 con 0x7f9b840f6860 2022-02-02T14:05:26.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8410c740 con 0x7f9b840f6860 2022-02-02T14:05:26.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b780148b0 con 0x7f9b840f6860 2022-02-02T14:05:26.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.735+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8410ccd0 con 0x7f9b840f6860 2022-02-02T14:05:26.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.737+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b840f49b0 con 0x7f9b840f6860 2022-02-02T14:05:26.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.737+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9b78007b20 con 0x7f9b840f6860 2022-02-02T14:05:26.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.737+0000 7f9b72ffd700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 0x7f9b6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:26.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.738+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9b780818f0 con 0x7f9b840f6860 2022-02-02T14:05:26.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.738+0000 7f9b8259c700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 0x7f9b6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:26.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.738+0000 7f9b8259c700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 0x7f9b6c067290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9b74013690 tx=0x7f9b74009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:26.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.742+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9b7804f9a0 con 0x7f9b840f6860 2022-02-02T14:05:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.945+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b840fdf00 con 0x7f9b6c064dd0 2022-02-02T14:05:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.946+0000 7f9b72ffd700 1 -- 172.21.15.33:0/1288720095 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9b840fdf00 con 0x7f9b6c064dd0 2022-02-02T14:05:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.948+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 msgr2=0x7f9b6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.948+0000 7f9b88825700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 0x7f9b6c067290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f9b74013690 tx=0x7f9b74009b30).stop 2022-02-02T14:05:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.948+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 msgr2=0x7f9b8410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.948+0000 7f9b88825700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f9b780026d0 tx=0x7f9b78009de0).stop 2022-02-02T14:05:26.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 shutdown_connections 2022-02-02T14:05:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9b6c064dd0 0x7f9b6c067290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b840f55c0 0x7f9b84109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 --2- 172.21.15.33:0/1288720095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b840f6860 0x7f9b8410c190 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:26.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 >> 172.21.15.33:0/1288720095 conn(0x7f9b840f0d40 msgr2=0x7f9b840fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 shutdown_connections 2022-02-02T14:05:26.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:26.949+0000 7f9b88825700 1 -- 172.21.15.33:0/1288720095 wait complete. 2022-02-02T14:05:26.959 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:05:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:05:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:05:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:26 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:05:27.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 -- 172.21.15.33:0/66151421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 msgr2=0x7f878c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 --2- 172.21.15.33:0/66151421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c0f6b30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f877c004660 tx=0x7f877c009b30).stop 2022-02-02T14:05:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 -- 172.21.15.33:0/66151421 shutdown_connections 2022-02-02T14:05:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 --2- 172.21.15.33:0/66151421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c0f6b30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 --2- 172.21.15.33:0/66151421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 -- 172.21.15.33:0/66151421 >> 172.21.15.33:0/66151421 conn(0x7f878c0f0b90 msgr2=0x7f878c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 -- 172.21.15.33:0/66151421 shutdown_connections 2022-02-02T14:05:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.055+0000 7f87919b3700 1 -- 172.21.15.33:0/66151421 wait complete. 2022-02-02T14:05:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 Processor -- start 2022-02-02T14:05:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 -- start start 2022-02-02T14:05:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c1060c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c106670 con 0x7f878c0f66d0 2022-02-02T14:05:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87919b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c1067b0 con 0x7f878c0f5430 2022-02-02T14:05:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f878bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c1060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f878bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c1060c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59510/0 (socket says 172.21.15.33:59510) 2022-02-02T14:05:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f878bfff700 1 -- 172.21.15.33:0/1613887404 learned_addr learned my addr 172.21.15.33:0/1613887404 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.056+0000 7f87909b1700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87909b1700 1 -- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 msgr2=0x7f878c1060c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87909b1700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c1060c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87909b1700 1 -- 172.21.15.33:0/1613887404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c005040 con 0x7f878c0f5430 2022-02-02T14:05:27.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87909b1700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c105bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f878c0f6530 tx=0x7f877400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87740092b0 con 0x7f878c0f5430 2022-02-02T14:05:27.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f877400ec70 con 0x7f878c0f5430 2022-02-02T14:05:27.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c107150 con 0x7f878c0f5430 2022-02-02T14:05:27.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c107710 con 0x7f878c0f5430 2022-02-02T14:05:27.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.057+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8774007c50 con 0x7f878c0f5430 2022-02-02T14:05:27.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.059+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8770004fa0 con 0x7f878c0f5430 2022-02-02T14:05:27.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.059+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8774022070 con 0x7f878c0f5430 2022-02-02T14:05:27.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.059+0000 7f87897fa700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 0x7f87780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.059+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8774084100 con 0x7f878c0f5430 2022-02-02T14:05:27.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.059+0000 7f878bfff700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 0x7f87780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.060+0000 7f878bfff700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 0x7f87780672e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f877c009d60 tx=0x7f877c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.064+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8774055b80 con 0x7f878c0f5430 2022-02-02T14:05:27.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:05:27.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:05:27.221 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:26 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:05:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.250+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8770000bc0 con 0x7f8778064e20 2022-02-02T14:05:27.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.265+0000 7f87897fa700 1 -- 172.21.15.33:0/1613887404 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8770000bc0 con 0x7f8778064e20 2022-02-02T14:05:27.266 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:05:27.266 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (30m) 3m ago 31m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:05:27.267 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (23m) 3m ago 31m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:05:27.267 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (23m) 3m ago 31m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:05:27.267 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (30m) 3m ago 31m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:05:27.267 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (24m) 3m ago 27m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:05:27.268 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (24m) 3m ago 27m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:05:27.268 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (25m) 3m ago 27m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:05:27.268 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (27m) 3m ago 27m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:05:27.268 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (25m) 3m ago 33m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:05:27.268 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (24m) 3m ago 31m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:05:27.269 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (24m) 3m ago 33m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:05:27.269 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (24m) 3m ago 31m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:05:27.269 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (31m) 3m ago 31m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:05:27.269 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (30m) 3m ago 30m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:05:27.270 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 30m - 4096M 2022-02-02T14:05:27.270 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (30m) 3m ago 30m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:05:27.270 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (29m) 3m ago 29m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:05:27.270 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (29m) 3m ago 29m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:05:27.271 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (29m) 3m ago 29m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:05:27.271 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (29m) 3m ago 29m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:05:27.271 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (30m) 3m ago 31m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:05:27.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 msgr2=0x7f87780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 0x7f87780672e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f877c009d60 tx=0x7f877c016040).stop 2022-02-02T14:05:27.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 msgr2=0x7f878c105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c105bd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f878c0f6530 tx=0x7f877400b040).stop 2022-02-02T14:05:27.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 shutdown_connections 2022-02-02T14:05:27.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8778064e20 0x7f87780672e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878c0f5430 0x7f878c105bd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 --2- 172.21.15.33:0/1613887404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f878c0f66d0 0x7f878c1060c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 >> 172.21.15.33:0/1613887404 conn(0x7f878c0f0b90 msgr2=0x7f878c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 shutdown_connections 2022-02-02T14:05:27.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.267+0000 7f87919b3700 1 -- 172.21.15.33:0/1613887404 wait complete. 2022-02-02T14:05:27.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 -- 172.21.15.33:0/499296476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f7980 msgr2=0x7f63fc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 --2- 172.21.15.33:0/499296476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f7980 0x7f63fc0f7de0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f63e4004660 tx=0x7f63e4009b30).stop 2022-02-02T14:05:27.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 -- 172.21.15.33:0/499296476 shutdown_connections 2022-02-02T14:05:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 --2- 172.21.15.33:0/499296476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f7980 0x7f63fc0f7de0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 --2- 172.21.15.33:0/499296476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f66e0 0x7f63fc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 -- 172.21.15.33:0/499296476 >> 172.21.15.33:0/499296476 conn(0x7f63fc0f1e40 msgr2=0x7f63fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 -- 172.21.15.33:0/499296476 shutdown_connections 2022-02-02T14:05:27.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.369+0000 7f64018b1700 1 -- 172.21.15.33:0/499296476 wait complete. 2022-02-02T14:05:27.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 Processor -- start 2022-02-02T14:05:27.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 -- start start 2022-02-02T14:05:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 0x7f63fc106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc107980 con 0x7f63fc0f66e0 2022-02-02T14:05:27.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f64018b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc107ac0 con 0x7f63fc0f7980 2022-02-02T14:05:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f63faffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 0x7f63fc106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f63fa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f63fa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:42004/0 (socket says 172.21.15.33:42004) 2022-02-02T14:05:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f63fa7fc700 1 -- 172.21.15.33:0/231099384 learned_addr learned my addr 172.21.15.33:0/231099384 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:27.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.370+0000 7f63faffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 0x7f63fc106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59518/0 (socket says 172.21.15.33:59518) 2022-02-02T14:05:27.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63fa7fc700 1 -- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 msgr2=0x7f63fc106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63fa7fc700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 0x7f63fc106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63fa7fc700 1 -- 172.21.15.33:0/231099384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4005040 con 0x7f63fc0f7980 2022-02-02T14:05:27.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63fa7fc700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f63e4009990 tx=0x7f63e4009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63e4018070 con 0x7f63fc0f7980 2022-02-02T14:05:27.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f63e4007ba0 con 0x7f63fc0f7980 2022-02-02T14:05:27.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc108400 con 0x7f63fc0f7980 2022-02-02T14:05:27.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63e401c3c0 con 0x7f63fc0f7980 2022-02-02T14:05:27.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.371+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc108960 con 0x7f63fc0f7980 2022-02-02T14:05:27.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.372+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc045ad0 con 0x7f63fc0f7980 2022-02-02T14:05:27.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.372+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f63e401d420 con 0x7f63fc0f7980 2022-02-02T14:05:27.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.373+0000 7f63f37fe700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 0x7f63e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.373+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f63e4083700 con 0x7f63fc0f7980 2022-02-02T14:05:27.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.373+0000 7f63faffd700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 0x7f63e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.373+0000 7f63faffd700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 0x7f63e8067290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f63fc0f77e0 tx=0x7f63ec00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.377+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f63e4055160 con 0x7f63fc0f7980 2022-02-02T14:05:27.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.623+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f63fc027a00 con 0x7f63fc0f7980 2022-02-02T14:05:27.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.624+0000 7f63f37fe700 1 -- 172.21.15.33:0/231099384 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f63e4054d50 con 0x7f63fc0f7980 2022-02-02T14:05:27.625 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:05:27.625 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:05:27.625 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:05:27.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:27.626 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:05:27.626 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:05:27.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:27.626 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:05:27.627 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:05:27.627 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:27.627 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:05:27.627 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:05:27.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:27.628 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:05:27.628 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:05:27.628 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:05:27.628 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:05:27.629 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:05:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 msgr2=0x7f63e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 0x7f63e8067290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f63fc0f77e0 tx=0x7f63ec00b040).stop 2022-02-02T14:05:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 msgr2=0x7f63fc1073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f63e4009990 tx=0x7f63e4009b30).stop 2022-02-02T14:05:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 shutdown_connections 2022-02-02T14:05:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f63e8064dd0 0x7f63e8067290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63fc0f66e0 0x7f63fc106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 --2- 172.21.15.33:0/231099384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63fc0f7980 0x7f63fc1073d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 >> 172.21.15.33:0/231099384 conn(0x7f63fc0f1e40 msgr2=0x7f63fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 shutdown_connections 2022-02-02T14:05:27.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.626+0000 7f64018b1700 1 -- 172.21.15.33:0/231099384 wait complete. 2022-02-02T14:05:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.727+0000 7fd885fcd700 1 -- 172.21.15.33:0/2566575557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f6860 msgr2=0x7fd8800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.727+0000 7fd885fcd700 1 --2- 172.21.15.33:0/2566575557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f6860 0x7fd8800f6cc0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fd870004660 tx=0x7fd870009b30).stop 2022-02-02T14:05:27.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 -- 172.21.15.33:0/2566575557 shutdown_connections 2022-02-02T14:05:27.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 --2- 172.21.15.33:0/2566575557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f6860 0x7fd8800f6cc0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 --2- 172.21.15.33:0/2566575557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f55c0 0x7fd8800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 -- 172.21.15.33:0/2566575557 >> 172.21.15.33:0/2566575557 conn(0x7fd8800f0d40 msgr2=0x7fd8800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 -- 172.21.15.33:0/2566575557 shutdown_connections 2022-02-02T14:05:27.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 -- 172.21.15.33:0/2566575557 wait complete. 2022-02-02T14:05:27.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 Processor -- start 2022-02-02T14:05:27.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.728+0000 7fd885fcd700 1 -- start start 2022-02-02T14:05:27.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f6860 0x7fd88010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800602b0 con 0x7fd8800f55c0 2022-02-02T14:05:27.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8800603f0 con 0x7fd8800f6860 2022-02-02T14:05:27.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59528/0 (socket says 172.21.15.33:59528) 2022-02-02T14:05:27.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 -- 172.21.15.33:0/1326324565 learned_addr learned my addr 172.21.15.33:0/1326324565 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:27.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87effd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f6860 0x7fd88010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 -- 172.21.15.33:0/1326324565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f6860 msgr2=0x7fd88010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f6860 0x7fd88010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 -- 172.21.15.33:0/1326324565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870005040 con 0x7fd8800f55c0 2022-02-02T14:05:27.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd87f7fe700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fd868002700 tx=0x7fd868009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8680079c0 con 0x7fd8800f55c0 2022-02-02T14:05:27.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88010ea60 con 0x7fd8800f55c0 2022-02-02T14:05:27.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd86800f040 con 0x7fd8800f55c0 2022-02-02T14:05:27.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88010eee0 con 0x7fd8800f55c0 2022-02-02T14:05:27.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.729+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd868014860 con 0x7fd8800f55c0 2022-02-02T14:05:27.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.730+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864004fa0 con 0x7fd8800f55c0 2022-02-02T14:05:27.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.731+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd86801b060 con 0x7fd8800f55c0 2022-02-02T14:05:27.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.731+0000 7fd877fff700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 0x7fd86c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:27.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.732+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd868081a00 con 0x7fd8800f55c0 2022-02-02T14:05:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.732+0000 7fd87effd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 0x7fd86c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.732+0000 7fd87effd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 0x7fd86c067290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd870004630 tx=0x7fd870009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.735+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd86804fb70 con 0x7fd8800f55c0 2022-02-02T14:05:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.949+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd864005940 con 0x7fd8800f55c0 2022-02-02T14:05:27.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.949+0000 7fd877fff700 1 -- 172.21.15.33:0/1326324565 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd868019070 con 0x7fd8800f55c0 2022-02-02T14:05:27.950 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:05:27.951 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:05:27.951 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:05:27.951 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:05:27.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:27.952 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:05:27.952 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:05:27.952 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:05:27.952 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:05:27.953 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:05:27.953 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:05:27.953 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:05:27.953 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:05:27.953 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:05:27.954 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:05:27.954 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:05:27.955 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:05:27.955 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:05:27.955 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:05:27.955 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:05:27.955 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:05:27.956 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:05:27.956 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:05:27.956 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:05:27.956 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:05:27.957 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:05:27.957 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:05:27.957 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:05:27.957 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 msgr2=0x7fd86c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 0x7fd86c067290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fd870004630 tx=0x7fd870009b30).stop 2022-02-02T14:05:27.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 msgr2=0x7fd88010c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fd868002700 tx=0x7fd868009d80).stop 2022-02-02T14:05:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 shutdown_connections 2022-02-02T14:05:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd86c064dd0 0x7fd86c067290 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0x7fd870004630 tx=0x7fd870009b30).stop 2022-02-02T14:05:27.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8800f55c0 0x7fd88010c070 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 --2- 172.21.15.33:0/1326324565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8800f6860 0x7fd88010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 >> 172.21.15.33:0/1326324565 conn(0x7fd8800f0d40 msgr2=0x7fd8800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 shutdown_connections 2022-02-02T14:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:27.951+0000 7fd885fcd700 1 -- 172.21.15.33:0/1326324565 wait complete. 2022-02-02T14:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:05:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:05:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: pgmap v790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:05:28.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:05:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/231099384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:05:28.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:27 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:05:28.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:05:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: pgmap v790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:05:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:05:28.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/231099384' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:05:28.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:27 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:05:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:28 smithi033 ceph-mon[101165]: from='client.44725 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:05:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:28 smithi033 ceph-mon[101165]: pgmap v791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:28 smithi033 ceph-mon[101165]: pgmap v792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1326324565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:05:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:28 smithi037 ceph-mon[69017]: from='client.44725 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:05:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:28 smithi037 ceph-mon[69017]: pgmap v791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:28 smithi037 ceph-mon[69017]: pgmap v792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:29.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1326324565' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:05:31.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:30 smithi033 ceph-mon[101165]: pgmap v793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:31.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:30 smithi037 ceph-mon[69017]: pgmap v793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:33.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:32 smithi033 ceph-mon[101165]: pgmap v794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:33.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:32 smithi037 ceph-mon[69017]: pgmap v794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:34 smithi033 ceph-mon[101165]: pgmap v795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:35.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:34 smithi037 ceph-mon[69017]: pgmap v795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:36 smithi033 ceph-mon[101165]: pgmap v796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:37.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:36 smithi037 ceph-mon[69017]: pgmap v796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:38 smithi033 ceph-mon[101165]: pgmap v797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:39.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:38 smithi037 ceph-mon[69017]: pgmap v797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:40 smithi033 ceph-mon[101165]: pgmap v798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:40 smithi037 ceph-mon[69017]: pgmap v798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:43.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:42 smithi033 ceph-mon[101165]: pgmap v799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:43.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:42 smithi037 ceph-mon[69017]: pgmap v799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:44 smithi033 ceph-mon[101165]: pgmap v800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:45.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:44 smithi037 ceph-mon[69017]: pgmap v800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:46 smithi033 ceph-mon[101165]: pgmap v801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:46 smithi037 ceph-mon[69017]: pgmap v801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:48 smithi033 ceph-mon[101165]: pgmap v802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:48 smithi037 ceph-mon[69017]: pgmap v802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:51.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:50 smithi033 ceph-mon[101165]: pgmap v803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:51.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:50 smithi037 ceph-mon[69017]: pgmap v803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:53.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:52 smithi033 ceph-mon[101165]: pgmap v804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:53.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:52 smithi037 ceph-mon[69017]: pgmap v804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:54 smithi033 ceph-mon[101165]: pgmap v805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:05:55.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:05:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:54 smithi037 ceph-mon[69017]: pgmap v805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:05:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:05:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:56 smithi033 ceph-mon[101165]: pgmap v806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:57.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:56 smithi037 ceph-mon[69017]: pgmap v806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:58.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 -- 172.21.15.33:0/2722837563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 msgr2=0x7fd8c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/2722837563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c80f59e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fd8bc004660 tx=0x7fd8bc009b30).stop 2022-02-02T14:05:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 -- 172.21.15.33:0/2722837563 shutdown_connections 2022-02-02T14:05:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/2722837563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 0x7fd8c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/2722837563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c80f59e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 -- 172.21.15.33:0/2722837563 >> 172.21.15.33:0/2722837563 conn(0x7fd8c80f0d40 msgr2=0x7fd8c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 -- 172.21.15.33:0/2722837563 shutdown_connections 2022-02-02T14:05:58.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.068+0000 7fd8cca9c700 1 -- 172.21.15.33:0/2722837563 wait complete. 2022-02-02T14:05:58.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 Processor -- start 2022-02-02T14:05:58.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 -- start start 2022-02-02T14:05:58.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 0x7fd8c810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c80603e0 con 0x7fd8c80f55c0 2022-02-02T14:05:58.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.069+0000 7fd8cca9c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c8060520 con 0x7fd8c80f6860 2022-02-02T14:05:58.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59536/0 (socket says 172.21.15.33:59536) 2022-02-02T14:05:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 -- 172.21.15.33:0/3883806041 learned_addr learned my addr 172.21.15.33:0/3883806041 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c5d9b700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 0x7fd8c810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 -- 172.21.15.33:0/3883806041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 msgr2=0x7fd8c810c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 0x7fd8c810c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 -- 172.21.15.33:0/3883806041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc005040 con 0x7fd8c80f55c0 2022-02-02T14:05:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8c659c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd8bc014040 tx=0x7fd8bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8bc019070 con 0x7fd8c80f55c0 2022-02-02T14:05:58.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8bc007e70 con 0x7fd8c80f55c0 2022-02-02T14:05:58.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8bc014d10 con 0x7fd8c80f55c0 2022-02-02T14:05:58.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c810c640 con 0x7fd8c80f55c0 2022-02-02T14:05:58.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.070+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c810cb50 con 0x7fd8c80f55c0 2022-02-02T14:05:58.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.071+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c8045ad0 con 0x7fd8c80f55c0 2022-02-02T14:05:58.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.072+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8bc025070 con 0x7fd8c80f55c0 2022-02-02T14:05:58.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.072+0000 7fd8b6ffd700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.073+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd8bc082a90 con 0x7fd8c80f55c0 2022-02-02T14:05:58.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.073+0000 7fd8c5d9b700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.073+0000 7fd8c5d9b700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 0x7fd8b0067290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fd8b8009fd0 tx=0x7fd8b800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.077+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8bc050b40 con 0x7fd8c80f55c0 2022-02-02T14:05:58.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.266+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c80fdf30 con 0x7fd8b0064dd0 2022-02-02T14:05:58.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.268+0000 7fd8b6ffd700 1 -- 172.21.15.33:0/3883806041 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd8b800f040 con 0x7fd8b0064dd0 2022-02-02T14:05:58.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 msgr2=0x7fd8b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 0x7fd8b0067290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fd8b8009fd0 tx=0x7fd8b800b040).stop 2022-02-02T14:05:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 msgr2=0x7fd8c8109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fd8bc014040 tx=0x7fd8bc00b040).stop 2022-02-02T14:05:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 shutdown_connections 2022-02-02T14:05:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8b0064dd0 0x7fd8b0067290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8c80f55c0 0x7fd8c8109bf0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 --2- 172.21.15.33:0/3883806041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8c80f6860 0x7fd8c810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 >> 172.21.15.33:0/3883806041 conn(0x7fd8c80f0d40 msgr2=0x7fd8c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 shutdown_connections 2022-02-02T14:05:58.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.270+0000 7fd8cca9c700 1 -- 172.21.15.33:0/3883806041 wait complete. 2022-02-02T14:05:58.279 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:05:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 -- 172.21.15.33:0/1986384071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 msgr2=0x7f45500f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 --2- 172.21.15.33:0/1986384071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f45500f6b30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f4544004660 tx=0x7f4544009b30).stop 2022-02-02T14:05:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 -- 172.21.15.33:0/1986384071 shutdown_connections 2022-02-02T14:05:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 --2- 172.21.15.33:0/1986384071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f45500f6b30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 --2- 172.21.15.33:0/1986384071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 0x7f45500f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 -- 172.21.15.33:0/1986384071 >> 172.21.15.33:0/1986384071 conn(0x7f45500f0b90 msgr2=0x7f45500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.370+0000 7f4556e61700 1 -- 172.21.15.33:0/1986384071 shutdown_connections 2022-02-02T14:05:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.371+0000 7f4556e61700 1 -- 172.21.15.33:0/1986384071 wait complete. 2022-02-02T14:05:58.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.371+0000 7f4556e61700 1 Processor -- start 2022-02-02T14:05:58.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.371+0000 7f4556e61700 1 -- start start 2022-02-02T14:05:58.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.371+0000 7f4556e61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 0x7f4550109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4556e61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4556e61700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500603e0 con 0x7f45500f66d0 2022-02-02T14:05:58.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4556e61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4550060520 con 0x7f45500f5430 2022-02-02T14:05:58.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59548/0 (socket says 172.21.15.33:59548) 2022-02-02T14:05:58.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 -- 172.21.15.33:0/2613138727 learned_addr learned my addr 172.21.15.33:0/2613138727 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:58.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4555e5f700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 0x7f4550109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 -- 172.21.15.33:0/2613138727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 msgr2=0x7f4550109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 0x7f4550109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 -- 172.21.15.33:0/2613138727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544005040 con 0x7f45500f66d0 2022-02-02T14:05:58.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f455565e700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4544009990 tx=0x7f4544009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4544018070 con 0x7f45500f66d0 2022-02-02T14:05:58.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4544007ca0 con 0x7f45500f66d0 2022-02-02T14:05:58.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455010c470 con 0x7f45500f66d0 2022-02-02T14:05:58.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f454401c620 con 0x7f45500f66d0 2022-02-02T14:05:58.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.372+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455010c9d0 con 0x7f45500f66d0 2022-02-02T14:05:58.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.373+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4550045ad0 con 0x7f45500f66d0 2022-02-02T14:05:58.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.374+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f454401d960 con 0x7f45500f66d0 2022-02-02T14:05:58.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.374+0000 7f45427fc700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 0x7f453c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.374+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4544083830 con 0x7f45500f66d0 2022-02-02T14:05:58.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.374+0000 7f4555e5f700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 0x7f453c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.375+0000 7f4555e5f700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 0x7f453c0672e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f4550060060 tx=0x7f454c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.379+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f45440519a0 con 0x7f45500f66d0 2022-02-02T14:05:58.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.559+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4550057f10 con 0x7f453c064e20 2022-02-02T14:05:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.573+0000 7f45427fc700 1 -- 172.21.15.33:0/2613138727 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4550057f10 con 0x7f453c064e20 2022-02-02T14:05:58.573 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:05:58.573 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (31m) 3m ago 32m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:05:58.574 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (24m) 3m ago 32m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:05:58.574 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (24m) 3m ago 31m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:05:58.575 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (31m) 3m ago 32m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:05:58.576 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (24m) 3m ago 28m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:05:58.576 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (25m) 3m ago 28m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:05:58.576 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (26m) 3m ago 28m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:05:58.576 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (28m) 3m ago 28m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:05:58.576 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (25m) 3m ago 33m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:05:58.577 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (25m) 3m ago 31m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:05:58.577 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (25m) 3m ago 33m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:05:58.578 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (24m) 3m ago 31m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:05:58.578 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (31m) 3m ago 31m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:05:58.578 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (31m) 3m ago 31m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:05:58.578 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 30m - 4096M 2022-02-02T14:05:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (30m) 3m ago 30m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:05:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (30m) 3m ago 30m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:05:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (30m) 3m ago 30m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:05:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (29m) 3m ago 29m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:05:58.580 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (29m) 3m ago 29m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:05:58.580 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (31m) 3m ago 31m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:05:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 msgr2=0x7f453c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 0x7f453c0672e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f4550060060 tx=0x7f454c009040).stop 2022-02-02T14:05:58.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 msgr2=0x7f455010bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f4544009990 tx=0x7f4544009b30).stop 2022-02-02T14:05:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 shutdown_connections 2022-02-02T14:05:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f453c064e20 0x7f453c0672e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45500f5430 0x7f4550109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 --2- 172.21.15.33:0/2613138727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45500f66d0 0x7f455010bf20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 >> 172.21.15.33:0/2613138727 conn(0x7f45500f0b90 msgr2=0x7f45500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 shutdown_connections 2022-02-02T14:05:58.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.575+0000 7f4556e61700 1 -- 172.21.15.33:0/2613138727 wait complete. 2022-02-02T14:05:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 -- 172.21.15.33:0/2285795771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 msgr2=0x7fc3600f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2285795771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc3600f5df0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fc354004660 tx=0x7fc354009b30).stop 2022-02-02T14:05:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 -- 172.21.15.33:0/2285795771 shutdown_connections 2022-02-02T14:05:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2285795771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc3600f5df0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2285795771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 0x7fc3600f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 -- 172.21.15.33:0/2285795771 >> 172.21.15.33:0/2285795771 conn(0x7fc3600f04c0 msgr2=0x7fc3600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 -- 172.21.15.33:0/2285795771 shutdown_connections 2022-02-02T14:05:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.675+0000 7fc3677dd700 1 -- 172.21.15.33:0/2285795771 wait complete. 2022-02-02T14:05:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 Processor -- start 2022-02-02T14:05:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 -- start start 2022-02-02T14:05:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 0x7fc360106370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360106920 con 0x7fc3600f5970 2022-02-02T14:05:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc3677dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc360106a60 con 0x7fc3600f6c60 2022-02-02T14:05:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59556/0 (socket says 172.21.15.33:59556) 2022-02-02T14:05:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 -- 172.21.15.33:0/2432596014 learned_addr learned my addr 172.21.15.33:0/2432596014 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc364d78700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 0x7fc360106370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 -- 172.21.15.33:0/2432596014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 msgr2=0x7fc360106370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 0x7fc360106370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.676+0000 7fc365579700 1 -- 172.21.15.33:0/2432596014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc354005040 con 0x7fc3600f5970 2022-02-02T14:05:58.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc365579700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc35c00e970 tx=0x7fc35c007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35c00c980 con 0x7fc3600f5970 2022-02-02T14:05:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc35c011470 con 0x7fc3600f5970 2022-02-02T14:05:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc360107400 con 0x7fc3600f5970 2022-02-02T14:05:58.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35c010630 con 0x7fc3600f5970 2022-02-02T14:05:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.677+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3601079c0 con 0x7fc3600f5970 2022-02-02T14:05:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.678+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc360045ad0 con 0x7fc3600f5970 2022-02-02T14:05:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.679+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc35c00cae0 con 0x7fc3600f5970 2022-02-02T14:05:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.679+0000 7fc351ffb700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:58.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.679+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc35c0848f0 con 0x7fc3600f5970 2022-02-02T14:05:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.679+0000 7fc364d78700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.680+0000 7fc364d78700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc354004630 tx=0x7fc354009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:58.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.684+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc35c0563d0 con 0x7fc3600f5970 2022-02-02T14:05:58.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.926+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc3600ff850 con 0x7fc3600f5970 2022-02-02T14:05:58.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.927+0000 7fc351ffb700 1 -- 172.21.15.33:0/2432596014 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc35c055fc0 con 0x7fc3600f5970 2022-02-02T14:05:58.927 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:05:58.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:05:58.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:05:58.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:58.928 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:05:58.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:05:58.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:58.929 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:05:58.929 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:05:58.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:58.930 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:05:58.930 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:05:58.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:05:58.931 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:05:58.931 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:05:58.931 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:05:58.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:05:58.931 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:05:58.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 msgr2=0x7fc34c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fc354004630 tx=0x7fc354009b30).stop 2022-02-02T14:05:58.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 msgr2=0x7fc360105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:58.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7fc35c00e970 tx=0x7fc35c007eb0).stop 2022-02-02T14:05:58.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 shutdown_connections 2022-02-02T14:05:58.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3600f5970 0x7fc360105e80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 --2- 172.21.15.33:0/2432596014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3600f6c60 0x7fc360106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:58.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.929+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 >> 172.21.15.33:0/2432596014 conn(0x7fc3600f04c0 msgr2=0x7fc3600fa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:58.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.930+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 shutdown_connections 2022-02-02T14:05:58.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:58.930+0000 7fc3677dd700 1 -- 172.21.15.33:0/2432596014 wait complete. 2022-02-02T14:05:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 -- 172.21.15.33:0/2348929379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f55e0 msgr2=0x7fe5180f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/2348929379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f55e0 0x7fe5180f5a00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fe508004660 tx=0x7fe508009b30).stop 2022-02-02T14:05:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 -- 172.21.15.33:0/2348929379 shutdown_connections 2022-02-02T14:05:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/2348929379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f5ef0 0x7fe5180f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/2348929379 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f55e0 0x7fe5180f5a00 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 -- 172.21.15.33:0/2348929379 >> 172.21.15.33:0/2348929379 conn(0x7fe5180f0de0 msgr2=0x7fe5180f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 -- 172.21.15.33:0/2348929379 shutdown_connections 2022-02-02T14:05:59.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.031+0000 7fe51d3d9700 1 -- 172.21.15.33:0/2348929379 wait complete. 2022-02-02T14:05:59.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 Processor -- start 2022-02-02T14:05:59.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 -- start start 2022-02-02T14:05:59.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f55e0 0x7fe5181090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:59.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:59.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe518109b90 con 0x7fe5180f5ef0 2022-02-02T14:05:59.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe51d3d9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe518109cd0 con 0x7fe5180f55e0 2022-02-02T14:05:59.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe5167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:59.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe5167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59568/0 (socket says 172.21.15.33:59568) 2022-02-02T14:05:59.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe5167fc700 1 -- 172.21.15.33:0/3648665747 learned_addr learned my addr 172.21.15.33:0/3648665747 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:05:59.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.032+0000 7fe516ffd700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f55e0 0x7fe5181090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:59.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe5167fc700 1 -- 172.21.15.33:0/3648665747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f55e0 msgr2=0x7fe5181090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:59.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe5167fc700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f55e0 0x7fe5181090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe5167fc700 1 -- 172.21.15.33:0/3648665747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508005040 con 0x7fe5180f5ef0 2022-02-02T14:05:59.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe5167fc700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fe50000e7f0 tx=0x7fe50000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:59.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5000092e0 con 0x7fe5180f5ef0 2022-02-02T14:05:59.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe50000f040 con 0x7fe5180f5ef0 2022-02-02T14:05:59.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51810a670 con 0x7fe5180f5ef0 2022-02-02T14:05:59.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51810ac30 con 0x7fe5180f5ef0 2022-02-02T14:05:59.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.033+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe500014750 con 0x7fe5180f5ef0 2022-02-02T14:05:59.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.034+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc004fa0 con 0x7fe5180f5ef0 2022-02-02T14:05:59.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.034+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe50001b030 con 0x7fe5180f5ef0 2022-02-02T14:05:59.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.035+0000 7fe50f7fe700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 0x7fe504067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:05:59.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.035+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe500081620 con 0x7fe5180f5ef0 2022-02-02T14:05:59.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.035+0000 7fe516ffd700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 0x7fe504067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:05:59.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.035+0000 7fe516ffd700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 0x7fe504067360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fe508004d80 tx=0x7fe50800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:05:59.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.039+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe5000531b0 con 0x7fe5180f5ef0 2022-02-02T14:05:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:58 smithi033 ceph-mon[101165]: pgmap v807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:59.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:58 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2432596014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:05:59.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.251+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe4fc005e80 con 0x7fe5180f5ef0 2022-02-02T14:05:59.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.252+0000 7fe50f7fe700 1 -- 172.21.15.33:0/3648665747 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe500019070 con 0x7fe5180f5ef0 2022-02-02T14:05:59.251 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:05:59.252 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:05:59.252 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:05:59.252 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:05:59.252 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:59.253 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:05:59.253 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:05:59.253 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:05:59.253 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:05:59.254 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:05:59.254 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:05:59.254 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:05:59.254 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:05:59.254 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:05:59.255 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:05:59.255 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:05:59.255 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:05:59.255 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:05:59.255 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:05:59.256 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:05:59.256 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:05:59.256 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:05:59.257 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:05:59.257 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:05:59.257 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:05:59.258 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:05:59.258 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:05:59.258 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:05:59.258 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:05:59.259 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:05:59.259 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:05:59.259 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:59.259 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:59.259 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:05:59.260 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:05:59.260 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:59.260 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:59.260 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:59.260 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:05:59.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 msgr2=0x7fe504067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 0x7fe504067360 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fe508004d80 tx=0x7fe50800b040).stop 2022-02-02T14:05:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 msgr2=0x7fe5181095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:05:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fe50000e7f0 tx=0x7fe50000b040).stop 2022-02-02T14:05:59.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 shutdown_connections 2022-02-02T14:05:59.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe504064ea0 0x7fe504067360 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5180f55e0 0x7fe5181090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 --2- 172.21.15.33:0/3648665747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5180f5ef0 0x7fe5181095e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:05:59.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 >> 172.21.15.33:0/3648665747 conn(0x7fe5180f0de0 msgr2=0x7fe51805ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:05:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 shutdown_connections 2022-02-02T14:05:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:05:59.255+0000 7fe51d3d9700 1 -- 172.21.15.33:0/3648665747 wait complete. 2022-02-02T14:05:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:05:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:58 smithi037 ceph-mon[69017]: pgmap v807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:05:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:58 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2432596014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:06:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:59 smithi037 ceph-mon[69017]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:59 smithi037 ceph-mon[69017]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:00.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:05:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3648665747' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:06:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:59 smithi033 ceph-mon[101165]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:00.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:59 smithi033 ceph-mon[101165]: from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:00.593 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:05:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3648665747' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:06:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:00 smithi037 ceph-mon[69017]: pgmap v808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:00 smithi033 ceph-mon[101165]: pgmap v808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:03.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:03 smithi037 ceph-mon[69017]: pgmap v809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:03 smithi033 ceph-mon[101165]: pgmap v809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:05 smithi037 ceph-mon[69017]: pgmap v810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:05 smithi033 ceph-mon[101165]: pgmap v810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:07 smithi037 ceph-mon[69017]: pgmap v811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:07 smithi033 ceph-mon[101165]: pgmap v811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:09 smithi037 ceph-mon[69017]: pgmap v812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:09.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:09 smithi033 ceph-mon[101165]: pgmap v812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:11 smithi037 ceph-mon[69017]: pgmap v813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:11.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:11 smithi033 ceph-mon[101165]: pgmap v813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:13 smithi037 ceph-mon[69017]: pgmap v814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:13 smithi033 ceph-mon[101165]: pgmap v814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:15.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:15 smithi037 ceph-mon[69017]: pgmap v815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:15.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:15 smithi033 ceph-mon[101165]: pgmap v815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:17 smithi037 ceph-mon[69017]: pgmap v816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:17.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:17 smithi033 ceph-mon[101165]: pgmap v816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:19.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:19 smithi037 ceph-mon[69017]: pgmap v817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:19.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:19 smithi033 ceph-mon[101165]: pgmap v817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:21.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:21 smithi037 ceph-mon[69017]: pgmap v818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:21.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:21 smithi033 ceph-mon[101165]: pgmap v818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:23.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:23 smithi037 ceph-mon[69017]: pgmap v819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:23 smithi033 ceph-mon[101165]: pgmap v819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:25.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:25 smithi037 ceph-mon[69017]: pgmap v820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:25 smithi033 ceph-mon[101165]: pgmap v820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:27.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:27 smithi037 ceph-mon[69017]: pgmap v821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:27.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:27 smithi033 ceph-mon[101165]: pgmap v821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:06:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:06:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:06:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:06:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:06:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:06:29.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:29 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:06:29.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:29 smithi033 ceph-mon[101165]: pgmap v822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:29.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:06:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 -- 172.21.15.33:0/2800394120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f6860 msgr2=0x7fcdcc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 --2- 172.21.15.33:0/2800394120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc0f6cc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7fcdc0004660 tx=0x7fcdc0009b30).stop 2022-02-02T14:06:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 -- 172.21.15.33:0/2800394120 shutdown_connections 2022-02-02T14:06:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 --2- 172.21.15.33:0/2800394120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc0f6cc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 --2- 172.21.15.33:0/2800394120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 -- 172.21.15.33:0/2800394120 >> 172.21.15.33:0/2800394120 conn(0x7fcdcc0f0d40 msgr2=0x7fcdcc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 -- 172.21.15.33:0/2800394120 shutdown_connections 2022-02-02T14:06:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.369+0000 7fcdd2012700 1 -- 172.21.15.33:0/2800394120 wait complete. 2022-02-02T14:06:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.370+0000 7fcdd2012700 1 Processor -- start 2022-02-02T14:06:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.370+0000 7fcdd2012700 1 -- start start 2022-02-02T14:06:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdd2012700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdd2012700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdd2012700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc107a10 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdd2012700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc107b50 con 0x7fcdcc0f6860 2022-02-02T14:06:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59576/0 (socket says 172.21.15.33:59576) 2022-02-02T14:06:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 -- 172.21.15.33:0/1631278666 learned_addr learned my addr 172.21.15.33:0/1631278666 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:06:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcaffd700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 -- 172.21.15.33:0/1631278666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f6860 msgr2=0x7fcdcc107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 -- 172.21.15.33:0/1631278666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0005040 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdcb7fe700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fcdbc00c530 tx=0x7fcdbc007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdbc00f650 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc1084f0 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.371+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcdbc00fc60 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.372+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdbc012d20 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.372+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc108ab0 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.373+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc045ad0 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.373+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcdbc019030 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.374+0000 7fcdb3fff700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 0x7fcdb4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.374+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcdbc081700 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.374+0000 7fcdcaffd700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 0x7fcdb4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.374+0000 7fcdcaffd700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 0x7fcdb4067290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fcdc0004e30 tx=0x7fcdc0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.378+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcdbc053230 con 0x7fcdcc0f55c0 2022-02-02T14:06:29.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:29 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:06:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:29 smithi037 ceph-mon[69017]: pgmap v822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:06:29.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.568+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdcc0faca0 con 0x7fcdb4064dd0 2022-02-02T14:06:29.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.569+0000 7fcdb3fff700 1 -- 172.21.15.33:0/1631278666 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fcdcc0faca0 con 0x7fcdb4064dd0 2022-02-02T14:06:29.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 msgr2=0x7fcdb4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 0x7fcdb4067290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7fcdc0004e30 tx=0x7fcdc0009b30).stop 2022-02-02T14:06:29.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 msgr2=0x7fcdcc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fcdbc00c530 tx=0x7fcdbc007e10).stop 2022-02-02T14:06:29.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 shutdown_connections 2022-02-02T14:06:29.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdb4064dd0 0x7fcdb4067290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdcc0f55c0 0x7fcdcc106f70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 --2- 172.21.15.33:0/1631278666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdcc0f6860 0x7fcdcc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 >> 172.21.15.33:0/1631278666 conn(0x7fcdcc0f0d40 msgr2=0x7fcdcc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:29.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 shutdown_connections 2022-02-02T14:06:29.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.571+0000 7fcdd2012700 1 -- 172.21.15.33:0/1631278666 wait complete. 2022-02-02T14:06:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:06:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- 172.21.15.33:0/2827700005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 msgr2=0x7fb2240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 --2- 172.21.15.33:0/2827700005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f6cc0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fb218004660 tx=0x7fb218009b30).stop 2022-02-02T14:06:29.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- 172.21.15.33:0/2827700005 shutdown_connections 2022-02-02T14:06:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 --2- 172.21.15.33:0/2827700005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f6cc0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 --2- 172.21.15.33:0/2827700005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 0x7fb2240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- 172.21.15.33:0/2827700005 >> 172.21.15.33:0/2827700005 conn(0x7fb2240f0d40 msgr2=0x7fb2240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- 172.21.15.33:0/2827700005 shutdown_connections 2022-02-02T14:06:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- 172.21.15.33:0/2827700005 wait complete. 2022-02-02T14:06:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 Processor -- start 2022-02-02T14:06:29.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.673+0000 7fb22c6de700 1 -- start start 2022-02-02T14:06:29.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb22c6de700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 0x7fb2240f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb22c6de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb22c6de700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240f8100 con 0x7fb2240f6860 2022-02-02T14:06:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb22c6de700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240f8240 con 0x7fb2240f55c0 2022-02-02T14:06:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59588/0 (socket says 172.21.15.33:59588) 2022-02-02T14:06:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 -- 172.21.15.33:0/31873465 learned_addr learned my addr 172.21.15.33:0/31873465 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:06:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb22a47a700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 0x7fb2240f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 -- 172.21.15.33:0/31873465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 msgr2=0x7fb2240f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 0x7fb2240f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 -- 172.21.15.33:0/31873465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb218005040 con 0x7fb2240f6860 2022-02-02T14:06:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.674+0000 7fb229c79700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fb218009da0 tx=0x7fb218009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.675+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb218018070 con 0x7fb2240f6860 2022-02-02T14:06:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.675+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240f84c0 con 0x7fb2240f6860 2022-02-02T14:06:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.675+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb218007cf0 con 0x7fb2240f6860 2022-02-02T14:06:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.675+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb21801c620 con 0x7fb2240f6860 2022-02-02T14:06:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.675+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240f8a20 con 0x7fb2240f6860 2022-02-02T14:06:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.676+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224045ad0 con 0x7fb2240f6860 2022-02-02T14:06:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.676+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb21801d420 con 0x7fb2240f6860 2022-02-02T14:06:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.677+0000 7fb216ffd700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 0x7fb210067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.677+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb218083a00 con 0x7fb2240f6860 2022-02-02T14:06:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.677+0000 7fb22a47a700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 0x7fb210067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.677+0000 7fb22a47a700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 0x7fb210067270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb2240f94b0 tx=0x7fb220009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.681+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb218051ab0 con 0x7fb2240f6860 2022-02-02T14:06:29.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.863+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2240faca0 con 0x7fb210064db0 2022-02-02T14:06:29.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.877+0000 7fb216ffd700 1 -- 172.21.15.33:0/31873465 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb2240faca0 con 0x7fb210064db0 2022-02-02T14:06:29.878 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:06:29.878 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (31m) 4m ago 32m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:06:29.878 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (24m) 4m ago 32m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:06:29.879 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (24m) 4m ago 32m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:06:29.879 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (31m) 4m ago 32m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:06:29.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (25m) 4m ago 28m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:06:29.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (25m) 4m ago 28m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:06:29.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (26m) 4m ago 29m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:06:29.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (28m) 4m ago 28m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:06:29.880 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (26m) 4m ago 34m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:06:29.880 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (25m) 4m ago 32m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:06:29.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (25m) 4m ago 34m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:06:29.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (25m) 4m ago 32m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:06:29.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (32m) 4m ago 32m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:06:29.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (32m) 4m ago 32m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:06:29.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 31m - 4096M 2022-02-02T14:06:29.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (31m) 4m ago 31m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:06:29.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (30m) 4m ago 30m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:06:29.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (30m) 4m ago 30m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:06:29.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (30m) 4m ago 30m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:06:29.883 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (30m) 4m ago 30m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:06:29.883 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (31m) 4m ago 32m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:06:29.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 msgr2=0x7fb210067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 0x7fb210067270 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fb2240f94b0 tx=0x7fb220009040).stop 2022-02-02T14:06:29.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 msgr2=0x7fb2240f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fb218009da0 tx=0x7fb218009b30).stop 2022-02-02T14:06:29.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 shutdown_connections 2022-02-02T14:06:29.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb210064db0 0x7fb210067270 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2240f55c0 0x7fb2240f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 --2- 172.21.15.33:0/31873465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2240f6860 0x7fb2240f7ba0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 >> 172.21.15.33:0/31873465 conn(0x7fb2240f0d40 msgr2=0x7fb22405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:29.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 shutdown_connections 2022-02-02T14:06:29.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.879+0000 7fb22c6de700 1 -- 172.21.15.33:0/31873465 wait complete. 2022-02-02T14:06:29.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 -- 172.21.15.33:0/2152523721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 msgr2=0x7f2ecc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 --2- 172.21.15.33:0/2152523721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc0f5850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f2ebc004660 tx=0x7f2ebc009b30).stop 2022-02-02T14:06:29.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 -- 172.21.15.33:0/2152523721 shutdown_connections 2022-02-02T14:06:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 --2- 172.21.15.33:0/2152523721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 --2- 172.21.15.33:0/2152523721 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc0f5850 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 -- 172.21.15.33:0/2152523721 >> 172.21.15.33:0/2152523721 conn(0x7f2ecc0f0b90 msgr2=0x7f2ecc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 -- 172.21.15.33:0/2152523721 shutdown_connections 2022-02-02T14:06:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 -- 172.21.15.33:0/2152523721 wait complete. 2022-02-02T14:06:29.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.979+0000 7f2ed179e700 1 Processor -- start 2022-02-02T14:06:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ed179e700 1 -- start start 2022-02-02T14:06:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ed179e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ed179e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ed179e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc1067d0 con 0x7f2ecc0f5430 2022-02-02T14:06:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ed179e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc106fd0 con 0x7f2ecc0f66d0 2022-02-02T14:06:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59596/0 (socket says 172.21.15.33:59596) 2022-02-02T14:06:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 -- 172.21.15.33:0/3016306092 learned_addr learned my addr 172.21.15.33:0/3016306092 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:06:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecb7fe700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 -- 172.21.15.33:0/3016306092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 msgr2=0x7f2ecc106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecbfff700 1 -- 172.21.15.33:0/3016306092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc005040 con 0x7f2ecc0f5430 2022-02-02T14:06:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.980+0000 7f2ecb7fe700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:06:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ecbfff700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f2ebc004f60 tx=0x7f2ebc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc018070 con 0x7f2ecc0f5430 2022-02-02T14:06:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ebc007ba0 con 0x7f2ecc0f5430 2022-02-02T14:06:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ebc01c620 con 0x7f2ecc0f5430 2022-02-02T14:06:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc107250 con 0x7f2ecc0f5430 2022-02-02T14:06:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.981+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc1077b0 con 0x7f2ecc0f5430 2022-02-02T14:06:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.982+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc059100 con 0x7f2ecc0f5430 2022-02-02T14:06:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.982+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2ebc01d420 con 0x7f2ecc0f5430 2022-02-02T14:06:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.983+0000 7f2ec8ff9700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 0x7f2eb40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.983+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2ebc0838e0 con 0x7f2ecc0f5430 2022-02-02T14:06:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.983+0000 7f2ecb7fe700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 0x7f2eb40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.983+0000 7f2ecb7fe700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 0x7f2eb40672e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f2ec00041d0 tx=0x7f2ec0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:29.987+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2ebc055480 con 0x7f2ecc0f5430 2022-02-02T14:06:30.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.234+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ecc0fdc40 con 0x7f2ecc0f5430 2022-02-02T14:06:30.236 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:30 smithi033 ceph-mon[101165]: pgmap v823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:30.238 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:30 smithi033 ceph-mon[101165]: pgmap v824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:30.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.234+0000 7f2ec8ff9700 1 -- 172.21.15.33:0/3016306092 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2ebc055070 con 0x7f2ecc0f5430 2022-02-02T14:06:30.239 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:06:30.240 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:06:30.240 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:06:30.241 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:06:30.242 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:06:30.242 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:06:30.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:06:30.242 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:06:30.243 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:06:30.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:06:30.243 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:06:30.243 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:06:30.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:06:30.244 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:06:30.244 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:06:30.244 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:06:30.244 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:06:30.245 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:06:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 msgr2=0x7f2eb40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 0x7f2eb40672e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f2ec00041d0 tx=0x7f2ec0009040).stop 2022-02-02T14:06:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 msgr2=0x7f2ecc105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f2ebc004f60 tx=0x7f2ebc009b30).stop 2022-02-02T14:06:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 shutdown_connections 2022-02-02T14:06:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2eb4064e20 0x7f2eb40672e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ecc0f5430 0x7f2ecc105d30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 --2- 172.21.15.33:0/3016306092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ecc0f66d0 0x7f2ecc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 >> 172.21.15.33:0/3016306092 conn(0x7f2ecc0f0b90 msgr2=0x7f2ecc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 shutdown_connections 2022-02-02T14:06:30.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.237+0000 7f2ed179e700 1 -- 172.21.15.33:0/3016306092 wait complete. 2022-02-02T14:06:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 -- 172.21.15.33:0/1324000134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0060310 msgr2=0x7f35f00f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 --2- 172.21.15.33:0/1324000134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0060310 0x7f35f00f9110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f35e0004660 tx=0x7f35e0009b30).stop 2022-02-02T14:06:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 -- 172.21.15.33:0/1324000134 shutdown_connections 2022-02-02T14:06:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 --2- 172.21.15.33:0/1324000134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f00f9690 0x7f35f00fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:06:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 --2- 172.21.15.33:0/1324000134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f0060310 0x7f35f00f9110 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 -- 172.21.15.33:0/1324000134 >> 172.21.15.33:0/1324000134 conn(0x7f35f00f0b90 msgr2=0x7f35f00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:30.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 -- 172.21.15.33:0/1324000134 shutdown_connections 2022-02-02T14:06:30.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.338+0000 7f35f4c51700 1 -- 172.21.15.33:0/1324000134 wait complete. 2022-02-02T14:06:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.339+0000 7f35f4c51700 1 Processor -- start 2022-02-02T14:06:30.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.339+0000 7f35f4c51700 1 -- start start 2022-02-02T14:06:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35f4c51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f0060310 0x7f35f0106db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35f4c51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35f4c51700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f0107930 con 0x7f35f00f9690 2022-02-02T14:06:30.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35f4c51700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f01080e0 con 0x7f35f0060310 2022-02-02T14:06:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59608/0 (socket says 172.21.15.33:59608) 2022-02-02T14:06:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 -- 172.21.15.33:0/66194812 learned_addr learned my addr 172.21.15.33:0/66194812 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:06:30.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35ef7fe700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f0060310 0x7f35f0106db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 -- 172.21.15.33:0/66194812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f0060310 msgr2=0x7f35f0106db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f0060310 0x7f35f0106db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 -- 172.21.15.33:0/66194812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0005040 con 0x7f35f00f9690 2022-02-02T14:06:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35eeffd700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f35e40093f0 tx=0x7f35e4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:30.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.340+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e4009ea0 con 0x7f35f00f9690 2022-02-02T14:06:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.341+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f01083c0 con 0x7f35f00f9690 2022-02-02T14:06:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.341+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f35e4013af0 con 0x7f35f00f9690 2022-02-02T14:06:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.341+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35e400db10 con 0x7f35f00f9690 2022-02-02T14:06:30.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.341+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f0108980 con 0x7f35f00f9690 2022-02-02T14:06:30.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.342+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f0059100 con 0x7f35f00f9690 2022-02-02T14:06:30.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.342+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f35e401a060 con 0x7f35f00f9690 2022-02-02T14:06:30.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.342+0000 7f35d7fff700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 0x7f35d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:06:30.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.342+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f35e4081a30 con 0x7f35f00f9690 2022-02-02T14:06:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.343+0000 7f35ef7fe700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 0x7f35d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:06:30.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.343+0000 7f35ef7fe700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 0x7f35d80672e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f35e0004e30 tx=0x7f35e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:06:30.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.347+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f35e404fae0 con 0x7f35f00f9690 2022-02-02T14:06:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:30 smithi037 ceph-mon[69017]: pgmap v823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:30 smithi037 ceph-mon[69017]: pgmap v824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:30.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.566+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f35f00fee30 con 0x7f35f00f9690 2022-02-02T14:06:30.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.566+0000 7f35d7fff700 1 -- 172.21.15.33:0/66194812 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f35e4018750 con 0x7f35f00f9690 2022-02-02T14:06:30.567 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:06:30.567 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:06:30.568 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:06:30.568 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:06:30.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:06:30.568 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:06:30.569 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:06:30.569 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:06:30.569 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:06:30.569 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:06:30.570 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:06:30.570 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:06:30.570 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:06:30.570 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:06:30.570 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:06:30.571 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:06:30.571 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:06:30.571 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:06:30.571 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:06:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:06:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:06:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:06:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:06:30.572 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:06:30.573 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:06:30.573 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:06:30.573 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:06:30.573 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:06:30.574 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:06:30.574 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:06:30.574 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:06:30.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:06:30.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:06:30.575 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:06:30.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:06:30.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:06:30.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:06:30.576 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:06:30.576 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:06:30.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 msgr2=0x7f35d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 0x7f35d80672e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f35e0004e30 tx=0x7f35e0009b30).stop 2022-02-02T14:06:30.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 msgr2=0x7f35f01072a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:06:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7f35e40093f0 tx=0x7f35e4006ec0).stop 2022-02-02T14:06:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 shutdown_connections 2022-02-02T14:06:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35d8064e20 0x7f35d80672e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f0060310 0x7f35f0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 --2- 172.21.15.33:0/66194812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f00f9690 0x7f35f01072a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:06:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 >> 172.21.15.33:0/66194812 conn(0x7f35f00f0b90 msgr2=0x7f35f00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:06:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 shutdown_connections 2022-02-02T14:06:30.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:06:30.568+0000 7f35f4c51700 1 -- 172.21.15.33:0/66194812 wait complete. 2022-02-02T14:06:30.580 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:06:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:31 smithi033 ceph-mon[101165]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:31.505 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:31 smithi033 ceph-mon[101165]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:31.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3016306092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:06:31.506 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/66194812' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:06:31.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:31 smithi037 ceph-mon[69017]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:31 smithi037 ceph-mon[69017]: from='client.34938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:06:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3016306092' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:06:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/66194812' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:06:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:32 smithi033 ceph-mon[101165]: pgmap v825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:32 smithi037 ceph-mon[69017]: pgmap v825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:34 smithi033 ceph-mon[101165]: pgmap v826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:34 smithi037 ceph-mon[69017]: pgmap v826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:36 smithi033 ceph-mon[101165]: pgmap v827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:36 smithi037 ceph-mon[69017]: pgmap v827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:38 smithi033 ceph-mon[101165]: pgmap v828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:38 smithi037 ceph-mon[69017]: pgmap v828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:40 smithi033 ceph-mon[101165]: pgmap v829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:40 smithi037 ceph-mon[69017]: pgmap v829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:42 smithi033 ceph-mon[101165]: pgmap v830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:42 smithi037 ceph-mon[69017]: pgmap v830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:44 smithi033 ceph-mon[101165]: pgmap v831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:44 smithi037 ceph-mon[69017]: pgmap v831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:46 smithi033 ceph-mon[101165]: pgmap v832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:46 smithi037 ceph-mon[69017]: pgmap v832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:48 smithi033 ceph-mon[101165]: pgmap v833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:48 smithi037 ceph-mon[69017]: pgmap v833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:50 smithi033 ceph-mon[101165]: pgmap v834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:50 smithi037 ceph-mon[69017]: pgmap v834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:52 smithi033 ceph-mon[101165]: pgmap v835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:52 smithi037 ceph-mon[69017]: pgmap v835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:54 smithi033 ceph-mon[101165]: pgmap v836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:54 smithi037 ceph-mon[69017]: pgmap v836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:06:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:06:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:06:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:06:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:56 smithi033 ceph-mon[101165]: pgmap v837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:56 smithi037 ceph-mon[69017]: pgmap v837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:06:58 smithi033 ceph-mon[101165]: pgmap v838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:06:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:06:58 smithi037 ceph-mon[69017]: pgmap v838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:00 smithi033 ceph-mon[101165]: pgmap v839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:00 smithi037 ceph-mon[69017]: pgmap v839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:00.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.683+0000 7f2eb4280700 1 -- 172.21.15.33:0/1750956457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 msgr2=0x7f2eac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.683+0000 7f2eb4280700 1 --2- 172.21.15.33:0/1750956457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac0f6cc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f2e9c004660 tx=0x7f2e9c009b30).stop 2022-02-02T14:07:00.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.683+0000 7f2eb4280700 1 -- 172.21.15.33:0/1750956457 shutdown_connections 2022-02-02T14:07:00.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 --2- 172.21.15.33:0/1750956457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac0f6cc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 --2- 172.21.15.33:0/1750956457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- 172.21.15.33:0/1750956457 >> 172.21.15.33:0/1750956457 conn(0x7f2eac0f0d40 msgr2=0x7f2eac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:00.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- 172.21.15.33:0/1750956457 shutdown_connections 2022-02-02T14:07:00.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- 172.21.15.33:0/1750956457 wait complete. 2022-02-02T14:07:00.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 Processor -- start 2022-02-02T14:07:00.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- start start 2022-02-02T14:07:00.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0602b0 con 0x7f2eac0f6860 2022-02-02T14:07:00.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.684+0000 7f2eb4280700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0603f0 con 0x7f2eac0f55c0 2022-02-02T14:07:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59618/0 (socket says 172.21.15.33:59618) 2022-02-02T14:07:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 -- 172.21.15.33:0/2759313815 learned_addr learned my addr 172.21.15.33:0/2759313815 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb201c700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 -- 172.21.15.33:0/2759313815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 msgr2=0x7f2eac10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac10c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 -- 172.21.15.33:0/2759313815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c005040 con 0x7f2eac0f6860 2022-02-02T14:07:00.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb181b700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f2e9c009990 tx=0x7f2e9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9c018070 con 0x7f2eac0f6860 2022-02-02T14:07:00.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e9c007ba0 con 0x7f2eac0f6860 2022-02-02T14:07:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e9c01c3c0 con 0x7f2eac0f6860 2022-02-02T14:07:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac10ea60 con 0x7f2eac0f6860 2022-02-02T14:07:00.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.685+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac10ee30 con 0x7f2eac0f6860 2022-02-02T14:07:00.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.686+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac045ad0 con 0x7f2eac0f6860 2022-02-02T14:07:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.687+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e9c01d420 con 0x7f2eac0f6860 2022-02-02T14:07:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.687+0000 7f2ea2ffd700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.687+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2e9c0836d0 con 0x7f2eac0f6860 2022-02-02T14:07:00.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.687+0000 7f2eb201c700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.688+0000 7f2eb201c700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2eac060040 tx=0x7f2ea8009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.692+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e9c051720 con 0x7f2eac0f6860 2022-02-02T14:07:00.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.881+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2eac0fde90 con 0x7f2e98064dd0 2022-02-02T14:07:00.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.882+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/2759313815 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2eac0fde90 con 0x7f2e98064dd0 2022-02-02T14:07:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 msgr2=0x7f2e98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f2eac060040 tx=0x7f2ea8009c00).stop 2022-02-02T14:07:00.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 msgr2=0x7f2eac10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f2e9c009990 tx=0x7f2e9c009b30).stop 2022-02-02T14:07:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 shutdown_connections 2022-02-02T14:07:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 --2- 172.21.15.33:0/2759313815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10e570 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 >> 172.21.15.33:0/2759313815 conn(0x7f2eac0f0d40 msgr2=0x7f2eac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 shutdown_connections 2022-02-02T14:07:00.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.884+0000 7f2eb4280700 1 -- 172.21.15.33:0/2759313815 wait complete. 2022-02-02T14:07:00.894 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:07:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 -- 172.21.15.33:0/3189830345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 msgr2=0x7f35840f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 --2- 172.21.15.33:0/3189830345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f6b30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f3578004660 tx=0x7f3578009b30).stop 2022-02-02T14:07:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 -- 172.21.15.33:0/3189830345 shutdown_connections 2022-02-02T14:07:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 --2- 172.21.15.33:0/3189830345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f6b30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 --2- 172.21.15.33:0/3189830345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 0x7f35840f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.986+0000 7f358881d700 1 -- 172.21.15.33:0/3189830345 >> 172.21.15.33:0/3189830345 conn(0x7f35840f0b90 msgr2=0x7f35840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:00.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.987+0000 7f358881d700 1 -- 172.21.15.33:0/3189830345 shutdown_connections 2022-02-02T14:07:00.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.987+0000 7f358881d700 1 -- 172.21.15.33:0/3189830345 wait complete. 2022-02-02T14:07:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.987+0000 7f358881d700 1 Processor -- start 2022-02-02T14:07:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.987+0000 7f358881d700 1 -- start start 2022-02-02T14:07:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f358881d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 0x7f35840f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f358881d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f358881d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840f7f70 con 0x7f35840f66d0 2022-02-02T14:07:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f358881d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840f80b0 con 0x7f35840f5430 2022-02-02T14:07:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59628/0 (socket says 172.21.15.33:59628) 2022-02-02T14:07:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 -- 172.21.15.33:0/530727321 learned_addr learned my addr 172.21.15.33:0/530727321 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f35837fe700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 0x7f35840f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 -- 172.21.15.33:0/530727321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 msgr2=0x7f35840f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 0x7f35840f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 -- 172.21.15.33:0/530727321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578005040 con 0x7f35840f66d0 2022-02-02T14:07:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f3582ffd700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f3578009830 tx=0x7f3578009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.988+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3578018070 con 0x7f35840f66d0 2022-02-02T14:07:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.989+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840f8330 con 0x7f35840f66d0 2022-02-02T14:07:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.989+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35840f8890 con 0x7f35840f66d0 2022-02-02T14:07:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.989+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3578007ba0 con 0x7f35840f66d0 2022-02-02T14:07:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.989+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f357801c620 con 0x7f35840f66d0 2022-02-02T14:07:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.990+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3564004fa0 con 0x7f35840f66d0 2022-02-02T14:07:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.990+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f357801c850 con 0x7f35840f66d0 2022-02-02T14:07:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.991+0000 7f356bfff700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 0x7f356c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.991+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f35780836c0 con 0x7f35840f66d0 2022-02-02T14:07:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.991+0000 7f35837fe700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 0x7f356c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.992+0000 7f35837fe700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 0x7f356c0672e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f35840f9320 tx=0x7f3574009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:00.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:00.995+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3578051830 con 0x7f35840f66d0 2022-02-02T14:07:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.179+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3564000bc0 con 0x7f356c064e20 2022-02-02T14:07:01.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.193+0000 7f356bfff700 1 -- 172.21.15.33:0/530727321 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3564000bc0 con 0x7f356c064e20 2022-02-02T14:07:01.193 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:07:01.193 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (32m) 4m ago 33m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:07:01.194 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (25m) 4m ago 33m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:07:01.194 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (25m) 4m ago 32m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:07:01.194 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (32m) 4m ago 33m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:07:01.194 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (25m) 4m ago 29m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:07:01.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (26m) 4m ago 29m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:07:01.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (27m) 4m ago 29m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:07:01.195 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (29m) 4m ago 29m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:07:01.195 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (26m) 4m ago 34m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:07:01.196 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (26m) 4m ago 32m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:07:01.196 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (26m) 4m ago 34m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:07:01.196 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (25m) 4m ago 32m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:07:01.196 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (33m) 4m ago 33m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:07:01.197 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (32m) 4m ago 32m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:07:01.197 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 32m - 4096M 2022-02-02T14:07:01.197 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (31m) 4m ago 31m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:07:01.197 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (31m) 4m ago 31m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:07:01.198 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (31m) 4m ago 31m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:07:01.198 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (30m) 4m ago 30m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:07:01.198 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (30m) 4m ago 30m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:07:01.198 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (32m) 4m ago 32m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:07:01.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 msgr2=0x7f356c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 0x7f356c0672e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f35840f9320 tx=0x7f3574009c80).stop 2022-02-02T14:07:01.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 msgr2=0x7f35840f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f3578009830 tx=0x7f3578009b30).stop 2022-02-02T14:07:01.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 shutdown_connections 2022-02-02T14:07:01.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f356c064e20 0x7f356c0672e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35840f5430 0x7f35840f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 --2- 172.21.15.33:0/530727321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35840f66d0 0x7f35840f7a10 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 >> 172.21.15.33:0/530727321 conn(0x7f35840f0b90 msgr2=0x7f358405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 shutdown_connections 2022-02-02T14:07:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.195+0000 7f358881d700 1 -- 172.21.15.33:0/530727321 wait complete. 2022-02-02T14:07:01.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- 172.21.15.33:0/4116056094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 msgr2=0x7fa6040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 --2- 172.21.15.33:0/4116056094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa6040f59e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fa5f8004660 tx=0x7fa5f8009b30).stop 2022-02-02T14:07:01.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- 172.21.15.33:0/4116056094 shutdown_connections 2022-02-02T14:07:01.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 --2- 172.21.15.33:0/4116056094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 0x7fa6040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 --2- 172.21.15.33:0/4116056094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa6040f59e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- 172.21.15.33:0/4116056094 >> 172.21.15.33:0/4116056094 conn(0x7fa6040f0d40 msgr2=0x7fa6040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:01.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- 172.21.15.33:0/4116056094 shutdown_connections 2022-02-02T14:07:01.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- 172.21.15.33:0/4116056094 wait complete. 2022-02-02T14:07:01.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 Processor -- start 2022-02-02T14:07:01.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.296+0000 7fa60aaee700 1 -- start start 2022-02-02T14:07:01.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60aaee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60aaee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 0x7fa6041073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60aaee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604107990 con 0x7fa6040f55c0 2022-02-02T14:07:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60aaee700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604107ad0 con 0x7fa6040f6860 2022-02-02T14:07:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59636/0 (socket says 172.21.15.33:59636) 2022-02-02T14:07:01.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 -- 172.21.15.33:0/1523914779 learned_addr learned my addr 172.21.15.33:0/1523914779 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:01.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa603fff700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 0x7fa6041073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 -- 172.21.15.33:0/1523914779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 msgr2=0x7fa6041073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 0x7fa6041073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 -- 172.21.15.33:0/1523914779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f8005040 con 0x7fa6040f55c0 2022-02-02T14:07:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.297+0000 7fa60888a700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa5f8014040 tx=0x7fa5f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.298+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f8019070 con 0x7fa6040f55c0 2022-02-02T14:07:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.298+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa5f8007e70 con 0x7fa6040f55c0 2022-02-02T14:07:01.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.298+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa604108410 con 0x7fa6040f55c0 2022-02-02T14:07:01.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.298+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f8014d10 con 0x7fa6040f55c0 2022-02-02T14:07:01.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.298+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa604108970 con 0x7fa6040f55c0 2022-02-02T14:07:01.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.299+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604045ad0 con 0x7fa6040f55c0 2022-02-02T14:07:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.299+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa5f8025070 con 0x7fa6040f55c0 2022-02-02T14:07:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.300+0000 7fa6017fa700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 0x7fa5f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.300+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa5f8082990 con 0x7fa6040f55c0 2022-02-02T14:07:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.300+0000 7fa603fff700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 0x7fa5f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.300+0000 7fa603fff700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 0x7fa5f4067290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa5f0009fd0 tx=0x7fa5f000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:01.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.304+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa5f8054470 con 0x7fa6040f55c0 2022-02-02T14:07:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.547+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa60410d510 con 0x7fa6040f55c0 2022-02-02T14:07:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.548+0000 7fa6017fa700 1 -- 172.21.15.33:0/1523914779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa5f80232d0 con 0x7fa6040f55c0 2022-02-02T14:07:01.548 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:07:01.551 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:07:01.551 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:07:01.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:01.551 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:07:01.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:07:01.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:01.552 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:07:01.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:07:01.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:01.553 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:07:01.553 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:07:01.553 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:01.554 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:07:01.554 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:07:01.554 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:07:01.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:07:01.554 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:07:01.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 msgr2=0x7fa5f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 0x7fa5f4067290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa5f0009fd0 tx=0x7fa5f000b040).stop 2022-02-02T14:07:01.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 msgr2=0x7fa604106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fa5f8014040 tx=0x7fa5f800b040).stop 2022-02-02T14:07:01.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 shutdown_connections 2022-02-02T14:07:01.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa5f4064dd0 0x7fa5f4067290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6040f55c0 0x7fa604106ef0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 --2- 172.21.15.33:0/1523914779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6040f6860 0x7fa6041073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 >> 172.21.15.33:0/1523914779 conn(0x7fa6040f0d40 msgr2=0x7fa60405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:01.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 shutdown_connections 2022-02-02T14:07:01.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.550+0000 7fa60aaee700 1 -- 172.21.15.33:0/1523914779 wait complete. 2022-02-02T14:07:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 -- 172.21.15.33:0/3647363079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f6700 msgr2=0x7fdae40f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 --2- 172.21.15.33:0/3647363079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f6700 0x7fdae40f6b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fdad8004660 tx=0x7fdad8009b30).stop 2022-02-02T14:07:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 -- 172.21.15.33:0/3647363079 shutdown_connections 2022-02-02T14:07:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 --2- 172.21.15.33:0/3647363079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f6700 0x7fdae40f6b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 --2- 172.21.15.33:0/3647363079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f5460 0x7fdae40f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 -- 172.21.15.33:0/3647363079 >> 172.21.15.33:0/3647363079 conn(0x7fdae40f0bc0 msgr2=0x7fdae40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:01.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.652+0000 7fdae9451700 1 -- 172.21.15.33:0/3647363079 shutdown_connections 2022-02-02T14:07:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 -- 172.21.15.33:0/3647363079 wait complete. 2022-02-02T14:07:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 Processor -- start 2022-02-02T14:07:01.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 -- start start 2022-02-02T14:07:01.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f6700 0x7fdae4109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4109a40 con 0x7fdae40f5460 2022-02-02T14:07:01.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.653+0000 7fdae9451700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae4109b80 con 0x7fdae40f6700 2022-02-02T14:07:01.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59646/0 (socket says 172.21.15.33:59646) 2022-02-02T14:07:01.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 -- 172.21.15.33:0/816856139 learned_addr learned my addr 172.21.15.33:0/816856139 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae27fc700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f6700 0x7fdae4109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 -- 172.21.15.33:0/816856139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f6700 msgr2=0x7fdae4109490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f6700 0x7fdae4109490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 -- 172.21.15.33:0/816856139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad8005040 con 0x7fdae40f5460 2022-02-02T14:07:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae2ffd700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdad4002700 tx=0x7fdad4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad4009320 con 0x7fdae40f5460 2022-02-02T14:07:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdad400f040 con 0x7fdae40f5460 2022-02-02T14:07:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdad4014900 con 0x7fdae40f5460 2022-02-02T14:07:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae410a520 con 0x7fdae40f5460 2022-02-02T14:07:01.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.654+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae410aae0 con 0x7fdae40f5460 2022-02-02T14:07:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.655+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae4045ad0 con 0x7fdae40f5460 2022-02-02T14:07:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.656+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdad4009480 con 0x7fdae40f5460 2022-02-02T14:07:01.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.656+0000 7fdacb7fe700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 0x7fdacc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.656+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdad4081d10 con 0x7fdae40f5460 2022-02-02T14:07:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.656+0000 7fdae27fc700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 0x7fdacc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.657+0000 7fdae27fc700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 0x7fdacc0672e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdad8004630 tx=0x7fdad8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.660+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdad40538b0 con 0x7fdae40f5460 2022-02-02T14:07:01.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.873+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdae410f5c0 con 0x7fdae40f5460 2022-02-02T14:07:01.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.874+0000 7fdacb7fe700 1 -- 172.21.15.33:0/816856139 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fdad40534a0 con 0x7fdae40f5460 2022-02-02T14:07:01.874 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:07:01.874 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:07:01.875 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:07:01.875 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:07:01.875 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:01.876 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:07:01.876 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:07:01.876 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:07:01.876 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:07:01.877 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:07:01.877 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:07:01.877 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:07:01.877 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:07:01.878 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:07:01.878 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:07:01.878 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:07:01.878 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:07:01.878 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:07:01.879 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:07:01.879 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:07:01.879 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:07:01.879 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:07:01.880 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:07:01.880 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:07:01.880 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:07:01.880 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:07:01.881 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:07:01.881 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:07:01.881 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:07:01.881 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:07:01.881 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:07:01.882 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:01.882 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:01.882 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:07:01.882 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:01.883 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:01.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 msgr2=0x7fdacc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 0x7fdacc0672e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fdad8004630 tx=0x7fdad8009b30).stop 2022-02-02T14:07:01.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 msgr2=0x7fdae4108fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:01.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fdad4002700 tx=0x7fdad4009d80).stop 2022-02-02T14:07:01.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 shutdown_connections 2022-02-02T14:07:01.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdacc064e20 0x7fdacc0672e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40f5460 0x7fdae4108fa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 --2- 172.21.15.33:0/816856139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdae40f6700 0x7fdae4109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:01.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 >> 172.21.15.33:0/816856139 conn(0x7fdae40f0bc0 msgr2=0x7fdae405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:01.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 shutdown_connections 2022-02-02T14:07:01.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:01.876+0000 7fdae9451700 1 -- 172.21.15.33:0/816856139 wait complete. 2022-02-02T14:07:01.887 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:07:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:02 smithi033 ceph-mon[101165]: pgmap v840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:02 smithi033 ceph-mon[101165]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1523914779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:07:02.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/816856139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:07:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:02 smithi037 ceph-mon[69017]: pgmap v840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:02.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:02 smithi037 ceph-mon[69017]: from='client.34950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:02.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1523914779' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:07:02.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/816856139' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:07:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:03 smithi033 ceph-mon[101165]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:03.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:03 smithi037 ceph-mon[69017]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:04 smithi033 ceph-mon[101165]: pgmap v841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:04 smithi037 ceph-mon[69017]: pgmap v841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:06 smithi033 ceph-mon[101165]: pgmap v842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:06 smithi037 ceph-mon[69017]: pgmap v842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:07.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:07 smithi037 ceph-mon[69017]: pgmap v843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:07.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:07 smithi033 ceph-mon[101165]: pgmap v843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:09.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:09 smithi033 ceph-mon[101165]: pgmap v844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:09.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:09 smithi037 ceph-mon[69017]: pgmap v844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:12.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:11 smithi033 ceph-mon[101165]: pgmap v845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:12.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:11 smithi037 ceph-mon[69017]: pgmap v845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:14.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:13 smithi033 ceph-mon[101165]: pgmap v846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:14.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:13 smithi037 ceph-mon[69017]: pgmap v846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:15 smithi033 ceph-mon[101165]: pgmap v847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:16.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:15 smithi037 ceph-mon[69017]: pgmap v847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:18.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:17 smithi033 ceph-mon[101165]: pgmap v848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:18.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:17 smithi037 ceph-mon[69017]: pgmap v848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:20.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:19 smithi033 ceph-mon[101165]: pgmap v849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:20.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:19 smithi037 ceph-mon[69017]: pgmap v849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:22.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:21 smithi033 ceph-mon[101165]: pgmap v850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:22.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:21 smithi037 ceph-mon[69017]: pgmap v850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:24.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:23 smithi033 ceph-mon[101165]: pgmap v851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:24.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:23 smithi037 ceph-mon[69017]: pgmap v851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:25 smithi033 ceph-mon[101165]: pgmap v852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:25 smithi037 ceph-mon[69017]: pgmap v852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:28.215 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:27 smithi037 ceph-mon[69017]: pgmap v853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:28.224 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:27 smithi033 ceph-mon[101165]: pgmap v853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:07:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:07:29.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:07:29.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:28 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:07:29.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:07:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:07:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:07:29.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:28 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:07:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:29 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:07:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:29 smithi033 ceph-mon[101165]: pgmap v854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:29 smithi033 ceph-mon[101165]: pgmap v855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:30.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:29 smithi033 ceph-mon[101165]: pgmap v856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:30.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:29 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:07:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:29 smithi037 ceph-mon[69017]: pgmap v854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:29 smithi037 ceph-mon[69017]: pgmap v855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:30.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:29 smithi037 ceph-mon[69017]: pgmap v856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:31.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 -- 172.21.15.33:0/1391786919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 msgr2=0x7f3e300f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 --2- 172.21.15.33:0/1391786919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e300f6b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f3e20004660 tx=0x7f3e20009b30).stop 2022-02-02T14:07:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 -- 172.21.15.33:0/1391786919 shutdown_connections 2022-02-02T14:07:31.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 --2- 172.21.15.33:0/1391786919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e300f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 --2- 172.21.15.33:0/1391786919 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e300f6b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 -- 172.21.15.33:0/1391786919 >> 172.21.15.33:0/1391786919 conn(0x7f3e300f1e40 msgr2=0x7f3e300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 -- 172.21.15.33:0/1391786919 shutdown_connections 2022-02-02T14:07:31.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.993+0000 7f3e377e8700 1 -- 172.21.15.33:0/1391786919 wait complete. 2022-02-02T14:07:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 Processor -- start 2022-02-02T14:07:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 -- start start 2022-02-02T14:07:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:31.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e301074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30107a50 con 0x7f3e300f66e0 2022-02-02T14:07:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e377e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e30107b90 con 0x7f3e300f7980 2022-02-02T14:07:32.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e35584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e35584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59656/0 (socket says 172.21.15.33:59656) 2022-02-02T14:07:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e35584700 1 -- 172.21.15.33:0/3965579756 learned_addr learned my addr 172.21.15.33:0/3965579756 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.994+0000 7f3e34d83700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e301074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e35584700 1 -- 172.21.15.33:0/3965579756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 msgr2=0x7f3e301074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e35584700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e301074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e35584700 1 -- 172.21.15.33:0/3965579756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e20005040 con 0x7f3e300f66e0 2022-02-02T14:07:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e34d83700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e301074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:07:32.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e35584700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3e20009830 tx=0x7f3e20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e20018070 con 0x7f3e300f66e0 2022-02-02T14:07:32.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e301084d0 con 0x7f3e300f66e0 2022-02-02T14:07:32.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e20007ba0 con 0x7f3e300f66e0 2022-02-02T14:07:32.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e2001c620 con 0x7f3e300f66e0 2022-02-02T14:07:32.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.995+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e30108a30 con 0x7f3e300f66e0 2022-02-02T14:07:32.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.997+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e30045ad0 con 0x7f3e300f66e0 2022-02-02T14:07:32.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.997+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e20007d10 con 0x7f3e300f66e0 2022-02-02T14:07:32.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.997+0000 7f3e25ffb700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 0x7f3e1c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.997+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e20083920 con 0x7f3e300f66e0 2022-02-02T14:07:32.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.998+0000 7f3e34d83700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 0x7f3e1c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:31.998+0000 7f3e34d83700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 0x7f3e1c067270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f3e2c009740 tx=0x7f3e2c009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.002+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e20055340 con 0x7f3e300f66e0 2022-02-02T14:07:32.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.191+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e300fefb0 con 0x7f3e1c064db0 2022-02-02T14:07:32.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.192+0000 7f3e25ffb700 1 -- 172.21.15.33:0/3965579756 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3e300fefb0 con 0x7f3e1c064db0 2022-02-02T14:07:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 msgr2=0x7f3e1c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 0x7f3e1c067270 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f3e2c009740 tx=0x7f3e2c009be0).stop 2022-02-02T14:07:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 msgr2=0x7f3e30106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3e20009830 tx=0x7f3e20009b30).stop 2022-02-02T14:07:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 shutdown_connections 2022-02-02T14:07:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e1c064db0 0x7f3e1c067270 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e300f66e0 0x7f3e30106fb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 --2- 172.21.15.33:0/3965579756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e300f7980 0x7f3e301074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 >> 172.21.15.33:0/3965579756 conn(0x7f3e300f1e40 msgr2=0x7f3e300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:32.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 shutdown_connections 2022-02-02T14:07:32.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.194+0000 7f3e377e8700 1 -- 172.21.15.33:0/3965579756 wait complete. 2022-02-02T14:07:32.204 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:07:32.239 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:31 smithi033 ceph-mon[101165]: pgmap v857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:32.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:31 smithi037 ceph-mon[69017]: pgmap v857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 -- 172.21.15.33:0/2570663431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 msgr2=0x7f9c480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/2570663431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c480f7de0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f9c3c004660 tx=0x7f9c3c009b30).stop 2022-02-02T14:07:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 -- 172.21.15.33:0/2570663431 shutdown_connections 2022-02-02T14:07:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/2570663431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c480f7de0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/2570663431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 0x7f9c480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 -- 172.21.15.33:0/2570663431 >> 172.21.15.33:0/2570663431 conn(0x7f9c480f1e40 msgr2=0x7f9c480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 -- 172.21.15.33:0/2570663431 shutdown_connections 2022-02-02T14:07:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.295+0000 7f9c4fc79700 1 -- 172.21.15.33:0/2570663431 wait complete. 2022-02-02T14:07:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 Processor -- start 2022-02-02T14:07:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 -- start start 2022-02-02T14:07:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 0x7f9c4806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4806a380 con 0x7f9c480f7980 2022-02-02T14:07:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4fc79700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4806a4c0 con 0x7f9c480f66e0 2022-02-02T14:07:32.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59668/0 (socket says 172.21.15.33:59668) 2022-02-02T14:07:32.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 -- 172.21.15.33:0/3177612972 learned_addr learned my addr 172.21.15.33:0/3177612972 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:32.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4da15700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 0x7f9c4806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 -- 172.21.15.33:0/3177612972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 msgr2=0x7f9c4806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 0x7f9c4806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 -- 172.21.15.33:0/3177612972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c005040 con 0x7f9c480f7980 2022-02-02T14:07:32.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.296+0000 7f9c4d214700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9c3c000c00 tx=0x7f9c3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.297+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c019070 con 0x7f9c480f7980 2022-02-02T14:07:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.297+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c3c007e70 con 0x7f9c480f7980 2022-02-02T14:07:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.297+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4806a740 con 0x7f9c480f7980 2022-02-02T14:07:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.297+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3c014ce0 con 0x7f9c480f7980 2022-02-02T14:07:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.297+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4806aca0 con 0x7f9c480f7980 2022-02-02T14:07:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.298+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c48045ad0 con 0x7f9c480f7980 2022-02-02T14:07:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.298+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c3c025070 con 0x7f9c480f7980 2022-02-02T14:07:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.298+0000 7f9c3a7fc700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 0x7f9c34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.299+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c3c082a30 con 0x7f9c480f7980 2022-02-02T14:07:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.299+0000 7f9c4da15700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 0x7f9c34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.299+0000 7f9c4da15700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 0x7f9c34067290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9c4806b730 tx=0x7f9c4400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.303+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c3c050ae0 con 0x7f9c480f7980 2022-02-02T14:07:32.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.483+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c48057f10 con 0x7f9c34064dd0 2022-02-02T14:07:32.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.498+0000 7f9c3a7fc700 1 -- 172.21.15.33:0/3177612972 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9c48057f10 con 0x7f9c34064dd0 2022-02-02T14:07:32.499 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:07:32.499 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (32m) 5m ago 33m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:07:32.499 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (25m) 5m ago 33m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:07:32.500 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (25m) 5m ago 33m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:07:32.500 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (32m) 5m ago 33m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:07:32.500 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (26m) 5m ago 30m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:07:32.501 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (26m) 5m ago 29m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:07:32.501 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (27m) 5m ago 30m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:07:32.501 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (30m) 5m ago 29m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:07:32.501 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (27m) 5m ago 35m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:07:32.501 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (26m) 5m ago 33m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:07:32.502 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (26m) 5m ago 35m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:07:32.502 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (26m) 5m ago 33m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:07:32.502 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (33m) 5m ago 33m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:07:32.502 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (33m) 5m ago 33m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:07:32.504 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 32m - 4096M 2022-02-02T14:07:32.504 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (32m) 5m ago 32m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:07:32.504 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (31m) 5m ago 31m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:07:32.505 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (31m) 5m ago 31m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:07:32.505 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (31m) 5m ago 31m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:07:32.505 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (31m) 5m ago 31m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:07:32.506 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (32m) 5m ago 33m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:07:32.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.499+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 msgr2=0x7f9c34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.499+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 0x7f9c34067290 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f9c4806b730 tx=0x7f9c4400b040).stop 2022-02-02T14:07:32.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.499+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 msgr2=0x7f9c48069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.499+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f9c3c000c00 tx=0x7f9c3c00b040).stop 2022-02-02T14:07:32.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.499+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 shutdown_connections 2022-02-02T14:07:32.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c34064dd0 0x7f9c34067290 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c480f66e0 0x7f9c4806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 --2- 172.21.15.33:0/3177612972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c480f7980 0x7f9c48069e20 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 >> 172.21.15.33:0/3177612972 conn(0x7f9c480f1e40 msgr2=0x7f9c480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:32.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 shutdown_connections 2022-02-02T14:07:32.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.500+0000 7f9c4fc79700 1 -- 172.21.15.33:0/3177612972 wait complete. 2022-02-02T14:07:32.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/2018043418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 msgr2=0x7f8c9c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/2018043418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c0f6b00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f8c900045a0 tx=0x7f8c90009b30).stop 2022-02-02T14:07:32.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/2018043418 shutdown_connections 2022-02-02T14:07:32.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/2018043418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 0x7f8c9c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/2018043418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c0f6b00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/2018043418 >> 172.21.15.33:0/2018043418 conn(0x7f8c9c0f1e40 msgr2=0x7f8c9c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:32.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/2018043418 shutdown_connections 2022-02-02T14:07:32.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.599+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/2018043418 wait complete. 2022-02-02T14:07:32.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 Processor -- start 2022-02-02T14:07:32.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 -- start start 2022-02-02T14:07:32.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 0x7f8c9c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c107a00 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.600+0000 7f8ca2d4a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c107b40 con 0x7f8c9c0f7980 2022-02-02T14:07:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59676/0 (socket says 172.21.15.33:59676) 2022-02-02T14:07:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 -- 172.21.15.33:0/1181643163 learned_addr learned my addr 172.21.15.33:0/1181643163 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8c9bfff700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 0x7f8c9c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 -- 172.21.15.33:0/1181643163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 msgr2=0x7f8c9c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 0x7f8c9c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 -- 172.21.15.33:0/1181643163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c88005040 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca0ae6700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f8c900134f0 tx=0x7f8c9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c9000e070 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c90005040 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c1087d0 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.601+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c900097d0 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.602+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c90019070 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.603+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c004fa0 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.603+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c90025070 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.603+0000 7f8c997fa700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 0x7f8c8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.604+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8c90082640 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.604+0000 7f8c9bfff700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 0x7f8c8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.604+0000 7f8c9bfff700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 0x7f8c8c067290 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f8c88009da0 tx=0x7f8c88009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.608+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c90054120 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.852+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c7c005e80 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.853+0000 7f8c997fa700 1 -- 172.21.15.33:0/1181643163 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8c90023070 con 0x7f8c9c0f66e0 2022-02-02T14:07:32.990 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:07:32.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:07:32.990 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:07:32.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:32.991 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:07:32.991 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:07:32.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:32.992 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:07:32.992 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:07:32.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:32.992 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:07:32.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:07:32.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:07:32.993 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:07:32.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:07:32.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:07:32.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:07:32.994 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:07:32.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 msgr2=0x7f8c8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 0x7f8c8c067290 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f8c88009da0 tx=0x7f8c88009b30).stop 2022-02-02T14:07:32.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 msgr2=0x7f8c9c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:32.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f8c900134f0 tx=0x7f8c9000b040).stop 2022-02-02T14:07:32.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 shutdown_connections 2022-02-02T14:07:32.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c8c064dd0 0x7f8c8c067290 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c9c0f66e0 0x7f8c9c106f60 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:32.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 --2- 172.21.15.33:0/1181643163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c9c0f7980 0x7f8c9c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 >> 172.21.15.33:0/1181643163 conn(0x7f8c9c0f1e40 msgr2=0x7f8c9c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:33.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 shutdown_connections 2022-02-02T14:07:33.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.855+0000 7f8ca2d4a700 1 -- 172.21.15.33:0/1181643163 wait complete. 2022-02-02T14:07:33.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.955+0000 7f5c9a474700 1 -- 172.21.15.33:0/1704092470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f55c0 msgr2=0x7f5c940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:33.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.955+0000 7f5c9a474700 1 --2- 172.21.15.33:0/1704092470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f55c0 0x7f5c940f59e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f5c84004660 tx=0x7f5c84009b30).stop 2022-02-02T14:07:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.955+0000 7f5c9a474700 1 -- 172.21.15.33:0/1704092470 shutdown_connections 2022-02-02T14:07:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.955+0000 7f5c9a474700 1 --2- 172.21.15.33:0/1704092470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f6860 0x7f5c940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.955+0000 7f5c9a474700 1 --2- 172.21.15.33:0/1704092470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f55c0 0x7f5c940f59e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.956+0000 7f5c9a474700 1 -- 172.21.15.33:0/1704092470 >> 172.21.15.33:0/1704092470 conn(0x7f5c940f0d40 msgr2=0x7f5c940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.956+0000 7f5c9a474700 1 -- 172.21.15.33:0/1704092470 shutdown_connections 2022-02-02T14:07:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.956+0000 7f5c9a474700 1 -- 172.21.15.33:0/1704092470 wait complete. 2022-02-02T14:07:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.956+0000 7f5c9a474700 1 Processor -- start 2022-02-02T14:07:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c9a474700 1 -- start start 2022-02-02T14:07:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c9a474700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f55c0 0x7f5c94109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c9a474700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c9a474700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940603c0 con 0x7f5c940f6860 2022-02-02T14:07:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c9a474700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94060500 con 0x7f5c940f55c0 2022-02-02T14:07:33.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:33.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59686/0 (socket says 172.21.15.33:59686) 2022-02-02T14:07:33.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 -- 172.21.15.33:0/46408861 learned_addr learned my addr 172.21.15.33:0/46408861 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:07:33.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c93fff700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f55c0 0x7f5c94109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:33.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 -- 172.21.15.33:0/46408861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f55c0 msgr2=0x7f5c94109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:33.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f55c0 0x7f5c94109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 -- 172.21.15.33:0/46408861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84005040 con 0x7f5c940f6860 2022-02-02T14:07:33.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.957+0000 7f5c937fe700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f5c880026d0 tx=0x7f5c88009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:33.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.958+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c880079c0 con 0x7f5c940f6860 2022-02-02T14:07:33.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.958+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c9410c740 con 0x7f5c940f6860 2022-02-02T14:07:33.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.958+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c8800f040 con 0x7f5c940f6860 2022-02-02T14:07:33.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.958+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c880148b0 con 0x7f5c940f6860 2022-02-02T14:07:33.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.958+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9410ccd0 con 0x7f5c940f6860 2022-02-02T14:07:33.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.959+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c940f49b0 con 0x7f5c940f6860 2022-02-02T14:07:33.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.959+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c88007b20 con 0x7f5c940f6860 2022-02-02T14:07:33.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.960+0000 7f5c90ff9700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 0x7f5c7c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:07:33.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.960+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5c88081b20 con 0x7f5c940f6860 2022-02-02T14:07:33.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.960+0000 7f5c93fff700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 0x7f5c7c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:07:33.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.960+0000 7f5c93fff700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 0x7f5c7c067290 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f5c84013690 tx=0x7f5c84009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:07:33.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:32.965+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c8804fb10 con 0x7f5c940f6860 2022-02-02T14:07:33.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.177+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5c94045ad0 con 0x7f5c940f6860 2022-02-02T14:07:33.179 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:32 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1181643163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:07:33.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.178+0000 7f5c90ff9700 1 -- 172.21.15.33:0/46408861 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f5c88053130 con 0x7f5c940f6860 2022-02-02T14:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:07:33.180 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:07:33.181 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:07:33.182 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:07:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:07:33.184 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:07:33.185 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:07:33.186 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:07:33.187 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:33.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:33.189 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:07:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 msgr2=0x7f5c7c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 0x7f5c7c067290 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f5c84013690 tx=0x7f5c84009b30).stop 2022-02-02T14:07:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 msgr2=0x7f5c9410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:07:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f5c880026d0 tx=0x7f5c88009de0).stop 2022-02-02T14:07:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 shutdown_connections 2022-02-02T14:07:33.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c7c064dd0 0x7f5c7c067290 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c940f55c0 0x7f5c94109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 --2- 172.21.15.33:0/46408861 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c940f6860 0x7f5c9410c190 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:07:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 >> 172.21.15.33:0/46408861 conn(0x7f5c940f0d40 msgr2=0x7f5c940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:07:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 shutdown_connections 2022-02-02T14:07:33.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:07:33.180+0000 7f5c9a474700 1 -- 172.21.15.33:0/46408861 wait complete. 2022-02-02T14:07:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:07:33.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:32 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1181643163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:07:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:33 smithi033 ceph-mon[101165]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:33 smithi033 ceph-mon[101165]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:33 smithi033 ceph-mon[101165]: pgmap v858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:34.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/46408861' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:07:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:33 smithi037 ceph-mon[69017]: from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:33 smithi037 ceph-mon[69017]: from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:07:34.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:33 smithi037 ceph-mon[69017]: pgmap v858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:34.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/46408861' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:07:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:35 smithi033 ceph-mon[101165]: pgmap v859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:36.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:35 smithi037 ceph-mon[69017]: pgmap v859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:37 smithi033 ceph-mon[101165]: pgmap v860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:38.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:37 smithi037 ceph-mon[69017]: pgmap v860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:39 smithi033 ceph-mon[101165]: pgmap v861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:39 smithi037 ceph-mon[69017]: pgmap v861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:41 smithi033 ceph-mon[101165]: pgmap v862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:41 smithi037 ceph-mon[69017]: pgmap v862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:44.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:43 smithi033 ceph-mon[101165]: pgmap v863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:44.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:43 smithi037 ceph-mon[69017]: pgmap v863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:45 smithi033 ceph-mon[101165]: pgmap v864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:45 smithi037 ceph-mon[69017]: pgmap v864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:47 smithi037 ceph-mon[69017]: pgmap v865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:47 smithi033 ceph-mon[101165]: pgmap v865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:50.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:49 smithi037 ceph-mon[69017]: pgmap v866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:49 smithi033 ceph-mon[101165]: pgmap v866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:52.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:52 smithi037 ceph-mon[69017]: pgmap v867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:51 smithi033 ceph-mon[101165]: pgmap v867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:54.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:54 smithi037 ceph-mon[69017]: pgmap v868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:54 smithi033 ceph-mon[101165]: pgmap v868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:07:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:07:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:07:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:07:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:56 smithi033 ceph-mon[101165]: pgmap v869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:56 smithi037 ceph-mon[69017]: pgmap v869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:07:58 smithi037 ceph-mon[69017]: pgmap v870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:07:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:07:58 smithi033 ceph-mon[101165]: pgmap v870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:00 smithi037 ceph-mon[69017]: pgmap v871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:00 smithi033 ceph-mon[101165]: pgmap v871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:02.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:02 smithi037 ceph-mon[69017]: pgmap v872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:02 smithi033 ceph-mon[101165]: pgmap v872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 -- 172.21.15.33:0/1017399432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 msgr2=0x7f1a040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 --2- 172.21.15.33:0/1017399432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a040f6b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f19f4004660 tx=0x7f19f4009b30).stop 2022-02-02T14:08:03.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 -- 172.21.15.33:0/1017399432 shutdown_connections 2022-02-02T14:08:03.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 --2- 172.21.15.33:0/1017399432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 --2- 172.21.15.33:0/1017399432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a040f6b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 -- 172.21.15.33:0/1017399432 >> 172.21.15.33:0/1017399432 conn(0x7f1a040f1e40 msgr2=0x7f1a040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:03.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 -- 172.21.15.33:0/1017399432 shutdown_connections 2022-02-02T14:08:03.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.297+0000 7f1a0c593700 1 -- 172.21.15.33:0/1017399432 wait complete. 2022-02-02T14:08:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 Processor -- start 2022-02-02T14:08:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 -- start start 2022-02-02T14:08:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a041074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04107a50 con 0x7f1a040f66e0 2022-02-02T14:08:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0c593700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a04107b90 con 0x7f1a040f7980 2022-02-02T14:08:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59694/0 (socket says 172.21.15.33:59694) 2022-02-02T14:08:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 -- 172.21.15.33:0/2151734505 learned_addr learned my addr 172.21.15.33:0/2151734505 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 -- 172.21.15.33:0/2151734505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 msgr2=0x7f1a041074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a09b2e700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a041074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a041074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a0a32f700 1 -- 172.21.15.33:0/2151734505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4005040 con 0x7f1a040f66e0 2022-02-02T14:08:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.298+0000 7f1a09b2e700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a041074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:08:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f1a0a32f700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f19f4013a70 tx=0x7f19f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f4018070 con 0x7f1a040f66e0 2022-02-02T14:08:03.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19f40097d0 con 0x7f1a040f66e0 2022-02-02T14:08:03.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a041084d0 con 0x7f1a040f66e0 2022-02-02T14:08:03.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f401c3c0 con 0x7f1a040f66e0 2022-02-02T14:08:03.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.299+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a04108a30 con 0x7f1a040f66e0 2022-02-02T14:08:03.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.300+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a04045ad0 con 0x7f1a040f66e0 2022-02-02T14:08:03.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.300+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19f4007ba0 con 0x7f1a040f66e0 2022-02-02T14:08:03.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.301+0000 7f19faffd700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 0x7f19f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.301+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f19f4083730 con 0x7f1a040f66e0 2022-02-02T14:08:03.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.301+0000 7f1a09b2e700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 0x7f19f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.302+0000 7f1a09b2e700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 0x7f19f0067290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f1a00009fd0 tx=0x7f1a0000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.305+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19f40552d0 con 0x7f1a040f66e0 2022-02-02T14:08:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.495+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a040fefb0 con 0x7f19f0064dd0 2022-02-02T14:08:03.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.496+0000 7f19faffd700 1 -- 172.21.15.33:0/2151734505 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1a040fefb0 con 0x7f19f0064dd0 2022-02-02T14:08:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 msgr2=0x7f19f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 0x7f19f0067290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f1a00009fd0 tx=0x7f1a0000b040).stop 2022-02-02T14:08:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 msgr2=0x7f1a04106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f19f4013a70 tx=0x7f19f4009b30).stop 2022-02-02T14:08:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 shutdown_connections 2022-02-02T14:08:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19f0064dd0 0x7f19f0067290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a040f66e0 0x7f1a04106fb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 --2- 172.21.15.33:0/2151734505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a040f7980 0x7f1a041074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 >> 172.21.15.33:0/2151734505 conn(0x7f1a040f1e40 msgr2=0x7f1a040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 shutdown_connections 2022-02-02T14:08:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.498+0000 7f1a0c593700 1 -- 172.21.15.33:0/2151734505 wait complete. 2022-02-02T14:08:03.507 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:08:03.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.598+0000 7fe84b240700 1 -- 172.21.15.33:0/3682238389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f7980 msgr2=0x7fe8440f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.598+0000 7fe84b240700 1 --2- 172.21.15.33:0/3682238389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f7980 0x7fe8440f7de0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fe830004660 tx=0x7fe830009b30).stop 2022-02-02T14:08:03.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 -- 172.21.15.33:0/3682238389 shutdown_connections 2022-02-02T14:08:03.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 --2- 172.21.15.33:0/3682238389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f7980 0x7fe8440f7de0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 --2- 172.21.15.33:0/3682238389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f66e0 0x7fe8440f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 -- 172.21.15.33:0/3682238389 >> 172.21.15.33:0/3682238389 conn(0x7fe8440f1e40 msgr2=0x7fe8440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:03.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 -- 172.21.15.33:0/3682238389 shutdown_connections 2022-02-02T14:08:03.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 -- 172.21.15.33:0/3682238389 wait complete. 2022-02-02T14:08:03.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 Processor -- start 2022-02-02T14:08:03.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.599+0000 7fe84b240700 1 -- start start 2022-02-02T14:08:03.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe84b240700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe84b240700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f7980 0x7fe844069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe84b240700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84406a380 con 0x7fe8440f66e0 2022-02-02T14:08:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe84b240700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84406a4c0 con 0x7fe8440f7980 2022-02-02T14:08:03.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59704/0 (socket says 172.21.15.33:59704) 2022-02-02T14:08:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 -- 172.21.15.33:0/112633649 learned_addr learned my addr 172.21.15.33:0/112633649 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe843fff700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f7980 0x7fe844069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 -- 172.21.15.33:0/112633649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f7980 msgr2=0x7fe844069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f7980 0x7fe844069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.600+0000 7fe848fdc700 1 -- 172.21.15.33:0/112633649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830005040 con 0x7fe8440f66e0 2022-02-02T14:08:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe848fdc700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe838002700 tx=0x7fe838009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8380079c0 con 0x7fe8440f66e0 2022-02-02T14:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe83800f040 con 0x7fe8440f66e0 2022-02-02T14:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84406a7a0 con 0x7fe8440f66e0 2022-02-02T14:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84410ef90 con 0x7fe8440f66e0 2022-02-02T14:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.601+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe838014860 con 0x7fe8440f66e0 2022-02-02T14:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.602+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe844045ad0 con 0x7fe8440f66e0 2022-02-02T14:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.603+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe83801b060 con 0x7fe8440f66e0 2022-02-02T14:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.603+0000 7fe8417fa700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 0x7fe834067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.603+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe838081840 con 0x7fe8440f66e0 2022-02-02T14:08:03.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.603+0000 7fe843fff700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 0x7fe834067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.604+0000 7fe843fff700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 0x7fe834067290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe830004630 tx=0x7fe830009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.607+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe83804f8f0 con 0x7fe8440f66e0 2022-02-02T14:08:03.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.791+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe844057f10 con 0x7fe834064dd0 2022-02-02T14:08:03.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.805+0000 7fe8417fa700 1 -- 172.21.15.33:0/112633649 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe844057f10 con 0x7fe834064dd0 2022-02-02T14:08:03.805 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:08:03.805 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (33m) 5m ago 34m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:08:03.805 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (26m) 5m ago 34m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:08:03.806 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (26m) 5m ago 33m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:08:03.806 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (33m) 5m ago 34m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:08:03.806 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (26m) 5m ago 30m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:08:03.806 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (27m) 5m ago 30m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:08:03.807 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (28m) 5m ago 30m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:08:03.808 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (30m) 5m ago 30m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:08:03.808 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (27m) 5m ago 35m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:08:03.808 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (27m) 5m ago 33m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:08:03.808 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (27m) 5m ago 35m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:08:03.809 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (26m) 5m ago 33m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:08:03.809 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (34m) 5m ago 34m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:08:03.809 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (33m) 5m ago 33m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:08:03.811 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 33m - 4096M 2022-02-02T14:08:03.812 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (32m) 5m ago 32m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:08:03.812 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (32m) 5m ago 32m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:08:03.812 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (32m) 5m ago 32m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:08:03.812 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (31m) 5m ago 31m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:08:03.813 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (31m) 5m ago 31m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:08:03.813 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (33m) 5m ago 33m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:08:03.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 msgr2=0x7fe834067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 0x7fe834067290 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fe830004630 tx=0x7fe830009b30).stop 2022-02-02T14:08:03.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 msgr2=0x7fe84406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fe838002700 tx=0x7fe838009d80).stop 2022-02-02T14:08:03.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 shutdown_connections 2022-02-02T14:08:03.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe834064dd0 0x7fe834067290 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8440f66e0 0x7fe84406b9a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 --2- 172.21.15.33:0/112633649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8440f7980 0x7fe844069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 >> 172.21.15.33:0/112633649 conn(0x7fe8440f1e40 msgr2=0x7fe8440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:03.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 shutdown_connections 2022-02-02T14:08:03.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.807+0000 7fe84b240700 1 -- 172.21.15.33:0/112633649 wait complete. 2022-02-02T14:08:03.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 -- 172.21.15.33:0/2738168097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 msgr2=0x7f2db40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/2738168097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db40f6b00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f2da4004660 tx=0x7f2da4009b30).stop 2022-02-02T14:08:03.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 -- 172.21.15.33:0/2738168097 shutdown_connections 2022-02-02T14:08:03.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/2738168097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/2738168097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db40f6b00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 -- 172.21.15.33:0/2738168097 >> 172.21.15.33:0/2738168097 conn(0x7f2db40f1e40 msgr2=0x7f2db40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:03.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 -- 172.21.15.33:0/2738168097 shutdown_connections 2022-02-02T14:08:03.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.907+0000 7f2dbc43a700 1 -- 172.21.15.33:0/2738168097 wait complete. 2022-02-02T14:08:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 Processor -- start 2022-02-02T14:08:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 -- start start 2022-02-02T14:08:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db406a380 con 0x7f2db40f66e0 2022-02-02T14:08:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dbc43a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db406a4c0 con 0x7f2db40f7980 2022-02-02T14:08:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dba1d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dba1d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59712/0 (socket says 172.21.15.33:59712) 2022-02-02T14:08:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2dba1d6700 1 -- 172.21.15.33:0/4060956065 learned_addr learned my addr 172.21.15.33:0/4060956065 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.908+0000 7f2db99d5700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dba1d6700 1 -- 172.21.15.33:0/4060956065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 msgr2=0x7f2db4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dba1d6700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db4069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dba1d6700 1 -- 172.21.15.33:0/4060956065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da4005040 con 0x7f2db40f66e0 2022-02-02T14:08:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2db99d5700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:08:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dba1d6700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f2da4004f60 tx=0x7f2da4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da4018070 con 0x7f2db40f66e0 2022-02-02T14:08:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db406a740 con 0x7f2db40f66e0 2022-02-02T14:08:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2da4007ba0 con 0x7f2db40f66e0 2022-02-02T14:08:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2da401c620 con 0x7f2db40f66e0 2022-02-02T14:08:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.909+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db406aca0 con 0x7f2db40f66e0 2022-02-02T14:08:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.910+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db4045ad0 con 0x7f2db40f66e0 2022-02-02T14:08:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.911+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2da401c8e0 con 0x7f2db40f66e0 2022-02-02T14:08:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.911+0000 7f2daaffd700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 0x7f2da0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.911+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2da40839b0 con 0x7f2db40f66e0 2022-02-02T14:08:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.912+0000 7f2db99d5700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 0x7f2da0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.912+0000 7f2db99d5700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 0x7f2da0067290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2db00041d0 tx=0x7f2db0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:03.916+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2da4051a60 con 0x7f2db40f66e0 2022-02-02T14:08:04.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.161+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2db40586e0 con 0x7f2db40f66e0 2022-02-02T14:08:04.162 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:04 smithi033 ceph-mon[101165]: pgmap v873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:04.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.161+0000 7f2daaffd700 1 -- 172.21.15.33:0/4060956065 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2da4055080 con 0x7f2db40f66e0 2022-02-02T14:08:04.164 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:08:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:08:04.164 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:08:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:04.165 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:08:04.166 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:08:04.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:04.167 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:08:04.167 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:08:04.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:04.168 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:08:04.169 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:08:04.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:04.169 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:08:04.170 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:08:04.171 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:08:04.171 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:08:04.172 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:08:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 msgr2=0x7f2da0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 0x7f2da0067290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f2db00041d0 tx=0x7f2db0009040).stop 2022-02-02T14:08:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 msgr2=0x7f2db406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f2da4004f60 tx=0x7f2da4009b30).stop 2022-02-02T14:08:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 shutdown_connections 2022-02-02T14:08:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2da0064dd0 0x7f2da0067290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2db40f66e0 0x7f2db406b9a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 --2- 172.21.15.33:0/4060956065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2db40f7980 0x7f2db4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 >> 172.21.15.33:0/4060956065 conn(0x7f2db40f1e40 msgr2=0x7f2db40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 shutdown_connections 2022-02-02T14:08:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.164+0000 7f2dbc43a700 1 -- 172.21.15.33:0/4060956065 wait complete. 2022-02-02T14:08:04.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 -- 172.21.15.33:0/2601828896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f4d60 msgr2=0x7fafbc0f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 --2- 172.21.15.33:0/2601828896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f4d60 0x7fafbc0f5180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fafa4004660 tx=0x7fafa4009b30).stop 2022-02-02T14:08:04.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 -- 172.21.15.33:0/2601828896 shutdown_connections 2022-02-02T14:08:04.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 --2- 172.21.15.33:0/2601828896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f5f60 0x7fafbc0f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 --2- 172.21.15.33:0/2601828896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f4d60 0x7fafbc0f5180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 -- 172.21.15.33:0/2601828896 >> 172.21.15.33:0/2601828896 conn(0x7fafbc0f04c0 msgr2=0x7fafbc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:04.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 -- 172.21.15.33:0/2601828896 shutdown_connections 2022-02-02T14:08:04.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.265+0000 7fafc13d5700 1 -- 172.21.15.33:0/2601828896 wait complete. 2022-02-02T14:08:04.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 Processor -- start 2022-02-02T14:08:04.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 -- start start 2022-02-02T14:08:04.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 0x7fafbc105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:04.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc106950 con 0x7fafbc0f5f60 2022-02-02T14:08:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafc13d5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc107150 con 0x7fafbc0f4d60 2022-02-02T14:08:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafba7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:04.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafba7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59724/0 (socket says 172.21.15.33:59724) 2022-02-02T14:08:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.266+0000 7fafba7fc700 1 -- 172.21.15.33:0/4180654720 learned_addr learned my addr 172.21.15.33:0/4180654720 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafbaffd700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 0x7fafbc105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafba7fc700 1 -- 172.21.15.33:0/4180654720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 msgr2=0x7fafbc105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafba7fc700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 0x7fafbc105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafba7fc700 1 -- 172.21.15.33:0/4180654720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa4005040 con 0x7fafbc0f5f60 2022-02-02T14:08:04.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafbaffd700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 0x7fafbc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:08:04.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafba7fc700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fafac010a00 tx=0x7fafac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:04.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafac0094c0 con 0x7fafbc0f5f60 2022-02-02T14:08:04.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc1073d0 con 0x7fafbc0f5f60 2022-02-02T14:08:04.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fafac009620 con 0x7fafbc0f5f60 2022-02-02T14:08:04.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafac007e50 con 0x7fafbc0f5f60 2022-02-02T14:08:04.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.267+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc107940 con 0x7fafbc0f5f60 2022-02-02T14:08:04.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.268+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0f4150 con 0x7fafbc0f5f60 2022-02-02T14:08:04.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.269+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fafac022070 con 0x7fafbc0f5f60 2022-02-02T14:08:04.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.269+0000 7fafb37fe700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 0x7fafa8067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:04.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.269+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fafac084400 con 0x7fafbc0f5f60 2022-02-02T14:08:04.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.269+0000 7fafbaffd700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 0x7fafa8067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:04.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.270+0000 7fafbaffd700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 0x7fafa8067230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fafa4004d80 tx=0x7fafa400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:04.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.273+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fafac055ee0 con 0x7fafbc0f5f60 2022-02-02T14:08:04.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:04 smithi037 ceph-mon[69017]: pgmap v873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:04.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.489+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fafbc0f7210 con 0x7fafbc0f5f60 2022-02-02T14:08:04.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.489+0000 7fafb37fe700 1 -- 172.21.15.33:0/4180654720 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fafac016750 con 0x7fafbc0f5f60 2022-02-02T14:08:04.492 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:08:04.492 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:08:04.493 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:08:04.493 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:08:04.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:04.493 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:08:04.494 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:08:04.494 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:08:04.494 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:08:04.494 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:08:04.495 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:08:04.495 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:08:04.495 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:08:04.495 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:08:04.496 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:08:04.496 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:08:04.496 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:08:04.496 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:08:04.496 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:04.501 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:04.501 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:04.502 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 msgr2=0x7fafa8067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 0x7fafa8067230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fafa4004d80 tx=0x7fafa400b040).stop 2022-02-02T14:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 msgr2=0x7fafbc1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fafac010a00 tx=0x7fafac00b040).stop 2022-02-02T14:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 shutdown_connections 2022-02-02T14:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafa8064d70 0x7fafa8067230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafbc0f4d60 0x7fafbc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 --2- 172.21.15.33:0/4180654720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafbc0f5f60 0x7fafbc1063a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 >> 172.21.15.33:0/4180654720 conn(0x7fafbc0f04c0 msgr2=0x7fafbc0fa330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:04.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 shutdown_connections 2022-02-02T14:08:04.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:04.493+0000 7fafc13d5700 1 -- 172.21.15.33:0/4180654720 wait complete. 2022-02-02T14:08:04.505 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:08:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:05 smithi037 ceph-mon[69017]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:05 smithi037 ceph-mon[69017]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4060956065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:08:05.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4180654720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:08:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:05 smithi033 ceph-mon[101165]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:05 smithi033 ceph-mon[101165]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4060956065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:08:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4180654720' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:08:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:06 smithi033 ceph-mon[101165]: pgmap v874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:06.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:06 smithi037 ceph-mon[69017]: pgmap v874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:08.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:08 smithi037 ceph-mon[69017]: pgmap v875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:08 smithi033 ceph-mon[101165]: pgmap v875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:10.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:10 smithi037 ceph-mon[69017]: pgmap v876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:10 smithi033 ceph-mon[101165]: pgmap v876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:12.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:12 smithi037 ceph-mon[69017]: pgmap v877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:12 smithi033 ceph-mon[101165]: pgmap v877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:14.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:14 smithi033 ceph-mon[101165]: pgmap v878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:14 smithi037 ceph-mon[69017]: pgmap v878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:16 smithi033 ceph-mon[101165]: pgmap v879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:16 smithi037 ceph-mon[69017]: pgmap v879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:18 smithi033 ceph-mon[101165]: pgmap v880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:18 smithi037 ceph-mon[69017]: pgmap v880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:20 smithi033 ceph-mon[101165]: pgmap v881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:20 smithi037 ceph-mon[69017]: pgmap v881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:22 smithi033 ceph-mon[101165]: pgmap v882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:22 smithi037 ceph-mon[69017]: pgmap v882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:24 smithi033 ceph-mon[101165]: pgmap v883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:24.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:24 smithi037 ceph-mon[69017]: pgmap v883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:26 smithi033 ceph-mon[101165]: pgmap v884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:26 smithi037 ceph-mon[69017]: pgmap v884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:28 smithi033 ceph-mon[101165]: pgmap v885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:28 smithi037 ceph-mon[69017]: pgmap v885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:08:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:08:29.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:08:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:08:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:08:29.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:08:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:30 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:08:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:30 smithi033 ceph-mon[101165]: pgmap v886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:30 smithi033 ceph-mon[101165]: pgmap v887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:30 smithi033 ceph-mon[101165]: pgmap v888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:08:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:30 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:08:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:30 smithi037 ceph-mon[69017]: pgmap v886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:30 smithi037 ceph-mon[69017]: pgmap v887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:30 smithi037 ceph-mon[69017]: pgmap v888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:08:32.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:31 smithi033 ceph-mon[101165]: pgmap v889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:32.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:31 smithi037 ceph-mon[69017]: pgmap v889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:33 smithi033 ceph-mon[101165]: pgmap v890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:33.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:33 smithi037 ceph-mon[69017]: pgmap v890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:34.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 -- 172.21.15.33:0/1167068737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f6860 msgr2=0x7f54780f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 --2- 172.21.15.33:0/1167068737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f6860 0x7f54780f6cc0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f5468004660 tx=0x7f5468009b30).stop 2022-02-02T14:08:34.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 -- 172.21.15.33:0/1167068737 shutdown_connections 2022-02-02T14:08:34.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 --2- 172.21.15.33:0/1167068737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f6860 0x7f54780f6cc0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 --2- 172.21.15.33:0/1167068737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f55c0 0x7f54780f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:08:34.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 -- 172.21.15.33:0/1167068737 >> 172.21.15.33:0/1167068737 conn(0x7f54780f0d40 msgr2=0x7f54780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:34.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 -- 172.21.15.33:0/1167068737 shutdown_connections 2022-02-02T14:08:34.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.608+0000 7f547dafe700 1 -- 172.21.15.33:0/1167068737 wait complete. 2022-02-02T14:08:34.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.609+0000 7f547dafe700 1 Processor -- start 2022-02-02T14:08:34.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.609+0000 7f547dafe700 1 -- start start 2022-02-02T14:08:34.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.609+0000 7f547dafe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.609+0000 7f547dafe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f6860 0x7f547810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.609+0000 7f547dafe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5478060470 con 0x7f54780f55c0 2022-02-02T14:08:34.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f547dafe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54780605b0 con 0x7f54780f6860 2022-02-02T14:08:34.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59732/0 (socket says 172.21.15.33:59732) 2022-02-02T14:08:34.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 -- 172.21.15.33:0/3817838382 learned_addr learned my addr 172.21.15.33:0/3817838382 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:34.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f5476ffd700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f6860 0x7f547810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 -- 172.21.15.33:0/3817838382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f6860 msgr2=0x7f547810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f6860 0x7f547810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 -- 172.21.15.33:0/3817838382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5468005040 con 0x7f54780f55c0 2022-02-02T14:08:34.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f54777fe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f54600093f0 tx=0x7f5460006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:34.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5460013640 con 0x7f54780f55c0 2022-02-02T14:08:34.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547810c810 con 0x7f54780f55c0 2022-02-02T14:08:34.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5460013c50 con 0x7f54780f55c0 2022-02-02T14:08:34.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.610+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5460012c70 con 0x7f54780f55c0 2022-02-02T14:08:34.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.611+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547810cda0 con 0x7f54780f55c0 2022-02-02T14:08:34.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.612+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5478045ad0 con 0x7f54780f55c0 2022-02-02T14:08:34.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.612+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f546001a060 con 0x7f54780f55c0 2022-02-02T14:08:34.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.613+0000 7f546ffff700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 0x7f5464067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.613+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5460081b60 con 0x7f54780f55c0 2022-02-02T14:08:34.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.613+0000 7f5476ffd700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 0x7f5464067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.613+0000 7f5476ffd700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 0x7f5464067290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f5468004630 tx=0x7f5468009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:34.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.618+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f546004faf0 con 0x7f54780f55c0 2022-02-02T14:08:34.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.805+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5478057f10 con 0x7f5464064dd0 2022-02-02T14:08:34.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.806+0000 7f546ffff700 1 -- 172.21.15.33:0/3817838382 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5478057f10 con 0x7f5464064dd0 2022-02-02T14:08:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 msgr2=0x7f5464067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 0x7f5464067290 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f5468004630 tx=0x7f5468009b30).stop 2022-02-02T14:08:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 msgr2=0x7f5478109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f54600093f0 tx=0x7f5460006ec0).stop 2022-02-02T14:08:34.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 shutdown_connections 2022-02-02T14:08:34.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5464064dd0 0x7f5464067290 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54780f55c0 0x7f5478109cb0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 --2- 172.21.15.33:0/3817838382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54780f6860 0x7f547810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 >> 172.21.15.33:0/3817838382 conn(0x7f54780f0d40 msgr2=0x7f54780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:34.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 shutdown_connections 2022-02-02T14:08:34.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.809+0000 7f547dafe700 1 -- 172.21.15.33:0/3817838382 wait complete. 2022-02-02T14:08:34.819 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:08:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.910+0000 7fec3f59e700 1 -- 172.21.15.33:0/155514462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 msgr2=0x7fec400f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.910+0000 7fec3f59e700 1 --2- 172.21.15.33:0/155514462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec400f7c30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fec34004660 tx=0x7fec34009b30).stop 2022-02-02T14:08:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 -- 172.21.15.33:0/155514462 shutdown_connections 2022-02-02T14:08:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 --2- 172.21.15.33:0/155514462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec400f7c30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 --2- 172.21.15.33:0/155514462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 0x7fec400f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 -- 172.21.15.33:0/155514462 >> 172.21.15.33:0/155514462 conn(0x7fec400f1c90 msgr2=0x7fec400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 -- 172.21.15.33:0/155514462 shutdown_connections 2022-02-02T14:08:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 -- 172.21.15.33:0/155514462 wait complete. 2022-02-02T14:08:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 Processor -- start 2022-02-02T14:08:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.911+0000 7fec3f59e700 1 -- start start 2022-02-02T14:08:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 0x7fec40104b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40105600 con 0x7fec400f77d0 2022-02-02T14:08:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec40105740 con 0x7fec400f6530 2022-02-02T14:08:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59744/0 (socket says 172.21.15.33:59744) 2022-02-02T14:08:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 -- 172.21.15.33:0/3226539713 learned_addr learned my addr 172.21.15.33:0/3226539713 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3e59c700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 0x7fec40104b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 -- 172.21.15.33:0/3226539713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 msgr2=0x7fec40104b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 0x7fec40104b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 -- 172.21.15.33:0/3226539713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34005040 con 0x7fec400f77d0 2022-02-02T14:08:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec3dd9b700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fec34009990 tx=0x7fec34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.912+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec34018070 con 0x7fec400f77d0 2022-02-02T14:08:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.913+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec40106050 con 0x7fec400f77d0 2022-02-02T14:08:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.913+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec34007ca0 con 0x7fec400f77d0 2022-02-02T14:08:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.913+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3401c620 con 0x7fec400f77d0 2022-02-02T14:08:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.913+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec401065b0 con 0x7fec400f77d0 2022-02-02T14:08:34.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.914+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40045ad0 con 0x7fec400f77d0 2022-02-02T14:08:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.914+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec3401d960 con 0x7fec400f77d0 2022-02-02T14:08:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.914+0000 7fec2effd700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:34.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.915+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fec34083820 con 0x7fec400f77d0 2022-02-02T14:08:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.915+0000 7fec3e59c700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.915+0000 7fec3e59c700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fec300041d0 tx=0x7fec30009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:34.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:34.919+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec34051a40 con 0x7fec400f77d0 2022-02-02T14:08:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.100+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec4010b1a0 con 0x7fec28064e20 2022-02-02T14:08:35.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.115+0000 7fec2effd700 1 -- 172.21.15.33:0/3226539713 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fec4010b1a0 con 0x7fec28064e20 2022-02-02T14:08:35.115 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:08:35.115 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (33m) 6m ago 34m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:08:35.116 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (26m) 6m ago 34m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:08:35.116 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (26m) 6m ago 34m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:08:35.116 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (33m) 6m ago 34m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:08:35.116 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (27m) 6m ago 31m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:08:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (28m) 6m ago 31m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:08:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (28m) 6m ago 31m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:08:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (31m) 6m ago 31m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:08:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (28m) 6m ago 36m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:08:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (28m) 6m ago 34m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:08:35.118 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (27m) 6m ago 36m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:08:35.118 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (27m) 6m ago 34m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:08:35.118 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (34m) 6m ago 34m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:08:35.118 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (34m) 6m ago 34m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:08:35.119 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 33m - 4096M 2022-02-02T14:08:35.119 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (33m) 6m ago 33m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:08:35.119 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (32m) 6m ago 32m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:08:35.119 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (32m) 6m ago 32m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:08:35.119 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (32m) 6m ago 32m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:08:35.120 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (32m) 6m ago 32m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:08:35.120 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (33m) 6m ago 34m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:08:35.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 msgr2=0x7fec280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fec300041d0 tx=0x7fec30009040).stop 2022-02-02T14:08:35.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 msgr2=0x7fec40105000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fec34009990 tx=0x7fec34009b30).stop 2022-02-02T14:08:35.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 shutdown_connections 2022-02-02T14:08:35.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec400f6530 0x7fec40104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 --2- 172.21.15.33:0/3226539713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f77d0 0x7fec40105000 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 >> 172.21.15.33:0/3226539713 conn(0x7fec400f1c90 msgr2=0x7fec4006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:35.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 shutdown_connections 2022-02-02T14:08:35.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.118+0000 7fec3f59e700 1 -- 172.21.15.33:0/3226539713 wait complete. 2022-02-02T14:08:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 -- 172.21.15.33:0/2757650945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 msgr2=0x7f54300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 --2- 172.21.15.33:0/2757650945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f54300f7de0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f5418004660 tx=0x7f5418009b30).stop 2022-02-02T14:08:35.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 -- 172.21.15.33:0/2757650945 shutdown_connections 2022-02-02T14:08:35.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 --2- 172.21.15.33:0/2757650945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f54300f7de0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 --2- 172.21.15.33:0/2757650945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 0x7f54300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 -- 172.21.15.33:0/2757650945 >> 172.21.15.33:0/2757650945 conn(0x7f54300f1e40 msgr2=0x7f54300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:35.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 -- 172.21.15.33:0/2757650945 shutdown_connections 2022-02-02T14:08:35.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.220+0000 7f5434fbe700 1 -- 172.21.15.33:0/2757650945 wait complete. 2022-02-02T14:08:35.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 Processor -- start 2022-02-02T14:08:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 -- start start 2022-02-02T14:08:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 0x7f543006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543006a380 con 0x7f54300f7980 2022-02-02T14:08:35.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f5434fbe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543006a4c0 con 0x7f54300f66e0 2022-02-02T14:08:35.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59754/0 (socket says 172.21.15.33:59754) 2022-02-02T14:08:35.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 -- 172.21.15.33:0/4263479054 learned_addr learned my addr 172.21.15.33:0/4263479054 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:35.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542e59c700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 0x7f543006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 -- 172.21.15.33:0/4263479054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 msgr2=0x7f543006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 0x7f543006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 -- 172.21.15.33:0/4263479054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5418005040 con 0x7f54300f7980 2022-02-02T14:08:35.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.221+0000 7f542dd9b700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5418009990 tx=0x7f5418009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:35.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.222+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5418018070 con 0x7f54300f7980 2022-02-02T14:08:35.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.222+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543006a740 con 0x7f54300f7980 2022-02-02T14:08:35.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.222+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5418007ca0 con 0x7f54300f7980 2022-02-02T14:08:35.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.222+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f541801c620 con 0x7f54300f7980 2022-02-02T14:08:35.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.222+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543006aca0 con 0x7f54300f7980 2022-02-02T14:08:35.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.223+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5430045ad0 con 0x7f54300f7980 2022-02-02T14:08:35.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.223+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f541801d960 con 0x7f54300f7980 2022-02-02T14:08:35.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.223+0000 7f5426ffd700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 0x7f541c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.224+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5418083820 con 0x7f54300f7980 2022-02-02T14:08:35.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.224+0000 7f542e59c700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 0x7f541c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.224+0000 7f542e59c700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 0x7f541c067290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f543006b730 tx=0x7f5420009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:35.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.228+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5418051a40 con 0x7f54300f7980 2022-02-02T14:08:35.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.475+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5430027a00 con 0x7f54300f7980 2022-02-02T14:08:35.475 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:35 smithi033 ceph-mon[101165]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:35.476 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:35 smithi033 ceph-mon[101165]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:35.476 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:35 smithi033 ceph-mon[101165]: pgmap v891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:35.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.476+0000 7f5426ffd700 1 -- 172.21.15.33:0/4263479054 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5418055060 con 0x7f54300f7980 2022-02-02T14:08:35.477 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:08:35.477 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:08:35.477 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:08:35.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:35.478 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:08:35.478 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:08:35.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:35.479 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:08:35.479 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:08:35.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:35.480 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:08:35.480 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:08:35.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:08:35.480 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:08:35.480 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:08:35.481 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:08:35.481 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:08:35.481 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:08:35.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 msgr2=0x7f541c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 0x7f541c067290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f543006b730 tx=0x7f5420009040).stop 2022-02-02T14:08:35.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 msgr2=0x7f5430069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f5418009990 tx=0x7f5418009b30).stop 2022-02-02T14:08:35.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 shutdown_connections 2022-02-02T14:08:35.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f541c064dd0 0x7f541c067290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54300f66e0 0x7f543006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 --2- 172.21.15.33:0/4263479054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54300f7980 0x7f5430069e20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 >> 172.21.15.33:0/4263479054 conn(0x7f54300f1e40 msgr2=0x7f54300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:35.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 shutdown_connections 2022-02-02T14:08:35.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.479+0000 7f5434fbe700 1 -- 172.21.15.33:0/4263479054 wait complete. 2022-02-02T14:08:35.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:35 smithi037 ceph-mon[69017]: from='client.34998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:35 smithi037 ceph-mon[69017]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:08:35.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:35 smithi037 ceph-mon[69017]: pgmap v891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 -- 172.21.15.33:0/4122054146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 msgr2=0x7fb4900f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 --2- 172.21.15.33:0/4122054146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb4900f7de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fb484004660 tx=0x7fb484009b30).stop 2022-02-02T14:08:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 -- 172.21.15.33:0/4122054146 shutdown_connections 2022-02-02T14:08:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 --2- 172.21.15.33:0/4122054146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb4900f7de0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 --2- 172.21.15.33:0/4122054146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 0x7fb4900f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 -- 172.21.15.33:0/4122054146 >> 172.21.15.33:0/4122054146 conn(0x7fb4900f1e40 msgr2=0x7fb4900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.582+0000 7fb494f2d700 1 -- 172.21.15.33:0/4122054146 shutdown_connections 2022-02-02T14:08:35.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.583+0000 7fb494f2d700 1 -- 172.21.15.33:0/4122054146 wait complete. 2022-02-02T14:08:35.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.583+0000 7fb494f2d700 1 Processor -- start 2022-02-02T14:08:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.583+0000 7fb494f2d700 1 -- start start 2022-02-02T14:08:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb494f2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 0x7fb49006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb494f2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb494f2d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49006a380 con 0x7fb4900f7980 2022-02-02T14:08:35.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb494f2d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49006a4c0 con 0x7fb4900f66e0 2022-02-02T14:08:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59764/0 (socket says 172.21.15.33:59764) 2022-02-02T14:08:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 -- 172.21.15.33:0/1214746777 learned_addr learned my addr 172.21.15.33:0/1214746777 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:08:35.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48e59c700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 0x7fb49006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 -- 172.21.15.33:0/1214746777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 msgr2=0x7fb49006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 0x7fb49006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 -- 172.21.15.33:0/1214746777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484005040 con 0x7fb4900f7980 2022-02-02T14:08:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb48dd9b700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fb484009990 tx=0x7fb484009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:35.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb484018070 con 0x7fb4900f7980 2022-02-02T14:08:35.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb484007ba0 con 0x7fb4900f7980 2022-02-02T14:08:35.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb49006a740 con 0x7fb4900f7980 2022-02-02T14:08:35.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.584+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48401c620 con 0x7fb4900f7980 2022-02-02T14:08:35.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.585+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49006aca0 con 0x7fb4900f7980 2022-02-02T14:08:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.585+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb490045ad0 con 0x7fb4900f7980 2022-02-02T14:08:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.586+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb48401c890 con 0x7fb4900f7980 2022-02-02T14:08:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.586+0000 7fb47effd700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 0x7fb478067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:08:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.586+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb484083800 con 0x7fb4900f7980 2022-02-02T14:08:35.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.586+0000 7fb48e59c700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 0x7fb478067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:08:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.587+0000 7fb48e59c700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 0x7fb478067290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fb49006b730 tx=0x7fb480009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:08:35.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.591+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb484051960 con 0x7fb4900f7980 2022-02-02T14:08:35.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.805+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb490027a00 con 0x7fb4900f7980 2022-02-02T14:08:35.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.806+0000 7fb47effd700 1 -- 172.21.15.33:0/1214746777 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb484054f80 con 0x7fb4900f7980 2022-02-02T14:08:35.806 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:08:35.806 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:08:35.812 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:08:35.812 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:08:35.812 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:08:35.812 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:08:35.812 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:08:35.813 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:08:35.813 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:08:35.813 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:08:35.813 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:08:35.814 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:08:35.814 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:08:35.814 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:08:35.814 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:08:35.814 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:08:35.815 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:08:35.815 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:08:35.815 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:08:35.815 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:08:35.816 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:35.816 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:35.816 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:08:35.816 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:08:35.816 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:35.817 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:35.817 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:35.817 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:08:35.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 msgr2=0x7fb478067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 0x7fb478067290 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fb49006b730 tx=0x7fb480009040).stop 2022-02-02T14:08:35.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 msgr2=0x7fb490069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:08:35.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fb484009990 tx=0x7fb484009b30).stop 2022-02-02T14:08:35.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 shutdown_connections 2022-02-02T14:08:35.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb478064dd0 0x7fb478067290 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4900f66e0 0x7fb49006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 --2- 172.21.15.33:0/1214746777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4900f7980 0x7fb490069e20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:08:35.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 >> 172.21.15.33:0/1214746777 conn(0x7fb4900f1e40 msgr2=0x7fb4900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:08:35.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 shutdown_connections 2022-02-02T14:08:35.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:08:35.808+0000 7fb494f2d700 1 -- 172.21.15.33:0/1214746777 wait complete. 2022-02-02T14:08:35.821 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:08:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4263479054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:08:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1214746777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:08:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4263479054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:08:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1214746777' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:08:37.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:37 smithi037 ceph-mon[69017]: pgmap v892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:37.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:37 smithi033 ceph-mon[101165]: pgmap v892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:39 smithi033 ceph-mon[101165]: pgmap v893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:39.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:39 smithi037 ceph-mon[69017]: pgmap v893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:42.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:41 smithi033 ceph-mon[101165]: pgmap v894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:41 smithi037 ceph-mon[69017]: pgmap v894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:43 smithi033 ceph-mon[101165]: pgmap v895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:43.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:43 smithi037 ceph-mon[69017]: pgmap v895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:45 smithi033 ceph-mon[101165]: pgmap v896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:45.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:45 smithi037 ceph-mon[69017]: pgmap v896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:47.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:47 smithi037 ceph-mon[69017]: pgmap v897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:47.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:47 smithi033 ceph-mon[101165]: pgmap v897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:49 smithi033 ceph-mon[101165]: pgmap v898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:49.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:49 smithi037 ceph-mon[69017]: pgmap v898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:52.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:51 smithi033 ceph-mon[101165]: pgmap v899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:52.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:51 smithi037 ceph-mon[69017]: pgmap v899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:53 smithi033 ceph-mon[101165]: pgmap v900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:53.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:53 smithi037 ceph-mon[69017]: pgmap v900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:54.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:08:54.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:08:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:08:54.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:08:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:55 smithi033 ceph-mon[101165]: pgmap v901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:55 smithi037 ceph-mon[69017]: pgmap v901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:57 smithi037 ceph-mon[69017]: pgmap v902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:57.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:57 smithi033 ceph-mon[101165]: pgmap v902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:59.495 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:08:59 smithi033 ceph-mon[101165]: pgmap v903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:08:59.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:08:59 smithi037 ceph-mon[69017]: pgmap v903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:01 smithi033 ceph-mon[101165]: pgmap v904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:02.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:01 smithi037 ceph-mon[69017]: pgmap v904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:03 smithi033 ceph-mon[101165]: pgmap v905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:03.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:03 smithi037 ceph-mon[69017]: pgmap v905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:05 smithi033 ceph-mon[101165]: pgmap v906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:05.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:05 smithi037 ceph-mon[69017]: pgmap v906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:05.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 -- 172.21.15.33:0/1952015531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540fbbf0 msgr2=0x7ff3540fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 --2- 172.21.15.33:0/1952015531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540fbbf0 0x7ff3540fdfe0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7ff348004660 tx=0x7ff348009b30).stop 2022-02-02T14:09:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 -- 172.21.15.33:0/1952015531 shutdown_connections 2022-02-02T14:09:05.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 --2- 172.21.15.33:0/1952015531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540fbbf0 0x7ff3540fdfe0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 --2- 172.21.15.33:0/1952015531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540602b0 0x7ff3540fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 -- 172.21.15.33:0/1952015531 >> 172.21.15.33:0/1952015531 conn(0x7ff3540f0d40 msgr2=0x7ff3540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 -- 172.21.15.33:0/1952015531 shutdown_connections 2022-02-02T14:09:05.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.924+0000 7ff359b24700 1 -- 172.21.15.33:0/1952015531 wait complete. 2022-02-02T14:09:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 Processor -- start 2022-02-02T14:09:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 -- start start 2022-02-02T14:09:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:05.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 0x7ff354109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354109be0 con 0x7ff3540602b0 2022-02-02T14:09:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff359b24700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff354109d20 con 0x7ff3540fbbf0 2022-02-02T14:09:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.925+0000 7ff3537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:05.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2022-02-02T14:09:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 -- 172.21.15.33:0/4121676810 learned_addr learned my addr 172.21.15.33:0/4121676810 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff352ffd700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 0x7ff354109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 -- 172.21.15.33:0/4121676810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 msgr2=0x7ff354109630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 0x7ff354109630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:05.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 -- 172.21.15.33:0/4121676810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348005040 con 0x7ff3540602b0 2022-02-02T14:09:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff352ffd700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 0x7ff354109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:09:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff3537fe700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ff3440026d0 tx=0x7ff344009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff344009320 con 0x7ff3540602b0 2022-02-02T14:09:05.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35410a6c0 con 0x7ff3540602b0 2022-02-02T14:09:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff34400f040 con 0x7ff3540602b0 2022-02-02T14:09:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3440147e0 con 0x7ff3540602b0 2022-02-02T14:09:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.926+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35410ac80 con 0x7ff3540602b0 2022-02-02T14:09:05.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.927+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff354045ad0 con 0x7ff3540602b0 2022-02-02T14:09:05.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.928+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff344009480 con 0x7ff3540602b0 2022-02-02T14:09:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.929+0000 7ff33bfff700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 0x7ff33c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.929+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff344082510 con 0x7ff3540602b0 2022-02-02T14:09:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.929+0000 7ff352ffd700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 0x7ff33c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.929+0000 7ff352ffd700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 0x7ff33c067290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff348009da0 tx=0x7ff348009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:05.932+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff3440540b0 con 0x7ff3540602b0 2022-02-02T14:09:06.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.119+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff35410af00 con 0x7ff33c064dd0 2022-02-02T14:09:06.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.120+0000 7ff33bfff700 1 -- 172.21.15.33:0/4121676810 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff35410af00 con 0x7ff33c064dd0 2022-02-02T14:09:06.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 msgr2=0x7ff33c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 0x7ff33c067290 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7ff348009da0 tx=0x7ff348009b30).stop 2022-02-02T14:09:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 msgr2=0x7ff354109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7ff3440026d0 tx=0x7ff344009de0).stop 2022-02-02T14:09:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 shutdown_connections 2022-02-02T14:09:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff33c064dd0 0x7ff33c067290 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3540602b0 0x7ff354109140 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 --2- 172.21.15.33:0/4121676810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3540fbbf0 0x7ff354109630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 >> 172.21.15.33:0/4121676810 conn(0x7ff3540f0d40 msgr2=0x7ff3540f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 shutdown_connections 2022-02-02T14:09:06.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.122+0000 7ff359b24700 1 -- 172.21.15.33:0/4121676810 wait complete. 2022-02-02T14:09:06.132 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:09:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 -- 172.21.15.33:0/4111995466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 msgr2=0x7f50280f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 --2- 172.21.15.33:0/4111995466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f50280f7de0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f5018004660 tx=0x7f5018009b30).stop 2022-02-02T14:09:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 -- 172.21.15.33:0/4111995466 shutdown_connections 2022-02-02T14:09:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 --2- 172.21.15.33:0/4111995466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f50280f7de0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 --2- 172.21.15.33:0/4111995466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f50280f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 -- 172.21.15.33:0/4111995466 >> 172.21.15.33:0/4111995466 conn(0x7f50280f1e40 msgr2=0x7f50280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 -- 172.21.15.33:0/4111995466 shutdown_connections 2022-02-02T14:09:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.223+0000 7f502d6ac700 1 -- 172.21.15.33:0/4111995466 wait complete. 2022-02-02T14:09:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 Processor -- start 2022-02-02T14:09:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 -- start start 2022-02-02T14:09:06.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f5028106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50281079b0 con 0x7f50280f7980 2022-02-02T14:09:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f502d6ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028107af0 con 0x7f50280f66e0 2022-02-02T14:09:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59784/0 (socket says 172.21.15.33:59784) 2022-02-02T14:09:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 -- 172.21.15.33:0/3609226053 learned_addr learned my addr 172.21.15.33:0/3609226053 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f5026ffd700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f5028106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 -- 172.21.15.33:0/3609226053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 msgr2=0x7f5028106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f5028106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f50267fc700 1 -- 172.21.15.33:0/3609226053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018005040 con 0x7f50280f7980 2022-02-02T14:09:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.224+0000 7f5026ffd700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f5028106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:09:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f50267fc700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f5018000c00 tx=0x7f501800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5018019070 con 0x7f50280f7980 2022-02-02T14:09:06.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5018007e70 con 0x7f50280f7980 2022-02-02T14:09:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5028108430 con 0x7f50280f7980 2022-02-02T14:09:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5018014d90 con 0x7f50280f7980 2022-02-02T14:09:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.225+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5028108990 con 0x7f50280f7980 2022-02-02T14:09:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.226+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5028045ad0 con 0x7f50280f7980 2022-02-02T14:09:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.227+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5018025070 con 0x7f50280f7980 2022-02-02T14:09:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.227+0000 7f500f7fe700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 0x7f5010067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.227+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5018082a60 con 0x7f50280f7980 2022-02-02T14:09:06.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.227+0000 7f5026ffd700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 0x7f5010067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.228+0000 7f5026ffd700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 0x7f5010067290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f50280f77e0 tx=0x7f501c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.231+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5018054540 con 0x7f50280f7980 2022-02-02T14:09:06.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.414+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5028108bb0 con 0x7f5010064dd0 2022-02-02T14:09:06.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.429+0000 7f500f7fe700 1 -- 172.21.15.33:0/3609226053 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5028108bb0 con 0x7f5010064dd0 2022-02-02T14:09:06.429 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:09:06.430 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (34m) 6m ago 35m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:09:06.431 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (27m) 6m ago 35m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:09:06.431 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (27m) 6m ago 34m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:09:06.431 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (34m) 6m ago 35m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:09:06.431 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (27m) 6m ago 31m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:09:06.432 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (28m) 6m ago 31m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:09:06.432 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (29m) 6m ago 31m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:09:06.432 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (31m) 6m ago 31m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:09:06.432 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (29m) 6m ago 36m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:09:06.433 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (28m) 6m ago 34m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:09:06.433 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (28m) 6m ago 36m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:09:06.433 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (27m) 6m ago 34m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:09:06.433 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (35m) 6m ago 35m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:09:06.434 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (34m) 6m ago 34m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:09:06.434 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 34m - 4096M 2022-02-02T14:09:06.434 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (33m) 6m ago 33m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:09:06.434 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (33m) 6m ago 33m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:09:06.435 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (33m) 6m ago 33m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:09:06.435 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (32m) 6m ago 32m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:09:06.435 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (32m) 6m ago 32m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:09:06.436 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (34m) 6m ago 34m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:09:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 msgr2=0x7f5010067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 0x7f5010067290 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f50280f77e0 tx=0x7f501c00b040).stop 2022-02-02T14:09:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 msgr2=0x7f5028107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f5018000c00 tx=0x7f501800b040).stop 2022-02-02T14:09:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 shutdown_connections 2022-02-02T14:09:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5010064dd0 0x7f5010067290 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280f66e0 0x7f5028106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 --2- 172.21.15.33:0/3609226053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50280f7980 0x7f5028107400 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 >> 172.21.15.33:0/3609226053 conn(0x7f50280f1e40 msgr2=0x7f50280fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 shutdown_connections 2022-02-02T14:09:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.431+0000 7f502d6ac700 1 -- 172.21.15.33:0/3609226053 wait complete. 2022-02-02T14:09:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 -- 172.21.15.33:0/1988875251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f6700 msgr2=0x7f27ec0f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 --2- 172.21.15.33:0/1988875251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f6b60 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f27e0004660 tx=0x7f27e0009b30).stop 2022-02-02T14:09:06.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 -- 172.21.15.33:0/1988875251 shutdown_connections 2022-02-02T14:09:06.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 --2- 172.21.15.33:0/1988875251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f6b60 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 --2- 172.21.15.33:0/1988875251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 -- 172.21.15.33:0/1988875251 >> 172.21.15.33:0/1988875251 conn(0x7f27ec0f0bc0 msgr2=0x7f27ec0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 -- 172.21.15.33:0/1988875251 shutdown_connections 2022-02-02T14:09:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.534+0000 7f27f19f0700 1 -- 172.21.15.33:0/1988875251 wait complete. 2022-02-02T14:09:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 Processor -- start 2022-02-02T14:09:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 -- start start 2022-02-02T14:09:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0f7fa0 con 0x7f27ec0f5460 2022-02-02T14:09:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.535+0000 7f27f19f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0f80e0 con 0x7f27ec0f6700 2022-02-02T14:09:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59792/0 (socket says 172.21.15.33:59792) 2022-02-02T14:09:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 -- 172.21.15.33:0/3380060517 learned_addr learned my addr 172.21.15.33:0/3380060517 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27ea7fc700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 -- 172.21.15.33:0/3380060517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f6700 msgr2=0x7f27ec0f7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 -- 172.21.15.33:0/3380060517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e0005040 con 0x7f27ec0f5460 2022-02-02T14:09:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27eaffd700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f27dc002700 tx=0x7f27dc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27dc0079c0 con 0x7f27ec0f5460 2022-02-02T14:09:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec0f83c0 con 0x7f27ec0f5460 2022-02-02T14:09:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f27dc00f040 con 0x7f27ec0f5460 2022-02-02T14:09:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27dc014860 con 0x7f27ec0f5460 2022-02-02T14:09:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.536+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec10edc0 con 0x7f27ec0f5460 2022-02-02T14:09:06.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.537+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec045ad0 con 0x7f27ec0f5460 2022-02-02T14:09:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.538+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f27dc01b060 con 0x7f27ec0f5460 2022-02-02T14:09:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.539+0000 7f27d37fe700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 0x7f27d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.539+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f27dc081b80 con 0x7f27ec0f5460 2022-02-02T14:09:06.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.539+0000 7f27ea7fc700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 0x7f27d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.539+0000 7f27ea7fc700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 0x7f27d40672e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f27e0004e30 tx=0x7f27e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.542+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27dc04fcf0 con 0x7f27ec0f5460 2022-02-02T14:09:06.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.787+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f27ec10f560 con 0x7f27ec0f5460 2022-02-02T14:09:06.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.788+0000 7f27d37fe700 1 -- 172.21.15.33:0/3380060517 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f27dc019020 con 0x7f27ec0f5460 2022-02-02T14:09:06.791 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:09:06.791 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:09:06.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:09:06.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:06.792 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:09:06.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:09:06.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:06.793 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:09:06.793 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:09:06.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:06.793 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:09:06.800 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:09:06.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:06.801 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:09:06.801 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:09:06.801 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:09:06.802 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:09:06.802 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:09:06.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 msgr2=0x7f27d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 0x7f27d40672e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f27e0004e30 tx=0x7f27e0009b30).stop 2022-02-02T14:09:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 msgr2=0x7f27ec0f95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f27dc002700 tx=0x7f27dc009d80).stop 2022-02-02T14:09:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 shutdown_connections 2022-02-02T14:09:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27d4064e20 0x7f27d40672e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec0f5460 0x7f27ec0f95c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 --2- 172.21.15.33:0/3380060517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec0f6700 0x7f27ec0f7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 >> 172.21.15.33:0/3380060517 conn(0x7f27ec0f0bc0 msgr2=0x7f27ec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.790+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 shutdown_connections 2022-02-02T14:09:06.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.791+0000 7f27f19f0700 1 -- 172.21.15.33:0/3380060517 wait complete. 2022-02-02T14:09:06.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/866521918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f55c0 msgr2=0x7fbf040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/866521918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f55c0 0x7fbf040f59e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fbef8004660 tx=0x7fbef8009b30).stop 2022-02-02T14:09:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/866521918 shutdown_connections 2022-02-02T14:09:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/866521918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f6860 0x7fbf040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/866521918 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f55c0 0x7fbf040f59e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/866521918 >> 172.21.15.33:0/866521918 conn(0x7fbf040f0d40 msgr2=0x7fbf040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/866521918 shutdown_connections 2022-02-02T14:09:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.891+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/866521918 wait complete. 2022-02-02T14:09:06.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.892+0000 7fbf0ab9e700 1 Processor -- start 2022-02-02T14:09:06.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.892+0000 7fbf0ab9e700 1 -- start start 2022-02-02T14:09:06.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0ab9e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f55c0 0x7fbf04109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0ab9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0ab9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf040603c0 con 0x7fbf040f6860 2022-02-02T14:09:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0ab9e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04060500 con 0x7fbf040f55c0 2022-02-02T14:09:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59804/0 (socket says 172.21.15.33:59804) 2022-02-02T14:09:06.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 -- 172.21.15.33:0/2660732804 learned_addr learned my addr 172.21.15.33:0/2660732804 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:06.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0893a700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f55c0 0x7fbf04109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 -- 172.21.15.33:0/2660732804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f55c0 msgr2=0x7fbf04109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:06.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f55c0 0x7fbf04109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 -- 172.21.15.33:0/2660732804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8005040 con 0x7fbf040f6860 2022-02-02T14:09:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf03fff700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbef00026d0 tx=0x7fbef0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef0009320 con 0x7fbf040f6860 2022-02-02T14:09:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0410c740 con 0x7fbf040f6860 2022-02-02T14:09:06.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.893+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbef000f040 con 0x7fbf040f6860 2022-02-02T14:09:06.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.894+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef00147e0 con 0x7fbf040f6860 2022-02-02T14:09:06.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.894+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0410ccd0 con 0x7fbf040f6860 2022-02-02T14:09:06.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.894+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf040f49b0 con 0x7fbf040f6860 2022-02-02T14:09:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.895+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbef0009480 con 0x7fbf040f6860 2022-02-02T14:09:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.895+0000 7fbf017fa700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 0x7fbef4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.895+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbef0082170 con 0x7fbf040f6860 2022-02-02T14:09:06.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.896+0000 7fbf0893a700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 0x7fbef4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:06.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.896+0000 7fbf0893a700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 0x7fbef4067290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fbef8004e30 tx=0x7fbef8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:06.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:06.900+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbef0050220 con 0x7fbf040f6860 2022-02-02T14:09:07.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.115+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbf04045ad0 con 0x7fbf040f6860 2022-02-02T14:09:07.115 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:06 smithi033 ceph-mon[101165]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:07.116 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:06 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3380060517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:09:07.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.116+0000 7fbf017fa700 1 -- 172.21.15.33:0/2660732804 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fbef0053840 con 0x7fbf040f6860 2022-02-02T14:09:07.116 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:09:07.117 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:09:07.117 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:09:07.117 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:09:07.117 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:07.118 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:09:07.118 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:09:07.118 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:09:07.118 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:09:07.119 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:09:07.127 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:09:07.128 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:09:07.128 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:09:07.128 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:09:07.129 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:09:07.129 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:09:07.129 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:09:07.129 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:09:07.129 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:09:07.130 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:09:07.130 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:09:07.130 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:09:07.130 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:09:07.131 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:09:07.131 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:09:07.131 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:09:07.131 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:09:07.132 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:09:07.132 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:09:07.132 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:09:07.132 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:09:07.132 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:07.133 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:07.133 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:09:07.133 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:07.133 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:07.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:07.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:07.134 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:07.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 msgr2=0x7fbef4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:07.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 0x7fbef4067290 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fbef8004e30 tx=0x7fbef8009b30).stop 2022-02-02T14:09:07.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 msgr2=0x7fbf0410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:07.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7fbef00026d0 tx=0x7fbef0009de0).stop 2022-02-02T14:09:07.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 shutdown_connections 2022-02-02T14:09:07.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbef4064dd0 0x7fbef4067290 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:07.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf040f55c0 0x7fbf04109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:07.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 --2- 172.21.15.33:0/2660732804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf040f6860 0x7fbf0410c190 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:07.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 >> 172.21.15.33:0/2660732804 conn(0x7fbf040f0d40 msgr2=0x7fbf040fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:07.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 shutdown_connections 2022-02-02T14:09:07.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:07.119+0000 7fbf0ab9e700 1 -- 172.21.15.33:0/2660732804 wait complete. 2022-02-02T14:09:07.140 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:09:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:06 smithi037 ceph-mon[69017]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:07.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:06 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3380060517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:09:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:07 smithi033 ceph-mon[101165]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2660732804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:09:08.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:07 smithi033 ceph-mon[101165]: pgmap v907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:07 smithi037 ceph-mon[69017]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2660732804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:09:08.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:07 smithi037 ceph-mon[69017]: pgmap v907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:09.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:09 smithi033 ceph-mon[101165]: pgmap v908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:09.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:09 smithi037 ceph-mon[69017]: pgmap v908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:12.246 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:11 smithi033 ceph-mon[101165]: pgmap v909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:12.293 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:11 smithi037 ceph-mon[69017]: pgmap v909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:13 smithi033 ceph-mon[101165]: pgmap v910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:13.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:13 smithi037 ceph-mon[69017]: pgmap v910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:15 smithi033 ceph-mon[101165]: pgmap v911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:15.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:15 smithi037 ceph-mon[69017]: pgmap v911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:17.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:17 smithi037 ceph-mon[69017]: pgmap v912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:17.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:17 smithi033 ceph-mon[101165]: pgmap v912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:19.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:19 smithi033 ceph-mon[101165]: pgmap v913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:19.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:19 smithi037 ceph-mon[69017]: pgmap v913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:22.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:21 smithi033 ceph-mon[101165]: pgmap v914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:22.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:21 smithi037 ceph-mon[69017]: pgmap v914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:23 smithi033 ceph-mon[101165]: pgmap v915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:23 smithi037 ceph-mon[69017]: pgmap v915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:25 smithi033 ceph-mon[101165]: pgmap v916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:25.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:25 smithi037 ceph-mon[69017]: pgmap v916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:27.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:27 smithi037 ceph-mon[69017]: pgmap v917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:27.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:27 smithi033 ceph-mon[101165]: pgmap v917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:09:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:09:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:29 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:09:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:29 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:09:29.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:29 smithi033 ceph-mon[101165]: pgmap v918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:29.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:09:29.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:09:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:29 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:09:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:29 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:09:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:29 smithi037 ceph-mon[69017]: pgmap v918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:30.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:30 smithi033 ceph-mon[101165]: pgmap v919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:30.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:30 smithi033 ceph-mon[101165]: pgmap v920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:30.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:09:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:30 smithi037 ceph-mon[69017]: pgmap v919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:31.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:30 smithi037 ceph-mon[69017]: pgmap v920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:31.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:09:33.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:32 smithi033 ceph-mon[101165]: pgmap v921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:33.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:32 smithi037 ceph-mon[69017]: pgmap v921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:35.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:34 smithi033 ceph-mon[101165]: pgmap v922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:35.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:34 smithi037 ceph-mon[69017]: pgmap v922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:37.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:36 smithi033 ceph-mon[101165]: pgmap v923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:37.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 -- 172.21.15.33:0/923973137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f55c0 msgr2=0x7f18e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 --2- 172.21.15.33:0/923973137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f55c0 0x7f18e00f59e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f18d4004660 tx=0x7f18d4009b30).stop 2022-02-02T14:09:37.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 -- 172.21.15.33:0/923973137 shutdown_connections 2022-02-02T14:09:37.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 --2- 172.21.15.33:0/923973137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f6860 0x7f18e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 --2- 172.21.15.33:0/923973137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f55c0 0x7f18e00f59e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.234+0000 7f18e6c50700 1 -- 172.21.15.33:0/923973137 >> 172.21.15.33:0/923973137 conn(0x7f18e00f0d40 msgr2=0x7f18e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.235+0000 7f18e6c50700 1 -- 172.21.15.33:0/923973137 shutdown_connections 2022-02-02T14:09:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.235+0000 7f18e6c50700 1 -- 172.21.15.33:0/923973137 wait complete. 2022-02-02T14:09:37.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.235+0000 7f18e6c50700 1 Processor -- start 2022-02-02T14:09:37.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.235+0000 7f18e6c50700 1 -- start start 2022-02-02T14:09:37.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18e6c50700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f55c0 0x7f18e0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18e6c50700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18e6c50700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00603c0 con 0x7f18e00f6860 2022-02-02T14:09:37.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18e6c50700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0060500 con 0x7f18e00f55c0 2022-02-02T14:09:37.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59814/0 (socket says 172.21.15.33:59814) 2022-02-02T14:09:37.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 -- 172.21.15.33:0/2951465568 learned_addr learned my addr 172.21.15.33:0/2951465568 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:37.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18e49ec700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f55c0 0x7f18e0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 -- 172.21.15.33:0/2951465568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f55c0 msgr2=0x7f18e0109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f55c0 0x7f18e0109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 -- 172.21.15.33:0/2951465568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4005040 con 0x7f18e00f6860 2022-02-02T14:09:37.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.236+0000 7f18dffff700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f18cc00c530 tx=0x7f18cc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.237+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18cc00f650 con 0x7f18e00f6860 2022-02-02T14:09:37.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.237+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e010c740 con 0x7f18e00f6860 2022-02-02T14:09:37.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.237+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18cc00fc60 con 0x7f18e00f6860 2022-02-02T14:09:37.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.237+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18cc012c20 con 0x7f18e00f6860 2022-02-02T14:09:37.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.237+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e010ccd0 con 0x7f18e00f6860 2022-02-02T14:09:37.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.238+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18cc010070 con 0x7f18e00f6860 2022-02-02T14:09:37.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.238+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00f49b0 con 0x7f18e00f6860 2022-02-02T14:09:37.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.239+0000 7f18dd7fa700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 0x7f18d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.239+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f18cc081760 con 0x7f18e00f6860 2022-02-02T14:09:37.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.239+0000 7f18e49ec700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 0x7f18d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.239+0000 7f18e49ec700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 0x7f18d0067290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f18d4013690 tx=0x7f18d4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.243+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18cc04f810 con 0x7f18e00f6860 2022-02-02T14:09:37.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:36 smithi037 ceph-mon[69017]: pgmap v923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:37.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.431+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18e00fdf00 con 0x7f18d0064dd0 2022-02-02T14:09:37.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.433+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2951465568 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f18e00fdf00 con 0x7f18d0064dd0 2022-02-02T14:09:37.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.434+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 msgr2=0x7f18d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.434+0000 7f18e6c50700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 0x7f18d0067290 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f18d4013690 tx=0x7f18d4009b30).stop 2022-02-02T14:09:37.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 msgr2=0x7f18e010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f18cc00c530 tx=0x7f18cc007e20).stop 2022-02-02T14:09:37.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 shutdown_connections 2022-02-02T14:09:37.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d0064dd0 0x7f18d0067290 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18e00f55c0 0x7f18e0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 --2- 172.21.15.33:0/2951465568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00f6860 0x7f18e010c190 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 >> 172.21.15.33:0/2951465568 conn(0x7f18e00f0d40 msgr2=0x7f18e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:37.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 shutdown_connections 2022-02-02T14:09:37.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.435+0000 7f18e6c50700 1 -- 172.21.15.33:0/2951465568 wait complete. 2022-02-02T14:09:37.444 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:09:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- 172.21.15.33:0/436667605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc600060270 msgr2=0x7fc6000f91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 --2- 172.21.15.33:0/436667605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc600060270 0x7fc6000f91c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fc5f0004660 tx=0x7fc5f0009b30).stop 2022-02-02T14:09:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- 172.21.15.33:0/436667605 shutdown_connections 2022-02-02T14:09:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 --2- 172.21.15.33:0/436667605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6000f96b0 0x7fc6000fbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 --2- 172.21.15.33:0/436667605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc600060270 0x7fc6000f91c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- 172.21.15.33:0/436667605 >> 172.21.15.33:0/436667605 conn(0x7fc6000f0ba0 msgr2=0x7fc6000f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:37.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- 172.21.15.33:0/436667605 shutdown_connections 2022-02-02T14:09:37.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- 172.21.15.33:0/436667605 wait complete. 2022-02-02T14:09:37.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 Processor -- start 2022-02-02T14:09:37.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.536+0000 7fc606166700 1 -- start start 2022-02-02T14:09:37.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc606166700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600060270 0x7fc6000f6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc606166700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc606166700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000f5620 con 0x7fc6000f96b0 2022-02-02T14:09:37.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc606166700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6000f5760 con 0x7fc600060270 2022-02-02T14:09:37.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59824/0 (socket says 172.21.15.33:59824) 2022-02-02T14:09:37.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 -- 172.21.15.33:0/830292149 learned_addr learned my addr 172.21.15.33:0/830292149 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:37.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc605164700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600060270 0x7fc6000f6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 -- 172.21.15.33:0/830292149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600060270 msgr2=0x7fc6000f6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600060270 0x7fc6000f6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 -- 172.21.15.33:0/830292149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0005040 con 0x7fc6000f96b0 2022-02-02T14:09:37.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc604963700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fc5fc00e7c0 tx=0x7fc5fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5fc0092e0 con 0x7fc6000f96b0 2022-02-02T14:09:37.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5fc00f040 con 0x7fc6000f96b0 2022-02-02T14:09:37.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6000f59e0 con 0x7fc6000f96b0 2022-02-02T14:09:37.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.537+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5fc0147a0 con 0x7fc6000f96b0 2022-02-02T14:09:37.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.538+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60010ed60 con 0x7fc6000f96b0 2022-02-02T14:09:37.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.539+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc600045ad0 con 0x7fc6000f96b0 2022-02-02T14:09:37.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.539+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc5fc014a10 con 0x7fc6000f96b0 2022-02-02T14:09:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.539+0000 7fc5f5ffb700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 0x7fc5ec0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.539+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc5fc081d80 con 0x7fc6000f96b0 2022-02-02T14:09:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.539+0000 7fc605164700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 0x7fc5ec0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.540+0000 7fc605164700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 0x7fc5ec0672e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fc5f0005010 tx=0x7fc5f000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.544+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc5fc04fe30 con 0x7fc6000f96b0 2022-02-02T14:09:37.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.725+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6000feed0 con 0x7fc5ec064e20 2022-02-02T14:09:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.739+0000 7fc5f5ffb700 1 -- 172.21.15.33:0/830292149 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc6000feed0 con 0x7fc5ec064e20 2022-02-02T14:09:37.740 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:09:37.740 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (34m) 7m ago 35m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:09:37.740 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (27m) 7m ago 35m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:09:37.741 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (27m) 7m ago 35m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:09:37.741 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (34m) 7m ago 35m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:09:37.742 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (28m) 7m ago 32m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:09:37.742 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (29m) 7m ago 32m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:09:37.743 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (29m) 7m ago 32m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:09:37.743 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (32m) 7m ago 32m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:09:37.743 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (29m) 7m ago 37m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:09:37.744 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (29m) 7m ago 35m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:09:37.744 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (28m) 7m ago 37m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:09:37.745 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (28m) 7m ago 35m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:09:37.745 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (35m) 7m ago 35m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:09:37.745 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (35m) 7m ago 35m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:09:37.746 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 7m ago 34m - 4096M 2022-02-02T14:09:37.749 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (34m) 7m ago 34m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:09:37.749 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (34m) 7m ago 34m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:09:37.750 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (33m) 7m ago 33m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:09:37.750 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (33m) 7m ago 33m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:09:37.750 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (33m) 7m ago 33m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:09:37.751 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (34m) 7m ago 35m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:09:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 msgr2=0x7fc5ec0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 0x7fc5ec0672e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fc5f0005010 tx=0x7fc5f000b040).stop 2022-02-02T14:09:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 msgr2=0x7fc6000f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fc5fc00e7c0 tx=0x7fc5fc00b040).stop 2022-02-02T14:09:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 shutdown_connections 2022-02-02T14:09:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5ec064e20 0x7fc5ec0672e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600060270 0x7fc6000f6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 --2- 172.21.15.33:0/830292149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6000f96b0 0x7fc6000f50c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 >> 172.21.15.33:0/830292149 conn(0x7fc6000f0ba0 msgr2=0x7fc6000f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 shutdown_connections 2022-02-02T14:09:37.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.741+0000 7fc606166700 1 -- 172.21.15.33:0/830292149 wait complete. 2022-02-02T14:09:37.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 -- 172.21.15.33:0/1854172096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 msgr2=0x7ffb340f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1854172096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb340f7de0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7ffb28004660 tx=0x7ffb28009b30).stop 2022-02-02T14:09:37.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 -- 172.21.15.33:0/1854172096 shutdown_connections 2022-02-02T14:09:37.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1854172096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb340f7de0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1854172096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb340f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 -- 172.21.15.33:0/1854172096 >> 172.21.15.33:0/1854172096 conn(0x7ffb340f1e40 msgr2=0x7ffb340f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 -- 172.21.15.33:0/1854172096 shutdown_connections 2022-02-02T14:09:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.841+0000 7ffb3a835700 1 -- 172.21.15.33:0/1854172096 wait complete. 2022-02-02T14:09:37.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.842+0000 7ffb3a835700 1 Processor -- start 2022-02-02T14:09:37.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb3a835700 1 -- start start 2022-02-02T14:09:37.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb3a835700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb34106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb3a835700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb3a835700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb341079b0 con 0x7ffb340f7980 2022-02-02T14:09:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb3a835700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb34107af0 con 0x7ffb340f66e0 2022-02-02T14:09:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59834/0 (socket says 172.21.15.33:59834) 2022-02-02T14:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 -- 172.21.15.33:0/1056367477 learned_addr learned my addr 172.21.15.33:0/1056367477 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb33fff700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb34106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 -- 172.21.15.33:0/1056367477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 msgr2=0x7ffb34106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb34106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb337fe700 1 -- 172.21.15.33:0/1056367477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb28005040 con 0x7ffb340f7980 2022-02-02T14:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.843+0000 7ffb33fff700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb34106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb337fe700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ffb28002040 tx=0x7ffb2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb28019070 con 0x7ffb340f7980 2022-02-02T14:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb34108430 con 0x7ffb340f7980 2022-02-02T14:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb28007e70 con 0x7ffb340f7980 2022-02-02T14:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb28014e30 con 0x7ffb340f7980 2022-02-02T14:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.844+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb34108990 con 0x7ffb340f7980 2022-02-02T14:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.845+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb34045ad0 con 0x7ffb340f7980 2022-02-02T14:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.845+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb28025070 con 0x7ffb340f7980 2022-02-02T14:09:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.846+0000 7ffb30ff9700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 0x7ffb1c067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.846+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffb28082af0 con 0x7ffb340f7980 2022-02-02T14:09:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.846+0000 7ffb33fff700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 0x7ffb1c067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.846+0000 7ffb33fff700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 0x7ffb1c067210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ffb24009da0 tx=0x7ffb2400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:37.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:37.850+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb28054570 con 0x7ffb340f7980 2022-02-02T14:09:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.094+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb34027a00 con 0x7ffb340f7980 2022-02-02T14:09:38.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.094+0000 7ffb30ff9700 1 -- 172.21.15.33:0/1056367477 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ffb28023070 con 0x7ffb340f7980 2022-02-02T14:09:38.094 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:09:38.095 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:09:38.095 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:09:38.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:38.095 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:09:38.096 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:09:38.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:38.096 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:09:38.096 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:09:38.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:38.097 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:09:38.097 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:09:38.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:09:38.098 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:09:38.098 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:09:38.098 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:09:38.098 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:09:38.098 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:09:38.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 msgr2=0x7ffb1c067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 0x7ffb1c067210 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7ffb24009da0 tx=0x7ffb2400b040).stop 2022-02-02T14:09:38.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 msgr2=0x7ffb34107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ffb28002040 tx=0x7ffb2800b040).stop 2022-02-02T14:09:38.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 shutdown_connections 2022-02-02T14:09:38.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb1c064d50 0x7ffb1c067210 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb340f66e0 0x7ffb34106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 --2- 172.21.15.33:0/1056367477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb340f7980 0x7ffb34107400 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 >> 172.21.15.33:0/1056367477 conn(0x7ffb340f1e40 msgr2=0x7ffb340fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:38.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 shutdown_connections 2022-02-02T14:09:38.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.096+0000 7ffb3a835700 1 -- 172.21.15.33:0/1056367477 wait complete. 2022-02-02T14:09:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3691413452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f55c0 msgr2=0x7fa1480f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3691413452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f55c0 0x7fa1480f59e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa13c004660 tx=0x7fa13c009b30).stop 2022-02-02T14:09:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3691413452 shutdown_connections 2022-02-02T14:09:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3691413452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f6860 0x7fa1480f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3691413452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f55c0 0x7fa1480f59e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3691413452 >> 172.21.15.33:0/3691413452 conn(0x7fa1480f0d40 msgr2=0x7fa1480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3691413452 shutdown_connections 2022-02-02T14:09:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.198+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3691413452 wait complete. 2022-02-02T14:09:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 Processor -- start 2022-02-02T14:09:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 -- start start 2022-02-02T14:09:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f55c0 0x7fa148109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480603e0 con 0x7fa1480f6860 2022-02-02T14:09:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ef5f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148060520 con 0x7fa1480f55c0 2022-02-02T14:09:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa147fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa147fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59842/0 (socket says 172.21.15.33:59842) 2022-02-02T14:09:38.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa147fff700 1 -- 172.21.15.33:0/3669399394 learned_addr learned my addr 172.21.15.33:0/3669399394 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:09:38.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.199+0000 7fa14ccfb700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f55c0 0x7fa148109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:38.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa147fff700 1 -- 172.21.15.33:0/3669399394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f55c0 msgr2=0x7fa148109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa147fff700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f55c0 0x7fa148109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa147fff700 1 -- 172.21.15.33:0/3669399394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13c005040 con 0x7fa1480f6860 2022-02-02T14:09:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa147fff700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fa1340026d0 tx=0x7fa134009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1340079c0 con 0x7fa1480f6860 2022-02-02T14:09:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14810c720 con 0x7fa1480f6860 2022-02-02T14:09:38.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa13400f040 con 0x7fa1480f6860 2022-02-02T14:09:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1340148b0 con 0x7fa1480f6860 2022-02-02T14:09:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.200+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14810cce0 con 0x7fa1480f6860 2022-02-02T14:09:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.201+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa148045ad0 con 0x7fa1480f6860 2022-02-02T14:09:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.202+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa134007b20 con 0x7fa1480f6860 2022-02-02T14:09:38.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.202+0000 7fa1457fa700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 0x7fa138067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:09:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.202+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa134081a30 con 0x7fa1480f6860 2022-02-02T14:09:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.202+0000 7fa14ccfb700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 0x7fa138067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:09:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.202+0000 7fa14ccfb700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 0x7fa138067270 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa148060060 tx=0x7fa13c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:09:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.206+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa13404fae0 con 0x7fa1480f6860 2022-02-02T14:09:38.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.421+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa148027a00 con 0x7fa1480f6860 2022-02-02T14:09:38.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.421+0000 7fa1457fa700 1 -- 172.21.15.33:0/3669399394 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa134053100 con 0x7fa1480f6860 2022-02-02T14:09:38.423 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:09:38.424 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:09:38.424 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:09:38.425 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:09:38.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:38.426 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:09:38.426 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:09:38.427 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:09:38.427 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:09:38.427 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:09:38.428 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:09:38.428 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:09:38.429 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:09:38.429 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:09:38.430 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:09:38.430 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:09:38.431 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:09:38.432 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:09:38.433 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:09:38.433 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:09:38.436 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:09:38.441 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:09:38.441 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:09:38.441 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:09:38.441 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:09:38.442 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:09:38.442 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:09:38.442 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:09:38.442 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:09:38.443 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:09:38.443 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:09:38.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:38.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:38.443 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:09:38.444 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:09:38.444 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:38.445 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:38.445 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:38.445 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:09:38.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.424+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 msgr2=0x7fa138067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.424+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 0x7fa138067270 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fa148060060 tx=0x7fa13c009b30).stop 2022-02-02T14:09:38.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.424+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 msgr2=0x7fa14810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:09:38.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.424+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fa1340026d0 tx=0x7fa134009de0).stop 2022-02-02T14:09:38.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 shutdown_connections 2022-02-02T14:09:38.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa138064db0 0x7fa138067270 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1480f55c0 0x7fa148109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 --2- 172.21.15.33:0/3669399394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1480f6860 0x7fa14810c170 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:09:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 >> 172.21.15.33:0/3669399394 conn(0x7fa1480f0d40 msgr2=0x7fa1480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:09:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 shutdown_connections 2022-02-02T14:09:38.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:09:38.425+0000 7fa14ef5f700 1 -- 172.21.15.33:0/3669399394 wait complete. 2022-02-02T14:09:38.450 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:09:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:38 smithi033 ceph-mon[101165]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:38 smithi033 ceph-mon[101165]: pgmap v924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:39.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:38 smithi033 ceph-mon[101165]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1056367477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:09:39.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3669399394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:09:39.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:38 smithi037 ceph-mon[69017]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:38 smithi037 ceph-mon[69017]: pgmap v924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:38 smithi037 ceph-mon[69017]: from='client.35034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:09:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1056367477' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:09:39.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3669399394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:09:41.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:40 smithi033 ceph-mon[101165]: pgmap v925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:41.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:40 smithi037 ceph-mon[69017]: pgmap v925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:43.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:42 smithi033 ceph-mon[101165]: pgmap v926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:43.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:42 smithi037 ceph-mon[69017]: pgmap v926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:45.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:44 smithi033 ceph-mon[101165]: pgmap v927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:45.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:44 smithi037 ceph-mon[69017]: pgmap v927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:46 smithi033 ceph-mon[101165]: pgmap v928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:46 smithi037 ceph-mon[69017]: pgmap v928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:49.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:48 smithi037 ceph-mon[69017]: pgmap v929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:48 smithi033 ceph-mon[101165]: pgmap v929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:51.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:50 smithi037 ceph-mon[69017]: pgmap v930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:50 smithi033 ceph-mon[101165]: pgmap v930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:53.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:52 smithi037 ceph-mon[69017]: pgmap v931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:52 smithi033 ceph-mon[101165]: pgmap v931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:55 smithi037 ceph-mon[69017]: pgmap v932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:09:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:09:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:55 smithi033 ceph-mon[101165]: pgmap v932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:09:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:09:57.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:57 smithi037 ceph-mon[69017]: pgmap v933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:57.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:57 smithi033 ceph-mon[101165]: pgmap v933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:59.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:09:59 smithi037 ceph-mon[69017]: pgmap v934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:09:59.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:09:59 smithi033 ceph-mon[101165]: pgmap v934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:10:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:00 smithi033 conmon[101141]: 2022-02-02T14:09:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:10:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:10:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:01 smithi037 ceph-mon[69017]: pgmap v935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:01 smithi033 ceph-mon[101165]: pgmap v935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:03.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:03 smithi037 ceph-mon[69017]: pgmap v936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:03 smithi033 ceph-mon[101165]: pgmap v936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:05.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:05 smithi037 ceph-mon[69017]: pgmap v937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:05 smithi033 ceph-mon[101165]: pgmap v937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:07 smithi037 ceph-mon[69017]: pgmap v938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:07 smithi033 ceph-mon[101165]: pgmap v938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:08.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 -- 172.21.15.33:0/1848709579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 msgr2=0x7fc3640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 --2- 172.21.15.33:0/1848709579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f6cc0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fc358004660 tx=0x7fc358009b30).stop 2022-02-02T14:10:08.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 -- 172.21.15.33:0/1848709579 shutdown_connections 2022-02-02T14:10:08.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 --2- 172.21.15.33:0/1848709579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f6cc0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 --2- 172.21.15.33:0/1848709579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 0x7fc3640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 -- 172.21.15.33:0/1848709579 >> 172.21.15.33:0/1848709579 conn(0x7fc3640f0d40 msgr2=0x7fc3640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:08.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 -- 172.21.15.33:0/1848709579 shutdown_connections 2022-02-02T14:10:08.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.541+0000 7fc369e69700 1 -- 172.21.15.33:0/1848709579 wait complete. 2022-02-02T14:10:08.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 Processor -- start 2022-02-02T14:10:08.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 -- start start 2022-02-02T14:10:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 0x7fc3640f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640f8100 con 0x7fc3640f6860 2022-02-02T14:10:08.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc369e69700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640f8240 con 0x7fc3640f55c0 2022-02-02T14:10:08.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc362ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59852/0 (socket says 172.21.15.33:59852) 2022-02-02T14:10:08.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc362ffd700 1 -- 172.21.15.33:0/3808950278 learned_addr learned my addr 172.21.15.33:0/3808950278 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:08.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.542+0000 7fc3637fe700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 0x7fc3640f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc362ffd700 1 -- 172.21.15.33:0/3808950278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 msgr2=0x7fc3640f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc362ffd700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 0x7fc3640f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc362ffd700 1 -- 172.21.15.33:0/3808950278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358005040 con 0x7fc3640f6860 2022-02-02T14:10:08.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc362ffd700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc358009990 tx=0x7fc358009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:08.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc358018070 con 0x7fc3640f6860 2022-02-02T14:10:08.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3640f84c0 con 0x7fc3640f6860 2022-02-02T14:10:08.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc358007ba0 con 0x7fc3640f6860 2022-02-02T14:10:08.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc35801c3c0 con 0x7fc3640f6860 2022-02-02T14:10:08.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.543+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3640f8a20 con 0x7fc3640f6860 2022-02-02T14:10:08.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.544+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364045ad0 con 0x7fc3640f6860 2022-02-02T14:10:08.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.545+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc35801d420 con 0x7fc3640f6860 2022-02-02T14:10:08.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.545+0000 7fc34bfff700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.545+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc3580836f0 con 0x7fc3640f6860 2022-02-02T14:10:08.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.545+0000 7fc3637fe700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.546+0000 7fc3637fe700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fc3640f94b0 tx=0x7fc35400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:08.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.550+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc358051860 con 0x7fc3640f6860 2022-02-02T14:10:08.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.739+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3640faca0 con 0x7fc34c064dd0 2022-02-02T14:10:08.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.740+0000 7fc34bfff700 1 -- 172.21.15.33:0/3808950278 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc3640faca0 con 0x7fc34c064dd0 2022-02-02T14:10:08.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 msgr2=0x7fc34c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fc3640f94b0 tx=0x7fc35400b040).stop 2022-02-02T14:10:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 msgr2=0x7fc3640f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7fc358009990 tx=0x7fc358009b30).stop 2022-02-02T14:10:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 shutdown_connections 2022-02-02T14:10:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f55c0 0x7fc3640f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 --2- 172.21.15.33:0/3808950278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f6860 0x7fc3640f7ba0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 >> 172.21.15.33:0/3808950278 conn(0x7fc3640f0d40 msgr2=0x7fc36405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 shutdown_connections 2022-02-02T14:10:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.742+0000 7fc369e69700 1 -- 172.21.15.33:0/3808950278 wait complete. 2022-02-02T14:10:08.751 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:10:08.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 -- 172.21.15.33:0/399031251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 msgr2=0x7f3c28069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 --2- 172.21.15.33:0/399031251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c28069ec0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f3c24004660 tx=0x7f3c24009b30).stop 2022-02-02T14:10:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 -- 172.21.15.33:0/399031251 shutdown_connections 2022-02-02T14:10:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 --2- 172.21.15.33:0/399031251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 0x7f3c2806a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 --2- 172.21.15.33:0/399031251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c28069ec0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 -- 172.21.15.33:0/399031251 >> 172.21.15.33:0/399031251 conn(0x7f3c280f1e40 msgr2=0x7f3c280f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.843+0000 7f3c300e8700 1 -- 172.21.15.33:0/399031251 shutdown_connections 2022-02-02T14:10:08.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.845+0000 7f3c300e8700 1 -- 172.21.15.33:0/399031251 wait complete. 2022-02-02T14:10:08.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.845+0000 7f3c300e8700 1 Processor -- start 2022-02-02T14:10:08.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.845+0000 7f3c300e8700 1 -- start start 2022-02-02T14:10:08.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c300e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 0x7f3c28109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c300e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c300e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28109ba0 con 0x7f3c2806b9c0 2022-02-02T14:10:08.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c300e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c28109ce0 con 0x7f3c2806a3b0 2022-02-02T14:10:08.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59862/0 (socket says 172.21.15.33:59862) 2022-02-02T14:10:08.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 -- 172.21.15.33:0/953719496 learned_addr learned my addr 172.21.15.33:0/953719496 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:08.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2de84700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 0x7f3c28109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 -- 172.21.15.33:0/953719496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 msgr2=0x7f3c28109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:08.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 0x7f3c28109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:08.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 -- 172.21.15.33:0/953719496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c24005040 con 0x7f3c2806b9c0 2022-02-02T14:10:08.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c2d683700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f3c1800e7f0 tx=0x7f3c1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:08.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c180092e0 con 0x7f3c2806b9c0 2022-02-02T14:10:08.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c1800f040 con 0x7f3c2806b9c0 2022-02-02T14:10:08.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.846+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2810a680 con 0x7f3c2806b9c0 2022-02-02T14:10:08.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.847+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2810ac40 con 0x7f3c2806b9c0 2022-02-02T14:10:08.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.847+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c18014750 con 0x7f3c2806b9c0 2022-02-02T14:10:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.848+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c10004fa0 con 0x7f3c2806b9c0 2022-02-02T14:10:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.848+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c1801b030 con 0x7f3c2806b9c0 2022-02-02T14:10:08.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.849+0000 7f3c1e7fc700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 0x7f3c14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.849+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3c180816c0 con 0x7f3c2806b9c0 2022-02-02T14:10:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.849+0000 7f3c2de84700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 0x7f3c14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.849+0000 7f3c2de84700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 0x7f3c14067290 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3c24005010 tx=0x7f3c24016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:08.853+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c18053250 con 0x7f3c2806b9c0 2022-02-02T14:10:09.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.038+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c10000bc0 con 0x7f3c14064dd0 2022-02-02T14:10:09.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.052+0000 7f3c1e7fc700 1 -- 172.21.15.33:0/953719496 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3c10000bc0 con 0x7f3c14064dd0 2022-02-02T14:10:09.052 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:10:09.052 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (35m) 7m ago 36m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:10:09.052 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (28m) 7m ago 36m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:10:09.053 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (28m) 7m ago 35m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:10:09.053 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (35m) 7m ago 36m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:10:09.053 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (28m) 7m ago 32m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:10:09.053 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (29m) 7m ago 32m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:10:09.054 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (30m) 7m ago 32m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:10:09.054 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (32m) 7m ago 32m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:10:09.054 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (30m) 7m ago 37m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:10:09.054 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (29m) 7m ago 35m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:10:09.055 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (29m) 7m ago 37m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:10:09.055 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (29m) 7m ago 35m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:10:09.055 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (36m) 7m ago 36m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:10:09.055 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (35m) 7m ago 35m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:10:09.055 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 7m ago 35m - 4096M 2022-02-02T14:10:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (34m) 7m ago 34m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:10:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (34m) 7m ago 34m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:10:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (34m) 7m ago 34m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:10:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (34m) 7m ago 34m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:10:09.056 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (33m) 7m ago 33m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:10:09.057 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (35m) 7m ago 36m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:10:09.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 msgr2=0x7f3c14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 0x7f3c14067290 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f3c24005010 tx=0x7f3c24016040).stop 2022-02-02T14:10:09.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 msgr2=0x7f3c281095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f3c1800e7f0 tx=0x7f3c1800b040).stop 2022-02-02T14:10:09.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 shutdown_connections 2022-02-02T14:10:09.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c14064dd0 0x7f3c14067290 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2806a3b0 0x7f3c28109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 --2- 172.21.15.33:0/953719496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2806b9c0 0x7f3c281095f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 >> 172.21.15.33:0/953719496 conn(0x7f3c280f1e40 msgr2=0x7f3c280fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:09.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 shutdown_connections 2022-02-02T14:10:09.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.054+0000 7f3c300e8700 1 -- 172.21.15.33:0/953719496 wait complete. 2022-02-02T14:10:09.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 -- 172.21.15.33:0/4117253554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f6860 msgr2=0x7fc8680f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4117253554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f6860 0x7fc8680f6cc0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7fc850004660 tx=0x7fc850009b30).stop 2022-02-02T14:10:09.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 -- 172.21.15.33:0/4117253554 shutdown_connections 2022-02-02T14:10:09.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4117253554 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f6860 0x7fc8680f6cc0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4117253554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f55c0 0x7fc8680f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 -- 172.21.15.33:0/4117253554 >> 172.21.15.33:0/4117253554 conn(0x7fc8680f0d40 msgr2=0x7fc8680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:09.155 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:09 smithi033 ceph-mon[101165]: pgmap v939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 -- 172.21.15.33:0/4117253554 shutdown_connections 2022-02-02T14:10:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.154+0000 7fc86cb07700 1 -- 172.21.15.33:0/4117253554 wait complete. 2022-02-02T14:10:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 Processor -- start 2022-02-02T14:10:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 -- start start 2022-02-02T14:10:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f6860 0x7fc8681063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8681069b0 con 0x7fc8680f55c0 2022-02-02T14:10:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86cb07700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8681071c0 con 0x7fc8680f6860 2022-02-02T14:10:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.155+0000 7fc86659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59870/0 (socket says 172.21.15.33:59870) 2022-02-02T14:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 -- 172.21.15.33:0/4068914159 learned_addr learned my addr 172.21.15.33:0/4068914159 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc865d9b700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f6860 0x7fc8681063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 -- 172.21.15.33:0/4068914159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f6860 msgr2=0x7fc8681063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f6860 0x7fc8681063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 -- 172.21.15.33:0/4068914159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850005040 con 0x7fc8680f55c0 2022-02-02T14:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86659c700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc85800c530 tx=0x7fc858007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc85800f650 con 0x7fc8680f55c0 2022-02-02T14:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc85800fc60 con 0x7fc8680f55c0 2022-02-02T14:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8681073e0 con 0x7fc8680f55c0 2022-02-02T14:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc858012cb0 con 0x7fc8680f55c0 2022-02-02T14:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.156+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc868107970 con 0x7fc8680f55c0 2022-02-02T14:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.158+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8680f49b0 con 0x7fc8680f55c0 2022-02-02T14:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.158+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc858019030 con 0x7fc8680f55c0 2022-02-02T14:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.158+0000 7fc85effd700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 0x7fc854067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.158+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc858081500 con 0x7fc8680f55c0 2022-02-02T14:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.159+0000 7fc865d9b700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 0x7fc854067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.159+0000 7fc865d9b700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 0x7fc854067350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc850004e30 tx=0x7fc850009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.163+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8580487d0 con 0x7fc8680f55c0 2022-02-02T14:10:09.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:09 smithi037 ceph-mon[69017]: pgmap v939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:09.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.406+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8680ff830 con 0x7fc8680f55c0 2022-02-02T14:10:09.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.406+0000 7fc85effd700 1 -- 172.21.15.33:0/4068914159 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc85804f6c0 con 0x7fc8680f55c0 2022-02-02T14:10:09.406 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:10:09.407 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:10:09.407 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:10:09.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:09.407 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:10:09.408 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:10:09.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:09.408 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:10:09.408 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:10:09.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:09.409 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:10:09.409 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:10:09.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:09.409 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:10:09.409 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:10:09.410 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:10:09.410 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:10:09.410 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:10:09.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 msgr2=0x7fc854067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 0x7fc854067350 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fc850004e30 tx=0x7fc850009b30).stop 2022-02-02T14:10:09.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 msgr2=0x7fc868105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc85800c530 tx=0x7fc858007e10).stop 2022-02-02T14:10:09.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 shutdown_connections 2022-02-02T14:10:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc854064e90 0x7fc854067350 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680f55c0 0x7fc868105ec0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 --2- 172.21.15.33:0/4068914159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8680f6860 0x7fc8681063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 >> 172.21.15.33:0/4068914159 conn(0x7fc8680f0d40 msgr2=0x7fc8680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 shutdown_connections 2022-02-02T14:10:09.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.408+0000 7fc86cb07700 1 -- 172.21.15.33:0/4068914159 wait complete. 2022-02-02T14:10:09.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 -- 172.21.15.33:0/966553285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f6530 msgr2=0x7f7b240f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 --2- 172.21.15.33:0/966553285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f6530 0x7f7b240f6950 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f7b14004660 tx=0x7f7b14009b30).stop 2022-02-02T14:10:09.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 -- 172.21.15.33:0/966553285 shutdown_connections 2022-02-02T14:10:09.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 --2- 172.21.15.33:0/966553285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f77d0 0x7f7b240f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:10:09.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 --2- 172.21.15.33:0/966553285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f6530 0x7f7b240f6950 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 -- 172.21.15.33:0/966553285 >> 172.21.15.33:0/966553285 conn(0x7f7b240f1c90 msgr2=0x7f7b240f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:09.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 -- 172.21.15.33:0/966553285 shutdown_connections 2022-02-02T14:10:09.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.509+0000 7f7b295b0700 1 -- 172.21.15.33:0/966553285 wait complete. 2022-02-02T14:10:09.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 Processor -- start 2022-02-02T14:10:09.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 -- start start 2022-02-02T14:10:09.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f6530 0x7f7b24106e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b241079a0 con 0x7f7b240f77d0 2022-02-02T14:10:09.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b295b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24108120 con 0x7f7b240f6530 2022-02-02T14:10:09.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.510+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59882/0 (socket says 172.21.15.33:59882) 2022-02-02T14:10:09.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 -- 172.21.15.33:0/1760683477 learned_addr learned my addr 172.21.15.33:0/1760683477 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:09.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b23fff700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f6530 0x7f7b24106e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 -- 172.21.15.33:0/1760683477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f6530 msgr2=0x7f7b24106e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f6530 0x7f7b24106e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 -- 172.21.15.33:0/1760683477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14005040 con 0x7f7b240f77d0 2022-02-02T14:10:09.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b237fe700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f7b1800b410 tx=0x7f7b18006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:09.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b180125f0 con 0x7f7b240f77d0 2022-02-02T14:10:09.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7b1800be30 con 0x7f7b240f77d0 2022-02-02T14:10:09.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b241083a0 con 0x7f7b240f77d0 2022-02-02T14:10:09.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b18002a70 con 0x7f7b240f77d0 2022-02-02T14:10:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.511+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b24108960 con 0x7f7b240f77d0 2022-02-02T14:10:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.512+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b24045ad0 con 0x7f7b240f77d0 2022-02-02T14:10:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.513+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7b1800f030 con 0x7f7b240f77d0 2022-02-02T14:10:09.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.513+0000 7f7b20ff9700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 0x7f7b0c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.513+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7b18081df0 con 0x7f7b240f77d0 2022-02-02T14:10:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.513+0000 7f7b23fff700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 0x7f7b0c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:09.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.514+0000 7f7b23fff700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 0x7f7b0c0672e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7b14013690 tx=0x7f7b14009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.517+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7b1804fea0 con 0x7f7b240f77d0 2022-02-02T14:10:09.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.732+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b24027a00 con 0x7f7b240f77d0 2022-02-02T14:10:09.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.732+0000 7f7b20ff9700 1 -- 172.21.15.33:0/1760683477 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7b180534c0 con 0x7f7b240f77d0 2022-02-02T14:10:09.733 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:10:09.733 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:10:09.733 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:10:09.735 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:10:09.735 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:09.735 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:10:09.736 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:10:09.736 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:10:09.736 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:10:09.736 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:10:09.737 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:10:09.737 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:10:09.737 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:10:09.737 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:10:09.738 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:10:09.738 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:10:09.738 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:10:09.738 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:10:09.738 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:10:09.739 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:10:09.739 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:10:09.739 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:10:09.739 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:10:09.740 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:10:09.740 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:10:09.740 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:10:09.740 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:10:09.741 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:10:09.741 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:10:09.741 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:10:09.741 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:10:09.742 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:09.742 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:09.742 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:10:09.742 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:09.743 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:09.743 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:09.743 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:09.743 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 msgr2=0x7f7b0c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 0x7f7b0c0672e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7b14013690 tx=0x7f7b14009b30).stop 2022-02-02T14:10:09.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 msgr2=0x7f7b24107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f7b1800b410 tx=0x7f7b18006ef0).stop 2022-02-02T14:10:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 shutdown_connections 2022-02-02T14:10:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7b0c064e20 0x7f7b0c0672e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240f6530 0x7f7b24106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 --2- 172.21.15.33:0/1760683477 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b240f77d0 0x7f7b24107310 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.734+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 >> 172.21.15.33:0/1760683477 conn(0x7f7b240f1c90 msgr2=0x7f7b240fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.735+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 shutdown_connections 2022-02-02T14:10:09.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:09.735+0000 7f7b295b0700 1 -- 172.21.15.33:0/1760683477 wait complete. 2022-02-02T14:10:09.748 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:10:10.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:10 smithi037 ceph-mon[69017]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:10 smithi037 ceph-mon[69017]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:10.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4068914159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:10:10.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1760683477' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:10:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:10 smithi033 ceph-mon[101165]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:10 smithi033 ceph-mon[101165]: from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4068914159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:10:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1760683477' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:10:11.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:11 smithi037 ceph-mon[69017]: pgmap v940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:11.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:11 smithi033 ceph-mon[101165]: pgmap v940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:13.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:13 smithi037 ceph-mon[69017]: pgmap v941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:13 smithi033 ceph-mon[101165]: pgmap v941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:15.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:15 smithi037 ceph-mon[69017]: pgmap v942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:15 smithi033 ceph-mon[101165]: pgmap v942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:17.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:17 smithi037 ceph-mon[69017]: pgmap v943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:17.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:17 smithi033 ceph-mon[101165]: pgmap v943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:19.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:19 smithi033 ceph-mon[101165]: pgmap v944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:19.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:19 smithi037 ceph-mon[69017]: pgmap v944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:21 smithi033 ceph-mon[101165]: pgmap v945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:21.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:21 smithi037 ceph-mon[69017]: pgmap v945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:23 smithi033 ceph-mon[101165]: pgmap v946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:23 smithi037 ceph-mon[69017]: pgmap v946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:25 smithi033 ceph-mon[101165]: pgmap v947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:25.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:25 smithi037 ceph-mon[69017]: pgmap v947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:27.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:27 smithi037 ceph-mon[69017]: pgmap v948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:27.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:27 smithi033 ceph-mon[101165]: pgmap v948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:29 smithi033 ceph-mon[101165]: pgmap v949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:29.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:29 smithi037 ceph-mon[69017]: pgmap v949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:10:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:10:30.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:10:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:10:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:10:30.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:10:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:31 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:10:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:31 smithi033 ceph-mon[101165]: pgmap v950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:31 smithi033 ceph-mon[101165]: pgmap v951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:31 smithi033 ceph-mon[101165]: pgmap v952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:10:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:31 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:10:31.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:31 smithi037 ceph-mon[69017]: pgmap v950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:31 smithi037 ceph-mon[69017]: pgmap v951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:31 smithi037 ceph-mon[69017]: pgmap v952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:31.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:10:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:33 smithi033 ceph-mon[101165]: pgmap v953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:33.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:33 smithi037 ceph-mon[69017]: pgmap v953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:35.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:35 smithi033 ceph-mon[101165]: pgmap v954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:35.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:35 smithi037 ceph-mon[69017]: pgmap v954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:37.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:36 smithi033 ceph-mon[101165]: pgmap v955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:37.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:36 smithi037 ceph-mon[69017]: pgmap v955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:39.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:39 smithi033 ceph-mon[101165]: pgmap v956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:39.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:39 smithi037 ceph-mon[69017]: pgmap v956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.851+0000 7f0e7349f700 1 -- 172.21.15.33:0/1604645892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f55c0 msgr2=0x7f0e6c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:39.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.851+0000 7f0e7349f700 1 --2- 172.21.15.33:0/1604645892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c0f59e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f0e68004660 tx=0x7f0e68009b30).stop 2022-02-02T14:10:39.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 -- 172.21.15.33:0/1604645892 shutdown_connections 2022-02-02T14:10:39.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 --2- 172.21.15.33:0/1604645892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:39.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 --2- 172.21.15.33:0/1604645892 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c0f59e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:39.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 -- 172.21.15.33:0/1604645892 >> 172.21.15.33:0/1604645892 conn(0x7f0e6c0f0d40 msgr2=0x7f0e6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:39.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 -- 172.21.15.33:0/1604645892 shutdown_connections 2022-02-02T14:10:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 -- 172.21.15.33:0/1604645892 wait complete. 2022-02-02T14:10:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 Processor -- start 2022-02-02T14:10:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.852+0000 7f0e7349f700 1 -- start start 2022-02-02T14:10:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e7349f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e7349f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e7349f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c060420 con 0x7f0e6c0f6860 2022-02-02T14:10:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e7349f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c060560 con 0x7f0e6c0f55c0 2022-02-02T14:10:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59892/0 (socket says 172.21.15.33:59892) 2022-02-02T14:10:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 -- 172.21.15.33:0/4079180967 learned_addr learned my addr 172.21.15.33:0/4079180967 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e7123b700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 -- 172.21.15.33:0/4079180967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f55c0 msgr2=0x7f0e6c109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 -- 172.21.15.33:0/4079180967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e68005040 con 0x7f0e6c0f6860 2022-02-02T14:10:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.853+0000 7f0e70a3a700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f0e6000c530 tx=0x7f0e60007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.854+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e6000f650 con 0x7f0e6c0f6860 2022-02-02T14:10:39.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.854+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c10c740 con 0x7f0e6c0f6860 2022-02-02T14:10:39.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.854+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0e6000fc60 con 0x7f0e6c0f6860 2022-02-02T14:10:39.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.854+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e60012cd0 con 0x7f0e6c0f6860 2022-02-02T14:10:39.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.854+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c10ccd0 con 0x7f0e6c0f6860 2022-02-02T14:10:39.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.855+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c0f49b0 con 0x7f0e6c0f6860 2022-02-02T14:10:39.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.855+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0e60010070 con 0x7f0e6c0f6860 2022-02-02T14:10:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.856+0000 7f0e5dffb700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 0x7f0e58067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.856+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0e600817e0 con 0x7f0e6c0f6860 2022-02-02T14:10:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.856+0000 7f0e7123b700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 0x7f0e58067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.856+0000 7f0e7123b700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 0x7f0e58067270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f0e6c0600a0 tx=0x7f0e68009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:39.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:39.860+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0e6004f890 con 0x7f0e6c0f6860 2022-02-02T14:10:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.047+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e6c0fdf00 con 0x7f0e58064db0 2022-02-02T14:10:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.049+0000 7f0e5dffb700 1 -- 172.21.15.33:0/4079180967 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f0e6c0fdf00 con 0x7f0e58064db0 2022-02-02T14:10:40.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.050+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 msgr2=0x7f0e58067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.050+0000 7f0e7349f700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 0x7f0e58067270 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f0e6c0600a0 tx=0x7f0e68009b30).stop 2022-02-02T14:10:40.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 msgr2=0x7f0e6c10c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f0e6000c530 tx=0x7f0e60007e20).stop 2022-02-02T14:10:40.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 shutdown_connections 2022-02-02T14:10:40.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0e58064db0 0x7f0e58067270 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e6c0f55c0 0x7f0e6c109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 --2- 172.21.15.33:0/4079180967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e6c0f6860 0x7f0e6c10c130 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 >> 172.21.15.33:0/4079180967 conn(0x7f0e6c0f0d40 msgr2=0x7f0e6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 shutdown_connections 2022-02-02T14:10:40.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.051+0000 7f0e7349f700 1 -- 172.21.15.33:0/4079180967 wait complete. 2022-02-02T14:10:40.060 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:10:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 -- 172.21.15.33:0/4220503844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc0f96a0 msgr2=0x7f64dc0fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 --2- 172.21.15.33:0/4220503844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0fbaf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f64cc004660 tx=0x7f64cc009b30).stop 2022-02-02T14:10:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 -- 172.21.15.33:0/4220503844 shutdown_connections 2022-02-02T14:10:40.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 --2- 172.21.15.33:0/4220503844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0fbaf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 --2- 172.21.15.33:0/4220503844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc060270 0x7f64dc0f91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 -- 172.21.15.33:0/4220503844 >> 172.21.15.33:0/4220503844 conn(0x7f64dc0f0b90 msgr2=0x7f64dc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 -- 172.21.15.33:0/4220503844 shutdown_connections 2022-02-02T14:10:40.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.152+0000 7f64e335a700 1 -- 172.21.15.33:0/4220503844 wait complete. 2022-02-02T14:10:40.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 Processor -- start 2022-02-02T14:10:40.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 -- start start 2022-02-02T14:10:40.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0f5610 con 0x7f64dc060270 2022-02-02T14:10:40.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.153+0000 7f64e335a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc0f5750 con 0x7f64dc0f96a0 2022-02-02T14:10:40.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59900/0 (socket says 172.21.15.33:59900) 2022-02-02T14:10:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 -- 172.21.15.33:0/3396801595 learned_addr learned my addr 172.21.15.33:0/3396801595 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e1b57700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 -- 172.21.15.33:0/3396801595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 msgr2=0x7f64dc0f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 -- 172.21.15.33:0/3396801595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc005040 con 0x7f64dc060270 2022-02-02T14:10:40.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e1b57700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:10:40.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e2358700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f64d800c790 tx=0x7f64d8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d800e680 con 0x7f64dc060270 2022-02-02T14:10:40.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc0f5a30 con 0x7f64dc060270 2022-02-02T14:10:40.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f64d800ec90 con 0x7f64dc060270 2022-02-02T14:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64d8013d60 con 0x7f64dc060270 2022-02-02T14:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.154+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc10ed70 con 0x7f64dc060270 2022-02-02T14:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.156+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64dc045ad0 con 0x7f64dc060270 2022-02-02T14:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.156+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f64d801a060 con 0x7f64dc060270 2022-02-02T14:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.156+0000 7f64d2ffd700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 0x7f64c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.157+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f64d8081ce0 con 0x7f64dc060270 2022-02-02T14:10:40.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.157+0000 7f64e1b57700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 0x7f64c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.157+0000 7f64e1b57700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 0x7f64c80672e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f64cc004e30 tx=0x7f64cc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.161+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f64d804fd90 con 0x7f64dc060270 2022-02-02T14:10:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.343+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f64dc0fee10 con 0x7f64c8064e20 2022-02-02T14:10:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.357+0000 7f64d2ffd700 1 -- 172.21.15.33:0/3396801595 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f64dc0fee10 con 0x7f64c8064e20 2022-02-02T14:10:40.357 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:10:40.357 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (35m) 8m ago 36m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:10:40.357 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (28m) 8m ago 36m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:10:40.358 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (28m) 8m ago 36m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:10:40.358 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (35m) 8m ago 36m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:10:40.358 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (29m) 8m ago 33m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:10:40.358 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (30m) 8m ago 33m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:10:40.359 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (30m) 8m ago 33m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:10:40.359 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (33m) 8m ago 33m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:10:40.359 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (30m) 8m ago 38m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:10:40.359 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (30m) 8m ago 36m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:10:40.359 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (29m) 8m ago 38m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:10:40.360 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (29m) 8m ago 36m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:10:40.360 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (36m) 8m ago 36m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:10:40.360 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (36m) 8m ago 36m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:10:40.360 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8m ago 35m - 4096M 2022-02-02T14:10:40.361 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (35m) 8m ago 35m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:10:40.361 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (35m) 8m ago 35m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:10:40.361 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (34m) 8m ago 34m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:10:40.361 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (34m) 8m ago 34m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:10:40.361 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (34m) 8m ago 34m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:10:40.362 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (35m) 8m ago 36m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:10:40.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 msgr2=0x7f64c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 0x7f64c80672e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f64cc004e30 tx=0x7f64cc009b30).stop 2022-02-02T14:10:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 msgr2=0x7f64dc0f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f64d800c790 tx=0x7f64d8007d70).stop 2022-02-02T14:10:40.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 shutdown_connections 2022-02-02T14:10:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f64c8064e20 0x7f64c80672e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64dc060270 0x7f64dc0f6c30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 --2- 172.21.15.33:0/3396801595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64dc0f96a0 0x7f64dc0f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 >> 172.21.15.33:0/3396801595 conn(0x7f64dc0f0b90 msgr2=0x7f64dc0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 shutdown_connections 2022-02-02T14:10:40.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.360+0000 7f64e335a700 1 -- 172.21.15.33:0/3396801595 wait complete. 2022-02-02T14:10:40.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 -- 172.21.15.33:0/1924046111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 msgr2=0x7f855c0fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1924046111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c0fb590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f8558004690 tx=0x7f8558009b30).stop 2022-02-02T14:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 -- 172.21.15.33:0/1924046111 shutdown_connections 2022-02-02T14:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1924046111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 0x7f855c0fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1924046111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c0fb590 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.460+0000 7f8562ddf700 1 -- 172.21.15.33:0/1924046111 >> 172.21.15.33:0/1924046111 conn(0x7f855c0f0b90 msgr2=0x7f855c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.461+0000 7f8562ddf700 1 -- 172.21.15.33:0/1924046111 shutdown_connections 2022-02-02T14:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.461+0000 7f8562ddf700 1 -- 172.21.15.33:0/1924046111 wait complete. 2022-02-02T14:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 Processor -- start 2022-02-02T14:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 -- start start 2022-02-02T14:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 0x7f855c1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c109990 con 0x7f855c060290 2022-02-02T14:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8562ddf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855c109ad0 con 0x7f855c0fba80 2022-02-02T14:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59910/0 (socket says 172.21.15.33:59910) 2022-02-02T14:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 -- 172.21.15.33:0/1712374423 learned_addr learned my addr 172.21.15.33:0/1712374423 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f85615dc700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 0x7f855c1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 -- 172.21.15.33:0/1712374423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 msgr2=0x7f855c1093e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 0x7f855c1093e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.462+0000 7f8561ddd700 1 -- 172.21.15.33:0/1712374423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8558005040 con 0x7f855c060290 2022-02-02T14:10:40.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.463+0000 7f8561ddd700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8558007a40 tx=0x7f8558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.463+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8558018070 con 0x7f855c060290 2022-02-02T14:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.463+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c10a410 con 0x7f855c060290 2022-02-02T14:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.463+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8558009630 con 0x7f855c060290 2022-02-02T14:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.463+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f855801c620 con 0x7f855c060290 2022-02-02T14:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.464+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855c10a970 con 0x7f855c060290 2022-02-02T14:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.464+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f855801d420 con 0x7f855c060290 2022-02-02T14:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.464+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f855c045ad0 con 0x7f855c060290 2022-02-02T14:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.465+0000 7f85527fc700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.465+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8558083760 con 0x7f855c060290 2022-02-02T14:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.465+0000 7f85615dc700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.465+0000 7f85615dc700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 0x7f85480672e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f854c0041d0 tx=0x7f854c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.469+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8558055240 con 0x7f855c060290 2022-02-02T14:10:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.712+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f855c101030 con 0x7f855c060290 2022-02-02T14:10:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.713+0000 7f85527fc700 1 -- 172.21.15.33:0/1712374423 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8558054e30 con 0x7f855c060290 2022-02-02T14:10:40.713 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:10:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:10:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:10:40.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:10:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:10:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:40.715 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:10:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:10:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:10:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:10:40.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:10:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:10:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:10:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:10:40.717 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:10:40.718 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:10:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 msgr2=0x7f85480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 0x7f85480672e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f854c0041d0 tx=0x7f854c009040).stop 2022-02-02T14:10:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 msgr2=0x7f855c108ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f8558007a40 tx=0x7f8558009b30).stop 2022-02-02T14:10:40.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 shutdown_connections 2022-02-02T14:10:40.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8548064e20 0x7f85480672e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f855c060290 0x7f855c108ef0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 --2- 172.21.15.33:0/1712374423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f855c0fba80 0x7f855c1093e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 >> 172.21.15.33:0/1712374423 conn(0x7f855c0f0b90 msgr2=0x7f855c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 shutdown_connections 2022-02-02T14:10:40.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.715+0000 7f8562ddf700 1 -- 172.21.15.33:0/1712374423 wait complete. 2022-02-02T14:10:40.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 -- 172.21.15.33:0/3506050784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 msgr2=0x7fe9980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 --2- 172.21.15.33:0/3506050784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe9980f6cc0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fe980004660 tx=0x7fe980009b30).stop 2022-02-02T14:10:40.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 -- 172.21.15.33:0/3506050784 shutdown_connections 2022-02-02T14:10:40.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 --2- 172.21.15.33:0/3506050784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe9980f6cc0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 --2- 172.21.15.33:0/3506050784 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 0x7fe9980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 -- 172.21.15.33:0/3506050784 >> 172.21.15.33:0/3506050784 conn(0x7fe9980f0d40 msgr2=0x7fe9980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:40.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 -- 172.21.15.33:0/3506050784 shutdown_connections 2022-02-02T14:10:40.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.817+0000 7fe99e14a700 1 -- 172.21.15.33:0/3506050784 wait complete. 2022-02-02T14:10:40.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 Processor -- start 2022-02-02T14:10:40.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 -- start start 2022-02-02T14:10:40.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 0x7fe998109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980603c0 con 0x7fe9980f6860 2022-02-02T14:10:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe99e14a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998060500 con 0x7fe9980f55c0 2022-02-02T14:10:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe996ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe996ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59922/0 (socket says 172.21.15.33:59922) 2022-02-02T14:10:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe996ffd700 1 -- 172.21.15.33:0/4171248655 learned_addr learned my addr 172.21.15.33:0/4171248655 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:10:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.818+0000 7fe9977fe700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 0x7fe998109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe996ffd700 1 -- 172.21.15.33:0/4171248655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 msgr2=0x7fe998109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe996ffd700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 0x7fe998109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe996ffd700 1 -- 172.21.15.33:0/4171248655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe980005040 con 0x7fe9980f6860 2022-02-02T14:10:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe996ffd700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe980009da0 tx=0x7fe980009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe980018070 con 0x7fe9980f6860 2022-02-02T14:10:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99810c6c0 con 0x7fe9980f6860 2022-02-02T14:10:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe980007cf0 con 0x7fe9980f6860 2022-02-02T14:10:40.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe98001c620 con 0x7fe9980f6860 2022-02-02T14:10:40.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.819+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99810cbf0 con 0x7fe9980f6860 2022-02-02T14:10:40.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.820+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998045ad0 con 0x7fe9980f6860 2022-02-02T14:10:40.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.821+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe98001d420 con 0x7fe9980f6860 2022-02-02T14:10:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.821+0000 7fe98ffff700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 0x7fe984067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:10:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.821+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe9800839a0 con 0x7fe9980f6860 2022-02-02T14:10:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.821+0000 7fe9977fe700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 0x7fe984067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:10:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.822+0000 7fe9977fe700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 0x7fe984067270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe998060040 tx=0x7fe988009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:10:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:40.825+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe980051a50 con 0x7fe9980f6860 2022-02-02T14:10:41.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.035+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe9980586e0 con 0x7fe9980f6860 2022-02-02T14:10:41.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.035+0000 7fe98ffff700 1 -- 172.21.15.33:0/4171248655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe980055070 con 0x7fe9980f6860 2022-02-02T14:10:41.036 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:10:41.036 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:10:41.036 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:10:41.036 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:10:41.037 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:41.037 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:10:41.037 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:10:41.037 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:10:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:10:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:10:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:10:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:10:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:10:41.039 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:10:41.039 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:10:41.039 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:10:41.039 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:10:41.040 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:10:41.040 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:10:41.040 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:10:41.040 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:10:41.040 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:10:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:10:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:10:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:10:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:10:41.041 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:10:41.042 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:10:41.042 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:10:41.042 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:10:41.042 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:10:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:41.043 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:10:41.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:10:41.043 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:41.044 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:41.044 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:41.044 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:10:41.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 msgr2=0x7fe984067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:41.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 0x7fe984067270 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7fe998060040 tx=0x7fe988009040).stop 2022-02-02T14:10:41.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 msgr2=0x7fe99810c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:10:41.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fe980009da0 tx=0x7fe980009b30).stop 2022-02-02T14:10:41.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 shutdown_connections 2022-02-02T14:10:41.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe984064db0 0x7fe984067270 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:41.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980f55c0 0x7fe998109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 --2- 172.21.15.33:0/4171248655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9980f6860 0x7fe99810c170 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:10:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 >> 172.21.15.33:0/4171248655 conn(0x7fe9980f0d40 msgr2=0x7fe9980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:10:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.037+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 shutdown_connections 2022-02-02T14:10:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:10:41.038+0000 7fe99e14a700 1 -- 172.21.15.33:0/4171248655 wait complete. 2022-02-02T14:10:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:10:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:41 smithi033 ceph-mon[101165]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:41.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:41 smithi033 ceph-mon[101165]: pgmap v957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:41.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1712374423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:10:41.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4171248655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:10:41.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:41 smithi037 ceph-mon[69017]: from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:41 smithi037 ceph-mon[69017]: pgmap v957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1712374423' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:10:41.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4171248655' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:10:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:42 smithi033 ceph-mon[101165]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:42 smithi037 ceph-mon[69017]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:10:43.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:43 smithi033 ceph-mon[101165]: pgmap v958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:43.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:43 smithi037 ceph-mon[69017]: pgmap v958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:45.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:45 smithi033 ceph-mon[101165]: pgmap v959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:45.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:45 smithi037 ceph-mon[69017]: pgmap v959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:47.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:46 smithi033 ceph-mon[101165]: pgmap v960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:46 smithi037 ceph-mon[69017]: pgmap v960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:49.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:49 smithi033 ceph-mon[101165]: pgmap v961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:49.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:49 smithi037 ceph-mon[69017]: pgmap v961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:51.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:51 smithi033 ceph-mon[101165]: pgmap v962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:51.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:51 smithi037 ceph-mon[69017]: pgmap v962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:53.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:53 smithi033 ceph-mon[101165]: pgmap v963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:53.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:53 smithi037 ceph-mon[69017]: pgmap v963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:55 smithi033 ceph-mon[101165]: pgmap v964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:10:55.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:10:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:55 smithi037 ceph-mon[69017]: pgmap v964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:10:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:10:57.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:56 smithi033 ceph-mon[101165]: pgmap v965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:57.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:56 smithi037 ceph-mon[69017]: pgmap v965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:59.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:10:59 smithi033 ceph-mon[101165]: pgmap v966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:10:59.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:10:59 smithi037 ceph-mon[69017]: pgmap v966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:01.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:01 smithi033 ceph-mon[101165]: pgmap v967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:01.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:01 smithi037 ceph-mon[69017]: pgmap v967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:03 smithi033 ceph-mon[101165]: pgmap v968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:03.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:03 smithi037 ceph-mon[69017]: pgmap v968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:05 smithi033 ceph-mon[101165]: pgmap v969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:05.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:05 smithi037 ceph-mon[69017]: pgmap v969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:07.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:06 smithi033 ceph-mon[101165]: pgmap v970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:07.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:06 smithi037 ceph-mon[69017]: pgmap v970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:09.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:09 smithi033 ceph-mon[101165]: pgmap v971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:09.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:09 smithi037 ceph-mon[69017]: pgmap v971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:11.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 -- 172.21.15.33:0/4213999469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 msgr2=0x7f84a00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 --2- 172.21.15.33:0/4213999469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a00f6b00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f8490004660 tx=0x7f8490009b30).stop 2022-02-02T14:11:11.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 -- 172.21.15.33:0/4213999469 shutdown_connections 2022-02-02T14:11:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 --2- 172.21.15.33:0/4213999469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 0x7f84a00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 --2- 172.21.15.33:0/4213999469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a00f6b00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 -- 172.21.15.33:0/4213999469 >> 172.21.15.33:0/4213999469 conn(0x7f84a00f1e40 msgr2=0x7f84a00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 -- 172.21.15.33:0/4213999469 shutdown_connections 2022-02-02T14:11:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.152+0000 7f84a6307700 1 -- 172.21.15.33:0/4213999469 wait complete. 2022-02-02T14:11:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 Processor -- start 2022-02-02T14:11:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 -- start start 2022-02-02T14:11:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 0x7f84a0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a006a380 con 0x7f84a00f66e0 2022-02-02T14:11:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.153+0000 7f84a6307700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a006a4c0 con 0x7f84a00f7980 2022-02-02T14:11:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59950/0 (socket says 172.21.15.33:59950) 2022-02-02T14:11:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 -- 172.21.15.33:0/3132322576 learned_addr learned my addr 172.21.15.33:0/3132322576 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849f7fe700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 0x7f84a0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 -- 172.21.15.33:0/3132322576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 msgr2=0x7f84a0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 0x7f84a0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 -- 172.21.15.33:0/3132322576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490005040 con 0x7f84a00f66e0 2022-02-02T14:11:11.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.154+0000 7f849ffff700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f8490014040 tx=0x7f849000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.159+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8490019070 con 0x7f84a00f66e0 2022-02-02T14:11:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.159+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8490007e70 con 0x7f84a00f66e0 2022-02-02T14:11:11.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.159+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a006a740 con 0x7f84a00f66e0 2022-02-02T14:11:11.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.159+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8490014d10 con 0x7f84a00f66e0 2022-02-02T14:11:11.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.159+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a006aca0 con 0x7f84a00f66e0 2022-02-02T14:11:11.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.160+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a0045ad0 con 0x7f84a00f66e0 2022-02-02T14:11:11.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.160+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8490025070 con 0x7f84a00f66e0 2022-02-02T14:11:11.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.161+0000 7f849cff9700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 0x7f8488067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.161+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8490082970 con 0x7f84a00f66e0 2022-02-02T14:11:11.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.161+0000 7f849f7fe700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 0x7f8488067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.162+0000 7f849f7fe700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 0x7f8488067290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f8494009fd0 tx=0x7f849400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.165+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8490050a20 con 0x7f84a00f66e0 2022-02-02T14:11:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.354+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f84a0057f10 con 0x7f8488064dd0 2022-02-02T14:11:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.355+0000 7f849cff9700 1 -- 172.21.15.33:0/3132322576 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f84a0057f10 con 0x7f8488064dd0 2022-02-02T14:11:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 msgr2=0x7f8488067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 0x7f8488067290 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f8494009fd0 tx=0x7f849400b040).stop 2022-02-02T14:11:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 msgr2=0x7f84a006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f8490014040 tx=0x7f849000b040).stop 2022-02-02T14:11:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 shutdown_connections 2022-02-02T14:11:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8488064dd0 0x7f8488067290 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84a00f66e0 0x7f84a006b9a0 secure :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0x7f8490014040 tx=0x7f849000b040).stop 2022-02-02T14:11:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 --2- 172.21.15.33:0/3132322576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84a00f7980 0x7f84a0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 >> 172.21.15.33:0/3132322576 conn(0x7f84a00f1e40 msgr2=0x7f84a00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 shutdown_connections 2022-02-02T14:11:11.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.357+0000 7f84a6307700 1 -- 172.21.15.33:0/3132322576 wait complete. 2022-02-02T14:11:11.367 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:11:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 -- 172.21.15.33:0/2005938470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 msgr2=0x7f75800f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 --2- 172.21.15.33:0/2005938470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f5850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f7570004660 tx=0x7f7570009b30).stop 2022-02-02T14:11:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 -- 172.21.15.33:0/2005938470 shutdown_connections 2022-02-02T14:11:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 --2- 172.21.15.33:0/2005938470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 0x7f75800f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 --2- 172.21.15.33:0/2005938470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f5850 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 -- 172.21.15.33:0/2005938470 >> 172.21.15.33:0/2005938470 conn(0x7f75800f0b90 msgr2=0x7f75800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:11.460 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:11 smithi033 ceph-mon[101165]: pgmap v972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 -- 172.21.15.33:0/2005938470 shutdown_connections 2022-02-02T14:11:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.458+0000 7f7584a22700 1 -- 172.21.15.33:0/2005938470 wait complete. 2022-02-02T14:11:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 Processor -- start 2022-02-02T14:11:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 -- start start 2022-02-02T14:11:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 0x7f75800f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800f7f70 con 0x7f75800f5430 2022-02-02T14:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.459+0000 7f7584a22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800f80b0 con 0x7f75800f66d0 2022-02-02T14:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59960/0 (socket says 172.21.15.33:59960) 2022-02-02T14:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 -- 172.21.15.33:0/3566854439 learned_addr learned my addr 172.21.15.33:0/3566854439 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757e59c700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 0x7f75800f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 -- 172.21.15.33:0/3566854439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 msgr2=0x7f75800f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 0x7f75800f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 -- 172.21.15.33:0/3566854439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7570005040 con 0x7f75800f5430 2022-02-02T14:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f757ed9d700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7570013a70 tx=0x7f7570009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7570018070 con 0x7f75800f5430 2022-02-02T14:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75700097d0 con 0x7f75800f5430 2022-02-02T14:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f757001de80 con 0x7f75800f5430 2022-02-02T14:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75800f8330 con 0x7f75800f5430 2022-02-02T14:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.460+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75800f8890 con 0x7f75800f5430 2022-02-02T14:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.462+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7570007ba0 con 0x7f75800f5430 2022-02-02T14:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.462+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580045ad0 con 0x7f75800f5430 2022-02-02T14:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.462+0000 7f75677fe700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 0x7f75680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.462+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f75700835f0 con 0x7f75800f5430 2022-02-02T14:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.462+0000 7f757e59c700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 0x7f75680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.463+0000 7f757e59c700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 0x7f75680672e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7574004d80 tx=0x7f757400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.467+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7570051810 con 0x7f75800f5430 2022-02-02T14:11:11.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:11 smithi037 ceph-mon[69017]: pgmap v972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:11.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.648+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75800fab10 con 0x7f7568064e20 2022-02-02T14:11:11.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.663+0000 7f75677fe700 1 -- 172.21.15.33:0/3566854439 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f75800fab10 con 0x7f7568064e20 2022-02-02T14:11:11.663 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:11:11.663 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (36m) 8m ago 37m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:11:11.664 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (29m) 8m ago 37m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:11:11.664 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (29m) 8m ago 36m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:11:11.665 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (36m) 8m ago 37m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:11:11.665 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (29m) 8m ago 33m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:11:11.665 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (30m) 8m ago 33m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:11:11.666 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (31m) 8m ago 33m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:11:11.666 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (33m) 8m ago 33m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:11:11.667 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (31m) 8m ago 38m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:11:11.667 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (30m) 8m ago 36m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:11:11.667 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (30m) 8m ago 38m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:11:11.668 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (30m) 8m ago 36m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:11:11.668 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (37m) 8m ago 37m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:11:11.669 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (36m) 8m ago 36m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:11:11.669 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8m ago 36m - 4096M 2022-02-02T14:11:11.669 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (35m) 8m ago 35m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:11:11.670 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (35m) 8m ago 35m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:11:11.670 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (35m) 8m ago 35m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:11:11.671 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (35m) 8m ago 35m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:11:11.671 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (34m) 8m ago 34m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:11:11.672 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (36m) 8m ago 37m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:11:11.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 msgr2=0x7f75680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 0x7f75680672e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7574004d80 tx=0x7f757400b040).stop 2022-02-02T14:11:11.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 msgr2=0x7f75800f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f7570013a70 tx=0x7f7570009b30).stop 2022-02-02T14:11:11.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 shutdown_connections 2022-02-02T14:11:11.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7568064e20 0x7f75680672e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75800f5430 0x7f75800f9590 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 --2- 172.21.15.33:0/3566854439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75800f66d0 0x7f75800f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 >> 172.21.15.33:0/3566854439 conn(0x7f75800f0b90 msgr2=0x7f758005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 shutdown_connections 2022-02-02T14:11:11.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.665+0000 7f7584a22700 1 -- 172.21.15.33:0/3566854439 wait complete. 2022-02-02T14:11:11.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 -- 172.21.15.33:0/3168054184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f6860 msgr2=0x7f70f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 --2- 172.21.15.33:0/3168054184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f6860 0x7f70f80f6cc0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f70f4004660 tx=0x7f70f4009b30).stop 2022-02-02T14:11:11.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 -- 172.21.15.33:0/3168054184 shutdown_connections 2022-02-02T14:11:11.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 --2- 172.21.15.33:0/3168054184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f6860 0x7f70f80f6cc0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 --2- 172.21.15.33:0/3168054184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f55c0 0x7f70f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 -- 172.21.15.33:0/3168054184 >> 172.21.15.33:0/3168054184 conn(0x7f70f80f0d40 msgr2=0x7f70f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:11.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 -- 172.21.15.33:0/3168054184 shutdown_connections 2022-02-02T14:11:11.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.765+0000 7f70ff83a700 1 -- 172.21.15.33:0/3168054184 wait complete. 2022-02-02T14:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 Processor -- start 2022-02-02T14:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 -- start start 2022-02-02T14:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 0x7f70f8109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8109c10 con 0x7f70f80f55c0 2022-02-02T14:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70ff83a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f8109d50 con 0x7f70f80f6860 2022-02-02T14:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70fd5d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70fd5d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59970/0 (socket says 172.21.15.33:59970) 2022-02-02T14:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.766+0000 7f70fd5d6700 1 -- 172.21.15.33:0/2041632719 learned_addr learned my addr 172.21.15.33:0/2041632719 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fcdd5700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 0x7f70f8109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fd5d6700 1 -- 172.21.15.33:0/2041632719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 msgr2=0x7f70f8109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fd5d6700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 0x7f70f8109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fd5d6700 1 -- 172.21.15.33:0/2041632719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4005040 con 0x7f70f80f55c0 2022-02-02T14:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fcdd5700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 0x7f70f8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70fd5d6700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f70e800c530 tx=0x7f70e8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e800f650 con 0x7f70f80f55c0 2022-02-02T14:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f70e800fc60 con 0x7f70f80f55c0 2022-02-02T14:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70e8012d20 con 0x7f70f80f55c0 2022-02-02T14:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.767+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f810a6f0 con 0x7f70f80f55c0 2022-02-02T14:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.768+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f810ac60 con 0x7f70f80f55c0 2022-02-02T14:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.768+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f8045ad0 con 0x7f70f80f55c0 2022-02-02T14:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.769+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f70e8019030 con 0x7f70f80f55c0 2022-02-02T14:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.769+0000 7f70edffb700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 0x7f70e4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.769+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f70e8081700 con 0x7f70f80f55c0 2022-02-02T14:11:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.769+0000 7f70fcdd5700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 0x7f70e4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.770+0000 7f70fcdd5700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 0x7f70e4067270 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f70f4004630 tx=0x7f70f4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:11.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:11.773+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f70e8053230 con 0x7f70f80f55c0 2022-02-02T14:11:12.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.019+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f70f810f790 con 0x7f70f80f55c0 2022-02-02T14:11:12.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.020+0000 7f70edffb700 1 -- 172.21.15.33:0/2041632719 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f70e8052e20 con 0x7f70f80f55c0 2022-02-02T14:11:12.020 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:11:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:11:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:11:12.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:11:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:11:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:12.021 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:11:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:11:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:11:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:11:12.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:11:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:11:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:11:12.023 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:11:12.024 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:11:12.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 msgr2=0x7f70e4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 0x7f70e4067270 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f70f4004630 tx=0x7f70f4009b30).stop 2022-02-02T14:11:12.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 msgr2=0x7f70f8109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f70e800c530 tx=0x7f70e8007e10).stop 2022-02-02T14:11:12.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 shutdown_connections 2022-02-02T14:11:12.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f70e4064db0 0x7f70e4067270 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70f80f55c0 0x7f70f8109170 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 --2- 172.21.15.33:0/2041632719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f80f6860 0x7f70f8109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.021+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 >> 172.21.15.33:0/2041632719 conn(0x7f70f80f0d40 msgr2=0x7f70f805f600 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:12.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.022+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 shutdown_connections 2022-02-02T14:11:12.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.022+0000 7f70ff83a700 1 -- 172.21.15.33:0/2041632719 wait complete. 2022-02-02T14:11:12.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 -- 172.21.15.33:0/3964233975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f66e0 msgr2=0x7f90c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 --2- 172.21.15.33:0/3964233975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f66e0 0x7f90c00f6b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f90b4004660 tx=0x7f90b4009b30).stop 2022-02-02T14:11:12.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 -- 172.21.15.33:0/3964233975 shutdown_connections 2022-02-02T14:11:12.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 --2- 172.21.15.33:0/3964233975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f7980 0x7f90c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 --2- 172.21.15.33:0/3964233975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f66e0 0x7f90c00f6b00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 -- 172.21.15.33:0/3964233975 >> 172.21.15.33:0/3964233975 conn(0x7f90c00f1e40 msgr2=0x7f90c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:12.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 -- 172.21.15.33:0/3964233975 shutdown_connections 2022-02-02T14:11:12.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.123+0000 7f90c5a49700 1 -- 172.21.15.33:0/3964233975 wait complete. 2022-02-02T14:11:12.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 Processor -- start 2022-02-02T14:11:12.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 -- start start 2022-02-02T14:11:12.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f66e0 0x7f90c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c006a380 con 0x7f90c00f7980 2022-02-02T14:11:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90c5a49700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c006a4c0 con 0x7f90c00f66e0 2022-02-02T14:11:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90be7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90be7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59982/0 (socket says 172.21.15.33:59982) 2022-02-02T14:11:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.124+0000 7f90be7fc700 1 -- 172.21.15.33:0/1711905124 learned_addr learned my addr 172.21.15.33:0/1711905124 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90beffd700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f66e0 0x7f90c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90be7fc700 1 -- 172.21.15.33:0/1711905124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f66e0 msgr2=0x7f90c006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90be7fc700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f66e0 0x7f90c006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90be7fc700 1 -- 172.21.15.33:0/1711905124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4005040 con 0x7f90c00f7980 2022-02-02T14:11:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90be7fc700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f90b000c530 tx=0x7f90b0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b000f650 con 0x7f90c00f7980 2022-02-02T14:11:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90b000fc60 con 0x7f90c00f7980 2022-02-02T14:11:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c006a7a0 con 0x7f90c00f7980 2022-02-02T14:11:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90b0012cd0 con 0x7f90c00f7980 2022-02-02T14:11:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.125+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c010efe0 con 0x7f90c00f7980 2022-02-02T14:11:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.126+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c0045ad0 con 0x7f90c00f7980 2022-02-02T14:11:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.127+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f90b0010070 con 0x7f90c00f7980 2022-02-02T14:11:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.127+0000 7f90a77fe700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 0x7f90a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.127+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f90b0081800 con 0x7f90c00f7980 2022-02-02T14:11:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.127+0000 7f90beffd700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 0x7f90a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.128+0000 7f90beffd700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 0x7f90a8067290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f90b4004e30 tx=0x7f90b4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.131+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f90b004f8b0 con 0x7f90c00f7980 2022-02-02T14:11:12.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.345+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f90c0027a00 con 0x7f90c00f7980 2022-02-02T14:11:12.346 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2041632719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:11:12.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.346+0000 7f90a77fe700 1 -- 172.21.15.33:0/1711905124 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f90b0052ed0 con 0x7f90c00f7980 2022-02-02T14:11:12.347 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:11:12.347 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:11:12.347 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:11:12.347 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:11:12.347 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:12.348 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:11:12.348 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:11:12.349 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:11:12.349 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:11:12.349 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:11:12.349 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:11:12.349 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:11:12.350 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:11:12.350 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:11:12.350 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:11:12.350 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:11:12.351 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:11:12.351 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:11:12.351 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:11:12.351 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:11:12.352 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:11:12.352 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:11:12.352 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:11:12.352 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:11:12.352 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:11:12.353 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:11:12.353 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:11:12.353 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:11:12.353 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:11:12.354 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:11:12.354 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:11:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:12.354 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:12.355 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:11:12.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:12.355 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:12.355 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:12.355 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:12.356 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 msgr2=0x7f90a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 0x7f90a8067290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f90b4004e30 tx=0x7f90b4009b30).stop 2022-02-02T14:11:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 msgr2=0x7f90c0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:12.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f90b000c530 tx=0x7f90b0007e20).stop 2022-02-02T14:11:12.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 shutdown_connections 2022-02-02T14:11:12.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90a8064dd0 0x7f90a8067290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90c00f66e0 0x7f90c006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 --2- 172.21.15.33:0/1711905124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90c00f7980 0x7f90c0069e20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:12.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 >> 172.21.15.33:0/1711905124 conn(0x7f90c00f1e40 msgr2=0x7f90c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:12.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 shutdown_connections 2022-02-02T14:11:12.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:12.348+0000 7f90c5a49700 1 -- 172.21.15.33:0/1711905124 wait complete. 2022-02-02T14:11:12.360 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:11:12.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2041632719' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:11:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:13 smithi033 ceph-mon[101165]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:13.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:13 smithi033 ceph-mon[101165]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:13.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:13 smithi033 ceph-mon[101165]: pgmap v973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:13.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1711905124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:11:13.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:13 smithi037 ceph-mon[69017]: from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:13.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:13 smithi037 ceph-mon[69017]: from='client.35082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:13.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:13 smithi037 ceph-mon[69017]: pgmap v973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:13.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1711905124' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:11:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:15 smithi033 ceph-mon[101165]: pgmap v974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:15.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:15 smithi037 ceph-mon[69017]: pgmap v974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:17.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:16 smithi037 ceph-mon[69017]: pgmap v975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:17.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:16 smithi033 ceph-mon[101165]: pgmap v975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:19.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:19 smithi033 ceph-mon[101165]: pgmap v976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:19.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:19 smithi037 ceph-mon[69017]: pgmap v976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:21 smithi033 ceph-mon[101165]: pgmap v977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:21.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:21 smithi037 ceph-mon[69017]: pgmap v977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:23 smithi033 ceph-mon[101165]: pgmap v978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:23 smithi037 ceph-mon[69017]: pgmap v978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:25.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:25 smithi033 ceph-mon[101165]: pgmap v979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:25.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:25 smithi037 ceph-mon[69017]: pgmap v979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:27.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:26 smithi037 ceph-mon[69017]: pgmap v980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:27.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:26 smithi033 ceph-mon[101165]: pgmap v980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:29.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:29 smithi033 ceph-mon[101165]: pgmap v981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:29.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:29 smithi037 ceph-mon[69017]: pgmap v981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:11:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:11:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:30 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:11:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:11:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:11:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:30 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:11:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:31 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:11:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:31 smithi033 ceph-mon[101165]: pgmap v982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:11:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:11:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:11:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:31 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:11:31.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:31 smithi037 ceph-mon[69017]: pgmap v982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:31.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:11:31.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2022-02-02T14:11:31.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:11:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:32 smithi033 ceph-mon[101165]: pgmap v983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:32.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:32 smithi033 ceph-mon[101165]: pgmap v984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:32 smithi037 ceph-mon[69017]: pgmap v983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:32.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:32 smithi037 ceph-mon[69017]: pgmap v984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:34 smithi033 ceph-mon[101165]: pgmap v985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:34 smithi037 ceph-mon[69017]: pgmap v985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:35.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:35 smithi033 ceph-mon[101165]: pgmap v986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:35.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:35 smithi037 ceph-mon[69017]: pgmap v986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:38.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:37 smithi037 ceph-mon[69017]: pgmap v987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:37 smithi033 ceph-mon[101165]: pgmap v987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:40.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:39 smithi037 ceph-mon[69017]: pgmap v988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:40.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:39 smithi033 ceph-mon[101165]: pgmap v988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:42 smithi037 ceph-mon[69017]: pgmap v989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:42.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 -- 172.21.15.33:0/706278600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc80fba80 msgr2=0x7fccc80fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/706278600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc80fba80 0x7fccc80fde70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fccbc004690 tx=0x7fccbc009b30).stop 2022-02-02T14:11:42.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 -- 172.21.15.33:0/706278600 shutdown_connections 2022-02-02T14:11:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/706278600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc80fba80 0x7fccc80fde70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/706278600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc8060290 0x7fccc80fb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.464+0000 7fcccc9a4700 1 -- 172.21.15.33:0/706278600 >> 172.21.15.33:0/706278600 conn(0x7fccc80f0b90 msgr2=0x7fccc80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:42.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.465+0000 7fcccc9a4700 1 -- 172.21.15.33:0/706278600 shutdown_connections 2022-02-02T14:11:42.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.465+0000 7fcccc9a4700 1 -- 172.21.15.33:0/706278600 wait complete. 2022-02-02T14:11:42.467 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:42 smithi033 ceph-mon[101165]: pgmap v989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:42.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.465+0000 7fcccc9a4700 1 Processor -- start 2022-02-02T14:11:42.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.465+0000 7fcccc9a4700 1 -- start start 2022-02-02T14:11:42.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fcccc9a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fcccc9a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc80fba80 0x7fccc81093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fcccc9a4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8109970 con 0x7fccc8060290 2022-02-02T14:11:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fcccc9a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc8109ab0 con 0x7fccc80fba80 2022-02-02T14:11:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59992/0 (socket says 172.21.15.33:59992) 2022-02-02T14:11:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 -- 172.21.15.33:0/2217421322 learned_addr learned my addr 172.21.15.33:0/2217421322 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc659c700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc80fba80 0x7fccc81093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 -- 172.21.15.33:0/2217421322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc80fba80 msgr2=0x7fccc81093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc80fba80 0x7fccc81093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 -- 172.21.15.33:0/2217421322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc005040 con 0x7fccc8060290 2022-02-02T14:11:42.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.466+0000 7fccc6d9d700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fccb80026d0 tx=0x7fccb8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:42.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.467+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb80079c0 con 0x7fccc8060290 2022-02-02T14:11:42.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.467+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fccb800f040 con 0x7fccc8060290 2022-02-02T14:11:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.467+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc810a450 con 0x7fccc8060290 2022-02-02T14:11:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.467+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb80148b0 con 0x7fccc8060290 2022-02-02T14:11:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.467+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc810aa10 con 0x7fccc8060290 2022-02-02T14:11:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.468+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc8045ad0 con 0x7fccc8060290 2022-02-02T14:11:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.468+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fccb8007b20 con 0x7fccc8060290 2022-02-02T14:11:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.469+0000 7fccaf7fe700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 0x7fccb00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.469+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fccb8081a30 con 0x7fccc8060290 2022-02-02T14:11:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.469+0000 7fccc659c700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 0x7fccb00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.469+0000 7fccc659c700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 0x7fccb00672e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fccbc005010 tx=0x7fccbc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:42.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.473+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fccb8053510 con 0x7fccc8060290 2022-02-02T14:11:42.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.661+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fccc810ac90 con 0x7fccb0064e20 2022-02-02T14:11:42.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.663+0000 7fccaf7fe700 1 -- 172.21.15.33:0/2217421322 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fccc810ac90 con 0x7fccb0064e20 2022-02-02T14:11:42.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 msgr2=0x7fccb00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 0x7fccb00672e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fccbc005010 tx=0x7fccbc009b30).stop 2022-02-02T14:11:42.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 msgr2=0x7fccc8108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fccb80026d0 tx=0x7fccb8009de0).stop 2022-02-02T14:11:42.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 shutdown_connections 2022-02-02T14:11:42.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccb0064e20 0x7fccb00672e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccc8060290 0x7fccc8108ed0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 --2- 172.21.15.33:0/2217421322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc80fba80 0x7fccc81093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 >> 172.21.15.33:0/2217421322 conn(0x7fccc80f0b90 msgr2=0x7fccc80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:42.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.664+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 shutdown_connections 2022-02-02T14:11:42.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.665+0000 7fcccc9a4700 1 -- 172.21.15.33:0/2217421322 wait complete. 2022-02-02T14:11:42.674 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:11:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 -- 172.21.15.33:0/3003230576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f66d0 msgr2=0x7f17e80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3003230576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f66d0 0x7f17e80f6b30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f17d0004660 tx=0x7f17d0009b30).stop 2022-02-02T14:11:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 -- 172.21.15.33:0/3003230576 shutdown_connections 2022-02-02T14:11:42.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3003230576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f66d0 0x7f17e80f6b30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3003230576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f5430 0x7f17e80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 -- 172.21.15.33:0/3003230576 >> 172.21.15.33:0/3003230576 conn(0x7f17e80f0b90 msgr2=0x7f17e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 -- 172.21.15.33:0/3003230576 shutdown_connections 2022-02-02T14:11:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.767+0000 7f17e7fff700 1 -- 172.21.15.33:0/3003230576 wait complete. 2022-02-02T14:11:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 Processor -- start 2022-02-02T14:11:42.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 -- start start 2022-02-02T14:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f66d0 0x7f17e810bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e80603c0 con 0x7f17e80f5430 2022-02-02T14:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e7fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e8060500 con 0x7f17e80f66d0 2022-02-02T14:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60002/0 (socket says 172.21.15.33:60002) 2022-02-02T14:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 -- 172.21.15.33:0/3731551900 learned_addr learned my addr 172.21.15.33:0/3731551900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e67fc700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f66d0 0x7f17e810bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 -- 172.21.15.33:0/3731551900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f66d0 msgr2=0x7f17e810bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f66d0 0x7f17e810bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 -- 172.21.15.33:0/3731551900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0005040 con 0x7f17e80f5430 2022-02-02T14:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.768+0000 7f17e6ffd700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f17d800e7c0 tx=0x7f17d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.769+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d80092e0 con 0x7f17e80f5430 2022-02-02T14:11:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.769+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f17d800f040 con 0x7f17e80f5430 2022-02-02T14:11:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.769+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e810c4a0 con 0x7f17e80f5430 2022-02-02T14:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.769+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17d80147e0 con 0x7f17e80f5430 2022-02-02T14:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.769+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e810ca30 con 0x7f17e80f5430 2022-02-02T14:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.770+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e8059100 con 0x7f17e80f5430 2022-02-02T14:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.770+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f17d801b030 con 0x7f17e80f5430 2022-02-02T14:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.771+0000 7f17df7fe700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 0x7f17d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.771+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f17d8081a00 con 0x7f17e80f5430 2022-02-02T14:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.771+0000 7f17e67fc700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 0x7f17d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.771+0000 7f17e67fc700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 0x7f17d40672e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f17d0005010 tx=0x7f17d0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.775+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f17d804fab0 con 0x7f17e80f5430 2022-02-02T14:11:42.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.957+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f17e80fdd80 con 0x7f17d4064e20 2022-02-02T14:11:42.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.972+0000 7f17df7fe700 1 -- 172.21.15.33:0/3731551900 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f17e80fdd80 con 0x7f17d4064e20 2022-02-02T14:11:42.972 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:11:42.972 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (37m) 9m ago 38m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:11:42.972 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (30m) 9m ago 37m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:11:42.973 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (29m) 9m ago 37m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:11:42.973 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (36m) 9m ago 37m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:11:42.973 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (30m) 9m ago 34m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:11:42.973 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (31m) 9m ago 34m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:11:42.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (31m) 9m ago 34m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:11:42.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (34m) 9m ago 34m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:11:42.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (31m) 9m ago 39m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:11:42.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (31m) 9m ago 37m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:11:42.975 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (30m) 9m ago 39m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:11:42.975 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (30m) 9m ago 37m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:11:42.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (37m) 9m ago 37m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:11:42.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (37m) 9m ago 37m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:11:42.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 36m - 4096M 2022-02-02T14:11:42.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (36m) 9m ago 36m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:11:42.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (36m) 9m ago 36m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:11:42.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (35m) 9m ago 35m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:11:42.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (35m) 9m ago 35m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:11:42.978 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (35m) 9m ago 35m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:11:42.978 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (36m) 9m ago 37m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:11:42.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 msgr2=0x7f17d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 0x7f17d40672e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f17d0005010 tx=0x7f17d0016040).stop 2022-02-02T14:11:42.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 msgr2=0x7f17e81099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:42.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f17d800e7c0 tx=0x7f17d800b040).stop 2022-02-02T14:11:42.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 shutdown_connections 2022-02-02T14:11:42.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f17d4064e20 0x7f17d40672e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17e80f5430 0x7f17e81099f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 --2- 172.21.15.33:0/3731551900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17e80f66d0 0x7f17e810bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:42.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 >> 172.21.15.33:0/3731551900 conn(0x7f17e80f0b90 msgr2=0x7f17e80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:42.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 shutdown_connections 2022-02-02T14:11:42.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:42.974+0000 7f17e7fff700 1 -- 172.21.15.33:0/3731551900 wait complete. 2022-02-02T14:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 -- 172.21.15.33:0/2262584045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 msgr2=0x7fb8c80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/2262584045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c80f59e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fb8c4004660 tx=0x7fb8c4009b30).stop 2022-02-02T14:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 -- 172.21.15.33:0/2262584045 shutdown_connections 2022-02-02T14:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/2262584045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 0x7fb8c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/2262584045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c80f59e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 -- 172.21.15.33:0/2262584045 >> 172.21.15.33:0/2262584045 conn(0x7fb8c80f0d40 msgr2=0x7fb8c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 -- 172.21.15.33:0/2262584045 shutdown_connections 2022-02-02T14:11:43.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.074+0000 7fb8cfee8700 1 -- 172.21.15.33:0/2262584045 wait complete. 2022-02-02T14:11:43.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 Processor -- start 2022-02-02T14:11:43.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 -- start start 2022-02-02T14:11:43.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 0x7fb8c8106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8106910 con 0x7fb8c80f55c0 2022-02-02T14:11:43.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cfee8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c8106a50 con 0x7fb8c80f6860 2022-02-02T14:11:43.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60012/0 (socket says 172.21.15.33:60012) 2022-02-02T14:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 -- 172.21.15.33:0/1727341181 learned_addr learned my addr 172.21.15.33:0/1727341181 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cd483700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 0x7fb8c8106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 -- 172.21.15.33:0/1727341181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 msgr2=0x7fb8c8106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 0x7fb8c8106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 -- 172.21.15.33:0/1727341181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c4005040 con 0x7fb8c80f55c0 2022-02-02T14:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.075+0000 7fb8cdc84700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fb8c4000c00 tx=0x7fb8c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.076+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c4018070 con 0x7fb8c80f55c0 2022-02-02T14:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.076+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb8c4007d70 con 0x7fb8c80f55c0 2022-02-02T14:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.076+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c8107390 con 0x7fb8c80f55c0 2022-02-02T14:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.076+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8c401c620 con 0x7fb8c80f55c0 2022-02-02T14:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.076+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c81078f0 con 0x7fb8c80f55c0 2022-02-02T14:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.077+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c8045ad0 con 0x7fb8c80f55c0 2022-02-02T14:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.077+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb8c401c860 con 0x7fb8c80f55c0 2022-02-02T14:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.078+0000 7fb8ba7fc700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 0x7fb8b4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.078+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb8c4083940 con 0x7fb8c80f55c0 2022-02-02T14:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.078+0000 7fb8cd483700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 0x7fb8b4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.078+0000 7fb8cd483700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 0x7fb8b4067270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb8bc0041d0 tx=0x7fb8bc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.082+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb8c4055420 con 0x7fb8c80f55c0 2022-02-02T14:11:43.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.323+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb8c80fdf00 con 0x7fb8c80f55c0 2022-02-02T14:11:43.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.324+0000 7fb8ba7fc700 1 -- 172.21.15.33:0/1727341181 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb8c4055010 con 0x7fb8c80f55c0 2022-02-02T14:11:43.324 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:11:43.324 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:11:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:11:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:11:43.325 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:11:43.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:43.326 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:11:43.326 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:11:43.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:43.327 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:11:43.327 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:11:43.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:11:43.327 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:11:43.327 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:11:43.328 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:11:43.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:11:43.328 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:11:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 msgr2=0x7fb8b4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 0x7fb8b4067270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb8bc0041d0 tx=0x7fb8bc009040).stop 2022-02-02T14:11:43.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 msgr2=0x7fb8c8105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fb8c4000c00 tx=0x7fb8c4009b30).stop 2022-02-02T14:11:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 shutdown_connections 2022-02-02T14:11:43.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb8b4064db0 0x7fb8b4067270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8c80f55c0 0x7fb8c8105e70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 --2- 172.21.15.33:0/1727341181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8c80f6860 0x7fb8c8106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 >> 172.21.15.33:0/1727341181 conn(0x7fb8c80f0d40 msgr2=0x7fb8c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:43.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 shutdown_connections 2022-02-02T14:11:43.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.326+0000 7fb8cfee8700 1 -- 172.21.15.33:0/1727341181 wait complete. 2022-02-02T14:11:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 -- 172.21.15.33:0/1801840895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180f9860 msgr2=0x7fb7180fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/1801840895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180f9860 0x7fb7180fbc70 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7fb700004660 tx=0x7fb700009b30).stop 2022-02-02T14:11:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 -- 172.21.15.33:0/1801840895 shutdown_connections 2022-02-02T14:11:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/1801840895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180f9860 0x7fb7180fbc70 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/1801840895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180602d0 0x7fb7180f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 -- 172.21.15.33:0/1801840895 >> 172.21.15.33:0/1801840895 conn(0x7fb7180f0d40 msgr2=0x7fb7180f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 -- 172.21.15.33:0/1801840895 shutdown_connections 2022-02-02T14:11:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.427+0000 7fb71cc2e700 1 -- 172.21.15.33:0/1801840895 wait complete. 2022-02-02T14:11:43.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 Processor -- start 2022-02-02T14:11:43.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 -- start start 2022-02-02T14:11:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180f9860 0x7fb7180f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180f5740 con 0x7fb7180602d0 2022-02-02T14:11:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71cc2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7180f5880 con 0x7fb7180f9860 2022-02-02T14:11:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60022/0 (socket says 172.21.15.33:60022) 2022-02-02T14:11:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.428+0000 7fb71659c700 1 -- 172.21.15.33:0/3696731573 learned_addr learned my addr 172.21.15.33:0/3696731573 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:11:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb715d9b700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180f9860 0x7fb7180f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71659c700 1 -- 172.21.15.33:0/3696731573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180f9860 msgr2=0x7fb7180f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71659c700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180f9860 0x7fb7180f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71659c700 1 -- 172.21.15.33:0/3696731573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700005040 con 0x7fb7180602d0 2022-02-02T14:11:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71659c700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb70800d8a0 tx=0x7fb708004f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70800b5a0 con 0x7fb7180602d0 2022-02-02T14:11:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb70800f040 con 0x7fb7180602d0 2022-02-02T14:11:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7180f5b60 con 0x7fb7180602d0 2022-02-02T14:11:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71810eef0 con 0x7fb7180602d0 2022-02-02T14:11:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.429+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb708013b40 con 0x7fb7180602d0 2022-02-02T14:11:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.430+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6fc004fa0 con 0x7fb7180602d0 2022-02-02T14:11:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.431+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb70801a030 con 0x7fb7180602d0 2022-02-02T14:11:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.431+0000 7fb70effd700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 0x7fb704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:11:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.431+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb708081830 con 0x7fb7180602d0 2022-02-02T14:11:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.431+0000 7fb715d9b700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 0x7fb704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:11:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.432+0000 7fb715d9b700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 0x7fb704067290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb700004630 tx=0x7fb700009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:11:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.436+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb70804f990 con 0x7fb7180602d0 2022-02-02T14:11:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.646+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6fc005e80 con 0x7fb7180602d0 2022-02-02T14:11:43.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.646+0000 7fb70effd700 1 -- 172.21.15.33:0/3696731573 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb708018020 con 0x7fb7180602d0 2022-02-02T14:11:43.655 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:11:43.656 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:11:43.656 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:11:43.656 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:11:43.656 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:11:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:11:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:11:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:11:43.657 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:11:43.658 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:11:43.658 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:11:43.658 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:11:43.659 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:11:43.659 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:11:43.660 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:11:43.660 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:11:43.661 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:11:43.661 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:11:43.662 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:11:43.663 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:11:43.663 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:11:43.663 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:11:43.663 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:11:43.664 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:11:43.664 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:11:43.664 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:11:43.664 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:11:43.665 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:11:43.665 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:11:43.665 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:11:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:43.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:43.666 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:11:43.666 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:11:43.666 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:43.666 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:43.667 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:43.667 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:11:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 msgr2=0x7fb704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 0x7fb704067290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fb700004630 tx=0x7fb700009b30).stop 2022-02-02T14:11:43.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 msgr2=0x7fb7180f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:11:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fb70800d8a0 tx=0x7fb708004f00).stop 2022-02-02T14:11:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 shutdown_connections 2022-02-02T14:11:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb704064dd0 0x7fb704067290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.649+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7180602d0 0x7fb7180f6d60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.650+0000 7fb71cc2e700 1 --2- 172.21.15.33:0/3696731573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7180f9860 0x7fb7180f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:11:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.650+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 >> 172.21.15.33:0/3696731573 conn(0x7fb7180f0d40 msgr2=0x7fb7180f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:11:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.650+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 shutdown_connections 2022-02-02T14:11:43.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:11:43.650+0000 7fb71cc2e700 1 -- 172.21.15.33:0/3696731573 wait complete. 2022-02-02T14:11:43.671 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:11:44.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:44 smithi037 ceph-mon[69017]: pgmap v990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:44.298 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:44 smithi037 ceph-mon[69017]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:44.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:44 smithi037 ceph-mon[69017]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:44.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1727341181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:11:44.299 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3696731573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:11:44.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:44 smithi033 ceph-mon[101165]: pgmap v990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:44.496 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:44 smithi033 ceph-mon[101165]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:44.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:44 smithi033 ceph-mon[101165]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:11:44.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1727341181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:11:44.497 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3696731573' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:11:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:46 smithi033 ceph-mon[101165]: pgmap v991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:46 smithi037 ceph-mon[69017]: pgmap v991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:48 smithi037 ceph-mon[69017]: pgmap v992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:48 smithi033 ceph-mon[101165]: pgmap v992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:50 smithi037 ceph-mon[69017]: pgmap v993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:50 smithi033 ceph-mon[101165]: pgmap v993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:52.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:52 smithi037 ceph-mon[69017]: pgmap v994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:52 smithi033 ceph-mon[101165]: pgmap v994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:54.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:54 smithi037 ceph-mon[69017]: pgmap v995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:54 smithi033 ceph-mon[101165]: pgmap v995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:11:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:11:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:11:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:11:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:56 smithi033 ceph-mon[101165]: pgmap v996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:56 smithi037 ceph-mon[69017]: pgmap v996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:58.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:11:58 smithi037 ceph-mon[69017]: pgmap v997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:11:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:11:58 smithi033 ceph-mon[101165]: pgmap v997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:00 smithi037 ceph-mon[69017]: pgmap v998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:00 smithi033 ceph-mon[101165]: pgmap v998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:02.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:02 smithi037 ceph-mon[69017]: pgmap v999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:02 smithi033 ceph-mon[101165]: pgmap v999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:04.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:04 smithi037 ceph-mon[69017]: pgmap v1000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:04 smithi033 ceph-mon[101165]: pgmap v1000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:06 smithi033 ceph-mon[101165]: pgmap v1001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:06.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:06 smithi037 ceph-mon[69017]: pgmap v1001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:08 smithi033 ceph-mon[101165]: pgmap v1002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:08 smithi037 ceph-mon[69017]: pgmap v1002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:10 smithi033 ceph-mon[101165]: pgmap v1003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:10 smithi037 ceph-mon[69017]: pgmap v1003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:12 smithi033 ceph-mon[101165]: pgmap v1004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:12 smithi037 ceph-mon[69017]: pgmap v1004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:13.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 -- 172.21.15.33:0/4095046599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 msgr2=0x7fd8dc0f7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 --2- 172.21.15.33:0/4095046599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f7ac0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fd8c4004660 tx=0x7fd8c4009b30).stop 2022-02-02T14:12:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 -- 172.21.15.33:0/4095046599 shutdown_connections 2022-02-02T14:12:13.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 --2- 172.21.15.33:0/4095046599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f7ac0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 --2- 172.21.15.33:0/4095046599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 0x7fd8dc0f4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 -- 172.21.15.33:0/4095046599 >> 172.21.15.33:0/4095046599 conn(0x7fd8dc0f04c0 msgr2=0x7fd8dc0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 -- 172.21.15.33:0/4095046599 shutdown_connections 2022-02-02T14:12:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 -- 172.21.15.33:0/4095046599 wait complete. 2022-02-02T14:12:13.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.766+0000 7fd8e1334700 1 Processor -- start 2022-02-02T14:12:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8e1334700 1 -- start start 2022-02-02T14:12:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8e1334700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 0x7fd8dc0f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:13.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8e1334700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8e1334700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0f5f30 con 0x7fd8dc0f5340 2022-02-02T14:12:13.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8e1334700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0f6070 con 0x7fd8dc0f49a0 2022-02-02T14:12:13.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:13.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60034/0 (socket says 172.21.15.33:60034) 2022-02-02T14:12:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 -- 172.21.15.33:0/1661736089 learned_addr learned my addr 172.21.15.33:0/1661736089 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:13.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8daffd700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 0x7fd8dc0f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:13.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 -- 172.21.15.33:0/1661736089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 msgr2=0x7fd8dc0f7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:13.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 0x7fd8dc0f7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 -- 172.21.15.33:0/1661736089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c4005040 con 0x7fd8dc0f5340 2022-02-02T14:12:13.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8da7fc700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd8c4013a70 tx=0x7fd8c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.767+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c4018070 con 0x7fd8dc0f5340 2022-02-02T14:12:13.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.768+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd8c40097d0 con 0x7fd8dc0f5340 2022-02-02T14:12:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.768+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0f62f0 con 0x7fd8dc0f5340 2022-02-02T14:12:13.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.768+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8c401c3c0 con 0x7fd8dc0f5340 2022-02-02T14:12:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.768+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc0f6850 con 0x7fd8dc0f5340 2022-02-02T14:12:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.769+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc045ad0 con 0x7fd8dc0f5340 2022-02-02T14:12:13.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.769+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd8c4007ba0 con 0x7fd8dc0f5340 2022-02-02T14:12:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.770+0000 7fd8d37fe700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 0x7fd8c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.770+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd8c4083790 con 0x7fd8dc0f5340 2022-02-02T14:12:13.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.770+0000 7fd8daffd700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 0x7fd8c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:13.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.770+0000 7fd8daffd700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 0x7fd8c8067290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd8dc0f72e0 tx=0x7fd8cc009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.774+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8c4051900 con 0x7fd8dc0f5340 2022-02-02T14:12:13.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.961+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8dc0ff030 con 0x7fd8c8064dd0 2022-02-02T14:12:13.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.963+0000 7fd8d37fe700 1 -- 172.21.15.33:0/1661736089 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd8dc0ff030 con 0x7fd8c8064dd0 2022-02-02T14:12:13.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 msgr2=0x7fd8c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:13.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 0x7fd8c8067290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd8dc0f72e0 tx=0x7fd8cc009c80).stop 2022-02-02T14:12:13.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 msgr2=0x7fd8dc0f59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:13.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fd8c4013a70 tx=0x7fd8c4009b30).stop 2022-02-02T14:12:13.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 shutdown_connections 2022-02-02T14:12:13.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd8c8064dd0 0x7fd8c8067290 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0f49a0 0x7fd8dc0f7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 --2- 172.21.15.33:0/1661736089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8dc0f5340 0x7fd8dc0f59d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.964+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 >> 172.21.15.33:0/1661736089 conn(0x7fd8dc0f04c0 msgr2=0x7fd8dc0fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.965+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 shutdown_connections 2022-02-02T14:12:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:13.965+0000 7fd8e1334700 1 -- 172.21.15.33:0/1661736089 wait complete. 2022-02-02T14:12:13.974 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:12:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 -- 172.21.15.33:0/816645408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a200f9690 msgr2=0x7f3a200fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/816645408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a200f9690 0x7f3a200fbae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7f3a14004660 tx=0x7f3a14009b30).stop 2022-02-02T14:12:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 -- 172.21.15.33:0/816645408 shutdown_connections 2022-02-02T14:12:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/816645408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a200f9690 0x7f3a200fbae0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/816645408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a20060310 0x7f3a200f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 -- 172.21.15.33:0/816645408 >> 172.21.15.33:0/816645408 conn(0x7f3a200f0b90 msgr2=0x7f3a200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 -- 172.21.15.33:0/816645408 shutdown_connections 2022-02-02T14:12:14.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.067+0000 7f3a24b9c700 1 -- 172.21.15.33:0/816645408 wait complete. 2022-02-02T14:12:14.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 Processor -- start 2022-02-02T14:12:14.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 -- start start 2022-02-02T14:12:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a200f9690 0x7f3a20107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a20107890 con 0x7f3a20060310 2022-02-02T14:12:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a24b9c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a201080d0 con 0x7f3a200f9690 2022-02-02T14:12:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60042/0 (socket says 172.21.15.33:60042) 2022-02-02T14:12:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a1f7fe700 1 -- 172.21.15.33:0/257104738 learned_addr learned my addr 172.21.15.33:0/257104738 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.068+0000 7f3a1effd700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a200f9690 0x7f3a20107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a1f7fe700 1 -- 172.21.15.33:0/257104738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a200f9690 msgr2=0x7f3a20107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a1f7fe700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a200f9690 0x7f3a20107290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a1f7fe700 1 -- 172.21.15.33:0/257104738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a14005040 con 0x7f3a20060310 2022-02-02T14:12:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a1f7fe700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f3a100026d0 tx=0x7f3a10009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a100079c0 con 0x7f3a20060310 2022-02-02T14:12:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a1000f040 con 0x7f3a20060310 2022-02-02T14:12:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a201083b0 con 0x7f3a20060310 2022-02-02T14:12:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a100148b0 con 0x7f3a20060310 2022-02-02T14:12:14.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.069+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a201088f0 con 0x7f3a20060310 2022-02-02T14:12:14.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.070+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a20059100 con 0x7f3a20060310 2022-02-02T14:12:14.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.071+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a10014a10 con 0x7f3a20060310 2022-02-02T14:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.071+0000 7f3a07fff700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 0x7f3a080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.071+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3a10081a40 con 0x7f3a20060310 2022-02-02T14:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.071+0000 7f3a1effd700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 0x7f3a080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.071+0000 7f3a1effd700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 0x7f3a080672e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f3a20106b30 tx=0x7f3a14009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.075+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a1004faf0 con 0x7f3a20060310 2022-02-02T14:12:14.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.260+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a200fee60 con 0x7f3a08064e20 2022-02-02T14:12:14.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.274+0000 7f3a07fff700 1 -- 172.21.15.33:0/257104738 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3a200fee60 con 0x7f3a08064e20 2022-02-02T14:12:14.274 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:12:14.274 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (37m) 9m ago 38m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:12:14.275 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (30m) 9m ago 38m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:12:14.275 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (30m) 9m ago 37m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:12:14.275 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (37m) 9m ago 38m 42.1M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:12:14.275 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (31m) 9m ago 34m 19.7M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:12:14.276 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (31m) 9m ago 34m 20.8M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:12:14.276 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (32m) 9m ago 34m 22.7M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:12:14.276 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (34m) 9m ago 34m 21.4M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:12:14.277 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (32m) 9m ago 39m 491M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:12:14.277 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (31m) 9m ago 37m 424M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:12:14.277 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (31m) 9m ago 39m 145M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:12:14.277 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (31m) 9m ago 37m 76.4M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:12:14.278 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (38m) 9m ago 38m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:12:14.278 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (37m) 9m ago 37m 18.4M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:12:14.278 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 37m - 4096M 2022-02-02T14:12:14.278 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (36m) 9m ago 36m 655M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:12:14.278 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (36m) 9m ago 36m 449M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:12:14.279 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (36m) 9m ago 36m 753M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:12:14.279 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (36m) 9m ago 36m 606M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:12:14.279 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (35m) 9m ago 35m 750M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:12:14.280 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (37m) 9m ago 38m 53.7M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:12:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 msgr2=0x7f3a080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 0x7f3a080672e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f3a20106b30 tx=0x7f3a14009b30).stop 2022-02-02T14:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 msgr2=0x7f3a20106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f3a100026d0 tx=0x7f3a10009de0).stop 2022-02-02T14:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 shutdown_connections 2022-02-02T14:12:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a08064e20 0x7f3a080672e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a20060310 0x7f3a20106da0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 --2- 172.21.15.33:0/257104738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a200f9690 0x7f3a20107290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.276+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 >> 172.21.15.33:0/257104738 conn(0x7f3a200f0b90 msgr2=0x7f3a200f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.277+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 shutdown_connections 2022-02-02T14:12:14.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.277+0000 7f3a24b9c700 1 -- 172.21.15.33:0/257104738 wait complete. 2022-02-02T14:12:14.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 -- 172.21.15.33:0/3510667703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f4d60 msgr2=0x7f98100f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 --2- 172.21.15.33:0/3510667703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f4d60 0x7f98100f5180 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f9800004770 tx=0x7f980000ac40).stop 2022-02-02T14:12:14.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 -- 172.21.15.33:0/3510667703 shutdown_connections 2022-02-02T14:12:14.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 --2- 172.21.15.33:0/3510667703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 0x7f98100f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 --2- 172.21.15.33:0/3510667703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f4d60 0x7f98100f5180 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 -- 172.21.15.33:0/3510667703 >> 172.21.15.33:0/3510667703 conn(0x7f98100f04c0 msgr2=0x7f98100f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 -- 172.21.15.33:0/3510667703 shutdown_connections 2022-02-02T14:12:14.379 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:14 smithi033 ceph-mon[101165]: pgmap v1005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:14.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.377+0000 7f981637a700 1 -- 172.21.15.33:0/3510667703 wait complete. 2022-02-02T14:12:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 Processor -- start 2022-02-02T14:12:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 -- start start 2022-02-02T14:12:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 0x7f98100f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981010ad80 con 0x7f98100f7330 2022-02-02T14:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.378+0000 7f981637a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981010aec0 con 0x7f98100f5f60 2022-02-02T14:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60054/0 (socket says 172.21.15.33:60054) 2022-02-02T14:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 -- 172.21.15.33:0/1766500582 learned_addr learned my addr 172.21.15.33:0/1766500582 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980ffff700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 0x7f98100f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 -- 172.21.15.33:0/1766500582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 msgr2=0x7f98100f8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 0x7f98100f8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 -- 172.21.15.33:0/1766500582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800005040 con 0x7f98100f7330 2022-02-02T14:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980f7fe700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f98040026d0 tx=0x7f9804009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98040079c0 con 0x7f98100f7330 2022-02-02T14:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f980400f040 con 0x7f98100f7330 2022-02-02T14:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98100f7ca0 con 0x7f98100f7330 2022-02-02T14:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.379+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9810113980 con 0x7f98100f7330 2022-02-02T14:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.380+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98040148b0 con 0x7f98100f7330 2022-02-02T14:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.380+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0004fa0 con 0x7f98100f7330 2022-02-02T14:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.381+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9804014a10 con 0x7f98100f7330 2022-02-02T14:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.381+0000 7f980cff9700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 0x7f97f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.381+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f98040818b0 con 0x7f98100f7330 2022-02-02T14:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.382+0000 7f980ffff700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 0x7f97f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.382+0000 7f980ffff700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 0x7f97f8067290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9800000c00 tx=0x7f980000c040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.386+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f980404f960 con 0x7f98100f7330 2022-02-02T14:12:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:14 smithi037 ceph-mon[69017]: pgmap v1005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:14.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.628+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97f0005e80 con 0x7f98100f7330 2022-02-02T14:12:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.629+0000 7f980cff9700 1 -- 172.21.15.33:0/1766500582 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9804052f80 con 0x7f98100f7330 2022-02-02T14:12:14.629 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:12:14.629 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:12:14.630 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:12:14.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:14.630 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:12:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:12:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:12:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:12:14.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:14.632 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:12:14.632 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:12:14.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:14.632 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:12:14.633 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:12:14.633 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:12:14.633 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:12:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:12:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 msgr2=0x7f97f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 0x7f97f8067290 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f9800000c00 tx=0x7f980000c040).stop 2022-02-02T14:12:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 msgr2=0x7f98100f77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f98040026d0 tx=0x7f9804009de0).stop 2022-02-02T14:12:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 shutdown_connections 2022-02-02T14:12:14.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f97f8064dd0 0x7f97f8067290 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98100f5f60 0x7f98100f8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 --2- 172.21.15.33:0/1766500582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98100f7330 0x7f98100f77b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 >> 172.21.15.33:0/1766500582 conn(0x7f98100f04c0 msgr2=0x7f98100f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 shutdown_connections 2022-02-02T14:12:14.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.631+0000 7f981637a700 1 -- 172.21.15.33:0/1766500582 wait complete. 2022-02-02T14:12:14.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/271256770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 msgr2=0x7f7bd80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/271256770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd80f6cc0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f7bc4004660 tx=0x7f7bc4009b30).stop 2022-02-02T14:12:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/271256770 shutdown_connections 2022-02-02T14:12:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/271256770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd80f6cc0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/271256770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 0x7f7bd80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/271256770 >> 172.21.15.33:0/271256770 conn(0x7f7bd80f0d40 msgr2=0x7f7bd80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/271256770 shutdown_connections 2022-02-02T14:12:14.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.732+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/271256770 wait complete. 2022-02-02T14:12:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 Processor -- start 2022-02-02T14:12:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 -- start start 2022-02-02T14:12:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8106950 con 0x7f7bd80f6860 2022-02-02T14:12:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bdf0f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd8107160 con 0x7f7bd80f55c0 2022-02-02T14:12:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.733+0000 7f7bd7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60064/0 (socket says 172.21.15.33:60064) 2022-02-02T14:12:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 -- 172.21.15.33:0/3301500138 learned_addr learned my addr 172.21.15.33:0/3301500138 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bdce92700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 -- 172.21.15.33:0/3301500138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 msgr2=0x7f7bd8105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 -- 172.21.15.33:0/3301500138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4005040 con 0x7f7bd80f6860 2022-02-02T14:12:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd7fff700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f7bc4009990 tx=0x7f7bc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc4018070 con 0x7f7bd80f6860 2022-02-02T14:12:14.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bc4007ba0 con 0x7f7bd80f6860 2022-02-02T14:12:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd8107380 con 0x7f7bd80f6860 2022-02-02T14:12:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bc401c620 con 0x7f7bd80f6860 2022-02-02T14:12:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.734+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd81078e0 con 0x7f7bd80f6860 2022-02-02T14:12:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.736+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd80f49b0 con 0x7f7bd80f6860 2022-02-02T14:12:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.736+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7bc401c890 con 0x7f7bd80f6860 2022-02-02T14:12:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.736+0000 7f7bd57fa700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 0x7f7bc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.736+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7bc4083810 con 0x7f7bd80f6860 2022-02-02T14:12:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.736+0000 7f7bdce92700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 0x7f7bc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.737+0000 7f7bdce92700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 0x7f7bc8067290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f7bd8105bd0 tx=0x7f7bcc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.740+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7bc40518c0 con 0x7f7bd80f6860 2022-02-02T14:12:14.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.951+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7bd80fdf10 con 0x7f7bd80f6860 2022-02-02T14:12:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.951+0000 7f7bd57fa700 1 -- 172.21.15.33:0/3301500138 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7bd80fdf10 con 0x7f7bd80f6860 2022-02-02T14:12:14.951 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:12:14.952 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:12:14.952 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:12:14.952 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:12:14.952 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:14.953 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:12:14.953 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:12:14.953 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:12:14.953 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:12:14.954 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:12:14.954 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:12:14.954 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:12:14.954 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:12:14.955 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:12:14.955 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:12:14.955 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:12:14.955 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:12:14.955 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:12:14.956 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:12:14.956 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:12:14.956 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:12:14.956 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:12:14.957 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:12:14.957 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:12:14.957 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:12:14.957 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:12:14.958 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:12:14.958 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:12:14.958 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:12:14.959 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:12:14.959 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:12:14.959 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:14.959 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:14.959 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:12:14.960 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:14.960 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:14.960 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:14.960 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:14.961 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:14.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 msgr2=0x7f7bc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 0x7f7bc8067290 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f7bd8105bd0 tx=0x7f7bcc009040).stop 2022-02-02T14:12:14.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 msgr2=0x7f7bd8106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:14.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f7bc4009990 tx=0x7f7bc4009b30).stop 2022-02-02T14:12:14.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 shutdown_connections 2022-02-02T14:12:14.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bc8064dd0 0x7f7bc8067290 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bd80f55c0 0x7f7bd8105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 --2- 172.21.15.33:0/3301500138 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bd80f6860 0x7f7bd8106350 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:14.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 >> 172.21.15.33:0/3301500138 conn(0x7f7bd80f0d40 msgr2=0x7f7bd80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:14.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 shutdown_connections 2022-02-02T14:12:14.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:14.954+0000 7f7bdf0f6700 1 -- 172.21.15.33:0/3301500138 wait complete. 2022-02-02T14:12:14.965 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:12:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:15 smithi033 ceph-mon[101165]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1766500582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:12:15.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3301500138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:12:15.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:15 smithi037 ceph-mon[69017]: from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:15.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1766500582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:12:15.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3301500138' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:12:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:16 smithi033 ceph-mon[101165]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:16 smithi033 ceph-mon[101165]: pgmap v1006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:16 smithi037 ceph-mon[69017]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:16.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:16 smithi037 ceph-mon[69017]: pgmap v1006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:18 smithi033 ceph-mon[101165]: pgmap v1007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:18 smithi037 ceph-mon[69017]: pgmap v1007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:20.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:20 smithi033 ceph-mon[101165]: pgmap v1008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:20 smithi037 ceph-mon[69017]: pgmap v1008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:22 smithi033 ceph-mon[101165]: pgmap v1009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:22 smithi037 ceph-mon[69017]: pgmap v1009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:24 smithi033 ceph-mon[101165]: pgmap v1010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:24 smithi037 ceph-mon[69017]: pgmap v1010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:26 smithi033 ceph-mon[101165]: pgmap v1011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:26 smithi037 ceph-mon[69017]: pgmap v1011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:28 smithi033 ceph-mon[101165]: pgmap v1012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:28 smithi037 ceph-mon[69017]: pgmap v1012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:30 smithi033 ceph-mon[101165]: pgmap v1013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:30 smithi037 ceph-mon[69017]: pgmap v1013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:12:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:12:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:31 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:12:31.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-02-02T14:12:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-02-02T14:12:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:31 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-02-02T14:12:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:32 smithi033 ceph-mon[101165]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:12:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:32 smithi033 ceph-mon[101165]: pgmap v1014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:32.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:32 smithi037 ceph-mon[69017]: unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-02-02T14:12:32.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:32 smithi037 ceph-mon[69017]: pgmap v1014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:34 smithi033 ceph-mon[101165]: pgmap v1015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:34 smithi037 ceph-mon[69017]: pgmap v1015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:35.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:35 smithi037 ceph-mon[69017]: pgmap v1016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:35 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:35 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:35.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:35 smithi033 ceph-mon[101165]: pgmap v1016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:35.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:35 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:35.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:35 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:37 smithi033 ceph-mon[101165]: pgmap v1017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:38.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:38.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:37 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:38.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:37 smithi037 ceph-mon[69017]: pgmap v1017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:38.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:38.292 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:37 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' 2022-02-02T14:12:40.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:39 smithi033 ceph-mon[101165]: pgmap v1018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:39 smithi037 ceph-mon[69017]: pgmap v1018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:42 smithi037 ceph-mon[69017]: pgmap v1019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:42 smithi033 ceph-mon[101165]: pgmap v1019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:44.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:44 smithi037 ceph-mon[69017]: pgmap v1020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:44 smithi033 ceph-mon[101165]: pgmap v1020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:45.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 -- 172.21.15.33:0/2869297697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f55c0 msgr2=0x7f88dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 --2- 172.21.15.33:0/2869297697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f59e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f88cc004660 tx=0x7f88cc009b30).stop 2022-02-02T14:12:45.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 -- 172.21.15.33:0/2869297697 shutdown_connections 2022-02-02T14:12:45.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 --2- 172.21.15.33:0/2869297697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 --2- 172.21.15.33:0/2869297697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f59e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 -- 172.21.15.33:0/2869297697 >> 172.21.15.33:0/2869297697 conn(0x7f88dc0f0d40 msgr2=0x7f88dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 -- 172.21.15.33:0/2869297697 shutdown_connections 2022-02-02T14:12:45.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.070+0000 7f88e0c45700 1 -- 172.21.15.33:0/2869297697 wait complete. 2022-02-02T14:12:45.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 Processor -- start 2022-02-02T14:12:45.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 -- start start 2022-02-02T14:12:45.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0f8100 con 0x7f88dc0f6860 2022-02-02T14:12:45.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88e0c45700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0f8240 con 0x7f88dc0f55c0 2022-02-02T14:12:45.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.071+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60074/0 (socket says 172.21.15.33:60074) 2022-02-02T14:12:45.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88da59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d9d9b700 1 -- 172.21.15.33:0/1900626251 learned_addr learned my addr 172.21.15.33:0/1900626251 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:45.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88da59c700 1 -- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 msgr2=0x7f88dc0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88da59c700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88da59c700 1 -- 172.21.15.33:0/1900626251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc005040 con 0x7f88dc0f55c0 2022-02-02T14:12:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d9d9b700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:12:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88da59c700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f9720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f88cc000c00 tx=0x7f88cc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc018070 con 0x7f88dc0f55c0 2022-02-02T14:12:45.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0f84c0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f88cc007ba0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88cc01de60 con 0x7f88dc0f55c0 2022-02-02T14:12:45.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.072+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0f89f0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.074+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f88cc007d10 con 0x7f88dc0f55c0 2022-02-02T14:12:45.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.074+0000 7f88d2ffd700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 0x7f88c8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.074+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc0f49b0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.074+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f88cc0835a0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.074+0000 7f88d9d9b700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 0x7f88c8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.075+0000 7f88d9d9b700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 0x7f88c8067270 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f88c40041d0 tx=0x7f88c400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.080+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f88cc0516b0 con 0x7f88dc0f55c0 2022-02-02T14:12:45.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.271+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f88dc0faca0 con 0x7f88c8064db0 2022-02-02T14:12:45.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.272+0000 7f88d2ffd700 1 -- 172.21.15.33:0/1900626251 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f88dc0faca0 con 0x7f88c8064db0 2022-02-02T14:12:45.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 msgr2=0x7f88c8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 0x7f88c8067270 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f88c40041d0 tx=0x7f88c400b040).stop 2022-02-02T14:12:45.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 msgr2=0x7f88dc0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f9720 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f88cc000c00 tx=0x7f88cc009b30).stop 2022-02-02T14:12:45.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 shutdown_connections 2022-02-02T14:12:45.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f88c8064db0 0x7f88c8067270 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88dc0f55c0 0x7f88dc0f9720 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 --2- 172.21.15.33:0/1900626251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88dc0f6860 0x7f88dc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 >> 172.21.15.33:0/1900626251 conn(0x7f88dc0f0d40 msgr2=0x7f88dc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 shutdown_connections 2022-02-02T14:12:45.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.274+0000 7f88e0c45700 1 -- 172.21.15.33:0/1900626251 wait complete. 2022-02-02T14:12:45.283 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:12:45.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 -- 172.21.15.33:0/3389209706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f20060270 msgr2=0x7f4f200f91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 --2- 172.21.15.33:0/3389209706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f20060270 0x7f4f200f91e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f4f10004660 tx=0x7f4f10009b30).stop 2022-02-02T14:12:45.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 -- 172.21.15.33:0/3389209706 shutdown_connections 2022-02-02T14:12:45.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 --2- 172.21.15.33:0/3389209706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f200f96d0 0x7f4f200fbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 --2- 172.21.15.33:0/3389209706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f20060270 0x7f4f200f91e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 -- 172.21.15.33:0/3389209706 >> 172.21.15.33:0/3389209706 conn(0x7f4f200f0bc0 msgr2=0x7f4f200f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 -- 172.21.15.33:0/3389209706 shutdown_connections 2022-02-02T14:12:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 -- 172.21.15.33:0/3389209706 wait complete. 2022-02-02T14:12:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.375+0000 7f4f25a45700 1 Processor -- start 2022-02-02T14:12:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f25a45700 1 -- start start 2022-02-02T14:12:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f25a45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f20060270 0x7f4f20108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f25a45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f25a45700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20109a40 con 0x7f4f200f96d0 2022-02-02T14:12:45.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f25a45700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f20109b80 con 0x7f4f20060270 2022-02-02T14:12:45.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60082/0 (socket says 172.21.15.33:60082) 2022-02-02T14:12:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4036253126 learned_addr learned my addr 172.21.15.33:0/4036253126 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1effd700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f20060270 0x7f4f20108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4036253126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f20060270 msgr2=0x7f4f20108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f20060270 0x7f4f20108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 -- 172.21.15.33:0/4036253126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10005040 con 0x7f4f200f96d0 2022-02-02T14:12:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.376+0000 7f4f1e7fc700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4f14002700 tx=0x7f4f14009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.377+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f140079c0 con 0x7f4f200f96d0 2022-02-02T14:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.377+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f1400f040 con 0x7f4f200f96d0 2022-02-02T14:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.377+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f14014740 con 0x7f4f200f96d0 2022-02-02T14:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.377+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2010a520 con 0x7f4f200f96d0 2022-02-02T14:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.377+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2010aae0 con 0x7f4f200f96d0 2022-02-02T14:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.378+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f20045ad0 con 0x7f4f200f96d0 2022-02-02T14:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.378+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f1401b060 con 0x7f4f200f96d0 2022-02-02T14:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.379+0000 7f4f077fe700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 0x7f4f080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.379+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f14081940 con 0x7f4f200f96d0 2022-02-02T14:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.379+0000 7f4f1effd700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 0x7f4f080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.379+0000 7f4f1effd700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 0x7f4f080672e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4f10005010 tx=0x7f4f10009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.384+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f14053420 con 0x7f4f200f96d0 2022-02-02T14:12:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.570+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f200f8cc0 con 0x7f4f08064e20 2022-02-02T14:12:45.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.585+0000 7f4f077fe700 1 -- 172.21.15.33:0/4036253126 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4f200f8cc0 con 0x7f4f08064e20 2022-02-02T14:12:45.585 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:12:45.585 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (38m) 8s ago 39m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:12:45.585 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (31m) 8s ago 39m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:12:45.585 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (31m) 10s ago 38m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:12:45.586 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (37m) 8s ago 38m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:12:45.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (31m) 8s ago 35m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:12:45.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (32m) 8s ago 35m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:12:45.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (32m) 10s ago 35m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:12:45.587 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (35m) 10s ago 35m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:12:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (32m) 8s ago 40m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:12:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (32m) 10s ago 38m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:12:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (32m) 8s ago 40m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:12:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (31m) 10s ago 38m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:12:45.588 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (38m) 8s ago 38m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:12:45.589 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (38m) 10s ago 38m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:12:45.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8s ago 37m - 4096M 2022-02-02T14:12:45.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (37m) 8s ago 37m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:12:45.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (37m) 8s ago 37m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:12:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (36m) 10s ago 36m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:12:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (36m) 10s ago 36m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:12:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (36m) 10s ago 36m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:12:45.590 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (37m) 8s ago 38m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:12:45.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.586+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 msgr2=0x7f4f080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.586+0000 7f4f25a45700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 0x7f4f080672e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f4f10005010 tx=0x7f4f10009b30).stop 2022-02-02T14:12:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.586+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 msgr2=0x7f4f20109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.586+0000 7f4f25a45700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f4f14002700 tx=0x7f4f14009d60).stop 2022-02-02T14:12:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 shutdown_connections 2022-02-02T14:12:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f08064e20 0x7f4f080672e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f20060270 0x7f4f20108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 --2- 172.21.15.33:0/4036253126 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f200f96d0 0x7f4f20109490 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 >> 172.21.15.33:0/4036253126 conn(0x7f4f200f0bc0 msgr2=0x7f4f200f1890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 shutdown_connections 2022-02-02T14:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.587+0000 7f4f25a45700 1 -- 172.21.15.33:0/4036253126 wait complete. 2022-02-02T14:12:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3802304836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 msgr2=0x7f53ac0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3802304836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac0f5850 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f53a0004660 tx=0x7f53a0009b30).stop 2022-02-02T14:12:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3802304836 shutdown_connections 2022-02-02T14:12:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3802304836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 0x7f53ac0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3802304836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac0f5850 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.686+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3802304836 >> 172.21.15.33:0/3802304836 conn(0x7f53ac0f0b90 msgr2=0x7f53ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.687+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3802304836 shutdown_connections 2022-02-02T14:12:45.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.687+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3802304836 wait complete. 2022-02-02T14:12:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.687+0000 7f53b1ea8700 1 Processor -- start 2022-02-02T14:12:45.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.687+0000 7f53b1ea8700 1 -- start start 2022-02-02T14:12:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b1ea8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b1ea8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 0x7f53ac10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b1ea8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac0603e0 con 0x7f53ac0f5430 2022-02-02T14:12:45.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b1ea8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac060520 con 0x7f53ac0f66d0 2022-02-02T14:12:45.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60090/0 (socket says 172.21.15.33:60090) 2022-02-02T14:12:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 -- 172.21.15.33:0/3007069211 learned_addr learned my addr 172.21.15.33:0/3007069211 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53abfff700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 0x7f53ac10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 -- 172.21.15.33:0/3007069211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 msgr2=0x7f53ac10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 0x7f53ac10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 -- 172.21.15.33:0/3007069211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a0005040 con 0x7f53ac0f5430 2022-02-02T14:12:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.688+0000 7f53b0ea6700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f53a0009830 tx=0x7f53a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.689+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a0018070 con 0x7f53ac0f5430 2022-02-02T14:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.689+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f53a0007ba0 con 0x7f53ac0f5430 2022-02-02T14:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.689+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53a001c620 con 0x7f53ac0f5430 2022-02-02T14:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.689+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac10c4e0 con 0x7f53ac0f5430 2022-02-02T14:12:45.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.689+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac10ca40 con 0x7f53ac0f5430 2022-02-02T14:12:45.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.690+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac045ad0 con 0x7f53ac0f5430 2022-02-02T14:12:45.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.691+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f53a0007d10 con 0x7f53ac0f5430 2022-02-02T14:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.691+0000 7f53a97fa700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 0x7f539c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.691+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f53a0083780 con 0x7f53ac0f5430 2022-02-02T14:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.691+0000 7f53abfff700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 0x7f539c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.692+0000 7f53abfff700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 0x7f539c0672e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f5398004a70 tx=0x7f539800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.695+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f53a0051890 con 0x7f53ac0f5430 2022-02-02T14:12:45.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.942+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f53ac0fdd00 con 0x7f53ac0f5430 2022-02-02T14:12:45.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.943+0000 7f53a97fa700 1 -- 172.21.15.33:0/3007069211 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f53a0054eb0 con 0x7f53ac0f5430 2022-02-02T14:12:45.943 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:12:45.943 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:12:45.944 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:12:45.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:45.944 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:12:45.945 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:12:45.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:45.945 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:12:45.945 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:12:45.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:45.946 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:12:45.946 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:12:45.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:12:45.946 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:12:45.947 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:12:45.947 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:12:45.947 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:12:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:12:45.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 msgr2=0x7f539c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 0x7f539c0672e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f5398004a70 tx=0x7f539800b040).stop 2022-02-02T14:12:45.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 msgr2=0x7f53ac109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:45.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f53a0009830 tx=0x7f53a0009b30).stop 2022-02-02T14:12:45.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 shutdown_connections 2022-02-02T14:12:45.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f539c064e20 0x7f539c0672e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53ac0f5430 0x7f53ac109a90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 --2- 172.21.15.33:0/3007069211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ac0f66d0 0x7f53ac10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:45.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 >> 172.21.15.33:0/3007069211 conn(0x7f53ac0f0b90 msgr2=0x7f53ac0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:45.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 shutdown_connections 2022-02-02T14:12:45.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:45.945+0000 7f53b1ea8700 1 -- 172.21.15.33:0/3007069211 wait complete. 2022-02-02T14:12:46.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 -- 172.21.15.33:0/2051779490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f7980 msgr2=0x7f6e240f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 --2- 172.21.15.33:0/2051779490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f7980 0x7f6e240f7de0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f6e14004660 tx=0x7f6e14009b30).stop 2022-02-02T14:12:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 -- 172.21.15.33:0/2051779490 shutdown_connections 2022-02-02T14:12:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 --2- 172.21.15.33:0/2051779490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f7980 0x7f6e240f7de0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 --2- 172.21.15.33:0/2051779490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f66e0 0x7f6e240f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 -- 172.21.15.33:0/2051779490 >> 172.21.15.33:0/2051779490 conn(0x7f6e240f1e40 msgr2=0x7f6e240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 -- 172.21.15.33:0/2051779490 shutdown_connections 2022-02-02T14:12:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.049+0000 7f6e29fec700 1 -- 172.21.15.33:0/2051779490 wait complete. 2022-02-02T14:12:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 Processor -- start 2022-02-02T14:12:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 -- start start 2022-02-02T14:12:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f7980 0x7f6e24107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24107a00 con 0x7f6e240f66e0 2022-02-02T14:12:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e29fec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e24107b40 con 0x7f6e240f7980 2022-02-02T14:12:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60100/0 (socket says 172.21.15.33:60100) 2022-02-02T14:12:46.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 -- 172.21.15.33:0/746884066 learned_addr learned my addr 172.21.15.33:0/746884066 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:12:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e22ffd700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f7980 0x7f6e24107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 -- 172.21.15.33:0/746884066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f7980 msgr2=0x7f6e24107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f7980 0x7f6e24107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.050+0000 7f6e237fe700 1 -- 172.21.15.33:0/746884066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e14005040 con 0x7f6e240f66e0 2022-02-02T14:12:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e237fe700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6e1800c790 tx=0x7f6e18007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e1800e680 con 0x7f6e240f66e0 2022-02-02T14:12:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e241084e0 con 0x7f6e240f66e0 2022-02-02T14:12:46.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e1800ec90 con 0x7f6e240f66e0 2022-02-02T14:12:46.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e18012d00 con 0x7f6e240f66e0 2022-02-02T14:12:46.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.051+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e24108aa0 con 0x7f6e240f66e0 2022-02-02T14:12:46.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.052+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e24045ad0 con 0x7f6e240f66e0 2022-02-02T14:12:46.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.052+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e18010070 con 0x7f6e240f66e0 2022-02-02T14:12:46.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.053+0000 7f6e0bfff700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 0x7f6e0c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:12:46.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.053+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e18081c40 con 0x7f6e240f66e0 2022-02-02T14:12:46.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.053+0000 7f6e22ffd700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 0x7f6e0c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:12:46.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.053+0000 7f6e22ffd700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 0x7f6e0c067270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6e14004e30 tx=0x7f6e14009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:12:46.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.057+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e18053660 con 0x7f6e240f66e0 2022-02-02T14:12:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:46 smithi033 ceph-mon[101165]: pgmap v1021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3007069211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:12:46.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.271+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e240fef70 con 0x7f6e240f66e0 2022-02-02T14:12:46.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.271+0000 7f6e0bfff700 1 -- 172.21.15.33:0/746884066 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6e18053250 con 0x7f6e240f66e0 2022-02-02T14:12:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:12:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:12:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:12:46.273 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:12:46.273 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:46.273 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:12:46.273 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:12:46.273 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:12:46.274 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:12:46.274 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:12:46.274 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:12:46.274 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:12:46.275 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:12:46.275 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:12:46.275 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:12:46.275 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:12:46.276 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:12:46.276 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:12:46.276 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:12:46.276 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:12:46.277 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:12:46.277 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:12:46.277 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:12:46.277 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:12:46.277 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:12:46.278 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:12:46.278 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:12:46.278 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:12:46.278 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:12:46.278 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:12:46.279 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:12:46.279 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:46.280 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:12:46.280 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:12:46.280 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:46.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:46.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:46.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:12:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 msgr2=0x7f6e0c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 0x7f6e0c067270 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f6e14004e30 tx=0x7f6e14009b30).stop 2022-02-02T14:12:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 msgr2=0x7f6e24106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:12:46.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f6e1800c790 tx=0x7f6e18007d90).stop 2022-02-02T14:12:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 shutdown_connections 2022-02-02T14:12:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e0c064db0 0x7f6e0c067270 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e240f66e0 0x7f6e24106f60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 --2- 172.21.15.33:0/746884066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e240f7980 0x7f6e24107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:12:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.273+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 >> 172.21.15.33:0/746884066 conn(0x7f6e240f1e40 msgr2=0x7f6e240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:12:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.274+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 shutdown_connections 2022-02-02T14:12:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:12:46.274+0000 7f6e29fec700 1 -- 172.21.15.33:0/746884066 wait complete. 2022-02-02T14:12:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:12:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:46 smithi037 ceph-mon[69017]: pgmap v1021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:46.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3007069211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:12:47.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:47 smithi037 ceph-mon[69017]: from='client.44889 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:47 smithi037 ceph-mon[69017]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:47.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:47 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/746884066' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:12:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:47 smithi033 ceph-mon[101165]: from='client.44889 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:47 smithi033 ceph-mon[101165]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:12:47.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:47 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/746884066' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:12:48.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:48 smithi037 ceph-mon[69017]: pgmap v1022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:48 smithi033 ceph-mon[101165]: pgmap v1022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:50.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:50 smithi037 ceph-mon[69017]: pgmap v1023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:50 smithi033 ceph-mon[101165]: pgmap v1023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:52.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:52 smithi037 ceph-mon[69017]: pgmap v1024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:52 smithi033 ceph-mon[101165]: pgmap v1024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:54.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:54 smithi037 ceph-mon[69017]: pgmap v1025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:54 smithi033 ceph-mon[101165]: pgmap v1025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:55.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:12:55.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:12:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:12:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:12:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:56 smithi033 ceph-mon[101165]: pgmap v1026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:56.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:56 smithi037 ceph-mon[69017]: pgmap v1026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:58.291 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:12:58 smithi037 ceph-mon[69017]: pgmap v1027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:12:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:12:58 smithi033 ceph-mon[101165]: pgmap v1027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:00 smithi037 ceph-mon[69017]: pgmap v1028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:00 smithi033 ceph-mon[101165]: pgmap v1028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:02 smithi033 ceph-mon[101165]: pgmap v1029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:02 smithi037 ceph-mon[69017]: pgmap v1029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:04 smithi033 ceph-mon[101165]: pgmap v1030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:04 smithi037 ceph-mon[69017]: pgmap v1030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:06 smithi033 ceph-mon[101165]: pgmap v1031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:06.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:06 smithi037 ceph-mon[69017]: pgmap v1031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:08 smithi033 ceph-mon[101165]: pgmap v1032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:08 smithi037 ceph-mon[69017]: pgmap v1032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:10 smithi033 ceph-mon[101165]: pgmap v1033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:10.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:10 smithi037 ceph-mon[69017]: pgmap v1033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:12 smithi033 ceph-mon[101165]: pgmap v1034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:12 smithi037 ceph-mon[69017]: pgmap v1034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:14 smithi033 ceph-mon[101165]: pgmap v1035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:14 smithi037 ceph-mon[69017]: pgmap v1035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:16 smithi033 ceph-mon[101165]: pgmap v1036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:16.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.388+0000 7f679098c700 1 -- 172.21.15.33:0/1347102548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f5430 msgr2=0x7f678c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.388+0000 7f679098c700 1 --2- 172.21.15.33:0/1347102548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f5430 0x7f678c0f5850 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f677c004660 tx=0x7f677c009b30).stop 2022-02-02T14:13:16.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 -- 172.21.15.33:0/1347102548 shutdown_connections 2022-02-02T14:13:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 --2- 172.21.15.33:0/1347102548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f66d0 0x7f678c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 --2- 172.21.15.33:0/1347102548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f5430 0x7f678c0f5850 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 -- 172.21.15.33:0/1347102548 >> 172.21.15.33:0/1347102548 conn(0x7f678c0f0b90 msgr2=0x7f678c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 -- 172.21.15.33:0/1347102548 shutdown_connections 2022-02-02T14:13:16.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 -- 172.21.15.33:0/1347102548 wait complete. 2022-02-02T14:13:16.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 Processor -- start 2022-02-02T14:13:16.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.389+0000 7f679098c700 1 -- start start 2022-02-02T14:13:16.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f679098c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 0x7f678c106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f679098c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f679098c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c107900 con 0x7f678c0f66d0 2022-02-02T14:13:16.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f679098c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c108110 con 0x7f678c0f5430 2022-02-02T14:13:16.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60112/0 (socket says 172.21.15.33:60112) 2022-02-02T14:13:16.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 -- 172.21.15.33:0/2647451567 learned_addr learned my addr 172.21.15.33:0/2647451567 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:16.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678b7fe700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 0x7f678c106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 -- 172.21.15.33:0/2647451567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 msgr2=0x7f678c106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 0x7f678c106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 -- 172.21.15.33:0/2647451567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677c005040 con 0x7f678c0f66d0 2022-02-02T14:13:16.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678b7fe700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 0x7f678c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:13:16.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f678affd700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f67800026d0 tx=0x7f6780009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:16.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.390+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6780009320 con 0x7f678c0f66d0 2022-02-02T14:13:16.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.391+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f678000f040 con 0x7f678c0f66d0 2022-02-02T14:13:16.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.391+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c108390 con 0x7f678c0f66d0 2022-02-02T14:13:16.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.391+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67800147e0 con 0x7f678c0f66d0 2022-02-02T14:13:16.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.391+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c108950 con 0x7f678c0f66d0 2022-02-02T14:13:16.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.392+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c059100 con 0x7f678c0f66d0 2022-02-02T14:13:16.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.392+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6780009480 con 0x7f678c0f66d0 2022-02-02T14:13:16.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.393+0000 7f6773fff700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 0x7f67740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.393+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6780082170 con 0x7f678c0f66d0 2022-02-02T14:13:16.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.393+0000 7f678b7fe700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 0x7f67740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.393+0000 7f678b7fe700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 0x7f67740672e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f677c004e30 tx=0x7f677c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:16.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.397+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6780050220 con 0x7f678c0f66d0 2022-02-02T14:13:16.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:16 smithi037 ceph-mon[69017]: pgmap v1036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:16.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.586+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f678c0fab10 con 0x7f6774064e20 2022-02-02T14:13:16.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.587+0000 7f6773fff700 1 -- 172.21.15.33:0/2647451567 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f678c0fab10 con 0x7f6774064e20 2022-02-02T14:13:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 msgr2=0x7f67740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 0x7f67740672e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f677c004e30 tx=0x7f677c009b30).stop 2022-02-02T14:13:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 msgr2=0x7f678c107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f67800026d0 tx=0x7f6780009de0).stop 2022-02-02T14:13:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 shutdown_connections 2022-02-02T14:13:16.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6774064e20 0x7f67740672e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f678c0f5430 0x7f678c106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 --2- 172.21.15.33:0/2647451567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f678c0f66d0 0x7f678c107300 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 >> 172.21.15.33:0/2647451567 conn(0x7f678c0f0b90 msgr2=0x7f678c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 shutdown_connections 2022-02-02T14:13:16.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.589+0000 7f679098c700 1 -- 172.21.15.33:0/2647451567 wait complete. 2022-02-02T14:13:16.599 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:13:16.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 -- 172.21.15.33:0/1093409119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f6860 msgr2=0x7f19c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1093409119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f6860 0x7f19c80f6cc0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f19b8004660 tx=0x7f19b8009b30).stop 2022-02-02T14:13:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 -- 172.21.15.33:0/1093409119 shutdown_connections 2022-02-02T14:13:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1093409119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f6860 0x7f19c80f6cc0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1093409119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f55c0 0x7f19c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 -- 172.21.15.33:0/1093409119 >> 172.21.15.33:0/1093409119 conn(0x7f19c80f0d40 msgr2=0x7f19c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 -- 172.21.15.33:0/1093409119 shutdown_connections 2022-02-02T14:13:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.691+0000 7f19cf80f700 1 -- 172.21.15.33:0/1093409119 wait complete. 2022-02-02T14:13:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.692+0000 7f19cf80f700 1 Processor -- start 2022-02-02T14:13:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.692+0000 7f19cf80f700 1 -- start start 2022-02-02T14:13:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.692+0000 7f19cf80f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.692+0000 7f19cf80f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f6860 0x7f19c810c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cf80f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c80603e0 con 0x7f19c80f55c0 2022-02-02T14:13:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cf80f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8060520 con 0x7f19c80f6860 2022-02-02T14:13:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60120/0 (socket says 172.21.15.33:60120) 2022-02-02T14:13:16.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 -- 172.21.15.33:0/1061501952 learned_addr learned my addr 172.21.15.33:0/1061501952 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:16.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19ccdaa700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f6860 0x7f19c810c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 -- 172.21.15.33:0/1061501952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f6860 msgr2=0x7f19c810c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f6860 0x7f19c810c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 -- 172.21.15.33:0/1061501952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8005040 con 0x7f19c80f55c0 2022-02-02T14:13:16.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19cd5ab700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f19c4002700 tx=0x7f19c4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:16.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c4009320 con 0x7f19c80f55c0 2022-02-02T14:13:16.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.693+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19c400f040 con 0x7f19c80f55c0 2022-02-02T14:13:16.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.694+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c40148e0 con 0x7f19c80f55c0 2022-02-02T14:13:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.694+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c810c670 con 0x7f19c80f55c0 2022-02-02T14:13:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.694+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c810cc30 con 0x7f19c80f55c0 2022-02-02T14:13:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.695+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c8045ad0 con 0x7f19c80f55c0 2022-02-02T14:13:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.695+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19c4009480 con 0x7f19c80f55c0 2022-02-02T14:13:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.696+0000 7f19bdffb700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 0x7f19b4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:16.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.696+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f19c4081cf0 con 0x7f19c80f55c0 2022-02-02T14:13:16.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.696+0000 7f19ccdaa700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 0x7f19b4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:16.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.696+0000 7f19ccdaa700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 0x7f19b4067290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f19b8004630 tx=0x7f19b8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:16.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.700+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19c404fe60 con 0x7f19c80f55c0 2022-02-02T14:13:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.882+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19c80fdf30 con 0x7f19b4064dd0 2022-02-02T14:13:16.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.896+0000 7f19bdffb700 1 -- 172.21.15.33:0/1061501952 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f19b8019040 con 0x7f19b4064dd0 2022-02-02T14:13:16.896 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:13:16.897 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (38m) 39s ago 39m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:13:16.897 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (31m) 39s ago 39m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:13:16.897 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (31m) 42s ago 39m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:13:16.897 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (38m) 39s ago 39m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:13:16.897 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (32m) 39s ago 35m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:13:16.898 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (32m) 39s ago 35m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:13:16.898 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (33m) 42s ago 35m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:13:16.898 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (35m) 42s ago 35m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:13:16.898 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (33m) 39s ago 40m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:13:16.899 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (32m) 42s ago 39m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:13:16.899 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (32m) 39s ago 40m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:13:16.899 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (32m) 42s ago 38m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:13:16.899 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (39m) 39s ago 39m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:13:16.900 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (38m) 42s ago 38m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:13:16.900 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 39s ago 38m - 4096M 2022-02-02T14:13:16.900 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (37m) 39s ago 37m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:13:16.900 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (37m) 39s ago 37m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:13:16.900 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (37m) 42s ago 37m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:13:16.901 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (37m) 42s ago 37m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:13:16.902 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (36m) 42s ago 36m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:13:16.903 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (38m) 39s ago 39m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:13:16.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 msgr2=0x7f19b4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 0x7f19b4067290 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f19b8004630 tx=0x7f19b8009b30).stop 2022-02-02T14:13:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 msgr2=0x7f19c8109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f19c4002700 tx=0x7f19c4009e00).stop 2022-02-02T14:13:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 shutdown_connections 2022-02-02T14:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19b4064dd0 0x7f19b4067290 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19c80f55c0 0x7f19c8109bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 --2- 172.21.15.33:0/1061501952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19c80f6860 0x7f19c810c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 >> 172.21.15.33:0/1061501952 conn(0x7f19c80f0d40 msgr2=0x7f19c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 shutdown_connections 2022-02-02T14:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.898+0000 7f19cf80f700 1 -- 172.21.15.33:0/1061501952 wait complete. 2022-02-02T14:13:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 -- 172.21.15.33:0/838895500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f66d0 msgr2=0x7f76240f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 --2- 172.21.15.33:0/838895500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f66d0 0x7f76240f6b30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f760c004660 tx=0x7f760c009b30).stop 2022-02-02T14:13:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 -- 172.21.15.33:0/838895500 shutdown_connections 2022-02-02T14:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 --2- 172.21.15.33:0/838895500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f66d0 0x7f76240f6b30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 --2- 172.21.15.33:0/838895500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f5430 0x7f76240f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 -- 172.21.15.33:0/838895500 >> 172.21.15.33:0/838895500 conn(0x7f76240f0b90 msgr2=0x7f76240f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 -- 172.21.15.33:0/838895500 shutdown_connections 2022-02-02T14:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 -- 172.21.15.33:0/838895500 wait complete. 2022-02-02T14:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.998+0000 7f762359e700 1 Processor -- start 2022-02-02T14:13:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762359e700 1 -- start start 2022-02-02T14:13:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 0x7f7624068890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624060450 con 0x7f76240f5430 2022-02-02T14:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624060590 con 0x7f76240f66d0 2022-02-02T14:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60130/0 (socket says 172.21.15.33:60130) 2022-02-02T14:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 -- 172.21.15.33:0/2644376297 learned_addr learned my addr 172.21.15.33:0/2644376297 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f7621d9b700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 0x7f7624068890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 -- 172.21.15.33:0/2644376297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 msgr2=0x7f7624068890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 0x7f7624068890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 -- 172.21.15.33:0/2644376297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c005040 con 0x7f76240f5430 2022-02-02T14:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f7621d9b700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 0x7f7624068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:16.999+0000 7f762259c700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f761400c530 tx=0x7f7614007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f761400f650 con 0x7f76240f5430 2022-02-02T14:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f761400fc60 con 0x7f76240f5430 2022-02-02T14:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7624068ea0 con 0x7f76240f5430 2022-02-02T14:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7614012d20 con 0x7f76240f5430 2022-02-02T14:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7624069460 con 0x7f76240f5430 2022-02-02T14:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.000+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7624045ad0 con 0x7f76240f5430 2022-02-02T14:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.001+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7614019030 con 0x7f76240f5430 2022-02-02T14:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.002+0000 7f761affd700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 0x7f76100672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.002+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7614081700 con 0x7f76240f5430 2022-02-02T14:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.002+0000 7f7621d9b700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 0x7f76100672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.002+0000 7f7621d9b700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 0x7f76100672d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f760c004e30 tx=0x7f760c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:17.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.006+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f761404f800 con 0x7f76240f5430 2022-02-02T14:13:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.251+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76240008d0 con 0x7f76240f5430 2022-02-02T14:13:17.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.252+0000 7f761affd700 1 -- 172.21.15.33:0/2644376297 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7614052e20 con 0x7f76240f5430 2022-02-02T14:13:17.253 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:13:17.253 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:13:17.253 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:13:17.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:17.254 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:13:17.254 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:13:17.254 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:17.254 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:13:17.255 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:13:17.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:17.255 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:13:17.255 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:13:17.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:17.256 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:13:17.256 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:13:17.256 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:13:17.257 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:13:17.257 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:13:17.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.253+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 msgr2=0x7f76100672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.253+0000 7f762359e700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 0x7f76100672d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f760c004e30 tx=0x7f760c009b30).stop 2022-02-02T14:13:17.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 msgr2=0x7f762405fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f761400c530 tx=0x7f7614007e10).stop 2022-02-02T14:13:17.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 shutdown_connections 2022-02-02T14:13:17.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7610064e10 0x7f76100672d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76240f5430 0x7f762405fe50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 --2- 172.21.15.33:0/2644376297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76240f66d0 0x7f7624068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 >> 172.21.15.33:0/2644376297 conn(0x7f76240f0b90 msgr2=0x7f76240fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:17.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 shutdown_connections 2022-02-02T14:13:17.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.254+0000 7f762359e700 1 -- 172.21.15.33:0/2644376297 wait complete. 2022-02-02T14:13:17.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 -- 172.21.15.33:0/39008368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f6860 msgr2=0x7f6a4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 --2- 172.21.15.33:0/39008368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c0f6cc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f6a3c004660 tx=0x7f6a3c009b30).stop 2022-02-02T14:13:17.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 -- 172.21.15.33:0/39008368 shutdown_connections 2022-02-02T14:13:17.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 --2- 172.21.15.33:0/39008368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c0f6cc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 --2- 172.21.15.33:0/39008368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 -- 172.21.15.33:0/39008368 >> 172.21.15.33:0/39008368 conn(0x7f6a4c0f0d40 msgr2=0x7f6a4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 -- 172.21.15.33:0/39008368 shutdown_connections 2022-02-02T14:13:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.354+0000 7f6a51e37700 1 -- 172.21.15.33:0/39008368 wait complete. 2022-02-02T14:13:17.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.355+0000 7f6a51e37700 1 Processor -- start 2022-02-02T14:13:17.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.355+0000 7f6a51e37700 1 -- start start 2022-02-02T14:13:17.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a51e37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a51e37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a51e37700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c109bc0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a51e37700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c109d00 con 0x7f6a4c0f6860 2022-02-02T14:13:17.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60140/0 (socket says 172.21.15.33:60140) 2022-02-02T14:13:17.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 -- 172.21.15.33:0/1488025388 learned_addr learned my addr 172.21.15.33:0/1488025388 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:17.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4affd700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 -- 172.21.15.33:0/1488025388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f6860 msgr2=0x7f6a4c109610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c109610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 -- 172.21.15.33:0/1488025388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c005040 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a4b7fe700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f6a3400e840 tx=0x7f6a3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:17.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a340092e0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c10a6a0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.356+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a3400f040 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.357+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a34014830 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.357+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c10ac60 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.358+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c045ad0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.358+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a34014ab0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.358+0000 7f6a43fff700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 0x7f6a38067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:17.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.358+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6a34081bb0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.358+0000 7f6a4affd700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 0x7f6a38067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:17.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.359+0000 7f6a4affd700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 0x7f6a38067270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6a3c009720 tx=0x7f6a3c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:17.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.363+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a34088080 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.577+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6a4c10b2a0 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.577+0000 7f6a43fff700 1 -- 172.21.15.33:0/1488025388 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6a34053690 con 0x7f6a4c0f55c0 2022-02-02T14:13:17.577 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:13:17.577 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:13:17.578 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:13:17.578 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:13:17.578 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:17.578 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:13:17.579 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:13:17.579 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:13:17.579 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:13:17.579 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:13:17.580 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:13:17.580 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:13:17.580 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:13:17.580 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:13:17.581 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:13:17.581 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:13:17.581 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:13:17.581 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:13:17.581 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:13:17.582 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:13:17.582 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:13:17.582 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:13:17.582 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:13:17.583 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:13:17.583 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:13:17.583 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:13:17.583 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:13:17.584 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:13:17.584 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:13:17.584 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:13:17.584 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:13:17.584 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:17.585 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:17.585 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:13:17.585 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:17.585 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:17.586 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:17.586 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:17.586 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:17.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 msgr2=0x7f6a38067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 0x7f6a38067270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f6a3c009720 tx=0x7f6a3c016040).stop 2022-02-02T14:13:17.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 msgr2=0x7f6a4c109120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:17.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f6a3400e840 tx=0x7f6a3400b040).stop 2022-02-02T14:13:17.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 shutdown_connections 2022-02-02T14:13:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a38064db0 0x7f6a38067270 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c0f55c0 0x7f6a4c109120 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 --2- 172.21.15.33:0/1488025388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a4c0f6860 0x7f6a4c109610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 >> 172.21.15.33:0/1488025388 conn(0x7f6a4c0f0d40 msgr2=0x7f6a4c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 shutdown_connections 2022-02-02T14:13:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:17.580+0000 7f6a51e37700 1 -- 172.21.15.33:0/1488025388 wait complete. 2022-02-02T14:13:17.590 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:13:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:18 smithi033 ceph-mon[101165]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:18 smithi033 ceph-mon[101165]: pgmap v1037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:18 smithi033 ceph-mon[101165]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:18.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2644376297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:13:18.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1488025388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:13:18.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:18 smithi037 ceph-mon[69017]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:18.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:18 smithi037 ceph-mon[69017]: pgmap v1037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:18.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:18 smithi037 ceph-mon[69017]: from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:18.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2644376297' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:13:18.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1488025388' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:13:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:20 smithi033 ceph-mon[101165]: pgmap v1038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:20 smithi037 ceph-mon[69017]: pgmap v1038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:22 smithi033 ceph-mon[101165]: pgmap v1039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:22 smithi037 ceph-mon[69017]: pgmap v1039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:24 smithi033 ceph-mon[101165]: pgmap v1040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:24 smithi037 ceph-mon[69017]: pgmap v1040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:26 smithi033 ceph-mon[101165]: pgmap v1041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:26 smithi037 ceph-mon[69017]: pgmap v1041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:28 smithi033 ceph-mon[101165]: pgmap v1042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:28 smithi037 ceph-mon[69017]: pgmap v1042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:30 smithi033 ceph-mon[101165]: pgmap v1043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:30 smithi037 ceph-mon[69017]: pgmap v1043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:32 smithi033 ceph-mon[101165]: pgmap v1044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:32 smithi037 ceph-mon[69017]: pgmap v1044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:34 smithi033 ceph-mon[101165]: pgmap v1045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:34 smithi037 ceph-mon[69017]: pgmap v1045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:36 smithi033 ceph-mon[101165]: pgmap v1046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:36 smithi037 ceph-mon[69017]: pgmap v1046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:38 smithi033 ceph-mon[101165]: pgmap v1047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:38.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:38 smithi037 ceph-mon[69017]: pgmap v1047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:40 smithi033 ceph-mon[101165]: pgmap v1048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:40 smithi037 ceph-mon[69017]: pgmap v1048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:42 smithi033 ceph-mon[101165]: pgmap v1049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:42 smithi037 ceph-mon[69017]: pgmap v1049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:44 smithi033 ceph-mon[101165]: pgmap v1050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:44 smithi037 ceph-mon[69017]: pgmap v1050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:46 smithi033 ceph-mon[101165]: pgmap v1051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:46 smithi037 ceph-mon[69017]: pgmap v1051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:47.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 -- 172.21.15.33:0/1089035092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f55c0 msgr2=0x7f67f00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 --2- 172.21.15.33:0/1089035092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f55c0 0x7f67f00f59e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f67e0004660 tx=0x7f67e0009b30).stop 2022-02-02T14:13:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 -- 172.21.15.33:0/1089035092 shutdown_connections 2022-02-02T14:13:47.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 --2- 172.21.15.33:0/1089035092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f6860 0x7f67f00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 --2- 172.21.15.33:0/1089035092 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f55c0 0x7f67f00f59e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 -- 172.21.15.33:0/1089035092 >> 172.21.15.33:0/1089035092 conn(0x7f67f00f0d40 msgr2=0x7f67f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 -- 172.21.15.33:0/1089035092 shutdown_connections 2022-02-02T14:13:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 -- 172.21.15.33:0/1089035092 wait complete. 2022-02-02T14:13:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.695+0000 7f67f66e5700 1 Processor -- start 2022-02-02T14:13:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67f66e5700 1 -- start start 2022-02-02T14:13:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67f66e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f55c0 0x7f67f0105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:47.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67f66e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67f66e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0106910 con 0x7f67f00f6860 2022-02-02T14:13:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67f66e5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0106a50 con 0x7f67f00f55c0 2022-02-02T14:13:47.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60152/0 (socket says 172.21.15.33:60152) 2022-02-02T14:13:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 -- 172.21.15.33:0/3805147225 learned_addr learned my addr 172.21.15.33:0/3805147225 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67effff700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f55c0 0x7f67f0105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 -- 172.21.15.33:0/3805147225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f55c0 msgr2=0x7f67f0105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:47.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f55c0 0x7f67f0105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.696+0000 7f67ef7fe700 1 -- 172.21.15.33:0/3805147225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0005040 con 0x7f67f00f6860 2022-02-02T14:13:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67ef7fe700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f67e400e9a0 tx=0x7f67e4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:47.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e400cb90 con 0x7f67f00f6860 2022-02-02T14:13:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f67e400ee30 con 0x7f67f00f6860 2022-02-02T14:13:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01073f0 con 0x7f67f00f6860 2022-02-02T14:13:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e4010630 con 0x7f67f00f6860 2022-02-02T14:13:47.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.697+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01079b0 con 0x7f67f00f6860 2022-02-02T14:13:47.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.698+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f0045ad0 con 0x7f67f00f6860 2022-02-02T14:13:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.698+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f67e400ccf0 con 0x7f67f00f6860 2022-02-02T14:13:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.699+0000 7f67ecff9700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 0x7f67d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:47.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.699+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f67e4084b70 con 0x7f67f00f6860 2022-02-02T14:13:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.699+0000 7f67effff700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 0x7f67d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.699+0000 7f67effff700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 0x7f67d8067290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f67e0004630 tx=0x7f67e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.703+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f67e40565f0 con 0x7f67f00f6860 2022-02-02T14:13:47.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.893+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f67f005f620 con 0x7f67d8064dd0 2022-02-02T14:13:47.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.894+0000 7f67ecff9700 1 -- 172.21.15.33:0/3805147225 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f67f005f620 con 0x7f67d8064dd0 2022-02-02T14:13:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 msgr2=0x7f67d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:47.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 0x7f67d8067290 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f67e0004630 tx=0x7f67e0009b30).stop 2022-02-02T14:13:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 msgr2=0x7f67f0106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f67e400e9a0 tx=0x7f67e4007e00).stop 2022-02-02T14:13:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 shutdown_connections 2022-02-02T14:13:47.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67d8064dd0 0x7f67d8067290 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f00f55c0 0x7f67f0105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 --2- 172.21.15.33:0/3805147225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67f00f6860 0x7f67f0106360 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 >> 172.21.15.33:0/3805147225 conn(0x7f67f00f0d40 msgr2=0x7f67f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 shutdown_connections 2022-02-02T14:13:47.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.896+0000 7f67f66e5700 1 -- 172.21.15.33:0/3805147225 wait complete. 2022-02-02T14:13:47.906 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:13:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- 172.21.15.33:0/3185402184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 msgr2=0x7f86080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 --2- 172.21.15.33:0/3185402184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f86080f6b30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f85f4004660 tx=0x7f85f4009b30).stop 2022-02-02T14:13:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- 172.21.15.33:0/3185402184 shutdown_connections 2022-02-02T14:13:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 --2- 172.21.15.33:0/3185402184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f86080f6b30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 --2- 172.21.15.33:0/3185402184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f86080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- 172.21.15.33:0/3185402184 >> 172.21.15.33:0/3185402184 conn(0x7f86080f0b90 msgr2=0x7f86080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- 172.21.15.33:0/3185402184 shutdown_connections 2022-02-02T14:13:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- 172.21.15.33:0/3185402184 wait complete. 2022-02-02T14:13:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 Processor -- start 2022-02-02T14:13:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.997+0000 7f860db71700 1 -- start start 2022-02-02T14:13:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860db71700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f860810be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860db71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860db71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080602b0 con 0x7f86080f66d0 2022-02-02T14:13:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860db71700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86080603f0 con 0x7f86080f5430 2022-02-02T14:13:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60162/0 (socket says 172.21.15.33:60162) 2022-02-02T14:13:48.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 -- 172.21.15.33:0/634080088 learned_addr learned my addr 172.21.15.33:0/634080088 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860cb6f700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f860810be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 -- 172.21.15.33:0/634080088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 msgr2=0x7f860810be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f860810be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 -- 172.21.15.33:0/634080088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4005040 con 0x7f86080f66d0 2022-02-02T14:13:48.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f860cb6f700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f860810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:13:48.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f8607fff700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f85f4009990 tx=0x7f85f4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.998+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f4018070 con 0x7f86080f66d0 2022-02-02T14:13:48.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.999+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85f4007ba0 con 0x7f86080f66d0 2022-02-02T14:13:48.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.999+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860810e830 con 0x7f86080f66d0 2022-02-02T14:13:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.999+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f401c3c0 con 0x7f86080f66d0 2022-02-02T14:13:48.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:47.999+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860810ec00 con 0x7f86080f66d0 2022-02-02T14:13:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.000+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8608059100 con 0x7f86080f66d0 2022-02-02T14:13:48.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.000+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85f401d420 con 0x7f86080f66d0 2022-02-02T14:13:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.000+0000 7f86057fa700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 0x7f85f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.001+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f85f40836b0 con 0x7f86080f66d0 2022-02-02T14:13:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.001+0000 7f860cb6f700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 0x7f85f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.001+0000 7f860cb6f700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 0x7f85f80672e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f8608060040 tx=0x7f85fc009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.005+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85f4051700 con 0x7f86080f66d0 2022-02-02T14:13:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.187+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86080fdd10 con 0x7f85f8064e20 2022-02-02T14:13:48.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.202+0000 7f86057fa700 1 -- 172.21.15.33:0/634080088 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f86080fdd10 con 0x7f85f8064e20 2022-02-02T14:13:48.202 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:13:48.202 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (39m) 71s ago 40m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:13:48.203 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (32m) 71s ago 40m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:13:48.203 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (32m) 73s ago 39m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:13:48.203 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (38m) 71s ago 39m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:13:48.203 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (32m) 71s ago 36m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:13:48.203 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (33m) 71s ago 36m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:13:48.204 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (33m) 73s ago 36m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:13:48.204 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (36m) 73s ago 36m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:13:48.204 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (33m) 71s ago 41m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:13:48.204 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (33m) 73s ago 39m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:13:48.205 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (33m) 71s ago 41m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:13:48.205 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (32m) 73s ago 39m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:13:48.205 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (39m) 71s ago 39m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:13:48.205 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (39m) 73s ago 39m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:13:48.205 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 71s ago 38m - 4096M 2022-02-02T14:13:48.206 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (38m) 71s ago 38m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:13:48.206 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (38m) 71s ago 38m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:13:48.206 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (37m) 73s ago 37m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:13:48.206 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (37m) 73s ago 37m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:13:48.207 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (37m) 73s ago 37m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:13:48.207 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (38m) 71s ago 39m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:13:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 msgr2=0x7f85f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 0x7f85f80672e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f8608060040 tx=0x7f85fc009c00).stop 2022-02-02T14:13:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 msgr2=0x7f860810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f85f4009990 tx=0x7f85f4009b30).stop 2022-02-02T14:13:48.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 shutdown_connections 2022-02-02T14:13:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85f8064e20 0x7f85f80672e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86080f5430 0x7f860810be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 --2- 172.21.15.33:0/634080088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86080f66d0 0x7f860810e340 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 >> 172.21.15.33:0/634080088 conn(0x7f86080f0b90 msgr2=0x7f86080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 shutdown_connections 2022-02-02T14:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.204+0000 7f860db71700 1 -- 172.21.15.33:0/634080088 wait complete. 2022-02-02T14:13:48.212 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:48 smithi033 ceph-mon[101165]: pgmap v1052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:48.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 -- 172.21.15.33:0/2573551070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 msgr2=0x7efe600f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 --2- 172.21.15.33:0/2573551070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe600f5880 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7efe50004660 tx=0x7efe50009b30).stop 2022-02-02T14:13:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 -- 172.21.15.33:0/2573551070 shutdown_connections 2022-02-02T14:13:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 --2- 172.21.15.33:0/2573551070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 0x7efe600f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 --2- 172.21.15.33:0/2573551070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe600f5880 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.304+0000 7efe65891700 1 -- 172.21.15.33:0/2573551070 >> 172.21.15.33:0/2573551070 conn(0x7efe600f0bc0 msgr2=0x7efe600f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.305+0000 7efe65891700 1 -- 172.21.15.33:0/2573551070 shutdown_connections 2022-02-02T14:13:48.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.305+0000 7efe65891700 1 -- 172.21.15.33:0/2573551070 wait complete. 2022-02-02T14:13:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.305+0000 7efe65891700 1 Processor -- start 2022-02-02T14:13:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.305+0000 7efe65891700 1 -- start start 2022-02-02T14:13:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe65891700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe65891700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 0x7efe6010c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe65891700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600603c0 con 0x7efe600f5460 2022-02-02T14:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe65891700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60060500 con 0x7efe600f6700 2022-02-02T14:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60170/0 (socket says 172.21.15.33:60170) 2022-02-02T14:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 -- 172.21.15.33:0/2455615902 learned_addr learned my addr 172.21.15.33:0/2455615902 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5e7fc700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 0x7efe6010c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 -- 172.21.15.33:0/2455615902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 msgr2=0x7efe6010c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 0x7efe6010c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 -- 172.21.15.33:0/2455615902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe50005040 con 0x7efe600f5460 2022-02-02T14:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe5effd700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7efe50013a70 tx=0x7efe50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.306+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe50018070 con 0x7efe600f5460 2022-02-02T14:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.307+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efe500097d0 con 0x7efe600f5460 2022-02-02T14:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.307+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6010c570 con 0x7efe600f5460 2022-02-02T14:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.307+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe5001de80 con 0x7efe600f5460 2022-02-02T14:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.307+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6010caa0 con 0x7efe600f5460 2022-02-02T14:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.308+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe60059100 con 0x7efe600f5460 2022-02-02T14:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.308+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efe50007ba0 con 0x7efe600f5460 2022-02-02T14:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.308+0000 7efe477fe700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 0x7efe480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.309+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efe500836a0 con 0x7efe600f5460 2022-02-02T14:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.309+0000 7efe5e7fc700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 0x7efe480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.309+0000 7efe5e7fc700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 0x7efe480672e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7efe54004c40 tx=0x7efe5400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.313+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efe50051750 con 0x7efe600f5460 2022-02-02T14:13:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:48 smithi037 ceph-mon[69017]: pgmap v1052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.558+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe600fdcf0 con 0x7efe600f5460 2022-02-02T14:13:48.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.558+0000 7efe477fe700 1 -- 172.21.15.33:0/2455615902 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7efe50054d70 con 0x7efe600f5460 2022-02-02T14:13:48.559 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:13:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:13:48.559 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:13:48.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:48.560 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:13:48.560 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:13:48.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:48.560 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:13:48.561 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:13:48.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:48.561 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:13:48.562 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:13:48.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:13:48.562 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:13:48.563 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:13:48.563 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:13:48.563 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:13:48.563 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:13:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 msgr2=0x7efe480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 0x7efe480672e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7efe54004c40 tx=0x7efe5400b040).stop 2022-02-02T14:13:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 msgr2=0x7efe60109b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7efe50013a70 tx=0x7efe50009b30).stop 2022-02-02T14:13:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 shutdown_connections 2022-02-02T14:13:48.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efe48064e20 0x7efe480672e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe600f5460 0x7efe60109b20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 --2- 172.21.15.33:0/2455615902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe600f6700 0x7efe6010c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.560+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 >> 172.21.15.33:0/2455615902 conn(0x7efe600f0bc0 msgr2=0x7efe600fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.561+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 shutdown_connections 2022-02-02T14:13:48.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.561+0000 7efe65891700 1 -- 172.21.15.33:0/2455615902 wait complete. 2022-02-02T14:13:48.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 -- 172.21.15.33:0/3068527848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 msgr2=0x7faf340f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 --2- 172.21.15.33:0/3068527848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf340f6b30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7faf28004660 tx=0x7faf28009b30).stop 2022-02-02T14:13:48.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 -- 172.21.15.33:0/3068527848 shutdown_connections 2022-02-02T14:13:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 --2- 172.21.15.33:0/3068527848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf340f6b30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 --2- 172.21.15.33:0/3068527848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 0x7faf340f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.661+0000 7faf3359e700 1 -- 172.21.15.33:0/3068527848 >> 172.21.15.33:0/3068527848 conn(0x7faf340f0b90 msgr2=0x7faf340f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 -- 172.21.15.33:0/3068527848 shutdown_connections 2022-02-02T14:13:48.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 -- 172.21.15.33:0/3068527848 wait complete. 2022-02-02T14:13:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 Processor -- start 2022-02-02T14:13:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 -- start start 2022-02-02T14:13:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 0x7faf34106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34107830 con 0x7faf340f66d0 2022-02-02T14:13:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf3359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34108040 con 0x7faf340f5430 2022-02-02T14:13:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.662+0000 7faf31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60182/0 (socket says 172.21.15.33:60182) 2022-02-02T14:13:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf31d9b700 1 -- 172.21.15.33:0/1094701592 learned_addr learned my addr 172.21.15.33:0/1094701592 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:13:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf3259c700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 0x7faf34106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf31d9b700 1 -- 172.21.15.33:0/1094701592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 msgr2=0x7faf34106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf31d9b700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 0x7faf34106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf31d9b700 1 -- 172.21.15.33:0/1094701592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28005040 con 0x7faf340f66d0 2022-02-02T14:13:48.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf31d9b700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7faf28009830 tx=0x7faf28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf28018070 con 0x7faf340f66d0 2022-02-02T14:13:48.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf34108260 con 0x7faf340f66d0 2022-02-02T14:13:48.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf28007ba0 con 0x7faf340f66d0 2022-02-02T14:13:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf341087c0 con 0x7faf340f66d0 2022-02-02T14:13:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.663+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf2801c3c0 con 0x7faf340f66d0 2022-02-02T14:13:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.664+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf18004fa0 con 0x7faf340f66d0 2022-02-02T14:13:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.665+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf28007d10 con 0x7faf340f66d0 2022-02-02T14:13:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.666+0000 7faf22ffd700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 0x7faf1c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:13:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.666+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faf280839d0 con 0x7faf340f66d0 2022-02-02T14:13:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.666+0000 7faf3259c700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 0x7faf1c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:13:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.666+0000 7faf3259c700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 0x7faf1c0672e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7faf34106ab0 tx=0x7faf2400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:13:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.669+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf28051a80 con 0x7faf340f66d0 2022-02-02T14:13:48.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.887+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faf18005940 con 0x7faf340f66d0 2022-02-02T14:13:48.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.887+0000 7faf22ffd700 1 -- 172.21.15.33:0/1094701592 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7faf280550a0 con 0x7faf340f66d0 2022-02-02T14:13:48.888 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:13:48.888 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:13:48.888 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:13:48.888 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:13:48.889 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:48.889 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:13:48.889 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:13:48.889 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:13:48.889 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:13:48.890 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:13:48.890 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:13:48.890 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:13:48.891 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:13:48.891 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:13:48.892 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:13:48.893 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:13:48.893 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:13:48.893 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:13:48.894 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:13:48.894 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:13:48.895 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:13:48.895 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:13:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:13:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:13:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:13:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:13:48.898 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:13:48.898 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:13:48.898 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:13:48.899 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:13:48.900 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:13:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:48.900 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:48.901 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:13:48.901 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:13:48.901 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:48.902 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:48.902 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:48.902 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:13:48.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 msgr2=0x7faf1c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 0x7faf1c0672e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7faf34106ab0 tx=0x7faf2400b040).stop 2022-02-02T14:13:48.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 msgr2=0x7faf34107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:13:48.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7faf28009830 tx=0x7faf28009b30).stop 2022-02-02T14:13:48.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 shutdown_connections 2022-02-02T14:13:48.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf1c064e20 0x7faf1c0672e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf340f5430 0x7faf34106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 --2- 172.21.15.33:0/1094701592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf340f66d0 0x7faf34107230 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:13:48.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 >> 172.21.15.33:0/1094701592 conn(0x7faf340f0b90 msgr2=0x7faf3405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:13:48.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 shutdown_connections 2022-02-02T14:13:48.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:13:48.889+0000 7faf3359e700 1 -- 172.21.15.33:0/1094701592 wait complete. 2022-02-02T14:13:48.906 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:13:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:49 smithi033 ceph-mon[101165]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:49.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:49 smithi033 ceph-mon[101165]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2455615902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:13:49.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1094701592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:13:49.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:49 smithi037 ceph-mon[69017]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:49 smithi037 ceph-mon[69017]: from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:13:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2455615902' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:13:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1094701592' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:13:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:50 smithi033 ceph-mon[101165]: pgmap v1053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:50 smithi037 ceph-mon[69017]: pgmap v1053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:52 smithi033 ceph-mon[101165]: pgmap v1054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:52 smithi037 ceph-mon[69017]: pgmap v1054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:54 smithi033 ceph-mon[101165]: pgmap v1055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:54 smithi037 ceph-mon[69017]: pgmap v1055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:13:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:13:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:13:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:13:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:56 smithi033 ceph-mon[101165]: pgmap v1056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:56 smithi037 ceph-mon[69017]: pgmap v1056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:13:58 smithi033 ceph-mon[101165]: pgmap v1057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:13:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:13:58 smithi037 ceph-mon[69017]: pgmap v1057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:00 smithi033 ceph-mon[101165]: pgmap v1058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:00 smithi037 ceph-mon[69017]: pgmap v1058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:02 smithi033 ceph-mon[101165]: pgmap v1059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:02 smithi037 ceph-mon[69017]: pgmap v1059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:04 smithi033 ceph-mon[101165]: pgmap v1060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:04 smithi037 ceph-mon[69017]: pgmap v1060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:06 smithi033 ceph-mon[101165]: pgmap v1061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:06 smithi037 ceph-mon[69017]: pgmap v1061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:08 smithi033 ceph-mon[101165]: pgmap v1062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:08.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:08 smithi037 ceph-mon[69017]: pgmap v1062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:10 smithi033 ceph-mon[101165]: pgmap v1063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:10 smithi037 ceph-mon[69017]: pgmap v1063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:12 smithi033 ceph-mon[101165]: pgmap v1064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:12 smithi037 ceph-mon[69017]: pgmap v1064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:14 smithi033 ceph-mon[101165]: pgmap v1065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:14 smithi037 ceph-mon[69017]: pgmap v1065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:16 smithi033 ceph-mon[101165]: pgmap v1066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:16.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:16 smithi037 ceph-mon[69017]: pgmap v1066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:18 smithi033 ceph-mon[101165]: pgmap v1067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:18.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:18 smithi037 ceph-mon[69017]: pgmap v1067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:19.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 -- 172.21.15.33:0/1989845923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f5430 msgr2=0x7f52b80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 --2- 172.21.15.33:0/1989845923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f5430 0x7f52b80f5850 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f52a8004660 tx=0x7f52a8009b30).stop 2022-02-02T14:14:19.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 -- 172.21.15.33:0/1989845923 shutdown_connections 2022-02-02T14:14:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 --2- 172.21.15.33:0/1989845923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f66d0 0x7f52b80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 --2- 172.21.15.33:0/1989845923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f5430 0x7f52b80f5850 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 -- 172.21.15.33:0/1989845923 >> 172.21.15.33:0/1989845923 conn(0x7f52b80f0b90 msgr2=0x7f52b80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 -- 172.21.15.33:0/1989845923 shutdown_connections 2022-02-02T14:14:19.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.004+0000 7f52b759e700 1 -- 172.21.15.33:0/1989845923 wait complete. 2022-02-02T14:14:19.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 Processor -- start 2022-02-02T14:14:19.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 -- start start 2022-02-02T14:14:19.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f5430 0x7f52b8105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8106760 con 0x7f52b80f66d0 2022-02-02T14:14:19.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8106f60 con 0x7f52b80f5430 2022-02-02T14:14:19.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60192/0 (socket says 172.21.15.33:60192) 2022-02-02T14:14:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 -- 172.21.15.33:0/977598415 learned_addr learned my addr 172.21.15.33:0/977598415 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b659c700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f5430 0x7f52b8105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 -- 172.21.15.33:0/977598415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f5430 msgr2=0x7f52b8105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f5430 0x7f52b8105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 -- 172.21.15.33:0/977598415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a8005040 con 0x7f52b80f66d0 2022-02-02T14:14:19.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.005+0000 7f52b5d9b700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f52ac00f970 tx=0x7f52ac009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.006+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac009500 con 0x7f52b80f66d0 2022-02-02T14:14:19.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.006+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f52ac009660 con 0x7f52b80f66d0 2022-02-02T14:14:19.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.006+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b81071e0 con 0x7f52b80f66d0 2022-02-02T14:14:19.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.006+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac00de80 con 0x7f52b80f66d0 2022-02-02T14:14:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.006+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8107750 con 0x7f52b80f66d0 2022-02-02T14:14:19.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.007+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b8059100 con 0x7f52b80f66d0 2022-02-02T14:14:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.007+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f52ac00e040 con 0x7f52b80f66d0 2022-02-02T14:14:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.008+0000 7f52a6ffd700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 0x7f52a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.008+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f52ac084360 con 0x7f52b80f66d0 2022-02-02T14:14:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.008+0000 7f52b659c700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 0x7f52a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.008+0000 7f52b659c700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 0x7f52a00672e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f52a8004630 tx=0x7f52a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.012+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52ac055d80 con 0x7f52b80f66d0 2022-02-02T14:14:19.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.200+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f52b80ff6c0 con 0x7f52a0064e20 2022-02-02T14:14:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.201+0000 7f52a6ffd700 1 -- 172.21.15.33:0/977598415 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f52b80ff6c0 con 0x7f52a0064e20 2022-02-02T14:14:19.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 msgr2=0x7f52a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 0x7f52a00672e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f52a8004630 tx=0x7f52a8009b30).stop 2022-02-02T14:14:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 msgr2=0x7f52b81061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f52ac00f970 tx=0x7f52ac009e00).stop 2022-02-02T14:14:19.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 shutdown_connections 2022-02-02T14:14:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f52a0064e20 0x7f52a00672e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b80f5430 0x7f52b8105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 --2- 172.21.15.33:0/977598415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52b80f66d0 0x7f52b81061b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.203+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 >> 172.21.15.33:0/977598415 conn(0x7f52b80f0b90 msgr2=0x7f52b80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.204+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 shutdown_connections 2022-02-02T14:14:19.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.204+0000 7f52b759e700 1 -- 172.21.15.33:0/977598415 wait complete. 2022-02-02T14:14:19.213 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:14:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 -- 172.21.15.33:0/95386885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 msgr2=0x7fbe180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 --2- 172.21.15.33:0/95386885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe180f7de0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fbe0c004660 tx=0x7fbe0c009b30).stop 2022-02-02T14:14:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 -- 172.21.15.33:0/95386885 shutdown_connections 2022-02-02T14:14:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 --2- 172.21.15.33:0/95386885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe180f7de0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 --2- 172.21.15.33:0/95386885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 0x7fbe180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 -- 172.21.15.33:0/95386885 >> 172.21.15.33:0/95386885 conn(0x7fbe180f1e40 msgr2=0x7fbe180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 -- 172.21.15.33:0/95386885 shutdown_connections 2022-02-02T14:14:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.304+0000 7fbe1f374700 1 -- 172.21.15.33:0/95386885 wait complete. 2022-02-02T14:14:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 Processor -- start 2022-02-02T14:14:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 -- start start 2022-02-02T14:14:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 0x7fbe18109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18109c20 con 0x7fbe180f7980 2022-02-02T14:14:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1f374700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18109d60 con 0x7fbe180f66e0 2022-02-02T14:14:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60202/0 (socket says 172.21.15.33:60202) 2022-02-02T14:14:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 -- 172.21.15.33:0/1606448684 learned_addr learned my addr 172.21.15.33:0/1606448684 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1d110700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 0x7fbe18109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 -- 172.21.15.33:0/1606448684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 msgr2=0x7fbe18109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 0x7fbe18109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.305+0000 7fbe1c90f700 1 -- 172.21.15.33:0/1606448684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c005040 con 0x7fbe180f7980 2022-02-02T14:14:19.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe1c90f700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fbe0c009990 tx=0x7fbe0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c018070 con 0x7fbe180f7980 2022-02-02T14:14:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbe0c007ca0 con 0x7fbe180f7980 2022-02-02T14:14:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0c01c620 con 0x7fbe180f7980 2022-02-02T14:14:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe1810a6a0 con 0x7fbe180f7980 2022-02-02T14:14:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.306+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe1810ac00 con 0x7fbe180f7980 2022-02-02T14:14:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.307+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe18045ad0 con 0x7fbe180f7980 2022-02-02T14:14:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.308+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbe0c01d960 con 0x7fbe180f7980 2022-02-02T14:14:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.308+0000 7fbe09ffb700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.308+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbe0c083780 con 0x7fbe180f7980 2022-02-02T14:14:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.308+0000 7fbe1d110700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.309+0000 7fbe1d110700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 0x7fbe04067290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fbe180f77e0 tx=0x7fbe14009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.312+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbe0c055260 con 0x7fbe180f7980 2022-02-02T14:14:19.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.493+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe1810ae70 con 0x7fbe04064dd0 2022-02-02T14:14:19.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.508+0000 7fbe09ffb700 1 -- 172.21.15.33:0/1606448684 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fbe1810ae70 con 0x7fbe04064dd0 2022-02-02T14:14:19.508 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:14:19.508 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (39m) 102s ago 40m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:14:19.509 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (32m) 102s ago 40m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:14:19.509 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (32m) 104s ago 40m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:14:19.510 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (39m) 102s ago 40m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:14:19.510 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (33m) 102s ago 36m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:14:19.511 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (33m) 102s ago 36m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:14:19.511 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (34m) 104s ago 36m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:14:19.511 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (36m) 104s ago 36m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:14:19.511 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (34m) 102s ago 41m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:14:19.512 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (33m) 104s ago 40m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:14:19.512 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (33m) 102s ago 42m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:14:19.512 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (33m) 104s ago 39m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:14:19.512 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (40m) 102s ago 40m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:14:19.513 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (39m) 104s ago 39m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:14:19.513 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 102s ago 39m - 4096M 2022-02-02T14:14:19.513 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (39m) 102s ago 39m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:14:19.513 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (38m) 102s ago 38m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:14:19.514 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (38m) 104s ago 38m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:14:19.514 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (38m) 104s ago 38m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:14:19.514 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (37m) 104s ago 37m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:14:19.516 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (39m) 102s ago 40m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:14:19.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 msgr2=0x7fbe04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 0x7fbe04067290 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7fbe180f77e0 tx=0x7fbe14009040).stop 2022-02-02T14:14:19.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 msgr2=0x7fbe18109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fbe0c009990 tx=0x7fbe0c009b30).stop 2022-02-02T14:14:19.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 shutdown_connections 2022-02-02T14:14:19.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbe04064dd0 0x7fbe04067290 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe180f66e0 0x7fbe18109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 --2- 172.21.15.33:0/1606448684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe180f7980 0x7fbe18109670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 >> 172.21.15.33:0/1606448684 conn(0x7fbe180f1e40 msgr2=0x7fbe1806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 shutdown_connections 2022-02-02T14:14:19.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.510+0000 7fbe1f374700 1 -- 172.21.15.33:0/1606448684 wait complete. 2022-02-02T14:14:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.609+0000 7fc77af6c700 1 -- 172.21.15.33:0/2577506783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f66d0 msgr2=0x7fc7740f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.609+0000 7fc77af6c700 1 --2- 172.21.15.33:0/2577506783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f66d0 0x7fc7740f6b30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7fc764004660 tx=0x7fc764009b30).stop 2022-02-02T14:14:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- 172.21.15.33:0/2577506783 shutdown_connections 2022-02-02T14:14:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 --2- 172.21.15.33:0/2577506783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f66d0 0x7fc7740f6b30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 --2- 172.21.15.33:0/2577506783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740f5430 0x7fc7740f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- 172.21.15.33:0/2577506783 >> 172.21.15.33:0/2577506783 conn(0x7fc7740f0b90 msgr2=0x7fc7740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- 172.21.15.33:0/2577506783 shutdown_connections 2022-02-02T14:14:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- 172.21.15.33:0/2577506783 wait complete. 2022-02-02T14:14:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 Processor -- start 2022-02-02T14:14:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- start start 2022-02-02T14:14:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740f66d0 0x7fc77410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7740603c0 con 0x7fc7740f5430 2022-02-02T14:14:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.610+0000 7fc77af6c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc774060500 con 0x7fc7740f66d0 2022-02-02T14:14:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60210/0 (socket says 172.21.15.33:60210) 2022-02-02T14:14:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 -- 172.21.15.33:0/3591763838 learned_addr learned my addr 172.21.15.33:0/3591763838 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 -- 172.21.15.33:0/3591763838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740f66d0 msgr2=0x7fc77410bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740f66d0 0x7fc77410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:14:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 -- 172.21.15.33:0/3591763838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764005040 con 0x7fc7740f5430 2022-02-02T14:14:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc779f6a700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc77000c530 tx=0x7fc770007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc77000f650 con 0x7fc7740f5430 2022-02-02T14:14:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc77000fc60 con 0x7fc7740f5430 2022-02-02T14:14:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77410c4f0 con 0x7fc7740f5430 2022-02-02T14:14:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc770012d20 con 0x7fc7740f5430 2022-02-02T14:14:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.611+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77410ca80 con 0x7fc7740f5430 2022-02-02T14:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.613+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc774059100 con 0x7fc7740f5430 2022-02-02T14:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.613+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc770019030 con 0x7fc7740f5430 2022-02-02T14:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.613+0000 7fc76a7fc700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 0x7fc7600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.613+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc770081670 con 0x7fc7740f5430 2022-02-02T14:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.613+0000 7fc779769700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 0x7fc7600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.614+0000 7fc779769700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 0x7fc7600672e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc764004e30 tx=0x7fc764009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.618+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc77004f830 con 0x7fc7740f5430 2022-02-02T14:14:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.859+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7740586e0 con 0x7fc7740f5430 2022-02-02T14:14:19.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.860+0000 7fc76a7fc700 1 -- 172.21.15.33:0/3591763838 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc770052e50 con 0x7fc7740f5430 2022-02-02T14:14:19.860 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:14:19.860 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:14:19.860 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:14:19.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:19.861 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:14:19.861 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:14:19.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:19.861 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:14:19.862 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:14:19.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:19.862 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:14:19.862 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:14:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:14:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:14:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:14:19.863 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:14:19.864 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:14:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 msgr2=0x7fc7600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 0x7fc7600672e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fc764004e30 tx=0x7fc764009b30).stop 2022-02-02T14:14:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 msgr2=0x7fc774109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fc77000c530 tx=0x7fc770007e10).stop 2022-02-02T14:14:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 shutdown_connections 2022-02-02T14:14:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc760064e20 0x7fc7600672e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7740f5430 0x7fc774109a40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 --2- 172.21.15.33:0/3591763838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7740f66d0 0x7fc77410bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:14:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 >> 172.21.15.33:0/3591763838 conn(0x7fc7740f0b90 msgr2=0x7fc7740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 shutdown_connections 2022-02-02T14:14:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.862+0000 7fc77af6c700 1 -- 172.21.15.33:0/3591763838 wait complete. 2022-02-02T14:14:19.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 -- 172.21.15.33:0/3565388956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f5430 msgr2=0x7f957c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 --2- 172.21.15.33:0/3565388956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f5430 0x7f957c0f5850 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f9578004660 tx=0x7f9578009b30).stop 2022-02-02T14:14:19.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 -- 172.21.15.33:0/3565388956 shutdown_connections 2022-02-02T14:14:19.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 --2- 172.21.15.33:0/3565388956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f66d0 0x7f957c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 --2- 172.21.15.33:0/3565388956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f5430 0x7f957c0f5850 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 -- 172.21.15.33:0/3565388956 >> 172.21.15.33:0/3565388956 conn(0x7f957c0f0b90 msgr2=0x7f957c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:19.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.962+0000 7f95829cb700 1 -- 172.21.15.33:0/3565388956 shutdown_connections 2022-02-02T14:14:19.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 -- 172.21.15.33:0/3565388956 wait complete. 2022-02-02T14:14:19.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 Processor -- start 2022-02-02T14:14:19.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 -- start start 2022-02-02T14:14:19.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f5430 0x7f957c10be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0602b0 con 0x7f957c0f66d0 2022-02-02T14:14:19.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95829cb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957c0603f0 con 0x7f957c0f5430 2022-02-02T14:14:19.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.963+0000 7f95811c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60222/0 (socket says 172.21.15.33:60222) 2022-02-02T14:14:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 -- 172.21.15.33:0/2973659516 learned_addr learned my addr 172.21.15.33:0/2973659516 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95819c9700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f5430 0x7f957c10be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 -- 172.21.15.33:0/2973659516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f5430 msgr2=0x7f957c10be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f5430 0x7f957c10be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 -- 172.21.15.33:0/2973659516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9578005040 con 0x7f957c0f66d0 2022-02-02T14:14:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95811c8700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f956c00e7f0 tx=0x7f956c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f956c0092e0 con 0x7f957c0f66d0 2022-02-02T14:14:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f956c00f040 con 0x7f957c0f66d0 2022-02-02T14:14:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f956c014750 con 0x7f957c0f66d0 2022-02-02T14:14:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957c10e830 con 0x7f957c0f66d0 2022-02-02T14:14:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.964+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f957c10ecb0 con 0x7f957c0f66d0 2022-02-02T14:14:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.965+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957c045ad0 con 0x7f957c0f66d0 2022-02-02T14:14:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.966+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f956c01b030 con 0x7f957c0f66d0 2022-02-02T14:14:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.966+0000 7f95727fc700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 0x7f95680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.966+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f956c081870 con 0x7f957c0f66d0 2022-02-02T14:14:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.966+0000 7f95819c9700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 0x7f95680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:19.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.967+0000 7f95819c9700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 0x7f95680672e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f9578000c00 tx=0x7f9578016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:19.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:19.970+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f956c04f9d0 con 0x7f957c0f66d0 2022-02-02T14:14:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.187+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f957c027a00 con 0x7f957c0f66d0 2022-02-02T14:14:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.187+0000 7f95727fc700 1 -- 172.21.15.33:0/2973659516 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f956c052ff0 con 0x7f957c0f66d0 2022-02-02T14:14:20.188 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:14:20.188 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:14:20.189 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:14:20.189 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:14:20.189 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:20.189 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:14:20.190 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:14:20.190 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:14:20.190 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:14:20.190 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:14:20.191 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:14:20.191 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:14:20.191 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:14:20.191 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:14:20.192 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:14:20.193 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:14:20.193 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:14:20.193 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:14:20.194 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:14:20.194 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:14:20.194 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:14:20.194 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:14:20.195 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:14:20.195 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:14:20.195 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:14:20.195 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:14:20.196 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:14:20.196 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:14:20.196 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:14:20.196 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:14:20.196 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:14:20.197 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:20.197 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:20.197 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:14:20.197 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:20.197 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:20.198 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:20.198 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:20.198 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:20.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 msgr2=0x7f95680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:20.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 0x7f95680672e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f9578000c00 tx=0x7f9578016040).stop 2022-02-02T14:14:20.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 msgr2=0x7f957c10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:20.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f956c00e7f0 tx=0x7f956c00b040).stop 2022-02-02T14:14:20.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 shutdown_connections 2022-02-02T14:14:20.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9568064e20 0x7f95680672e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:20.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f957c0f5430 0x7f957c10be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:20.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 --2- 172.21.15.33:0/2973659516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f957c0f66d0 0x7f957c10e340 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:20.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 >> 172.21.15.33:0/2973659516 conn(0x7f957c0f0b90 msgr2=0x7f957c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:20.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 shutdown_connections 2022-02-02T14:14:20.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:20.189+0000 7f95829cb700 1 -- 172.21.15.33:0/2973659516 wait complete. 2022-02-02T14:14:20.202 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:14:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:20 smithi033 ceph-mon[101165]: pgmap v1068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:20 smithi033 ceph-mon[101165]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3591763838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:14:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:20 smithi037 ceph-mon[69017]: pgmap v1068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:20 smithi037 ceph-mon[69017]: from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3591763838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:14:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:21 smithi033 ceph-mon[101165]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:21.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:21 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2973659516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:14:21.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:21 smithi037 ceph-mon[69017]: from='client.35178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:21.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:21 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2973659516' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:14:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:22 smithi033 ceph-mon[101165]: pgmap v1069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:22 smithi037 ceph-mon[69017]: pgmap v1069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:24 smithi033 ceph-mon[101165]: pgmap v1070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:24 smithi037 ceph-mon[69017]: pgmap v1070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:26 smithi033 ceph-mon[101165]: pgmap v1071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:26 smithi037 ceph-mon[69017]: pgmap v1071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:28 smithi033 ceph-mon[101165]: pgmap v1072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:28 smithi037 ceph-mon[69017]: pgmap v1072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:30 smithi033 ceph-mon[101165]: pgmap v1073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:30 smithi037 ceph-mon[69017]: pgmap v1073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:32 smithi033 ceph-mon[101165]: pgmap v1074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:32 smithi037 ceph-mon[69017]: pgmap v1074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:34 smithi033 ceph-mon[101165]: pgmap v1075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:34 smithi037 ceph-mon[69017]: pgmap v1075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:36 smithi033 ceph-mon[101165]: pgmap v1076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:36 smithi037 ceph-mon[69017]: pgmap v1076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:38 smithi033 ceph-mon[101165]: pgmap v1077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:38 smithi037 ceph-mon[69017]: pgmap v1077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:40.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:40 smithi033 ceph-mon[101165]: pgmap v1078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:40 smithi037 ceph-mon[69017]: pgmap v1078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:42.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:42 smithi037 ceph-mon[69017]: pgmap v1079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:42 smithi033 ceph-mon[101165]: pgmap v1079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:44.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:44 smithi037 ceph-mon[69017]: pgmap v1080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:44 smithi033 ceph-mon[101165]: pgmap v1080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:46 smithi033 ceph-mon[101165]: pgmap v1081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:46 smithi037 ceph-mon[69017]: pgmap v1081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:48.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:48 smithi033 ceph-mon[101165]: pgmap v1082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:48 smithi037 ceph-mon[69017]: pgmap v1082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 -- 172.21.15.33:0/1716854610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 msgr2=0x7fb3840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 --2- 172.21.15.33:0/1716854610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb3840f5850 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fb380004660 tx=0x7fb380009b30).stop 2022-02-02T14:14:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 -- 172.21.15.33:0/1716854610 shutdown_connections 2022-02-02T14:14:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 --2- 172.21.15.33:0/1716854610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb3840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 --2- 172.21.15.33:0/1716854610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb3840f5850 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 -- 172.21.15.33:0/1716854610 >> 172.21.15.33:0/1716854610 conn(0x7fb3840f0b90 msgr2=0x7fb3840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:50.306 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:50 smithi033 ceph-mon[101165]: pgmap v1083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:50.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 -- 172.21.15.33:0/1716854610 shutdown_connections 2022-02-02T14:14:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.305+0000 7fb38b1df700 1 -- 172.21.15.33:0/1716854610 wait complete. 2022-02-02T14:14:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.306+0000 7fb38b1df700 1 Processor -- start 2022-02-02T14:14:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.306+0000 7fb38b1df700 1 -- start start 2022-02-02T14:14:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38b1df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38b1df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb384106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38b1df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841067d0 con 0x7fb3840f5430 2022-02-02T14:14:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38b1df700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb384106fd0 con 0x7fb3840f66d0 2022-02-02T14:14:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60230/0 (socket says 172.21.15.33:60230) 2022-02-02T14:14:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 -- 172.21.15.33:0/3187428700 learned_addr learned my addr 172.21.15.33:0/3187428700 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb3899dc700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb384106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 -- 172.21.15.33:0/3187428700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 msgr2=0x7fb384106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb384106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 -- 172.21.15.33:0/3187428700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380005040 con 0x7fb3840f5430 2022-02-02T14:14:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb38a1dd700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb380013a70 tx=0x7fb380009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.307+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb380018070 con 0x7fb3840f5430 2022-02-02T14:14:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.308+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb384107250 con 0x7fb3840f5430 2022-02-02T14:14:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.308+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb3800097d0 con 0x7fb3840f5430 2022-02-02T14:14:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.308+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38001c3c0 con 0x7fb3840f5430 2022-02-02T14:14:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.308+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3841077b0 con 0x7fb3840f5430 2022-02-02T14:14:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.309+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384059100 con 0x7fb3840f5430 2022-02-02T14:14:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.309+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb380007ba0 con 0x7fb3840f5430 2022-02-02T14:14:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.309+0000 7fb37affd700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.310+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb380083790 con 0x7fb3840f5430 2022-02-02T14:14:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.310+0000 7fb3899dc700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.310+0000 7fb3899dc700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fb3740096c0 tx=0x7fb374009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.314+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb380055330 con 0x7fb3840f5430 2022-02-02T14:14:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.503+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb38405f620 con 0x7fb370064e20 2022-02-02T14:14:50.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.504+0000 7fb37affd700 1 -- 172.21.15.33:0/3187428700 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb38405f620 con 0x7fb370064e20 2022-02-02T14:14:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 msgr2=0x7fb3700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fb3740096c0 tx=0x7fb374009be0).stop 2022-02-02T14:14:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 msgr2=0x7fb384105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fb380013a70 tx=0x7fb380009b30).stop 2022-02-02T14:14:50.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 shutdown_connections 2022-02-02T14:14:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb384105d30 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 --2- 172.21.15.33:0/3187428700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb384106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 >> 172.21.15.33:0/3187428700 conn(0x7fb3840f0b90 msgr2=0x7fb3840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 shutdown_connections 2022-02-02T14:14:50.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.506+0000 7fb38b1df700 1 -- 172.21.15.33:0/3187428700 wait complete. 2022-02-02T14:14:50.515 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:14:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:50 smithi037 ceph-mon[69017]: pgmap v1083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 -- 172.21.15.33:0/833507051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f6860 msgr2=0x7f83e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/833507051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f6860 0x7f83e00f6cc0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f83d0004660 tx=0x7f83d0009b30).stop 2022-02-02T14:14:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 -- 172.21.15.33:0/833507051 shutdown_connections 2022-02-02T14:14:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/833507051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f6860 0x7f83e00f6cc0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/833507051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f55c0 0x7f83e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 -- 172.21.15.33:0/833507051 >> 172.21.15.33:0/833507051 conn(0x7f83e00f0d40 msgr2=0x7f83e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 -- 172.21.15.33:0/833507051 shutdown_connections 2022-02-02T14:14:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.608+0000 7f83e4ea9700 1 -- 172.21.15.33:0/833507051 wait complete. 2022-02-02T14:14:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 Processor -- start 2022-02-02T14:14:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 -- start start 2022-02-02T14:14:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f6860 0x7f83e00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e010ab80 con 0x7f83e00f55c0 2022-02-02T14:14:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83e4ea9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e010acc0 con 0x7f83e00f6860 2022-02-02T14:14:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60240/0 (socket says 172.21.15.33:60240) 2022-02-02T14:14:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 -- 172.21.15.33:0/524442311 learned_addr learned my addr 172.21.15.33:0/524442311 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83ddd9b700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f6860 0x7f83e00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 -- 172.21.15.33:0/524442311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f6860 msgr2=0x7f83e00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f6860 0x7f83e00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 -- 172.21.15.33:0/524442311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0005040 con 0x7f83e00f55c0 2022-02-02T14:14:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.609+0000 7f83de59c700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f83d400e7c0 tx=0x7f83d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.610+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d40092e0 con 0x7f83e00f55c0 2022-02-02T14:14:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.610+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83d400f040 con 0x7f83e00f55c0 2022-02-02T14:14:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.610+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d40147e0 con 0x7f83e00f55c0 2022-02-02T14:14:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.610+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e00f8150 con 0x7f83e00f55c0 2022-02-02T14:14:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.610+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e00f8710 con 0x7f83e00f55c0 2022-02-02T14:14:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.611+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e0045ad0 con 0x7f83e00f55c0 2022-02-02T14:14:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.611+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83d401b030 con 0x7f83e00f55c0 2022-02-02T14:14:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.612+0000 7f83ceffd700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 0x7f83c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.612+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f83d4081a20 con 0x7f83e00f55c0 2022-02-02T14:14:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.612+0000 7f83ddd9b700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 0x7f83c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.612+0000 7f83ddd9b700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 0x7f83c8067290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f83d0005010 tx=0x7f83d0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.616+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83d404fa10 con 0x7f83e00f55c0 2022-02-02T14:14:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.801+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83e00faca0 con 0x7f83c8064dd0 2022-02-02T14:14:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.816+0000 7f83ceffd700 1 -- 172.21.15.33:0/524442311 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f83e00faca0 con 0x7f83c8064dd0 2022-02-02T14:14:50.815 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:14:50.816 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (40m) 2m ago 41m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:14:50.816 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (33m) 2m ago 41m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:14:50.816 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (33m) 2m ago 40m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:14:50.816 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (39m) 2m ago 40m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:14:50.817 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (33m) 2m ago 37m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:14:50.817 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (34m) 2m ago 37m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:14:50.817 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (35m) 2m ago 37m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:14:50.818 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (37m) 2m ago 37m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:14:50.818 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (34m) 2m ago 42m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:14:50.818 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (34m) 2m ago 40m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:14:50.819 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (34m) 2m ago 42m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:14:50.819 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (33m) 2m ago 40m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:14:50.819 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (40m) 2m ago 40m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:14:50.819 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (40m) 2m ago 40m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:14:50.819 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 2m ago 39m - 4096M 2022-02-02T14:14:50.820 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (39m) 2m ago 39m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:14:50.820 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (39m) 2m ago 39m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:14:50.820 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (39m) 2m ago 39m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:14:50.820 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (38m) 2m ago 38m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:14:50.821 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (38m) 2m ago 38m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:14:50.821 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (39m) 2m ago 40m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:14:50.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 msgr2=0x7f83c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 0x7f83c8067290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f83d0005010 tx=0x7f83d0016040).stop 2022-02-02T14:14:50.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 msgr2=0x7f83e00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f83d400e7c0 tx=0x7f83d400b040).stop 2022-02-02T14:14:50.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 shutdown_connections 2022-02-02T14:14:50.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83c8064dd0 0x7f83c8067290 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.817+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83e00f55c0 0x7f83e00f9720 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.818+0000 7f83e4ea9700 1 --2- 172.21.15.33:0/524442311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83e00f6860 0x7f83e00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.818+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 >> 172.21.15.33:0/524442311 conn(0x7f83e00f0d40 msgr2=0x7f83e005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:50.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.818+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 shutdown_connections 2022-02-02T14:14:50.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.818+0000 7f83e4ea9700 1 -- 172.21.15.33:0/524442311 wait complete. 2022-02-02T14:14:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 -- 172.21.15.33:0/241227645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f55c0 msgr2=0x7f19800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 --2- 172.21.15.33:0/241227645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f55c0 0x7f19800f59e0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f1970004660 tx=0x7f1970009b30).stop 2022-02-02T14:14:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 -- 172.21.15.33:0/241227645 shutdown_connections 2022-02-02T14:14:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 --2- 172.21.15.33:0/241227645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f6860 0x7f19800f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 --2- 172.21.15.33:0/241227645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f55c0 0x7f19800f59e0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 -- 172.21.15.33:0/241227645 >> 172.21.15.33:0/241227645 conn(0x7f19800f0d40 msgr2=0x7f19800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 -- 172.21.15.33:0/241227645 shutdown_connections 2022-02-02T14:14:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.917+0000 7f1985b1e700 1 -- 172.21.15.33:0/241227645 wait complete. 2022-02-02T14:14:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.918+0000 7f1985b1e700 1 Processor -- start 2022-02-02T14:14:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.918+0000 7f1985b1e700 1 -- start start 2022-02-02T14:14:50.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f1985b1e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f55c0 0x7f1980109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f1985b1e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f1985b1e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800603c0 con 0x7f19800f6860 2022-02-02T14:14:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f1985b1e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1980060500 con 0x7f19800f55c0 2022-02-02T14:14:50.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60252/0 (socket says 172.21.15.33:60252) 2022-02-02T14:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 -- 172.21.15.33:0/2195984396 learned_addr learned my addr 172.21.15.33:0/2195984396 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197f7fe700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f55c0 0x7f1980109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 -- 172.21.15.33:0/2195984396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f55c0 msgr2=0x7f1980109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f55c0 0x7f1980109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 -- 172.21.15.33:0/2195984396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970005040 con 0x7f19800f6860 2022-02-02T14:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.919+0000 7f197effd700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f197400e7f0 tx=0x7f197400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.920+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19740092e0 con 0x7f19800f6860 2022-02-02T14:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.920+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f197400f040 con 0x7f19800f6860 2022-02-02T14:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.920+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198010c6c0 con 0x7f19800f6860 2022-02-02T14:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.920+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1974014750 con 0x7f19800f6860 2022-02-02T14:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.920+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198010cc50 con 0x7f19800f6860 2022-02-02T14:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.921+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1960004fa0 con 0x7f19800f6860 2022-02-02T14:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.921+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f197401b030 con 0x7f19800f6860 2022-02-02T14:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.922+0000 7f1967fff700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 0x7f1968067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.922+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1974081730 con 0x7f19800f6860 2022-02-02T14:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.922+0000 7f197f7fe700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 0x7f1968067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.922+0000 7f197f7fe700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 0x7f1968067290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f1970000c00 tx=0x7f1970016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:50.926+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1974050860 con 0x7f19800f6860 2022-02-02T14:14:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.173+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1960005e80 con 0x7f19800f6860 2022-02-02T14:14:51.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.174+0000 7f1967fff700 1 -- 172.21.15.33:0/2195984396 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f19740192d0 con 0x7f19800f6860 2022-02-02T14:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:14:51.175 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:14:51.175 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:14:51.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:51.175 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:14:51.175 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:14:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:51.176 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:14:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 msgr2=0x7f1968067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 0x7f1968067290 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f1970000c00 tx=0x7f1970016040).stop 2022-02-02T14:14:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 msgr2=0x7f198010c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f197400e7f0 tx=0x7f197400b040).stop 2022-02-02T14:14:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 shutdown_connections 2022-02-02T14:14:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1968064dd0 0x7f1968067290 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19800f55c0 0x7f1980109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 --2- 172.21.15.33:0/2195984396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19800f6860 0x7f198010c110 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 >> 172.21.15.33:0/2195984396 conn(0x7f19800f0d40 msgr2=0x7f19800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 shutdown_connections 2022-02-02T14:14:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.176+0000 7f1985b1e700 1 -- 172.21.15.33:0/2195984396 wait complete. 2022-02-02T14:14:51.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 -- 172.21.15.33:0/2218910987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f7980 msgr2=0x7f8ea00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/2218910987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f7980 0x7f8ea00f7de0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f8e88004660 tx=0x7f8e88009b30).stop 2022-02-02T14:14:51.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 -- 172.21.15.33:0/2218910987 shutdown_connections 2022-02-02T14:14:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/2218910987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f7980 0x7f8ea00f7de0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/2218910987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f66e0 0x7f8ea00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 -- 172.21.15.33:0/2218910987 >> 172.21.15.33:0/2218910987 conn(0x7f8ea00f1e40 msgr2=0x7f8ea00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 -- 172.21.15.33:0/2218910987 shutdown_connections 2022-02-02T14:14:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.277+0000 7f8ea54cf700 1 -- 172.21.15.33:0/2218910987 wait complete. 2022-02-02T14:14:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 Processor -- start 2022-02-02T14:14:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 -- start start 2022-02-02T14:14:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f7980 0x7f8ea0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea006a380 con 0x7f8ea00f66e0 2022-02-02T14:14:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8ea54cf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea006a4c0 con 0x7f8ea00f7980 2022-02-02T14:14:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60260/0 (socket says 172.21.15.33:60260) 2022-02-02T14:14:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 -- 172.21.15.33:0/1451182864 learned_addr learned my addr 172.21.15.33:0/1451182864 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:14:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9e7fc700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f7980 0x7f8ea0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 -- 172.21.15.33:0/1451182864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f7980 msgr2=0x7f8ea0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f7980 0x7f8ea0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 -- 172.21.15.33:0/1451182864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88005040 con 0x7f8ea00f66e0 2022-02-02T14:14:51.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.278+0000 7f8e9effd700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f8e9000c530 tx=0x7f8e90007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:51.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.279+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e9000f650 con 0x7f8ea00f66e0 2022-02-02T14:14:51.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.279+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea006a7a0 con 0x7f8ea00f66e0 2022-02-02T14:14:51.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.279+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e9000fc60 con 0x7f8ea00f66e0 2022-02-02T14:14:51.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.279+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e90012d20 con 0x7f8ea00f66e0 2022-02-02T14:14:51.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.279+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea010ef90 con 0x7f8ea00f66e0 2022-02-02T14:14:51.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.280+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84004fa0 con 0x7f8ea00f66e0 2022-02-02T14:14:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.280+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8e90019030 con 0x7f8ea00f66e0 2022-02-02T14:14:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.281+0000 7f8e977fe700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 0x7f8e8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:14:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.281+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8e90081d30 con 0x7f8ea00f66e0 2022-02-02T14:14:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.281+0000 7f8e9e7fc700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 0x7f8e8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:14:51.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.281+0000 7f8e9e7fc700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 0x7f8e8c067290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8e88004e30 tx=0x7f8e88009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:14:51.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.284+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8e9004fef0 con 0x7f8ea00f66e0 2022-02-02T14:14:51.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.497+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8e84005940 con 0x7f8ea00f66e0 2022-02-02T14:14:51.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.498+0000 7f8e977fe700 1 -- 172.21.15.33:0/1451182864 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f8e90017750 con 0x7f8ea00f66e0 2022-02-02T14:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:14:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.501+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 msgr2=0x7f8e8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.501+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 0x7f8e8c067290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f8e88004e30 tx=0x7f8e88009b30).stop 2022-02-02T14:14:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.501+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 msgr2=0x7f8ea006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:14:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.501+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f8e9000c530 tx=0x7f8e90007e10).stop 2022-02-02T14:14:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 shutdown_connections 2022-02-02T14:14:51.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e8c064dd0 0x7f8e8c067290 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00f66e0 0x7f8ea006b9a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 --2- 172.21.15.33:0/1451182864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea00f7980 0x7f8ea0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:14:51.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 >> 172.21.15.33:0/1451182864 conn(0x7f8ea00f1e40 msgr2=0x7f8ea00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:14:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 shutdown_connections 2022-02-02T14:14:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:14:51.502+0000 7f8ea54cf700 1 -- 172.21.15.33:0/1451182864 wait complete. 2022-02-02T14:14:51.514 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:14:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:52 smithi033 ceph-mon[101165]: from='client.35190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:52 smithi033 ceph-mon[101165]: pgmap v1084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:52 smithi033 ceph-mon[101165]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2195984396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:14:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1451182864' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:14:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:52 smithi037 ceph-mon[69017]: from='client.35190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:52 smithi037 ceph-mon[69017]: pgmap v1084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:52 smithi037 ceph-mon[69017]: from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:14:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2195984396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:14:52.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1451182864' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:14:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:54 smithi033 ceph-mon[101165]: pgmap v1085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:54 smithi037 ceph-mon[69017]: pgmap v1085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:14:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:14:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:14:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:14:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:56 smithi033 ceph-mon[101165]: pgmap v1086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:56 smithi037 ceph-mon[69017]: pgmap v1086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:14:58 smithi033 ceph-mon[101165]: pgmap v1087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:14:58.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:14:58 smithi037 ceph-mon[69017]: pgmap v1087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:00 smithi033 ceph-mon[101165]: pgmap v1088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:00 smithi037 ceph-mon[69017]: pgmap v1088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:02 smithi033 ceph-mon[101165]: pgmap v1089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:02 smithi037 ceph-mon[69017]: pgmap v1089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:04.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:04 smithi033 ceph-mon[101165]: pgmap v1090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:04 smithi037 ceph-mon[69017]: pgmap v1090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:06 smithi033 ceph-mon[101165]: pgmap v1091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:06 smithi037 ceph-mon[69017]: pgmap v1091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:08 smithi033 ceph-mon[101165]: pgmap v1092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:08 smithi037 ceph-mon[69017]: pgmap v1092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:10 smithi033 ceph-mon[101165]: pgmap v1093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:10 smithi037 ceph-mon[69017]: pgmap v1093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:12 smithi033 ceph-mon[101165]: pgmap v1094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:12 smithi037 ceph-mon[69017]: pgmap v1094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:14 smithi033 ceph-mon[101165]: pgmap v1095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:14 smithi037 ceph-mon[69017]: pgmap v1095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:16.239 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:16 smithi033 ceph-mon[101165]: pgmap v1096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:16.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:16 smithi037 ceph-mon[69017]: pgmap v1096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:18 smithi033 ceph-mon[101165]: pgmap v1097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:18 smithi037 ceph-mon[69017]: pgmap v1097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:20 smithi033 ceph-mon[101165]: pgmap v1098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:20 smithi037 ceph-mon[69017]: pgmap v1098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- 172.21.15.33:0/2441285378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 msgr2=0x7fd4500f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 --2- 172.21.15.33:0/2441285378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd4500f6b30 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd444004660 tx=0x7fd444009b30).stop 2022-02-02T14:15:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- 172.21.15.33:0/2441285378 shutdown_connections 2022-02-02T14:15:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 --2- 172.21.15.33:0/2441285378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd4500f6b30 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 --2- 172.21.15.33:0/2441285378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 0x7fd4500f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- 172.21.15.33:0/2441285378 >> 172.21.15.33:0/2441285378 conn(0x7fd4500f0b90 msgr2=0x7fd4500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:21.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- 172.21.15.33:0/2441285378 shutdown_connections 2022-02-02T14:15:21.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- 172.21.15.33:0/2441285378 wait complete. 2022-02-02T14:15:21.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 Processor -- start 2022-02-02T14:15:21.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.617+0000 7fd454a4b700 1 -- start start 2022-02-02T14:15:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd454a4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 0x7fd450109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd454a4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd454a4b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4500603c0 con 0x7fd4500f66d0 2022-02-02T14:15:21.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd454a4b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd450060500 con 0x7fd4500f5430 2022-02-02T14:15:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60276/0 (socket says 172.21.15.33:60276) 2022-02-02T14:15:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 -- 172.21.15.33:0/75675128 learned_addr learned my addr 172.21.15.33:0/75675128 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44f7fe700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 0x7fd450109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 -- 172.21.15.33:0/75675128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 msgr2=0x7fd450109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 0x7fd450109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 -- 172.21.15.33:0/75675128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd444005040 con 0x7fd4500f66d0 2022-02-02T14:15:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.618+0000 7fd44effd700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd444009990 tx=0x7fd444009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:21.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.619+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd444018070 con 0x7fd4500f66d0 2022-02-02T14:15:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.619+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd444007ba0 con 0x7fd4500f66d0 2022-02-02T14:15:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.619+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45010c490 con 0x7fd4500f66d0 2022-02-02T14:15:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.619+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44401c620 con 0x7fd4500f66d0 2022-02-02T14:15:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.619+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45010c9c0 con 0x7fd4500f66d0 2022-02-02T14:15:21.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.620+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd450059100 con 0x7fd4500f66d0 2022-02-02T14:15:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.620+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd44401c890 con 0x7fd4500f66d0 2022-02-02T14:15:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.621+0000 7fd437fff700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 0x7fd4380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.621+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd4440837e0 con 0x7fd4500f66d0 2022-02-02T14:15:21.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.621+0000 7fd44f7fe700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 0x7fd4380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.621+0000 7fd44f7fe700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 0x7fd4380672e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fd450060040 tx=0x7fd440009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:21.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.625+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd444051940 con 0x7fd4500f66d0 2022-02-02T14:15:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.814+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4500fdd80 con 0x7fd438064e20 2022-02-02T14:15:21.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.815+0000 7fd437fff700 1 -- 172.21.15.33:0/75675128 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd4500fdd80 con 0x7fd438064e20 2022-02-02T14:15:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 msgr2=0x7fd4380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 0x7fd4380672e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fd450060040 tx=0x7fd440009040).stop 2022-02-02T14:15:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 msgr2=0x7fd45010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd444009990 tx=0x7fd444009b30).stop 2022-02-02T14:15:21.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 shutdown_connections 2022-02-02T14:15:21.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd438064e20 0x7fd4380672e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4500f5430 0x7fd450109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 --2- 172.21.15.33:0/75675128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4500f66d0 0x7fd45010bf40 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 >> 172.21.15.33:0/75675128 conn(0x7fd4500f0b90 msgr2=0x7fd4500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:21.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 shutdown_connections 2022-02-02T14:15:21.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.817+0000 7fd454a4b700 1 -- 172.21.15.33:0/75675128 wait complete. 2022-02-02T14:15:21.827 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:15:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 -- 172.21.15.33:0/2043616414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 msgr2=0x7f9f500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 --2- 172.21.15.33:0/2043616414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f500f5850 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f9f40004660 tx=0x7f9f40009b30).stop 2022-02-02T14:15:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 -- 172.21.15.33:0/2043616414 shutdown_connections 2022-02-02T14:15:21.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 --2- 172.21.15.33:0/2043616414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 0x7f9f500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 --2- 172.21.15.33:0/2043616414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f500f5850 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.918+0000 7f9f568ed700 1 -- 172.21.15.33:0/2043616414 >> 172.21.15.33:0/2043616414 conn(0x7f9f500f0b90 msgr2=0x7f9f500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:21.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.919+0000 7f9f568ed700 1 -- 172.21.15.33:0/2043616414 shutdown_connections 2022-02-02T14:15:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.919+0000 7f9f568ed700 1 -- 172.21.15.33:0/2043616414 wait complete. 2022-02-02T14:15:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.919+0000 7f9f568ed700 1 Processor -- start 2022-02-02T14:15:21.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.919+0000 7f9f568ed700 1 -- start start 2022-02-02T14:15:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f568ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f568ed700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 0x7f9f50105060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f568ed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50105610 con 0x7f9f500f5430 2022-02-02T14:15:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f568ed700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50105750 con 0x7f9f500f66d0 2022-02-02T14:15:21.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60284/0 (socket says 172.21.15.33:60284) 2022-02-02T14:15:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 -- 172.21.15.33:0/3027729635 learned_addr learned my addr 172.21.15.33:0/3027729635 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f550ea700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 0x7f9f50105060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 -- 172.21.15.33:0/3027729635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 msgr2=0x7f9f50105060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 0x7f9f50105060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 -- 172.21.15.33:0/3027729635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40005040 con 0x7f9f500f5430 2022-02-02T14:15:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f558eb700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9f40013a70 tx=0x7f9f40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:21.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.920+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f40018070 con 0x7f9f500f5430 2022-02-02T14:15:21.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.921+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f50106090 con 0x7f9f500f5430 2022-02-02T14:15:21.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.921+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9f400097d0 con 0x7f9f500f5430 2022-02-02T14:15:21.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.921+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f4001de80 con 0x7f9f500f5430 2022-02-02T14:15:21.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.921+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f501065f0 con 0x7f9f500f5430 2022-02-02T14:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.922+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50045ad0 con 0x7f9f500f5430 2022-02-02T14:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.922+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9f40007ba0 con 0x7f9f500f5430 2022-02-02T14:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.922+0000 7f9f467fc700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 0x7f9f3c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.923+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9f400836b0 con 0x7f9f500f5430 2022-02-02T14:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.923+0000 7f9f550ea700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 0x7f9f3c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.923+0000 7f9f550ea700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 0x7f9f3c0694f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9f4c004c40 tx=0x7f9f4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:21.927+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9f40055250 con 0x7f9f500f5430 2022-02-02T14:15:22.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.107+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f500fcc60 con 0x7f9f3c067030 2022-02-02T14:15:22.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.122+0000 7f9f467fc700 1 -- 172.21.15.33:0/3027729635 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9f500fcc60 con 0x7f9f3c067030 2022-02-02T14:15:22.121 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:15:22.122 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (40m) 2m ago 41m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:15:22.122 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (33m) 2m ago 41m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:15:22.122 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (33m) 2m ago 41m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:15:22.122 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (40m) 2m ago 41m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:15:22.123 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (34m) 2m ago 37m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:15:22.123 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (34m) 2m ago 37m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:15:22.123 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (35m) 2m ago 37m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:15:22.123 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (37m) 2m ago 37m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:15:22.124 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (35m) 2m ago 42m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:15:22.124 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (34m) 2m ago 41m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:15:22.124 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (34m) 2m ago 43m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:15:22.125 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (34m) 2m ago 41m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:15:22.125 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (41m) 2m ago 41m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:15:22.125 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (40m) 2m ago 40m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:15:22.125 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 2m ago 40m - 4096M 2022-02-02T14:15:22.125 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (40m) 2m ago 40m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:15:22.126 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (39m) 2m ago 39m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:15:22.126 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (39m) 2m ago 39m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:15:22.126 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (39m) 2m ago 39m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:15:22.126 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (38m) 2m ago 38m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:15:22.127 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (40m) 2m ago 41m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:15:22.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 msgr2=0x7f9f3c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 0x7f9f3c0694f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f9f4c004c40 tx=0x7f9f4c00b040).stop 2022-02-02T14:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 msgr2=0x7f9f50104b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9f40013a70 tx=0x7f9f40009b30).stop 2022-02-02T14:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 shutdown_connections 2022-02-02T14:15:22.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9f3c067030 0x7f9f3c0694f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f500f5430 0x7f9f50104b70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 --2- 172.21.15.33:0/3027729635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f500f66d0 0x7f9f50105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.123+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 >> 172.21.15.33:0/3027729635 conn(0x7f9f500f0b90 msgr2=0x7f9f500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:22.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.124+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 shutdown_connections 2022-02-02T14:15:22.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.124+0000 7f9f568ed700 1 -- 172.21.15.33:0/3027729635 wait complete. 2022-02-02T14:15:22.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 -- 172.21.15.33:0/2325935155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 msgr2=0x7f3ed00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 --2- 172.21.15.33:0/2325935155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed00f6cc0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f3ec4004660 tx=0x7f3ec4009b30).stop 2022-02-02T14:15:22.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 -- 172.21.15.33:0/2325935155 shutdown_connections 2022-02-02T14:15:22.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 --2- 172.21.15.33:0/2325935155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed00f6cc0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 --2- 172.21.15.33:0/2325935155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 0x7f3ed00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 -- 172.21.15.33:0/2325935155 >> 172.21.15.33:0/2325935155 conn(0x7f3ed00f0d40 msgr2=0x7f3ed00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:22.225 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:22 smithi033 ceph-mon[101165]: pgmap v1099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 -- 172.21.15.33:0/2325935155 shutdown_connections 2022-02-02T14:15:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.223+0000 7f3ed7360700 1 -- 172.21.15.33:0/2325935155 wait complete. 2022-02-02T14:15:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 Processor -- start 2022-02-02T14:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 -- start start 2022-02-02T14:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 0x7f3ed010c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed00602d0 con 0x7f3ed00f6860 2022-02-02T14:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.224+0000 7f3ed7360700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed0060410 con 0x7f3ed00f55c0 2022-02-02T14:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60296/0 (socket says 172.21.15.33:60296) 2022-02-02T14:15:22.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 -- 172.21.15.33:0/4100173982 learned_addr learned my addr 172.21.15.33:0/4100173982 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:22.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed50fc700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 0x7f3ed010c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 -- 172.21.15.33:0/4100173982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 msgr2=0x7f3ed010c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 0x7f3ed010c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 -- 172.21.15.33:0/4100173982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4005040 con 0x7f3ed00f6860 2022-02-02T14:15:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed48fb700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f3ec4009830 tx=0x7f3ec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec4018070 con 0x7f3ed00f6860 2022-02-02T14:15:22.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed010ea40 con 0x7f3ed00f6860 2022-02-02T14:15:22.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ec4007ba0 con 0x7f3ed00f6860 2022-02-02T14:15:22.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec401c3c0 con 0x7f3ed00f6860 2022-02-02T14:15:22.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.225+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed010ee10 con 0x7f3ed00f6860 2022-02-02T14:15:22.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.226+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb0004fa0 con 0x7f3ed00f6860 2022-02-02T14:15:22.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.227+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ec4007d10 con 0x7f3ed00f6860 2022-02-02T14:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.227+0000 7f3ec1ffb700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 0x7f3ebc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.227+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3ec4083620 con 0x7f3ed00f6860 2022-02-02T14:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.228+0000 7f3ed50fc700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 0x7f3ebc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.228+0000 7f3ed50fc700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 0x7f3ebc067270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f3ed0060060 tx=0x7f3ecc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:22.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.232+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ec4051790 con 0x7f3ed00f6860 2022-02-02T14:15:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.477+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3eb0005e80 con 0x7f3ed00f6860 2022-02-02T14:15:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.478+0000 7f3ec1ffb700 1 -- 172.21.15.33:0/4100173982 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3ec4054db0 con 0x7f3ed00f6860 2022-02-02T14:15:22.479 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:15:22.479 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:15:22.480 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:15:22.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:22.480 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:15:22.480 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:15:22.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:22.481 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:15:22.481 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:15:22.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:22.481 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:15:22.482 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:15:22.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:22.482 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:15:22.483 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:15:22.483 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:15:22.483 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:15:22.483 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:15:22.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 msgr2=0x7f3ebc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 0x7f3ebc067270 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f3ed0060060 tx=0x7f3ecc00b040).stop 2022-02-02T14:15:22.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 msgr2=0x7f3ed010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f3ec4009830 tx=0x7f3ec4009b30).stop 2022-02-02T14:15:22.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 shutdown_connections 2022-02-02T14:15:22.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ebc064db0 0x7f3ebc067270 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed00f55c0 0x7f3ed010c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 --2- 172.21.15.33:0/4100173982 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ed00f6860 0x7f3ed010e550 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 >> 172.21.15.33:0/4100173982 conn(0x7f3ed00f0d40 msgr2=0x7f3ed00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 shutdown_connections 2022-02-02T14:15:22.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.480+0000 7f3ed7360700 1 -- 172.21.15.33:0/4100173982 wait complete. 2022-02-02T14:15:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:22 smithi037 ceph-mon[69017]: pgmap v1099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:22.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 -- 172.21.15.33:0/1692069584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f55c0 msgr2=0x7f539c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 --2- 172.21.15.33:0/1692069584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f55c0 0x7f539c0f59e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f5398004660 tx=0x7f5398009b30).stop 2022-02-02T14:15:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 -- 172.21.15.33:0/1692069584 shutdown_connections 2022-02-02T14:15:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 --2- 172.21.15.33:0/1692069584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f6860 0x7f539c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 --2- 172.21.15.33:0/1692069584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f55c0 0x7f539c0f59e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 -- 172.21.15.33:0/1692069584 >> 172.21.15.33:0/1692069584 conn(0x7f539c0f0d40 msgr2=0x7f539c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 -- 172.21.15.33:0/1692069584 shutdown_connections 2022-02-02T14:15:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.581+0000 7f53a3f66700 1 -- 172.21.15.33:0/1692069584 wait complete. 2022-02-02T14:15:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 Processor -- start 2022-02-02T14:15:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 -- start start 2022-02-02T14:15:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f55c0 0x7f539c109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0603e0 con 0x7f539c0f6860 2022-02-02T14:15:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a3f66700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c060520 con 0x7f539c0f55c0 2022-02-02T14:15:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a1501700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a1501700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60306/0 (socket says 172.21.15.33:60306) 2022-02-02T14:15:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a1501700 1 -- 172.21.15.33:0/2994210561 learned_addr learned my addr 172.21.15.33:0/2994210561 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:22.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.582+0000 7f53a1d02700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f55c0 0x7f539c109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a1501700 1 -- 172.21.15.33:0/2994210561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f55c0 msgr2=0x7f539c109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a1501700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f55c0 0x7f539c109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a1501700 1 -- 172.21.15.33:0/2994210561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398005040 con 0x7f539c0f6860 2022-02-02T14:15:22.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a1501700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f5390002700 tx=0x7f5390009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5390009320 con 0x7f539c0f6860 2022-02-02T14:15:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c10c6a0 con 0x7f539c0f6860 2022-02-02T14:15:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f539000f040 con 0x7f539c0f6860 2022-02-02T14:15:22.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5390014820 con 0x7f539c0f6860 2022-02-02T14:15:22.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.583+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c10cc60 con 0x7f539c0f6860 2022-02-02T14:15:22.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.584+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c045ad0 con 0x7f539c0f6860 2022-02-02T14:15:22.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.585+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5390009480 con 0x7f539c0f6860 2022-02-02T14:15:22.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.585+0000 7f538e7fc700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 0x7f5388067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:22.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.585+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5390081e20 con 0x7f539c0f6860 2022-02-02T14:15:22.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.585+0000 7f53a1d02700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 0x7f5388067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:22.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.585+0000 7f53a1d02700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 0x7f5388067290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5398004e30 tx=0x7f5398009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:22.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.589+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f539004fed0 con 0x7f539c0f6860 2022-02-02T14:15:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.801+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f539c027a00 con 0x7f539c0f6860 2022-02-02T14:15:22.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.802+0000 7f538e7fc700 1 -- 172.21.15.33:0/2994210561 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f53900534f0 con 0x7f539c0f6860 2022-02-02T14:15:22.802 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:15:22.802 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:15:22.802 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:15:22.803 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:15:22.803 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:22.803 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:15:22.803 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:15:22.804 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:15:22.804 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:15:22.804 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:15:22.804 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:15:22.804 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:15:22.805 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:15:22.805 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:15:22.805 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:15:22.805 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:15:22.806 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:15:22.806 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:15:22.806 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:15:22.806 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:15:22.807 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:15:22.807 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:15:22.807 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:15:22.807 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:15:22.808 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:15:22.808 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:15:22.808 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:15:22.808 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:15:22.808 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:15:22.809 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:15:22.809 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:15:22.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:22.809 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:22.809 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:15:22.810 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:22.810 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:22.810 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:22.810 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:22.811 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:22.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 msgr2=0x7f5388067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 0x7f5388067290 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f5398004e30 tx=0x7f5398009b30).stop 2022-02-02T14:15:22.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 msgr2=0x7f539c10c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:22.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f5390002700 tx=0x7f5390009e00).stop 2022-02-02T14:15:22.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 shutdown_connections 2022-02-02T14:15:22.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5388064dd0 0x7f5388067290 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539c0f55c0 0x7f539c109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 --2- 172.21.15.33:0/2994210561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f539c0f6860 0x7f539c10c0f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 >> 172.21.15.33:0/2994210561 conn(0x7f539c0f0d40 msgr2=0x7f539c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 shutdown_connections 2022-02-02T14:15:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:22.805+0000 7f53a3f66700 1 -- 172.21.15.33:0/2994210561 wait complete. 2022-02-02T14:15:22.814 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:15:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:23 smithi033 ceph-mon[101165]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:23.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:23 smithi033 ceph-mon[101165]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4100173982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:15:23.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2994210561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:15:23.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:23 smithi037 ceph-mon[69017]: from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:23 smithi037 ceph-mon[69017]: from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4100173982' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:15:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2994210561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:15:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:24 smithi033 ceph-mon[101165]: pgmap v1100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:24 smithi037 ceph-mon[69017]: pgmap v1100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:26 smithi033 ceph-mon[101165]: pgmap v1101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:26 smithi037 ceph-mon[69017]: pgmap v1101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:28 smithi033 ceph-mon[101165]: pgmap v1102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:28 smithi037 ceph-mon[69017]: pgmap v1102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:30 smithi033 ceph-mon[101165]: pgmap v1103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:30 smithi037 ceph-mon[69017]: pgmap v1103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:32 smithi033 ceph-mon[101165]: pgmap v1104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:32 smithi037 ceph-mon[69017]: pgmap v1104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:34 smithi033 ceph-mon[101165]: pgmap v1105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:34 smithi037 ceph-mon[69017]: pgmap v1105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:36.242 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:36 smithi033 ceph-mon[101165]: pgmap v1106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:36 smithi037 ceph-mon[69017]: pgmap v1106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:38 smithi033 ceph-mon[101165]: pgmap v1107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:38.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:38 smithi037 ceph-mon[69017]: pgmap v1107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:40 smithi033 ceph-mon[101165]: pgmap v1108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:40 smithi037 ceph-mon[69017]: pgmap v1108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:42 smithi033 ceph-mon[101165]: pgmap v1109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:42 smithi037 ceph-mon[69017]: pgmap v1109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:44 smithi033 ceph-mon[101165]: pgmap v1110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:44 smithi037 ceph-mon[69017]: pgmap v1110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:46 smithi033 ceph-mon[101165]: pgmap v1111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:46 smithi037 ceph-mon[69017]: pgmap v1111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:48 smithi033 ceph-mon[101165]: pgmap v1112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:48 smithi037 ceph-mon[69017]: pgmap v1112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:50 smithi033 ceph-mon[101165]: pgmap v1113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:50.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:50 smithi037 ceph-mon[69017]: pgmap v1113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:52.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:52 smithi033 ceph-mon[101165]: pgmap v1114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:52 smithi037 ceph-mon[69017]: pgmap v1114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:52.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/293889762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f7980 msgr2=0x7f5d040f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:52.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/293889762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f7980 0x7f5d040f7de0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f5cf8004660 tx=0x7f5cf8009b30).stop 2022-02-02T14:15:52.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/293889762 shutdown_connections 2022-02-02T14:15:52.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/293889762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f7980 0x7f5d040f7de0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:52.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/293889762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f66e0 0x7f5d040f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:52.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/293889762 >> 172.21.15.33:0/293889762 conn(0x7f5d040f1e40 msgr2=0x7f5d040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:52.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/293889762 shutdown_connections 2022-02-02T14:15:52.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/293889762 wait complete. 2022-02-02T14:15:52.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.920+0000 7f5d0a5f6700 1 Processor -- start 2022-02-02T14:15:52.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d0a5f6700 1 -- start start 2022-02-02T14:15:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d0a5f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d0a5f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 0x7f5d04107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d0a5f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d041079b0 con 0x7f5d040f66e0 2022-02-02T14:15:52.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d0a5f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d04107af0 con 0x7f5d040f7980 2022-02-02T14:15:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60314/0 (socket says 172.21.15.33:60314) 2022-02-02T14:15:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 -- 172.21.15.33:0/1133452663 learned_addr learned my addr 172.21.15.33:0/1133452663 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:52.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d037fe700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 0x7f5d04107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 -- 172.21.15.33:0/1133452663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 msgr2=0x7f5d04107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 0x7f5d04107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d03fff700 1 -- 172.21.15.33:0/1133452663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf8005040 con 0x7f5d040f66e0 2022-02-02T14:15:52.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.921+0000 7f5d037fe700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 0x7f5d04107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:15:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d03fff700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f5cf400e7c0 tx=0x7f5cf400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf40092e0 con 0x7f5d040f66e0 2022-02-02T14:15:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cf400f040 con 0x7f5d040f66e0 2022-02-02T14:15:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d04108490 con 0x7f5d040f66e0 2022-02-02T14:15:52.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cf4014750 con 0x7f5d040f66e0 2022-02-02T14:15:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.922+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d04108a50 con 0x7f5d040f66e0 2022-02-02T14:15:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.923+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d04045ad0 con 0x7f5d040f66e0 2022-02-02T14:15:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.923+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cf401b030 con 0x7f5d040f66e0 2022-02-02T14:15:52.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.924+0000 7f5d00ff9700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 0x7f5cec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.924+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5cf4081b60 con 0x7f5d040f66e0 2022-02-02T14:15:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.924+0000 7f5d037fe700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 0x7f5cec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:52.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.924+0000 7f5d037fe700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 0x7f5cec067290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5cf8004d80 tx=0x7f5cf800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:52.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:52.928+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cf4053640 con 0x7f5d040f66e0 2022-02-02T14:15:53.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.118+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d04108c70 con 0x7f5cec064dd0 2022-02-02T14:15:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.119+0000 7f5d00ff9700 1 -- 172.21.15.33:0/1133452663 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5d04108c70 con 0x7f5cec064dd0 2022-02-02T14:15:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 msgr2=0x7f5cec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 0x7f5cec067290 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f5cf8004d80 tx=0x7f5cf800b040).stop 2022-02-02T14:15:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 msgr2=0x7f5d04106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f5cf400e7c0 tx=0x7f5cf400b040).stop 2022-02-02T14:15:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 shutdown_connections 2022-02-02T14:15:53.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cec064dd0 0x7f5cec067290 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d040f66e0 0x7f5d04106f10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 --2- 172.21.15.33:0/1133452663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d040f7980 0x7f5d04107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 >> 172.21.15.33:0/1133452663 conn(0x7f5d040f1e40 msgr2=0x7f5d040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 shutdown_connections 2022-02-02T14:15:53.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.121+0000 7f5d0a5f6700 1 -- 172.21.15.33:0/1133452663 wait complete. 2022-02-02T14:15:53.131 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:15:53.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 -- 172.21.15.33:0/2554224964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f5430 msgr2=0x7f90a00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/2554224964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f5430 0x7f90a00f5850 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f909c004660 tx=0x7f909c009b30).stop 2022-02-02T14:15:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 -- 172.21.15.33:0/2554224964 shutdown_connections 2022-02-02T14:15:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/2554224964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f66d0 0x7f90a00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/2554224964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f5430 0x7f90a00f5850 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 -- 172.21.15.33:0/2554224964 >> 172.21.15.33:0/2554224964 conn(0x7f90a00f0b90 msgr2=0x7f90a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 -- 172.21.15.33:0/2554224964 shutdown_connections 2022-02-02T14:15:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.223+0000 7f90a6c7e700 1 -- 172.21.15.33:0/2554224964 wait complete. 2022-02-02T14:15:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 Processor -- start 2022-02-02T14:15:53.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 -- start start 2022-02-02T14:15:53.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f5430 0x7f90a0109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a00603e0 con 0x7f90a00f66d0 2022-02-02T14:15:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a6c7e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a0060520 con 0x7f90a00f5430 2022-02-02T14:15:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a547b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a547b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60326/0 (socket says 172.21.15.33:60326) 2022-02-02T14:15:53.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.224+0000 7f90a547b700 1 -- 172.21.15.33:0/3442145624 learned_addr learned my addr 172.21.15.33:0/3442145624 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:53.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a5c7c700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f5430 0x7f90a0109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a547b700 1 -- 172.21.15.33:0/3442145624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f5430 msgr2=0x7f90a0109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a547b700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f5430 0x7f90a0109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a547b700 1 -- 172.21.15.33:0/3442145624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c005040 con 0x7f90a00f66d0 2022-02-02T14:15:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a547b700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90940026d0 tx=0x7f9094009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9094009320 con 0x7f90a00f66d0 2022-02-02T14:15:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f909400f040 con 0x7f90a00f66d0 2022-02-02T14:15:53.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a010c540 con 0x7f90a00f66d0 2022-02-02T14:15:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90940147e0 con 0x7f90a00f66d0 2022-02-02T14:15:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.225+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a010cb00 con 0x7f90a00f66d0 2022-02-02T14:15:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.226+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a0045ad0 con 0x7f90a00f66d0 2022-02-02T14:15:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.227+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9094009480 con 0x7f90a00f66d0 2022-02-02T14:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.227+0000 7f90927fc700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 0x7f908c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.227+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9094082230 con 0x7f90a00f66d0 2022-02-02T14:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.228+0000 7f90a5c7c700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 0x7f908c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.228+0000 7f90a5c7c700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 0x7f908c0672e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f90a0060060 tx=0x7f909c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.232+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9094050220 con 0x7f90a00f66d0 2022-02-02T14:15:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.417+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f90a00fdd30 con 0x7f908c064e20 2022-02-02T14:15:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.432+0000 7f90927fc700 1 -- 172.21.15.33:0/3442145624 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f90a00fdd30 con 0x7f908c064e20 2022-02-02T14:15:53.432 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:15:53.432 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (41m) 3m ago 42m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:15:53.432 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (34m) 3m ago 42m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:15:53.433 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (34m) 3m ago 41m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:15:53.433 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (41m) 3m ago 41m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:15:53.433 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (34m) 3m ago 38m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:15:53.433 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (35m) 3m ago 38m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:15:53.434 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (36m) 3m ago 38m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:15:53.434 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (38m) 3m ago 38m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:15:53.434 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (35m) 3m ago 43m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:15:53.435 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (35m) 3m ago 41m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:15:53.435 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (35m) 3m ago 43m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:15:53.435 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (34m) 3m ago 41m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:15:53.435 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (41m) 3m ago 41m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:15:53.435 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (41m) 3m ago 41m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:15:53.436 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 40m - 4096M 2022-02-02T14:15:53.436 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (40m) 3m ago 40m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:15:53.436 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (40m) 3m ago 40m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:15:53.436 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (40m) 3m ago 40m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:15:53.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (39m) 3m ago 39m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:15:53.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (39m) 3m ago 39m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:15:53.439 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (40m) 3m ago 41m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:15:53.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 msgr2=0x7f908c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 0x7f908c0672e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f90a0060060 tx=0x7f909c009b30).stop 2022-02-02T14:15:53.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 msgr2=0x7f90a010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90940026d0 tx=0x7f9094009de0).stop 2022-02-02T14:15:53.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 shutdown_connections 2022-02-02T14:15:53.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f908c064e20 0x7f908c0672e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90a00f5430 0x7f90a0109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 --2- 172.21.15.33:0/3442145624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a00f66d0 0x7f90a010bf90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 >> 172.21.15.33:0/3442145624 conn(0x7f90a00f0b90 msgr2=0x7f90a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 shutdown_connections 2022-02-02T14:15:53.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.434+0000 7f90a6c7e700 1 -- 172.21.15.33:0/3442145624 wait complete. 2022-02-02T14:15:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 -- 172.21.15.33:0/1050695331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f6880 msgr2=0x7f89e00f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 --2- 172.21.15.33:0/1050695331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f6880 0x7f89e00f6ce0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f89d4004660 tx=0x7f89d4009b30).stop 2022-02-02T14:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 -- 172.21.15.33:0/1050695331 shutdown_connections 2022-02-02T14:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 --2- 172.21.15.33:0/1050695331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f6880 0x7f89e00f6ce0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 --2- 172.21.15.33:0/1050695331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f55e0 0x7f89e00f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 -- 172.21.15.33:0/1050695331 >> 172.21.15.33:0/1050695331 conn(0x7f89e00f0d40 msgr2=0x7f89e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 -- 172.21.15.33:0/1050695331 shutdown_connections 2022-02-02T14:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.533+0000 7f89e5350700 1 -- 172.21.15.33:0/1050695331 wait complete. 2022-02-02T14:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 Processor -- start 2022-02-02T14:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 -- start start 2022-02-02T14:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f6880 0x7f89e01063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01069b0 con 0x7f89e00f55e0 2022-02-02T14:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.534+0000 7f89e5350700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e01071c0 con 0x7f89e00f6880 2022-02-02T14:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60332/0 (socket says 172.21.15.33:60332) 2022-02-02T14:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 -- 172.21.15.33:0/614616045 learned_addr learned my addr 172.21.15.33:0/614616045 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89de7fc700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f6880 0x7f89e01063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 -- 172.21.15.33:0/614616045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f6880 msgr2=0x7f89e01063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f6880 0x7f89e01063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 -- 172.21.15.33:0/614616045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4005040 con 0x7f89e00f55e0 2022-02-02T14:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89deffd700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f89d000e9a0 tx=0x7f89d0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d000c9b0 con 0x7f89e00f55e0 2022-02-02T14:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e01073e0 con 0x7f89e00f55e0 2022-02-02T14:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89d0011470 con 0x7f89e00f55e0 2022-02-02T14:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89d0010610 con 0x7f89e00f55e0 2022-02-02T14:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.535+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e0107970 con 0x7f89e00f55e0 2022-02-02T14:15:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.536+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e00f49d0 con 0x7f89e00f55e0 2022-02-02T14:15:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.537+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f89d00115e0 con 0x7f89e00f55e0 2022-02-02T14:15:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.537+0000 7f89c77fe700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 0x7f89c8067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.537+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f89d0084a80 con 0x7f89e00f55e0 2022-02-02T14:15:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.537+0000 7f89de7fc700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 0x7f89c8067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.538+0000 7f89de7fc700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 0x7f89c8067230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f89d4004e30 tx=0x7f89d4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.541+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f89d0052b30 con 0x7f89e00f55e0 2022-02-02T14:15:53.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.785+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89e00ff7b0 con 0x7f89e00f55e0 2022-02-02T14:15:53.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.785+0000 7f89c77fe700 1 -- 172.21.15.33:0/614616045 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f89d0056150 con 0x7f89e00f55e0 2022-02-02T14:15:53.785 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:15:53.786 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:15:53.786 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:15:53.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:53.786 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:15:53.787 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:15:53.787 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:53.787 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:15:53.787 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:15:53.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:53.788 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:15:53.788 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:15:53.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:15:53.789 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:15:53.789 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:15:53.789 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:15:53.789 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:15:53.789 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:15:53.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 msgr2=0x7f89c8067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 0x7f89c8067230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f89d4004e30 tx=0x7f89d4009b30).stop 2022-02-02T14:15:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 msgr2=0x7f89e0105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f89d000e9a0 tx=0x7f89d0007e20).stop 2022-02-02T14:15:53.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 shutdown_connections 2022-02-02T14:15:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89c8064d70 0x7f89c8067230 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89e00f55e0 0x7f89e0105ec0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 --2- 172.21.15.33:0/614616045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89e00f6880 0x7f89e01063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 >> 172.21.15.33:0/614616045 conn(0x7f89e00f0d40 msgr2=0x7f89e00fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 shutdown_connections 2022-02-02T14:15:53.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.787+0000 7f89e5350700 1 -- 172.21.15.33:0/614616045 wait complete. 2022-02-02T14:15:53.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 -- 172.21.15.33:0/3685474252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f55c0 msgr2=0x7f62340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 --2- 172.21.15.33:0/3685474252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f55c0 0x7f62340f59e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f6230004660 tx=0x7f6230009b30).stop 2022-02-02T14:15:53.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 -- 172.21.15.33:0/3685474252 shutdown_connections 2022-02-02T14:15:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 --2- 172.21.15.33:0/3685474252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f6860 0x7f62340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 --2- 172.21.15.33:0/3685474252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f55c0 0x7f62340f59e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 -- 172.21.15.33:0/3685474252 >> 172.21.15.33:0/3685474252 conn(0x7f62340f0d40 msgr2=0x7f62340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 -- 172.21.15.33:0/3685474252 shutdown_connections 2022-02-02T14:15:53.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.888+0000 7f623c3ba700 1 -- 172.21.15.33:0/3685474252 wait complete. 2022-02-02T14:15:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 Processor -- start 2022-02-02T14:15:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 -- start start 2022-02-02T14:15:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f55c0 0x7f62340f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62340f8920 con 0x7f62340f6860 2022-02-02T14:15:53.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623c3ba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62340f8a60 con 0x7f62340f55c0 2022-02-02T14:15:53.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f6239955700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f6239955700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60344/0 (socket says 172.21.15.33:60344) 2022-02-02T14:15:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f6239955700 1 -- 172.21.15.33:0/622510950 learned_addr learned my addr 172.21.15.33:0/622510950 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:15:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.889+0000 7f623a156700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f55c0 0x7f62340f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f6239955700 1 -- 172.21.15.33:0/622510950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f55c0 msgr2=0x7f62340f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f6239955700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f55c0 0x7f62340f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:53.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f6239955700 1 -- 172.21.15.33:0/622510950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6230005040 con 0x7f62340f6860 2022-02-02T14:15:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f6239955700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f62240026d0 tx=0x7f6224009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62240079c0 con 0x7f62340f6860 2022-02-02T14:15:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f622400f040 con 0x7f62340f6860 2022-02-02T14:15:53.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62240148b0 con 0x7f62340f6860 2022-02-02T14:15:53.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62340f8d40 con 0x7f62340f6860 2022-02-02T14:15:53.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.890+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623410efa0 con 0x7f62340f6860 2022-02-02T14:15:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.891+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6234045ad0 con 0x7f62340f6860 2022-02-02T14:15:53.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.891+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6224007b20 con 0x7f62340f6860 2022-02-02T14:15:53.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.892+0000 7f622affd700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 0x7f6220067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:15:53.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.892+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6224081910 con 0x7f62340f6860 2022-02-02T14:15:53.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.892+0000 7f623a156700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 0x7f6220067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:15:53.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.892+0000 7f623a156700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 0x7f6220067290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f6230013690 tx=0x7f6230009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:15:53.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:53.896+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f622404f9c0 con 0x7f62340f6860 2022-02-02T14:15:54.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.108+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f62340fdd80 con 0x7f62340f6860 2022-02-02T14:15:54.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.109+0000 7f622affd700 1 -- 172.21.15.33:0/622510950 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6224052fe0 con 0x7f62340f6860 2022-02-02T14:15:54.109 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:15:54.109 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:15:54.109 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:15:54.110 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:15:54.110 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:54.110 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:15:54.110 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:15:54.111 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:15:54.111 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:15:54.111 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:15:54.111 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:15:54.112 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:15:54.112 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:15:54.112 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:15:54.112 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:15:54.112 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:15:54.113 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:15:54.113 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:15:54.113 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:15:54.113 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:15:54.114 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:15:54.114 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:15:54.114 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:15:54.114 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:15:54.115 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:15:54.115 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:15:54.115 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:15:54.115 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:15:54.115 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:15:54.116 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:15:54.116 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:15:54.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:54.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:54.117 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:15:54.117 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:15:54.117 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:54.117 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:54.117 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:54.118 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:15:54.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.110+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 msgr2=0x7f6220067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:54.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.110+0000 7f623c3ba700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 0x7f6220067290 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f6230013690 tx=0x7f6230009b30).stop 2022-02-02T14:15:54.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.110+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 msgr2=0x7f62340f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:15:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.110+0000 7f623c3ba700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f62240026d0 tx=0x7f6224009de0).stop 2022-02-02T14:15:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.110+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 shutdown_connections 2022-02-02T14:15:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6220064dd0 0x7f6220067290 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62340f55c0 0x7f62340f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:54.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 --2- 172.21.15.33:0/622510950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62340f6860 0x7f62340f83c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:15:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 >> 172.21.15.33:0/622510950 conn(0x7f62340f0d40 msgr2=0x7f623405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:15:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 shutdown_connections 2022-02-02T14:15:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:15:54.111+0000 7f623c3ba700 1 -- 172.21.15.33:0/622510950 wait complete. 2022-02-02T14:15:54.121 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:15:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:54 smithi033 ceph-mon[101165]: pgmap v1115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:54 smithi033 ceph-mon[101165]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/614616045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:15:54.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/622510950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:15:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:54 smithi037 ceph-mon[69017]: pgmap v1115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:54.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:54 smithi037 ceph-mon[69017]: from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:54.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/614616045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:15:54.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/622510950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:15:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:55 smithi033 ceph-mon[101165]: from='client.35226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:15:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:15:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:55 smithi037 ceph-mon[69017]: from='client.35226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:15:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:15:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:15:56.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:56 smithi033 ceph-mon[101165]: pgmap v1116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:56 smithi037 ceph-mon[69017]: pgmap v1116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:15:58 smithi033 ceph-mon[101165]: pgmap v1117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:15:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:15:58 smithi037 ceph-mon[69017]: pgmap v1117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:00 smithi033 ceph-mon[101165]: pgmap v1118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:00 smithi037 ceph-mon[69017]: pgmap v1118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:02 smithi033 ceph-mon[101165]: pgmap v1119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:02 smithi037 ceph-mon[69017]: pgmap v1119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:04 smithi033 ceph-mon[101165]: pgmap v1120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:04 smithi037 ceph-mon[69017]: pgmap v1120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:06 smithi033 ceph-mon[101165]: pgmap v1121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:06 smithi037 ceph-mon[69017]: pgmap v1121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:08 smithi033 ceph-mon[101165]: pgmap v1122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:08 smithi037 ceph-mon[69017]: pgmap v1122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:10 smithi033 ceph-mon[101165]: pgmap v1123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:10 smithi037 ceph-mon[69017]: pgmap v1123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:12 smithi033 ceph-mon[101165]: pgmap v1124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:12 smithi037 ceph-mon[69017]: pgmap v1124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:14 smithi033 ceph-mon[101165]: pgmap v1125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:14 smithi037 ceph-mon[69017]: pgmap v1125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:16.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:16 smithi033 ceph-mon[101165]: pgmap v1126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:16 smithi037 ceph-mon[69017]: pgmap v1126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:18 smithi033 ceph-mon[101165]: pgmap v1127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:18.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:18 smithi037 ceph-mon[69017]: pgmap v1127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:20 smithi033 ceph-mon[101165]: pgmap v1128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:20 smithi037 ceph-mon[69017]: pgmap v1128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:22.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:22 smithi033 ceph-mon[101165]: pgmap v1129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:22 smithi037 ceph-mon[69017]: pgmap v1129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 -- 172.21.15.33:0/143473635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f55c0 msgr2=0x7f192c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 --2- 172.21.15.33:0/143473635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f55c0 0x7f192c0f59e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f191c004660 tx=0x7f191c009b30).stop 2022-02-02T14:16:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 -- 172.21.15.33:0/143473635 shutdown_connections 2022-02-02T14:16:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 --2- 172.21.15.33:0/143473635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f6860 0x7f192c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:16:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 --2- 172.21.15.33:0/143473635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f55c0 0x7f192c0f59e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 -- 172.21.15.33:0/143473635 >> 172.21.15.33:0/143473635 conn(0x7f192c0f0d40 msgr2=0x7f192c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 -- 172.21.15.33:0/143473635 shutdown_connections 2022-02-02T14:16:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.227+0000 7f19320d9700 1 -- 172.21.15.33:0/143473635 wait complete. 2022-02-02T14:16:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 Processor -- start 2022-02-02T14:16:24.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 -- start start 2022-02-02T14:16:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f55c0 0x7f192c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1069f0 con 0x7f192c0f6860 2022-02-02T14:16:24.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.228+0000 7f19320d9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f192c1072a0 con 0x7f192c0f55c0 2022-02-02T14:16:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f55c0 0x7f192c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60354/0 (socket says 172.21.15.33:60354) 2022-02-02T14:16:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 -- 172.21.15.33:0/1480597539 learned_addr learned my addr 172.21.15.33:0/1480597539 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:24.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 -- 172.21.15.33:0/1480597539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f55c0 msgr2=0x7f192c105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f55c0 0x7f192c105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 -- 172.21.15.33:0/1480597539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c005040 con 0x7f192c0f6860 2022-02-02T14:16:24.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f192affd700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f192000b410 tx=0x7f1920006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19200125f0 con 0x7f192c0f6860 2022-02-02T14:16:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f192c107580 con 0x7f192c0f6860 2022-02-02T14:16:24.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f192000be30 con 0x7f192c0f6860 2022-02-02T14:16:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1920002a70 con 0x7f192c0f6860 2022-02-02T14:16:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.229+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f192c107b40 con 0x7f192c0f6860 2022-02-02T14:16:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.231+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192c0f49b0 con 0x7f192c0f6860 2022-02-02T14:16:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.231+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f192000f030 con 0x7f192c0f6860 2022-02-02T14:16:24.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.231+0000 7f1913fff700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 0x7f1914067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.231+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1920081ed0 con 0x7f192c0f6860 2022-02-02T14:16:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.232+0000 7f192b7fe700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 0x7f1914067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.232+0000 7f192b7fe700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 0x7f1914067290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f191c004630 tx=0x7f191c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.236+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19200539b0 con 0x7f192c0f6860 2022-02-02T14:16:24.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.423+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f192c0fde00 con 0x7f1914064dd0 2022-02-02T14:16:24.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.424+0000 7f1913fff700 1 -- 172.21.15.33:0/1480597539 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f192c0fde00 con 0x7f1914064dd0 2022-02-02T14:16:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 msgr2=0x7f1914067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 0x7f1914067290 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f191c004630 tx=0x7f191c009b30).stop 2022-02-02T14:16:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 msgr2=0x7f192c1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f192000b410 tx=0x7f1920006ef0).stop 2022-02-02T14:16:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 shutdown_connections 2022-02-02T14:16:24.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1914064dd0 0x7f1914067290 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f192c0f55c0 0x7f192c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 --2- 172.21.15.33:0/1480597539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f192c0f6860 0x7f192c1063b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 >> 172.21.15.33:0/1480597539 conn(0x7f192c0f0d40 msgr2=0x7f192c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 shutdown_connections 2022-02-02T14:16:24.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.426+0000 7f19320d9700 1 -- 172.21.15.33:0/1480597539 wait complete. 2022-02-02T14:16:24.436 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:16:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:24 smithi033 ceph-mon[101165]: pgmap v1130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:24.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/882329181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f7980 msgr2=0x7fc7b00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/882329181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f7980 0x7fc7b00f7de0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7fc7a4004660 tx=0x7fc7a4009b30).stop 2022-02-02T14:16:24.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/882329181 shutdown_connections 2022-02-02T14:16:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/882329181 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f7980 0x7fc7b00f7de0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/882329181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f66e0 0x7fc7b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/882329181 >> 172.21.15.33:0/882329181 conn(0x7fc7b00f1e40 msgr2=0x7fc7b00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:24.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/882329181 shutdown_connections 2022-02-02T14:16:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.528+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/882329181 wait complete. 2022-02-02T14:16:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 Processor -- start 2022-02-02T14:16:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 -- start start 2022-02-02T14:16:24.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f7980 0x7fc7b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b006a380 con 0x7fc7b00f66e0 2022-02-02T14:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.529+0000 7fc7b4d5d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b006a4c0 con 0x7fc7b00f7980 2022-02-02T14:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60362/0 (socket says 172.21.15.33:60362) 2022-02-02T14:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 -- 172.21.15.33:0/3918661211 learned_addr learned my addr 172.21.15.33:0/3918661211 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7add9b700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f7980 0x7fc7b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 -- 172.21.15.33:0/3918661211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f7980 msgr2=0x7fc7b0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f7980 0x7fc7b0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 -- 172.21.15.33:0/3918661211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a4005040 con 0x7fc7b00f66e0 2022-02-02T14:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7ae59c700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fc7a000c530 tx=0x7fc7a0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a000f650 con 0x7fc7b00f66e0 2022-02-02T14:16:24.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7a000fc60 con 0x7fc7b00f66e0 2022-02-02T14:16:24.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b006a7a0 con 0x7fc7b00f66e0 2022-02-02T14:16:24.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7a0012cb0 con 0x7fc7b00f66e0 2022-02-02T14:16:24.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.530+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b010ef90 con 0x7fc7b00f66e0 2022-02-02T14:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.531+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b0045ad0 con 0x7fc7b00f66e0 2022-02-02T14:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.532+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc7a0019030 con 0x7fc7b00f66e0 2022-02-02T14:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.532+0000 7fc79effd700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 0x7fc798067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.532+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc7a0081580 con 0x7fc7b00f66e0 2022-02-02T14:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.532+0000 7fc7add9b700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 0x7fc798067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.533+0000 7fc7add9b700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 0x7fc798067270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fc7a4004e30 tx=0x7fc7a4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.536+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7a00487d0 con 0x7fc7b00f66e0 2022-02-02T14:16:24.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:24 smithi037 ceph-mon[69017]: pgmap v1130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:24.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.716+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7b00ff010 con 0x7fc798064db0 2022-02-02T14:16:24.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.731+0000 7fc79effd700 1 -- 172.21.15.33:0/3918661211 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc7b00ff010 con 0x7fc798064db0 2022-02-02T14:16:24.731 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:16:24.731 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (41m) 3m ago 42m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:16:24.731 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (34m) 3m ago 42m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:16:24.731 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (34m) 3m ago 42m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:16:24.732 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (41m) 3m ago 42m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:16:24.732 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (35m) 3m ago 38m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:16:24.732 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (35m) 3m ago 38m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:16:24.732 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (36m) 3m ago 38m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:16:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (38m) 3m ago 38m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:16:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (36m) 3m ago 44m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:16:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (35m) 3m ago 42m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:16:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (35m) 3m ago 44m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:16:24.733 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (35m) 3m ago 42m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:16:24.734 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (42m) 3m ago 42m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:16:24.734 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (41m) 3m ago 41m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:16:24.734 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 3m ago 41m - 4096M 2022-02-02T14:16:24.734 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (41m) 3m ago 41m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:16:24.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (40m) 3m ago 40m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:16:24.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (40m) 3m ago 40m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:16:24.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (40m) 3m ago 40m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:16:24.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (40m) 3m ago 40m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:16:24.736 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (41m) 3m ago 42m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 msgr2=0x7fc798067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 0x7fc798067270 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fc7a4004e30 tx=0x7fc7a4009b30).stop 2022-02-02T14:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 msgr2=0x7fc7b006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fc7a000c530 tx=0x7fc7a0007e10).stop 2022-02-02T14:16:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 shutdown_connections 2022-02-02T14:16:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.732+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc798064db0 0x7fc798067270 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.733+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7b00f66e0 0x7fc7b006b9a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.733+0000 7fc7b4d5d700 1 --2- 172.21.15.33:0/3918661211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7b00f7980 0x7fc7b0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.733+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 >> 172.21.15.33:0/3918661211 conn(0x7fc7b00f1e40 msgr2=0x7fc7b00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.733+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 shutdown_connections 2022-02-02T14:16:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.733+0000 7fc7b4d5d700 1 -- 172.21.15.33:0/3918661211 wait complete. 2022-02-02T14:16:24.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 -- 172.21.15.33:0/1347557462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f7d20 msgr2=0x7f34000f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 --2- 172.21.15.33:0/1347557462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f7d20 0x7f34000f8140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f33f0004660 tx=0x7f33f0009b30).stop 2022-02-02T14:16:24.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 -- 172.21.15.33:0/1347557462 shutdown_connections 2022-02-02T14:16:24.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 --2- 172.21.15.33:0/1347557462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f86c0 0x7f34000f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 --2- 172.21.15.33:0/1347557462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f7d20 0x7f34000f8140 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 -- 172.21.15.33:0/1347557462 >> 172.21.15.33:0/1347557462 conn(0x7f34000f04c0 msgr2=0x7f34000f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:24.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 -- 172.21.15.33:0/1347557462 shutdown_connections 2022-02-02T14:16:24.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.832+0000 7f34059be700 1 -- 172.21.15.33:0/1347557462 wait complete. 2022-02-02T14:16:24.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 Processor -- start 2022-02-02T14:16:24.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 -- start start 2022-02-02T14:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 0x7f34000f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000f5fd0 con 0x7f34000f86c0 2022-02-02T14:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.833+0000 7f34059be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000f6110 con 0x7f34000f7d20 2022-02-02T14:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60374/0 (socket says 172.21.15.33:60374) 2022-02-02T14:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 -- 172.21.15.33:0/3591358746 learned_addr learned my addr 172.21.15.33:0/3591358746 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33feffd700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 0x7f34000f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 -- 172.21.15.33:0/3591358746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 msgr2=0x7f34000f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:24.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 0x7f34000f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:24.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 -- 172.21.15.33:0/3591358746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f0005040 con 0x7f34000f86c0 2022-02-02T14:16:24.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33feffd700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 0x7f34000f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:16:24.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33fe7fc700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f33f40026d0 tx=0x7f33f4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f40079c0 con 0x7f34000f86c0 2022-02-02T14:16:24.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34000f63f0 con 0x7f34000f86c0 2022-02-02T14:16:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f33f400f040 con 0x7f34000f86c0 2022-02-02T14:16:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.834+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f40148b0 con 0x7f34000f86c0 2022-02-02T14:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.835+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340010efe0 con 0x7f34000f86c0 2022-02-02T14:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.835+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3400045ad0 con 0x7f34000f86c0 2022-02-02T14:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.836+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f33f4007b20 con 0x7f34000f86c0 2022-02-02T14:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.837+0000 7f33e77fe700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 0x7f33e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.837+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f33f40819d0 con 0x7f34000f86c0 2022-02-02T14:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.837+0000 7f33feffd700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 0x7f33e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.837+0000 7f33feffd700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 0x7f33e8067290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f33f0013690 tx=0x7f33f0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:24.841+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f33f404f9c0 con 0x7f34000f86c0 2022-02-02T14:16:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.085+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3400027a00 con 0x7f34000f86c0 2022-02-02T14:16:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.085+0000 7f33e77fe700 1 -- 172.21.15.33:0/3591358746 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f33f4052fe0 con 0x7f34000f86c0 2022-02-02T14:16:25.086 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:16:25.086 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:16:25.086 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:16:25.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:25.088 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:16:25.088 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:16:25.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:25.089 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:16:25.089 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:16:25.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:25.089 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:16:25.090 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:16:25.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:25.090 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:16:25.090 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:16:25.090 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:16:25.091 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:16:25.091 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:16:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 msgr2=0x7f33e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 0x7f33e8067290 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f33f0013690 tx=0x7f33f0009b30).stop 2022-02-02T14:16:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 msgr2=0x7f34000f5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f33f40026d0 tx=0x7f33f4009de0).stop 2022-02-02T14:16:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 shutdown_connections 2022-02-02T14:16:25.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f33e8064dd0 0x7f33e8067290 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34000f7d20 0x7f34000f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 --2- 172.21.15.33:0/3591358746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34000f86c0 0x7f34000f5a70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 >> 172.21.15.33:0/3591358746 conn(0x7f34000f04c0 msgr2=0x7f34000fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:25.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 shutdown_connections 2022-02-02T14:16:25.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.087+0000 7f34059be700 1 -- 172.21.15.33:0/3591358746 wait complete. 2022-02-02T14:16:25.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2013778728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f77d0 msgr2=0x7f6c900f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2013778728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f77d0 0x7f6c900f7c30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f6c84004660 tx=0x7f6c84009b30).stop 2022-02-02T14:16:25.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2013778728 shutdown_connections 2022-02-02T14:16:25.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2013778728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f77d0 0x7f6c900f7c30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2013778728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f6530 0x7f6c900f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2013778728 >> 172.21.15.33:0/2013778728 conn(0x7f6c900f1c90 msgr2=0x7f6c900f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2013778728 shutdown_connections 2022-02-02T14:16:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.188+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2013778728 wait complete. 2022-02-02T14:16:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 Processor -- start 2022-02-02T14:16:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 -- start start 2022-02-02T14:16:25.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f77d0 0x7f6c90107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90107880 con 0x7f6c900f6530 2022-02-02T14:16:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c94a1a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c90108090 con 0x7f6c900f77d0 2022-02-02T14:16:25.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c8ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c8ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60382/0 (socket says 172.21.15.33:60382) 2022-02-02T14:16:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.189+0000 7f6c8ed9d700 1 -- 172.21.15.33:0/2895408770 learned_addr learned my addr 172.21.15.33:0/2895408770 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c8e59c700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f77d0 0x7f6c90107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c8ed9d700 1 -- 172.21.15.33:0/2895408770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f77d0 msgr2=0x7f6c90107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c8ed9d700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f77d0 0x7f6c90107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c8ed9d700 1 -- 172.21.15.33:0/2895408770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84005040 con 0x7f6c900f6530 2022-02-02T14:16:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c8ed9d700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f6c80002700 tx=0x7f6c80009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c800079c0 con 0x7f6c900f6530 2022-02-02T14:16:25.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c8000f040 con 0x7f6c900f6530 2022-02-02T14:16:25.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c80014860 con 0x7f6c900f6530 2022-02-02T14:16:25.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c90108310 con 0x7f6c900f6530 2022-02-02T14:16:25.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.190+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c901088d0 con 0x7f6c900f6530 2022-02-02T14:16:25.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.191+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c90059100 con 0x7f6c900f6530 2022-02-02T14:16:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.192+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c8001b060 con 0x7f6c900f6530 2022-02-02T14:16:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.192+0000 7f6c777fe700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 0x7f6c780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.192+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c80081930 con 0x7f6c900f6530 2022-02-02T14:16:25.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.192+0000 7f6c8e59c700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 0x7f6c780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.193+0000 7f6c8e59c700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 0x7f6c780672e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f6c84004630 tx=0x7f6c84009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:25.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.196+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c8004f9e0 con 0x7f6c900f6530 2022-02-02T14:16:25.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.409+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6c90045ad0 con 0x7f6c900f6530 2022-02-02T14:16:25.410 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3591358746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:16:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.410+0000 7f6c777fe700 1 -- 172.21.15.33:0/2895408770 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6c80019070 con 0x7f6c900f6530 2022-02-02T14:16:25.410 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:16:25.411 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:16:25.411 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:16:25.411 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:16:25.412 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:25.412 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:16:25.412 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:16:25.413 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:16:25.413 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:16:25.413 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:16:25.413 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:16:25.414 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:16:25.414 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:16:25.414 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:16:25.415 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:16:25.415 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:16:25.415 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:16:25.415 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:16:25.417 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:16:25.417 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:16:25.417 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:16:25.417 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:16:25.418 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:16:25.418 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:16:25.419 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:16:25.419 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:16:25.419 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:16:25.419 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:16:25.420 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:16:25.420 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:16:25.420 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:16:25.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:25.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:25.421 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:16:25.421 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:25.421 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:25.422 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:25.422 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:25.422 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:25.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 msgr2=0x7f6c780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 0x7f6c780672e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f6c84004630 tx=0x7f6c84009b30).stop 2022-02-02T14:16:25.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 msgr2=0x7f6c90106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:25.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f6c80002700 tx=0x7f6c80009d80).stop 2022-02-02T14:16:25.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 shutdown_connections 2022-02-02T14:16:25.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c78064e20 0x7f6c780672e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c900f6530 0x7f6c90106d90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 --2- 172.21.15.33:0/2895408770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c900f77d0 0x7f6c90107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 >> 172.21.15.33:0/2895408770 conn(0x7f6c900f1c90 msgr2=0x7f6c900fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 shutdown_connections 2022-02-02T14:16:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:25.412+0000 7f6c94a1a700 1 -- 172.21.15.33:0/2895408770 wait complete. 2022-02-02T14:16:25.427 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:16:25.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3591358746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:16:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:26 smithi033 ceph-mon[101165]: from='client.35238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:26 smithi033 ceph-mon[101165]: pgmap v1131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:26 smithi033 ceph-mon[101165]: from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:26.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:26 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2895408770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:16:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:26 smithi037 ceph-mon[69017]: from='client.35238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:26 smithi037 ceph-mon[69017]: pgmap v1131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:26.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:26 smithi037 ceph-mon[69017]: from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:26.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:26 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2895408770' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:16:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:28 smithi033 ceph-mon[101165]: pgmap v1132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:28 smithi037 ceph-mon[69017]: pgmap v1132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:30 smithi033 ceph-mon[101165]: pgmap v1133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:30 smithi037 ceph-mon[69017]: pgmap v1133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:32 smithi033 ceph-mon[101165]: pgmap v1134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:32 smithi037 ceph-mon[69017]: pgmap v1134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:34 smithi033 ceph-mon[101165]: pgmap v1135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:34 smithi037 ceph-mon[69017]: pgmap v1135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:36.241 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:36 smithi033 ceph-mon[101165]: pgmap v1136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:36 smithi037 ceph-mon[69017]: pgmap v1136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:38 smithi033 ceph-mon[101165]: pgmap v1137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:38 smithi037 ceph-mon[69017]: pgmap v1137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:40 smithi033 ceph-mon[101165]: pgmap v1138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:40 smithi037 ceph-mon[69017]: pgmap v1138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:42 smithi033 ceph-mon[101165]: pgmap v1139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:42 smithi037 ceph-mon[69017]: pgmap v1139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:44 smithi033 ceph-mon[101165]: pgmap v1140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:44 smithi037 ceph-mon[69017]: pgmap v1140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:46 smithi033 ceph-mon[101165]: pgmap v1141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:46 smithi037 ceph-mon[69017]: pgmap v1141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:48 smithi033 ceph-mon[101165]: pgmap v1142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:48 smithi037 ceph-mon[69017]: pgmap v1142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:50 smithi033 ceph-mon[101165]: pgmap v1143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:50 smithi037 ceph-mon[69017]: pgmap v1143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:52 smithi033 ceph-mon[101165]: pgmap v1144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:52 smithi037 ceph-mon[69017]: pgmap v1144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:54.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:54 smithi033 ceph-mon[101165]: pgmap v1145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:54 smithi037 ceph-mon[69017]: pgmap v1145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:16:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:16:55.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 -- 172.21.15.33:0/1449797370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f66e0 msgr2=0x7f4bb40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 --2- 172.21.15.33:0/1449797370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f66e0 0x7f4bb40f6b00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f4ba40099e0 tx=0x7f4ba4004d10).stop 2022-02-02T14:16:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 -- 172.21.15.33:0/1449797370 shutdown_connections 2022-02-02T14:16:55.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 --2- 172.21.15.33:0/1449797370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f7980 0x7f4bb40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 --2- 172.21.15.33:0/1449797370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f66e0 0x7f4bb40f6b00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 -- 172.21.15.33:0/1449797370 >> 172.21.15.33:0/1449797370 conn(0x7f4bb40f1e40 msgr2=0x7f4bb40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:55.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 -- 172.21.15.33:0/1449797370 shutdown_connections 2022-02-02T14:16:55.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.529+0000 7f4bba135700 1 -- 172.21.15.33:0/1449797370 wait complete. 2022-02-02T14:16:55.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 Processor -- start 2022-02-02T14:16:55.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 -- start start 2022-02-02T14:16:55.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f66e0 0x7f4bb406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb406a380 con 0x7f4bb40f7980 2022-02-02T14:16:55.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.530+0000 7f4bba135700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb406a4c0 con 0x7f4bb40f66e0 2022-02-02T14:16:55.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60394/0 (socket says 172.21.15.33:60394) 2022-02-02T14:16:55.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 -- 172.21.15.33:0/2787191732 learned_addr learned my addr 172.21.15.33:0/2787191732 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:55.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb37fe700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f66e0 0x7f4bb406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 -- 172.21.15.33:0/2787191732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f66e0 msgr2=0x7f4bb406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f66e0 0x7f4bb406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 -- 172.21.15.33:0/2787191732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba4009640 con 0x7f4bb40f7980 2022-02-02T14:16:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bb2ffd700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f4b9c00c790 tx=0x7f4b9c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b9c002590 con 0x7f4bb40f7980 2022-02-02T14:16:55.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b9c002ba0 con 0x7f4bb40f7980 2022-02-02T14:16:55.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb406a7a0 con 0x7f4bb40f7980 2022-02-02T14:16:55.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b9c013d90 con 0x7f4bb40f7980 2022-02-02T14:16:55.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.531+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb410f090 con 0x7f4bb40f7980 2022-02-02T14:16:55.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.533+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb40f5ad0 con 0x7f4bb40f7980 2022-02-02T14:16:55.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.533+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b9c01a060 con 0x7f4bb40f7980 2022-02-02T14:16:55.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.533+0000 7f4babfff700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 0x7f4ba0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.533+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4b9c081d10 con 0x7f4bb40f7980 2022-02-02T14:16:55.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.533+0000 7f4bb37fe700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 0x7f4ba0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.534+0000 7f4bb37fe700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 0x7f4ba0067290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f4ba40099b0 tx=0x7f4ba4004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:55.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.538+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b9c04fd60 con 0x7f4bb40f7980 2022-02-02T14:16:55.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:16:55.545 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:16:55.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.727+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb40fef60 con 0x7f4ba0064dd0 2022-02-02T14:16:55.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.728+0000 7f4babfff700 1 -- 172.21.15.33:0/2787191732 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4bb40fef60 con 0x7f4ba0064dd0 2022-02-02T14:16:55.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 msgr2=0x7f4ba0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 0x7f4ba0067290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f4ba40099b0 tx=0x7f4ba4004d10).stop 2022-02-02T14:16:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 msgr2=0x7f4bb4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f4b9c00c790 tx=0x7f4b9c007d70).stop 2022-02-02T14:16:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 shutdown_connections 2022-02-02T14:16:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ba0064dd0 0x7f4ba0067290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bb40f66e0 0x7f4bb406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 --2- 172.21.15.33:0/2787191732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bb40f7980 0x7f4bb4069e20 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.730+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 >> 172.21.15.33:0/2787191732 conn(0x7f4bb40f1e40 msgr2=0x7f4bb40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.731+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 shutdown_connections 2022-02-02T14:16:55.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.731+0000 7f4bba135700 1 -- 172.21.15.33:0/2787191732 wait complete. 2022-02-02T14:16:55.741 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:16:55.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 -- 172.21.15.33:0/1259616089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 msgr2=0x7f585c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 --2- 172.21.15.33:0/1259616089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c0f5850 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f584c004660 tx=0x7f584c009b30).stop 2022-02-02T14:16:55.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 -- 172.21.15.33:0/1259616089 shutdown_connections 2022-02-02T14:16:55.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 --2- 172.21.15.33:0/1259616089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 0x7f585c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 --2- 172.21.15.33:0/1259616089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c0f5850 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 -- 172.21.15.33:0/1259616089 >> 172.21.15.33:0/1259616089 conn(0x7f585c0f0b90 msgr2=0x7f585c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 -- 172.21.15.33:0/1259616089 shutdown_connections 2022-02-02T14:16:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 -- 172.21.15.33:0/1259616089 wait complete. 2022-02-02T14:16:55.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.832+0000 7f586179e700 1 Processor -- start 2022-02-02T14:16:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f586179e700 1 -- start start 2022-02-02T14:16:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f586179e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f586179e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 0x7f585c10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f586179e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0603e0 con 0x7f585c0f5430 2022-02-02T14:16:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f586179e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c060520 con 0x7f585c0f66d0 2022-02-02T14:16:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60402/0 (socket says 172.21.15.33:60402) 2022-02-02T14:16:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 -- 172.21.15.33:0/426718197 learned_addr learned my addr 172.21.15.33:0/426718197 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585b7fe700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 0x7f585c10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 -- 172.21.15.33:0/426718197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 msgr2=0x7f585c10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 0x7f585c10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.833+0000 7f585bfff700 1 -- 172.21.15.33:0/426718197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c005040 con 0x7f585c0f5430 2022-02-02T14:16:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f585bfff700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f584c009830 tx=0x7f584c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f584c018070 con 0x7f585c0f5430 2022-02-02T14:16:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c10c4e0 con 0x7f585c0f5430 2022-02-02T14:16:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f584c007ba0 con 0x7f585c0f5430 2022-02-02T14:16:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f584c01de60 con 0x7f585c0f5430 2022-02-02T14:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.834+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c10ca40 con 0x7f585c0f5430 2022-02-02T14:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.835+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c045ad0 con 0x7f585c0f5430 2022-02-02T14:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.836+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f584c007d10 con 0x7f585c0f5430 2022-02-02T14:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.836+0000 7f5858ff9700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 0x7f58480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:55.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.836+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f584c0835e0 con 0x7f585c0f5430 2022-02-02T14:16:55.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.838+0000 7f585b7fe700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 0x7f58480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:55.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.838+0000 7f585b7fe700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 0x7f58480672e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f5844004c40 tx=0x7f584400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:55.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:55.840+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f584c051630 con 0x7f585c0f5430 2022-02-02T14:16:56.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.025+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f585c0fdd30 con 0x7f5848064e20 2022-02-02T14:16:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.040+0000 7f5858ff9700 1 -- 172.21.15.33:0/426718197 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f585c0fdd30 con 0x7f5848064e20 2022-02-02T14:16:56.040 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:16:56.040 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (42m) 4m ago 43m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:16:56.040 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (35m) 4m ago 43m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:16:56.040 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (35m) 4m ago 42m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:16:56.041 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (42m) 4m ago 42m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:16:56.041 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (35m) 4m ago 39m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:16:56.041 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (36m) 4m ago 39m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:16:56.041 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (37m) 4m ago 39m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:16:56.041 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (39m) 4m ago 39m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:16:56.042 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (36m) 4m ago 44m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:16:56.042 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (36m) 4m ago 42m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:16:56.042 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (36m) 4m ago 44m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:16:56.042 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (35m) 4m ago 42m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:16:56.043 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (42m) 4m ago 42m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:16:56.043 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (42m) 4m ago 42m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:16:56.043 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 41m - 4096M 2022-02-02T14:16:56.043 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (41m) 4m ago 41m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:16:56.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (41m) 4m ago 41m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:16:56.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (41m) 4m ago 41m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:16:56.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (40m) 4m ago 40m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:16:56.044 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (40m) 4m ago 40m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:16:56.045 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (42m) 4m ago 42m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:16:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 msgr2=0x7f58480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 0x7f58480672e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f5844004c40 tx=0x7f584400b040).stop 2022-02-02T14:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 msgr2=0x7f585c109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f584c009830 tx=0x7f584c009b30).stop 2022-02-02T14:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 shutdown_connections 2022-02-02T14:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5848064e20 0x7f58480672e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c0f5430 0x7f585c109a90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 --2- 172.21.15.33:0/426718197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585c0f66d0 0x7f585c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 >> 172.21.15.33:0/426718197 conn(0x7f585c0f0b90 msgr2=0x7f585c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 shutdown_connections 2022-02-02T14:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.042+0000 7f586179e700 1 -- 172.21.15.33:0/426718197 wait complete. 2022-02-02T14:16:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- 172.21.15.33:0/2124143714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f6860 msgr2=0x7fece80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 --2- 172.21.15.33:0/2124143714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f6860 0x7fece80f6cc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7fecd4004660 tx=0x7fecd4009b30).stop 2022-02-02T14:16:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- 172.21.15.33:0/2124143714 shutdown_connections 2022-02-02T14:16:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 --2- 172.21.15.33:0/2124143714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f6860 0x7fece80f6cc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 --2- 172.21.15.33:0/2124143714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f55c0 0x7fece80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- 172.21.15.33:0/2124143714 >> 172.21.15.33:0/2124143714 conn(0x7fece80f0d40 msgr2=0x7fece80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- 172.21.15.33:0/2124143714 shutdown_connections 2022-02-02T14:16:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- 172.21.15.33:0/2124143714 wait complete. 2022-02-02T14:16:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 Processor -- start 2022-02-02T14:16:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.143+0000 7feceeab7700 1 -- start start 2022-02-02T14:16:56.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f6860 0x7fece810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8060420 con 0x7fece80f55c0 2022-02-02T14:16:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8060560 con 0x7fece80f6860 2022-02-02T14:16:56.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60412/0 (socket says 172.21.15.33:60412) 2022-02-02T14:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 -- 172.21.15.33:0/3971709357 learned_addr learned my addr 172.21.15.33:0/3971709357 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fece7fff700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f6860 0x7fece810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 -- 172.21.15.33:0/3971709357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f6860 msgr2=0x7fece810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f6860 0x7fece810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 -- 172.21.15.33:0/3971709357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4005040 con 0x7fece80f55c0 2022-02-02T14:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fecec853700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fecdc002700 tx=0x7fecdc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecdc0079c0 con 0x7fece80f55c0 2022-02-02T14:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecdc00f040 con 0x7fece80f55c0 2022-02-02T14:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece810c720 con 0x7fece80f55c0 2022-02-02T14:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecdc014860 con 0x7fece80f55c0 2022-02-02T14:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.144+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece810ccb0 con 0x7fece80f55c0 2022-02-02T14:16:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.146+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece80f49b0 con 0x7fece80f55c0 2022-02-02T14:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.146+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fecdc01b060 con 0x7fece80f55c0 2022-02-02T14:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.146+0000 7fece57fa700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 0x7fecd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.146+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fecdc081860 con 0x7fece80f55c0 2022-02-02T14:16:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.146+0000 7fece7fff700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 0x7fecd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.147+0000 7fece7fff700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 0x7fecd8067290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fecd4004630 tx=0x7fecd4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:56.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.151+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fecdc04f910 con 0x7fece80f55c0 2022-02-02T14:16:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.398+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fece80586e0 con 0x7fece80f55c0 2022-02-02T14:16:56.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:56 smithi033 ceph-mon[101165]: pgmap v1146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.398+0000 7fece57fa700 1 -- 172.21.15.33:0/3971709357 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fecdc0192d0 con 0x7fece80f55c0 2022-02-02T14:16:56.399 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:16:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:16:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:16:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:56.400 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:16:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:16:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:16:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:16:56.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:16:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:16:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:16:56.402 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:16:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:16:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:16:56.403 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:16:56.403 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:16:56.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 msgr2=0x7fecd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 0x7fecd8067290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fecd4004630 tx=0x7fecd4009b30).stop 2022-02-02T14:16:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 msgr2=0x7fece8109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7fecdc002700 tx=0x7fecdc009d80).stop 2022-02-02T14:16:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 shutdown_connections 2022-02-02T14:16:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fecd8064dd0 0x7fecd8067290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fece80f55c0 0x7fece8109c10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 --2- 172.21.15.33:0/3971709357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fece80f6860 0x7fece810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 >> 172.21.15.33:0/3971709357 conn(0x7fece80f0d40 msgr2=0x7fece80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 shutdown_connections 2022-02-02T14:16:56.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.401+0000 7feceeab7700 1 -- 172.21.15.33:0/3971709357 wait complete. 2022-02-02T14:16:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 -- 172.21.15.33:0/3324467180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 msgr2=0x7f096c0f5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 --2- 172.21.15.33:0/3324467180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f5990 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f0968004660 tx=0x7f0968009b30).stop 2022-02-02T14:16:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 -- 172.21.15.33:0/3324467180 shutdown_connections 2022-02-02T14:16:56.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 --2- 172.21.15.33:0/3324467180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 0x7f096c0f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 --2- 172.21.15.33:0/3324467180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f5990 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 -- 172.21.15.33:0/3324467180 >> 172.21.15.33:0/3324467180 conn(0x7f096c0f0cd0 msgr2=0x7f096c0f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 -- 172.21.15.33:0/3324467180 shutdown_connections 2022-02-02T14:16:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.502+0000 7f0974282700 1 -- 172.21.15.33:0/3324467180 wait complete. 2022-02-02T14:16:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 Processor -- start 2022-02-02T14:16:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 -- start start 2022-02-02T14:16:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 0x7f096c0f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c10ab70 con 0x7f096c0f5570 2022-02-02T14:16:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f0974282700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096c10acb0 con 0x7f096c0f6810 2022-02-02T14:16:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f097201e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f097201e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60422/0 (socket says 172.21.15.33:60422) 2022-02-02T14:16:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f097201e700 1 -- 172.21.15.33:0/819214059 learned_addr learned my addr 172.21.15.33:0/819214059 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:16:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.503+0000 7f097181d700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 0x7f096c0f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f097201e700 1 -- 172.21.15.33:0/819214059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 msgr2=0x7f096c0f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f097201e700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 0x7f096c0f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f097201e700 1 -- 172.21.15.33:0/819214059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968005040 con 0x7f096c0f5570 2022-02-02T14:16:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f097201e700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f0968013a70 tx=0x7f0968009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0968018070 con 0x7f096c0f5570 2022-02-02T14:16:56.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09680097d0 con 0x7f096c0f5570 2022-02-02T14:16:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096c0f80a0 con 0x7f096c0f5570 2022-02-02T14:16:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096c0f8600 con 0x7f096c0f5570 2022-02-02T14:16:56.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.504+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f096801de80 con 0x7f096c0f5570 2022-02-02T14:16:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.505+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954004fa0 con 0x7f096c0f5570 2022-02-02T14:16:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.505+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0968007ba0 con 0x7f096c0f5570 2022-02-02T14:16:56.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.506+0000 7f095effd700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 0x7f09580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:16:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.506+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0968083530 con 0x7f096c0f5570 2022-02-02T14:16:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.506+0000 7f097181d700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 0x7f09580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:16:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.506+0000 7f097181d700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 0x7f09580672e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0960004e20 tx=0x7f096000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:16:56.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.510+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09680515e0 con 0x7f096c0f5570 2022-02-02T14:16:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:56 smithi037 ceph-mon[69017]: pgmap v1146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:56.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.723+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0954005e80 con 0x7f096c0f5570 2022-02-02T14:16:56.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.723+0000 7f095effd700 1 -- 172.21.15.33:0/819214059 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0968054c00 con 0x7f096c0f5570 2022-02-02T14:16:56.898 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:16:56.898 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:16:56.898 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:16:56.899 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:16:56.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:56.899 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:16:56.899 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:16:56.900 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:16:56.900 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:16:56.900 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:16:56.900 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:16:56.900 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:16:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:16:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:16:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:16:56.901 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:16:56.902 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:16:56.902 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:16:56.902 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:16:56.902 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:16:56.903 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:16:56.903 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:16:56.903 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:16:56.903 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:16:56.903 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:16:56.904 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:16:56.904 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:16:56.904 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:16:56.904 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:16:56.905 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:16:56.905 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:16:56.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:56.905 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:56.905 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:16:56.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:16:56.906 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:56.906 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:56.906 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:56.907 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:16:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 msgr2=0x7f09580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 0x7f09580672e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f0960004e20 tx=0x7f096000b040).stop 2022-02-02T14:16:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 msgr2=0x7f096c0f96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:16:56.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f0968013a70 tx=0x7f0968009b30).stop 2022-02-02T14:16:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 shutdown_connections 2022-02-02T14:16:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0958064e20 0x7f09580672e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096c0f5570 0x7f096c0f96d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 --2- 172.21.15.33:0/819214059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f096c0f6810 0x7f096c0f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:16:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 >> 172.21.15.33:0/819214059 conn(0x7f096c0f0cd0 msgr2=0x7f096c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:16:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 shutdown_connections 2022-02-02T14:16:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:16:56.726+0000 7f0974282700 1 -- 172.21.15.33:0/819214059 wait complete. 2022-02-02T14:16:56.910 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:16:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:57 smithi037 ceph-mon[69017]: from='client.35254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:57 smithi037 ceph-mon[69017]: from='client.35258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:57.485 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3971709357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:16:57.486 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/819214059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:16:57.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:57 smithi033 ceph-mon[101165]: from='client.35254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:57 smithi033 ceph-mon[101165]: from='client.35258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:16:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3971709357' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:16:57.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/819214059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:16:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:16:58 smithi033 ceph-mon[101165]: pgmap v1147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:16:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:16:58 smithi037 ceph-mon[69017]: pgmap v1147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:00 smithi033 ceph-mon[101165]: pgmap v1148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:00 smithi037 ceph-mon[69017]: pgmap v1148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:02.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:02 smithi037 ceph-mon[69017]: pgmap v1149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:02 smithi033 ceph-mon[101165]: pgmap v1149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:04 smithi033 ceph-mon[101165]: pgmap v1150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:04.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:04 smithi037 ceph-mon[69017]: pgmap v1150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:06 smithi033 ceph-mon[101165]: pgmap v1151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:06 smithi037 ceph-mon[69017]: pgmap v1151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:08 smithi033 ceph-mon[101165]: pgmap v1152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:08 smithi037 ceph-mon[69017]: pgmap v1152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:10 smithi033 ceph-mon[101165]: pgmap v1153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:10 smithi037 ceph-mon[69017]: pgmap v1153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:12 smithi033 ceph-mon[101165]: pgmap v1154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:12 smithi037 ceph-mon[69017]: pgmap v1154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:14 smithi033 ceph-mon[101165]: pgmap v1155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:14 smithi037 ceph-mon[69017]: pgmap v1155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:16 smithi033 ceph-mon[101165]: pgmap v1156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:16 smithi037 ceph-mon[69017]: pgmap v1156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:18 smithi033 ceph-mon[101165]: pgmap v1157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:18 smithi037 ceph-mon[69017]: pgmap v1157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:20 smithi033 ceph-mon[101165]: pgmap v1158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:20 smithi037 ceph-mon[69017]: pgmap v1158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:22 smithi033 ceph-mon[101165]: pgmap v1159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:22 smithi037 ceph-mon[69017]: pgmap v1159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:24 smithi033 ceph-mon[101165]: pgmap v1160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:24 smithi037 ceph-mon[69017]: pgmap v1160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:26 smithi033 ceph-mon[101165]: pgmap v1161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:26 smithi037 ceph-mon[69017]: pgmap v1161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:26.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.843+0000 7fba44bb6700 1 -- 172.21.15.33:0/3060230541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 msgr2=0x7fba400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.843+0000 7fba44bb6700 1 --2- 172.21.15.33:0/3060230541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba400f6cc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fba28004660 tx=0x7fba28009b30).stop 2022-02-02T14:17:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 -- 172.21.15.33:0/3060230541 shutdown_connections 2022-02-02T14:17:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 --2- 172.21.15.33:0/3060230541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba400f6cc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 --2- 172.21.15.33:0/3060230541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 0x7fba400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 -- 172.21.15.33:0/3060230541 >> 172.21.15.33:0/3060230541 conn(0x7fba400f0d40 msgr2=0x7fba400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 -- 172.21.15.33:0/3060230541 shutdown_connections 2022-02-02T14:17:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 -- 172.21.15.33:0/3060230541 wait complete. 2022-02-02T14:17:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 Processor -- start 2022-02-02T14:17:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.844+0000 7fba44bb6700 1 -- start start 2022-02-02T14:17:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba44bb6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 0x7fba40105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba44bb6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba44bb6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40106920 con 0x7fba400f6860 2022-02-02T14:17:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba44bb6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba40107130 con 0x7fba400f55c0 2022-02-02T14:17:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60434/0 (socket says 172.21.15.33:60434) 2022-02-02T14:17:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 -- 172.21.15.33:0/671042354 learned_addr learned my addr 172.21.15.33:0/671042354 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3e59c700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 0x7fba40105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 -- 172.21.15.33:0/671042354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 msgr2=0x7fba40105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 0x7fba40105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 -- 172.21.15.33:0/671042354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba28005040 con 0x7fba400f6860 2022-02-02T14:17:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.845+0000 7fba3dd9b700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fba28009990 tx=0x7fba28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:26.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.846+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba28018070 con 0x7fba400f6860 2022-02-02T14:17:26.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.846+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba28007ba0 con 0x7fba400f6860 2022-02-02T14:17:26.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.846+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba2801c3c0 con 0x7fba400f6860 2022-02-02T14:17:26.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.846+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba40107350 con 0x7fba400f6860 2022-02-02T14:17:26.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.846+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401078b0 con 0x7fba400f6860 2022-02-02T14:17:26.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.847+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba400f49b0 con 0x7fba400f6860 2022-02-02T14:17:26.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.847+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba2801d420 con 0x7fba400f6860 2022-02-02T14:17:26.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.848+0000 7fba36ffd700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 0x7fba2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:26.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.848+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fba28083680 con 0x7fba400f6860 2022-02-02T14:17:26.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.848+0000 7fba3e59c700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 0x7fba2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:26.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.848+0000 7fba3e59c700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 0x7fba2c067290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fba40105ba0 tx=0x7fba3000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:26.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:26.852+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba28051730 con 0x7fba400f6860 2022-02-02T14:17:27.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.041+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fba400fde70 con 0x7fba2c064dd0 2022-02-02T14:17:27.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.042+0000 7fba36ffd700 1 -- 172.21.15.33:0/671042354 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fba400fde70 con 0x7fba2c064dd0 2022-02-02T14:17:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 msgr2=0x7fba2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 0x7fba2c067290 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fba40105ba0 tx=0x7fba3000b040).stop 2022-02-02T14:17:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 msgr2=0x7fba40106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fba28009990 tx=0x7fba28009b30).stop 2022-02-02T14:17:27.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 shutdown_connections 2022-02-02T14:17:27.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fba2c064dd0 0x7fba2c067290 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba400f55c0 0x7fba40105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 --2- 172.21.15.33:0/671042354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba400f6860 0x7fba40106320 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 >> 172.21.15.33:0/671042354 conn(0x7fba400f0d40 msgr2=0x7fba400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 shutdown_connections 2022-02-02T14:17:27.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.044+0000 7fba44bb6700 1 -- 172.21.15.33:0/671042354 wait complete. 2022-02-02T14:17:27.053 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:17:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 -- 172.21.15.33:0/3273224701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 msgr2=0x7fd7600f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 --2- 172.21.15.33:0/3273224701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f5df0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fd750004660 tx=0x7fd750009b30).stop 2022-02-02T14:17:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 -- 172.21.15.33:0/3273224701 shutdown_connections 2022-02-02T14:17:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 --2- 172.21.15.33:0/3273224701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f5df0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 --2- 172.21.15.33:0/3273224701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 0x7fd7600f7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 -- 172.21.15.33:0/3273224701 >> 172.21.15.33:0/3273224701 conn(0x7fd7600f04c0 msgr2=0x7fd7600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 -- 172.21.15.33:0/3273224701 shutdown_connections 2022-02-02T14:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.145+0000 7fd76834d700 1 -- 172.21.15.33:0/3273224701 wait complete. 2022-02-02T14:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 Processor -- start 2022-02-02T14:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 -- start start 2022-02-02T14:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 0x7fd7600f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600f82b0 con 0x7fd7600f5970 2022-02-02T14:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd76834d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600f83f0 con 0x7fd7600f6c60 2022-02-02T14:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60442/0 (socket says 172.21.15.33:60442) 2022-02-02T14:17:27.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 -- 172.21.15.33:0/1505788164 learned_addr learned my addr 172.21.15.33:0/1505788164 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:27.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7658e8700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 0x7fd7600f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 -- 172.21.15.33:0/1505788164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 msgr2=0x7fd7600f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 0x7fd7600f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.146+0000 7fd7660e9700 1 -- 172.21.15.33:0/1505788164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750005040 con 0x7fd7600f5970 2022-02-02T14:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd7660e9700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fd75c00b410 tx=0x7fd75c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd75c0125f0 con 0x7fd7600f5970 2022-02-02T14:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd75c012c00 con 0x7fd7600f5970 2022-02-02T14:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7600f86d0 con 0x7fd7600f5970 2022-02-02T14:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd75c002ae0 con 0x7fd7600f5970 2022-02-02T14:17:27.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.147+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd76010f010 con 0x7fd7600f5970 2022-02-02T14:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.148+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd760045ad0 con 0x7fd7600f5970 2022-02-02T14:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.148+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd75c00f030 con 0x7fd7600f5970 2022-02-02T14:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.149+0000 7fd756ffd700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 0x7fd74c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.149+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd75c081ef0 con 0x7fd7600f5970 2022-02-02T14:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.149+0000 7fd7658e8700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 0x7fd74c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.149+0000 7fd7658e8700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 0x7fd74c067270 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd750004630 tx=0x7fd750009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.153+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd75c04ffa0 con 0x7fd7600f5970 2022-02-02T14:17:27.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.336+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7600fadc0 con 0x7fd74c064db0 2022-02-02T14:17:27.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.351+0000 7fd756ffd700 1 -- 172.21.15.33:0/1505788164 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd7600fadc0 con 0x7fd74c064db0 2022-02-02T14:17:27.487 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:17:27.487 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (42m) 4m ago 43m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:17:27.487 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (35m) 4m ago 43m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:17:27.488 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (35m) 4m ago 43m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:17:27.488 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (42m) 4m ago 43m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:17:27.488 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (36m) 4m ago 39m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:17:27.488 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (36m) 4m ago 39m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:17:27.489 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (37m) 4m ago 39m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:17:27.489 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (39m) 4m ago 39m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:17:27.489 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (37m) 4m ago 45m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:17:27.489 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (36m) 4m ago 43m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:17:27.490 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (36m) 4m ago 45m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:17:27.490 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (36m) 4m ago 43m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:17:27.491 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (43m) 4m ago 43m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:17:27.491 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (42m) 4m ago 42m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:17:27.491 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 4m ago 42m - 4096M 2022-02-02T14:17:27.491 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (42m) 4m ago 42m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:17:27.491 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (41m) 4m ago 41m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:17:27.492 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (41m) 4m ago 41m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:17:27.492 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (41m) 4m ago 41m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:17:27.492 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (41m) 4m ago 41m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:17:27.492 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (42m) 4m ago 43m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:17:27.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 msgr2=0x7fd74c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 0x7fd74c067270 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fd750004630 tx=0x7fd750009b30).stop 2022-02-02T14:17:27.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 msgr2=0x7fd7600f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7fd75c00b410 tx=0x7fd75c006ef0).stop 2022-02-02T14:17:27.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 shutdown_connections 2022-02-02T14:17:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd74c064db0 0x7fd74c067270 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7600f5970 0x7fd7600f9840 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 --2- 172.21.15.33:0/1505788164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7600f6c60 0x7fd7600f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 >> 172.21.15.33:0/1505788164 conn(0x7fd7600f04c0 msgr2=0x7fd7600f5040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 shutdown_connections 2022-02-02T14:17:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.353+0000 7fd76834d700 1 -- 172.21.15.33:0/1505788164 wait complete. 2022-02-02T14:17:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 -- 172.21.15.33:0/2509384660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 msgr2=0x7f51880fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 --2- 172.21.15.33:0/2509384660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f51880fbc70 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f517c004660 tx=0x7f517c009b30).stop 2022-02-02T14:17:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 -- 172.21.15.33:0/2509384660 shutdown_connections 2022-02-02T14:17:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 --2- 172.21.15.33:0/2509384660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f51880fbc70 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 --2- 172.21.15.33:0/2509384660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 0x7f51880f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 -- 172.21.15.33:0/2509384660 >> 172.21.15.33:0/2509384660 conn(0x7f51880f0d40 msgr2=0x7f51880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 -- 172.21.15.33:0/2509384660 shutdown_connections 2022-02-02T14:17:27.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.457+0000 7f518e84b700 1 -- 172.21.15.33:0/2509384660 wait complete. 2022-02-02T14:17:27.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 Processor -- start 2022-02-02T14:17:27.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 -- start start 2022-02-02T14:17:27.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 0x7f5188109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5188109be0 con 0x7f51880f9820 2022-02-02T14:17:27.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.458+0000 7f518e84b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5188109d20 con 0x7f5188060310 2022-02-02T14:17:27.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60454/0 (socket says 172.21.15.33:60454) 2022-02-02T14:17:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 -- 172.21.15.33:0/2713899529 learned_addr learned my addr 172.21.15.33:0/2713899529 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f5187fff700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 0x7f5188109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 -- 172.21.15.33:0/2713899529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 msgr2=0x7f5188109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 0x7f5188109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 -- 172.21.15.33:0/2713899529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c005040 con 0x7f51880f9820 2022-02-02T14:17:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f51877fe700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f517c004f60 tx=0x7f517c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f517c018070 con 0x7f51880f9820 2022-02-02T14:17:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.459+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f517c009770 con 0x7f51880f9820 2022-02-02T14:17:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.460+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518810a660 con 0x7f51880f9820 2022-02-02T14:17:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.460+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f517c01c3c0 con 0x7f51880f9820 2022-02-02T14:17:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.460+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518810abc0 con 0x7f51880f9820 2022-02-02T14:17:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.460+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5188045ad0 con 0x7f51880f9820 2022-02-02T14:17:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.461+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f517c01d420 con 0x7f51880f9820 2022-02-02T14:17:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.461+0000 7f5184ff9700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 0x7f5170067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.462+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f517c083810 con 0x7f51880f9820 2022-02-02T14:17:27.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.462+0000 7f5187fff700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 0x7f5170067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.462+0000 7f5187fff700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 0x7f5170067290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5178007fd0 tx=0x7f5178009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.466+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f517c0552f0 con 0x7f51880f9820 2022-02-02T14:17:27.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.715+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5188027a00 con 0x7f51880f9820 2022-02-02T14:17:27.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.715+0000 7f5184ff9700 1 -- 172.21.15.33:0/2713899529 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f517c054ee0 con 0x7f51880f9820 2022-02-02T14:17:27.716 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:17:27.716 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:17:27.716 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:17:27.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:27.717 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:17:27.717 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:17:27.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:27.717 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:17:27.718 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:17:27.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:27.718 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:17:27.718 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:17:27.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:27.719 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:17:27.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:17:27.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:17:27.720 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:17:27.720 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:17:27.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 msgr2=0x7f5170067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 0x7f5170067290 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5178007fd0 tx=0x7f5178009040).stop 2022-02-02T14:17:27.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 msgr2=0x7f5188109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f517c004f60 tx=0x7f517c009b30).stop 2022-02-02T14:17:27.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 shutdown_connections 2022-02-02T14:17:27.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5170064dd0 0x7f5170067290 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5188060310 0x7f5188109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 --2- 172.21.15.33:0/2713899529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51880f9820 0x7f5188109630 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 >> 172.21.15.33:0/2713899529 conn(0x7f51880f0d40 msgr2=0x7f51880f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 shutdown_connections 2022-02-02T14:17:27.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.718+0000 7f518e84b700 1 -- 172.21.15.33:0/2713899529 wait complete. 2022-02-02T14:17:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- 172.21.15.33:0/1593962546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f55c0 msgr2=0x7f1ac00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/1593962546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f55c0 0x7f1ac00f59e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f1abc004660 tx=0x7f1abc009b30).stop 2022-02-02T14:17:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- 172.21.15.33:0/1593962546 shutdown_connections 2022-02-02T14:17:27.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/1593962546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f6860 0x7f1ac00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/1593962546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f55c0 0x7f1ac00f59e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- 172.21.15.33:0/1593962546 >> 172.21.15.33:0/1593962546 conn(0x7f1ac00f0d40 msgr2=0x7f1ac00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- 172.21.15.33:0/1593962546 shutdown_connections 2022-02-02T14:17:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- 172.21.15.33:0/1593962546 wait complete. 2022-02-02T14:17:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 Processor -- start 2022-02-02T14:17:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.820+0000 7f1ac7e66700 1 -- start start 2022-02-02T14:17:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac7e66700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f55c0 0x7f1ac0105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac7e66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac7e66700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac01069a0 con 0x7f1ac00f6860 2022-02-02T14:17:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac7e66700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac01071b0 con 0x7f1ac00f55c0 2022-02-02T14:17:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5c02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f55c0 0x7f1ac0105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60464/0 (socket says 172.21.15.33:60464) 2022-02-02T14:17:27.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 -- 172.21.15.33:0/2092259561 learned_addr learned my addr 172.21.15.33:0/2092259561 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:27.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 -- 172.21.15.33:0/2092259561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f55c0 msgr2=0x7f1ac0105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:27.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f55c0 0x7f1ac0105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 -- 172.21.15.33:0/2092259561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc005040 con 0x7f1ac00f6860 2022-02-02T14:17:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ac5401700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f1ab00026d0 tx=0x7f1ab0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.821+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab00079c0 con 0x7f1ac00f6860 2022-02-02T14:17:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.822+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac0107430 con 0x7f1ac00f6860 2022-02-02T14:17:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.822+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ab000f040 con 0x7f1ac00f6860 2022-02-02T14:17:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.822+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab00148b0 con 0x7f1ac00f6860 2022-02-02T14:17:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.822+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac01079f0 con 0x7f1ac00f6860 2022-02-02T14:17:27.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.823+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac00f49b0 con 0x7f1ac00f6860 2022-02-02T14:17:27.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.823+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ab0007b20 con 0x7f1ac00f6860 2022-02-02T14:17:27.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.823+0000 7f1ab67fc700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 0x7f1aac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:27.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.824+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1ab0081a30 con 0x7f1ac00f6860 2022-02-02T14:17:27.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.824+0000 7f1ac5c02700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 0x7f1aac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:27.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.824+0000 7f1ac5c02700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 0x7f1aac067290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1abc013690 tx=0x7f1abc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:27.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:27.828+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ab004fae0 con 0x7f1ac00f6860 2022-02-02T14:17:28.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.044+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1ac00fdf10 con 0x7f1ac00f6860 2022-02-02T14:17:28.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.044+0000 7f1ab67fc700 1 -- 172.21.15.33:0/2092259561 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1ac00fdf10 con 0x7f1ac00f6860 2022-02-02T14:17:28.044 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:17:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:17:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:17:28.045 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:17:28.045 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:17:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:17:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:17:28.046 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:17:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:17:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:17:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:17:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:17:28.047 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:17:28.048 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:17:28.048 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:17:28.048 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:17:28.048 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:17:28.049 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:17:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:17:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:17:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:17:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:17:28.051 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:17:28.051 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:17:28.051 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:17:28.051 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:17:28.052 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:17:28.052 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:17:28.052 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:17:28.052 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:17:28.053 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:28.053 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:28.053 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:17:28.053 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:28.054 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:28.054 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:28.054 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:28.054 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:28.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 msgr2=0x7f1aac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 0x7f1aac067290 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f1abc013690 tx=0x7f1abc009b30).stop 2022-02-02T14:17:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 msgr2=0x7f1ac01063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f1ab00026d0 tx=0x7f1ab0009de0).stop 2022-02-02T14:17:28.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 shutdown_connections 2022-02-02T14:17:28.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1aac064dd0 0x7f1aac067290 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:28.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac00f55c0 0x7f1ac0105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:28.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 --2- 172.21.15.33:0/2092259561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac00f6860 0x7f1ac01063a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:28.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 >> 172.21.15.33:0/2092259561 conn(0x7f1ac00f0d40 msgr2=0x7f1ac00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:28.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 shutdown_connections 2022-02-02T14:17:28.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:28.046+0000 7f1ac7e66700 1 -- 172.21.15.33:0/2092259561 wait complete. 2022-02-02T14:17:28.058 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:17:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:28 smithi033 ceph-mon[101165]: pgmap v1162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:28 smithi033 ceph-mon[101165]: from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:17:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2713899529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:17:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2092259561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:17:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:28 smithi037 ceph-mon[69017]: pgmap v1162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:28 smithi037 ceph-mon[69017]: from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:17:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2713899529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:17:28.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2092259561' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:17:29.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:29 smithi033 ceph-mon[101165]: from='client.35274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:17:29.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:29 smithi037 ceph-mon[69017]: from='client.35274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:17:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:30 smithi033 ceph-mon[101165]: pgmap v1163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:30.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:30 smithi037 ceph-mon[69017]: pgmap v1163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:32 smithi033 ceph-mon[101165]: pgmap v1164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:32 smithi037 ceph-mon[69017]: pgmap v1164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:34 smithi033 ceph-mon[101165]: pgmap v1165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:34 smithi037 ceph-mon[69017]: pgmap v1165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:36 smithi033 ceph-mon[101165]: pgmap v1166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:36 smithi037 ceph-mon[69017]: pgmap v1166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:38 smithi033 ceph-mon[101165]: pgmap v1167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:38 smithi037 ceph-mon[69017]: pgmap v1167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:40 smithi033 ceph-mon[101165]: pgmap v1168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:40 smithi037 ceph-mon[69017]: pgmap v1168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:42 smithi033 ceph-mon[101165]: pgmap v1169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:42 smithi037 ceph-mon[69017]: pgmap v1169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:44 smithi033 ceph-mon[101165]: pgmap v1170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:44 smithi037 ceph-mon[69017]: pgmap v1170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:46.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:46 smithi033 ceph-mon[101165]: pgmap v1171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:46 smithi037 ceph-mon[69017]: pgmap v1171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:48.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:48 smithi033 ceph-mon[101165]: pgmap v1172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:48 smithi037 ceph-mon[69017]: pgmap v1172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:50 smithi033 ceph-mon[101165]: pgmap v1173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:50 smithi037 ceph-mon[69017]: pgmap v1173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:52 smithi033 ceph-mon[101165]: pgmap v1174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:52 smithi037 ceph-mon[69017]: pgmap v1174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:54 smithi033 ceph-mon[101165]: pgmap v1175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:54 smithi037 ceph-mon[69017]: pgmap v1175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:17:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:17:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:17:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:17:56.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:56 smithi033 ceph-mon[101165]: pgmap v1176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:56 smithi037 ceph-mon[69017]: pgmap v1176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 -- 172.21.15.33:0/3415499272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f5430 msgr2=0x7fa6d80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3415499272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f5430 0x7fa6d80f5850 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fa6d4004660 tx=0x7fa6d4009b30).stop 2022-02-02T14:17:58.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 -- 172.21.15.33:0/3415499272 shutdown_connections 2022-02-02T14:17:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3415499272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f66d0 0x7fa6d80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3415499272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f5430 0x7fa6d80f5850 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 -- 172.21.15.33:0/3415499272 >> 172.21.15.33:0/3415499272 conn(0x7fa6d80f0b90 msgr2=0x7fa6d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:58.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 -- 172.21.15.33:0/3415499272 shutdown_connections 2022-02-02T14:17:58.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.161+0000 7fa6de51e700 1 -- 172.21.15.33:0/3415499272 wait complete. 2022-02-02T14:17:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 Processor -- start 2022-02-02T14:17:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 -- start start 2022-02-02T14:17:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f5430 0x7fa6d8109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d80603c0 con 0x7fa6d80f66d0 2022-02-02T14:17:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6de51e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d8060500 con 0x7fa6d80f5430 2022-02-02T14:17:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6dcd1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6dcd1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60474/0 (socket says 172.21.15.33:60474) 2022-02-02T14:17:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6dcd1b700 1 -- 172.21.15.33:0/3885222193 learned_addr learned my addr 172.21.15.33:0/3885222193 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.162+0000 7fa6dd51c700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f5430 0x7fa6d8109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6dcd1b700 1 -- 172.21.15.33:0/3885222193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f5430 msgr2=0x7fa6d8109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6dcd1b700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f5430 0x7fa6d8109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6dcd1b700 1 -- 172.21.15.33:0/3885222193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4005040 con 0x7fa6d80f66d0 2022-02-02T14:17:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6dcd1b700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fa6c800c790 tx=0x7fa6c8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c800e680 con 0x7fa6d80f66d0 2022-02-02T14:17:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa6c800ec90 con 0x7fa6d80f66d0 2022-02-02T14:17:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d810c560 con 0x7fa6d80f66d0 2022-02-02T14:17:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6c8013d60 con 0x7fa6d80f66d0 2022-02-02T14:17:58.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.163+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6d810caf0 con 0x7fa6d80f66d0 2022-02-02T14:17:58.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.164+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6d8059100 con 0x7fa6d80f66d0 2022-02-02T14:17:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.165+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa6c801a060 con 0x7fa6d80f66d0 2022-02-02T14:17:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.165+0000 7fa6cdffb700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 0x7fa6c40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.165+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa6c8081c00 con 0x7fa6d80f66d0 2022-02-02T14:17:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.165+0000 7fa6dd51c700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 0x7fa6c40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.166+0000 7fa6dd51c700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 0x7fa6c40672e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa6d4004e30 tx=0x7fa6d4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.170+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa6c8087020 con 0x7fa6d80f66d0 2022-02-02T14:17:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.360+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6d80fdd80 con 0x7fa6c4064e20 2022-02-02T14:17:58.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.361+0000 7fa6cdffb700 1 -- 172.21.15.33:0/3885222193 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa6d80fdd80 con 0x7fa6c4064e20 2022-02-02T14:17:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 msgr2=0x7fa6c40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 0x7fa6c40672e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fa6d4004e30 tx=0x7fa6d4009b30).stop 2022-02-02T14:17:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 msgr2=0x7fa6d810bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fa6c800c790 tx=0x7fa6c8007d70).stop 2022-02-02T14:17:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 shutdown_connections 2022-02-02T14:17:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa6c4064e20 0x7fa6c40672e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6d80f5430 0x7fa6d8109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 --2- 172.21.15.33:0/3885222193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6d80f66d0 0x7fa6d810bfb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 >> 172.21.15.33:0/3885222193 conn(0x7fa6d80f0b90 msgr2=0x7fa6d80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 shutdown_connections 2022-02-02T14:17:58.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.363+0000 7fa6de51e700 1 -- 172.21.15.33:0/3885222193 wait complete. 2022-02-02T14:17:58.373 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 -- 172.21.15.33:0/2527405685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f5460 msgr2=0x7f26000f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 --2- 172.21.15.33:0/2527405685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f5460 0x7f26000f5880 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f25f0004660 tx=0x7f25f0009b30).stop 2022-02-02T14:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 -- 172.21.15.33:0/2527405685 shutdown_connections 2022-02-02T14:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 --2- 172.21.15.33:0/2527405685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f6700 0x7f26000f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 --2- 172.21.15.33:0/2527405685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f5460 0x7f26000f5880 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.464+0000 7f26052fd700 1 -- 172.21.15.33:0/2527405685 >> 172.21.15.33:0/2527405685 conn(0x7f26000f0bc0 msgr2=0x7f26000f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:58.466 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:58 smithi033 ceph-mon[101165]: pgmap v1177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.465+0000 7f26052fd700 1 -- 172.21.15.33:0/2527405685 shutdown_connections 2022-02-02T14:17:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.465+0000 7f26052fd700 1 -- 172.21.15.33:0/2527405685 wait complete. 2022-02-02T14:17:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.465+0000 7f26052fd700 1 Processor -- start 2022-02-02T14:17:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.465+0000 7f26052fd700 1 -- start start 2022-02-02T14:17:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f26052fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f5460 0x7f260010be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f26052fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f26052fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000602b0 con 0x7f26000f6700 2022-02-02T14:17:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f26052fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26000603f0 con 0x7f26000f5460 2022-02-02T14:17:58.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25feffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f5460 0x7f260010be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60482/0 (socket says 172.21.15.33:60482) 2022-02-02T14:17:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 -- 172.21.15.33:0/3479621698 learned_addr learned my addr 172.21.15.33:0/3479621698 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:58.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 -- 172.21.15.33:0/3479621698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f5460 msgr2=0x7f260010be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f5460 0x7f260010be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 -- 172.21.15.33:0/3479621698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0005040 con 0x7f26000f6700 2022-02-02T14:17:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25fe7fc700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f25f4002700 tx=0x7f25f4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.466+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f4009320 con 0x7f26000f6700 2022-02-02T14:17:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.467+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260010e870 con 0x7f26000f6700 2022-02-02T14:17:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.467+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25f400f040 con 0x7f26000f6700 2022-02-02T14:17:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.467+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f4014870 con 0x7f26000f6700 2022-02-02T14:17:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.467+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260010ecf0 con 0x7f26000f6700 2022-02-02T14:17:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.468+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600045ad0 con 0x7f26000f6700 2022-02-02T14:17:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.468+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f25f4009480 con 0x7f26000f6700 2022-02-02T14:17:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.468+0000 7f25e77fe700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 0x7f25e80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.469+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f25f4081d40 con 0x7f26000f6700 2022-02-02T14:17:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.469+0000 7f25feffd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 0x7f25e80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.469+0000 7f25feffd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 0x7f25e80672e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f25f0013690 tx=0x7f25f0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.473+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f25f404fdf0 con 0x7f26000f6700 2022-02-02T14:17:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:58 smithi037 ceph-mon[69017]: pgmap v1177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:17:58.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.657+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2600057f10 con 0x7f25e8064e20 2022-02-02T14:17:58.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.671+0000 7f25e77fe700 1 -- 172.21.15.33:0/3479621698 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2600057f10 con 0x7f25e8064e20 2022-02-02T14:17:58.672 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:17:58.672 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (43m) 5m ago 44m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:17:58.672 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (36m) 5m ago 44m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:17:58.673 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (36m) 5m ago 43m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:17:58.673 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (43m) 5m ago 44m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:17:58.673 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (36m) 5m ago 40m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:17:58.673 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (37m) 5m ago 40m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:17:58.674 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (38m) 5m ago 40m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:17:58.674 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (40m) 5m ago 40m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:17:58.674 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (37m) 5m ago 45m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:17:58.674 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (37m) 5m ago 43m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:17:58.675 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (37m) 5m ago 45m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:17:58.675 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (36m) 5m ago 43m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:17:58.675 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (43m) 5m ago 43m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:17:58.676 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (43m) 5m ago 43m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:17:58.676 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 42m - 4096M 2022-02-02T14:17:58.676 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (42m) 5m ago 42m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:17:58.676 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (42m) 5m ago 42m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:17:58.677 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (42m) 5m ago 42m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:17:58.677 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (41m) 5m ago 41m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:17:58.677 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (41m) 5m ago 41m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:17:58.677 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (43m) 5m ago 43m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:17:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 msgr2=0x7f25e80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 0x7f25e80672e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f25f0013690 tx=0x7f25f0009b30).stop 2022-02-02T14:17:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 msgr2=0x7f260010e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f25f4002700 tx=0x7f25f4009e00).stop 2022-02-02T14:17:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 shutdown_connections 2022-02-02T14:17:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f25e8064e20 0x7f25e80672e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26000f5460 0x7f260010be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 --2- 172.21.15.33:0/3479621698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26000f6700 0x7f260010e380 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 >> 172.21.15.33:0/3479621698 conn(0x7f26000f0bc0 msgr2=0x7f26000fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.673+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 shutdown_connections 2022-02-02T14:17:58.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.674+0000 7f26052fd700 1 -- 172.21.15.33:0/3479621698 wait complete. 2022-02-02T14:17:58.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 -- 172.21.15.33:0/608764033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f66e0 msgr2=0x7f23f00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 --2- 172.21.15.33:0/608764033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f66e0 0x7f23f00f6b00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f23e0004660 tx=0x7f23e0009b30).stop 2022-02-02T14:17:58.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 -- 172.21.15.33:0/608764033 shutdown_connections 2022-02-02T14:17:58.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 --2- 172.21.15.33:0/608764033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f7980 0x7f23f00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 --2- 172.21.15.33:0/608764033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f66e0 0x7f23f00f6b00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 -- 172.21.15.33:0/608764033 >> 172.21.15.33:0/608764033 conn(0x7f23f00f1e40 msgr2=0x7f23f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:58.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 -- 172.21.15.33:0/608764033 shutdown_connections 2022-02-02T14:17:58.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.774+0000 7f23f69dc700 1 -- 172.21.15.33:0/608764033 wait complete. 2022-02-02T14:17:58.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 Processor -- start 2022-02-02T14:17:58.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 -- start start 2022-02-02T14:17:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f66e0 0x7f23f006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f006a380 con 0x7f23f00f7980 2022-02-02T14:17:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23f69dc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f006a4c0 con 0x7f23f00f66e0 2022-02-02T14:17:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60492/0 (socket says 172.21.15.33:60492) 2022-02-02T14:17:58.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.775+0000 7f23ef7fe700 1 -- 172.21.15.33:0/3735890596 learned_addr learned my addr 172.21.15.33:0/3735890596 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:58.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23effff700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f66e0 0x7f23f006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ef7fe700 1 -- 172.21.15.33:0/3735890596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f66e0 msgr2=0x7f23f006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:58.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ef7fe700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f66e0 0x7f23f006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:58.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ef7fe700 1 -- 172.21.15.33:0/3735890596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e0005040 con 0x7f23f00f7980 2022-02-02T14:17:58.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ef7fe700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f23e40026d0 tx=0x7f23e4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e4009320 con 0x7f23f00f7980 2022-02-02T14:17:58.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23e400f040 con 0x7f23f00f7980 2022-02-02T14:17:58.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f006a7a0 con 0x7f23f00f7980 2022-02-02T14:17:58.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23e40147e0 con 0x7f23f00f7980 2022-02-02T14:17:58.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.776+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f010efa0 con 0x7f23f00f7980 2022-02-02T14:17:58.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.777+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f0045ad0 con 0x7f23f00f7980 2022-02-02T14:17:58.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.778+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f23e4009480 con 0x7f23f00f7980 2022-02-02T14:17:58.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.778+0000 7f23ecff9700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 0x7f23d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:58.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.778+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f23e40820c0 con 0x7f23f00f7980 2022-02-02T14:17:58.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.778+0000 7f23effff700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 0x7f23d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:58.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.779+0000 7f23effff700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 0x7f23d8067290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f23e0004e30 tx=0x7f23e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:58.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:58.782+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f23e4050170 con 0x7f23f00f7980 2022-02-02T14:17:59.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.024+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f23f0027a00 con 0x7f23f00f7980 2022-02-02T14:17:59.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.025+0000 7f23ecff9700 1 -- 172.21.15.33:0/3735890596 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f23e4053790 con 0x7f23f00f7980 2022-02-02T14:17:59.025 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:17:59.025 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:17:59.025 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:17:59.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:59.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:17:59.026 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:17:59.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:59.026 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:17:59.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:17:59.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:59.027 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:17:59.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:17:59.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:17:59.028 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:17:59.028 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:17:59.028 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:17:59.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:17:59.029 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:17:59.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.026+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 msgr2=0x7f23d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.026+0000 7f23f69dc700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 0x7f23d8067290 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f23e0004e30 tx=0x7f23e0009b30).stop 2022-02-02T14:17:59.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.026+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 msgr2=0x7f23f0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.026+0000 7f23f69dc700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f23e40026d0 tx=0x7f23e4009de0).stop 2022-02-02T14:17:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 shutdown_connections 2022-02-02T14:17:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23d8064dd0 0x7f23d8067290 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00f66e0 0x7f23f006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 --2- 172.21.15.33:0/3735890596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23f00f7980 0x7f23f0069e20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 >> 172.21.15.33:0/3735890596 conn(0x7f23f00f1e40 msgr2=0x7f23f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 shutdown_connections 2022-02-02T14:17:59.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.027+0000 7f23f69dc700 1 -- 172.21.15.33:0/3735890596 wait complete. 2022-02-02T14:17:59.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- 172.21.15.33:0/3633336631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f6860 msgr2=0x7f52880f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3633336631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f6860 0x7f52880f6cc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f527c004660 tx=0x7f527c009b30).stop 2022-02-02T14:17:59.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- 172.21.15.33:0/3633336631 shutdown_connections 2022-02-02T14:17:59.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3633336631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f6860 0x7f52880f6cc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3633336631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f55c0 0x7f52880f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- 172.21.15.33:0/3633336631 >> 172.21.15.33:0/3633336631 conn(0x7f52880f0d40 msgr2=0x7f52880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:59.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- 172.21.15.33:0/3633336631 shutdown_connections 2022-02-02T14:17:59.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- 172.21.15.33:0/3633336631 wait complete. 2022-02-02T14:17:59.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 Processor -- start 2022-02-02T14:17:59.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.128+0000 7f528cb5e700 1 -- start start 2022-02-02T14:17:59.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:59.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f6860 0x7f52881063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:59.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52881069b0 con 0x7f52880f55c0 2022-02-02T14:17:59.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52881071c0 con 0x7f52880f6860 2022-02-02T14:17:59.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:59.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60500/0 (socket says 172.21.15.33:60500) 2022-02-02T14:17:59.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 -- 172.21.15.33:0/3002424832 learned_addr learned my addr 172.21.15.33:0/3002424832 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:17:59.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f5285d9b700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f6860 0x7f52881063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:59.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 -- 172.21.15.33:0/3002424832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f6860 msgr2=0x7f52881063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f6860 0x7f52881063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 -- 172.21.15.33:0/3002424832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c005040 con 0x7f52880f55c0 2022-02-02T14:17:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528659c700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f5278002700 tx=0x7f5278009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5278009320 con 0x7f52880f55c0 2022-02-02T14:17:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f527800f040 con 0x7f52880f55c0 2022-02-02T14:17:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5288107440 con 0x7f52880f55c0 2022-02-02T14:17:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5278014900 con 0x7f52880f55c0 2022-02-02T14:17:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.129+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5288107a00 con 0x7f52880f55c0 2022-02-02T14:17:59.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.130+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52880f49b0 con 0x7f52880f55c0 2022-02-02T14:17:59.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.131+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5278009480 con 0x7f52880f55c0 2022-02-02T14:17:59.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.132+0000 7f5276ffd700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 0x7f5270067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:17:59.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.132+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f52780820c0 con 0x7f52880f55c0 2022-02-02T14:17:59.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.132+0000 7f5285d9b700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 0x7f5270067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:17:59.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.132+0000 7f5285d9b700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 0x7f5270067290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f527c004630 tx=0x7f527c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:17:59.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.135+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52780501a0 con 0x7f52880f55c0 2022-02-02T14:17:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.347+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5288027a00 con 0x7f52880f55c0 2022-02-02T14:17:59.349 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:17:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3735890596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:17:59.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.347+0000 7f5276ffd700 1 -- 172.21.15.33:0/3002424832 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f52780537c0 con 0x7f52880f55c0 2022-02-02T14:17:59.351 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:17:59.351 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:17:59.351 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:17:59.352 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:17:59.352 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:59.352 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:17:59.352 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:17:59.352 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:17:59.354 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:17:59.354 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:17:59.354 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:17:59.354 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:17:59.355 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:17:59.355 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:17:59.355 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:17:59.355 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:17:59.356 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:17:59.356 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:17:59.356 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:17:59.356 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:17:59.356 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:17:59.357 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:17:59.357 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:17:59.357 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:17:59.357 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:17:59.358 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:17:59.358 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:17:59.358 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:17:59.359 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:17:59.359 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:17:59.359 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:17:59.359 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:59.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:59.360 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:17:59.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:17:59.361 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:59.361 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:59.361 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:59.362 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:17:59.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.349+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 msgr2=0x7f5270067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.349+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 0x7f5270067290 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f527c004630 tx=0x7f527c009b30).stop 2022-02-02T14:17:59.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.349+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 msgr2=0x7f5288105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:17:59.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.349+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f5278002700 tx=0x7f5278009d80).stop 2022-02-02T14:17:59.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 shutdown_connections 2022-02-02T14:17:59.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5270064dd0 0x7f5270067290 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52880f55c0 0x7f5288105ec0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 --2- 172.21.15.33:0/3002424832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52880f6860 0x7f52881063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:17:59.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 >> 172.21.15.33:0/3002424832 conn(0x7f52880f0d40 msgr2=0x7f52880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:17:59.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 shutdown_connections 2022-02-02T14:17:59.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:17:59.350+0000 7f528cb5e700 1 -- 172.21.15.33:0/3002424832 wait complete. 2022-02-02T14:17:59.366 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:17:59.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:17:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3735890596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:18:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:00 smithi033 ceph-mon[101165]: from='client.35286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:00 smithi033 ceph-mon[101165]: from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:00 smithi033 ceph-mon[101165]: pgmap v1178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:00.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:00 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3002424832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:18:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:00 smithi037 ceph-mon[69017]: from='client.35286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:00 smithi037 ceph-mon[69017]: from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:00 smithi037 ceph-mon[69017]: pgmap v1178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:00 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3002424832' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:18:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:02 smithi033 ceph-mon[101165]: pgmap v1179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:02 smithi037 ceph-mon[69017]: pgmap v1179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:04 smithi033 ceph-mon[101165]: pgmap v1180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:04 smithi037 ceph-mon[69017]: pgmap v1180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:06 smithi033 ceph-mon[101165]: pgmap v1181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:06 smithi037 ceph-mon[69017]: pgmap v1181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:08 smithi033 ceph-mon[101165]: pgmap v1182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:08 smithi037 ceph-mon[69017]: pgmap v1182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:10 smithi033 ceph-mon[101165]: pgmap v1183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:10 smithi037 ceph-mon[69017]: pgmap v1183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:12 smithi037 ceph-mon[69017]: pgmap v1184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:12 smithi033 ceph-mon[101165]: pgmap v1184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:14 smithi037 ceph-mon[69017]: pgmap v1185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:14 smithi033 ceph-mon[101165]: pgmap v1185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:15.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:15 smithi033 ceph-mon[101165]: pgmap v1186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:15.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:15 smithi037 ceph-mon[69017]: pgmap v1186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:18 smithi033 ceph-mon[101165]: pgmap v1187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:18 smithi037 ceph-mon[69017]: pgmap v1187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:20 smithi033 ceph-mon[101165]: pgmap v1188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:20 smithi037 ceph-mon[69017]: pgmap v1188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:22 smithi033 ceph-mon[101165]: pgmap v1189: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:22 smithi037 ceph-mon[69017]: pgmap v1189: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:24 smithi033 ceph-mon[101165]: pgmap v1190: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:24 smithi037 ceph-mon[69017]: pgmap v1190: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:26 smithi033 ceph-mon[101165]: pgmap v1191: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:26.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:26 smithi037 ceph-mon[69017]: pgmap v1191: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:28 smithi033 ceph-mon[101165]: pgmap v1192: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:28 smithi037 ceph-mon[69017]: pgmap v1192: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:29.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 -- 172.21.15.33:0/1503664017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f55c0 msgr2=0x7fa7900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1503664017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f55c0 0x7fa7900f59e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fa778004660 tx=0x7fa778009b30).stop 2022-02-02T14:18:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 -- 172.21.15.33:0/1503664017 shutdown_connections 2022-02-02T14:18:29.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1503664017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f6860 0x7fa7900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1503664017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f55c0 0x7fa7900f59e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 -- 172.21.15.33:0/1503664017 >> 172.21.15.33:0/1503664017 conn(0x7fa7900f0d40 msgr2=0x7fa7900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 -- 172.21.15.33:0/1503664017 shutdown_connections 2022-02-02T14:18:29.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.465+0000 7fa7951c7700 1 -- 172.21.15.33:0/1503664017 wait complete. 2022-02-02T14:18:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 Processor -- start 2022-02-02T14:18:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 -- start start 2022-02-02T14:18:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f55c0 0x7fa790109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa790109c00 con 0x7fa7900f6860 2022-02-02T14:18:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa7951c7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa790109d40 con 0x7fa7900f55c0 2022-02-02T14:18:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78ed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f55c0 0x7fa790109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60512/0 (socket says 172.21.15.33:60512) 2022-02-02T14:18:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 -- 172.21.15.33:0/1608735120 learned_addr learned my addr 172.21.15.33:0/1608735120 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:18:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 -- 172.21.15.33:0/1608735120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f55c0 msgr2=0x7fa790109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f55c0 0x7fa790109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.466+0000 7fa78e59c700 1 -- 172.21.15.33:0/1608735120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa778005040 con 0x7fa7900f6860 2022-02-02T14:18:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa78e59c700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fa78000c790 tx=0x7fa780007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa780002590 con 0x7fa7900f6860 2022-02-02T14:18:29.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa780002ba0 con 0x7fa7900f6860 2022-02-02T14:18:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79010a6e0 con 0x7fa7900f6860 2022-02-02T14:18:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa780013d90 con 0x7fa7900f6860 2022-02-02T14:18:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.467+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79010aca0 con 0x7fa7900f6860 2022-02-02T14:18:29.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.468+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa790045ad0 con 0x7fa7900f6860 2022-02-02T14:18:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.468+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa78001a060 con 0x7fa7900f6860 2022-02-02T14:18:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.469+0000 7fa7877fe700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 0x7fa77c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.469+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa780081d10 con 0x7fa7900f6860 2022-02-02T14:18:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.469+0000 7fa78ed9d700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 0x7fa77c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.469+0000 7fa78ed9d700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 0x7fa77c067290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa778004630 tx=0x7fa778009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:29.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.473+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa780053790 con 0x7fa7900f6860 2022-02-02T14:18:29.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.661+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7900faaa0 con 0x7fa77c064dd0 2022-02-02T14:18:29.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.663+0000 7fa7877fe700 1 -- 172.21.15.33:0/1608735120 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa7900faaa0 con 0x7fa77c064dd0 2022-02-02T14:18:29.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.664+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 msgr2=0x7fa77c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.664+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 0x7fa77c067290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa778004630 tx=0x7fa778009b30).stop 2022-02-02T14:18:29.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.664+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 msgr2=0x7fa790109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.664+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fa78000c790 tx=0x7fa780007d70).stop 2022-02-02T14:18:29.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 shutdown_connections 2022-02-02T14:18:29.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa77c064dd0 0x7fa77c067290 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7900f55c0 0x7fa790109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 --2- 172.21.15.33:0/1608735120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7900f6860 0x7fa790109650 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 >> 172.21.15.33:0/1608735120 conn(0x7fa7900f0d40 msgr2=0x7fa79005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:29.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 shutdown_connections 2022-02-02T14:18:29.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.665+0000 7fa7951c7700 1 -- 172.21.15.33:0/1608735120 wait complete. 2022-02-02T14:18:29.674 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:18:29.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 -- 172.21.15.33:0/1524588632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 msgr2=0x7fec400fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 --2- 172.21.15.33:0/1524588632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400fbae0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fec34004660 tx=0x7fec34009b30).stop 2022-02-02T14:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 -- 172.21.15.33:0/1524588632 shutdown_connections 2022-02-02T14:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 --2- 172.21.15.33:0/1524588632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400fbae0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 --2- 172.21.15.33:0/1524588632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 0x7fec400f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 -- 172.21.15.33:0/1524588632 >> 172.21.15.33:0/1524588632 conn(0x7fec400f0b90 msgr2=0x7fec400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 -- 172.21.15.33:0/1524588632 shutdown_connections 2022-02-02T14:18:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.766+0000 7fec454c3700 1 -- 172.21.15.33:0/1524588632 wait complete. 2022-02-02T14:18:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 Processor -- start 2022-02-02T14:18:29.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 -- start start 2022-02-02T14:18:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 0x7fec400f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec400f5570 con 0x7fec400f9690 2022-02-02T14:18:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec454c3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec400f56b0 con 0x7fec40060310 2022-02-02T14:18:29.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec3f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec3f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60522/0 (socket says 172.21.15.33:60522) 2022-02-02T14:18:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec3f7fe700 1 -- 172.21.15.33:0/2010634340 learned_addr learned my addr 172.21.15.33:0/2010634340 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:18:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.767+0000 7fec3ffff700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 0x7fec400f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3f7fe700 1 -- 172.21.15.33:0/2010634340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 msgr2=0x7fec400f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3f7fe700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 0x7fec400f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3f7fe700 1 -- 172.21.15.33:0/2010634340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34005040 con 0x7fec400f9690 2022-02-02T14:18:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3f7fe700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fec34004f60 tx=0x7fec34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec34018070 con 0x7fec400f9690 2022-02-02T14:18:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec400f5930 con 0x7fec400f9690 2022-02-02T14:18:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec34009770 con 0x7fec400f9690 2022-02-02T14:18:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec3401c3c0 con 0x7fec400f9690 2022-02-02T14:18:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.768+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec400f5e90 con 0x7fec400f9690 2022-02-02T14:18:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.769+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec40045ad0 con 0x7fec400f9690 2022-02-02T14:18:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.770+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec3401d420 con 0x7fec400f9690 2022-02-02T14:18:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.770+0000 7fec3cff9700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.770+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fec340838d0 con 0x7fec400f9690 2022-02-02T14:18:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.770+0000 7fec3ffff700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:29.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.771+0000 7fec3ffff700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fec300041d0 tx=0x7fec30009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:29.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.774+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec34051a40 con 0x7fec400f9690 2022-02-02T14:18:29.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.956+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec400fee30 con 0x7fec28064e20 2022-02-02T14:18:29.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.971+0000 7fec3cff9700 1 -- 172.21.15.33:0/2010634340 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fec400fee30 con 0x7fec28064e20 2022-02-02T14:18:29.971 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:18:29.971 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (43m) 5m ago 44m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:18:29.972 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (36m) 5m ago 44m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:18:29.972 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (36m) 5m ago 44m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:18:29.972 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (43m) 5m ago 44m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:18:29.972 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (37m) 5m ago 40m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:18:29.972 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (37m) 5m ago 40m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:18:29.973 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (38m) 5m ago 41m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:18:29.973 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (40m) 5m ago 40m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:18:29.973 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (38m) 5m ago 46m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:18:29.973 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (37m) 5m ago 44m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:18:29.974 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (37m) 5m ago 46m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:18:29.974 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (37m) 5m ago 44m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:18:29.974 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (44m) 5m ago 44m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:18:29.974 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (44m) 5m ago 44m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:18:29.974 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 5m ago 43m - 4096M 2022-02-02T14:18:29.975 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (43m) 5m ago 43m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:18:29.975 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (42m) 5m ago 42m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:18:29.975 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (42m) 5m ago 42m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:18:29.975 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (42m) 5m ago 42m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:18:29.976 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (42m) 5m ago 42m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:18:29.976 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (43m) 5m ago 44m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:18:29.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 msgr2=0x7fec280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fec300041d0 tx=0x7fec30009040).stop 2022-02-02T14:18:29.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 msgr2=0x7fec400f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:29.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fec34004f60 tx=0x7fec34009b30).stop 2022-02-02T14:18:29.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 shutdown_connections 2022-02-02T14:18:29.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec28064e20 0x7fec280672e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec40060310 0x7fec400f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 --2- 172.21.15.33:0/2010634340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec400f9690 0x7fec400f5010 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:29.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 >> 172.21.15.33:0/2010634340 conn(0x7fec400f0b90 msgr2=0x7fec400f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:29.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 shutdown_connections 2022-02-02T14:18:29.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:29.973+0000 7fec454c3700 1 -- 172.21.15.33:0/2010634340 wait complete. 2022-02-02T14:18:30.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 -- 172.21.15.33:0/3962310192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f7980 msgr2=0x7f480c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 --2- 172.21.15.33:0/3962310192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f7980 0x7f480c0f7de0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4800004660 tx=0x7f4800009b30).stop 2022-02-02T14:18:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 -- 172.21.15.33:0/3962310192 shutdown_connections 2022-02-02T14:18:30.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 --2- 172.21.15.33:0/3962310192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f7980 0x7f480c0f7de0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 --2- 172.21.15.33:0/3962310192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f66e0 0x7f480c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.072+0000 7f4813f7f700 1 -- 172.21.15.33:0/3962310192 >> 172.21.15.33:0/3962310192 conn(0x7f480c0f1e40 msgr2=0x7f480c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.073+0000 7f4813f7f700 1 -- 172.21.15.33:0/3962310192 shutdown_connections 2022-02-02T14:18:30.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.073+0000 7f4813f7f700 1 -- 172.21.15.33:0/3962310192 wait complete. 2022-02-02T14:18:30.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.073+0000 7f4813f7f700 1 Processor -- start 2022-02-02T14:18:30.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.073+0000 7f4813f7f700 1 -- start start 2022-02-02T14:18:30.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4813f7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4813f7f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f7980 0x7f480c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4813f7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c107a00 con 0x7f480c0f66e0 2022-02-02T14:18:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4813f7f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c107b40 con 0x7f480c0f7980 2022-02-02T14:18:30.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60530/0 (socket says 172.21.15.33:60530) 2022-02-02T14:18:30.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 -- 172.21.15.33:0/1654449858 learned_addr learned my addr 172.21.15.33:0/1654449858 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:18:30.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f481151a700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f7980 0x7f480c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 -- 172.21.15.33:0/1654449858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f7980 msgr2=0x7f480c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f7980 0x7f480c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 -- 172.21.15.33:0/1654449858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800005040 con 0x7f480c0f66e0 2022-02-02T14:18:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4811d1b700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f480800c530 tx=0x7f4808007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:30.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f480800f650 con 0x7f480c0f66e0 2022-02-02T14:18:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f480800fc60 con 0x7f480c0f66e0 2022-02-02T14:18:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c1084e0 con 0x7f480c0f66e0 2022-02-02T14:18:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.074+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4808012cb0 con 0x7f480c0f66e0 2022-02-02T14:18:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.075+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c108aa0 con 0x7f480c0f66e0 2022-02-02T14:18:30.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.076+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c045ad0 con 0x7f480c0f66e0 2022-02-02T14:18:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.076+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4808019030 con 0x7f480c0f66e0 2022-02-02T14:18:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.077+0000 7f47fe7fc700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 0x7f47f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.077+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4808081650 con 0x7f480c0f66e0 2022-02-02T14:18:30.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.077+0000 7f481151a700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 0x7f47f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.077+0000 7f481151a700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 0x7f47f8067290 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4800004630 tx=0x7f4800009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:30.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.081+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f48080531e0 con 0x7f480c0f66e0 2022-02-02T14:18:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.323+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f480c0ff020 con 0x7f480c0f66e0 2022-02-02T14:18:30.324 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:30 smithi033 ceph-mon[101165]: pgmap v1193: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.324+0000 7f47fe7fc700 1 -- 172.21.15.33:0/1654449858 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f48080172d0 con 0x7f480c0f66e0 2022-02-02T14:18:30.324 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:18:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:18:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:18:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:18:30.325 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:18:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:18:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:18:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:18:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:18:30.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:18:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:18:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:18:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:18:30.327 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:18:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:18:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:18:30.328 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:18:30.328 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:18:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 msgr2=0x7f47f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 0x7f47f8067290 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f4800004630 tx=0x7f4800009b30).stop 2022-02-02T14:18:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 msgr2=0x7f480c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f480800c530 tx=0x7f4808007e10).stop 2022-02-02T14:18:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 shutdown_connections 2022-02-02T14:18:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47f8064dd0 0x7f47f8067290 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f480c0f66e0 0x7f480c106f60 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 --2- 172.21.15.33:0/1654449858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f480c0f7980 0x7f480c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 >> 172.21.15.33:0/1654449858 conn(0x7f480c0f1e40 msgr2=0x7f480c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 shutdown_connections 2022-02-02T14:18:30.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.326+0000 7f4813f7f700 1 -- 172.21.15.33:0/1654449858 wait complete. 2022-02-02T14:18:30.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- 172.21.15.33:0/629026303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 msgr2=0x7f13c00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 --2- 172.21.15.33:0/629026303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c00f7de0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f13bc004660 tx=0x7f13bc009b30).stop 2022-02-02T14:18:30.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- 172.21.15.33:0/629026303 shutdown_connections 2022-02-02T14:18:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 --2- 172.21.15.33:0/629026303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c00f7de0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 --2- 172.21.15.33:0/629026303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 0x7f13c00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- 172.21.15.33:0/629026303 >> 172.21.15.33:0/629026303 conn(0x7f13c00f1e40 msgr2=0x7f13c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- 172.21.15.33:0/629026303 shutdown_connections 2022-02-02T14:18:30.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- 172.21.15.33:0/629026303 wait complete. 2022-02-02T14:18:30.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 Processor -- start 2022-02-02T14:18:30.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- start start 2022-02-02T14:18:30.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 0x7f13c0109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0109c30 con 0x7f13c00f7980 2022-02-02T14:18:30.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.427+0000 7f13c82dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c0109d70 con 0x7f13c00f66e0 2022-02-02T14:18:30.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60542/0 (socket says 172.21.15.33:60542) 2022-02-02T14:18:30.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 -- 172.21.15.33:0/1174711567 learned_addr learned my addr 172.21.15.33:0/1174711567 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:18:30.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c6079700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 0x7f13c0109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 -- 172.21.15.33:0/1174711567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 msgr2=0x7f13c0109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 0x7f13c0109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 -- 172.21.15.33:0/1174711567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc005040 con 0x7f13c00f7980 2022-02-02T14:18:30.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c5878700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f13bc009990 tx=0x7f13bc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:30.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc018070 con 0x7f13c00f7980 2022-02-02T14:18:30.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13bc007ba0 con 0x7f13c00f7980 2022-02-02T14:18:30.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c010a6b0 con 0x7f13c00f7980 2022-02-02T14:18:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13bc01c3c0 con 0x7f13c00f7980 2022-02-02T14:18:30.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.428+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c010ac10 con 0x7f13c00f7980 2022-02-02T14:18:30.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.429+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c0045ad0 con 0x7f13c00f7980 2022-02-02T14:18:30.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.431+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f13bc01d420 con 0x7f13c00f7980 2022-02-02T14:18:30.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.431+0000 7f13b6ffd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 0x7f13ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:18:30.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.431+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f13bc083980 con 0x7f13c00f7980 2022-02-02T14:18:30.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.431+0000 7f13c6079700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 0x7f13ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:18:30.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.431+0000 7f13c6079700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 0x7f13ac067290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f13c00f77e0 tx=0x7f13b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:18:30.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.434+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13bc055460 con 0x7f13c00f7980 2022-02-02T14:18:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:30 smithi037 ceph-mon[69017]: pgmap v1193: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.647+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f13c0027a00 con 0x7f13c00f7980 2022-02-02T14:18:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.648+0000 7f13b6ffd700 1 -- 172.21.15.33:0/1174711567 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f13bc055050 con 0x7f13c00f7980 2022-02-02T14:18:30.648 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:18:30.648 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:18:30.648 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:18:30.649 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:18:30.649 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:18:30.649 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:18:30.649 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:18:30.650 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:18:30.650 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:18:30.650 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:18:30.650 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:18:30.650 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:18:30.651 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:18:30.651 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:18:30.651 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:18:30.651 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:18:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:18:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:18:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:18:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:18:30.652 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:18:30.653 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:18:30.653 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:18:30.653 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:18:30.653 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:18:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:18:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:18:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:18:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:18:30.654 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:18:30.655 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:18:30.655 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:18:30.655 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:18:30.655 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:18:30.656 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:18:30.656 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:18:30.656 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:18:30.656 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:18:30.656 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:18:30.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 msgr2=0x7f13ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 0x7f13ac067290 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f13c00f77e0 tx=0x7f13b000b040).stop 2022-02-02T14:18:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 msgr2=0x7f13c0109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:18:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f13bc009990 tx=0x7f13bc009b30).stop 2022-02-02T14:18:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 shutdown_connections 2022-02-02T14:18:30.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f13ac064dd0 0x7f13ac067290 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13c00f66e0 0x7f13c0109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 --2- 172.21.15.33:0/1174711567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13c00f7980 0x7f13c0109680 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:18:30.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 >> 172.21.15.33:0/1174711567 conn(0x7f13c00f1e40 msgr2=0x7f13c006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:18:30.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 shutdown_connections 2022-02-02T14:18:30.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:18:30.650+0000 7f13c82dd700 1 -- 172.21.15.33:0/1174711567 wait complete. 2022-02-02T14:18:30.660 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:18:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:31 smithi033 ceph-mon[101165]: from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:31.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:31 smithi033 ceph-mon[101165]: from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1654449858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:18:31.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1174711567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:18:31.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:31 smithi037 ceph-mon[69017]: from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:31 smithi037 ceph-mon[69017]: from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:18:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1654449858' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:18:31.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1174711567' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:18:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:32 smithi033 ceph-mon[101165]: pgmap v1194: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:32 smithi037 ceph-mon[69017]: pgmap v1194: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:34 smithi033 ceph-mon[101165]: pgmap v1195: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:34 smithi037 ceph-mon[69017]: pgmap v1195: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:36.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:36 smithi033 ceph-mon[101165]: pgmap v1196: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:36 smithi037 ceph-mon[69017]: pgmap v1196: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:38 smithi033 ceph-mon[101165]: pgmap v1197: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:38 smithi037 ceph-mon[69017]: pgmap v1197: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:40 smithi033 ceph-mon[101165]: pgmap v1198: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:40 smithi037 ceph-mon[69017]: pgmap v1198: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:42 smithi033 ceph-mon[101165]: pgmap v1199: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:42 smithi037 ceph-mon[69017]: pgmap v1199: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:44 smithi033 ceph-mon[101165]: pgmap v1200: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:44 smithi037 ceph-mon[69017]: pgmap v1200: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:46 smithi033 ceph-mon[101165]: pgmap v1201: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:46 smithi037 ceph-mon[69017]: pgmap v1201: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:48 smithi033 ceph-mon[101165]: pgmap v1202: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:48 smithi037 ceph-mon[69017]: pgmap v1202: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:50 smithi033 ceph-mon[101165]: pgmap v1203: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:50 smithi037 ceph-mon[69017]: pgmap v1203: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:52 smithi033 ceph-mon[101165]: pgmap v1204: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:52 smithi037 ceph-mon[69017]: pgmap v1204: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:54 smithi033 ceph-mon[101165]: pgmap v1205: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:54 smithi037 ceph-mon[69017]: pgmap v1205: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:18:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:18:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:18:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:18:56.239 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:56 smithi033 ceph-mon[101165]: pgmap v1206: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:56 smithi037 ceph-mon[69017]: pgmap v1206: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:18:58 smithi033 ceph-mon[101165]: pgmap v1207: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:18:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:18:58 smithi037 ceph-mon[69017]: pgmap v1207: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:00 smithi033 ceph-mon[101165]: pgmap v1208: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:00 smithi037 ceph-mon[69017]: pgmap v1208: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 -- 172.21.15.33:0/899840178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f6630 msgr2=0x7ff45c0f6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 --2- 172.21.15.33:0/899840178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f6a90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7ff44c004660 tx=0x7ff44c009b30).stop 2022-02-02T14:19:00.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 -- 172.21.15.33:0/899840178 shutdown_connections 2022-02-02T14:19:00.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 --2- 172.21.15.33:0/899840178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f6a90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 --2- 172.21.15.33:0/899840178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 -- 172.21.15.33:0/899840178 >> 172.21.15.33:0/899840178 conn(0x7ff45c0f0ad0 msgr2=0x7ff45c0f2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:00.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 -- 172.21.15.33:0/899840178 shutdown_connections 2022-02-02T14:19:00.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.766+0000 7ff4634b1700 1 -- 172.21.15.33:0/899840178 wait complete. 2022-02-02T14:19:00.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 Processor -- start 2022-02-02T14:19:00.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 -- start start 2022-02-02T14:19:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0f7ed0 con 0x7ff45c0f5390 2022-02-02T14:19:00.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4634b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45c0f8010 con 0x7ff45c0f6630 2022-02-02T14:19:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60550/0 (socket says 172.21.15.33:60550) 2022-02-02T14:19:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 -- 172.21.15.33:0/3863015701 learned_addr learned my addr 172.21.15.33:0/3863015701 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff461cae700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:00.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 -- 172.21.15.33:0/3863015701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f6630 msgr2=0x7ff45c0f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.767+0000 7ff4624af700 1 -- 172.21.15.33:0/3863015701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c005040 con 0x7ff45c0f5390 2022-02-02T14:19:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff4624af700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff458002700 tx=0x7ff458009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:00.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff458009320 con 0x7ff45c0f5390 2022-02-02T14:19:00.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff45800f040 con 0x7ff45c0f5390 2022-02-02T14:19:00.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45c0f82f0 con 0x7ff45c0f5390 2022-02-02T14:19:00.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff458014900 con 0x7ff45c0f5390 2022-02-02T14:19:00.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.768+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45c10ed20 con 0x7ff45c0f5390 2022-02-02T14:19:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.769+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45c045ad0 con 0x7ff45c0f5390 2022-02-02T14:19:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.769+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff458009480 con 0x7ff45c0f5390 2022-02-02T14:19:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.770+0000 7ff452ffd700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 0x7ff4480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.770+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff458081d10 con 0x7ff45c0f5390 2022-02-02T14:19:00.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.770+0000 7ff461cae700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 0x7ff4480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.770+0000 7ff461cae700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 0x7ff4480672e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff44c004630 tx=0x7ff44c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:00.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.774+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff45804fe80 con 0x7ff45c0f5390 2022-02-02T14:19:00.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.964+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff45c0faa70 con 0x7ff448064e20 2022-02-02T14:19:00.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.966+0000 7ff452ffd700 1 -- 172.21.15.33:0/3863015701 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff45c0faa70 con 0x7ff448064e20 2022-02-02T14:19:00.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 msgr2=0x7ff4480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 0x7ff4480672e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7ff44c004630 tx=0x7ff44c009b30).stop 2022-02-02T14:19:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 msgr2=0x7ff45c0f94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7ff458002700 tx=0x7ff458009d80).stop 2022-02-02T14:19:00.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 shutdown_connections 2022-02-02T14:19:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff448064e20 0x7ff4480672e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff45c0f5390 0x7ff45c0f94f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.967+0000 7ff4634b1700 1 --2- 172.21.15.33:0/3863015701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff45c0f6630 0x7ff45c0f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.968+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 >> 172.21.15.33:0/3863015701 conn(0x7ff45c0f0ad0 msgr2=0x7ff45c05fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:00.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.968+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 shutdown_connections 2022-02-02T14:19:00.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:00.968+0000 7ff4634b1700 1 -- 172.21.15.33:0/3863015701 wait complete. 2022-02-02T14:19:00.977 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:19:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 -- 172.21.15.33:0/2337846783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 msgr2=0x7f55640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 --2- 172.21.15.33:0/2337846783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f55640f6cc0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f55580046e0 tx=0x7f5558009b30).stop 2022-02-02T14:19:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 -- 172.21.15.33:0/2337846783 shutdown_connections 2022-02-02T14:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 --2- 172.21.15.33:0/2337846783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f55640f6cc0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 --2- 172.21.15.33:0/2337846783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 0x7f55640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 -- 172.21.15.33:0/2337846783 >> 172.21.15.33:0/2337846783 conn(0x7f55640f0d40 msgr2=0x7f55640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 -- 172.21.15.33:0/2337846783 shutdown_connections 2022-02-02T14:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.069+0000 7f556a6c5700 1 -- 172.21.15.33:0/2337846783 wait complete. 2022-02-02T14:19:01.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 Processor -- start 2022-02-02T14:19:01.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 -- start start 2022-02-02T14:19:01.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 0x7f5564104d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5564105880 con 0x7f55640f6860 2022-02-02T14:19:01.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f556a6c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55641060c0 con 0x7f55640f55c0 2022-02-02T14:19:01.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f55637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f55637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60562/0 (socket says 172.21.15.33:60562) 2022-02-02T14:19:01.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.070+0000 7f55637fe700 1 -- 172.21.15.33:0/285319883 learned_addr learned my addr 172.21.15.33:0/285319883 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:01.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f5563fff700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 0x7f5564104d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f55637fe700 1 -- 172.21.15.33:0/285319883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 msgr2=0x7f5564104d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f55637fe700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 0x7f5564104d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f55637fe700 1 -- 172.21.15.33:0/285319883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5558005040 con 0x7f55640f6860 2022-02-02T14:19:01.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f55637fe700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5558000c00 tx=0x7f5558009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5558007c70 con 0x7f55640f6860 2022-02-02T14:19:01.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5558007dd0 con 0x7f55640f6860 2022-02-02T14:19:01.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5564106340 con 0x7f55640f6860 2022-02-02T14:19:01.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5558023610 con 0x7f55640f6860 2022-02-02T14:19:01.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.071+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5564106820 con 0x7f55640f6860 2022-02-02T14:19:01.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.072+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55640f49b0 con 0x7f55640f6860 2022-02-02T14:19:01.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.073+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f555802b070 con 0x7f55640f6860 2022-02-02T14:19:01.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.073+0000 7f5560ff9700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 0x7f554c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.074+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5558085650 con 0x7f55640f6860 2022-02-02T14:19:01.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.074+0000 7f5563fff700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 0x7f554c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.074+0000 7f5563fff700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 0x7f554c067290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f5564105b50 tx=0x7f5554009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.078+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5558053700 con 0x7f55640f6860 2022-02-02T14:19:01.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.262+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f55640fcd50 con 0x7f554c064dd0 2022-02-02T14:19:01.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.276+0000 7f5560ff9700 1 -- 172.21.15.33:0/285319883 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f55640fcd50 con 0x7f554c064dd0 2022-02-02T14:19:01.276 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:19:01.276 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (44m) 6m ago 45m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:19:01.276 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (37m) 6m ago 45m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:19:01.277 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (37m) 6m ago 44m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:19:01.277 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (44m) 6m ago 45m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:19:01.277 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (37m) 6m ago 41m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:19:01.277 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (38m) 6m ago 41m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:19:01.278 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (39m) 6m ago 41m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:19:01.278 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (41m) 6m ago 41m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:19:01.278 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (38m) 6m ago 46m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:19:01.278 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (38m) 6m ago 44m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:19:01.279 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (38m) 6m ago 46m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:19:01.279 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (37m) 6m ago 44m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:19:01.279 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (45m) 6m ago 45m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:19:01.279 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (44m) 6m ago 44m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:19:01.280 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 44m - 4096M 2022-02-02T14:19:01.280 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (43m) 6m ago 43m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:19:01.280 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (43m) 6m ago 43m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:19:01.280 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (43m) 6m ago 43m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:19:01.280 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (42m) 6m ago 42m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:19:01.281 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (42m) 6m ago 42m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:19:01.281 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (44m) 6m ago 44m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:19:01.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 msgr2=0x7f554c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 0x7f554c067290 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f5564105b50 tx=0x7f5554009c00).stop 2022-02-02T14:19:01.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 msgr2=0x7f5564105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f5558000c00 tx=0x7f5558009b30).stop 2022-02-02T14:19:01.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 shutdown_connections 2022-02-02T14:19:01.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f554c064dd0 0x7f554c067290 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55640f55c0 0x7f5564104d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 --2- 172.21.15.33:0/285319883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55640f6860 0x7f5564105280 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 >> 172.21.15.33:0/285319883 conn(0x7f55640f0d40 msgr2=0x7f55640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 shutdown_connections 2022-02-02T14:19:01.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.278+0000 7f556a6c5700 1 -- 172.21.15.33:0/285319883 wait complete. 2022-02-02T14:19:01.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 -- 172.21.15.33:0/578333203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 msgr2=0x7fb2ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 --2- 172.21.15.33:0/578333203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac0f6cc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fb2a0004660 tx=0x7fb2a0009b30).stop 2022-02-02T14:19:01.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 -- 172.21.15.33:0/578333203 shutdown_connections 2022-02-02T14:19:01.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 --2- 172.21.15.33:0/578333203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac0f6cc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 --2- 172.21.15.33:0/578333203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 0x7fb2ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 -- 172.21.15.33:0/578333203 >> 172.21.15.33:0/578333203 conn(0x7fb2ac0f0d40 msgr2=0x7fb2ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 -- 172.21.15.33:0/578333203 shutdown_connections 2022-02-02T14:19:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.378+0000 7fb2b2904700 1 -- 172.21.15.33:0/578333203 wait complete. 2022-02-02T14:19:01.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.379+0000 7fb2b2904700 1 Processor -- start 2022-02-02T14:19:01.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.379+0000 7fb2b2904700 1 -- start start 2022-02-02T14:19:01.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2b2904700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 0x7fb2ac109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2b2904700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2b2904700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac0603c0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2b2904700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac060500 con 0x7fb2ac0f55c0 2022-02-02T14:19:01.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60572/0 (socket says 172.21.15.33:60572) 2022-02-02T14:19:01.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 -- 172.21.15.33:0/3554662305 learned_addr learned my addr 172.21.15.33:0/3554662305 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:01.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2abfff700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 0x7fb2ac109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 -- 172.21.15.33:0/3554662305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 msgr2=0x7fb2ac109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 0x7fb2ac109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 -- 172.21.15.33:0/3554662305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0005040 con 0x7fb2ac0f6860 2022-02-02T14:19:01.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2ab7fe700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb2a0009da0 tx=0x7fb2a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a0018070 con 0x7fb2ac0f6860 2022-02-02T14:19:01.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2a0007cf0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a001c620 con 0x7fb2ac0f6860 2022-02-02T14:19:01.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.380+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac10c6c0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.381+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac10cbf0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.382+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac0f49b0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.382+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2a001d420 con 0x7fb2ac0f6860 2022-02-02T14:19:01.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.382+0000 7fb2a8ff9700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 0x7fb294067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.383+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2a00838b0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.383+0000 7fb2abfff700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 0x7fb294067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.383+0000 7fb2abfff700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 0x7fb294067270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb2ac060040 tx=0x7fb29c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.387+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2a0051a20 con 0x7fb2ac0f6860 2022-02-02T14:19:01.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.632+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2ac045ad0 con 0x7fb2ac0f6860 2022-02-02T14:19:01.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.632+0000 7fb2a8ff9700 1 -- 172.21.15.33:0/3554662305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb2a0055040 con 0x7fb2ac0f6860 2022-02-02T14:19:01.633 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:19:01.633 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:19:01.634 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:19:01.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:01.634 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:19:01.635 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:19:01.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:01.635 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:19:01.635 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:19:01.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:01.636 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:19:01.636 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:19:01.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:01.637 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:19:01.637 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:19:01.637 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:19:01.637 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:19:01.638 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:19:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 msgr2=0x7fb294067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 0x7fb294067270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb2ac060040 tx=0x7fb29c009040).stop 2022-02-02T14:19:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 msgr2=0x7fb2ac10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb2a0009da0 tx=0x7fb2a0009b30).stop 2022-02-02T14:19:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 shutdown_connections 2022-02-02T14:19:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb294064db0 0x7fb294067270 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2ac0f55c0 0x7fb2ac109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 --2- 172.21.15.33:0/3554662305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2ac0f6860 0x7fb2ac10c170 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.634+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 >> 172.21.15.33:0/3554662305 conn(0x7fb2ac0f0d40 msgr2=0x7fb2ac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.635+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 shutdown_connections 2022-02-02T14:19:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.635+0000 7fb2b2904700 1 -- 172.21.15.33:0/3554662305 wait complete. 2022-02-02T14:19:01.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 -- 172.21.15.33:0/1471339740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c060310 msgr2=0x7fd82c0f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 --2- 172.21.15.33:0/1471339740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c060310 0x7fd82c0f92a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fd81c004660 tx=0x7fd81c009b30).stop 2022-02-02T14:19:01.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 -- 172.21.15.33:0/1471339740 shutdown_connections 2022-02-02T14:19:01.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 --2- 172.21.15.33:0/1471339740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c0f9820 0x7fd82c0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 --2- 172.21.15.33:0/1471339740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c060310 0x7fd82c0f92a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 -- 172.21.15.33:0/1471339740 >> 172.21.15.33:0/1471339740 conn(0x7fd82c0f0d40 msgr2=0x7fd82c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 -- 172.21.15.33:0/1471339740 shutdown_connections 2022-02-02T14:19:01.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.737+0000 7fd831b0b700 1 -- 172.21.15.33:0/1471339740 wait complete. 2022-02-02T14:19:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 Processor -- start 2022-02-02T14:19:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 -- start start 2022-02-02T14:19:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 0x7fd82c106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c107980 con 0x7fd82c0f9820 2022-02-02T14:19:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd831b0b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82c107ac0 con 0x7fd82c060310 2022-02-02T14:19:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd82affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd82affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60582/0 (socket says 172.21.15.33:60582) 2022-02-02T14:19:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.738+0000 7fd82affd700 1 -- 172.21.15.33:0/4224050061 learned_addr learned my addr 172.21.15.33:0/4224050061 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82b7fe700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 0x7fd82c106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82affd700 1 -- 172.21.15.33:0/4224050061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 msgr2=0x7fd82c106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82affd700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 0x7fd82c106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82affd700 1 -- 172.21.15.33:0/4224050061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c005040 con 0x7fd82c0f9820 2022-02-02T14:19:01.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82b7fe700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 0x7fd82c106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:19:01.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd82affd700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fd8140026d0 tx=0x7fd814009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd814009320 con 0x7fd82c0f9820 2022-02-02T14:19:01.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd81400f040 con 0x7fd82c0f9820 2022-02-02T14:19:01.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd82c108460 con 0x7fd82c0f9820 2022-02-02T14:19:01.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd814014870 con 0x7fd82c0f9820 2022-02-02T14:19:01.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.739+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82c108a20 con 0x7fd82c0f9820 2022-02-02T14:19:01.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.740+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82c045ad0 con 0x7fd82c0f9820 2022-02-02T14:19:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.741+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd814009480 con 0x7fd82c0f9820 2022-02-02T14:19:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.741+0000 7fd823fff700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 0x7fd818067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.741+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd814081de0 con 0x7fd82c0f9820 2022-02-02T14:19:01.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.741+0000 7fd82b7fe700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 0x7fd818067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.742+0000 7fd82b7fe700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 0x7fd818067290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd81c004630 tx=0x7fd81c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:01.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.745+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd8140538c0 con 0x7fd82c0f9820 2022-02-02T14:19:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.958+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd82c027a00 con 0x7fd82c0f9820 2022-02-02T14:19:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.959+0000 7fd823fff700 1 -- 172.21.15.33:0/4224050061 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd8140534b0 con 0x7fd82c0f9820 2022-02-02T14:19:01.959 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:19:01.959 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:19:01.960 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:19:01.960 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:19:01.960 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:01.960 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:19:01.961 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:19:01.961 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:19:01.961 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:19:01.961 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:19:01.962 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:19:01.962 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:19:01.962 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:19:01.962 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:19:01.962 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:19:01.963 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:19:01.963 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:19:01.963 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:19:01.963 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:19:01.964 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:19:01.964 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:19:01.964 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:19:01.964 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:19:01.965 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:19:01.965 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:19:01.965 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:19:01.965 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:19:01.965 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:19:01.966 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:19:01.966 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:19:01.966 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:19:01.966 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:01.967 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:01.967 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:19:01.967 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:01.967 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:01.968 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:01.968 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:01.968 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:01.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 msgr2=0x7fd818067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 0x7fd818067290 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd81c004630 tx=0x7fd81c009b30).stop 2022-02-02T14:19:01.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 msgr2=0x7fd82c1073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:01.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7fd8140026d0 tx=0x7fd814009e00).stop 2022-02-02T14:19:01.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 shutdown_connections 2022-02-02T14:19:01.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd818064dd0 0x7fd818067290 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd82c060310 0x7fd82c106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 --2- 172.21.15.33:0/4224050061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd82c0f9820 0x7fd82c1073d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:01.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 >> 172.21.15.33:0/4224050061 conn(0x7fd82c0f0d40 msgr2=0x7fd82c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:01.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 shutdown_connections 2022-02-02T14:19:01.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:01.961+0000 7fd831b0b700 1 -- 172.21.15.33:0/4224050061 wait complete. 2022-02-02T14:19:01.972 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:19:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:02 smithi033 ceph-mon[101165]: pgmap v1209: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:02 smithi033 ceph-mon[101165]: from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3554662305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:19:02.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4224050061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:19:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:02 smithi037 ceph-mon[69017]: pgmap v1209: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:02 smithi037 ceph-mon[69017]: from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:02.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3554662305' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:19:02.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4224050061' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:19:03.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:03 smithi033 ceph-mon[101165]: from='client.35322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:03.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:03 smithi037 ceph-mon[69017]: from='client.35322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:04 smithi033 ceph-mon[101165]: pgmap v1210: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:04 smithi037 ceph-mon[69017]: pgmap v1210: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:06 smithi033 ceph-mon[101165]: pgmap v1211: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:06 smithi037 ceph-mon[69017]: pgmap v1211: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:08 smithi033 ceph-mon[101165]: pgmap v1212: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:08 smithi037 ceph-mon[69017]: pgmap v1212: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:10 smithi033 ceph-mon[101165]: pgmap v1213: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:10 smithi037 ceph-mon[69017]: pgmap v1213: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:12 smithi033 ceph-mon[101165]: pgmap v1214: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:12 smithi037 ceph-mon[69017]: pgmap v1214: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:14 smithi033 ceph-mon[101165]: pgmap v1215: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:14 smithi037 ceph-mon[69017]: pgmap v1215: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:16.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:16 smithi033 ceph-mon[101165]: pgmap v1216: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:16 smithi037 ceph-mon[69017]: pgmap v1216: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:18 smithi033 ceph-mon[101165]: pgmap v1217: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:18 smithi037 ceph-mon[69017]: pgmap v1217: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:20 smithi033 ceph-mon[101165]: pgmap v1218: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:20 smithi037 ceph-mon[69017]: pgmap v1218: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:22 smithi033 ceph-mon[101165]: pgmap v1219: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:22 smithi037 ceph-mon[69017]: pgmap v1219: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:24 smithi033 ceph-mon[101165]: pgmap v1220: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:24 smithi037 ceph-mon[69017]: pgmap v1220: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:26 smithi033 ceph-mon[101165]: pgmap v1221: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:26 smithi037 ceph-mon[69017]: pgmap v1221: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:28 smithi033 ceph-mon[101165]: pgmap v1222: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:28 smithi037 ceph-mon[69017]: pgmap v1222: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:30 smithi033 ceph-mon[101165]: pgmap v1223: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:30 smithi037 ceph-mon[69017]: pgmap v1223: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1908266141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f6860 msgr2=0x7fcb280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1908266141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f6860 0x7fcb280f6cc0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fcb18004660 tx=0x7fcb18009b30).stop 2022-02-02T14:19:32.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1908266141 shutdown_connections 2022-02-02T14:19:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1908266141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f6860 0x7fcb280f6cc0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1908266141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f55c0 0x7fcb280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1908266141 >> 172.21.15.33:0/1908266141 conn(0x7fcb280f0d40 msgr2=0x7fcb280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1908266141 shutdown_connections 2022-02-02T14:19:32.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.076+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1908266141 wait complete. 2022-02-02T14:19:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 Processor -- start 2022-02-02T14:19:32.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 -- start start 2022-02-02T14:19:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f6860 0x7fcb280f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280f8100 con 0x7fcb280f55c0 2022-02-02T14:19:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2f42d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb280f8240 con 0x7fcb280f6860 2022-02-02T14:19:32.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2d1c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2d1c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60590/0 (socket says 172.21.15.33:60590) 2022-02-02T14:19:32.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2d1c9700 1 -- 172.21.15.33:0/1702883799 learned_addr learned my addr 172.21.15.33:0/1702883799 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.077+0000 7fcb2c9c8700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f6860 0x7fcb280f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2d1c9700 1 -- 172.21.15.33:0/1702883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f6860 msgr2=0x7fcb280f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2d1c9700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f6860 0x7fcb280f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2d1c9700 1 -- 172.21.15.33:0/1702883799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18005040 con 0x7fcb280f55c0 2022-02-02T14:19:32.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2d1c9700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fcb24002700 tx=0x7fcb24009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb240079c0 con 0x7fcb280f55c0 2022-02-02T14:19:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb2400f040 con 0x7fcb280f55c0 2022-02-02T14:19:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb280f8520 con 0x7fcb280f55c0 2022-02-02T14:19:32.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb24014860 con 0x7fcb280f55c0 2022-02-02T14:19:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.078+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2810efa0 con 0x7fcb280f55c0 2022-02-02T14:19:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.079+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb28045ad0 con 0x7fcb280f55c0 2022-02-02T14:19:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.080+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb2401b060 con 0x7fcb280f55c0 2022-02-02T14:19:32.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.080+0000 7fcb1dffb700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 0x7fcb14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.081+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb24081930 con 0x7fcb280f55c0 2022-02-02T14:19:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.081+0000 7fcb2c9c8700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 0x7fcb14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.081+0000 7fcb2c9c8700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 0x7fcb14067290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fcb18004630 tx=0x7fcb18009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.085+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb2404f9e0 con 0x7fcb280f55c0 2022-02-02T14:19:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.275+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb280faca0 con 0x7fcb14064dd0 2022-02-02T14:19:32.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.276+0000 7fcb1dffb700 1 -- 172.21.15.33:0/1702883799 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fcb280faca0 con 0x7fcb14064dd0 2022-02-02T14:19:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 msgr2=0x7fcb14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 0x7fcb14067290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fcb18004630 tx=0x7fcb18009b30).stop 2022-02-02T14:19:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 msgr2=0x7fcb280f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fcb24002700 tx=0x7fcb24009d80).stop 2022-02-02T14:19:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 shutdown_connections 2022-02-02T14:19:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb14064dd0 0x7fcb14067290 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb280f55c0 0x7fcb280f9720 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 --2- 172.21.15.33:0/1702883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb280f6860 0x7fcb280f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 >> 172.21.15.33:0/1702883799 conn(0x7fcb280f0d40 msgr2=0x7fcb2805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 shutdown_connections 2022-02-02T14:19:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.278+0000 7fcb2f42d700 1 -- 172.21.15.33:0/1702883799 wait complete. 2022-02-02T14:19:32.288 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:19:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 -- 172.21.15.33:0/1824366923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 msgr2=0x7f2ea40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/1824366923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea40f6cc0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f2e8c004660 tx=0x7f2e8c009b30).stop 2022-02-02T14:19:32.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 -- 172.21.15.33:0/1824366923 shutdown_connections 2022-02-02T14:19:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/1824366923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea40f6cc0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/1824366923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 0x7f2ea40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 -- 172.21.15.33:0/1824366923 >> 172.21.15.33:0/1824366923 conn(0x7f2ea40f0d40 msgr2=0x7f2ea40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.381 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:32 smithi033 ceph-mon[101165]: pgmap v1224: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.379+0000 7f2ea9f41700 1 -- 172.21.15.33:0/1824366923 shutdown_connections 2022-02-02T14:19:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 -- 172.21.15.33:0/1824366923 wait complete. 2022-02-02T14:19:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 Processor -- start 2022-02-02T14:19:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 -- start start 2022-02-02T14:19:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 0x7f2ea410c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40602b0 con 0x7f2ea40f6860 2022-02-02T14:19:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.380+0000 7f2ea9f41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40603f0 con 0x7f2ea40f55c0 2022-02-02T14:19:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60602/0 (socket says 172.21.15.33:60602) 2022-02-02T14:19:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/165145496 learned_addr learned my addr 172.21.15.33:0/165145496 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea37fe700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 0x7f2ea410c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/165145496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 msgr2=0x7f2ea410c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 0x7f2ea410c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 -- 172.21.15.33:0/165145496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c005040 con 0x7f2ea40f6860 2022-02-02T14:19:32.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea2ffd700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2e8c009990 tx=0x7f2e8c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e8c018070 con 0x7f2ea40f6860 2022-02-02T14:19:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2e8c007ca0 con 0x7f2ea40f6860 2022-02-02T14:19:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea410ea60 con 0x7f2ea40f6860 2022-02-02T14:19:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e8c01c620 con 0x7f2ea40f6860 2022-02-02T14:19:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.381+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea410ee30 con 0x7f2ea40f6860 2022-02-02T14:19:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.382+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea4045ad0 con 0x7f2ea40f6860 2022-02-02T14:19:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.383+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2e8c01d960 con 0x7f2ea40f6860 2022-02-02T14:19:32.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.383+0000 7f2e9bfff700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 0x7f2e90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.383+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2e8c083830 con 0x7f2ea40f6860 2022-02-02T14:19:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.383+0000 7f2ea37fe700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 0x7f2e90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.384+0000 7f2ea37fe700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 0x7f2e90067290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f2ea4060040 tx=0x7f2e94009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.387+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2e8c0519a0 con 0x7f2ea40f6860 2022-02-02T14:19:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:32 smithi037 ceph-mon[69017]: pgmap v1224: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:32.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.569+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ea4057f10 con 0x7f2e90064dd0 2022-02-02T14:19:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.584+0000 7f2e9bfff700 1 -- 172.21.15.33:0/165145496 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2ea4057f10 con 0x7f2e90064dd0 2022-02-02T14:19:32.584 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:19:32.584 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (44m) 6m ago 45m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:19:32.584 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (37m) 6m ago 45m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:19:32.585 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (37m) 6m ago 45m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:19:32.585 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (44m) 6m ago 45m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:19:32.585 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (38m) 6m ago 42m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:19:32.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (38m) 6m ago 41m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:19:32.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (39m) 6m ago 42m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:19:32.586 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (42m) 6m ago 41m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:19:32.587 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (39m) 6m ago 47m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:19:32.587 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (39m) 6m ago 45m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:19:32.587 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (38m) 6m ago 47m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:19:32.587 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (38m) 6m ago 45m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:19:32.588 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (45m) 6m ago 45m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:19:32.588 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (45m) 6m ago 45m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:19:32.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 6m ago 44m - 4096M 2022-02-02T14:19:32.588 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (44m) 6m ago 44m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:19:32.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (43m) 6m ago 43m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:19:32.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (43m) 6m ago 43m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:19:32.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (43m) 6m ago 43m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:19:32.589 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (43m) 6m ago 43m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:19:32.590 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (44m) 6m ago 45m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:19:32.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 msgr2=0x7f2e90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 0x7f2e90067290 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f2ea4060040 tx=0x7f2e94009040).stop 2022-02-02T14:19:32.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 msgr2=0x7f2ea410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f2e8c009990 tx=0x7f2e8c009b30).stop 2022-02-02T14:19:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 shutdown_connections 2022-02-02T14:19:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e90064dd0 0x7f2e90067290 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ea40f55c0 0x7f2ea410c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 --2- 172.21.15.33:0/165145496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ea40f6860 0x7f2ea410e570 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.585+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 >> 172.21.15.33:0/165145496 conn(0x7f2ea40f0d40 msgr2=0x7f2ea40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.586+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 shutdown_connections 2022-02-02T14:19:32.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.586+0000 7f2ea9f41700 1 -- 172.21.15.33:0/165145496 wait complete. 2022-02-02T14:19:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- 172.21.15.33:0/379777267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f6860 msgr2=0x7f65bc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 --2- 172.21.15.33:0/379777267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f6cc0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f65b0004660 tx=0x7f65b0009b30).stop 2022-02-02T14:19:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- 172.21.15.33:0/379777267 shutdown_connections 2022-02-02T14:19:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 --2- 172.21.15.33:0/379777267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f6cc0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 --2- 172.21.15.33:0/379777267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- 172.21.15.33:0/379777267 >> 172.21.15.33:0/379777267 conn(0x7f65bc0f0d40 msgr2=0x7f65bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- 172.21.15.33:0/379777267 shutdown_connections 2022-02-02T14:19:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- 172.21.15.33:0/379777267 wait complete. 2022-02-02T14:19:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 Processor -- start 2022-02-02T14:19:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.686+0000 7f65c475a700 1 -- start start 2022-02-02T14:19:32.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c475a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c475a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c475a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0f8100 con 0x7f65bc0f55c0 2022-02-02T14:19:32.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c475a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0f8240 con 0x7f65bc0f6860 2022-02-02T14:19:32.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60610/0 (socket says 172.21.15.33:60610) 2022-02-02T14:19:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 -- 172.21.15.33:0/1846415738 learned_addr learned my addr 172.21.15.33:0/1846415738 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c1cf5700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 -- 172.21.15.33:0/1846415738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f6860 msgr2=0x7f65bc0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 -- 172.21.15.33:0/1846415738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b0005040 con 0x7f65bc0f55c0 2022-02-02T14:19:32.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c24f6700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f65b8002700 tx=0x7f65b8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b8009320 con 0x7f65bc0f55c0 2022-02-02T14:19:32.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f65b800f040 con 0x7f65bc0f55c0 2022-02-02T14:19:32.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0f8520 con 0x7f65bc0f55c0 2022-02-02T14:19:32.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.687+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65b8014900 con 0x7f65bc0f55c0 2022-02-02T14:19:32.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.688+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc10efa0 con 0x7f65bc0f55c0 2022-02-02T14:19:32.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.688+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc045ad0 con 0x7f65bc0f55c0 2022-02-02T14:19:32.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.689+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f65b8009480 con 0x7f65bc0f55c0 2022-02-02T14:19:32.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.690+0000 7f65aeffd700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 0x7f65a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:32.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.690+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f65b8081c30 con 0x7f65bc0f55c0 2022-02-02T14:19:32.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.690+0000 7f65c1cf5700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 0x7f65a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:32.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.690+0000 7f65c1cf5700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 0x7f65a8067290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f65b0009da0 tx=0x7f65b0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:32.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.694+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f65b804fce0 con 0x7f65bc0f55c0 2022-02-02T14:19:32.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.938+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f65bc10f750 con 0x7f65bc0f55c0 2022-02-02T14:19:32.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.939+0000 7f65aeffd700 1 -- 172.21.15.33:0/1846415738 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f65b8053300 con 0x7f65bc0f55c0 2022-02-02T14:19:32.939 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:19:32.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:19:32.939 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:19:32.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:32.940 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:19:32.940 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:19:32.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:32.940 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:19:32.941 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:19:32.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:32.941 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:19:32.941 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:19:32.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:19:32.942 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:19:32.942 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:19:32.942 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:19:32.943 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:19:32.943 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:19:32.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 msgr2=0x7f65a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 0x7f65a8067290 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f65b0009da0 tx=0x7f65b0009b30).stop 2022-02-02T14:19:32.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 msgr2=0x7f65bc0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:32.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f65b8002700 tx=0x7f65b8009d80).stop 2022-02-02T14:19:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 shutdown_connections 2022-02-02T14:19:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f65a8064dd0 0x7f65a8067290 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65bc0f55c0 0x7f65bc0f9720 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 --2- 172.21.15.33:0/1846415738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65bc0f6860 0x7f65bc0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 >> 172.21.15.33:0/1846415738 conn(0x7f65bc0f0d40 msgr2=0x7f65bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 shutdown_connections 2022-02-02T14:19:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:32.941+0000 7f65c475a700 1 -- 172.21.15.33:0/1846415738 wait complete. 2022-02-02T14:19:33.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 -- 172.21.15.33:0/2681245647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 msgr2=0x7f3f600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 --2- 172.21.15.33:0/2681245647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f600f59e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f3f54004660 tx=0x7f3f54009b30).stop 2022-02-02T14:19:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 -- 172.21.15.33:0/2681245647 shutdown_connections 2022-02-02T14:19:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 --2- 172.21.15.33:0/2681245647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 --2- 172.21.15.33:0/2681245647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f600f59e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 -- 172.21.15.33:0/2681245647 >> 172.21.15.33:0/2681245647 conn(0x7f3f600f0d40 msgr2=0x7f3f600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:33.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 -- 172.21.15.33:0/2681245647 shutdown_connections 2022-02-02T14:19:33.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 -- 172.21.15.33:0/2681245647 wait complete. 2022-02-02T14:19:33.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.042+0000 7f3f66daa700 1 Processor -- start 2022-02-02T14:19:33.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f66daa700 1 -- start start 2022-02-02T14:19:33.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f66daa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:33.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f66daa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f6010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:33.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f66daa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600602b0 con 0x7f3f600f55c0 2022-02-02T14:19:33.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f66daa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f600603f0 con 0x7f3f600f6860 2022-02-02T14:19:33.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:33.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60620/0 (socket says 172.21.15.33:60620) 2022-02-02T14:19:33.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 -- 172.21.15.33:0/1923673281 learned_addr learned my addr 172.21.15.33:0/1923673281 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:19:33.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f5ffff700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f6010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:33.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 -- 172.21.15.33:0/1923673281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 msgr2=0x7f3f6010e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:33.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f6010e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 -- 172.21.15.33:0/1923673281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54005040 con 0x7f3f600f55c0 2022-02-02T14:19:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f5ffff700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f6010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:19:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.043+0000 7f3f64b46700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f3f54013a70 tx=0x7f3f54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.044+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f54018070 con 0x7f3f600f55c0 2022-02-02T14:19:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.044+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f540097d0 con 0x7f3f600f55c0 2022-02-02T14:19:33.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.044+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6010eac0 con 0x7f3f600f55c0 2022-02-02T14:19:33.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.044+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f5401c3c0 con 0x7f3f600f55c0 2022-02-02T14:19:33.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.044+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f6010ee90 con 0x7f3f600f55c0 2022-02-02T14:19:33.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.045+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f60045ad0 con 0x7f3f600f55c0 2022-02-02T14:19:33.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.046+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f54007ba0 con 0x7f3f600f55c0 2022-02-02T14:19:33.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.046+0000 7f3f5d7fa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 0x7f3f50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:19:33.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.046+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f54083a30 con 0x7f3f600f55c0 2022-02-02T14:19:33.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.046+0000 7f3f5ffff700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 0x7f3f50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:19:33.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.047+0000 7f3f5ffff700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 0x7f3f50067290 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3f4c004bb0 tx=0x7f3f4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:19:33.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.050+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f54051b60 con 0x7f3f600f55c0 2022-02-02T14:19:33.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.264+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3f600586e0 con 0x7f3f600f55c0 2022-02-02T14:19:33.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.264+0000 7f3f5d7fa700 1 -- 172.21.15.33:0/1923673281 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f3f54055180 con 0x7f3f600f55c0 2022-02-02T14:19:33.264 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:19:33.265 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:19:33.265 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:19:33.265 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:19:33.265 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:33.265 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:19:33.266 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:19:33.266 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:19:33.266 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:19:33.266 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:19:33.267 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:19:33.267 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:19:33.267 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:19:33.267 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:19:33.268 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:19:33.268 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:19:33.268 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:19:33.268 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:19:33.269 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:19:33.269 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:19:33.269 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:19:33.269 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:19:33.270 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:19:33.270 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:19:33.270 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:19:33.271 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:19:33.271 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:19:33.271 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:19:33.271 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:19:33.272 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:19:33.272 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:19:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:33.272 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:33.273 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:19:33.273 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:19:33.273 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:33.273 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:33.273 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:33.274 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:19:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 msgr2=0x7f3f50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 0x7f3f50067290 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f3f4c004bb0 tx=0x7f3f4c00b040).stop 2022-02-02T14:19:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 msgr2=0x7f3f6010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:19:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f3f54013a70 tx=0x7f3f54009b30).stop 2022-02-02T14:19:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 shutdown_connections 2022-02-02T14:19:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f50064dd0 0x7f3f50067290 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f600f55c0 0x7f3f6010c0d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 --2- 172.21.15.33:0/1923673281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f600f6860 0x7f3f6010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:19:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 >> 172.21.15.33:0/1923673281 conn(0x7f3f600f0d40 msgr2=0x7f3f600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:19:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 shutdown_connections 2022-02-02T14:19:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:19:33.266+0000 7f3f66daa700 1 -- 172.21.15.33:0/1923673281 wait complete. 2022-02-02T14:19:33.278 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:19:33.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1846415738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:19:33.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1846415738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:19:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:34 smithi033 ceph-mon[101165]: from='client.35334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:34 smithi033 ceph-mon[101165]: from='client.35338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:34 smithi033 ceph-mon[101165]: pgmap v1225: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:34.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:34 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1923673281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:19:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:34 smithi037 ceph-mon[69017]: from='client.35334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:34.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:34 smithi037 ceph-mon[69017]: from='client.35338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:19:34.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:34 smithi037 ceph-mon[69017]: pgmap v1225: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:34.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:34 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1923673281' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:19:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:36 smithi033 ceph-mon[101165]: pgmap v1226: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:36 smithi037 ceph-mon[69017]: pgmap v1226: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:38 smithi033 ceph-mon[101165]: pgmap v1227: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:38 smithi037 ceph-mon[69017]: pgmap v1227: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:40 smithi033 ceph-mon[101165]: pgmap v1228: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:40 smithi037 ceph-mon[69017]: pgmap v1228: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:42 smithi033 ceph-mon[101165]: pgmap v1229: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:42 smithi037 ceph-mon[69017]: pgmap v1229: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:44 smithi037 ceph-mon[69017]: pgmap v1230: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:44 smithi033 ceph-mon[101165]: pgmap v1230: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:46 smithi037 ceph-mon[69017]: pgmap v1231: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:46 smithi033 ceph-mon[101165]: pgmap v1231: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:48 smithi037 ceph-mon[69017]: pgmap v1232: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:48 smithi033 ceph-mon[101165]: pgmap v1232: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:50 smithi037 ceph-mon[69017]: pgmap v1233: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:50 smithi033 ceph-mon[101165]: pgmap v1233: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:52 smithi037 ceph-mon[69017]: pgmap v1234: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:52 smithi033 ceph-mon[101165]: pgmap v1234: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:54 smithi037 ceph-mon[69017]: pgmap v1235: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:54 smithi033 ceph-mon[101165]: pgmap v1235: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:19:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:19:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:19:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:19:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:56 smithi037 ceph-mon[69017]: pgmap v1236: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:56 smithi033 ceph-mon[101165]: pgmap v1236: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:57.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:57 smithi037 ceph-mon[69017]: pgmap v1237: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:19:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:57 smithi033 ceph-mon[101165]: pgmap v1237: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:19:59 smithi033 ceph-mon[101165]: pgmap v1238: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:00.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:00 smithi033 conmon[101141]: 2022-02-02T14:19:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:20:00.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:19:59 smithi037 ceph-mon[69017]: pgmap v1238: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:01.239 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:20:01.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:20:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:02 smithi033 ceph-mon[101165]: pgmap v1239: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:02 smithi037 ceph-mon[69017]: pgmap v1239: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:03.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 -- 172.21.15.33:0/2267571567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f7980 msgr2=0x7f731c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 --2- 172.21.15.33:0/2267571567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f7980 0x7f731c0f7de0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f7304004660 tx=0x7f7304009b30).stop 2022-02-02T14:20:03.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 -- 172.21.15.33:0/2267571567 shutdown_connections 2022-02-02T14:20:03.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 --2- 172.21.15.33:0/2267571567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f7980 0x7f731c0f7de0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 --2- 172.21.15.33:0/2267571567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f66e0 0x7f731c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 -- 172.21.15.33:0/2267571567 >> 172.21.15.33:0/2267571567 conn(0x7f731c0f1e40 msgr2=0x7f731c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:03.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 -- 172.21.15.33:0/2267571567 shutdown_connections 2022-02-02T14:20:03.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.381+0000 7f7321132700 1 -- 172.21.15.33:0/2267571567 wait complete. 2022-02-02T14:20:03.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 Processor -- start 2022-02-02T14:20:03.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 -- start start 2022-02-02T14:20:03.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f7980 0x7f731c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c06a380 con 0x7f731c0f66e0 2022-02-02T14:20:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f7321132700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c06a4c0 con 0x7f731c0f7980 2022-02-02T14:20:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.382+0000 7f731ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60630/0 (socket says 172.21.15.33:60630) 2022-02-02T14:20:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 -- 172.21.15.33:0/1991314684 learned_addr learned my addr 172.21.15.33:0/1991314684 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731a59c700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f7980 0x7f731c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 -- 172.21.15.33:0/1991314684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f7980 msgr2=0x7f731c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f7980 0x7f731c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 -- 172.21.15.33:0/1991314684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7304005040 con 0x7f731c0f66e0 2022-02-02T14:20:03.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f731ad9d700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f730c002700 tx=0x7f730c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:03.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c0079c0 con 0x7f731c0f66e0 2022-02-02T14:20:03.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c06a7a0 con 0x7f731c0f66e0 2022-02-02T14:20:03.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f730c00f040 con 0x7f731c0f66e0 2022-02-02T14:20:03.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730c014860 con 0x7f731c0f66e0 2022-02-02T14:20:03.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.383+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c10ef90 con 0x7f731c0f66e0 2022-02-02T14:20:03.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.385+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c045ad0 con 0x7f731c0f66e0 2022-02-02T14:20:03.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.385+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f730c01b060 con 0x7f731c0f66e0 2022-02-02T14:20:03.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.386+0000 7f73137fe700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 0x7f7308067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.386+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f730c081930 con 0x7f731c0f66e0 2022-02-02T14:20:03.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.386+0000 7f731a59c700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 0x7f7308067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.386+0000 7f731a59c700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 0x7f7308067290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7304004630 tx=0x7f7304009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:03.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.390+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f730c04f9e0 con 0x7f731c0f66e0 2022-02-02T14:20:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.578+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f731c0fefe0 con 0x7f7308064dd0 2022-02-02T14:20:03.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.579+0000 7f73137fe700 1 -- 172.21.15.33:0/1991314684 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f731c0fefe0 con 0x7f7308064dd0 2022-02-02T14:20:03.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 msgr2=0x7f7308067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 0x7f7308067290 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f7304004630 tx=0x7f7304009b30).stop 2022-02-02T14:20:03.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 msgr2=0x7f731c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f730c002700 tx=0x7f730c009d80).stop 2022-02-02T14:20:03.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 shutdown_connections 2022-02-02T14:20:03.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7308064dd0 0x7f7308067290 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f731c0f66e0 0x7f731c06b9a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 --2- 172.21.15.33:0/1991314684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f731c0f7980 0x7f731c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 >> 172.21.15.33:0/1991314684 conn(0x7f731c0f1e40 msgr2=0x7f731c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:03.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 shutdown_connections 2022-02-02T14:20:03.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.581+0000 7f7321132700 1 -- 172.21.15.33:0/1991314684 wait complete. 2022-02-02T14:20:03.590 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:20:03.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 -- 172.21.15.33:0/4278261186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 msgr2=0x7f626c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 --2- 172.21.15.33:0/4278261186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c0f6cc0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f6258004660 tx=0x7f6258009b30).stop 2022-02-02T14:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 -- 172.21.15.33:0/4278261186 shutdown_connections 2022-02-02T14:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 --2- 172.21.15.33:0/4278261186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c0f6cc0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 --2- 172.21.15.33:0/4278261186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 -- 172.21.15.33:0/4278261186 >> 172.21.15.33:0/4278261186 conn(0x7f626c0f0d40 msgr2=0x7f626c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 -- 172.21.15.33:0/4278261186 shutdown_connections 2022-02-02T14:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.682+0000 7f6272de2700 1 -- 172.21.15.33:0/4278261186 wait complete. 2022-02-02T14:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 Processor -- start 2022-02-02T14:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 -- start start 2022-02-02T14:20:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c107a10 con 0x7f626c0f6860 2022-02-02T14:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.683+0000 7f6272de2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c107b50 con 0x7f626c0f55c0 2022-02-02T14:20:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60642/0 (socket says 172.21.15.33:60642) 2022-02-02T14:20:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 -- 172.21.15.33:0/2994942872 learned_addr learned my addr 172.21.15.33:0/2994942872 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f6270b7e700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 -- 172.21.15.33:0/2994942872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 msgr2=0x7f626c106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 -- 172.21.15.33:0/2994942872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258005040 con 0x7f626c0f6860 2022-02-02T14:20:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f6270b7e700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:20:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f626bfff700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f6258009830 tx=0x7f6258009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6258018070 con 0x7f626c0f6860 2022-02-02T14:20:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6258007ba0 con 0x7f626c0f6860 2022-02-02T14:20:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c108490 con 0x7f626c0f6860 2022-02-02T14:20:03.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1089f0 con 0x7f626c0f6860 2022-02-02T14:20:03.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.684+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f625801c3c0 con 0x7f626c0f6860 2022-02-02T14:20:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.685+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c045ad0 con 0x7f626c0f6860 2022-02-02T14:20:03.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.686+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f625801d420 con 0x7f626c0f6860 2022-02-02T14:20:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.687+0000 7f62697fa700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 0x7f625c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.687+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6258083590 con 0x7f626c0f6860 2022-02-02T14:20:03.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.687+0000 7f6270b7e700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 0x7f625c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.687+0000 7f6270b7e700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 0x7f625c067270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f626c0f66c0 tx=0x7f626000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:03.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.691+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6258055130 con 0x7f626c0f6860 2022-02-02T14:20:03.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.873+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f626c0faca0 con 0x7f625c064db0 2022-02-02T14:20:03.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.888+0000 7f62697fa700 1 -- 172.21.15.33:0/2994942872 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f626c0faca0 con 0x7f625c064db0 2022-02-02T14:20:03.888 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:20:03.888 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (45m) 7m ago 46m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:20:03.889 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (38m) 7m ago 46m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:20:03.889 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (38m) 7m ago 45m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:20:03.889 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (45m) 7m ago 46m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:20:03.889 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (38m) 7m ago 42m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:20:03.890 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (39m) 7m ago 42m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:20:03.890 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (40m) 7m ago 42m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:20:03.890 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (42m) 7m ago 42m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:20:03.890 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (39m) 7m ago 47m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:20:03.891 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (39m) 7m ago 45m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:20:03.891 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (39m) 7m ago 47m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:20:03.891 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (38m) 7m ago 45m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:20:03.891 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (46m) 7m ago 46m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:20:03.891 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (45m) 7m ago 45m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:20:03.892 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 7m ago 45m - 4096M 2022-02-02T14:20:03.892 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (44m) 7m ago 44m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:20:03.892 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (44m) 7m ago 44m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:20:03.892 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (44m) 7m ago 44m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:20:03.893 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (43m) 7m ago 43m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:20:03.893 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (43m) 7m ago 43m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:20:03.893 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (45m) 7m ago 45m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:20:03.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 msgr2=0x7f625c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 0x7f625c067270 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f626c0f66c0 tx=0x7f626000b040).stop 2022-02-02T14:20:03.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 msgr2=0x7f626c107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f6258009830 tx=0x7f6258009b30).stop 2022-02-02T14:20:03.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 shutdown_connections 2022-02-02T14:20:03.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f625c064db0 0x7f625c067270 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f626c0f55c0 0x7f626c106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 --2- 172.21.15.33:0/2994942872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f626c0f6860 0x7f626c107460 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 >> 172.21.15.33:0/2994942872 conn(0x7f626c0f0d40 msgr2=0x7f626c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:03.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 shutdown_connections 2022-02-02T14:20:03.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.890+0000 7f6272de2700 1 -- 172.21.15.33:0/2994942872 wait complete. 2022-02-02T14:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/3116776337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c280f9820 msgr2=0x7f8c280fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/3116776337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c280f9820 0x7f8c280fbc70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8c1c004660 tx=0x7f8c1c009b30).stop 2022-02-02T14:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/3116776337 shutdown_connections 2022-02-02T14:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/3116776337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c280f9820 0x7f8c280fbc70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/3116776337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c28060310 0x7f8c280f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/3116776337 >> 172.21.15.33:0/3116776337 conn(0x7f8c280f0d40 msgr2=0x7f8c280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/3116776337 shutdown_connections 2022-02-02T14:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.990+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/3116776337 wait complete. 2022-02-02T14:20:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 Processor -- start 2022-02-02T14:20:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 -- start start 2022-02-02T14:20:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c280f9820 0x7f8c28107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:03.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28107a10 con 0x7f8c28060310 2022-02-02T14:20:03.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2c9d5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c28107b50 con 0x7f8c280f9820 2022-02-02T14:20:03.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60650/0 (socket says 172.21.15.33:60650) 2022-02-02T14:20:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c2659c700 1 -- 172.21.15.33:0/1707482565 learned_addr learned my addr 172.21.15.33:0/1707482565 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.991+0000 7f8c25d9b700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c280f9820 0x7f8c28107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2659c700 1 -- 172.21.15.33:0/1707482565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c280f9820 msgr2=0x7f8c28107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2659c700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c280f9820 0x7f8c28107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2659c700 1 -- 172.21.15.33:0/1707482565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c005040 con 0x7f8c28060310 2022-02-02T14:20:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2659c700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f8c1800c510 tx=0x7f8c18007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c1800f650 con 0x7f8c28060310 2022-02-02T14:20:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c281084f0 con 0x7f8c28060310 2022-02-02T14:20:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c1800fc60 con 0x7f8c28060310 2022-02-02T14:20:03.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c18012c50 con 0x7f8c28060310 2022-02-02T14:20:03.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.992+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28108ab0 con 0x7f8c28060310 2022-02-02T14:20:03.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.993+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c28045ad0 con 0x7f8c28060310 2022-02-02T14:20:03.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.994+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c18010070 con 0x7f8c28060310 2022-02-02T14:20:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.994+0000 7f8c16ffd700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.994+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8c18082090 con 0x7f8c28060310 2022-02-02T14:20:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.994+0000 7f8c25d9b700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.995+0000 7f8c25d9b700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 0x7f8c10067290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f8c1c004630 tx=0x7f8c1c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:03.998+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c18053cb0 con 0x7f8c28060310 2022-02-02T14:20:04.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.243+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c280fef70 con 0x7f8c28060310 2022-02-02T14:20:04.243 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:04 smithi033 ceph-mon[101165]: pgmap v1240: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:04.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.243+0000 7f8c16ffd700 1 -- 172.21.15.33:0/1707482565 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8c18020070 con 0x7f8c28060310 2022-02-02T14:20:04.244 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:20:04.244 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:20:04.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:20:04.245 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:04.245 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:20:04.245 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:20:04.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:04.246 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:20:04.246 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:20:04.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:04.247 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:20:04.247 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:20:04.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:04.248 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:20:04.248 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:20:04.248 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:20:04.248 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:20:04.248 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:20:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 msgr2=0x7f8c10067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 0x7f8c10067290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f8c1c004630 tx=0x7f8c1c009b30).stop 2022-02-02T14:20:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 msgr2=0x7f8c28106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f8c1800c510 tx=0x7f8c18007e00).stop 2022-02-02T14:20:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 shutdown_connections 2022-02-02T14:20:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c10064dd0 0x7f8c10067290 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c28060310 0x7f8c28106f70 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 --2- 172.21.15.33:0/1707482565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c280f9820 0x7f8c28107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 >> 172.21.15.33:0/1707482565 conn(0x7f8c280f0d40 msgr2=0x7f8c280f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 shutdown_connections 2022-02-02T14:20:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.246+0000 7f8c2c9d5700 1 -- 172.21.15.33:0/1707482565 wait complete. 2022-02-02T14:20:04.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 -- 172.21.15.33:0/2160517510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f9740 msgr2=0x7f15200fbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 --2- 172.21.15.33:0/2160517510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f9740 0x7f15200fbb30 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f1514004660 tx=0x7f1514009b30).stop 2022-02-02T14:20:04.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 -- 172.21.15.33:0/2160517510 shutdown_connections 2022-02-02T14:20:04.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 --2- 172.21.15.33:0/2160517510 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f9740 0x7f15200fbb30 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 --2- 172.21.15.33:0/2160517510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1520060290 0x7f15200f91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.346+0000 7f15255c8700 1 -- 172.21.15.33:0/2160517510 >> 172.21.15.33:0/2160517510 conn(0x7f15200f0bc0 msgr2=0x7f15200f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.347+0000 7f15255c8700 1 -- 172.21.15.33:0/2160517510 shutdown_connections 2022-02-02T14:20:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.347+0000 7f15255c8700 1 -- 172.21.15.33:0/2160517510 wait complete. 2022-02-02T14:20:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.347+0000 7f15255c8700 1 Processor -- start 2022-02-02T14:20:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.347+0000 7f15255c8700 1 -- start start 2022-02-02T14:20:04.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15255c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:04.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15255c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f9740 0x7f15201072c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:04.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15255c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15201078c0 con 0x7f1520060290 2022-02-02T14:20:04.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15255c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520108100 con 0x7f15200f9740 2022-02-02T14:20:04.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:04.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60660/0 (socket says 172.21.15.33:60660) 2022-02-02T14:20:04.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 -- 172.21.15.33:0/1617731395 learned_addr learned my addr 172.21.15.33:0/1617731395 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:04.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151e7fc700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f9740 0x7f15201072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:04.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 -- 172.21.15.33:0/1617731395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f9740 msgr2=0x7f15201072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f9740 0x7f15201072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 -- 172.21.15.33:0/1617731395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514005040 con 0x7f1520060290 2022-02-02T14:20:04.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f151effd700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f15100026d0 tx=0x7f1510009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:04.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1510009320 con 0x7f1520060290 2022-02-02T14:20:04.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.348+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15201083e0 con 0x7f1520060290 2022-02-02T14:20:04.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.349+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f151000f040 con 0x7f1520060290 2022-02-02T14:20:04.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.349+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1520108920 con 0x7f1520060290 2022-02-02T14:20:04.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.349+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15100147e0 con 0x7f1520060290 2022-02-02T14:20:04.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.350+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1500004fa0 con 0x7f1520060290 2022-02-02T14:20:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.350+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1510009480 con 0x7f1520060290 2022-02-02T14:20:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.351+0000 7f15077fe700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 0x7f15080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.351+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1510082030 con 0x7f1520060290 2022-02-02T14:20:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.351+0000 7f151e7fc700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 0x7f15080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.351+0000 7f151e7fc700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 0x7f15080672e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f1514004e30 tx=0x7f1514009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.355+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f15100500e0 con 0x7f1520060290 2022-02-02T14:20:04.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:04 smithi037 ceph-mon[69017]: pgmap v1240: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:04.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.566+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1500005e80 con 0x7f1520060290 2022-02-02T14:20:04.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.566+0000 7f15077fe700 1 -- 172.21.15.33:0/1617731395 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1510053700 con 0x7f1520060290 2022-02-02T14:20:04.566 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:20:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:20:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:20:04.567 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:20:04.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:04.568 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:20:04.568 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:20:04.568 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:20:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:20:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:20:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:20:04.569 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:20:04.570 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:20:04.570 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:20:04.570 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:20:04.570 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:20:04.571 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:20:04.571 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:20:04.571 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:20:04.571 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:20:04.572 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:20:04.572 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:20:04.572 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:20:04.572 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:20:04.572 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:20:04.573 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:20:04.573 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:20:04.573 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:20:04.573 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:20:04.574 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:20:04.574 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:20:04.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:04.574 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:04.575 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:20:04.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:04.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:04.575 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:04.576 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:04.576 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 msgr2=0x7f15080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 0x7f15080672e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f1514004e30 tx=0x7f1514009b30).stop 2022-02-02T14:20:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 msgr2=0x7f1520106dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f15100026d0 tx=0x7f1510009de0).stop 2022-02-02T14:20:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 shutdown_connections 2022-02-02T14:20:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1508064e20 0x7f15080672e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1520060290 0x7f1520106dd0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 --2- 172.21.15.33:0/1617731395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f9740 0x7f15201072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 >> 172.21.15.33:0/1617731395 conn(0x7f15200f0bc0 msgr2=0x7f15200f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 shutdown_connections 2022-02-02T14:20:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:04.570+0000 7f15255c8700 1 -- 172.21.15.33:0/1617731395 wait complete. 2022-02-02T14:20:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:20:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:05 smithi033 ceph-mon[101165]: from='client.35350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:05 smithi033 ceph-mon[101165]: from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:05.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1707482565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:20:05.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1617731395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:20:05.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:05 smithi037 ceph-mon[69017]: from='client.35350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:05 smithi037 ceph-mon[69017]: from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1707482565' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:20:05.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1617731395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:20:06.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:06 smithi033 ceph-mon[101165]: pgmap v1241: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:06 smithi037 ceph-mon[69017]: pgmap v1241: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:08 smithi033 ceph-mon[101165]: pgmap v1242: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:08 smithi037 ceph-mon[69017]: pgmap v1242: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:10 smithi033 ceph-mon[101165]: pgmap v1243: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:10 smithi037 ceph-mon[69017]: pgmap v1243: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:12 smithi033 ceph-mon[101165]: pgmap v1244: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:12 smithi037 ceph-mon[69017]: pgmap v1244: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:14 smithi033 ceph-mon[101165]: pgmap v1245: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:14 smithi037 ceph-mon[69017]: pgmap v1245: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:16 smithi033 ceph-mon[101165]: pgmap v1246: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:16 smithi037 ceph-mon[69017]: pgmap v1246: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:18 smithi033 ceph-mon[101165]: pgmap v1247: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:18 smithi037 ceph-mon[69017]: pgmap v1247: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:20 smithi033 ceph-mon[101165]: pgmap v1248: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:20 smithi037 ceph-mon[69017]: pgmap v1248: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:22 smithi033 ceph-mon[101165]: pgmap v1249: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:22 smithi037 ceph-mon[69017]: pgmap v1249: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:24 smithi033 ceph-mon[101165]: pgmap v1250: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:24 smithi037 ceph-mon[69017]: pgmap v1250: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:26 smithi033 ceph-mon[101165]: pgmap v1251: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:26 smithi037 ceph-mon[69017]: pgmap v1251: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:28 smithi033 ceph-mon[101165]: pgmap v1252: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:28 smithi037 ceph-mon[69017]: pgmap v1252: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:30 smithi033 ceph-mon[101165]: pgmap v1253: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:30.546 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:30 smithi037 ceph-mon[69017]: pgmap v1253: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:32 smithi033 ceph-mon[101165]: pgmap v1254: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:32 smithi037 ceph-mon[69017]: pgmap v1254: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:34 smithi033 ceph-mon[101165]: pgmap v1255: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:34 smithi037 ceph-mon[69017]: pgmap v1255: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:34.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.685+0000 7f5231ea1700 1 -- 172.21.15.33:0/1560310997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f6860 msgr2=0x7f522c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.685+0000 7f5231ea1700 1 --2- 172.21.15.33:0/1560310997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f6860 0x7f522c0f6cc0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f5220004660 tx=0x7f5220009b30).stop 2022-02-02T14:20:34.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 -- 172.21.15.33:0/1560310997 shutdown_connections 2022-02-02T14:20:34.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 --2- 172.21.15.33:0/1560310997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f6860 0x7f522c0f6cc0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 --2- 172.21.15.33:0/1560310997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f55c0 0x7f522c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 -- 172.21.15.33:0/1560310997 >> 172.21.15.33:0/1560310997 conn(0x7f522c0f0d40 msgr2=0x7f522c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:34.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 -- 172.21.15.33:0/1560310997 shutdown_connections 2022-02-02T14:20:34.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 -- 172.21.15.33:0/1560310997 wait complete. 2022-02-02T14:20:34.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 Processor -- start 2022-02-02T14:20:34.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.686+0000 7f5231ea1700 1 -- start start 2022-02-02T14:20:34.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f5231ea1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f5231ea1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f6860 0x7f522c1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f5231ea1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1069b0 con 0x7f522c0f55c0 2022-02-02T14:20:34.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f5231ea1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f522c1071c0 con 0x7f522c0f6860 2022-02-02T14:20:34.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60670/0 (socket says 172.21.15.33:60670) 2022-02-02T14:20:34.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 -- 172.21.15.33:0/2745683889 learned_addr learned my addr 172.21.15.33:0/2745683889 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:34.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522affd700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f6860 0x7f522c1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 -- 172.21.15.33:0/2745683889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f6860 msgr2=0x7f522c1063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f6860 0x7f522c1063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 -- 172.21.15.33:0/2745683889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5220005040 con 0x7f522c0f55c0 2022-02-02T14:20:34.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f522b7fe700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f521c002700 tx=0x7f521c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:34.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.687+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f521c0079c0 con 0x7f522c0f55c0 2022-02-02T14:20:34.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.688+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f522c107440 con 0x7f522c0f55c0 2022-02-02T14:20:34.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.688+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f522c107a00 con 0x7f522c0f55c0 2022-02-02T14:20:34.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.688+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f521c00f040 con 0x7f522c0f55c0 2022-02-02T14:20:34.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.688+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f521c014860 con 0x7f522c0f55c0 2022-02-02T14:20:34.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.689+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f522c0f49b0 con 0x7f522c0f55c0 2022-02-02T14:20:34.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.689+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f521c01b060 con 0x7f522c0f55c0 2022-02-02T14:20:34.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.690+0000 7f5213fff700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 0x7f5214067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.690+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f521c081840 con 0x7f522c0f55c0 2022-02-02T14:20:34.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.690+0000 7f522affd700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 0x7f5214067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.690+0000 7f522affd700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 0x7f5214067290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f5220004630 tx=0x7f5220009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:34.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.694+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f521c04f8f0 con 0x7f522c0f55c0 2022-02-02T14:20:34.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.882+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f522c0fde60 con 0x7f5214064dd0 2022-02-02T14:20:34.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.883+0000 7f5213fff700 1 -- 172.21.15.33:0/2745683889 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f522c0fde60 con 0x7f5214064dd0 2022-02-02T14:20:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 msgr2=0x7f5214067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 0x7f5214067290 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f5220004630 tx=0x7f5220009b30).stop 2022-02-02T14:20:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 msgr2=0x7f522c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f521c002700 tx=0x7f521c009d80).stop 2022-02-02T14:20:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 shutdown_connections 2022-02-02T14:20:34.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5214064dd0 0x7f5214067290 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f522c0f55c0 0x7f522c105ec0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 --2- 172.21.15.33:0/2745683889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f522c0f6860 0x7f522c1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 >> 172.21.15.33:0/2745683889 conn(0x7f522c0f0d40 msgr2=0x7f522c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.885+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 shutdown_connections 2022-02-02T14:20:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.886+0000 7f5231ea1700 1 -- 172.21.15.33:0/2745683889 wait complete. 2022-02-02T14:20:34.895 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:20:34.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 -- 172.21.15.33:0/2157968615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 msgr2=0x7f99040f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 --2- 172.21.15.33:0/2157968615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f99040f59e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f9900004660 tx=0x7f9900009b30).stop 2022-02-02T14:20:34.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 -- 172.21.15.33:0/2157968615 shutdown_connections 2022-02-02T14:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 --2- 172.21.15.33:0/2157968615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 0x7f99040f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 --2- 172.21.15.33:0/2157968615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f99040f59e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 -- 172.21.15.33:0/2157968615 >> 172.21.15.33:0/2157968615 conn(0x7f99040f0d40 msgr2=0x7f99040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 -- 172.21.15.33:0/2157968615 shutdown_connections 2022-02-02T14:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.986+0000 7f990b684700 1 -- 172.21.15.33:0/2157968615 wait complete. 2022-02-02T14:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 Processor -- start 2022-02-02T14:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 -- start start 2022-02-02T14:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 0x7f9904107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904107a10 con 0x7f99040f55c0 2022-02-02T14:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f990b684700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9904107b50 con 0x7f99040f6860 2022-02-02T14:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f9909420700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.987+0000 7f9909420700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60680/0 (socket says 172.21.15.33:60680) 2022-02-02T14:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9909420700 1 -- 172.21.15.33:0/2660971842 learned_addr learned my addr 172.21.15.33:0/2660971842 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9908c1f700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 0x7f9904107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9909420700 1 -- 172.21.15.33:0/2660971842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 msgr2=0x7f9904107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9909420700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 0x7f9904107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9909420700 1 -- 172.21.15.33:0/2660971842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9900005040 con 0x7f99040f55c0 2022-02-02T14:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f9909420700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f9900004f60 tx=0x7f9900009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9900018070 con 0x7f99040f55c0 2022-02-02T14:20:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9900009770 con 0x7f99040f55c0 2022-02-02T14:20:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9904108490 con 0x7f99040f55c0 2022-02-02T14:20:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f990001c3c0 con 0x7f99040f55c0 2022-02-02T14:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.988+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99041089f0 con 0x7f99040f55c0 2022-02-02T14:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.990+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904045ad0 con 0x7f99040f55c0 2022-02-02T14:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.990+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f990001d420 con 0x7f99040f55c0 2022-02-02T14:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.990+0000 7f98f5ffb700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 0x7f98f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.990+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f99000837d0 con 0x7f99040f55c0 2022-02-02T14:20:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.991+0000 7f9908c1f700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 0x7f98f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.991+0000 7f9908c1f700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 0x7f98f0067290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f98f80041d0 tx=0x7f98f8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:34.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:34.995+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99000552b0 con 0x7f99040f55c0 2022-02-02T14:20:35.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.176+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f990405fd30 con 0x7f98f0064dd0 2022-02-02T14:20:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.190+0000 7f98f5ffb700 1 -- 172.21.15.33:0/2660971842 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f990405fd30 con 0x7f98f0064dd0 2022-02-02T14:20:35.190 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:20:35.191 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (45m) 7m ago 46m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:20:35.191 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (38m) 7m ago 46m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:20:35.191 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (38m) 8m ago 46m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:20:35.191 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (45m) 7m ago 46m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:20:35.191 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (39m) 7m ago 43m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:20:35.192 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (40m) 7m ago 43m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:20:35.192 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (40m) 8m ago 43m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:20:35.192 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (43m) 8m ago 43m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:20:35.192 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (40m) 7m ago 48m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:20:35.193 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (40m) 8m ago 46m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:20:35.193 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (39m) 7m ago 48m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:20:35.193 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (39m) 8m ago 46m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:20:35.193 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (46m) 7m ago 46m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:20:35.194 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (46m) 8m ago 46m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:20:35.194 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 7m ago 45m - 4096M 2022-02-02T14:20:35.194 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (45m) 7m ago 45m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:20:35.194 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (45m) 7m ago 44m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:20:35.194 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (44m) 8m ago 44m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:20:35.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (44m) 8m ago 44m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:20:35.195 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (44m) 8m ago 44m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:20:35.195 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (45m) 7m ago 46m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:20:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 msgr2=0x7f98f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 0x7f98f0067290 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f98f80041d0 tx=0x7f98f8009040).stop 2022-02-02T14:20:35.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 msgr2=0x7f9904106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f9900004f60 tx=0x7f9900009b30).stop 2022-02-02T14:20:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 shutdown_connections 2022-02-02T14:20:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f98f0064dd0 0x7f98f0067290 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99040f55c0 0x7f9904106f70 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 --2- 172.21.15.33:0/2660971842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99040f6860 0x7f9904107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 >> 172.21.15.33:0/2660971842 conn(0x7f99040f0d40 msgr2=0x7f990405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 shutdown_connections 2022-02-02T14:20:35.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.192+0000 7f990b684700 1 -- 172.21.15.33:0/2660971842 wait complete. 2022-02-02T14:20:35.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 -- 172.21.15.33:0/251005605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 msgr2=0x7fe8f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/251005605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f00f7de0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fe8d8004660 tx=0x7fe8d8009b30).stop 2022-02-02T14:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 -- 172.21.15.33:0/251005605 shutdown_connections 2022-02-02T14:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/251005605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f00f7de0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/251005605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 0x7fe8f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 -- 172.21.15.33:0/251005605 >> 172.21.15.33:0/251005605 conn(0x7fe8f00f1e40 msgr2=0x7fe8f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 -- 172.21.15.33:0/251005605 shutdown_connections 2022-02-02T14:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.293+0000 7fe8f4f02700 1 -- 172.21.15.33:0/251005605 wait complete. 2022-02-02T14:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.294+0000 7fe8f4f02700 1 Processor -- start 2022-02-02T14:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.294+0000 7fe8f4f02700 1 -- start start 2022-02-02T14:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.294+0000 7fe8f4f02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 0x7fe8f0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8f4f02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8f4f02700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0107a00 con 0x7fe8f00f7980 2022-02-02T14:20:35.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8f4f02700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0107b40 con 0x7fe8f00f66e0 2022-02-02T14:20:35.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60692/0 (socket says 172.21.15.33:60692) 2022-02-02T14:20:35.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 -- 172.21.15.33:0/3337655054 learned_addr learned my addr 172.21.15.33:0/3337655054 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:35.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8ee59c700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 0x7fe8f0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 -- 172.21.15.33:0/3337655054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 msgr2=0x7fe8f0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 0x7fe8f0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 -- 172.21.15.33:0/3337655054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8005040 con 0x7fe8f00f7980 2022-02-02T14:20:35.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8edd9b700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe8d8009990 tx=0x7fe8d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:35.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d8018070 con 0x7fe8f00f7980 2022-02-02T14:20:35.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f0108480 con 0x7fe8f00f7980 2022-02-02T14:20:35.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe8d8007ba0 con 0x7fe8f00f7980 2022-02-02T14:20:35.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8d801c3c0 con 0x7fe8f00f7980 2022-02-02T14:20:35.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.295+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f01089e0 con 0x7fe8f00f7980 2022-02-02T14:20:35.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.297+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f0045ad0 con 0x7fe8f00f7980 2022-02-02T14:20:35.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.297+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe8d801d420 con 0x7fe8f00f7980 2022-02-02T14:20:35.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.297+0000 7fe8e6ffd700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 0x7fe8dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.297+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe8d80832d0 con 0x7fe8f00f7980 2022-02-02T14:20:35.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.297+0000 7fe8ee59c700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 0x7fe8dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.298+0000 7fe8ee59c700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 0x7fe8dc067290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fe8f00f77e0 tx=0x7fe8e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:35.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.302+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe8d8054d90 con 0x7fe8f00f7980 2022-02-02T14:20:35.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.549+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe8f00ff020 con 0x7fe8f00f7980 2022-02-02T14:20:35.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.550+0000 7fe8e6ffd700 1 -- 172.21.15.33:0/3337655054 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe8d8054980 con 0x7fe8f00f7980 2022-02-02T14:20:35.550 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:20:35.550 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:20:35.550 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:20:35.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:35.551 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:20:35.551 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:20:35.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:35.551 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:20:35.551 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:20:35.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:35.552 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:20:35.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:20:35.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:20:35.553 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:20:35.553 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:20:35.553 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:20:35.553 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:20:35.554 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:20:35.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 msgr2=0x7fe8dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 0x7fe8dc067290 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fe8f00f77e0 tx=0x7fe8e000b040).stop 2022-02-02T14:20:35.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 msgr2=0x7fe8f0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7fe8d8009990 tx=0x7fe8d8009b30).stop 2022-02-02T14:20:35.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 shutdown_connections 2022-02-02T14:20:35.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe8dc064dd0 0x7fe8dc067290 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8f00f66e0 0x7fe8f0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 --2- 172.21.15.33:0/3337655054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8f00f7980 0x7fe8f0107450 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.552+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 >> 172.21.15.33:0/3337655054 conn(0x7fe8f00f1e40 msgr2=0x7fe8f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.553+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 shutdown_connections 2022-02-02T14:20:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.553+0000 7fe8f4f02700 1 -- 172.21.15.33:0/3337655054 wait complete. 2022-02-02T14:20:35.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- 172.21.15.33:0/2835527319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 msgr2=0x7fdfa40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/2835527319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f59e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fdfa0004660 tx=0x7fdfa0009b30).stop 2022-02-02T14:20:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- 172.21.15.33:0/2835527319 shutdown_connections 2022-02-02T14:20:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/2835527319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 0x7fdfa40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/2835527319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f59e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- 172.21.15.33:0/2835527319 >> 172.21.15.33:0/2835527319 conn(0x7fdfa40f0d40 msgr2=0x7fdfa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- 172.21.15.33:0/2835527319 shutdown_connections 2022-02-02T14:20:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- 172.21.15.33:0/2835527319 wait complete. 2022-02-02T14:20:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 Processor -- start 2022-02-02T14:20:35.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.654+0000 7fdfac0a1700 1 -- start start 2022-02-02T14:20:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 0x7fdfa40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40f8100 con 0x7fdfa40f55c0 2022-02-02T14:20:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40f8240 con 0x7fdfa40f6860 2022-02-02T14:20:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60700/0 (socket says 172.21.15.33:60700) 2022-02-02T14:20:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 -- 172.21.15.33:0/379195165 learned_addr learned my addr 172.21.15.33:0/379195165 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:20:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa963c700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 0x7fdfa40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 -- 172.21.15.33:0/379195165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 msgr2=0x7fdfa40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 0x7fdfa40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 -- 172.21.15.33:0/379195165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa0005040 con 0x7fdfa40f55c0 2022-02-02T14:20:35.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfa9e3d700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fdfa0014040 tx=0x7fdfa000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:35.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa0019070 con 0x7fdfa40f55c0 2022-02-02T14:20:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa40f84c0 con 0x7fdfa40f55c0 2022-02-02T14:20:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdfa0007e70 con 0x7fdfa40f55c0 2022-02-02T14:20:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfa0014d10 con 0x7fdfa40f55c0 2022-02-02T14:20:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.655+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40f8a20 con 0x7fdfa40f55c0 2022-02-02T14:20:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.656+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa4045ad0 con 0x7fdfa40f55c0 2022-02-02T14:20:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.657+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdfa0025070 con 0x7fdfa40f55c0 2022-02-02T14:20:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.657+0000 7fdf9a7fc700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 0x7fdf90067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:20:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.657+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdfa0082a80 con 0x7fdfa40f55c0 2022-02-02T14:20:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.658+0000 7fdfa963c700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 0x7fdf90067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:20:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.658+0000 7fdfa963c700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 0x7fdf90067290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fdf94009fd0 tx=0x7fdf9400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:20:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.662+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdfa0050b30 con 0x7fdfa40f55c0 2022-02-02T14:20:35.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.873+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdfa410f670 con 0x7fdfa40f55c0 2022-02-02T14:20:35.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.873+0000 7fdf9a7fc700 1 -- 172.21.15.33:0/379195165 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fdfa0023020 con 0x7fdfa40f55c0 2022-02-02T14:20:35.873 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:20:35.874 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:20:35.874 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:20:35.874 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:20:35.874 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:35.875 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:20:35.875 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:20:35.875 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:20:35.875 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:20:35.876 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:20:35.876 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:20:35.876 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:20:35.876 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:20:35.877 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:20:35.877 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:20:35.877 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:20:35.877 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:20:35.877 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:20:35.878 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:20:35.878 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:20:35.878 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:20:35.878 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:20:35.879 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:20:35.879 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:20:35.879 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:20:35.880 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:20:35.880 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:20:35.880 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:20:35.880 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:20:35.881 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:20:35.881 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:20:35.881 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:35.881 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:35.881 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:20:35.882 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:20:35.882 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:35.882 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:35.882 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:35.883 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:20:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 msgr2=0x7fdf90067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 0x7fdf90067290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fdf94009fd0 tx=0x7fdf9400b040).stop 2022-02-02T14:20:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 msgr2=0x7fdfa40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:20:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7fdfa0014040 tx=0x7fdfa000b040).stop 2022-02-02T14:20:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 shutdown_connections 2022-02-02T14:20:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf90064dd0 0x7fdf90067290 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfa40f55c0 0x7fdfa40f9720 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 --2- 172.21.15.33:0/379195165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfa40f6860 0x7fdfa40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:20:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 >> 172.21.15.33:0/379195165 conn(0x7fdfa40f0d40 msgr2=0x7fdfa405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:20:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 shutdown_connections 2022-02-02T14:20:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:20:35.877+0000 7fdfac0a1700 1 -- 172.21.15.33:0/379195165 wait complete. 2022-02-02T14:20:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:20:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:36 smithi033 ceph-mon[101165]: pgmap v1256: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:36 smithi033 ceph-mon[101165]: from='client.35366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:36 smithi033 ceph-mon[101165]: from='client.35370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3337655054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:20:36.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/379195165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:20:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:36 smithi037 ceph-mon[69017]: pgmap v1256: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:36 smithi037 ceph-mon[69017]: from='client.35366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:36 smithi037 ceph-mon[69017]: from='client.35370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:20:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3337655054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:20:36.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/379195165' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:20:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:38 smithi033 ceph-mon[101165]: pgmap v1257: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:38 smithi037 ceph-mon[69017]: pgmap v1257: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:40 smithi033 ceph-mon[101165]: pgmap v1258: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:40 smithi037 ceph-mon[69017]: pgmap v1258: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:42 smithi033 ceph-mon[101165]: pgmap v1259: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:42 smithi037 ceph-mon[69017]: pgmap v1259: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:44 smithi033 ceph-mon[101165]: pgmap v1260: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:44 smithi037 ceph-mon[69017]: pgmap v1260: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:46.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:46 smithi033 ceph-mon[101165]: pgmap v1261: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:46 smithi037 ceph-mon[69017]: pgmap v1261: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:48 smithi033 ceph-mon[101165]: pgmap v1262: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:48 smithi037 ceph-mon[69017]: pgmap v1262: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:50 smithi033 ceph-mon[101165]: pgmap v1263: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:50 smithi037 ceph-mon[69017]: pgmap v1263: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:52 smithi033 ceph-mon[101165]: pgmap v1264: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:52 smithi037 ceph-mon[69017]: pgmap v1264: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:54 smithi033 ceph-mon[101165]: pgmap v1265: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:54 smithi037 ceph-mon[69017]: pgmap v1265: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:20:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:20:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:20:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:20:56.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:56 smithi033 ceph-mon[101165]: pgmap v1266: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:56 smithi037 ceph-mon[69017]: pgmap v1266: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:20:58 smithi033 ceph-mon[101165]: pgmap v1267: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:20:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:20:58 smithi037 ceph-mon[69017]: pgmap v1267: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:00 smithi033 ceph-mon[101165]: pgmap v1268: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:00 smithi037 ceph-mon[69017]: pgmap v1268: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:02 smithi033 ceph-mon[101165]: pgmap v1269: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:02 smithi037 ceph-mon[69017]: pgmap v1269: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:04 smithi033 ceph-mon[101165]: pgmap v1270: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:04 smithi037 ceph-mon[69017]: pgmap v1270: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:05.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 -- 172.21.15.33:0/4275322456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f55c0 msgr2=0x7faa140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 --2- 172.21.15.33:0/4275322456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f55c0 0x7faa140f59e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7faa04004660 tx=0x7faa04009b30).stop 2022-02-02T14:21:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 -- 172.21.15.33:0/4275322456 shutdown_connections 2022-02-02T14:21:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 --2- 172.21.15.33:0/4275322456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f6860 0x7faa140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 --2- 172.21.15.33:0/4275322456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f55c0 0x7faa140f59e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:05.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 -- 172.21.15.33:0/4275322456 >> 172.21.15.33:0/4275322456 conn(0x7faa140f0d40 msgr2=0x7faa140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:05.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 -- 172.21.15.33:0/4275322456 shutdown_connections 2022-02-02T14:21:05.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.993+0000 7faa1a682700 1 -- 172.21.15.33:0/4275322456 wait complete. 2022-02-02T14:21:05.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 Processor -- start 2022-02-02T14:21:05.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 -- start start 2022-02-02T14:21:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f55c0 0x7faa14109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa140603c0 con 0x7faa140f6860 2022-02-02T14:21:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa1a682700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa14060500 con 0x7faa140f55c0 2022-02-02T14:21:05.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:05.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60712/0 (socket says 172.21.15.33:60712) 2022-02-02T14:21:05.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa137fe700 1 -- 172.21.15.33:0/1784815504 learned_addr learned my addr 172.21.15.33:0/1784815504 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.994+0000 7faa13fff700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f55c0 0x7faa14109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa137fe700 1 -- 172.21.15.33:0/1784815504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f55c0 msgr2=0x7faa14109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa137fe700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f55c0 0x7faa14109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa137fe700 1 -- 172.21.15.33:0/1784815504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa04005040 con 0x7faa140f6860 2022-02-02T14:21:06.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa137fe700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fa9fc0026d0 tx=0x7fa9fc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9fc0079c0 con 0x7faa140f6860 2022-02-02T14:21:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1410c740 con 0x7faa140f6860 2022-02-02T14:21:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9fc00f040 con 0x7faa140f6860 2022-02-02T14:21:06.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9fc0148b0 con 0x7faa140f6860 2022-02-02T14:21:06.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.995+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1410ccd0 con 0x7faa140f6860 2022-02-02T14:21:06.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.996+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa140f49b0 con 0x7faa140f6860 2022-02-02T14:21:06.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.996+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa9fc007b20 con 0x7faa140f6860 2022-02-02T14:21:06.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.997+0000 7faa10ff9700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 0x7faa00067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.997+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa9fc0819e0 con 0x7faa140f6860 2022-02-02T14:21:06.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.997+0000 7faa13fff700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 0x7faa00067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:05.998+0000 7faa13fff700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 0x7faa00067290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7faa04013690 tx=0x7faa04009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.001+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa9fc04fa90 con 0x7faa140f6860 2022-02-02T14:21:06.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.192+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa140fdf00 con 0x7faa00064dd0 2022-02-02T14:21:06.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.194+0000 7faa10ff9700 1 -- 172.21.15.33:0/1784815504 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7faa140fdf00 con 0x7faa00064dd0 2022-02-02T14:21:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 msgr2=0x7faa00067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 0x7faa00067290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7faa04013690 tx=0x7faa04009b30).stop 2022-02-02T14:21:06.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 msgr2=0x7faa1410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7fa9fc0026d0 tx=0x7fa9fc009de0).stop 2022-02-02T14:21:06.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 shutdown_connections 2022-02-02T14:21:06.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa00064dd0 0x7faa00067290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa140f55c0 0x7faa14109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 --2- 172.21.15.33:0/1784815504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa140f6860 0x7faa1410c190 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.195+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 >> 172.21.15.33:0/1784815504 conn(0x7faa140f0d40 msgr2=0x7faa140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.196+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 shutdown_connections 2022-02-02T14:21:06.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.196+0000 7faa1a682700 1 -- 172.21.15.33:0/1784815504 wait complete. 2022-02-02T14:21:06.205 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 -- 172.21.15.33:0/2695290287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 msgr2=0x7f86000f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 --2- 172.21.15.33:0/2695290287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f86000f59e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f85f0004660 tx=0x7f85f0009b30).stop 2022-02-02T14:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 -- 172.21.15.33:0/2695290287 shutdown_connections 2022-02-02T14:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 --2- 172.21.15.33:0/2695290287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f86000f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 --2- 172.21.15.33:0/2695290287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f86000f59e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 -- 172.21.15.33:0/2695290287 >> 172.21.15.33:0/2695290287 conn(0x7f86000f0d40 msgr2=0x7f86000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 -- 172.21.15.33:0/2695290287 shutdown_connections 2022-02-02T14:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.298+0000 7f8604b3b700 1 -- 172.21.15.33:0/2695290287 wait complete. 2022-02-02T14:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 Processor -- start 2022-02-02T14:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 -- start start 2022-02-02T14:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f8600106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600106910 con 0x7f86000f55c0 2022-02-02T14:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f8604b3b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600106a50 con 0x7f86000f6860 2022-02-02T14:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60720/0 (socket says 172.21.15.33:60720) 2022-02-02T14:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 -- 172.21.15.33:0/3067769139 learned_addr learned my addr 172.21.15.33:0/3067769139 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fdd9b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f8600106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 -- 172.21.15.33:0/3067769139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 msgr2=0x7f8600106360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f8600106360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fe59c700 1 -- 172.21.15.33:0/3067769139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f0005040 con 0x7f86000f55c0 2022-02-02T14:21:06.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.299+0000 7f85fdd9b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f8600106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:21:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f85fe59c700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f85f0004570 tx=0x7f85f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f001a070 con 0x7f86000f55c0 2022-02-02T14:21:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f85f0009630 con 0x7f86000f55c0 2022-02-02T14:21:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85f001f8d0 con 0x7f86000f55c0 2022-02-02T14:21:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8600107390 con 0x7f86000f55c0 2022-02-02T14:21:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.300+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86001078a0 con 0x7f86000f55c0 2022-02-02T14:21:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.301+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8600045ad0 con 0x7f86000f55c0 2022-02-02T14:21:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.301+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f85f00125d0 con 0x7f86000f55c0 2022-02-02T14:21:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.302+0000 7f85f6ffd700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 0x7f85ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.302+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f85f0085dc0 con 0x7f86000f55c0 2022-02-02T14:21:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.302+0000 7f85fdd9b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 0x7f85ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.302+0000 7f85fdd9b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 0x7f85ec067290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f85e8009fd0 tx=0x7f85e800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.306+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f85f00578a0 con 0x7f86000f55c0 2022-02-02T14:21:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.488+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f860005f620 con 0x7f85ec064dd0 2022-02-02T14:21:06.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:06 smithi033 ceph-mon[101165]: pgmap v1271: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:06.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.503+0000 7f85f6ffd700 1 -- 172.21.15.33:0/3067769139 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f860005f620 con 0x7f85ec064dd0 2022-02-02T14:21:06.503 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:21:06.504 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (46m) 8m ago 47m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:21:06.504 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (39m) 8m ago 47m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:21:06.504 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (39m) 8m ago 46m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:21:06.504 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (46m) 8m ago 47m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:21:06.504 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (39m) 8m ago 43m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:21:06.505 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (40m) 8m ago 43m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:21:06.505 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (41m) 8m ago 43m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:21:06.505 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (43m) 8m ago 43m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:21:06.505 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (41m) 8m ago 48m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:21:06.506 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (40m) 8m ago 46m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:21:06.506 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (40m) 8m ago 48m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:21:06.506 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (39m) 8m ago 46m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:21:06.506 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (47m) 8m ago 47m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:21:06.507 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (46m) 8m ago 46m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:21:06.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 8m ago 46m - 4096M 2022-02-02T14:21:06.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (45m) 8m ago 45m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:21:06.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (45m) 8m ago 45m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:21:06.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (45m) 8m ago 45m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:21:06.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (44m) 8m ago 44m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:21:06.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (44m) 8m ago 44m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:21:06.508 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (46m) 8m ago 46m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:21:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 msgr2=0x7f85ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 0x7f85ec067290 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f85e8009fd0 tx=0x7f85e800b040).stop 2022-02-02T14:21:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 msgr2=0x7f8600105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f85f0004570 tx=0x7f85f0009b30).stop 2022-02-02T14:21:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 shutdown_connections 2022-02-02T14:21:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f85ec064dd0 0x7f85ec067290 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000f55c0 0x7f8600105e70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 --2- 172.21.15.33:0/3067769139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86000f6860 0x7f8600106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 >> 172.21.15.33:0/3067769139 conn(0x7f86000f0d40 msgr2=0x7f86000fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 shutdown_connections 2022-02-02T14:21:06.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.505+0000 7f8604b3b700 1 -- 172.21.15.33:0/3067769139 wait complete. 2022-02-02T14:21:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:06 smithi037 ceph-mon[69017]: pgmap v1271: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2128856447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 msgr2=0x7fbb4c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2128856447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c0f5850 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fbb40004660 tx=0x7fbb40009b30).stop 2022-02-02T14:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2128856447 shutdown_connections 2022-02-02T14:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2128856447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 0x7fbb4c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2128856447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c0f5850 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2128856447 >> 172.21.15.33:0/2128856447 conn(0x7fbb4c0f0b90 msgr2=0x7fbb4c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2128856447 shutdown_connections 2022-02-02T14:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.605+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2128856447 wait complete. 2022-02-02T14:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 Processor -- start 2022-02-02T14:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 -- start start 2022-02-02T14:21:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 0x7fbb4c106240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c106880 con 0x7fbb4c0f5430 2022-02-02T14:21:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb51fb0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c106ff0 con 0x7fbb4c0f66d0 2022-02-02T14:21:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb50fae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb50fae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60730/0 (socket says 172.21.15.33:60730) 2022-02-02T14:21:06.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb50fae700 1 -- 172.21.15.33:0/2739314488 learned_addr learned my addr 172.21.15.33:0/2739314488 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:06.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.606+0000 7fbb4bfff700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 0x7fbb4c106240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb50fae700 1 -- 172.21.15.33:0/2739314488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 msgr2=0x7fbb4c106240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb50fae700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 0x7fbb4c106240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb50fae700 1 -- 172.21.15.33:0/2739314488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40005040 con 0x7fbb4c0f5430 2022-02-02T14:21:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb50fae700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbb40004f60 tx=0x7fbb40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb40018070 con 0x7fbb4c0f5430 2022-02-02T14:21:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbb40009770 con 0x7fbb4c0f5430 2022-02-02T14:21:06.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c107270 con 0x7fbb4c0f5430 2022-02-02T14:21:06.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb4001c3c0 con 0x7fbb4c0f5430 2022-02-02T14:21:06.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.607+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c1077d0 con 0x7fbb4c0f5430 2022-02-02T14:21:06.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.608+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c045ad0 con 0x7fbb4c0f5430 2022-02-02T14:21:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.609+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbb4001d420 con 0x7fbb4c0f5430 2022-02-02T14:21:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.609+0000 7fbb497fa700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 0x7fbb3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.609+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbb40083e80 con 0x7fbb4c0f5430 2022-02-02T14:21:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.609+0000 7fbb4bfff700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 0x7fbb3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.610+0000 7fbb4bfff700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 0x7fbb3c0672e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbb38006fd0 tx=0x7fbb38008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.613+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbb40055aa0 con 0x7fbb4c0f5430 2022-02-02T14:21:06.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.856+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb4c027a00 con 0x7fbb4c0f5430 2022-02-02T14:21:06.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.857+0000 7fbb497fa700 1 -- 172.21.15.33:0/2739314488 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fbb40055690 con 0x7fbb4c0f5430 2022-02-02T14:21:06.857 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:21:06.857 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:21:06.858 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:21:06.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:06.858 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:21:06.858 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:21:06.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:06.859 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:21:06.859 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:21:06.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:06.859 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:21:06.860 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:21:06.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:06.860 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:21:06.860 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:21:06.860 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:21:06.861 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:21:06.861 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:21:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 msgr2=0x7fbb3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 0x7fbb3c0672e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fbb38006fd0 tx=0x7fbb38008040).stop 2022-02-02T14:21:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 msgr2=0x7fbb4c105d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7fbb40004f60 tx=0x7fbb40009b30).stop 2022-02-02T14:21:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 shutdown_connections 2022-02-02T14:21:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbb3c064e20 0x7fbb3c0672e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb4c0f5430 0x7fbb4c105d50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 --2- 172.21.15.33:0/2739314488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb4c0f66d0 0x7fbb4c106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 >> 172.21.15.33:0/2739314488 conn(0x7fbb4c0f0b90 msgr2=0x7fbb4c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 shutdown_connections 2022-02-02T14:21:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.859+0000 7fbb51fb0700 1 -- 172.21.15.33:0/2739314488 wait complete. 2022-02-02T14:21:06.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 -- 172.21.15.33:0/2663852124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f6860 msgr2=0x7fbac00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2663852124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f6860 0x7fbac00f6cc0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fbab4004660 tx=0x7fbab4009b30).stop 2022-02-02T14:21:06.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 -- 172.21.15.33:0/2663852124 shutdown_connections 2022-02-02T14:21:06.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2663852124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f6860 0x7fbac00f6cc0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2663852124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f55c0 0x7fbac00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 -- 172.21.15.33:0/2663852124 >> 172.21.15.33:0/2663852124 conn(0x7fbac00f0d40 msgr2=0x7fbac00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:06.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 -- 172.21.15.33:0/2663852124 shutdown_connections 2022-02-02T14:21:06.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.960+0000 7fbac52ec700 1 -- 172.21.15.33:0/2663852124 wait complete. 2022-02-02T14:21:06.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 Processor -- start 2022-02-02T14:21:06.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 -- start start 2022-02-02T14:21:06.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f6860 0x7fbac010c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0060500 con 0x7fbac00f55c0 2022-02-02T14:21:06.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbac52ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac0060640 con 0x7fbac00f6860 2022-02-02T14:21:06.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbabeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbabeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60740/0 (socket says 172.21.15.33:60740) 2022-02-02T14:21:06.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbabeffd700 1 -- 172.21.15.33:0/2937069886 learned_addr learned my addr 172.21.15.33:0/2937069886 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:06.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.961+0000 7fbabe7fc700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f6860 0x7fbac010c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbabeffd700 1 -- 172.21.15.33:0/2937069886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f6860 msgr2=0x7fbac010c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:06.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbabeffd700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f6860 0x7fbac010c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:06.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbabeffd700 1 -- 172.21.15.33:0/2937069886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4005040 con 0x7fbac00f55c0 2022-02-02T14:21:06.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbabeffd700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fbab000e7c0 tx=0x7fbab000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab00092e0 con 0x7fbac00f55c0 2022-02-02T14:21:06.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbab000f040 con 0x7fbac00f55c0 2022-02-02T14:21:06.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbab00147e0 con 0x7fbac00f55c0 2022-02-02T14:21:06.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac010c670 con 0x7fbac00f55c0 2022-02-02T14:21:06.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.962+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac010cc30 con 0x7fbac00f55c0 2022-02-02T14:21:06.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.963+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac0045ad0 con 0x7fbac00f55c0 2022-02-02T14:21:06.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.963+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbab001b030 con 0x7fbac00f55c0 2022-02-02T14:21:06.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.964+0000 7fbaa77fe700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 0x7fbaa8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:06.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.964+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbab0081960 con 0x7fbac00f55c0 2022-02-02T14:21:06.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.964+0000 7fbabe7fc700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 0x7fbaa8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:06.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.964+0000 7fbabe7fc700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 0x7fbaa8067290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fbab4005010 tx=0x7fbab4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:06.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:06.968+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbab004fa10 con 0x7fbac00f55c0 2022-02-02T14:21:07.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.178+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbac0027a00 con 0x7fbac00f55c0 2022-02-02T14:21:07.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.178+0000 7fbaa77fe700 1 -- 172.21.15.33:0/2937069886 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fbab0019070 con 0x7fbac00f55c0 2022-02-02T14:21:07.178 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:21:07.179 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:21:07.179 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:21:07.179 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:21:07.179 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:07.180 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:21:07.180 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:21:07.180 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:21:07.180 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:21:07.181 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:21:07.181 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:21:07.181 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:21:07.181 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:21:07.181 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:21:07.182 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:21:07.182 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:21:07.182 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:21:07.182 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:21:07.183 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:21:07.183 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:21:07.183 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:21:07.183 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:21:07.184 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:21:07.184 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:21:07.184 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:21:07.184 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:21:07.184 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:21:07.185 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:21:07.185 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:21:07.185 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:21:07.185 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:21:07.186 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:07.186 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:07.186 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:21:07.186 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:07.186 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:07.187 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:07.187 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:07.187 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:07.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 msgr2=0x7fbaa8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:07.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 0x7fbaa8067290 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7fbab4005010 tx=0x7fbab4016040).stop 2022-02-02T14:21:07.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 msgr2=0x7fbac0109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:07.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fbab000e7c0 tx=0x7fbab000b040).stop 2022-02-02T14:21:07.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 shutdown_connections 2022-02-02T14:21:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.180+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbaa8064dd0 0x7fbaa8067290 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.181+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00f55c0 0x7fbac0109bc0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.181+0000 7fbac52ec700 1 --2- 172.21.15.33:0/2937069886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbac00f6860 0x7fbac010c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.181+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 >> 172.21.15.33:0/2937069886 conn(0x7fbac00f0d40 msgr2=0x7fbac00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.181+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 shutdown_connections 2022-02-02T14:21:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:07.181+0000 7fbac52ec700 1 -- 172.21.15.33:0/2937069886 wait complete. 2022-02-02T14:21:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:21:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:07 smithi033 ceph-mon[101165]: from='client.35382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2739314488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:21:07.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2937069886' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:21:07.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:07 smithi037 ceph-mon[69017]: from='client.35382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:07.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2739314488' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:21:07.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2937069886' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:21:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:08 smithi033 ceph-mon[101165]: from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:08 smithi033 ceph-mon[101165]: pgmap v1272: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:08 smithi037 ceph-mon[69017]: from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:08.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:08 smithi037 ceph-mon[69017]: pgmap v1272: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:10 smithi037 ceph-mon[69017]: pgmap v1273: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:10 smithi033 ceph-mon[101165]: pgmap v1273: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:12 smithi037 ceph-mon[69017]: pgmap v1274: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:12 smithi033 ceph-mon[101165]: pgmap v1274: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:14 smithi037 ceph-mon[69017]: pgmap v1275: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:14 smithi033 ceph-mon[101165]: pgmap v1275: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:16 smithi037 ceph-mon[69017]: pgmap v1276: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:16 smithi033 ceph-mon[101165]: pgmap v1276: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:18 smithi037 ceph-mon[69017]: pgmap v1277: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:18 smithi033 ceph-mon[101165]: pgmap v1277: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:20 smithi037 ceph-mon[69017]: pgmap v1278: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:20 smithi033 ceph-mon[101165]: pgmap v1278: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:22 smithi037 ceph-mon[69017]: pgmap v1279: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:22 smithi033 ceph-mon[101165]: pgmap v1279: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:24 smithi037 ceph-mon[69017]: pgmap v1280: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:24 smithi033 ceph-mon[101165]: pgmap v1280: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:26 smithi037 ceph-mon[69017]: pgmap v1281: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:26 smithi033 ceph-mon[101165]: pgmap v1281: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:28 smithi037 ceph-mon[69017]: pgmap v1282: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:28 smithi033 ceph-mon[101165]: pgmap v1282: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:30 smithi037 ceph-mon[69017]: pgmap v1283: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:30 smithi033 ceph-mon[101165]: pgmap v1283: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:32 smithi037 ceph-mon[69017]: pgmap v1284: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:32 smithi033 ceph-mon[101165]: pgmap v1284: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:34 smithi037 ceph-mon[69017]: pgmap v1285: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:34 smithi033 ceph-mon[101165]: pgmap v1285: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:36 smithi037 ceph-mon[69017]: pgmap v1286: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:36 smithi033 ceph-mon[101165]: pgmap v1286: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:37.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 -- 172.21.15.33:0/2464166806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f49a0 msgr2=0x7faa040f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 --2- 172.21.15.33:0/2464166806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f49a0 0x7faa040f4dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fa9f4004660 tx=0x7fa9f4009b30).stop 2022-02-02T14:21:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 -- 172.21.15.33:0/2464166806 shutdown_connections 2022-02-02T14:21:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 --2- 172.21.15.33:0/2464166806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f5340 0x7faa040f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 --2- 172.21.15.33:0/2464166806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f49a0 0x7faa040f4dc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 -- 172.21.15.33:0/2464166806 >> 172.21.15.33:0/2464166806 conn(0x7faa040f04c0 msgr2=0x7faa040f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.294+0000 7faa093d1700 1 -- 172.21.15.33:0/2464166806 shutdown_connections 2022-02-02T14:21:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.295+0000 7faa093d1700 1 -- 172.21.15.33:0/2464166806 wait complete. 2022-02-02T14:21:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.295+0000 7faa093d1700 1 Processor -- start 2022-02-02T14:21:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.295+0000 7faa093d1700 1 -- start start 2022-02-02T14:21:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f49a0 0x7faa04106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04107a60 con 0x7faa040f5340 2022-02-02T14:21:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa04107ba0 con 0x7faa040f49a0 2022-02-02T14:21:37.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60752/0 (socket says 172.21.15.33:60752) 2022-02-02T14:21:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 -- 172.21.15.33:0/4034531849 learned_addr learned my addr 172.21.15.33:0/4034531849 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa02ffd700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f49a0 0x7faa04106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 -- 172.21.15.33:0/4034531849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f49a0 msgr2=0x7faa04106fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f49a0 0x7faa04106fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 -- 172.21.15.33:0/4034531849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f4005040 con 0x7faa040f5340 2022-02-02T14:21:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa027fc700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa9f8002700 tx=0x7fa9f8009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f80079c0 con 0x7faa040f5340 2022-02-02T14:21:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa04108540 con 0x7faa040f5340 2022-02-02T14:21:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9f800f040 con 0x7faa040f5340 2022-02-02T14:21:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f8014740 con 0x7faa040f5340 2022-02-02T14:21:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.296+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa04108b00 con 0x7faa040f5340 2022-02-02T14:21:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.297+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa04045ad0 con 0x7faa040f5340 2022-02-02T14:21:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.298+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa9f801b060 con 0x7faa040f5340 2022-02-02T14:21:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.298+0000 7fa9eb7fe700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.298+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa9f8081a30 con 0x7faa040f5340 2022-02-02T14:21:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.298+0000 7faa02ffd700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.299+0000 7faa02ffd700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa9f4004630 tx=0x7fa9f4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.303+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa9f80533f0 con 0x7faa040f5340 2022-02-02T14:21:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.491+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa04108d80 con 0x7fa9ec064dd0 2022-02-02T14:21:37.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.493+0000 7fa9eb7fe700 1 -- 172.21.15.33:0/4034531849 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7faa04108d80 con 0x7fa9ec064dd0 2022-02-02T14:21:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 msgr2=0x7fa9ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fa9f4004630 tx=0x7fa9f4009b30).stop 2022-02-02T14:21:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 msgr2=0x7faa041074b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa9f8002700 tx=0x7fa9f8009d60).stop 2022-02-02T14:21:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 shutdown_connections 2022-02-02T14:21:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9ec064dd0 0x7fa9ec067290 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa040f49a0 0x7faa04106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 --2- 172.21.15.33:0/4034531849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa040f5340 0x7faa041074b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 >> 172.21.15.33:0/4034531849 conn(0x7faa040f04c0 msgr2=0x7faa040fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 shutdown_connections 2022-02-02T14:21:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.494+0000 7faa093d1700 1 -- 172.21.15.33:0/4034531849 wait complete. 2022-02-02T14:21:37.505 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:21:37.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 -- 172.21.15.33:0/909514965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f6860 msgr2=0x7f30540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 --2- 172.21.15.33:0/909514965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f6860 0x7f30540f6cc0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f3050004660 tx=0x7f3050009b30).stop 2022-02-02T14:21:37.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 -- 172.21.15.33:0/909514965 shutdown_connections 2022-02-02T14:21:37.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 --2- 172.21.15.33:0/909514965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f6860 0x7f30540f6cc0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 --2- 172.21.15.33:0/909514965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f55c0 0x7f30540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 -- 172.21.15.33:0/909514965 >> 172.21.15.33:0/909514965 conn(0x7f30540f0d40 msgr2=0x7f30540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:37.598 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:37 smithi033 ceph-mon[101165]: pgmap v1287: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:37.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 -- 172.21.15.33:0/909514965 shutdown_connections 2022-02-02T14:21:37.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.596+0000 7f305bb9a700 1 -- 172.21.15.33:0/909514965 wait complete. 2022-02-02T14:21:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 Processor -- start 2022-02-02T14:21:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 -- start start 2022-02-02T14:21:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f6860 0x7f305410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30540603c0 con 0x7f30540f55c0 2022-02-02T14:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f305bb9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3054060500 con 0x7f30540f6860 2022-02-02T14:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f3059936700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f3059936700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60760/0 (socket says 172.21.15.33:60760) 2022-02-02T14:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f3059936700 1 -- 172.21.15.33:0/3514136743 learned_addr learned my addr 172.21.15.33:0/3514136743 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.597+0000 7f3059135700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f6860 0x7f305410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f3059936700 1 -- 172.21.15.33:0/3514136743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f6860 msgr2=0x7f305410c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f3059936700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f6860 0x7f305410c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f3059936700 1 -- 172.21.15.33:0/3514136743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050005040 con 0x7f30540f55c0 2022-02-02T14:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f3059936700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f3044002700 tx=0x7f3044009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30440079c0 con 0x7f30540f55c0 2022-02-02T14:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f304400f040 con 0x7f30540f55c0 2022-02-02T14:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3044014850 con 0x7f30540f55c0 2022-02-02T14:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305410c690 con 0x7f30540f55c0 2022-02-02T14:21:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.598+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305410cc20 con 0x7f30540f55c0 2022-02-02T14:21:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.599+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3054045ad0 con 0x7f30540f55c0 2022-02-02T14:21:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.600+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f304401b060 con 0x7f30540f55c0 2022-02-02T14:21:37.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.600+0000 7f304a7fc700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 0x7f3040067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.600+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3044081ac0 con 0x7f30540f55c0 2022-02-02T14:21:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.600+0000 7f3059135700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 0x7f3040067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.601+0000 7f3059135700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 0x7f3040067290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3050004630 tx=0x7f3050009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.604+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f304404fb10 con 0x7f30540f55c0 2022-02-02T14:21:37.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.786+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3054057f10 con 0x7f3040064dd0 2022-02-02T14:21:37.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:37 smithi037 ceph-mon[69017]: pgmap v1287: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.801+0000 7f304a7fc700 1 -- 172.21.15.33:0/3514136743 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3054057f10 con 0x7f3040064dd0 2022-02-02T14:21:37.802 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:21:37.803 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (46m) 9m ago 47m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:21:37.803 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (39m) 9m ago 47m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:21:37.803 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (39m) 9m ago 47m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:21:37.804 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (46m) 9m ago 47m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:21:37.804 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (40m) 9m ago 44m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:21:37.804 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (41m) 9m ago 44m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:21:37.804 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (41m) 9m ago 44m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:21:37.805 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (44m) 9m ago 44m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:21:37.805 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (41m) 9m ago 49m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:21:37.805 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (41m) 9m ago 47m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:21:37.805 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (40m) 9m ago 49m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:21:37.805 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (40m) 9m ago 47m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:21:37.806 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (47m) 9m ago 47m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:21:37.806 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (47m) 9m ago 47m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:21:37.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 46m - 4096M 2022-02-02T14:21:37.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (46m) 9m ago 46m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:21:37.807 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (46m) 9m ago 46m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:21:37.807 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (45m) 9m ago 45m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:21:37.807 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (45m) 9m ago 45m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:21:37.807 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (45m) 9m ago 45m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:21:37.808 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (46m) 9m ago 47m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:21:37.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 msgr2=0x7f3040067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 0x7f3040067290 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f3050004630 tx=0x7f3050009b30).stop 2022-02-02T14:21:37.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 msgr2=0x7f3054109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f3044002700 tx=0x7f3044009e00).stop 2022-02-02T14:21:37.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 shutdown_connections 2022-02-02T14:21:37.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3040064dd0 0x7f3040067290 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30540f55c0 0x7f3054109be0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 --2- 172.21.15.33:0/3514136743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30540f6860 0x7f305410c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 >> 172.21.15.33:0/3514136743 conn(0x7f30540f0d40 msgr2=0x7f30540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.803+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 shutdown_connections 2022-02-02T14:21:37.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.804+0000 7f305bb9a700 1 -- 172.21.15.33:0/3514136743 wait complete. 2022-02-02T14:21:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 -- 172.21.15.33:0/1754581042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f55c0 msgr2=0x7f23200f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 --2- 172.21.15.33:0/1754581042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f55c0 0x7f23200f59e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f23100099e0 tx=0x7f2310004d10).stop 2022-02-02T14:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 -- 172.21.15.33:0/1754581042 shutdown_connections 2022-02-02T14:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 --2- 172.21.15.33:0/1754581042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f6860 0x7f23200f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 --2- 172.21.15.33:0/1754581042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f55c0 0x7f23200f59e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 -- 172.21.15.33:0/1754581042 >> 172.21.15.33:0/1754581042 conn(0x7f23200f0d40 msgr2=0x7f23200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 -- 172.21.15.33:0/1754581042 shutdown_connections 2022-02-02T14:21:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.903+0000 7f2326e20700 1 -- 172.21.15.33:0/1754581042 wait complete. 2022-02-02T14:21:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 Processor -- start 2022-02-02T14:21:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 -- start start 2022-02-02T14:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f55c0 0x7f2320109d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23200603c0 con 0x7f23200f6860 2022-02-02T14:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f2326e20700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320060500 con 0x7f23200f55c0 2022-02-02T14:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.904+0000 7f231ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60772/0 (socket says 172.21.15.33:60772) 2022-02-02T14:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 -- 172.21.15.33:0/2247334090 learned_addr learned my addr 172.21.15.33:0/2247334090 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f2324bbc700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f55c0 0x7f2320109d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 -- 172.21.15.33:0/2247334090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f55c0 msgr2=0x7f2320109d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f55c0 0x7f2320109d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 -- 172.21.15.33:0/2247334090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009640 con 0x7f23200f6860 2022-02-02T14:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231ffff700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f231400c530 tx=0x7f2314007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231400f650 con 0x7f23200f6860 2022-02-02T14:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232010c830 con 0x7f23200f6860 2022-02-02T14:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f231400fc60 con 0x7f23200f6860 2022-02-02T14:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2314012c20 con 0x7f23200f6860 2022-02-02T14:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.905+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232010cd40 con 0x7f23200f6860 2022-02-02T14:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.907+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200f49b0 con 0x7f23200f6860 2022-02-02T14:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.907+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2314010070 con 0x7f23200f6860 2022-02-02T14:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.907+0000 7f231d7fa700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 0x7f2308067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.907+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2314081660 con 0x7f23200f6860 2022-02-02T14:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.907+0000 7f2324bbc700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 0x7f2308067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.908+0000 7f2324bbc700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 0x7f2308067290 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f23100099b0 tx=0x7f2310004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:37.912+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f23140477d0 con 0x7f23200f6860 2022-02-02T14:21:38.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.153+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2320045ad0 con 0x7f23200f6860 2022-02-02T14:21:38.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.154+0000 7f231d7fa700 1 -- 172.21.15.33:0/2247334090 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f231404f710 con 0x7f23200f6860 2022-02-02T14:21:38.155 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:21:38.155 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:21:38.155 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:21:38.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:38.156 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:21:38.156 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:21:38.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:38.157 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:21:38.157 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:21:38.157 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:38.157 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:21:38.158 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:21:38.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:21:38.158 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:21:38.158 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:21:38.159 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:21:38.159 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:21:38.159 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:21:38.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 msgr2=0x7f2308067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 0x7f2308067290 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f23100099b0 tx=0x7f2310004d10).stop 2022-02-02T14:21:38.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 msgr2=0x7f232010c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f231400c530 tx=0x7f2314007e20).stop 2022-02-02T14:21:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 shutdown_connections 2022-02-02T14:21:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2308064dd0 0x7f2308067290 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23200f55c0 0x7f2320109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 --2- 172.21.15.33:0/2247334090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23200f6860 0x7f232010c280 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 >> 172.21.15.33:0/2247334090 conn(0x7f23200f0d40 msgr2=0x7f23200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 shutdown_connections 2022-02-02T14:21:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.156+0000 7f2326e20700 1 -- 172.21.15.33:0/2247334090 wait complete. 2022-02-02T14:21:38.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 -- 172.21.15.33:0/2819981098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f7980 msgr2=0x7f9e080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/2819981098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f7980 0x7f9e080f7de0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f9df0004660 tx=0x7f9df0009b30).stop 2022-02-02T14:21:38.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 -- 172.21.15.33:0/2819981098 shutdown_connections 2022-02-02T14:21:38.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/2819981098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f7980 0x7f9e080f7de0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/2819981098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f66e0 0x7f9e080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 -- 172.21.15.33:0/2819981098 >> 172.21.15.33:0/2819981098 conn(0x7f9e080f1e40 msgr2=0x7f9e080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:38.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 -- 172.21.15.33:0/2819981098 shutdown_connections 2022-02-02T14:21:38.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.257+0000 7f9e0e91b700 1 -- 172.21.15.33:0/2819981098 wait complete. 2022-02-02T14:21:38.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 Processor -- start 2022-02-02T14:21:38.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 -- start start 2022-02-02T14:21:38.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:38.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 0x7f9e08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:38.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0806a380 con 0x7f9e080f66e0 2022-02-02T14:21:38.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e0e91b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0806a4c0 con 0x7f9e080f7980 2022-02-02T14:21:38.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60780/0 (socket says 172.21.15.33:60780) 2022-02-02T14:21:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e07fff700 1 -- 172.21.15.33:0/4018752808 learned_addr learned my addr 172.21.15.33:0/4018752808 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:21:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e077fe700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 0x7f9e08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:38.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e07fff700 1 -- 172.21.15.33:0/4018752808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 msgr2=0x7f9e08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.258+0000 7f9e07fff700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 0x7f9e08069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e07fff700 1 -- 172.21.15.33:0/4018752808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0005040 con 0x7f9e080f66e0 2022-02-02T14:21:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e077fe700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 0x7f9e08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:21:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e07fff700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9df8002700 tx=0x7f9df8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:38.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df8009320 con 0x7f9e080f66e0 2022-02-02T14:21:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9df800f040 con 0x7f9e080f66e0 2022-02-02T14:21:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0806a7a0 con 0x7f9e080f66e0 2022-02-02T14:21:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9df8014900 con 0x7f9e080f66e0 2022-02-02T14:21:38.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.259+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0810ef90 con 0x7f9e080f66e0 2022-02-02T14:21:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.260+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e08045ad0 con 0x7f9e080f66e0 2022-02-02T14:21:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.260+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9df8009480 con 0x7f9e080f66e0 2022-02-02T14:21:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.261+0000 7f9e04ff9700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 0x7f9df4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:21:38.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.261+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9df8081c30 con 0x7f9e080f66e0 2022-02-02T14:21:38.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.261+0000 7f9e077fe700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 0x7f9df4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:21:38.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.261+0000 7f9e077fe700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 0x7f9df4067290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f9df0009da0 tx=0x7f9df0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:21:38.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.265+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9df804fda0 con 0x7f9e080f66e0 2022-02-02T14:21:38.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.478+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e080fef70 con 0x7f9e080f66e0 2022-02-02T14:21:38.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:38 smithi033 ceph-mon[101165]: from='client.35398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:38.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:38 smithi033 ceph-mon[101165]: from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:38.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2247334090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:21:38.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.478+0000 7f9e04ff9700 1 -- 172.21.15.33:0/4018752808 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f9df80533c0 con 0x7f9e080f66e0 2022-02-02T14:21:38.480 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:21:38.480 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:21:38.481 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:21:38.481 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:21:38.481 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:38.481 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:21:38.482 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:21:38.482 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:21:38.482 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:21:38.482 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:21:38.483 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:21:38.483 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:21:38.483 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:21:38.483 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:21:38.484 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:21:38.484 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:21:38.484 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:21:38.484 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:21:38.485 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:21:38.485 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:21:38.485 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:21:38.485 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:21:38.485 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:21:38.486 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:21:38.486 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:21:38.486 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:21:38.486 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:21:38.487 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:21:38.487 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:21:38.487 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:21:38.487 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:21:38.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:38.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:38.488 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:21:38.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:21:38.488 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:38.489 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:38.489 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:38.489 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:21:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 msgr2=0x7f9df4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 0x7f9df4067290 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f9df0009da0 tx=0x7f9df0009b30).stop 2022-02-02T14:21:38.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 msgr2=0x7f9e0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:21:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f9df8002700 tx=0x7f9df8009d80).stop 2022-02-02T14:21:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 shutdown_connections 2022-02-02T14:21:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9df4064dd0 0x7f9df4067290 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e080f66e0 0x7f9e0806b9a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 --2- 172.21.15.33:0/4018752808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e080f7980 0x7f9e08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:21:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 >> 172.21.15.33:0/4018752808 conn(0x7f9e080f1e40 msgr2=0x7f9e080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:21:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 shutdown_connections 2022-02-02T14:21:38.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:21:38.480+0000 7f9e0e91b700 1 -- 172.21.15.33:0/4018752808 wait complete. 2022-02-02T14:21:38.493 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:21:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:38 smithi037 ceph-mon[69017]: from='client.35398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:38 smithi037 ceph-mon[69017]: from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:21:38.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2247334090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:21:39.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:39 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4018752808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:21:39.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:39 smithi033 ceph-mon[101165]: pgmap v1288: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:39.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:39 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4018752808' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:21:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:39 smithi037 ceph-mon[69017]: pgmap v1288: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:42 smithi033 ceph-mon[101165]: pgmap v1289: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:42 smithi037 ceph-mon[69017]: pgmap v1289: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:44.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:44 smithi033 ceph-mon[101165]: pgmap v1290: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:44 smithi037 ceph-mon[69017]: pgmap v1290: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:46.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:46 smithi033 ceph-mon[101165]: pgmap v1291: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:46 smithi037 ceph-mon[69017]: pgmap v1291: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:48 smithi033 ceph-mon[101165]: pgmap v1292: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:48.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:48 smithi037 ceph-mon[69017]: pgmap v1292: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:50 smithi033 ceph-mon[101165]: pgmap v1293: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:50 smithi037 ceph-mon[69017]: pgmap v1293: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:52 smithi033 ceph-mon[101165]: pgmap v1294: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:52 smithi037 ceph-mon[69017]: pgmap v1294: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:54 smithi033 ceph-mon[101165]: pgmap v1295: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:54 smithi037 ceph-mon[69017]: pgmap v1295: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:21:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:21:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:21:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:21:56.239 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:56 smithi033 ceph-mon[101165]: pgmap v1296: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:56 smithi037 ceph-mon[69017]: pgmap v1296: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:21:58 smithi033 ceph-mon[101165]: pgmap v1297: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:21:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:21:58 smithi037 ceph-mon[69017]: pgmap v1297: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:00 smithi033 ceph-mon[101165]: pgmap v1298: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:00 smithi037 ceph-mon[69017]: pgmap v1298: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:02 smithi033 ceph-mon[101165]: pgmap v1299: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:02 smithi037 ceph-mon[69017]: pgmap v1299: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:04 smithi033 ceph-mon[101165]: pgmap v1300: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:04 smithi037 ceph-mon[69017]: pgmap v1300: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:06 smithi033 ceph-mon[101165]: pgmap v1301: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:06 smithi037 ceph-mon[69017]: pgmap v1301: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:08 smithi033 ceph-mon[101165]: pgmap v1302: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:08 smithi037 ceph-mon[69017]: pgmap v1302: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.596+0000 7f1c0422e700 1 -- 172.21.15.33:0/4223071441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f7980 msgr2=0x7f1bfc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:08.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.596+0000 7f1c0422e700 1 --2- 172.21.15.33:0/4223071441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc0f7de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f1bf0004660 tx=0x7f1bf0009b30).stop 2022-02-02T14:22:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.596+0000 7f1c0422e700 1 -- 172.21.15.33:0/4223071441 shutdown_connections 2022-02-02T14:22:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 --2- 172.21.15.33:0/4223071441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc0f7de0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 --2- 172.21.15.33:0/4223071441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 -- 172.21.15.33:0/4223071441 >> 172.21.15.33:0/4223071441 conn(0x7f1bfc0f1e40 msgr2=0x7f1bfc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 -- 172.21.15.33:0/4223071441 shutdown_connections 2022-02-02T14:22:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 -- 172.21.15.33:0/4223071441 wait complete. 2022-02-02T14:22:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 Processor -- start 2022-02-02T14:22:08.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 -- start start 2022-02-02T14:22:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.597+0000 7f1c0422e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c0422e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c0422e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc107a00 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c0422e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc107b40 con 0x7f1bfc0f7980 2022-02-02T14:22:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60790/0 (socket says 172.21.15.33:60790) 2022-02-02T14:22:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 -- 172.21.15.33:0/1733077221 learned_addr learned my addr 172.21.15.33:0/1733077221 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:08.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c017c9700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 -- 172.21.15.33:0/1733077221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 msgr2=0x7f1bfc107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 -- 172.21.15.33:0/1733077221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0005040 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c017c9700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:22:08.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c01fca700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f1bf800c790 tx=0x7f1bf8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:08.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf800e680 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1bf800ec90 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.598+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc1084e0 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.599+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf8012d00 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.599+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc108aa0 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.600+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc045ad0 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.600+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1bf8010070 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.600+0000 7f1bee7fc700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 0x7f1be8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.600+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1bf8081ac0 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.601+0000 7f1c017c9700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 0x7f1be8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:08.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.601+0000 7f1c017c9700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 0x7f1be8067270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1bf0004630 tx=0x7f1bf0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:08.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.605+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1bf80535a0 con 0x7f1bfc0f66e0 2022-02-02T14:22:08.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.792+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bfc0ff010 con 0x7f1be8064db0 2022-02-02T14:22:08.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.793+0000 7f1bee7fc700 1 -- 172.21.15.33:0/1733077221 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1bfc0ff010 con 0x7f1be8064db0 2022-02-02T14:22:08.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 msgr2=0x7f1be8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:08.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 0x7f1be8067270 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1bf0004630 tx=0x7f1bf0009b30).stop 2022-02-02T14:22:08.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 msgr2=0x7f1bfc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:08.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f1bf800c790 tx=0x7f1bf8007d90).stop 2022-02-02T14:22:08.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 shutdown_connections 2022-02-02T14:22:08.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1be8064db0 0x7f1be8067270 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1bfc0f66e0 0x7f1bfc106f60 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 --2- 172.21.15.33:0/1733077221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bfc0f7980 0x7f1bfc107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 >> 172.21.15.33:0/1733077221 conn(0x7f1bfc0f1e40 msgr2=0x7f1bfc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:08.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 shutdown_connections 2022-02-02T14:22:08.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.795+0000 7f1c0422e700 1 -- 172.21.15.33:0/1733077221 wait complete. 2022-02-02T14:22:08.804 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:22:08.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- 172.21.15.33:0/2782085946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 msgr2=0x7f37c00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 --2- 172.21.15.33:0/2782085946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c00f7de0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f37b0004660 tx=0x7f37b0009b30).stop 2022-02-02T14:22:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- 172.21.15.33:0/2782085946 shutdown_connections 2022-02-02T14:22:08.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 --2- 172.21.15.33:0/2782085946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c00f7de0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 --2- 172.21.15.33:0/2782085946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f66e0 0x7f37c00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- 172.21.15.33:0/2782085946 >> 172.21.15.33:0/2782085946 conn(0x7f37c00f1e40 msgr2=0x7f37c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- 172.21.15.33:0/2782085946 shutdown_connections 2022-02-02T14:22:08.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- 172.21.15.33:0/2782085946 wait complete. 2022-02-02T14:22:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 Processor -- start 2022-02-02T14:22:08.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.896+0000 7f37c68cf700 1 -- start start 2022-02-02T14:22:08.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37c68cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f66e0 0x7f37c0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37c68cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37c68cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0107a00 con 0x7f37c00f7980 2022-02-02T14:22:08.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37c68cf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0107b40 con 0x7f37c00f66e0 2022-02-02T14:22:08.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:08.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60802/0 (socket says 172.21.15.33:60802) 2022-02-02T14:22:08.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 -- 172.21.15.33:0/3245269439 learned_addr learned my addr 172.21.15.33:0/3245269439 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:08.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 -- 172.21.15.33:0/3245269439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f66e0 msgr2=0x7f37c0106f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T14:22:08.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f66e0 0x7f37c0106f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:22:08.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 -- 172.21.15.33:0/3245269439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b0005040 con 0x7f37c00f7980 2022-02-02T14:22:08.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.897+0000 7f37bf7fe700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f37b0009990 tx=0x7f37b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:08.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.898+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b0018070 con 0x7f37c00f7980 2022-02-02T14:22:08.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.898+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37b0007ba0 con 0x7f37c00f7980 2022-02-02T14:22:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.898+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37b001c3c0 con 0x7f37c00f7980 2022-02-02T14:22:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.898+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0108480 con 0x7f37c00f7980 2022-02-02T14:22:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.898+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c01089e0 con 0x7f37c00f7980 2022-02-02T14:22:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.899+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0045ad0 con 0x7f37c00f7980 2022-02-02T14:22:08.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.899+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f37b001d420 con 0x7f37c00f7980 2022-02-02T14:22:08.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.900+0000 7f37bcff9700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:08.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.900+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f37b00836f0 con 0x7f37c00f7980 2022-02-02T14:22:08.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.900+0000 7f37bffff700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:08.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.900+0000 7f37bffff700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f37c00f77e0 tx=0x7f37a80099e0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:08.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:08.904+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f37b0055170 con 0x7f37c00f7980 2022-02-02T14:22:09.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.085+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f37c0108c50 con 0x7f37ac064dd0 2022-02-02T14:22:09.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.100+0000 7f37bcff9700 1 -- 172.21.15.33:0/3245269439 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f37c0108c50 con 0x7f37ac064dd0 2022-02-02T14:22:09.101 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:22:09.101 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (47m) 9m ago 48m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:22:09.102 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (40m) 9m ago 48m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:22:09.102 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (40m) 9m ago 47m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:22:09.102 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (47m) 9m ago 48m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:22:09.102 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (40m) 9m ago 44m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:22:09.103 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (41m) 9m ago 44m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:22:09.103 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (42m) 9m ago 44m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:22:09.103 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (44m) 9m ago 44m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:22:09.103 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (42m) 9m ago 49m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:22:09.104 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (41m) 9m ago 47m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:22:09.104 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (41m) 9m ago 49m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:22:09.104 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (41m) 9m ago 47m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:22:09.104 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (48m) 9m ago 48m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:22:09.105 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (47m) 9m ago 47m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:22:09.105 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 9m ago 47m - 4096M 2022-02-02T14:22:09.105 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (46m) 9m ago 46m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:22:09.105 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (46m) 9m ago 46m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:22:09.106 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (46m) 9m ago 46m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:22:09.106 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (46m) 9m ago 46m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:22:09.106 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (45m) 9m ago 45m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:22:09.106 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (47m) 9m ago 48m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:22:09.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 msgr2=0x7f37ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f37c00f77e0 tx=0x7f37a80099e0).stop 2022-02-02T14:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 msgr2=0x7f37c0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f37b0009990 tx=0x7f37b0009b30).stop 2022-02-02T14:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 shutdown_connections 2022-02-02T14:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f37ac064dd0 0x7f37ac067290 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37c00f66e0 0x7f37c0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 --2- 172.21.15.33:0/3245269439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c00f7980 0x7f37c0107450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 >> 172.21.15.33:0/3245269439 conn(0x7f37c00f1e40 msgr2=0x7f37c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 shutdown_connections 2022-02-02T14:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.103+0000 7f37c68cf700 1 -- 172.21.15.33:0/3245269439 wait complete. 2022-02-02T14:22:09.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 -- 172.21.15.33:0/4187363564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 msgr2=0x7f4fe00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4187363564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe00f6cc0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f4fd4004660 tx=0x7f4fd4009b30).stop 2022-02-02T14:22:09.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 -- 172.21.15.33:0/4187363564 shutdown_connections 2022-02-02T14:22:09.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4187363564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe00f6cc0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4187363564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 -- 172.21.15.33:0/4187363564 >> 172.21.15.33:0/4187363564 conn(0x7f4fe00f0d40 msgr2=0x7f4fe00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:09.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 -- 172.21.15.33:0/4187363564 shutdown_connections 2022-02-02T14:22:09.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.204+0000 7f4fe5096700 1 -- 172.21.15.33:0/4187363564 wait complete. 2022-02-02T14:22:09.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 Processor -- start 2022-02-02T14:22:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 -- start start 2022-02-02T14:22:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00602d0 con 0x7f4fe00f6860 2022-02-02T14:22:09.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fe5096700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe0060410 con 0x7f4fe00f55c0 2022-02-02T14:22:09.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fde59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fded9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43294/0 (socket says 172.21.15.33:43294) 2022-02-02T14:22:09.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fded9d700 1 -- 172.21.15.33:0/4035379603 learned_addr learned my addr 172.21.15.33:0/4035379603 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:09.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.205+0000 7f4fde59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60812/0 (socket says 172.21.15.33:60812) 2022-02-02T14:22:09.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fded9d700 1 -- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 msgr2=0x7f4fe010e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fded9d700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fded9d700 1 -- 172.21.15.33:0/4035379603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4005040 con 0x7f4fe00f55c0 2022-02-02T14:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fde59c700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fded9d700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4fd0002700 tx=0x7f4fd0009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd00079c0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4fd000f040 con 0x7f4fe00f55c0 2022-02-02T14:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe010ea40 con 0x7f4fe00f55c0 2022-02-02T14:22:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fd0014860 con 0x7f4fe00f55c0 2022-02-02T14:22:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.206+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe010eec0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.207+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe0045ad0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.208+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4fd001b060 con 0x7f4fe00f55c0 2022-02-02T14:22:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.208+0000 7f4fc77fe700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 0x7f4fc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.208+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4fd00818d0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.208+0000 7f4fde59c700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 0x7f4fc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.209+0000 7f4fde59c700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 0x7f4fc8067290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4fd4005010 tx=0x7f4fd4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:09.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.213+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4fd004f980 con 0x7f4fe00f55c0 2022-02-02T14:22:09.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.460+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4fe00605a0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.461+0000 7f4fc77fe700 1 -- 172.21.15.33:0/4035379603 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4fd00192d0 con 0x7f4fe00f55c0 2022-02-02T14:22:09.461 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:22:09.461 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:22:09.461 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:22:09.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:22:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:22:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:09.462 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:22:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:22:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:22:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:22:09.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:22:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:22:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:22:09.464 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:22:09.465 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:22:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 msgr2=0x7f4fc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 0x7f4fc8067290 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f4fd4005010 tx=0x7f4fd4009b30).stop 2022-02-02T14:22:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 msgr2=0x7f4fe010c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4fd0002700 tx=0x7f4fd0009d80).stop 2022-02-02T14:22:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 shutdown_connections 2022-02-02T14:22:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4fc8064dd0 0x7f4fc8067290 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe00f55c0 0x7f4fe010c050 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 --2- 172.21.15.33:0/4035379603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fe00f6860 0x7f4fe010e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.462+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 >> 172.21.15.33:0/4035379603 conn(0x7f4fe00f0d40 msgr2=0x7f4fe00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.463+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 shutdown_connections 2022-02-02T14:22:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.463+0000 7f4fe5096700 1 -- 172.21.15.33:0/4035379603 wait complete. 2022-02-02T14:22:09.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 -- 172.21.15.33:0/3797583389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f66e0 msgr2=0x7fd5240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 --2- 172.21.15.33:0/3797583389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f66e0 0x7fd5240f6b00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7fd514004660 tx=0x7fd514009b30).stop 2022-02-02T14:22:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 -- 172.21.15.33:0/3797583389 shutdown_connections 2022-02-02T14:22:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 --2- 172.21.15.33:0/3797583389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f7980 0x7fd5240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 --2- 172.21.15.33:0/3797583389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f66e0 0x7fd5240f6b00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 -- 172.21.15.33:0/3797583389 >> 172.21.15.33:0/3797583389 conn(0x7fd5240f1e40 msgr2=0x7fd5240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 -- 172.21.15.33:0/3797583389 shutdown_connections 2022-02-02T14:22:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.564+0000 7fd529c61700 1 -- 172.21.15.33:0/3797583389 wait complete. 2022-02-02T14:22:09.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 Processor -- start 2022-02-02T14:22:09.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 -- start start 2022-02-02T14:22:09.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 0x7fd52406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52406a380 con 0x7fd5240f7980 2022-02-02T14:22:09.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd529c61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52406a4c0 con 0x7fd5240f66e0 2022-02-02T14:22:09.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd522ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60822/0 (socket says 172.21.15.33:60822) 2022-02-02T14:22:09.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd522ffd700 1 -- 172.21.15.33:0/2449392665 learned_addr learned my addr 172.21.15.33:0/2449392665 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd5237fe700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 0x7fd52406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd522ffd700 1 -- 172.21.15.33:0/2449392665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 msgr2=0x7fd52406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.565+0000 7fd522ffd700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 0x7fd52406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd522ffd700 1 -- 172.21.15.33:0/2449392665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514005040 con 0x7fd5240f7980 2022-02-02T14:22:09.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd5237fe700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 0x7fd52406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:22:09.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd522ffd700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fd50c00c790 tx=0x7fd50c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:09.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50c00e680 con 0x7fd5240f7980 2022-02-02T14:22:09.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd50c00ec90 con 0x7fd5240f7980 2022-02-02T14:22:09.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52406a7a0 con 0x7fd5240f7980 2022-02-02T14:22:09.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52410ef70 con 0x7fd5240f7980 2022-02-02T14:22:09.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.566+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd50c013d60 con 0x7fd5240f7980 2022-02-02T14:22:09.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.567+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd508004fa0 con 0x7fd5240f7980 2022-02-02T14:22:09.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.567+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd50c01a060 con 0x7fd5240f7980 2022-02-02T14:22:09.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.568+0000 7fd51bfff700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 0x7fd510067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:09.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.568+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd50c081b40 con 0x7fd5240f7980 2022-02-02T14:22:09.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.568+0000 7fd5237fe700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 0x7fd510067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:09.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.568+0000 7fd5237fe700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 0x7fd510067290 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fd514004e30 tx=0x7fd514009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:09.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.572+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd50c04fb90 con 0x7fd5240f7980 2022-02-02T14:22:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.785+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd508005e80 con 0x7fd5240f7980 2022-02-02T14:22:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.785+0000 7fd51bfff700 1 -- 172.21.15.33:0/2449392665 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd50c018070 con 0x7fd5240f7980 2022-02-02T14:22:09.785 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:22:09.785 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:22:09.786 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:22:09.786 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:22:09.786 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:09.786 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:22:09.786 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:22:09.787 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:22:09.787 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:22:09.787 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:22:09.787 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:22:09.788 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:22:09.788 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:22:09.788 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:22:09.788 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:22:09.789 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:22:09.789 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:22:09.789 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:22:09.789 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:22:09.789 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:22:09.790 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:22:09.790 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:22:09.790 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:22:09.790 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:22:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:22:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:22:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:22:09.791 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:22:09.792 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:22:09.792 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:22:09.792 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:22:09.792 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:09.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:09.793 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:22:09.793 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:09.794 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:09.794 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:09.794 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:09.794 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 msgr2=0x7fd510067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 0x7fd510067290 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fd514004e30 tx=0x7fd514009b30).stop 2022-02-02T14:22:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 msgr2=0x7fd524069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fd50c00c790 tx=0x7fd50c007d70).stop 2022-02-02T14:22:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 shutdown_connections 2022-02-02T14:22:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd510064dd0 0x7fd510067290 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5240f66e0 0x7fd52406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 --2- 172.21.15.33:0/2449392665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5240f7980 0x7fd524069e20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 >> 172.21.15.33:0/2449392665 conn(0x7fd5240f1e40 msgr2=0x7fd5240fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 shutdown_connections 2022-02-02T14:22:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:09.787+0000 7fd529c61700 1 -- 172.21.15.33:0/2449392665 wait complete. 2022-02-02T14:22:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:22:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:10 smithi033 ceph-mon[101165]: pgmap v1303: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:10 smithi033 ceph-mon[101165]: from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:10 smithi033 ceph-mon[101165]: from='client.35418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4035379603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:22:10.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2449392665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:22:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:10 smithi037 ceph-mon[69017]: pgmap v1303: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:10 smithi037 ceph-mon[69017]: from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:10 smithi037 ceph-mon[69017]: from='client.35418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4035379603' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:22:10.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2449392665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:22:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:12 smithi033 ceph-mon[101165]: pgmap v1304: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:12 smithi037 ceph-mon[69017]: pgmap v1304: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:14 smithi033 ceph-mon[101165]: pgmap v1305: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:14 smithi037 ceph-mon[69017]: pgmap v1305: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:16.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:16 smithi033 ceph-mon[101165]: pgmap v1306: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:16 smithi037 ceph-mon[69017]: pgmap v1306: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:18 smithi033 ceph-mon[101165]: pgmap v1307: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:18 smithi037 ceph-mon[69017]: pgmap v1307: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:20 smithi033 ceph-mon[101165]: pgmap v1308: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:20 smithi037 ceph-mon[69017]: pgmap v1308: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:22 smithi033 ceph-mon[101165]: pgmap v1309: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:22 smithi037 ceph-mon[69017]: pgmap v1309: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:24 smithi033 ceph-mon[101165]: pgmap v1310: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:24 smithi037 ceph-mon[69017]: pgmap v1310: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:26.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:26 smithi033 ceph-mon[101165]: pgmap v1311: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:26 smithi037 ceph-mon[69017]: pgmap v1311: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:28 smithi033 ceph-mon[101165]: pgmap v1312: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:28 smithi037 ceph-mon[69017]: pgmap v1312: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:30 smithi033 ceph-mon[101165]: pgmap v1313: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:30 smithi037 ceph-mon[69017]: pgmap v1313: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:32 smithi033 ceph-mon[101165]: pgmap v1314: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:32 smithi037 ceph-mon[69017]: pgmap v1314: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:34 smithi033 ceph-mon[101165]: pgmap v1315: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:34 smithi037 ceph-mon[69017]: pgmap v1315: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:36 smithi033 ceph-mon[101165]: pgmap v1316: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:36 smithi037 ceph-mon[69017]: pgmap v1316: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:38 smithi033 ceph-mon[101165]: pgmap v1317: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:38 smithi037 ceph-mon[69017]: pgmap v1317: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:39.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 -- 172.21.15.33:0/3625376609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 msgr2=0x7f80ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:39.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3625376609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec0f6cc0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f80d4004660 tx=0x7f80d4009b30).stop 2022-02-02T14:22:39.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 -- 172.21.15.33:0/3625376609 shutdown_connections 2022-02-02T14:22:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3625376609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec0f6cc0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3625376609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 -- 172.21.15.33:0/3625376609 >> 172.21.15.33:0/3625376609 conn(0x7f80ec0f0d40 msgr2=0x7f80ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 -- 172.21.15.33:0/3625376609 shutdown_connections 2022-02-02T14:22:39.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.902+0000 7f80f22a8700 1 -- 172.21.15.33:0/3625376609 wait complete. 2022-02-02T14:22:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 Processor -- start 2022-02-02T14:22:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 -- start start 2022-02-02T14:22:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:39.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec107a10 con 0x7f80ec0f6860 2022-02-02T14:22:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80f22a8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ec107b50 con 0x7f80ec0f55c0 2022-02-02T14:22:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:39.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60830/0 (socket says 172.21.15.33:60830) 2022-02-02T14:22:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 -- 172.21.15.33:0/3504901283 learned_addr learned my addr 172.21.15.33:0/3504901283 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80ebfff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 -- 172.21.15.33:0/3504901283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 msgr2=0x7f80ec106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:39.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80e3fff700 1 -- 172.21.15.33:0/3504901283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d4005040 con 0x7f80ec0f6860 2022-02-02T14:22:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.903+0000 7f80ebfff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:22:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80e3fff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f80d4009990 tx=0x7f80d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d4018070 con 0x7f80ec0f6860 2022-02-02T14:22:39.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80d4007ba0 con 0x7f80ec0f6860 2022-02-02T14:22:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80d401c3c0 con 0x7f80ec0f6860 2022-02-02T14:22:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80ec108490 con 0x7f80ec0f6860 2022-02-02T14:22:39.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.904+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80ec1089a0 con 0x7f80ec0f6860 2022-02-02T14:22:39.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.905+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ec045ad0 con 0x7f80ec0f6860 2022-02-02T14:22:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.905+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80d401d420 con 0x7f80ec0f6860 2022-02-02T14:22:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.906+0000 7f80e97fa700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.906+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f80d40837b0 con 0x7f80ec0f6860 2022-02-02T14:22:39.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.906+0000 7f80ebfff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.906+0000 7f80ebfff700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 0x7f80d8067290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f80ec0f66c0 tx=0x7f80dc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:39.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:39.910+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80d4055230 con 0x7f80ec0f6860 2022-02-02T14:22:40.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.100+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80ec05fd30 con 0x7f80d8064dd0 2022-02-02T14:22:40.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.101+0000 7f80e97fa700 1 -- 172.21.15.33:0/3504901283 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f80ec05fd30 con 0x7f80d8064dd0 2022-02-02T14:22:40.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 msgr2=0x7f80d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 0x7f80d8067290 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f80ec0f66c0 tx=0x7f80dc00b040).stop 2022-02-02T14:22:40.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 msgr2=0x7f80ec107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f80d4009990 tx=0x7f80d4009b30).stop 2022-02-02T14:22:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 shutdown_connections 2022-02-02T14:22:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80d8064dd0 0x7f80d8067290 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80ec0f55c0 0x7f80ec106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 --2- 172.21.15.33:0/3504901283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80ec0f6860 0x7f80ec107460 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 >> 172.21.15.33:0/3504901283 conn(0x7f80ec0f0d40 msgr2=0x7f80ec05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 shutdown_connections 2022-02-02T14:22:40.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.103+0000 7f80f22a8700 1 -- 172.21.15.33:0/3504901283 wait complete. 2022-02-02T14:22:40.113 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:22:40.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 -- 172.21.15.33:0/1312634725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 msgr2=0x7fef040fbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1312634725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040fbc90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7feef0004660 tx=0x7feef0009b30).stop 2022-02-02T14:22:40.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 -- 172.21.15.33:0/1312634725 shutdown_connections 2022-02-02T14:22:40.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1312634725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040fbc90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1312634725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 0x7fef040f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 -- 172.21.15.33:0/1312634725 >> 172.21.15.33:0/1312634725 conn(0x7fef040f0d40 msgr2=0x7fef040f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 -- 172.21.15.33:0/1312634725 shutdown_connections 2022-02-02T14:22:40.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.204+0000 7fef0aeab700 1 -- 172.21.15.33:0/1312634725 wait complete. 2022-02-02T14:22:40.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 Processor -- start 2022-02-02T14:22:40.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 -- start start 2022-02-02T14:22:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 0x7fef040f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0410abe0 con 0x7fef040f98a0 2022-02-02T14:22:40.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef0aeab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0410ad20 con 0x7fef04060290 2022-02-02T14:22:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.205+0000 7fef03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60840/0 (socket says 172.21.15.33:60840) 2022-02-02T14:22:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 -- 172.21.15.33:0/1566673779 learned_addr learned my addr 172.21.15.33:0/1566673779 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:40.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef08c47700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 0x7fef040f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 -- 172.21.15.33:0/1566673779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 msgr2=0x7fef040f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 0x7fef040f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 -- 172.21.15.33:0/1566673779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0005040 con 0x7fef040f98a0 2022-02-02T14:22:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef03fff700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7feef0009830 tx=0x7feef0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef0018070 con 0x7fef040f98a0 2022-02-02T14:22:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef0410afa0 con 0x7fef040f98a0 2022-02-02T14:22:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0410b500 con 0x7fef040f98a0 2022-02-02T14:22:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feef0007ba0 con 0x7fef040f98a0 2022-02-02T14:22:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.206+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feef001de60 con 0x7fef040f98a0 2022-02-02T14:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.207+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee4004fa0 con 0x7fef040f98a0 2022-02-02T14:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.208+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feef0007d10 con 0x7fef040f98a0 2022-02-02T14:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.208+0000 7fef017fa700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 0x7feef4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.209+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feef00834c0 con 0x7fef040f98a0 2022-02-02T14:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.209+0000 7fef08c47700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 0x7feef4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.209+0000 7fef08c47700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 0x7feef4067270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fef040f6b30 tx=0x7feef800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.213+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feef0051510 con 0x7fef040f98a0 2022-02-02T14:22:40.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.397+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feee4000bc0 con 0x7feef4064db0 2022-02-02T14:22:40.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.412+0000 7fef017fa700 1 -- 172.21.15.33:0/1566673779 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7feee4000bc0 con 0x7feef4064db0 2022-02-02T14:22:40.413 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:22:40.413 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (47m) 10m ago 48m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:22:40.413 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (40m) 10m ago 48m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:22:40.413 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (40m) 10m ago 48m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:22:40.414 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (47m) 10m ago 48m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:22:40.414 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (41m) 10m ago 45m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:22:40.414 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (42m) 10m ago 45m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:22:40.414 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (42m) 10m ago 45m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:22:40.415 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (45m) 10m ago 45m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:22:40.415 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (42m) 10m ago 50m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:22:40.415 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (42m) 10m ago 48m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:22:40.415 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (41m) 10m ago 50m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:22:40.415 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (41m) 10m ago 48m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:22:40.416 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (48m) 10m ago 48m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:22:40.416 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (48m) 10m ago 48m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:22:40.416 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 10m ago 47m - 4096M 2022-02-02T14:22:40.416 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (47m) 10m ago 47m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:22:40.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (47m) 10m ago 47m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:22:40.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (46m) 10m ago 46m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:22:40.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (46m) 10m ago 46m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:22:40.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (46m) 10m ago 46m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:22:40.417 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (47m) 10m ago 48m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:22:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 msgr2=0x7feef4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 0x7feef4067270 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fef040f6b30 tx=0x7feef800b040).stop 2022-02-02T14:22:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 msgr2=0x7fef040f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7feef0009830 tx=0x7feef0009b30).stop 2022-02-02T14:22:40.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 shutdown_connections 2022-02-02T14:22:40.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feef4064db0 0x7feef4067270 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef04060290 0x7fef040f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.414+0000 7fef0aeab700 1 --2- 172.21.15.33:0/1566673779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef040f98a0 0x7fef040f5220 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.415+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 >> 172.21.15.33:0/1566673779 conn(0x7fef040f0d40 msgr2=0x7fef040f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.415+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 shutdown_connections 2022-02-02T14:22:40.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.415+0000 7fef0aeab700 1 -- 172.21.15.33:0/1566673779 wait complete. 2022-02-02T14:22:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:40 smithi033 ceph-mon[101165]: pgmap v1318: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:40.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 -- 172.21.15.33:0/3377551378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 msgr2=0x7fc6200f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 --2- 172.21.15.33:0/3377551378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc6200f6b60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fc610004660 tx=0x7fc610009b30).stop 2022-02-02T14:22:40.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 -- 172.21.15.33:0/3377551378 shutdown_connections 2022-02-02T14:22:40.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 --2- 172.21.15.33:0/3377551378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc6200f6b60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 --2- 172.21.15.33:0/3377551378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 0x7fc6200f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.514+0000 7fc62546e700 1 -- 172.21.15.33:0/3377551378 >> 172.21.15.33:0/3377551378 conn(0x7fc6200f0bc0 msgr2=0x7fc6200f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 -- 172.21.15.33:0/3377551378 shutdown_connections 2022-02-02T14:22:40.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 -- 172.21.15.33:0/3377551378 wait complete. 2022-02-02T14:22:40.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 Processor -- start 2022-02-02T14:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 -- start start 2022-02-02T14:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 0x7fc620106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620107920 con 0x7fc6200f6700 2022-02-02T14:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.515+0000 7fc62546e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620108130 con 0x7fc6200f5460 2022-02-02T14:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60850/0 (socket says 172.21.15.33:60850) 2022-02-02T14:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 -- 172.21.15.33:0/4051681189 learned_addr learned my addr 172.21.15.33:0/4051681189 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61effd700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 0x7fc620106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 -- 172.21.15.33:0/4051681189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 msgr2=0x7fc620106e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 0x7fc620106e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 -- 172.21.15.33:0/4051681189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc610005040 con 0x7fc6200f6700 2022-02-02T14:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc61e7fc700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fc610009990 tx=0x7fc610009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61001c070 con 0x7fc6200f6700 2022-02-02T14:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc620108350 con 0x7fc6200f6700 2022-02-02T14:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc610009630 con 0x7fc6200f6700 2022-02-02T14:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6201088b0 con 0x7fc6200f6700 2022-02-02T14:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.516+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc610021820 con 0x7fc6200f6700 2022-02-02T14:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.517+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc620059100 con 0x7fc6200f6700 2022-02-02T14:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.518+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc610012b80 con 0x7fc6200f6700 2022-02-02T14:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.518+0000 7fc6177fe700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 0x7fc60c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.518+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc610087c90 con 0x7fc6200f6700 2022-02-02T14:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.518+0000 7fc61effd700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 0x7fc60c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.519+0000 7fc61effd700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 0x7fc60c0672e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc620106ba0 tx=0x7fc60800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.523+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc610055c80 con 0x7fc6200f6700 2022-02-02T14:22:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:40 smithi037 ceph-mon[69017]: pgmap v1318: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:40.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.765+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc6200f8140 con 0x7fc6200f6700 2022-02-02T14:22:40.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.765+0000 7fc6177fe700 1 -- 172.21.15.33:0/4051681189 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc610087070 con 0x7fc6200f6700 2022-02-02T14:22:40.766 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:22:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:22:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:22:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:40.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:22:40.768 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:22:40.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:40.768 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:22:40.768 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:22:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:22:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:22:40.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:22:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:22:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:22:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:22:40.770 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:22:40.770 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:22:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 msgr2=0x7fc60c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 0x7fc60c0672e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc620106ba0 tx=0x7fc60800b040).stop 2022-02-02T14:22:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 msgr2=0x7fc620107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7fc610009990 tx=0x7fc610009b30).stop 2022-02-02T14:22:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 shutdown_connections 2022-02-02T14:22:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc60c064e20 0x7fc60c0672e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6200f5460 0x7fc620106e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 --2- 172.21.15.33:0/4051681189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6200f6700 0x7fc620107320 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 >> 172.21.15.33:0/4051681189 conn(0x7fc6200f0bc0 msgr2=0x7fc62005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.768+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 shutdown_connections 2022-02-02T14:22:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.769+0000 7fc62546e700 1 -- 172.21.15.33:0/4051681189 wait complete. 2022-02-02T14:22:40.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.869+0000 7feacf59e700 1 -- 172.21.15.33:0/851954028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f6530 msgr2=0x7fead00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.869+0000 7feacf59e700 1 --2- 172.21.15.33:0/851954028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f6530 0x7fead00f6950 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7feac0004660 tx=0x7feac0009b30).stop 2022-02-02T14:22:40.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- 172.21.15.33:0/851954028 shutdown_connections 2022-02-02T14:22:40.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 --2- 172.21.15.33:0/851954028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f77d0 0x7fead00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 --2- 172.21.15.33:0/851954028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f6530 0x7fead00f6950 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- 172.21.15.33:0/851954028 >> 172.21.15.33:0/851954028 conn(0x7fead00f1c90 msgr2=0x7fead00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:40.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- 172.21.15.33:0/851954028 shutdown_connections 2022-02-02T14:22:40.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- 172.21.15.33:0/851954028 wait complete. 2022-02-02T14:22:40.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 Processor -- start 2022-02-02T14:22:40.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- start start 2022-02-02T14:22:40.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 0x7fead006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead006a380 con 0x7fead00f77d0 2022-02-02T14:22:40.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.870+0000 7feacf59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead006a4c0 con 0x7fead00f6530 2022-02-02T14:22:40.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60860/0 (socket says 172.21.15.33:60860) 2022-02-02T14:22:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 -- 172.21.15.33:0/4293737168 learned_addr learned my addr 172.21.15.33:0/4293737168 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:22:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feace59c700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 0x7fead006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 -- 172.21.15.33:0/4293737168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 msgr2=0x7fead006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:40.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 0x7fead006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 -- 172.21.15.33:0/4293737168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0005040 con 0x7fead00f77d0 2022-02-02T14:22:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feace59c700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 0x7fead006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:22:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacdd9b700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7feac400e7f0 tx=0x7feac400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac40092e0 con 0x7fead00f77d0 2022-02-02T14:22:40.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feac400f040 con 0x7fead00f77d0 2022-02-02T14:22:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead006a7a0 con 0x7fead00f77d0 2022-02-02T14:22:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feac4014750 con 0x7fead00f77d0 2022-02-02T14:22:40.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.871+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead010ed50 con 0x7fead00f77d0 2022-02-02T14:22:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.872+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0045ad0 con 0x7fead00f77d0 2022-02-02T14:22:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.873+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feac401b030 con 0x7fead00f77d0 2022-02-02T14:22:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.873+0000 7feabeffd700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 0x7feab80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:22:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.873+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feac4081750 con 0x7fead00f77d0 2022-02-02T14:22:40.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.873+0000 7feace59c700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 0x7feab80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:22:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.874+0000 7feace59c700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 0x7feab80672e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7feac0004d80 tx=0x7feac000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:22:40.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:40.877+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feac404f8b0 con 0x7fead00f77d0 2022-02-02T14:22:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.091+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fead00fed90 con 0x7fead00f77d0 2022-02-02T14:22:41.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.092+0000 7feabeffd700 1 -- 172.21.15.33:0/4293737168 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7feac4019070 con 0x7fead00f77d0 2022-02-02T14:22:41.093 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:22:41.093 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:22:41.094 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:22:41.094 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:22:41.094 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:41.094 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:22:41.094 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:22:41.095 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:22:41.095 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:22:41.095 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:22:41.095 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:22:41.096 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:22:41.096 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:22:41.096 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:22:41.096 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:22:41.096 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:22:41.097 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:22:41.097 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:22:41.097 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:22:41.097 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:22:41.098 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:22:41.098 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:22:41.098 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:22:41.098 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:22:41.098 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:22:41.099 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:22:41.099 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:22:41.099 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:22:41.099 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:22:41.100 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:22:41.100 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:22:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:41.100 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:41.100 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:22:41.101 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:22:41.101 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:41.101 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:41.101 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:41.102 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:22:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 msgr2=0x7feab80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 0x7feab80672e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7feac0004d80 tx=0x7feac000b040).stop 2022-02-02T14:22:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 msgr2=0x7fead0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:22:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7feac400e7f0 tx=0x7feac400b040).stop 2022-02-02T14:22:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 shutdown_connections 2022-02-02T14:22:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feab8064e20 0x7feab80672e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fead00f6530 0x7fead006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 --2- 172.21.15.33:0/4293737168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fead00f77d0 0x7fead0069e20 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:22:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 >> 172.21.15.33:0/4293737168 conn(0x7fead00f1c90 msgr2=0x7fead00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:22:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 shutdown_connections 2022-02-02T14:22:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:22:41.094+0000 7feacf59e700 1 -- 172.21.15.33:0/4293737168 wait complete. 2022-02-02T14:22:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:22:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:41 smithi033 ceph-mon[101165]: from='client.35430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4051681189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:22:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4293737168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:22:41.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:41 smithi037 ceph-mon[69017]: from='client.35430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:41.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4051681189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:22:41.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4293737168' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:22:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:42 smithi037 ceph-mon[69017]: from='client.35434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:42.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:42 smithi037 ceph-mon[69017]: pgmap v1319: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:42 smithi033 ceph-mon[101165]: from='client.35434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:22:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:42 smithi033 ceph-mon[101165]: pgmap v1319: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:44 smithi037 ceph-mon[69017]: pgmap v1320: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:44 smithi033 ceph-mon[101165]: pgmap v1320: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:46 smithi037 ceph-mon[69017]: pgmap v1321: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:46 smithi033 ceph-mon[101165]: pgmap v1321: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:48 smithi037 ceph-mon[69017]: pgmap v1322: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:48 smithi033 ceph-mon[101165]: pgmap v1322: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:50 smithi037 ceph-mon[69017]: pgmap v1323: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:50 smithi033 ceph-mon[101165]: pgmap v1323: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:52 smithi037 ceph-mon[69017]: pgmap v1324: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:52 smithi033 ceph-mon[101165]: pgmap v1324: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:54 smithi037 ceph-mon[69017]: pgmap v1325: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:54 smithi033 ceph-mon[101165]: pgmap v1325: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:22:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:22:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:22:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:22:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:56 smithi037 ceph-mon[69017]: pgmap v1326: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:56 smithi033 ceph-mon[101165]: pgmap v1326: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:22:58 smithi037 ceph-mon[69017]: pgmap v1327: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:22:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:22:58 smithi033 ceph-mon[101165]: pgmap v1327: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:00 smithi037 ceph-mon[69017]: pgmap v1328: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:00 smithi033 ceph-mon[101165]: pgmap v1328: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:02 smithi037 ceph-mon[69017]: pgmap v1329: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:02 smithi033 ceph-mon[101165]: pgmap v1329: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:04 smithi037 ceph-mon[69017]: pgmap v1330: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:04 smithi033 ceph-mon[101165]: pgmap v1330: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:06 smithi037 ceph-mon[69017]: pgmap v1331: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:06 smithi033 ceph-mon[101165]: pgmap v1331: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:08 smithi033 ceph-mon[101165]: pgmap v1332: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:08 smithi037 ceph-mon[69017]: pgmap v1332: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:10 smithi033 ceph-mon[101165]: pgmap v1333: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:10 smithi037 ceph-mon[69017]: pgmap v1333: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.210+0000 7f5cec919700 1 -- 172.21.15.33:0/3615520945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 msgr2=0x7f5ce80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.210+0000 7f5cec919700 1 --2- 172.21.15.33:0/3615520945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce80f6cc0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f5cdc004660 tx=0x7f5cdc009b30).stop 2022-02-02T14:23:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 -- 172.21.15.33:0/3615520945 shutdown_connections 2022-02-02T14:23:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 --2- 172.21.15.33:0/3615520945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce80f6cc0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 --2- 172.21.15.33:0/3615520945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 0x7f5ce80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 -- 172.21.15.33:0/3615520945 >> 172.21.15.33:0/3615520945 conn(0x7f5ce80f0d40 msgr2=0x7f5ce80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 -- 172.21.15.33:0/3615520945 shutdown_connections 2022-02-02T14:23:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 -- 172.21.15.33:0/3615520945 wait complete. 2022-02-02T14:23:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 Processor -- start 2022-02-02T14:23:11.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.211+0000 7f5cec919700 1 -- start start 2022-02-02T14:23:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cec919700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 0x7f5ce8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cec919700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cec919700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce81069b0 con 0x7f5ce80f6860 2022-02-02T14:23:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cec919700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce81071c0 con 0x7f5ce80f55c0 2022-02-02T14:23:11.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60868/0 (socket says 172.21.15.33:60868) 2022-02-02T14:23:11.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 -- 172.21.15.33:0/607308470 learned_addr learned my addr 172.21.15.33:0/607308470 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:11.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce659c700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 0x7f5ce8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 -- 172.21.15.33:0/607308470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 msgr2=0x7f5ce8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 0x7f5ce8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 -- 172.21.15.33:0/607308470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc005040 con 0x7f5ce80f6860 2022-02-02T14:23:11.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5ce5d9b700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5cdc009990 tx=0x7f5cdc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cdc018070 con 0x7f5ce80f6860 2022-02-02T14:23:11.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce81073e0 con 0x7f5ce80f6860 2022-02-02T14:23:11.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5cdc007ba0 con 0x7f5ce80f6860 2022-02-02T14:23:11.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.212+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cdc01c3c0 con 0x7f5ce80f6860 2022-02-02T14:23:11.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.213+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce8107940 con 0x7f5ce80f6860 2022-02-02T14:23:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.214+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce80f49b0 con 0x7f5ce80f6860 2022-02-02T14:23:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.214+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5cdc01d420 con 0x7f5ce80f6860 2022-02-02T14:23:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.214+0000 7f5cd6ffd700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 0x7f5cd0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.215+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5cdc083700 con 0x7f5ce80f6860 2022-02-02T14:23:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.215+0000 7f5ce659c700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 0x7f5cd0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.215+0000 7f5ce659c700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 0x7f5cd0067290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5ce8105c30 tx=0x7f5cd800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.219+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5cdc051810 con 0x7f5ce80f6860 2022-02-02T14:23:11.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.407+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ce80fdf10 con 0x7f5cd0064dd0 2022-02-02T14:23:11.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.409+0000 7f5cd6ffd700 1 -- 172.21.15.33:0/607308470 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5ce80fdf10 con 0x7f5cd0064dd0 2022-02-02T14:23:11.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 msgr2=0x7f5cd0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 0x7f5cd0067290 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f5ce8105c30 tx=0x7f5cd800b040).stop 2022-02-02T14:23:11.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 msgr2=0x7f5ce81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f5cdc009990 tx=0x7f5cdc009b30).stop 2022-02-02T14:23:11.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 shutdown_connections 2022-02-02T14:23:11.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5cd0064dd0 0x7f5cd0067290 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce80f55c0 0x7f5ce8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 --2- 172.21.15.33:0/607308470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ce80f6860 0x7f5ce81063b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 >> 172.21.15.33:0/607308470 conn(0x7f5ce80f0d40 msgr2=0x7f5ce80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:11.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 shutdown_connections 2022-02-02T14:23:11.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.411+0000 7f5cec919700 1 -- 172.21.15.33:0/607308470 wait complete. 2022-02-02T14:23:11.420 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:23:11.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 -- 172.21.15.33:0/410342479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f7980 msgr2=0x7f01f40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 --2- 172.21.15.33:0/410342479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f7980 0x7f01f40f7de0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f01e8004660 tx=0x7f01e8009b30).stop 2022-02-02T14:23:11.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 -- 172.21.15.33:0/410342479 shutdown_connections 2022-02-02T14:23:11.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 --2- 172.21.15.33:0/410342479 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f7980 0x7f01f40f7de0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 --2- 172.21.15.33:0/410342479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f66e0 0x7f01f40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 -- 172.21.15.33:0/410342479 >> 172.21.15.33:0/410342479 conn(0x7f01f40f1e40 msgr2=0x7f01f40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:11.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 -- 172.21.15.33:0/410342479 shutdown_connections 2022-02-02T14:23:11.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 -- 172.21.15.33:0/410342479 wait complete. 2022-02-02T14:23:11.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.512+0000 7f01fa32a700 1 Processor -- start 2022-02-02T14:23:11.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01fa32a700 1 -- start start 2022-02-02T14:23:11.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01fa32a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01fa32a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f7980 0x7f01f4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01fa32a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f41079b0 con 0x7f01f40f66e0 2022-02-02T14:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01fa32a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f4107af0 con 0x7f01f40f7980 2022-02-02T14:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60876/0 (socket says 172.21.15.33:60876) 2022-02-02T14:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 -- 172.21.15.33:0/595018430 learned_addr learned my addr 172.21.15.33:0/595018430 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f37fe700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f7980 0x7f01f4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 -- 172.21.15.33:0/595018430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f7980 msgr2=0x7f01f4107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f7980 0x7f01f4107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.513+0000 7f01f3fff700 1 -- 172.21.15.33:0/595018430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e8005040 con 0x7f01f40f66e0 2022-02-02T14:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01f3fff700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f01e400e7c0 tx=0x7f01e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01e40092e0 con 0x7f01f40f66e0 2022-02-02T14:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f01e400f040 con 0x7f01f40f66e0 2022-02-02T14:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01e40147e0 con 0x7f01f40f66e0 2022-02-02T14:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f4108490 con 0x7f01f40f66e0 2022-02-02T14:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.514+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f4108a00 con 0x7f01f40f66e0 2022-02-02T14:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.515+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f4045ad0 con 0x7f01f40f66e0 2022-02-02T14:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.515+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f01e401b030 con 0x7f01f40f66e0 2022-02-02T14:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.516+0000 7f01f0ff9700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 0x7f01dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.516+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f01e40818e0 con 0x7f01f40f66e0 2022-02-02T14:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.516+0000 7f01f37fe700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 0x7f01dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.516+0000 7f01f37fe700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 0x7f01dc067290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f01e8005010 tx=0x7f01e8016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.520+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f01e40533c0 con 0x7f01f40f66e0 2022-02-02T14:23:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.703+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01f40fefe0 con 0x7f01dc064dd0 2022-02-02T14:23:11.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.718+0000 7f01f0ff9700 1 -- 172.21.15.33:0/595018430 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f01f40fefe0 con 0x7f01dc064dd0 2022-02-02T14:23:11.718 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:23:11.718 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (48m) 10m ago 49m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:23:11.719 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (41m) 10m ago 49m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:23:11.719 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (41m) 10m ago 48m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:23:11.719 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (48m) 10m ago 49m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:23:11.720 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (41m) 10m ago 45m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:23:11.720 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (42m) 10m ago 45m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:23:11.720 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (43m) 10m ago 45m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:23:11.720 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (45m) 10m ago 45m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:23:11.721 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (43m) 10m ago 50m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:23:11.721 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (42m) 10m ago 48m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:23:11.721 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (42m) 10m ago 50m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:23:11.721 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (42m) 10m ago 48m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:23:11.722 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (49m) 10m ago 49m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:23:11.722 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (48m) 10m ago 48m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:23:11.722 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 10m ago 48m - 4096M 2022-02-02T14:23:11.722 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (47m) 10m ago 47m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:23:11.723 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (47m) 10m ago 47m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:23:11.723 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (47m) 10m ago 47m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:23:11.723 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (47m) 10m ago 47m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:23:11.723 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (46m) 10m ago 46m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:23:11.723 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (48m) 10m ago 49m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:23:11.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 msgr2=0x7f01dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 0x7f01dc067290 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f01e8005010 tx=0x7f01e8016040).stop 2022-02-02T14:23:11.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 msgr2=0x7f01f4106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f01e400e7c0 tx=0x7f01e400b040).stop 2022-02-02T14:23:11.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 shutdown_connections 2022-02-02T14:23:11.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01dc064dd0 0x7f01dc067290 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01f40f66e0 0x7f01f4106f10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 --2- 172.21.15.33:0/595018430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01f40f7980 0x7f01f4107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 >> 172.21.15.33:0/595018430 conn(0x7f01f40f1e40 msgr2=0x7f01f40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 shutdown_connections 2022-02-02T14:23:11.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.720+0000 7f01fa32a700 1 -- 172.21.15.33:0/595018430 wait complete. 2022-02-02T14:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 -- 172.21.15.33:0/3841038498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 msgr2=0x7ff40c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 --2- 172.21.15.33:0/3841038498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c0f7a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7ff3fc004660 tx=0x7ff3fc009b30).stop 2022-02-02T14:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 -- 172.21.15.33:0/3841038498 shutdown_connections 2022-02-02T14:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 --2- 172.21.15.33:0/3841038498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c0f7a20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 --2- 172.21.15.33:0/3841038498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 -- 172.21.15.33:0/3841038498 >> 172.21.15.33:0/3841038498 conn(0x7ff40c0f1f00 msgr2=0x7ff40c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 -- 172.21.15.33:0/3841038498 shutdown_connections 2022-02-02T14:23:11.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.820+0000 7ff4132df700 1 -- 172.21.15.33:0/3841038498 wait complete. 2022-02-02T14:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 Processor -- start 2022-02-02T14:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 -- start start 2022-02-02T14:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c06a380 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff4132df700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c06a4c0 con 0x7ff40c0f66e0 2022-02-02T14:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff41087a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.821+0000 7ff41107b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60888/0 (socket says 172.21.15.33:60888) 2022-02-02T14:23:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41107b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43370/0 (socket says 172.21.15.33:43370) 2022-02-02T14:23:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 -- 172.21.15.33:0/3595239651 learned_addr learned my addr 172.21.15.33:0/3595239651 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 -- 172.21.15.33:0/3595239651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 msgr2=0x7ff40c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 -- 172.21.15.33:0/3595239651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc005040 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff41087a700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7ff3fc009990 tx=0x7ff3fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc018070 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c06a740 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3fc007ba0 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3fc01c3c0 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.822+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c06aca0 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.823+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c045ad0 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.824+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff3fc01d420 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.824+0000 7ff401ffb700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 0x7ff3f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:11.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.825+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff3fc083700 con 0x7ff40c0f6ff0 2022-02-02T14:23:11.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.825+0000 7ff41107b700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 0x7ff3f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:11.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.825+0000 7ff41107b700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 0x7ff3f8067290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff40c06b730 tx=0x7ff40800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:11.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:11.829+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff3fc051810 con 0x7ff40c0f6ff0 2022-02-02T14:23:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.070+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff40c027a00 con 0x7ff40c0f6ff0 2022-02-02T14:23:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.071+0000 7ff401ffb700 1 -- 172.21.15.33:0/3595239651 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff3fc054e30 con 0x7ff40c0f6ff0 2022-02-02T14:23:12.071 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:23:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:23:12.071 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:23:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:23:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:23:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:12.072 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:23:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:23:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:23:12.073 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:23:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:23:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:23:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:23:12.074 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:23:12.075 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:23:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 msgr2=0x7ff3f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 0x7ff3f8067290 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7ff40c06b730 tx=0x7ff40800b040).stop 2022-02-02T14:23:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 msgr2=0x7ff40c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7ff3fc009990 tx=0x7ff3fc009b30).stop 2022-02-02T14:23:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 shutdown_connections 2022-02-02T14:23:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3f8064dd0 0x7ff3f8067290 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff40c0f66e0 0x7ff40c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.072+0000 7ff4132df700 1 --2- 172.21.15.33:0/3595239651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff40c0f6ff0 0x7ff40c069e20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.073+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 >> 172.21.15.33:0/3595239651 conn(0x7ff40c0f1f00 msgr2=0x7ff40c0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.073+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 shutdown_connections 2022-02-02T14:23:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.073+0000 7ff4132df700 1 -- 172.21.15.33:0/3595239651 wait complete. 2022-02-02T14:23:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 -- 172.21.15.33:0/1334739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 msgr2=0x7fcc440f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 --2- 172.21.15.33:0/1334739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc440f5850 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fcc34004660 tx=0x7fcc34009b30).stop 2022-02-02T14:23:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 -- 172.21.15.33:0/1334739708 shutdown_connections 2022-02-02T14:23:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 --2- 172.21.15.33:0/1334739708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc440f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 --2- 172.21.15.33:0/1334739708 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc440f5850 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 -- 172.21.15.33:0/1334739708 >> 172.21.15.33:0/1334739708 conn(0x7fcc440f0b90 msgr2=0x7fcc440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 -- 172.21.15.33:0/1334739708 shutdown_connections 2022-02-02T14:23:12.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.174+0000 7fcc489b1700 1 -- 172.21.15.33:0/1334739708 wait complete. 2022-02-02T14:23:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 Processor -- start 2022-02-02T14:23:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 -- start start 2022-02-02T14:23:12.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:12.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc4410bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:12.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc440603e0 con 0x7fcc440f5430 2022-02-02T14:23:12.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc489b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc44060520 con 0x7fcc440f66d0 2022-02-02T14:23:12.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:12.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc437fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60896/0 (socket says 172.21.15.33:60896) 2022-02-02T14:23:12.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc437fe700 1 -- 172.21.15.33:0/2860057288 learned_addr learned my addr 172.21.15.33:0/2860057288 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:12.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.175+0000 7fcc42ffd700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc4410bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:12.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc437fe700 1 -- 172.21.15.33:0/2860057288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 msgr2=0x7fcc4410bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc437fe700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc4410bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc437fe700 1 -- 172.21.15.33:0/2860057288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc34005040 con 0x7fcc440f5430 2022-02-02T14:23:12.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc42ffd700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc4410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:23:12.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc437fe700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fcc34013a70 tx=0x7fcc34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:12.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc34018070 con 0x7fcc440f5430 2022-02-02T14:23:12.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4410c4e0 con 0x7fcc440f5430 2022-02-02T14:23:12.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc340097d0 con 0x7fcc440f5430 2022-02-02T14:23:12.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc3401c3c0 con 0x7fcc440f5430 2022-02-02T14:23:12.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.176+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4410ca40 con 0x7fcc440f5430 2022-02-02T14:23:12.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.177+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc44045ad0 con 0x7fcc440f5430 2022-02-02T14:23:12.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.178+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcc34007ba0 con 0x7fcc440f5430 2022-02-02T14:23:12.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.178+0000 7fcc2bfff700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 0x7fcc2c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:12.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.178+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcc34083790 con 0x7fcc440f5430 2022-02-02T14:23:12.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.178+0000 7fcc42ffd700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 0x7fcc2c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:12.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.179+0000 7fcc42ffd700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 0x7fcc2c0672e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fcc38009fd0 tx=0x7fcc3800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:12.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.182+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcc34051900 con 0x7fcc440f5430 2022-02-02T14:23:12.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.397+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc440fdcc0 con 0x7fcc440f5430 2022-02-02T14:23:12.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:12 smithi033 ceph-mon[101165]: pgmap v1334: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:12.398 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3595239651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:23:12.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.398+0000 7fcc2bfff700 1 -- 172.21.15.33:0/2860057288 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcc34054f20 con 0x7fcc440f5430 2022-02-02T14:23:12.399 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:23:12.399 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:23:12.400 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:23:12.400 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:23:12.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:12.401 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:23:12.401 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:23:12.401 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:23:12.401 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:23:12.402 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:23:12.402 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:23:12.402 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:23:12.402 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:23:12.403 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:23:12.403 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:23:12.403 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:23:12.404 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:23:12.404 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:23:12.404 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:23:12.404 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:23:12.405 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:23:12.405 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:23:12.405 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:23:12.405 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:23:12.406 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:23:12.406 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:23:12.406 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:23:12.406 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:23:12.407 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:23:12.407 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:23:12.407 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:23:12.407 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:12.408 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:23:12.408 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:12.408 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:12.409 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:12.409 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:12.409 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:12.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 msgr2=0x7fcc2c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 0x7fcc2c0672e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fcc38009fd0 tx=0x7fcc3800b040).stop 2022-02-02T14:23:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 msgr2=0x7fcc44109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fcc34013a70 tx=0x7fcc34009b30).stop 2022-02-02T14:23:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 shutdown_connections 2022-02-02T14:23:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc2c064e20 0x7fcc2c0672e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc440f5430 0x7fcc44109a90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 --2- 172.21.15.33:0/2860057288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc440f66d0 0x7fcc4410bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 >> 172.21.15.33:0/2860057288 conn(0x7fcc440f0b90 msgr2=0x7fcc440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 shutdown_connections 2022-02-02T14:23:12.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:12.400+0000 7fcc489b1700 1 -- 172.21.15.33:0/2860057288 wait complete. 2022-02-02T14:23:12.413 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:23:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:12 smithi037 ceph-mon[69017]: pgmap v1334: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:12.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3595239651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:23:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:13 smithi033 ceph-mon[101165]: from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:13 smithi033 ceph-mon[101165]: from='client.35450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2860057288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:23:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:13 smithi033 ceph-mon[101165]: pgmap v1335: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:13.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:13 smithi037 ceph-mon[69017]: from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:13 smithi037 ceph-mon[69017]: from='client.35450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2860057288' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:23:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:13 smithi037 ceph-mon[69017]: pgmap v1335: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:16.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:15 smithi033 ceph-mon[101165]: pgmap v1336: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:16.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:15 smithi037 ceph-mon[69017]: pgmap v1336: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:18 smithi033 ceph-mon[101165]: pgmap v1337: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:18 smithi037 ceph-mon[69017]: pgmap v1337: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:20.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:20 smithi033 ceph-mon[101165]: pgmap v1338: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:20 smithi037 ceph-mon[69017]: pgmap v1338: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:22 smithi033 ceph-mon[101165]: pgmap v1339: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:22 smithi037 ceph-mon[69017]: pgmap v1339: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:24 smithi033 ceph-mon[101165]: pgmap v1340: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:24 smithi037 ceph-mon[69017]: pgmap v1340: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:26 smithi033 ceph-mon[101165]: pgmap v1341: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:26 smithi037 ceph-mon[69017]: pgmap v1341: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:28 smithi033 ceph-mon[101165]: pgmap v1342: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:28 smithi037 ceph-mon[69017]: pgmap v1342: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:30 smithi033 ceph-mon[101165]: pgmap v1343: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:30 smithi037 ceph-mon[69017]: pgmap v1343: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:32.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:32 smithi033 ceph-mon[101165]: pgmap v1344: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:32 smithi037 ceph-mon[69017]: pgmap v1344: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:34.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:34 smithi033 ceph-mon[101165]: pgmap v1345: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:34 smithi037 ceph-mon[69017]: pgmap v1345: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:36 smithi033 ceph-mon[101165]: pgmap v1346: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:36 smithi037 ceph-mon[69017]: pgmap v1346: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:38 smithi033 ceph-mon[101165]: pgmap v1347: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:38 smithi037 ceph-mon[69017]: pgmap v1347: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:40 smithi033 ceph-mon[101165]: pgmap v1348: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:40 smithi037 ceph-mon[69017]: pgmap v1348: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:42 smithi033 ceph-mon[101165]: pgmap v1349: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:42.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 -- 172.21.15.33:0/3815473478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 msgr2=0x7fb6380f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 --2- 172.21.15.33:0/3815473478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb6380f6cc0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb62c004660 tx=0x7fb62c009b30).stop 2022-02-02T14:23:42.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 -- 172.21.15.33:0/3815473478 shutdown_connections 2022-02-02T14:23:42.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 --2- 172.21.15.33:0/3815473478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb6380f6cc0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 --2- 172.21.15.33:0/3815473478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb6380f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 -- 172.21.15.33:0/3815473478 >> 172.21.15.33:0/3815473478 conn(0x7fb6380f0d40 msgr2=0x7fb6380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:42.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 -- 172.21.15.33:0/3815473478 shutdown_connections 2022-02-02T14:23:42.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.515+0000 7fb6400a0700 1 -- 172.21.15.33:0/3815473478 wait complete. 2022-02-02T14:23:42.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.516+0000 7fb6400a0700 1 Processor -- start 2022-02-02T14:23:42.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.516+0000 7fb6400a0700 1 -- start start 2022-02-02T14:23:42.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb6400a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb63810bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb6400a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb6400a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380602b0 con 0x7fb6380f6860 2022-02-02T14:23:42.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb6400a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380603f0 con 0x7fb6380f55c0 2022-02-02T14:23:42.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63de3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb63810bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60908/0 (socket says 172.21.15.33:60908) 2022-02-02T14:23:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63de3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb63810bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43390/0 (socket says 172.21.15.33:43390) 2022-02-02T14:23:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 -- 172.21.15.33:0/771237575 learned_addr learned my addr 172.21.15.33:0/771237575 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 -- 172.21.15.33:0/771237575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 msgr2=0x7fb63810bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb63810bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 -- 172.21.15.33:0/771237575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c005040 con 0x7fb6380f6860 2022-02-02T14:23:42.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb63d63b700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb62c000c00 tx=0x7fb62c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:42.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c019070 con 0x7fb6380f6860 2022-02-02T14:23:42.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb62c007e70 con 0x7fb6380f6860 2022-02-02T14:23:42.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63810e9d0 con 0x7fb6380f6860 2022-02-02T14:23:42.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.517+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb62c014ce0 con 0x7fb6380f6860 2022-02-02T14:23:42.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.518+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63810eda0 con 0x7fb6380f6860 2022-02-02T14:23:42.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.518+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6380f49b0 con 0x7fb6380f6860 2022-02-02T14:23:42.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.519+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb62c025070 con 0x7fb6380f6860 2022-02-02T14:23:42.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.520+0000 7fb62a7fc700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.520+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb62c082a10 con 0x7fb6380f6860 2022-02-02T14:23:42.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.520+0000 7fb63de3c700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.520+0000 7fb63de3c700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 0x7fb624067290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb638060040 tx=0x7fb63400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:42.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.524+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb62c050ac0 con 0x7fb6380f6860 2022-02-02T14:23:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:42 smithi037 ceph-mon[69017]: pgmap v1349: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:42.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.715+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6380fde90 con 0x7fb624064dd0 2022-02-02T14:23:42.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.717+0000 7fb62a7fc700 1 -- 172.21.15.33:0/771237575 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb6380fde90 con 0x7fb624064dd0 2022-02-02T14:23:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 msgr2=0x7fb624067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 0x7fb624067290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb638060040 tx=0x7fb63400b040).stop 2022-02-02T14:23:42.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 msgr2=0x7fb63810e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fb62c000c00 tx=0x7fb62c00b040).stop 2022-02-02T14:23:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 shutdown_connections 2022-02-02T14:23:42.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb624064dd0 0x7fb624067290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6380f55c0 0x7fb63810bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 --2- 172.21.15.33:0/771237575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6380f6860 0x7fb63810e4e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.718+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 >> 172.21.15.33:0/771237575 conn(0x7fb6380f0d40 msgr2=0x7fb6380fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.719+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 shutdown_connections 2022-02-02T14:23:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.719+0000 7fb6400a0700 1 -- 172.21.15.33:0/771237575 wait complete. 2022-02-02T14:23:42.729 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:23:42.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 -- 172.21.15.33:0/4209791703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 msgr2=0x7fb7580f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/4209791703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb7580f5850 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7fb754004660 tx=0x7fb754009b30).stop 2022-02-02T14:23:42.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 -- 172.21.15.33:0/4209791703 shutdown_connections 2022-02-02T14:23:42.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/4209791703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 0x7fb7580f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/4209791703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb7580f5850 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 -- 172.21.15.33:0/4209791703 >> 172.21.15.33:0/4209791703 conn(0x7fb7580f0b90 msgr2=0x7fb7580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:42.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 -- 172.21.15.33:0/4209791703 shutdown_connections 2022-02-02T14:23:42.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.820+0000 7fb75e5e1700 1 -- 172.21.15.33:0/4209791703 wait complete. 2022-02-02T14:23:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 Processor -- start 2022-02-02T14:23:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 -- start start 2022-02-02T14:23:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 0x7fb75810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7580603e0 con 0x7fb7580f5430 2022-02-02T14:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.821+0000 7fb75e5e1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb758060520 con 0x7fb7580f66d0 2022-02-02T14:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60916/0 (socket says 172.21.15.33:60916) 2022-02-02T14:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 -- 172.21.15.33:0/351554636 learned_addr learned my addr 172.21.15.33:0/351554636 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75cdde700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 0x7fb75810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 -- 172.21.15.33:0/351554636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 msgr2=0x7fb75810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 0x7fb75810bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 -- 172.21.15.33:0/351554636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754005040 con 0x7fb7580f5430 2022-02-02T14:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75d5df700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fb754014040 tx=0x7fb75400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb75401d070 con 0x7fb7580f5430 2022-02-02T14:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb758105800 con 0x7fb7580f5430 2022-02-02T14:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb7540077b0 con 0x7fb7580f5430 2022-02-02T14:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.822+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb754021620 con 0x7fb7580f5430 2022-02-02T14:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.823+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb758105d60 con 0x7fb7580f5430 2022-02-02T14:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.824+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb758045ad0 con 0x7fb7580f5430 2022-02-02T14:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.824+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb754029070 con 0x7fb7580f5430 2022-02-02T14:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.825+0000 7fb749ffb700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 0x7fb7440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.825+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb754086e40 con 0x7fb7580f5430 2022-02-02T14:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.825+0000 7fb75cdde700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 0x7fb7440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.825+0000 7fb75cdde700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 0x7fb7440672e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fb74c009fd0 tx=0x7fb74c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:42.829+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb754054ef0 con 0x7fb7580f5430 2022-02-02T14:23:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.010+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb758057f10 con 0x7fb744064e20 2022-02-02T14:23:43.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.024+0000 7fb749ffb700 1 -- 172.21.15.33:0/351554636 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb758057f10 con 0x7fb744064e20 2022-02-02T14:23:43.025 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:23:43.025 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (49m) 11m ago 50m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:23:43.026 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (42m) 11m ago 49m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:23:43.026 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (41m) 11m ago 49m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:23:43.026 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (48m) 11m ago 49m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:23:43.026 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (42m) 11m ago 46m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:23:43.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (43m) 11m ago 46m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:23:43.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (43m) 11m ago 46m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:23:43.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (46m) 11m ago 46m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:23:43.027 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (43m) 11m ago 51m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:23:43.028 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (43m) 11m ago 49m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:23:43.028 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (42m) 11m ago 51m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:23:43.028 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (42m) 11m ago 49m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:23:43.028 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (49m) 11m ago 49m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:23:43.029 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (49m) 11m ago 49m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:23:43.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 11m ago 48m - 4096M 2022-02-02T14:23:43.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (48m) 11m ago 48m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:23:43.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (48m) 11m ago 48m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:23:43.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (47m) 11m ago 47m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:23:43.030 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (47m) 11m ago 47m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:23:43.030 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (47m) 11m ago 47m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:23:43.030 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (48m) 11m ago 49m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:23:43.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 msgr2=0x7fb7440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 0x7fb7440672e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fb74c009fd0 tx=0x7fb74c00b040).stop 2022-02-02T14:23:43.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 msgr2=0x7fb758109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fb754014040 tx=0x7fb75400b040).stop 2022-02-02T14:23:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 shutdown_connections 2022-02-02T14:23:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb744064e20 0x7fb7440672e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7580f5430 0x7fb758109a20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 --2- 172.21.15.33:0/351554636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7580f66d0 0x7fb75810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 >> 172.21.15.33:0/351554636 conn(0x7fb7580f0b90 msgr2=0x7fb7580fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 shutdown_connections 2022-02-02T14:23:43.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.026+0000 7fb75e5e1700 1 -- 172.21.15.33:0/351554636 wait complete. 2022-02-02T14:23:43.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.126+0000 7f5217297700 1 -- 172.21.15.33:0/1141195648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 msgr2=0x7f52100fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.126+0000 7f5217297700 1 --2- 172.21.15.33:0/1141195648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f52100fbae0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f5200004660 tx=0x7f5200009b30).stop 2022-02-02T14:23:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 -- 172.21.15.33:0/1141195648 shutdown_connections 2022-02-02T14:23:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 --2- 172.21.15.33:0/1141195648 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f52100fbae0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 --2- 172.21.15.33:0/1141195648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 0x7f52100f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 -- 172.21.15.33:0/1141195648 >> 172.21.15.33:0/1141195648 conn(0x7f52100f0b90 msgr2=0x7f52100f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 -- 172.21.15.33:0/1141195648 shutdown_connections 2022-02-02T14:23:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 -- 172.21.15.33:0/1141195648 wait complete. 2022-02-02T14:23:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 Processor -- start 2022-02-02T14:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.127+0000 7f5217297700 1 -- start start 2022-02-02T14:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5217297700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 0x7f5210106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5217297700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5217297700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210107890 con 0x7f52100f9690 2022-02-02T14:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5217297700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52101080d0 con 0x7f5210060310 2022-02-02T14:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60926/0 (socket says 172.21.15.33:60926) 2022-02-02T14:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 -- 172.21.15.33:0/2110871596 learned_addr learned my addr 172.21.15.33:0/2110871596 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5216295700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 0x7f5210106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 -- 172.21.15.33:0/2110871596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 msgr2=0x7f5210106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 0x7f5210106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 -- 172.21.15.33:0/2110871596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5200005040 con 0x7f52100f9690 2022-02-02T14:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.128+0000 7f5215a94700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5200004f60 tx=0x7f5200009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.129+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5200018070 con 0x7f52100f9690 2022-02-02T14:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.129+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5200009770 con 0x7f52100f9690 2022-02-02T14:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.129+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210108350 con 0x7f52100f9690 2022-02-02T14:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.129+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520001c3c0 con 0x7f52100f9690 2022-02-02T14:23:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.129+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5210108830 con 0x7f52100f9690 2022-02-02T14:23:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.130+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210059100 con 0x7f52100f9690 2022-02-02T14:23:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.130+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f520001d420 con 0x7f52100f9690 2022-02-02T14:23:43.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.131+0000 7f5206ffd700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 0x7f51fc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.131+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f52000837d0 con 0x7f52100f9690 2022-02-02T14:23:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.131+0000 7f5216295700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 0x7f51fc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.131+0000 7f5216295700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 0x7f51fc0672e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f520c007fd0 tx=0x7f520c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:43.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.135+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5200051880 con 0x7f52100f9690 2022-02-02T14:23:43.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.379+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f52100fede0 con 0x7f52100f9690 2022-02-02T14:23:43.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.379+0000 7f5206ffd700 1 -- 172.21.15.33:0/2110871596 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5200054ea0 con 0x7f52100f9690 2022-02-02T14:23:43.380 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:23:43.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:23:43.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:23:43.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:43.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:23:43.382 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:23:43.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:43.382 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:23:43.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:23:43.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:43.383 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:23:43.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:23:43.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:23:43.384 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:23:43.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:23:43.384 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:23:43.385 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:23:43.385 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:23:43.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 msgr2=0x7f51fc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 0x7f51fc0672e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f520c007fd0 tx=0x7f520c009040).stop 2022-02-02T14:23:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 msgr2=0x7f5210107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5200004f60 tx=0x7f5200009b30).stop 2022-02-02T14:23:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 shutdown_connections 2022-02-02T14:23:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f51fc064e20 0x7f51fc0672e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5210060310 0x7f5210106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 --2- 172.21.15.33:0/2110871596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52100f9690 0x7f5210107290 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 >> 172.21.15.33:0/2110871596 conn(0x7f52100f0b90 msgr2=0x7f52100f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 shutdown_connections 2022-02-02T14:23:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.381+0000 7f5217297700 1 -- 172.21.15.33:0/2110871596 wait complete. 2022-02-02T14:23:43.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 -- 172.21.15.33:0/3554849618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 msgr2=0x7ff9440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 --2- 172.21.15.33:0/3554849618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff9440f59e0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7ff938004660 tx=0x7ff938009b30).stop 2022-02-02T14:23:43.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 -- 172.21.15.33:0/3554849618 shutdown_connections 2022-02-02T14:23:43.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 --2- 172.21.15.33:0/3554849618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 0x7ff9440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 --2- 172.21.15.33:0/3554849618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff9440f59e0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 -- 172.21.15.33:0/3554849618 >> 172.21.15.33:0/3554849618 conn(0x7ff9440f0d40 msgr2=0x7ff9440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:43.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.481+0000 7ff948c4d700 1 -- 172.21.15.33:0/3554849618 shutdown_connections 2022-02-02T14:23:43.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 -- 172.21.15.33:0/3554849618 wait complete. 2022-02-02T14:23:43.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 Processor -- start 2022-02-02T14:23:43.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 -- start start 2022-02-02T14:23:43.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 0x7ff944109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944109c00 con 0x7ff9440f55c0 2022-02-02T14:23:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff948c4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff944109d40 con 0x7ff9440f6860 2022-02-02T14:23:43.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff94259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff94259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60934/0 (socket says 172.21.15.33:60934) 2022-02-02T14:23:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.482+0000 7ff94259c700 1 -- 172.21.15.33:0/1496720574 learned_addr learned my addr 172.21.15.33:0/1496720574 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:23:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff941d9b700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 0x7ff944109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff94259c700 1 -- 172.21.15.33:0/1496720574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 msgr2=0x7ff944109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff94259c700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 0x7ff944109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff94259c700 1 -- 172.21.15.33:0/1496720574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff938005040 con 0x7ff9440f55c0 2022-02-02T14:23:43.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff94259c700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7ff938004f60 tx=0x7ff938009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:43.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff938018070 con 0x7ff9440f55c0 2022-02-02T14:23:43.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94410a680 con 0x7ff9440f55c0 2022-02-02T14:23:43.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff938009770 con 0x7ff9440f55c0 2022-02-02T14:23:43.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff93801c3c0 con 0x7ff9440f55c0 2022-02-02T14:23:43.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.483+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94410abe0 con 0x7ff9440f55c0 2022-02-02T14:23:43.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.484+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944045ad0 con 0x7ff9440f55c0 2022-02-02T14:23:43.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.485+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff93801d420 con 0x7ff9440f55c0 2022-02-02T14:23:43.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.485+0000 7ff932ffd700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:23:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.485+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9380838d0 con 0x7ff9440f55c0 2022-02-02T14:23:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.485+0000 7ff941d9b700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:23:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.485+0000 7ff941d9b700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 0x7ff92c067290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff934007fd0 tx=0x7ff934009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:23:43.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.489+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff938055470 con 0x7ff9440f55c0 2022-02-02T14:23:43.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.699+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9440fdf00 con 0x7ff9440f55c0 2022-02-02T14:23:43.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.700+0000 7ff932ffd700 1 -- 172.21.15.33:0/1496720574 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff938055060 con 0x7ff9440f55c0 2022-02-02T14:23:43.701 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:23:43.701 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:23:43.701 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:23:43.702 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:23:43.702 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:43.702 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:23:43.703 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:23:43.703 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:23:43.703 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:23:43.703 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:23:43.703 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:23:43.704 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:23:43.704 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:23:43.704 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:23:43.704 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:23:43.705 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:23:43.705 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:23:43.705 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:23:43.705 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:23:43.706 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:23:43.706 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:23:43.706 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:23:43.706 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:23:43.706 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:23:43.707 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:23:43.707 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:23:43.707 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:23:43.707 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:23:43.708 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:23:43.708 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:23:43.708 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:23:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:43.708 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:43.709 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:23:43.709 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:23:43.709 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:43.709 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:43.710 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:43.710 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:23:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 msgr2=0x7ff92c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 0x7ff92c067290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff934007fd0 tx=0x7ff934009040).stop 2022-02-02T14:23:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 msgr2=0x7ff944109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:23:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7ff938004f60 tx=0x7ff938009b30).stop 2022-02-02T14:23:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 shutdown_connections 2022-02-02T14:23:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff92c064dd0 0x7ff92c067290 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9440f55c0 0x7ff944109160 secure :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0x7ff938004f60 tx=0x7ff938009b30).stop 2022-02-02T14:23:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 --2- 172.21.15.33:0/1496720574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9440f6860 0x7ff944109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:23:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 >> 172.21.15.33:0/1496720574 conn(0x7ff9440f0d40 msgr2=0x7ff94405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:23:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 shutdown_connections 2022-02-02T14:23:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:23:43.702+0000 7ff948c4d700 1 -- 172.21.15.33:0/1496720574 wait complete. 2022-02-02T14:23:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:23:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:44 smithi033 ceph-mon[101165]: from='client.35462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:44 smithi033 ceph-mon[101165]: pgmap v1350: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:44 smithi033 ceph-mon[101165]: from='client.35466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2110871596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:23:44.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1496720574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:23:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:44 smithi037 ceph-mon[69017]: from='client.35462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:44 smithi037 ceph-mon[69017]: pgmap v1350: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:44 smithi037 ceph-mon[69017]: from='client.35466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:23:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2110871596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:23:44.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1496720574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:23:46.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:46 smithi033 ceph-mon[101165]: pgmap v1351: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:46 smithi037 ceph-mon[69017]: pgmap v1351: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:48 smithi033 ceph-mon[101165]: pgmap v1352: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:48 smithi037 ceph-mon[69017]: pgmap v1352: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:50.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:50 smithi033 ceph-mon[101165]: pgmap v1353: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:50 smithi037 ceph-mon[69017]: pgmap v1353: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:52 smithi033 ceph-mon[101165]: pgmap v1354: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:52 smithi037 ceph-mon[69017]: pgmap v1354: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:54 smithi033 ceph-mon[101165]: pgmap v1355: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:54 smithi037 ceph-mon[69017]: pgmap v1355: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:23:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:23:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:23:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:23:56.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:56 smithi033 ceph-mon[101165]: pgmap v1356: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:56 smithi037 ceph-mon[69017]: pgmap v1356: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:23:58 smithi033 ceph-mon[101165]: pgmap v1357: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:23:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:23:58 smithi037 ceph-mon[69017]: pgmap v1357: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:00 smithi033 ceph-mon[101165]: pgmap v1358: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:00 smithi037 ceph-mon[69017]: pgmap v1358: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:02 smithi033 ceph-mon[101165]: pgmap v1359: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:02 smithi037 ceph-mon[69017]: pgmap v1359: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:04 smithi033 ceph-mon[101165]: pgmap v1360: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:04 smithi037 ceph-mon[69017]: pgmap v1360: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:06.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:06 smithi033 ceph-mon[101165]: pgmap v1361: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:06 smithi037 ceph-mon[69017]: pgmap v1361: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:08.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:08 smithi033 ceph-mon[101165]: pgmap v1362: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:08 smithi037 ceph-mon[69017]: pgmap v1362: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:10 smithi033 ceph-mon[101165]: pgmap v1363: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:10 smithi037 ceph-mon[69017]: pgmap v1363: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:12 smithi037 ceph-mon[69017]: pgmap v1364: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:12 smithi033 ceph-mon[101165]: pgmap v1364: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:13.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1666332826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 msgr2=0x7fdeb00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:13.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1666332826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb00f59e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7fdeac004660 tx=0x7fdeac009b30).stop 2022-02-02T14:24:13.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1666332826 shutdown_connections 2022-02-02T14:24:13.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1666332826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 0x7fdeb00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1666332826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb00f59e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.818+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1666332826 >> 172.21.15.33:0/1666332826 conn(0x7fdeb00f0d40 msgr2=0x7fdeb00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.819+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1666332826 shutdown_connections 2022-02-02T14:24:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.819+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1666332826 wait complete. 2022-02-02T14:24:13.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.819+0000 7fdeb72a0700 1 Processor -- start 2022-02-02T14:24:13.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.819+0000 7fdeb72a0700 1 -- start start 2022-02-02T14:24:13.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb72a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb72a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 0x7fdeb0107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb72a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01079c0 con 0x7fdeb00f55c0 2022-02-02T14:24:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb72a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0107b00 con 0x7fdeb00f6860 2022-02-02T14:24:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60944/0 (socket says 172.21.15.33:60944) 2022-02-02T14:24:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 -- 172.21.15.33:0/1543892906 learned_addr learned my addr 172.21.15.33:0/1543892906 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb483b700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 0x7fdeb0107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 -- 172.21.15.33:0/1543892906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 msgr2=0x7fdeb0107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 0x7fdeb0107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 -- 172.21.15.33:0/1543892906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeac005040 con 0x7fdeb00f55c0 2022-02-02T14:24:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.820+0000 7fdeb503c700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fdeac014040 tx=0x7fdeac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:13.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.821+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac019070 con 0x7fdeb00f55c0 2022-02-02T14:24:13.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.821+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb0108440 con 0x7fdeb00f55c0 2022-02-02T14:24:13.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.821+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdeac007e70 con 0x7fdeb00f55c0 2022-02-02T14:24:13.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.821+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdeac014d50 con 0x7fdeb00f55c0 2022-02-02T14:24:13.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.821+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb01089a0 con 0x7fdeb00f55c0 2022-02-02T14:24:13.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.822+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0045ad0 con 0x7fdeb00f55c0 2022-02-02T14:24:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.822+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdeac025070 con 0x7fdeb00f55c0 2022-02-02T14:24:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.823+0000 7fdea5ffb700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 0x7fde9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.823+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdeac082b70 con 0x7fdeb00f55c0 2022-02-02T14:24:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.823+0000 7fdeb483b700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 0x7fde9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.823+0000 7fdeb483b700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 0x7fde9c067290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fdea0009da0 tx=0x7fdea000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:13.827+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdeac054650 con 0x7fdeb00f55c0 2022-02-02T14:24:14.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.017+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdeb005fd30 con 0x7fde9c064dd0 2022-02-02T14:24:14.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.019+0000 7fdea5ffb700 1 -- 172.21.15.33:0/1543892906 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fdeb005fd30 con 0x7fde9c064dd0 2022-02-02T14:24:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 msgr2=0x7fde9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 0x7fde9c067290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fdea0009da0 tx=0x7fdea000b040).stop 2022-02-02T14:24:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 msgr2=0x7fdeb0106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fdeac014040 tx=0x7fdeac00b040).stop 2022-02-02T14:24:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 shutdown_connections 2022-02-02T14:24:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fde9c064dd0 0x7fde9c067290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdeb00f55c0 0x7fdeb0106f20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 --2- 172.21.15.33:0/1543892906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdeb00f6860 0x7fdeb0107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 >> 172.21.15.33:0/1543892906 conn(0x7fdeb00f0d40 msgr2=0x7fdeb005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 shutdown_connections 2022-02-02T14:24:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.021+0000 7fdeb72a0700 1 -- 172.21.15.33:0/1543892906 wait complete. 2022-02-02T14:24:14.030 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:24:14.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 -- 172.21.15.33:0/3363637434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 msgr2=0x7fc3bc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 --2- 172.21.15.33:0/3363637434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f5850 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7fc3b0004660 tx=0x7fc3b0009b30).stop 2022-02-02T14:24:14.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 -- 172.21.15.33:0/3363637434 shutdown_connections 2022-02-02T14:24:14.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 --2- 172.21.15.33:0/3363637434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 --2- 172.21.15.33:0/3363637434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f5850 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.121+0000 7fc3c1934700 1 -- 172.21.15.33:0/3363637434 >> 172.21.15.33:0/3363637434 conn(0x7fc3bc0f0b90 msgr2=0x7fc3bc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.122+0000 7fc3c1934700 1 -- 172.21.15.33:0/3363637434 shutdown_connections 2022-02-02T14:24:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.122+0000 7fc3c1934700 1 -- 172.21.15.33:0/3363637434 wait complete. 2022-02-02T14:24:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.122+0000 7fc3c1934700 1 Processor -- start 2022-02-02T14:24:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.122+0000 7fc3c1934700 1 -- start start 2022-02-02T14:24:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c1934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c1934700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c1934700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0f7f70 con 0x7fc3bc0f5430 2022-02-02T14:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c1934700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0f80b0 con 0x7fc3bc0f66d0 2022-02-02T14:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60954/0 (socket says 172.21.15.33:60954) 2022-02-02T14:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 -- 172.21.15.33:0/368796513 learned_addr learned my addr 172.21.15.33:0/368796513 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3bbfff700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 -- 172.21.15.33:0/368796513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 msgr2=0x7fc3bc0f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 -- 172.21.15.33:0/368796513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3b0005040 con 0x7fc3bc0f5430 2022-02-02T14:24:14.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.123+0000 7fc3c0932700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc3b0004f60 tx=0x7fc3b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.124+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b0018070 con 0x7fc3bc0f5430 2022-02-02T14:24:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.124+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc3b0009770 con 0x7fc3bc0f5430 2022-02-02T14:24:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.124+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0f8330 con 0x7fc3bc0f5430 2022-02-02T14:24:14.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.124+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3b001c3c0 con 0x7fc3bc0f5430 2022-02-02T14:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.124+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc0f8890 con 0x7fc3bc0f5430 2022-02-02T14:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.125+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc045ad0 con 0x7fc3bc0f5430 2022-02-02T14:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.125+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc3b001d420 con 0x7fc3bc0f5430 2022-02-02T14:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.126+0000 7fc3b97fa700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 0x7fc3ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.126+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc3b0083810 con 0x7fc3bc0f5430 2022-02-02T14:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.126+0000 7fc3bbfff700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 0x7fc3ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.126+0000 7fc3bbfff700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 0x7fc3ac0672e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fc3a8007fd0 tx=0x7fc3a8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.130+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3b00518c0 con 0x7fc3bc0f5430 2022-02-02T14:24:14.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.317+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3bc0fab10 con 0x7fc3ac064e20 2022-02-02T14:24:14.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.331+0000 7fc3b97fa700 1 -- 172.21.15.33:0/368796513 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc3bc0fab10 con 0x7fc3ac064e20 2022-02-02T14:24:14.331 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:24:14.331 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (49m) 11m ago 50m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:24:14.332 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (42m) 11m ago 50m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:24:14.332 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (42m) 11m ago 49m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:24:14.332 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (49m) 11m ago 50m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:24:14.332 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (43m) 11m ago 46m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:24:14.333 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (43m) 11m ago 46m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:24:14.333 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (44m) 11m ago 46m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:24:14.333 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (46m) 11m ago 46m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:24:14.333 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (44m) 11m ago 51m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:24:14.334 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (43m) 11m ago 49m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:24:14.334 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (43m) 11m ago 51m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:24:14.334 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (43m) 11m ago 49m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:24:14.334 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (50m) 11m ago 50m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:24:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (49m) 11m ago 49m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:24:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 11m ago 49m - 4096M 2022-02-02T14:24:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (48m) 11m ago 48m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:24:14.335 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (48m) 11m ago 48m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:24:14.336 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (48m) 11m ago 48m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:24:14.336 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (48m) 11m ago 48m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:24:14.336 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (47m) 11m ago 47m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:24:14.337 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (49m) 11m ago 50m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:24:14.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 msgr2=0x7fc3ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 0x7fc3ac0672e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fc3a8007fd0 tx=0x7fc3a8009040).stop 2022-02-02T14:24:14.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 msgr2=0x7fc3bc0f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc3b0004f60 tx=0x7fc3b0009b30).stop 2022-02-02T14:24:14.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 shutdown_connections 2022-02-02T14:24:14.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc3ac064e20 0x7fc3ac0672e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3bc0f5430 0x7fc3bc0f9590 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 --2- 172.21.15.33:0/368796513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3bc0f66d0 0x7fc3bc0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 >> 172.21.15.33:0/368796513 conn(0x7fc3bc0f0b90 msgr2=0x7fc3bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.333+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 shutdown_connections 2022-02-02T14:24:14.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.334+0000 7fc3c1934700 1 -- 172.21.15.33:0/368796513 wait complete. 2022-02-02T14:24:14.342 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:14 smithi033 ceph-mon[101165]: pgmap v1365: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:14.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 -- 172.21.15.33:0/1702975806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f55c0 msgr2=0x7f9ec00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 --2- 172.21.15.33:0/1702975806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f55c0 0x7f9ec00f59e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f9eb0004660 tx=0x7f9eb0009b30).stop 2022-02-02T14:24:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 -- 172.21.15.33:0/1702975806 shutdown_connections 2022-02-02T14:24:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 --2- 172.21.15.33:0/1702975806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f6860 0x7f9ec00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 --2- 172.21.15.33:0/1702975806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f55c0 0x7f9ec00f59e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 -- 172.21.15.33:0/1702975806 >> 172.21.15.33:0/1702975806 conn(0x7f9ec00f0d40 msgr2=0x7f9ec00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 -- 172.21.15.33:0/1702975806 shutdown_connections 2022-02-02T14:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.433+0000 7f9ec5544700 1 -- 172.21.15.33:0/1702975806 wait complete. 2022-02-02T14:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 Processor -- start 2022-02-02T14:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 -- start start 2022-02-02T14:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f55c0 0x7f9ec0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00603e0 con 0x7f9ec00f6860 2022-02-02T14:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ec5544700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec0060520 con 0x7f9ec00f55c0 2022-02-02T14:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60966/0 (socket says 172.21.15.33:60966) 2022-02-02T14:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 -- 172.21.15.33:0/582650659 learned_addr learned my addr 172.21.15.33:0/582650659 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebeffd700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f55c0 0x7f9ec0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 -- 172.21.15.33:0/582650659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f55c0 msgr2=0x7f9ec0109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f55c0 0x7f9ec0109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.434+0000 7f9ebe7fc700 1 -- 172.21.15.33:0/582650659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb0005040 con 0x7f9ec00f6860 2022-02-02T14:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ebe7fc700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9eb400c530 tx=0x7f9eb4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb400f650 con 0x7f9ec00f6860 2022-02-02T14:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9eb400fc60 con 0x7f9ec00f6860 2022-02-02T14:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec010c720 con 0x7f9ec00f6860 2022-02-02T14:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb4012c20 con 0x7f9ec00f6860 2022-02-02T14:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.435+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec010cce0 con 0x7f9ec00f6860 2022-02-02T14:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.436+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec0045ad0 con 0x7f9ec00f6860 2022-02-02T14:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.436+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9eb4010070 con 0x7f9ec00f6860 2022-02-02T14:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.437+0000 7f9ea77fe700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 0x7f9ea8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.437+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9eb4081730 con 0x7f9ec00f6860 2022-02-02T14:24:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.437+0000 7f9ebeffd700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 0x7f9ea8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.437+0000 7f9ebeffd700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 0x7f9ea8067290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f9eb0013690 tx=0x7f9eb0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.441+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9eb404f7e0 con 0x7f9ec00f6860 2022-02-02T14:24:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:14 smithi037 ceph-mon[69017]: pgmap v1365: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.685+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ec0027a00 con 0x7f9ec00f6860 2022-02-02T14:24:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.685+0000 7f9ea77fe700 1 -- 172.21.15.33:0/582650659 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9eb4052e00 con 0x7f9ec00f6860 2022-02-02T14:24:14.686 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:24:14.686 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:24:14.686 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:24:14.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:14.687 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:24:14.687 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:24:14.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:14.687 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:24:14.688 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:24:14.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:14.688 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:24:14.688 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:24:14.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:14.689 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:24:14.689 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:24:14.689 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:24:14.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:24:14.690 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:24:14.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.687+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 msgr2=0x7f9ea8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.687+0000 7f9ec5544700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 0x7f9ea8067290 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f9eb0013690 tx=0x7f9eb0009b30).stop 2022-02-02T14:24:14.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.687+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 msgr2=0x7f9ec010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.687+0000 7f9ec5544700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f9eb400c530 tx=0x7f9eb4007e20).stop 2022-02-02T14:24:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 shutdown_connections 2022-02-02T14:24:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ea8064dd0 0x7f9ea8067290 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ec00f55c0 0x7f9ec0109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 --2- 172.21.15.33:0/582650659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ec00f6860 0x7f9ec010c170 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 >> 172.21.15.33:0/582650659 conn(0x7f9ec00f0d40 msgr2=0x7f9ec00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 shutdown_connections 2022-02-02T14:24:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.688+0000 7f9ec5544700 1 -- 172.21.15.33:0/582650659 wait complete. 2022-02-02T14:24:14.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 -- 172.21.15.33:0/2397348362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 msgr2=0x7fd2a40f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/2397348362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a40f9360 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fd298004660 tx=0x7fd298009b30).stop 2022-02-02T14:24:14.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 -- 172.21.15.33:0/2397348362 shutdown_connections 2022-02-02T14:24:14.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/2397348362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a40fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/2397348362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a40f9360 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 -- 172.21.15.33:0/2397348362 >> 172.21.15.33:0/2397348362 conn(0x7fd2a40f0d40 msgr2=0x7fd2a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 -- 172.21.15.33:0/2397348362 shutdown_connections 2022-02-02T14:24:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 -- 172.21.15.33:0/2397348362 wait complete. 2022-02-02T14:24:14.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.789+0000 7fd2aaca2700 1 Processor -- start 2022-02-02T14:24:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2aaca2700 1 -- start start 2022-02-02T14:24:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2aaca2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2aaca2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2aaca2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a4107a20 con 0x7fd2a4060250 2022-02-02T14:24:14.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2aaca2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a4107b60 con 0x7fd2a40f9850 2022-02-02T14:24:14.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60974/0 (socket says 172.21.15.33:60974) 2022-02-02T14:24:14.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 -- 172.21.15.33:0/892239276 learned_addr learned my addr 172.21.15.33:0/892239276 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:14.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a3fff700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 -- 172.21.15.33:0/892239276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 msgr2=0x7fd2a4107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:14.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a4107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:14.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 -- 172.21.15.33:0/892239276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298005040 con 0x7fd2a4060250 2022-02-02T14:24:14.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a3fff700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:24:14.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.790+0000 7fd2a8a3e700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd298009990 tx=0x7fd298009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.791+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd298018070 con 0x7fd2a4060250 2022-02-02T14:24:14.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.791+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd298007ba0 con 0x7fd2a4060250 2022-02-02T14:24:14.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.791+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a41084a0 con 0x7fd2a4060250 2022-02-02T14:24:14.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.791+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29801c3c0 con 0x7fd2a4060250 2022-02-02T14:24:14.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.791+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a4108a00 con 0x7fd2a4060250 2022-02-02T14:24:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.792+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a4045ad0 con 0x7fd2a4060250 2022-02-02T14:24:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.793+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd29801d420 con 0x7fd2a4060250 2022-02-02T14:24:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.793+0000 7fd2a17fa700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 0x7fd294067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.793+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd298083950 con 0x7fd2a4060250 2022-02-02T14:24:14.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.793+0000 7fd2a3fff700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 0x7fd294067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:14.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.794+0000 7fd2a3fff700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 0x7fd294067290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fd290009fd0 tx=0x7fd29000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:14.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:14.797+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd298055450 con 0x7fd2a4060250 2022-02-02T14:24:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.010+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd2a40ff050 con 0x7fd2a4060250 2022-02-02T14:24:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.011+0000 7fd2a17fa700 1 -- 172.21.15.33:0/892239276 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd298055040 con 0x7fd2a4060250 2022-02-02T14:24:15.011 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:24:15.011 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:24:15.012 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:24:15.012 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:24:15.012 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:15.012 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:24:15.012 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:24:15.013 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:24:15.013 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:24:15.013 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:24:15.013 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:24:15.014 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:24:15.014 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:24:15.014 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:24:15.014 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:24:15.014 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:24:15.015 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:24:15.015 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:24:15.015 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:24:15.016 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:24:15.016 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:24:15.016 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:24:15.016 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:24:15.017 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:24:15.017 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:24:15.017 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:24:15.017 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:24:15.018 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:24:15.018 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:24:15.018 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:24:15.018 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:24:15.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:15.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:15.019 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:24:15.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:15.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:15.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:15.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:15.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 msgr2=0x7fd294067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 0x7fd294067290 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fd290009fd0 tx=0x7fd29000b040).stop 2022-02-02T14:24:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 msgr2=0x7fd2a4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd298009990 tx=0x7fd298009b30).stop 2022-02-02T14:24:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 shutdown_connections 2022-02-02T14:24:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd294064dd0 0x7fd294067290 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:15.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a4060250 0x7fd2a4106f80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:15.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 --2- 172.21.15.33:0/892239276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a40f9850 0x7fd2a4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:15.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 >> 172.21.15.33:0/892239276 conn(0x7fd2a40f0d40 msgr2=0x7fd2a40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:15.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.014+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 shutdown_connections 2022-02-02T14:24:15.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:15.015+0000 7fd2aaca2700 1 -- 172.21.15.33:0/892239276 wait complete. 2022-02-02T14:24:15.025 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:24:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:15 smithi033 ceph-mon[101165]: from='client.35478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/582650659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:24:15.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/892239276' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:24:15.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:15 smithi037 ceph-mon[69017]: from='client.35478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:15.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/582650659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:24:15.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/892239276' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:24:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:16 smithi037 ceph-mon[69017]: from='client.35482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:16 smithi037 ceph-mon[69017]: pgmap v1366: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:16 smithi033 ceph-mon[101165]: from='client.35482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:16 smithi033 ceph-mon[101165]: pgmap v1366: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:18 smithi037 ceph-mon[69017]: pgmap v1367: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:18 smithi033 ceph-mon[101165]: pgmap v1367: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:20.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:20 smithi037 ceph-mon[69017]: pgmap v1368: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:20.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:20 smithi033 ceph-mon[101165]: pgmap v1368: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:22 smithi037 ceph-mon[69017]: pgmap v1369: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:22.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:22 smithi033 ceph-mon[101165]: pgmap v1369: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:24 smithi037 ceph-mon[69017]: pgmap v1370: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:24 smithi033 ceph-mon[101165]: pgmap v1370: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:26 smithi037 ceph-mon[69017]: pgmap v1371: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:26 smithi033 ceph-mon[101165]: pgmap v1371: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:28 smithi037 ceph-mon[69017]: pgmap v1372: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:28 smithi033 ceph-mon[101165]: pgmap v1372: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:30 smithi037 ceph-mon[69017]: pgmap v1373: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:30 smithi033 ceph-mon[101165]: pgmap v1373: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:32 smithi037 ceph-mon[69017]: pgmap v1374: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:32 smithi033 ceph-mon[101165]: pgmap v1374: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:34 smithi037 ceph-mon[69017]: pgmap v1375: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:34 smithi033 ceph-mon[101165]: pgmap v1375: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:36 smithi037 ceph-mon[69017]: pgmap v1376: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:36 smithi033 ceph-mon[101165]: pgmap v1376: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:38 smithi033 ceph-mon[101165]: pgmap v1377: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:38 smithi037 ceph-mon[69017]: pgmap v1377: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:40 smithi033 ceph-mon[101165]: pgmap v1378: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:40 smithi037 ceph-mon[69017]: pgmap v1378: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:42 smithi033 ceph-mon[101165]: pgmap v1379: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:42.880 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:42 smithi037 ceph-mon[69017]: pgmap v1379: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:44 smithi033 ceph-mon[101165]: pgmap v1380: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:44 smithi037 ceph-mon[69017]: pgmap v1380: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:45.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 -- 172.21.15.33:0/3228447650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 msgr2=0x7fd3240f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 --2- 172.21.15.33:0/3228447650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3240f6b00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fd314004660 tx=0x7fd314009b30).stop 2022-02-02T14:24:45.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 -- 172.21.15.33:0/3228447650 shutdown_connections 2022-02-02T14:24:45.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 --2- 172.21.15.33:0/3228447650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 0x7fd3240f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 --2- 172.21.15.33:0/3228447650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3240f6b00 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 -- 172.21.15.33:0/3228447650 >> 172.21.15.33:0/3228447650 conn(0x7fd3240f1e40 msgr2=0x7fd3240f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:45.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 -- 172.21.15.33:0/3228447650 shutdown_connections 2022-02-02T14:24:45.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.128+0000 7fd32a771700 1 -- 172.21.15.33:0/3228447650 wait complete. 2022-02-02T14:24:45.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 Processor -- start 2022-02-02T14:24:45.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 -- start start 2022-02-02T14:24:45.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 0x7fd324109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324109c40 con 0x7fd3240f66e0 2022-02-02T14:24:45.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd32a771700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324109d80 con 0x7fd3240f7980 2022-02-02T14:24:45.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd323fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd323fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60984/0 (socket says 172.21.15.33:60984) 2022-02-02T14:24:45.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd323fff700 1 -- 172.21.15.33:0/455255033 learned_addr learned my addr 172.21.15.33:0/455255033 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:45.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd3237fe700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 0x7fd324109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd323fff700 1 -- 172.21.15.33:0/455255033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 msgr2=0x7fd324109690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.129+0000 7fd323fff700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 0x7fd324109690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd323fff700 1 -- 172.21.15.33:0/455255033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314005040 con 0x7fd3240f66e0 2022-02-02T14:24:45.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd323fff700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fd314004f60 tx=0x7fd314009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd314018070 con 0x7fd3240f66e0 2022-02-02T14:24:45.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd314007ba0 con 0x7fd3240f66e0 2022-02-02T14:24:45.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32410a6c0 con 0x7fd3240f66e0 2022-02-02T14:24:45.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd31401c620 con 0x7fd3240f66e0 2022-02-02T14:24:45.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.130+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32410ac20 con 0x7fd3240f66e0 2022-02-02T14:24:45.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.131+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd324045ad0 con 0x7fd3240f66e0 2022-02-02T14:24:45.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.132+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd31401c8e0 con 0x7fd3240f66e0 2022-02-02T14:24:45.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.132+0000 7fd320ff9700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 0x7fd310067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.132+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3140839b0 con 0x7fd3240f66e0 2022-02-02T14:24:45.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.132+0000 7fd3237fe700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 0x7fd310067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.133+0000 7fd3237fe700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 0x7fd310067290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd30c0041d0 tx=0x7fd30c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.137+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd314055490 con 0x7fd3240f66e0 2022-02-02T14:24:45.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.327+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd32410ae40 con 0x7fd310064dd0 2022-02-02T14:24:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.328+0000 7fd320ff9700 1 -- 172.21.15.33:0/455255033 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd32410ae40 con 0x7fd310064dd0 2022-02-02T14:24:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 msgr2=0x7fd310067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 0x7fd310067290 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fd30c0041d0 tx=0x7fd30c009040).stop 2022-02-02T14:24:45.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 msgr2=0x7fd3241091a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fd314004f60 tx=0x7fd314009b30).stop 2022-02-02T14:24:45.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 shutdown_connections 2022-02-02T14:24:45.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd310064dd0 0x7fd310067290 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3240f66e0 0x7fd3241091a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 --2- 172.21.15.33:0/455255033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3240f7980 0x7fd324109690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 >> 172.21.15.33:0/455255033 conn(0x7fd3240f1e40 msgr2=0x7fd32406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:45.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 shutdown_connections 2022-02-02T14:24:45.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.330+0000 7fd32a771700 1 -- 172.21.15.33:0/455255033 wait complete. 2022-02-02T14:24:45.340 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:24:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 -- 172.21.15.33:0/1176721646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 msgr2=0x7f88580f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 --2- 172.21.15.33:0/1176721646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f88580f6b30 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7f8848004660 tx=0x7f8848009b30).stop 2022-02-02T14:24:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 -- 172.21.15.33:0/1176721646 shutdown_connections 2022-02-02T14:24:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 --2- 172.21.15.33:0/1176721646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f88580f6b30 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 --2- 172.21.15.33:0/1176721646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 0x7f88580f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 -- 172.21.15.33:0/1176721646 >> 172.21.15.33:0/1176721646 conn(0x7f88580f0b90 msgr2=0x7f88580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:45.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 -- 172.21.15.33:0/1176721646 shutdown_connections 2022-02-02T14:24:45.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.431+0000 7f885ed48700 1 -- 172.21.15.33:0/1176721646 wait complete. 2022-02-02T14:24:45.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 Processor -- start 2022-02-02T14:24:45.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 -- start start 2022-02-02T14:24:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 0x7f8858108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88581099e0 con 0x7f88580f66d0 2022-02-02T14:24:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885ed48700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858109b20 con 0x7f88580f5430 2022-02-02T14:24:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885d545700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.432+0000 7f885d545700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60996/0 (socket says 172.21.15.33:60996) 2022-02-02T14:24:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885d545700 1 -- 172.21.15.33:0/1464757659 learned_addr learned my addr 172.21.15.33:0/1464757659 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885dd46700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 0x7f8858108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885d545700 1 -- 172.21.15.33:0/1464757659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 msgr2=0x7f8858108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885d545700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 0x7f8858108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885d545700 1 -- 172.21.15.33:0/1464757659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848005040 con 0x7f88580f66d0 2022-02-02T14:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885d545700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f8848009990 tx=0x7f8848009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8848018070 con 0x7f88580f66d0 2022-02-02T14:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885810a460 con 0x7f88580f66d0 2022-02-02T14:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8848007ba0 con 0x7f88580f66d0 2022-02-02T14:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f884801c3c0 con 0x7f88580f66d0 2022-02-02T14:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.433+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885810a9c0 con 0x7f88580f66d0 2022-02-02T14:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.434+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8858045ad0 con 0x7f88580f66d0 2022-02-02T14:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.435+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f884801d420 con 0x7f88580f66d0 2022-02-02T14:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.436+0000 7f884e7fc700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 0x7f88440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.436+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8848083700 con 0x7f88580f66d0 2022-02-02T14:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.436+0000 7f885dd46700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 0x7f88440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.436+0000 7f885dd46700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 0x7f88440672e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f88580f6530 tx=0x7f885400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.440+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8848055240 con 0x7f88580f66d0 2022-02-02T14:24:45.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.624+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f88580fa910 con 0x7f8844064e20 2022-02-02T14:24:45.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.639+0000 7f884e7fc700 1 -- 172.21.15.33:0/1464757659 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f88580fa910 con 0x7f8844064e20 2022-02-02T14:24:45.640 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:24:45.640 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (50m) 12m ago 51m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:24:45.640 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (43m) 12m ago 51m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:24:45.641 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (43m) 12m ago 50m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:24:45.642 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (49m) 12m ago 50m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:24:45.642 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (43m) 12m ago 47m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:24:45.642 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (44m) 12m ago 47m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:24:45.642 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (44m) 12m ago 47m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:24:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (47m) 12m ago 47m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:24:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (44m) 12m ago 52m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:24:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (44m) 12m ago 50m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:24:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (44m) 12m ago 52m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:24:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (43m) 12m ago 50m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:24:45.644 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (50m) 12m ago 50m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:24:45.644 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (50m) 12m ago 50m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:24:45.644 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 12m ago 49m - 4096M 2022-02-02T14:24:45.644 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (49m) 12m ago 49m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:24:45.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (49m) 12m ago 49m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:24:45.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (48m) 12m ago 48m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:24:45.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (48m) 12m ago 48m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:24:45.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (48m) 12m ago 48m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:24:45.646 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (49m) 12m ago 50m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:24:45.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 msgr2=0x7f88440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 0x7f88440672e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f88580f6530 tx=0x7f885400b040).stop 2022-02-02T14:24:45.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 msgr2=0x7f8858109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f8848009990 tx=0x7f8848009b30).stop 2022-02-02T14:24:45.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 shutdown_connections 2022-02-02T14:24:45.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8844064e20 0x7f88440672e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88580f5430 0x7f8858108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 --2- 172.21.15.33:0/1464757659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88580f66d0 0x7f8858109430 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 >> 172.21.15.33:0/1464757659 conn(0x7f88580f0b90 msgr2=0x7f885805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 shutdown_connections 2022-02-02T14:24:45.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.641+0000 7f885ed48700 1 -- 172.21.15.33:0/1464757659 wait complete. 2022-02-02T14:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.741+0000 7f34f5a23700 1 -- 172.21.15.33:0/1861267732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f6860 msgr2=0x7f34f00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.741+0000 7f34f5a23700 1 --2- 172.21.15.33:0/1861267732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f6860 0x7f34f00f6cc0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f34e4004660 tx=0x7f34e4009b30).stop 2022-02-02T14:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- 172.21.15.33:0/1861267732 shutdown_connections 2022-02-02T14:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 --2- 172.21.15.33:0/1861267732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f6860 0x7f34f00f6cc0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 --2- 172.21.15.33:0/1861267732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f55c0 0x7f34f00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- 172.21.15.33:0/1861267732 >> 172.21.15.33:0/1861267732 conn(0x7f34f00f0d40 msgr2=0x7f34f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- 172.21.15.33:0/1861267732 shutdown_connections 2022-02-02T14:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- 172.21.15.33:0/1861267732 wait complete. 2022-02-02T14:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 Processor -- start 2022-02-02T14:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- start start 2022-02-02T14:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 0x7f34f0109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0109c20 con 0x7f34f00f55c0 2022-02-02T14:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.742+0000 7f34f5a23700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f0109d60 con 0x7f34f00f6860 2022-02-02T14:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32772/0 (socket says 172.21.15.33:32772) 2022-02-02T14:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 -- 172.21.15.33:0/3855692704 learned_addr learned my addr 172.21.15.33:0/3855692704 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34ee7fc700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 0x7f34f0109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 -- 172.21.15.33:0/3855692704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 msgr2=0x7f34f0109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 0x7f34f0109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:45.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 -- 172.21.15.33:0/3855692704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4005040 con 0x7f34f00f55c0 2022-02-02T14:24:45.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34ee7fc700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 0x7f34f0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:24:45.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34eeffd700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f34e0002700 tx=0x7f34e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0009320 con 0x7f34f00f55c0 2022-02-02T14:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f34e000f040 con 0x7f34f00f55c0 2022-02-02T14:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f010a700 con 0x7f34f00f55c0 2022-02-02T14:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.743+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0014900 con 0x7f34f00f55c0 2022-02-02T14:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.744+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f010acc0 con 0x7f34f00f55c0 2022-02-02T14:24:45.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.745+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f0045ad0 con 0x7f34f00f55c0 2022-02-02T14:24:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.745+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f34e0009480 con 0x7f34f00f55c0 2022-02-02T14:24:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.746+0000 7f34d77fe700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 0x7f34d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.746+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f34e0081c30 con 0x7f34f00f55c0 2022-02-02T14:24:45.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.746+0000 7f34ee7fc700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 0x7f34d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:45.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.746+0000 7f34ee7fc700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 0x7f34d8067290 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f34e4009da0 tx=0x7f34e4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:45.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.750+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f34e0053710 con 0x7f34f00f55c0 2022-02-02T14:24:45.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.996+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34f010f8d0 con 0x7f34f00f55c0 2022-02-02T14:24:45.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.996+0000 7f34d77fe700 1 -- 172.21.15.33:0/3855692704 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f34e0053300 con 0x7f34f00f55c0 2022-02-02T14:24:45.997 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:24:45.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:24:45.998 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:24:45.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:45.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:24:45.999 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:24:45.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:45.999 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:24:46.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:24:46.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:46.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:24:46.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:24:46.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:24:46.001 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:24:46.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:24:46.001 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:24:46.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:24:46.002 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:24:46.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 msgr2=0x7f34d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 0x7f34d8067290 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f34e4009da0 tx=0x7f34e4009b30).stop 2022-02-02T14:24:46.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 msgr2=0x7f34f0109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f34e0002700 tx=0x7f34e0009d80).stop 2022-02-02T14:24:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 shutdown_connections 2022-02-02T14:24:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f34d8064dd0 0x7f34d8067290 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34f00f55c0 0x7f34f0109180 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 --2- 172.21.15.33:0/3855692704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34f00f6860 0x7f34f0109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 >> 172.21.15.33:0/3855692704 conn(0x7f34f00f0d40 msgr2=0x7f34f005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 shutdown_connections 2022-02-02T14:24:46.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:45.998+0000 7f34f5a23700 1 -- 172.21.15.33:0/3855692704 wait complete. 2022-02-02T14:24:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 -- 172.21.15.33:0/1251121925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 msgr2=0x7f76a40f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 --2- 172.21.15.33:0/1251121925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a40f7d20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7694004660 tx=0x7f7694009b30).stop 2022-02-02T14:24:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 -- 172.21.15.33:0/1251121925 shutdown_connections 2022-02-02T14:24:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 --2- 172.21.15.33:0/1251121925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a40f7d20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 --2- 172.21.15.33:0/1251121925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 0x7f76a40f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 -- 172.21.15.33:0/1251121925 >> 172.21.15.33:0/1251121925 conn(0x7f76a40f04c0 msgr2=0x7f76a40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 -- 172.21.15.33:0/1251121925 shutdown_connections 2022-02-02T14:24:46.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.099+0000 7f76a9a38700 1 -- 172.21.15.33:0/1251121925 wait complete. 2022-02-02T14:24:46.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 Processor -- start 2022-02-02T14:24:46.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 -- start start 2022-02-02T14:24:46.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 0x7f76a41093a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4109e40 con 0x7f76a40f53e0 2022-02-02T14:24:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a9a38700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a4109f80 con 0x7f76a40f4a40 2022-02-02T14:24:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:46.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32784/0 (socket says 172.21.15.33:32784) 2022-02-02T14:24:46.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.100+0000 7f76a27fc700 1 -- 172.21.15.33:0/2004110460 learned_addr learned my addr 172.21.15.33:0/2004110460 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:24:46.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a2ffd700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 0x7f76a41093a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:46.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a27fc700 1 -- 172.21.15.33:0/2004110460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 msgr2=0x7f76a41093a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a27fc700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 0x7f76a41093a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a27fc700 1 -- 172.21.15.33:0/2004110460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694005040 con 0x7f76a40f53e0 2022-02-02T14:24:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a27fc700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f7694009830 tx=0x7f7694009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:46.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7694018070 con 0x7f76a40f53e0 2022-02-02T14:24:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7694007ba0 con 0x7f76a40f53e0 2022-02-02T14:24:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a410a8c0 con 0x7f76a40f53e0 2022-02-02T14:24:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f769401de60 con 0x7f76a40f53e0 2022-02-02T14:24:46.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.101+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a410ae20 con 0x7f76a40f53e0 2022-02-02T14:24:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.102+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a4045ad0 con 0x7f76a40f53e0 2022-02-02T14:24:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.103+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7694007d10 con 0x7f76a40f53e0 2022-02-02T14:24:46.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.103+0000 7f769b7fe700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 0x7f7690067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:24:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.103+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7694083590 con 0x7f76a40f53e0 2022-02-02T14:24:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.103+0000 7f76a2ffd700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 0x7f7690067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:24:46.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.103+0000 7f76a2ffd700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 0x7f7690067270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f768c004c40 tx=0x7f768c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:24:46.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.107+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76940550d0 con 0x7f76a40f53e0 2022-02-02T14:24:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.321+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f76a40ff0f0 con 0x7f76a40f53e0 2022-02-02T14:24:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.322+0000 7f769b7fe700 1 -- 172.21.15.33:0/2004110460 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7694054cc0 con 0x7f76a40f53e0 2022-02-02T14:24:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:24:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:24:46.323 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:24:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:24:46.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:46.324 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:24:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:24:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:24:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:24:46.325 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:24:46.326 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:24:46.326 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:24:46.326 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:24:46.326 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:24:46.327 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:24:46.327 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:24:46.327 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:24:46.327 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:24:46.327 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:24:46.328 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:24:46.328 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:24:46.328 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:24:46.328 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:24:46.328 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:24:46.329 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:24:46.329 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:24:46.329 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:24:46.329 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:24:46.330 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:24:46.330 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:24:46.330 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:24:46.331 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:46.331 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:46.331 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:24:46.331 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:24:46.331 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:46.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:46.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:46.332 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:24:46.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 msgr2=0x7f7690067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 0x7f7690067270 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f768c004c40 tx=0x7f768c00b040).stop 2022-02-02T14:24:46.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 msgr2=0x7f76a4109890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:24:46.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f7694009830 tx=0x7f7694009b30).stop 2022-02-02T14:24:46.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 shutdown_connections 2022-02-02T14:24:46.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7690064db0 0x7f7690067270 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76a40f4a40 0x7f76a41093a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 --2- 172.21.15.33:0/2004110460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76a40f53e0 0x7f76a4109890 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:24:46.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 >> 172.21.15.33:0/2004110460 conn(0x7f76a40f04c0 msgr2=0x7f76a40f9760 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:24:46.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 shutdown_connections 2022-02-02T14:24:46.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:24:46.324+0000 7f76a9a38700 1 -- 172.21.15.33:0/2004110460 wait complete. 2022-02-02T14:24:46.336 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:24:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:46 smithi033 ceph-mon[101165]: pgmap v1381: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3855692704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:24:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:46 smithi037 ceph-mon[69017]: pgmap v1381: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3855692704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:24:47.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:47 smithi033 ceph-mon[101165]: from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:47.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:47 smithi033 ceph-mon[101165]: from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:47.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:47 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2004110460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:24:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:47 smithi037 ceph-mon[69017]: from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:47 smithi037 ceph-mon[69017]: from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:24:47.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:47 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2004110460' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:24:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:48 smithi033 ceph-mon[101165]: pgmap v1382: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:48 smithi037 ceph-mon[69017]: pgmap v1382: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:50 smithi033 ceph-mon[101165]: pgmap v1383: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:50 smithi037 ceph-mon[69017]: pgmap v1383: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:52 smithi033 ceph-mon[101165]: pgmap v1384: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:52 smithi037 ceph-mon[69017]: pgmap v1384: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:54 smithi033 ceph-mon[101165]: pgmap v1385: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:54 smithi037 ceph-mon[69017]: pgmap v1385: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:55.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:24:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:24:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:24:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:24:56.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:56 smithi033 ceph-mon[101165]: pgmap v1386: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:56 smithi037 ceph-mon[69017]: pgmap v1386: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:24:58 smithi033 ceph-mon[101165]: pgmap v1387: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:24:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:24:58 smithi037 ceph-mon[69017]: pgmap v1387: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:00 smithi033 ceph-mon[101165]: pgmap v1388: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:00 smithi037 ceph-mon[69017]: pgmap v1388: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:02 smithi033 ceph-mon[101165]: pgmap v1389: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:02 smithi037 ceph-mon[69017]: pgmap v1389: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:04.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:04 smithi033 ceph-mon[101165]: pgmap v1390: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:04 smithi037 ceph-mon[69017]: pgmap v1390: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:06 smithi033 ceph-mon[101165]: pgmap v1391: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:06 smithi037 ceph-mon[69017]: pgmap v1391: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:08.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:08 smithi033 ceph-mon[101165]: pgmap v1392: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:08 smithi037 ceph-mon[69017]: pgmap v1392: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:10 smithi033 ceph-mon[101165]: pgmap v1393: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:10 smithi037 ceph-mon[69017]: pgmap v1393: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:12.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:12 smithi033 ceph-mon[101165]: pgmap v1394: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:12 smithi037 ceph-mon[69017]: pgmap v1394: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:14.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:14 smithi033 ceph-mon[101165]: pgmap v1395: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:14 smithi037 ceph-mon[69017]: pgmap v1395: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:16.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 -- 172.21.15.33:0/1855678556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 msgr2=0x7f25600f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 --2- 172.21.15.33:0/1855678556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f25600f6b00 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f2554004660 tx=0x7f2554009b30).stop 2022-02-02T14:25:16.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 -- 172.21.15.33:0/1855678556 shutdown_connections 2022-02-02T14:25:16.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 --2- 172.21.15.33:0/1855678556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25600f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 --2- 172.21.15.33:0/1855678556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f25600f6b00 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 -- 172.21.15.33:0/1855678556 >> 172.21.15.33:0/1855678556 conn(0x7f25600f1e40 msgr2=0x7f25600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:16.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 -- 172.21.15.33:0/1855678556 shutdown_connections 2022-02-02T14:25:16.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.440+0000 7f256720a700 1 -- 172.21.15.33:0/1855678556 wait complete. 2022-02-02T14:25:16.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.441+0000 7f256720a700 1 Processor -- start 2022-02-02T14:25:16.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.441+0000 7f256720a700 1 -- start start 2022-02-02T14:25:16.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f256720a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f256720a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25601074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f256720a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560107a50 con 0x7f25600f66e0 2022-02-02T14:25:16.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f256720a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560107b90 con 0x7f25600f7980 2022-02-02T14:25:16.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32796/0 (socket says 172.21.15.33:32796) 2022-02-02T14:25:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 -- 172.21.15.33:0/1472279076 learned_addr learned my addr 172.21.15.33:0/1472279076 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f255ffff700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25601074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 -- 172.21.15.33:0/1472279076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 msgr2=0x7f25601074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25601074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 -- 172.21.15.33:0/1472279076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005040 con 0x7f25600f66e0 2022-02-02T14:25:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f255ffff700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25601074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:25:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.442+0000 7f2564fa6700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f2554013a70 tx=0x7f2554009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.443+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554018070 con 0x7f25600f66e0 2022-02-02T14:25:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.443+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f25540097d0 con 0x7f25600f66e0 2022-02-02T14:25:16.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.443+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f255401c3c0 con 0x7f25600f66e0 2022-02-02T14:25:16.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.443+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25601084d0 con 0x7f25600f66e0 2022-02-02T14:25:16.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.443+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2560108a30 con 0x7f25600f66e0 2022-02-02T14:25:16.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.444+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2560045ad0 con 0x7f25600f66e0 2022-02-02T14:25:16.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.444+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2554007ba0 con 0x7f25600f66e0 2022-02-02T14:25:16.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.445+0000 7f255d7fa700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 0x7f2550067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.445+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2554083750 con 0x7f25600f66e0 2022-02-02T14:25:16.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.445+0000 7f255ffff700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 0x7f2550067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.445+0000 7f255ffff700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 0x7f2550067290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f254c009fd0 tx=0x7f254c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:16.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.449+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2554055230 con 0x7f25600f66e0 2022-02-02T14:25:16.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:16 smithi033 ceph-mon[101165]: pgmap v1396: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:16 smithi037 ceph-mon[69017]: pgmap v1396: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:16.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.642+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f25600fefe0 con 0x7f2550064dd0 2022-02-02T14:25:16.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.643+0000 7f255d7fa700 1 -- 172.21.15.33:0/1472279076 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f25600fefe0 con 0x7f2550064dd0 2022-02-02T14:25:16.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 msgr2=0x7f2550067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 0x7f2550067290 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f254c009fd0 tx=0x7f254c00b040).stop 2022-02-02T14:25:16.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 msgr2=0x7f2560106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f2554013a70 tx=0x7f2554009b30).stop 2022-02-02T14:25:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 shutdown_connections 2022-02-02T14:25:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2550064dd0 0x7f2550067290 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25600f66e0 0x7f2560106fb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 --2- 172.21.15.33:0/1472279076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600f7980 0x7f25601074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 >> 172.21.15.33:0/1472279076 conn(0x7f25600f1e40 msgr2=0x7f25600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:16.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 shutdown_connections 2022-02-02T14:25:16.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.645+0000 7f256720a700 1 -- 172.21.15.33:0/1472279076 wait complete. 2022-02-02T14:25:16.654 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:25:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 -- 172.21.15.33:0/2791084739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f77d0 msgr2=0x7f86940f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 --2- 172.21.15.33:0/2791084739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f77d0 0x7f86940f7c30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f8684004660 tx=0x7f8684009b30).stop 2022-02-02T14:25:16.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 -- 172.21.15.33:0/2791084739 shutdown_connections 2022-02-02T14:25:16.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 --2- 172.21.15.33:0/2791084739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f77d0 0x7f86940f7c30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 --2- 172.21.15.33:0/2791084739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f6530 0x7f86940f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.746+0000 7f869a303700 1 -- 172.21.15.33:0/2791084739 >> 172.21.15.33:0/2791084739 conn(0x7f86940f1c90 msgr2=0x7f86940f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 -- 172.21.15.33:0/2791084739 shutdown_connections 2022-02-02T14:25:16.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 -- 172.21.15.33:0/2791084739 wait complete. 2022-02-02T14:25:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 Processor -- start 2022-02-02T14:25:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 -- start start 2022-02-02T14:25:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f77d0 0x7f8694107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8694107880 con 0x7f86940f6530 2022-02-02T14:25:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f869a303700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8694108090 con 0x7f86940f77d0 2022-02-02T14:25:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f8699301700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f8699301700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32806/0 (socket says 172.21.15.33:32806) 2022-02-02T14:25:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.747+0000 7f8699301700 1 -- 172.21.15.33:0/1693906775 learned_addr learned my addr 172.21.15.33:0/1693906775 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8698b00700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f77d0 0x7f8694107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8699301700 1 -- 172.21.15.33:0/1693906775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f77d0 msgr2=0x7f8694107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8699301700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f77d0 0x7f8694107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8699301700 1 -- 172.21.15.33:0/1693906775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8684005040 con 0x7f86940f6530 2022-02-02T14:25:16.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8699301700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f8690002700 tx=0x7f8690009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:16.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86900079c0 con 0x7f86940f6530 2022-02-02T14:25:16.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f869000f040 con 0x7f86940f6530 2022-02-02T14:25:16.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8694108310 con 0x7f86940f6530 2022-02-02T14:25:16.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8690014860 con 0x7f86940f6530 2022-02-02T14:25:16.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.748+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86941088d0 con 0x7f86940f6530 2022-02-02T14:25:16.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.749+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8694059100 con 0x7f86940f6530 2022-02-02T14:25:16.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.750+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f869001b060 con 0x7f86940f6530 2022-02-02T14:25:16.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.750+0000 7f8689ffb700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 0x7f86800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:16.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.750+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8690081950 con 0x7f86940f6530 2022-02-02T14:25:16.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.750+0000 7f8698b00700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 0x7f86800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:16.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.751+0000 7f8698b00700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 0x7f86800672e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f8684004630 tx=0x7f8684009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:16.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.754+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f869004fa00 con 0x7f86940f6530 2022-02-02T14:25:16.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.935+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86940008d0 con 0x7f8680064e20 2022-02-02T14:25:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.951+0000 7f8689ffb700 1 -- 172.21.15.33:0/1693906775 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f86940008d0 con 0x7f8680064e20 2022-02-02T14:25:16.951 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:25:16.951 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (50m) 12m ago 51m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:25:16.951 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (43m) 12m ago 51m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:25:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (43m) 12m ago 51m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:25:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (50m) 12m ago 51m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:25:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (44m) 12m ago 47m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:25:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (44m) 12m ago 47m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:25:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (45m) 12m ago 47m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:25:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (47m) 12m ago 47m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:25:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (45m) 12m ago 52m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:25:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (44m) 12m ago 51m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:25:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (44m) 12m ago 52m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:25:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (44m) 12m ago 50m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:25:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (51m) 12m ago 51m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:25:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (50m) 12m ago 50m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:25:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 12m ago 50m - 4096M 2022-02-02T14:25:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (49m) 12m ago 49m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:25:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (49m) 12m ago 49m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:25:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (49m) 12m ago 49m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:25:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (49m) 12m ago 49m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:25:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (48m) 12m ago 48m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:25:16.956 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (50m) 12m ago 51m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:25:16.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 msgr2=0x7f86800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 0x7f86800672e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f8684004630 tx=0x7f8684009b30).stop 2022-02-02T14:25:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 msgr2=0x7f8694106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f8690002700 tx=0x7f8690009d80).stop 2022-02-02T14:25:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 shutdown_connections 2022-02-02T14:25:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8680064e20 0x7f86800672e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86940f6530 0x7f8694106d90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 --2- 172.21.15.33:0/1693906775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86940f77d0 0x7f8694107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 >> 172.21.15.33:0/1693906775 conn(0x7f86940f1c90 msgr2=0x7f86940fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 shutdown_connections 2022-02-02T14:25:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:16.954+0000 7f869a303700 1 -- 172.21.15.33:0/1693906775 wait complete. 2022-02-02T14:25:17.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 -- 172.21.15.33:0/1268242032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f6860 msgr2=0x7f0be80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 --2- 172.21.15.33:0/1268242032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f6860 0x7f0be80f6cc0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7f0bd8004660 tx=0x7f0bd8009b30).stop 2022-02-02T14:25:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 -- 172.21.15.33:0/1268242032 shutdown_connections 2022-02-02T14:25:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 --2- 172.21.15.33:0/1268242032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f6860 0x7f0be80f6cc0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 --2- 172.21.15.33:0/1268242032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f55c0 0x7f0be80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 -- 172.21.15.33:0/1268242032 >> 172.21.15.33:0/1268242032 conn(0x7f0be80f0d40 msgr2=0x7f0be80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 -- 172.21.15.33:0/1268242032 shutdown_connections 2022-02-02T14:25:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.053+0000 7f0bef693700 1 -- 172.21.15.33:0/1268242032 wait complete. 2022-02-02T14:25:17.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 Processor -- start 2022-02-02T14:25:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 -- start start 2022-02-02T14:25:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f6860 0x7f0be80f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80f8100 con 0x7f0be80f55c0 2022-02-02T14:25:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bef693700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80f8240 con 0x7f0be80f6860 2022-02-02T14:25:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bed42f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bed42f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32816/0 (socket says 172.21.15.33:32816) 2022-02-02T14:25:17.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0bed42f700 1 -- 172.21.15.33:0/1978705146 learned_addr learned my addr 172.21.15.33:0/1978705146 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:17.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.054+0000 7f0becc2e700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f6860 0x7f0be80f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bed42f700 1 -- 172.21.15.33:0/1978705146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f6860 msgr2=0x7f0be80f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bed42f700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f6860 0x7f0be80f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bed42f700 1 -- 172.21.15.33:0/1978705146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd8005040 con 0x7f0be80f55c0 2022-02-02T14:25:17.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bed42f700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0be400c530 tx=0x7f0be4007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:17.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be400f650 con 0x7f0be80f55c0 2022-02-02T14:25:17.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0be400fc60 con 0x7f0be80f55c0 2022-02-02T14:25:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be80f8520 con 0x7f0be80f55c0 2022-02-02T14:25:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0be4012d20 con 0x7f0be80f55c0 2022-02-02T14:25:17.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.055+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be810efa0 con 0x7f0be80f55c0 2022-02-02T14:25:17.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.056+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8045ad0 con 0x7f0be80f55c0 2022-02-02T14:25:17.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.057+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0be4019030 con 0x7f0be80f55c0 2022-02-02T14:25:17.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.057+0000 7f0bddffb700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 0x7f0bd4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.057+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0be4081700 con 0x7f0be80f55c0 2022-02-02T14:25:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.057+0000 7f0becc2e700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 0x7f0bd4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.057+0000 7f0becc2e700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 0x7f0bd4067290 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0bd8004e30 tx=0x7f0bd8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.061+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0be404f800 con 0x7f0be80f55c0 2022-02-02T14:25:17.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.307+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0be810f790 con 0x7f0be80f55c0 2022-02-02T14:25:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.307+0000 7f0bddffb700 1 -- 172.21.15.33:0/1978705146 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0be4052e20 con 0x7f0be80f55c0 2022-02-02T14:25:17.308 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:25:17.308 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:25:17.308 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:25:17.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:17.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:25:17.309 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:25:17.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:17.309 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:25:17.310 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:25:17.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:17.310 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:25:17.310 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:25:17.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:17.311 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:25:17.311 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:25:17.311 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:25:17.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:25:17.312 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:25:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 msgr2=0x7f0bd4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 0x7f0bd4067290 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f0bd8004e30 tx=0x7f0bd8009b30).stop 2022-02-02T14:25:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 msgr2=0x7f0be80f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7f0be400c530 tx=0x7f0be4007e10).stop 2022-02-02T14:25:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 shutdown_connections 2022-02-02T14:25:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0bd4064dd0 0x7f0bd4067290 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0be80f55c0 0x7f0be80f9720 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 --2- 172.21.15.33:0/1978705146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80f6860 0x7f0be80f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 >> 172.21.15.33:0/1978705146 conn(0x7f0be80f0d40 msgr2=0x7f0be805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 shutdown_connections 2022-02-02T14:25:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.310+0000 7f0bef693700 1 -- 172.21.15.33:0/1978705146 wait complete. 2022-02-02T14:25:17.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 -- 172.21.15.33:0/2292698891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 msgr2=0x7fcae40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 --2- 172.21.15.33:0/2292698891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae40f7de0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fcad0004660 tx=0x7fcad0009b30).stop 2022-02-02T14:25:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 -- 172.21.15.33:0/2292698891 shutdown_connections 2022-02-02T14:25:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 --2- 172.21.15.33:0/2292698891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae40f7de0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 --2- 172.21.15.33:0/2292698891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 -- 172.21.15.33:0/2292698891 >> 172.21.15.33:0/2292698891 conn(0x7fcae40f1e40 msgr2=0x7fcae40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:17.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 -- 172.21.15.33:0/2292698891 shutdown_connections 2022-02-02T14:25:17.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.411+0000 7fcaeac41700 1 -- 172.21.15.33:0/2292698891 wait complete. 2022-02-02T14:25:17.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 Processor -- start 2022-02-02T14:25:17.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 -- start start 2022-02-02T14:25:17.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae406a380 con 0x7fcae40f7980 2022-02-02T14:25:17.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcaeac41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae406a4c0 con 0x7fcae40f66e0 2022-02-02T14:25:17.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.412+0000 7fcae3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32828/0 (socket says 172.21.15.33:32828) 2022-02-02T14:25:17.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 -- 172.21.15.33:0/1107187750 learned_addr learned my addr 172.21.15.33:0/1107187750 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:17.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae89dd700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 -- 172.21.15.33:0/1107187750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 msgr2=0x7fcae406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 -- 172.21.15.33:0/1107187750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad0005040 con 0x7fcae40f7980 2022-02-02T14:25:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae89dd700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:25:17.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae3fff700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcad0009990 tx=0x7fcad0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:17.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad0018070 con 0x7fcae40f7980 2022-02-02T14:25:17.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae406a740 con 0x7fcae40f7980 2022-02-02T14:25:17.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcad0007ba0 con 0x7fcae40f7980 2022-02-02T14:25:17.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad001c3c0 con 0x7fcae40f7980 2022-02-02T14:25:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.413+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae406aca0 con 0x7fcae40f7980 2022-02-02T14:25:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.414+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae4045ad0 con 0x7fcae40f7980 2022-02-02T14:25:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.415+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcad001d420 con 0x7fcae40f7980 2022-02-02T14:25:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.415+0000 7fcae17fa700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 0x7fcad4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.415+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcad00837b0 con 0x7fcae40f7980 2022-02-02T14:25:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.415+0000 7fcae89dd700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 0x7fcad4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.416+0000 7fcae89dd700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 0x7fcad4067290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fcad8009fd0 tx=0x7fcad800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.419+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcad0051800 con 0x7fcae40f7980 2022-02-02T14:25:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.634+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcae4027a00 con 0x7fcae40f7980 2022-02-02T14:25:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.635+0000 7fcae17fa700 1 -- 172.21.15.33:0/1107187750 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcad0054e20 con 0x7fcae40f7980 2022-02-02T14:25:17.635 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:25:17.635 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:25:17.635 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:25:17.636 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:25:17.636 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:17.636 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:25:17.636 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:25:17.636 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:25:17.637 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:25:17.637 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:25:17.637 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:25:17.637 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:25:17.638 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:25:17.638 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:25:17.638 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:25:17.638 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:25:17.638 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:25:17.639 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:25:17.639 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:25:17.639 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:25:17.639 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:25:17.640 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:25:17.640 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:25:17.640 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:25:17.640 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:25:17.641 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:25:17.641 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:25:17.641 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:25:17.641 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:25:17.641 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:25:17.642 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:25:17.642 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:17.642 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:17.642 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:25:17.643 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:17.643 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:17.643 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:17.643 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:17.643 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:17.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 msgr2=0x7fcad4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 0x7fcad4067290 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fcad8009fd0 tx=0x7fcad800b040).stop 2022-02-02T14:25:17.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 msgr2=0x7fcae4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:17.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fcad0009990 tx=0x7fcad0009b30).stop 2022-02-02T14:25:17.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 shutdown_connections 2022-02-02T14:25:17.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcad4064dd0 0x7fcad4067290 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae40f66e0 0x7fcae406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 --2- 172.21.15.33:0/1107187750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcae40f7980 0x7fcae4069e20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:17.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 >> 172.21.15.33:0/1107187750 conn(0x7fcae40f1e40 msgr2=0x7fcae40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:17.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 shutdown_connections 2022-02-02T14:25:17.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:17.637+0000 7fcaeac41700 1 -- 172.21.15.33:0/1107187750 wait complete. 2022-02-02T14:25:17.647 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:25:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:18 smithi033 ceph-mon[101165]: from='client.35510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:18.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:18 smithi033 ceph-mon[101165]: pgmap v1397: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:18.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:18 smithi033 ceph-mon[101165]: from='client.35514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:18.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1978705146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:25:18.492 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1107187750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:25:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:18 smithi037 ceph-mon[69017]: from='client.35510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:18.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:18 smithi037 ceph-mon[69017]: pgmap v1397: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:18.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:18 smithi037 ceph-mon[69017]: from='client.35514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:18.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1978705146' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:25:18.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1107187750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:25:20.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:20 smithi033 ceph-mon[101165]: pgmap v1398: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:20 smithi037 ceph-mon[69017]: pgmap v1398: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:22.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:22 smithi033 ceph-mon[101165]: pgmap v1399: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:22 smithi037 ceph-mon[69017]: pgmap v1399: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:24.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:24 smithi033 ceph-mon[101165]: pgmap v1400: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:24 smithi037 ceph-mon[69017]: pgmap v1400: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:26.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:26 smithi033 ceph-mon[101165]: pgmap v1401: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:26 smithi037 ceph-mon[69017]: pgmap v1401: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:28 smithi037 ceph-mon[69017]: pgmap v1402: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:28 smithi033 ceph-mon[101165]: pgmap v1402: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:30 smithi037 ceph-mon[69017]: pgmap v1403: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:30 smithi033 ceph-mon[101165]: pgmap v1403: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:32 smithi037 ceph-mon[69017]: pgmap v1404: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:32 smithi033 ceph-mon[101165]: pgmap v1404: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:34 smithi037 ceph-mon[69017]: pgmap v1405: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:34 smithi033 ceph-mon[101165]: pgmap v1405: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:36 smithi037 ceph-mon[69017]: pgmap v1406: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:36 smithi033 ceph-mon[101165]: pgmap v1406: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:38 smithi037 ceph-mon[69017]: pgmap v1407: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:38 smithi033 ceph-mon[101165]: pgmap v1407: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:40 smithi037 ceph-mon[69017]: pgmap v1408: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:40 smithi033 ceph-mon[101165]: pgmap v1408: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:42 smithi037 ceph-mon[69017]: pgmap v1409: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:42 smithi033 ceph-mon[101165]: pgmap v1409: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:44 smithi037 ceph-mon[69017]: pgmap v1410: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:44 smithi033 ceph-mon[101165]: pgmap v1410: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:46 smithi037 ceph-mon[69017]: pgmap v1411: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:46 smithi033 ceph-mon[101165]: pgmap v1411: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:47.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 -- 172.21.15.33:0/1744673669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f6ac0 msgr2=0x7f07240f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 --2- 172.21.15.33:0/1744673669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f6ac0 0x7f07240f6ee0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f0714004660 tx=0x7f0714009b30).stop 2022-02-02T14:25:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 -- 172.21.15.33:0/1744673669 shutdown_connections 2022-02-02T14:25:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 --2- 172.21.15.33:0/1744673669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f57d0 0x7f07240f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 --2- 172.21.15.33:0/1744673669 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f6ac0 0x7f07240f6ee0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 -- 172.21.15.33:0/1744673669 >> 172.21.15.33:0/1744673669 conn(0x7f07240f0320 msgr2=0x7f07240f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:47.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 -- 172.21.15.33:0/1744673669 shutdown_connections 2022-02-02T14:25:47.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.751+0000 7f0723fff700 1 -- 172.21.15.33:0/1744673669 wait complete. 2022-02-02T14:25:47.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 Processor -- start 2022-02-02T14:25:47.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 -- start start 2022-02-02T14:25:47.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:47.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f6ac0 0x7f072410bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:47.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240f5460 con 0x7f07240f57d0 2022-02-02T14:25:47.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0723fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240f55a0 con 0x7f07240f6ac0 2022-02-02T14:25:47.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:47.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32836/0 (socket says 172.21.15.33:32836) 2022-02-02T14:25:47.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 -- 172.21.15.33:0/2601593220 learned_addr learned my addr 172.21.15.33:0/2601593220 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:47.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 -- 172.21.15.33:0/2601593220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f6ac0 msgr2=0x7f072410bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:47.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f07227fc700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f6ac0 0x7f072410bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:47.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f6ac0 0x7f072410bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 -- 172.21.15.33:0/2601593220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714005040 con 0x7f07240f57d0 2022-02-02T14:25:47.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.752+0000 7f0722ffd700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f0714009990 tx=0x7f0714009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:47.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.753+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0714018070 con 0x7f07240f57d0 2022-02-02T14:25:47.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.753+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072410c420 con 0x7f07240f57d0 2022-02-02T14:25:47.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.753+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0714007ba0 con 0x7f07240f57d0 2022-02-02T14:25:47.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.753+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f071401c3c0 con 0x7f07240f57d0 2022-02-02T14:25:47.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.753+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072410c950 con 0x7f07240f57d0 2022-02-02T14:25:47.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.754+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0724059100 con 0x7f07240f57d0 2022-02-02T14:25:47.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.754+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f071401d420 con 0x7f07240f57d0 2022-02-02T14:25:47.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.755+0000 7f070b7fe700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 0x7f070c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:47.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.755+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0714083790 con 0x7f07240f57d0 2022-02-02T14:25:47.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.755+0000 7f07227fc700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 0x7f070c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:47.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.755+0000 7f07227fc700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 0x7f070c0672e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f0718009fd0 tx=0x7f071800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:47.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.759+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f07140517e0 con 0x7f07240f57d0 2022-02-02T14:25:47.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.946+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f07240fde50 con 0x7f070c064e20 2022-02-02T14:25:47.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.948+0000 7f070b7fe700 1 -- 172.21.15.33:0/2601593220 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f071800f040 con 0x7f070c064e20 2022-02-02T14:25:47.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 msgr2=0x7f070c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 0x7f070c0672e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f0718009fd0 tx=0x7f071800b040).stop 2022-02-02T14:25:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 msgr2=0x7f07241099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7f0714009990 tx=0x7f0714009b30).stop 2022-02-02T14:25:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 shutdown_connections 2022-02-02T14:25:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f070c064e20 0x7f070c0672e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07240f57d0 0x7f07241099d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 --2- 172.21.15.33:0/2601593220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240f6ac0 0x7f072410bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.949+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 >> 172.21.15.33:0/2601593220 conn(0x7f07240f0320 msgr2=0x7f07240fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.950+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 shutdown_connections 2022-02-02T14:25:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:47.950+0000 7f0723fff700 1 -- 172.21.15.33:0/2601593220 wait complete. 2022-02-02T14:25:47.960 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:25:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 -- 172.21.15.33:0/3099828187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 msgr2=0x7f4bd00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3099828187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd00f59e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f4bcc004660 tx=0x7f4bcc009b30).stop 2022-02-02T14:25:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 -- 172.21.15.33:0/3099828187 shutdown_connections 2022-02-02T14:25:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3099828187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 0x7f4bd00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3099828187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd00f59e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 -- 172.21.15.33:0/3099828187 >> 172.21.15.33:0/3099828187 conn(0x7f4bd00f0d40 msgr2=0x7f4bd00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.050+0000 7f4bd7427700 1 -- 172.21.15.33:0/3099828187 shutdown_connections 2022-02-02T14:25:48.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 -- 172.21.15.33:0/3099828187 wait complete. 2022-02-02T14:25:48.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 Processor -- start 2022-02-02T14:25:48.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 -- start start 2022-02-02T14:25:48.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 0x7f4bd01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0109b90 con 0x7f4bd00f55c0 2022-02-02T14:25:48.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd7427700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0109cd0 con 0x7f4bd00f6860 2022-02-02T14:25:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.051+0000 7f4bd51c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32846/0 (socket says 172.21.15.33:32846) 2022-02-02T14:25:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 -- 172.21.15.33:0/3694884651 learned_addr learned my addr 172.21.15.33:0/3694884651 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:48.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd49c2700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 0x7f4bd01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 -- 172.21.15.33:0/3694884651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 msgr2=0x7f4bd01095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 0x7f4bd01095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 -- 172.21.15.33:0/3694884651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc005040 con 0x7f4bd00f55c0 2022-02-02T14:25:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd51c3700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f4bcc013a70 tx=0x7f4bcc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc018070 con 0x7f4bd00f55c0 2022-02-02T14:25:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd010a610 con 0x7f4bd00f55c0 2022-02-02T14:25:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4bcc0097d0 con 0x7f4bd00f55c0 2022-02-02T14:25:48.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.052+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc01de80 con 0x7f4bd00f55c0 2022-02-02T14:25:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.053+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd010ab70 con 0x7f4bd00f55c0 2022-02-02T14:25:48.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.054+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd0045ad0 con 0x7f4bd00f55c0 2022-02-02T14:25:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.054+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4bcc007ba0 con 0x7f4bd00f55c0 2022-02-02T14:25:48.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.055+0000 7f4bc1ffb700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 0x7f4bbc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.055+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4bcc0836b0 con 0x7f4bd00f55c0 2022-02-02T14:25:48.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.055+0000 7f4bd49c2700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 0x7f4bbc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.055+0000 7f4bd49c2700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 0x7f4bbc067290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4bc4004c40 tx=0x7f4bc400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.059+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4bcc055190 con 0x7f4bd00f55c0 2022-02-02T14:25:48.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.239+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bd00faaa0 con 0x7f4bbc064dd0 2022-02-02T14:25:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.254+0000 7f4bc1ffb700 1 -- 172.21.15.33:0/3694884651 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4bd00faaa0 con 0x7f4bbc064dd0 2022-02-02T14:25:48.255 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:25:48.255 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (51m) 13m ago 52m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:25:48.256 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (44m) 13m ago 52m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:25:48.257 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (44m) 13m ago 51m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:25:48.257 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (50m) 13m ago 51m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:25:48.258 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (44m) 13m ago 48m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:25:48.259 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (45m) 13m ago 48m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:25:48.259 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (45m) 13m ago 48m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:25:48.259 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (48m) 13m ago 48m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:25:48.260 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (45m) 13m ago 53m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:25:48.260 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (45m) 13m ago 51m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:25:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (45m) 13m ago 53m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:25:48.261 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (44m) 13m ago 51m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:25:48.262 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (51m) 13m ago 51m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:25:48.262 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (51m) 13m ago 51m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:25:48.263 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 13m ago 50m - 4096M 2022-02-02T14:25:48.263 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (50m) 13m ago 50m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:25:48.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (50m) 13m ago 50m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:25:48.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (49m) 13m ago 49m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:25:48.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (49m) 13m ago 49m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:25:48.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (49m) 13m ago 49m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:25:48.265 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (50m) 13m ago 51m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:25:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 msgr2=0x7f4bbc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 0x7f4bbc067290 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f4bc4004c40 tx=0x7f4bc400b040).stop 2022-02-02T14:25:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 msgr2=0x7f4bd01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f4bcc013a70 tx=0x7f4bcc009b30).stop 2022-02-02T14:25:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 shutdown_connections 2022-02-02T14:25:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4bbc064dd0 0x7f4bbc067290 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd00f55c0 0x7f4bd01090f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 --2- 172.21.15.33:0/3694884651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd00f6860 0x7f4bd01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 >> 172.21.15.33:0/3694884651 conn(0x7f4bd00f0d40 msgr2=0x7f4bd005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 shutdown_connections 2022-02-02T14:25:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.256+0000 7f4bd7427700 1 -- 172.21.15.33:0/3694884651 wait complete. 2022-02-02T14:25:48.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 -- 172.21.15.33:0/1070454940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f7980 msgr2=0x7fdb600f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 --2- 172.21.15.33:0/1070454940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f7980 0x7fdb600f7de0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7fdb54004660 tx=0x7fdb54009b30).stop 2022-02-02T14:25:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 -- 172.21.15.33:0/1070454940 shutdown_connections 2022-02-02T14:25:48.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 --2- 172.21.15.33:0/1070454940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f7980 0x7fdb600f7de0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 --2- 172.21.15.33:0/1070454940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f66e0 0x7fdb600f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 -- 172.21.15.33:0/1070454940 >> 172.21.15.33:0/1070454940 conn(0x7fdb600f1e40 msgr2=0x7fdb600f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 -- 172.21.15.33:0/1070454940 shutdown_connections 2022-02-02T14:25:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.357+0000 7fdb6660d700 1 -- 172.21.15.33:0/1070454940 wait complete. 2022-02-02T14:25:48.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 Processor -- start 2022-02-02T14:25:48.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 -- start start 2022-02-02T14:25:48.364 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:48 smithi033 ceph-mon[101165]: pgmap v1412: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f7980 0x7fdb60069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6006a380 con 0x7fdb600f66e0 2022-02-02T14:25:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb6660d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6006a4c0 con 0x7fdb600f7980 2022-02-02T14:25:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.358+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32856/0 (socket says 172.21.15.33:32856) 2022-02-02T14:25:48.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 -- 172.21.15.33:0/2840593269 learned_addr learned my addr 172.21.15.33:0/2840593269 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:48.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5f7fe700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f7980 0x7fdb60069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 -- 172.21.15.33:0/2840593269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f7980 msgr2=0x7fdb60069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f7980 0x7fdb60069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 -- 172.21.15.33:0/2840593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb54005040 con 0x7fdb600f66e0 2022-02-02T14:25:48.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5ffff700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fdb5000e7c0 tx=0x7fdb5000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb500092e0 con 0x7fdb600f66e0 2022-02-02T14:25:48.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdb5000f040 con 0x7fdb600f66e0 2022-02-02T14:25:48.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb500147e0 con 0x7fdb600f66e0 2022-02-02T14:25:48.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6006a7a0 con 0x7fdb600f66e0 2022-02-02T14:25:48.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.359+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6010ef40 con 0x7fdb600f66e0 2022-02-02T14:25:48.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.361+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb60045ad0 con 0x7fdb600f66e0 2022-02-02T14:25:48.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.361+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdb5001b030 con 0x7fdb600f66e0 2022-02-02T14:25:48.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.361+0000 7fdb5cff9700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 0x7fdb48067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.362+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdb50081a00 con 0x7fdb600f66e0 2022-02-02T14:25:48.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.362+0000 7fdb5f7fe700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 0x7fdb48067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.362+0000 7fdb5f7fe700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 0x7fdb48067270 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdb54009720 tx=0x7fdb54016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.366+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdb5004fab0 con 0x7fdb600f66e0 2022-02-02T14:25:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:48 smithi037 ceph-mon[69017]: pgmap v1412: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.611+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdb600fef70 con 0x7fdb600f66e0 2022-02-02T14:25:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.612+0000 7fdb5cff9700 1 -- 172.21.15.33:0/2840593269 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fdb500192d0 con 0x7fdb600f66e0 2022-02-02T14:25:48.613 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:25:48.613 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:25:48.614 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:25:48.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:48.614 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:25:48.614 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:25:48.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:48.615 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:25:48.615 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:25:48.616 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:48.617 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:25:48.617 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:25:48.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:25:48.618 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:25:48.618 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:25:48.618 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:25:48.618 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:25:48.619 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:25:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 msgr2=0x7fdb48067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 0x7fdb48067270 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdb54009720 tx=0x7fdb54016040).stop 2022-02-02T14:25:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 msgr2=0x7fdb6006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fdb5000e7c0 tx=0x7fdb5000b040).stop 2022-02-02T14:25:48.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 shutdown_connections 2022-02-02T14:25:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdb48064db0 0x7fdb48067270 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb600f66e0 0x7fdb6006b9a0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 --2- 172.21.15.33:0/2840593269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb600f7980 0x7fdb60069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 >> 172.21.15.33:0/2840593269 conn(0x7fdb600f1e40 msgr2=0x7fdb600fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 shutdown_connections 2022-02-02T14:25:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.614+0000 7fdb6660d700 1 -- 172.21.15.33:0/2840593269 wait complete. 2022-02-02T14:25:48.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 -- 172.21.15.33:0/2615582075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 msgr2=0x7f09f00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 --2- 172.21.15.33:0/2615582075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f00f6cc0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f09d8004660 tx=0x7f09d8009b30).stop 2022-02-02T14:25:48.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 -- 172.21.15.33:0/2615582075 shutdown_connections 2022-02-02T14:25:48.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 --2- 172.21.15.33:0/2615582075 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f00f6cc0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 --2- 172.21.15.33:0/2615582075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 0x7f09f00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 -- 172.21.15.33:0/2615582075 >> 172.21.15.33:0/2615582075 conn(0x7f09f00f0d40 msgr2=0x7f09f00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 -- 172.21.15.33:0/2615582075 shutdown_connections 2022-02-02T14:25:48.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.715+0000 7f09f55be700 1 -- 172.21.15.33:0/2615582075 wait complete. 2022-02-02T14:25:48.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 Processor -- start 2022-02-02T14:25:48.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 -- start start 2022-02-02T14:25:48.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 0x7f09f010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00602b0 con 0x7f09f00f6860 2022-02-02T14:25:48.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09f55be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00603f0 con 0x7f09f00f55c0 2022-02-02T14:25:48.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32868/0 (socket says 172.21.15.33:32868) 2022-02-02T14:25:48.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 -- 172.21.15.33:0/2520820959 learned_addr learned my addr 172.21.15.33:0/2520820959 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:25:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09eeffd700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 0x7f09f010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 -- 172.21.15.33:0/2520820959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 msgr2=0x7f09f010c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 0x7f09f010c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.716+0000 7f09ee7fc700 1 -- 172.21.15.33:0/2520820959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d8005040 con 0x7f09f00f6860 2022-02-02T14:25:48.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09ee7fc700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09d8009990 tx=0x7f09d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d8018070 con 0x7f09f00f6860 2022-02-02T14:25:48.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09d8007ca0 con 0x7f09f00f6860 2022-02-02T14:25:48.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f010ea70 con 0x7f09f00f6860 2022-02-02T14:25:48.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d801c620 con 0x7f09f00f6860 2022-02-02T14:25:48.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.717+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f010ee40 con 0x7f09f00f6860 2022-02-02T14:25:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.718+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f0045ad0 con 0x7f09f00f6860 2022-02-02T14:25:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.718+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09d801d960 con 0x7f09f00f6860 2022-02-02T14:25:48.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.719+0000 7f09e77fe700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 0x7f09dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:25:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.719+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09d8083750 con 0x7f09f00f6860 2022-02-02T14:25:48.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.719+0000 7f09eeffd700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 0x7f09dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:25:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.719+0000 7f09eeffd700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 0x7f09dc067290 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f09e00041d0 tx=0x7f09e0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:25:48.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.723+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09d8051800 con 0x7f09f00f6860 2022-02-02T14:25:48.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.938+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f09f00fde30 con 0x7f09f00f6860 2022-02-02T14:25:48.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.939+0000 7f09e77fe700 1 -- 172.21.15.33:0/2520820959 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f09d8054e20 con 0x7f09f00f6860 2022-02-02T14:25:48.941 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:25:48.941 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:25:48.941 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:25:48.942 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:25:48.942 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:48.942 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:25:48.942 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:25:48.942 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:25:48.943 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:25:48.943 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:25:48.944 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:25:48.944 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:25:48.944 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:25:48.944 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:25:48.945 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:25:48.945 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:25:48.945 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:25:48.945 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:25:48.945 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:25:48.946 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:25:48.946 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:25:48.946 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:25:48.947 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:25:48.947 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:25:48.947 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:25:48.948 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:25:48.948 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:25:48.948 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:25:48.948 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:25:48.948 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:25:48.949 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:25:48.949 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:48.950 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:48.950 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:25:48.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:25:48.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:48.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:48.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:48.952 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:25:48.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 msgr2=0x7f09dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 0x7f09dc067290 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f09e00041d0 tx=0x7f09e0009040).stop 2022-02-02T14:25:48.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 msgr2=0x7f09f010e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:25:48.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f09d8009990 tx=0x7f09d8009b30).stop 2022-02-02T14:25:48.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 shutdown_connections 2022-02-02T14:25:48.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09dc064dd0 0x7f09dc067290 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f00f55c0 0x7f09f010c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 --2- 172.21.15.33:0/2520820959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f00f6860 0x7f09f010e580 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:25:48.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 >> 172.21.15.33:0/2520820959 conn(0x7f09f00f0d40 msgr2=0x7f09f00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:25:48.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 shutdown_connections 2022-02-02T14:25:48.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:25:48.941+0000 7f09f55be700 1 -- 172.21.15.33:0/2520820959 wait complete. 2022-02-02T14:25:48.955 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:25:49.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:49 smithi037 ceph-mon[69017]: from='client.35526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:49 smithi037 ceph-mon[69017]: from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2840593269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:25:49.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2520820959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:25:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:49 smithi033 ceph-mon[101165]: from='client.35526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:49 smithi033 ceph-mon[101165]: from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:25:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2840593269' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:25:49.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2520820959' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:25:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:50 smithi037 ceph-mon[69017]: pgmap v1413: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:50 smithi033 ceph-mon[101165]: pgmap v1413: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:52 smithi037 ceph-mon[69017]: pgmap v1414: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:52 smithi033 ceph-mon[101165]: pgmap v1414: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:54 smithi037 ceph-mon[69017]: pgmap v1415: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:54 smithi033 ceph-mon[101165]: pgmap v1415: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:25:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:25:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:25:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:25:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:56 smithi033 ceph-mon[101165]: pgmap v1416: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:56 smithi037 ceph-mon[69017]: pgmap v1416: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:25:58 smithi033 ceph-mon[101165]: pgmap v1417: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:25:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:25:58 smithi037 ceph-mon[69017]: pgmap v1417: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:00 smithi033 ceph-mon[101165]: pgmap v1418: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:00 smithi037 ceph-mon[69017]: pgmap v1418: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:02 smithi033 ceph-mon[101165]: pgmap v1419: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:02 smithi037 ceph-mon[69017]: pgmap v1419: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:04 smithi033 ceph-mon[101165]: pgmap v1420: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:05.045 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:04 smithi037 ceph-mon[69017]: pgmap v1420: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:06 smithi033 ceph-mon[101165]: pgmap v1421: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:06 smithi037 ceph-mon[69017]: pgmap v1421: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:08 smithi033 ceph-mon[101165]: pgmap v1422: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:08 smithi037 ceph-mon[69017]: pgmap v1422: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:10 smithi033 ceph-mon[101165]: pgmap v1423: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:10 smithi037 ceph-mon[69017]: pgmap v1423: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:12 smithi033 ceph-mon[101165]: pgmap v1424: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:12 smithi037 ceph-mon[69017]: pgmap v1424: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:14 smithi033 ceph-mon[101165]: pgmap v1425: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:14.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:14 smithi037 ceph-mon[69017]: pgmap v1425: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:16 smithi033 ceph-mon[101165]: pgmap v1426: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:16 smithi037 ceph-mon[69017]: pgmap v1426: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:18 smithi033 ceph-mon[101165]: pgmap v1427: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:18 smithi037 ceph-mon[69017]: pgmap v1427: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:19.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 -- 172.21.15.33:0/842847533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 msgr2=0x7f23340f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 --2- 172.21.15.33:0/842847533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f23340f7c30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f2324004660 tx=0x7f2324009b30).stop 2022-02-02T14:26:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 -- 172.21.15.33:0/842847533 shutdown_connections 2022-02-02T14:26:19.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 --2- 172.21.15.33:0/842847533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f23340f7c30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 --2- 172.21.15.33:0/842847533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 0x7f23340f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 -- 172.21.15.33:0/842847533 >> 172.21.15.33:0/842847533 conn(0x7f23340f1c90 msgr2=0x7f23340f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 -- 172.21.15.33:0/842847533 shutdown_connections 2022-02-02T14:26:19.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.058+0000 7f2333fff700 1 -- 172.21.15.33:0/842847533 wait complete. 2022-02-02T14:26:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 Processor -- start 2022-02-02T14:26:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 -- start start 2022-02-02T14:26:19.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 0x7f2334106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334107880 con 0x7f23340f77d0 2022-02-02T14:26:19.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2333fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334108090 con 0x7f23340f6530 2022-02-02T14:26:19.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32898/0 (socket says 172.21.15.33:32898) 2022-02-02T14:26:19.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 -- 172.21.15.33:0/2700097351 learned_addr learned my addr 172.21.15.33:0/2700097351 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:19.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f2332ffd700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 0x7f2334106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 -- 172.21.15.33:0/2700097351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 msgr2=0x7f2334106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 0x7f2334106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 -- 172.21.15.33:0/2700097351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324005040 con 0x7f23340f77d0 2022-02-02T14:26:19.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.059+0000 7f23327fc700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f2324009990 tx=0x7f2324009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.060+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2324018070 con 0x7f23340f77d0 2022-02-02T14:26:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.060+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23341082b0 con 0x7f23340f77d0 2022-02-02T14:26:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.060+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2334108810 con 0x7f23340f77d0 2022-02-02T14:26:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.060+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2324007ba0 con 0x7f23340f77d0 2022-02-02T14:26:19.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.060+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f232401c620 con 0x7f23340f77d0 2022-02-02T14:26:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.061+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2314004fa0 con 0x7f23340f77d0 2022-02-02T14:26:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.061+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f232401c890 con 0x7f23340f77d0 2022-02-02T14:26:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.062+0000 7f231b7fe700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 0x7f231c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.062+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2324083750 con 0x7f23340f77d0 2022-02-02T14:26:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.062+0000 7f2332ffd700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 0x7f231c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.062+0000 7f2332ffd700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 0x7f231c0672e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2334106b00 tx=0x7f2328009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.066+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f23240517a0 con 0x7f23340f77d0 2022-02-02T14:26:19.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.255+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2314000bc0 con 0x7f231c064e20 2022-02-02T14:26:19.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.257+0000 7f231b7fe700 1 -- 172.21.15.33:0/2700097351 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2314000bc0 con 0x7f231c064e20 2022-02-02T14:26:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 msgr2=0x7f231c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 0x7f231c0672e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2334106b00 tx=0x7f2328009040).stop 2022-02-02T14:26:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 msgr2=0x7f2334107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f2324009990 tx=0x7f2324009b30).stop 2022-02-02T14:26:19.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 shutdown_connections 2022-02-02T14:26:19.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f231c064e20 0x7f231c0672e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23340f6530 0x7f2334106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 --2- 172.21.15.33:0/2700097351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23340f77d0 0x7f2334107280 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 >> 172.21.15.33:0/2700097351 conn(0x7f23340f1c90 msgr2=0x7f23340fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 shutdown_connections 2022-02-02T14:26:19.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.259+0000 7f2333fff700 1 -- 172.21.15.33:0/2700097351 wait complete. 2022-02-02T14:26:19.268 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:26:19.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/2501340458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 msgr2=0x7fa2f80f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/2501340458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f80f6b40 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fa2ec004660 tx=0x7fa2ec009b30).stop 2022-02-02T14:26:19.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/2501340458 shutdown_connections 2022-02-02T14:26:19.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/2501340458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f80f6b40 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/2501340458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f80f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/2501340458 >> 172.21.15.33:0/2501340458 conn(0x7fa2f80f0ba0 msgr2=0x7fa2f80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/2501340458 shutdown_connections 2022-02-02T14:26:19.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.360+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/2501340458 wait complete. 2022-02-02T14:26:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.361+0000 7fa2fc9b6700 1 Processor -- start 2022-02-02T14:26:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.361+0000 7fa2fc9b6700 1 -- start start 2022-02-02T14:26:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.361+0000 7fa2fc9b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f81099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2fc9b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2fc9b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80603c0 con 0x7fa2f80f66e0 2022-02-02T14:26:19.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2fc9b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8060500 con 0x7fa2f80f5440 2022-02-02T14:26:19.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32908/0 (socket says 172.21.15.33:32908) 2022-02-02T14:26:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f659c700 1 -- 172.21.15.33:0/328414772 learned_addr learned my addr 172.21.15.33:0/328414772 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f6d9d700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f81099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f6d9d700 1 -- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 msgr2=0x7fa2f810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f6d9d700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f6d9d700 1 -- 172.21.15.33:0/328414772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec005040 con 0x7fa2f80f5440 2022-02-02T14:26:19.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f659c700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:26:19.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2f6d9d700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f81099d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa2f80f6540 tx=0x7fa2e800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.362+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e80092e0 con 0x7fa2f80f5440 2022-02-02T14:26:19.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.363+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f810c480 con 0x7fa2f80f5440 2022-02-02T14:26:19.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.363+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x7fa2f80f5440 2022-02-02T14:26:19.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.363+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e80147a0 con 0x7fa2f80f5440 2022-02-02T14:26:19.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.363+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f810ca10 con 0x7fa2f80f5440 2022-02-02T14:26:19.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.364+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d8004fa0 con 0x7fa2f80f5440 2022-02-02T14:26:19.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.364+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa2e801b030 con 0x7fa2f80f5440 2022-02-02T14:26:19.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.365+0000 7fa2df7fe700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 0x7fa2e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.365+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa2e8081860 con 0x7fa2f80f5440 2022-02-02T14:26:19.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.365+0000 7fa2f659c700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 0x7fa2e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.365+0000 7fa2f659c700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 0x7fa2e00672e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa2ec005010 tx=0x7fa2ec016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.369+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa2e804f910 con 0x7fa2f80f5440 2022-02-02T14:26:19.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.553+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2d8000bc0 con 0x7fa2e0064e20 2022-02-02T14:26:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.568+0000 7fa2df7fe700 1 -- 172.21.15.33:0/328414772 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa2d8000bc0 con 0x7fa2e0064e20 2022-02-02T14:26:19.568 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:26:19.569 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (51m) 13m ago 52m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:26:19.569 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (44m) 13m ago 52m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:26:19.570 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (44m) 13m ago 52m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:26:19.570 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (51m) 13m ago 52m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:26:19.570 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (45m) 13m ago 48m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:26:19.570 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (45m) 13m ago 48m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:26:19.571 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (46m) 13m ago 48m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:26:19.571 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (48m) 13m ago 48m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:26:19.572 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (46m) 13m ago 53m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:26:19.572 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (45m) 13m ago 52m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:26:19.572 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (45m) 13m ago 54m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:26:19.572 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (45m) 13m ago 51m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:26:19.572 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (52m) 13m ago 52m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:26:19.573 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (51m) 13m ago 51m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:26:19.574 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 13m ago 51m - 4096M 2022-02-02T14:26:19.574 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (51m) 13m ago 51m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:26:19.575 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (50m) 13m ago 50m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:26:19.575 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (50m) 13m ago 50m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:26:19.576 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (50m) 13m ago 50m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:26:19.576 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (49m) 13m ago 49m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:26:19.576 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (51m) 13m ago 52m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:26:19.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 msgr2=0x7fa2e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 0x7fa2e00672e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa2ec005010 tx=0x7fa2ec016040).stop 2022-02-02T14:26:19.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 msgr2=0x7fa2f81099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f81099d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fa2f80f6540 tx=0x7fa2e800b040).stop 2022-02-02T14:26:19.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 shutdown_connections 2022-02-02T14:26:19.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa2e0064e20 0x7fa2e00672e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f80f5440 0x7fa2f81099d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 --2- 172.21.15.33:0/328414772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f80f66e0 0x7fa2f810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 >> 172.21.15.33:0/328414772 conn(0x7fa2f80f0ba0 msgr2=0x7fa2f80fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 shutdown_connections 2022-02-02T14:26:19.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.570+0000 7fa2fc9b6700 1 -- 172.21.15.33:0/328414772 wait complete. 2022-02-02T14:26:19.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 -- 172.21.15.33:0/4011252416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 msgr2=0x7f057c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 --2- 172.21.15.33:0/4011252416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c0f7de0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f0564004660 tx=0x7f0564009b30).stop 2022-02-02T14:26:19.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 -- 172.21.15.33:0/4011252416 shutdown_connections 2022-02-02T14:26:19.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 --2- 172.21.15.33:0/4011252416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c0f7de0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 --2- 172.21.15.33:0/4011252416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 0x7f057c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:26:19.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 -- 172.21.15.33:0/4011252416 >> 172.21.15.33:0/4011252416 conn(0x7f057c0f1e40 msgr2=0x7f057c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.670+0000 7f05827b4700 1 -- 172.21.15.33:0/4011252416 shutdown_connections 2022-02-02T14:26:19.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 -- 172.21.15.33:0/4011252416 wait complete. 2022-02-02T14:26:19.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 Processor -- start 2022-02-02T14:26:19.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 -- start start 2022-02-02T14:26:19.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 0x7f057c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c06a410 con 0x7f057c0f7980 2022-02-02T14:26:19.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.671+0000 7f05827b4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c06a550 con 0x7f057c0f66e0 2022-02-02T14:26:19.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32918/0 (socket says 172.21.15.33:32918) 2022-02-02T14:26:19.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 -- 172.21.15.33:0/4001203622 learned_addr learned my addr 172.21.15.33:0/4001203622 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:19.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f057bfff700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 0x7f057c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 -- 172.21.15.33:0/4001203622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 msgr2=0x7f057c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 0x7f057c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 -- 172.21.15.33:0/4001203622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564005040 con 0x7f057c0f7980 2022-02-02T14:26:19.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f0573fff700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0564009990 tx=0x7f0564009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0564018070 con 0x7f057c0f7980 2022-02-02T14:26:19.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0564007ba0 con 0x7f057c0f7980 2022-02-02T14:26:19.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f056401c620 con 0x7f057c0f7980 2022-02-02T14:26:19.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.672+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c06a7d0 con 0x7f057c0f7980 2022-02-02T14:26:19.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.673+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c10efe0 con 0x7f057c0f7980 2022-02-02T14:26:19.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.674+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057c045ad0 con 0x7f057c0f7980 2022-02-02T14:26:19.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.674+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f056401c890 con 0x7f057c0f7980 2022-02-02T14:26:19.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.675+0000 7f05797fa700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 0x7f0568067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:19.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.675+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0564083810 con 0x7f057c0f7980 2022-02-02T14:26:19.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.675+0000 7f057bfff700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 0x7f0568067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:19.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.675+0000 7f057bfff700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 0x7f0568067290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f057c06b730 tx=0x7f056c008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:19.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.679+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f05640518c0 con 0x7f057c0f7980 2022-02-02T14:26:19.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.923+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f057c027a00 con 0x7f057c0f7980 2022-02-02T14:26:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.923+0000 7f05797fa700 1 -- 172.21.15.33:0/4001203622 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0564054ee0 con 0x7f057c0f7980 2022-02-02T14:26:19.924 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:26:19.924 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:26:19.924 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:26:19.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:19.925 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:26:19.925 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:26:19.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:19.925 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:26:19.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:26:19.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:19.926 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:26:19.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:26:19.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:19.927 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:26:19.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:26:19.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:26:19.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:26:19.928 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:26:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 msgr2=0x7f0568067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 0x7f0568067290 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f057c06b730 tx=0x7f056c008040).stop 2022-02-02T14:26:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 msgr2=0x7f057c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0564009990 tx=0x7f0564009b30).stop 2022-02-02T14:26:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 shutdown_connections 2022-02-02T14:26:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0568064dd0 0x7f0568067290 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f057c0f66e0 0x7f057c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 --2- 172.21.15.33:0/4001203622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057c0f7980 0x7f057c069e20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 >> 172.21.15.33:0/4001203622 conn(0x7f057c0f1e40 msgr2=0x7f057c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 shutdown_connections 2022-02-02T14:26:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:19.925+0000 7f05827b4700 1 -- 172.21.15.33:0/4001203622 wait complete. 2022-02-02T14:26:20.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- 172.21.15.33:0/2667361764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 msgr2=0x7fc2980f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:20.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/2667361764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2980f6cc0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7fc280004660 tx=0x7fc280009b30).stop 2022-02-02T14:26:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- 172.21.15.33:0/2667361764 shutdown_connections 2022-02-02T14:26:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/2667361764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2980f6cc0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/2667361764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 0x7fc2980f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- 172.21.15.33:0/2667361764 >> 172.21.15.33:0/2667361764 conn(0x7fc2980f0d40 msgr2=0x7fc2980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:20.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- 172.21.15.33:0/2667361764 shutdown_connections 2022-02-02T14:26:20.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- 172.21.15.33:0/2667361764 wait complete. 2022-02-02T14:26:20.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 Processor -- start 2022-02-02T14:26:20.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.026+0000 7fc29cf2c700 1 -- start start 2022-02-02T14:26:20.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc29cf2c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 0x7fc298105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:20.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc29cf2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:20.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc29cf2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981069b0 con 0x7fc2980f6860 2022-02-02T14:26:20.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc29cf2c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2981071c0 con 0x7fc2980f55c0 2022-02-02T14:26:20.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:20.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32928/0 (socket says 172.21.15.33:32928) 2022-02-02T14:26:20.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 -- 172.21.15.33:0/1736659129 learned_addr learned my addr 172.21.15.33:0/1736659129 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:20.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc29659c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 0x7fc298105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:20.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 -- 172.21.15.33:0/1736659129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 msgr2=0x7fc298105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:20.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 0x7fc298105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 -- 172.21.15.33:0/1736659129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280005040 con 0x7fc2980f6860 2022-02-02T14:26:20.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.027+0000 7fc295d9b700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fc280009990 tx=0x7fc280009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:20.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.028+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc280018070 con 0x7fc2980f6860 2022-02-02T14:26:20.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.028+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2981073e0 con 0x7fc2980f6860 2022-02-02T14:26:20.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.028+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc280007ba0 con 0x7fc2980f6860 2022-02-02T14:26:20.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.028+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc28001c3c0 con 0x7fc2980f6860 2022-02-02T14:26:20.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.028+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc298107940 con 0x7fc2980f6860 2022-02-02T14:26:20.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.029+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2980f49b0 con 0x7fc2980f6860 2022-02-02T14:26:20.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.029+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc28001d420 con 0x7fc2980f6860 2022-02-02T14:26:20.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.030+0000 7fc28effd700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 0x7fc284067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:20.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.030+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc280083630 con 0x7fc2980f6860 2022-02-02T14:26:20.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.030+0000 7fc29659c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 0x7fc284067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:20.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.030+0000 7fc29659c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 0x7fc284067290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc298105c30 tx=0x7fc28800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:20.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.034+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc280051680 con 0x7fc2980f6860 2022-02-02T14:26:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.250+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc2980ff7c0 con 0x7fc2980f6860 2022-02-02T14:26:20.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.251+0000 7fc28effd700 1 -- 172.21.15.33:0/1736659129 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc280054ca0 con 0x7fc2980f6860 2022-02-02T14:26:20.251 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:26:20.251 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:26:20.251 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:26:20.251 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:26:20.252 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:20.252 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:26:20.252 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:26:20.252 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:26:20.253 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:26:20.253 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:26:20.253 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:26:20.253 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:26:20.254 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:26:20.254 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:26:20.254 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:26:20.255 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:26:20.256 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:26:20.256 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:26:20.256 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:26:20.257 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:26:20.257 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:26:20.257 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:26:20.257 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:26:20.258 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:26:20.258 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:26:20.258 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:26:20.258 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:26:20.259 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:26:20.259 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:26:20.259 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:26:20.259 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:26:20.260 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:20.260 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:20.260 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:26:20.260 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:20.260 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:20.261 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:20.261 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:20.261 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:20.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 msgr2=0x7fc284067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:20.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 0x7fc284067290 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fc298105c30 tx=0x7fc28800b040).stop 2022-02-02T14:26:20.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 msgr2=0x7fc2981063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:20.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fc280009990 tx=0x7fc280009b30).stop 2022-02-02T14:26:20.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 shutdown_connections 2022-02-02T14:26:20.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc284064dd0 0x7fc284067290 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2980f55c0 0x7fc298105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 --2- 172.21.15.33:0/1736659129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2980f6860 0x7fc2981063b0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:20.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.252+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 >> 172.21.15.33:0/1736659129 conn(0x7fc2980f0d40 msgr2=0x7fc2980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:20.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.253+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 shutdown_connections 2022-02-02T14:26:20.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:20.253+0000 7fc29cf2c700 1 -- 172.21.15.33:0/1736659129 wait complete. 2022-02-02T14:26:20.266 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:26:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:20 smithi033 ceph-mon[101165]: pgmap v1428: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:20 smithi033 ceph-mon[101165]: from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4001203622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:26:20.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1736659129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:26:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:20 smithi037 ceph-mon[69017]: pgmap v1428: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:20.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:20 smithi037 ceph-mon[69017]: from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:20.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4001203622' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:26:20.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1736659129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:26:21.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:21 smithi033 ceph-mon[101165]: from='client.45201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:21.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:21 smithi037 ceph-mon[69017]: from='client.45201 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:22 smithi033 ceph-mon[101165]: pgmap v1429: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:22 smithi037 ceph-mon[69017]: pgmap v1429: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:23.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:23 smithi033 ceph-mon[101165]: pgmap v1430: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:23.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:23 smithi037 ceph-mon[69017]: pgmap v1430: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:26.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:25 smithi033 ceph-mon[101165]: pgmap v1431: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:26.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:25 smithi037 ceph-mon[69017]: pgmap v1431: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:28 smithi033 ceph-mon[101165]: pgmap v1432: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:28 smithi037 ceph-mon[69017]: pgmap v1432: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:30.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:30 smithi033 ceph-mon[101165]: pgmap v1433: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:30 smithi037 ceph-mon[69017]: pgmap v1433: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:32 smithi033 ceph-mon[101165]: pgmap v1434: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:32 smithi037 ceph-mon[69017]: pgmap v1434: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:34 smithi033 ceph-mon[101165]: pgmap v1435: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:34 smithi037 ceph-mon[69017]: pgmap v1435: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:36 smithi033 ceph-mon[101165]: pgmap v1436: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:36 smithi037 ceph-mon[69017]: pgmap v1436: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:38 smithi033 ceph-mon[101165]: pgmap v1437: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:38 smithi037 ceph-mon[69017]: pgmap v1437: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:40 smithi033 ceph-mon[101165]: pgmap v1438: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:40 smithi037 ceph-mon[69017]: pgmap v1438: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:42.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:42 smithi033 ceph-mon[101165]: pgmap v1439: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:42 smithi037 ceph-mon[69017]: pgmap v1439: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:44.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:44 smithi033 ceph-mon[101165]: pgmap v1440: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:44 smithi037 ceph-mon[69017]: pgmap v1440: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:46.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:46 smithi033 ceph-mon[101165]: pgmap v1441: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:46 smithi037 ceph-mon[69017]: pgmap v1441: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:48.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:48 smithi033 ceph-mon[101165]: pgmap v1442: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:48 smithi037 ceph-mon[69017]: pgmap v1442: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:50.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 -- 172.21.15.33:0/3222270555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 msgr2=0x7f328c0f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 --2- 172.21.15.33:0/3222270555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f9110 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f327c004660 tx=0x7f327c009b30).stop 2022-02-02T14:26:50.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 -- 172.21.15.33:0/3222270555 shutdown_connections 2022-02-02T14:26:50.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 --2- 172.21.15.33:0/3222270555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 0x7f328c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 --2- 172.21.15.33:0/3222270555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f9110 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 -- 172.21.15.33:0/3222270555 >> 172.21.15.33:0/3222270555 conn(0x7f328c0f0b90 msgr2=0x7f328c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 -- 172.21.15.33:0/3222270555 shutdown_connections 2022-02-02T14:26:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.366+0000 7f329338c700 1 -- 172.21.15.33:0/3222270555 wait complete. 2022-02-02T14:26:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 Processor -- start 2022-02-02T14:26:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 -- start start 2022-02-02T14:26:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 0x7f328c0f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0f5570 con 0x7f328c060310 2022-02-02T14:26:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329338c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0f56b0 con 0x7f328c0f9690 2022-02-02T14:26:50.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329238a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329238a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32936/0 (socket says 172.21.15.33:32936) 2022-02-02T14:26:50.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f329238a700 1 -- 172.21.15.33:0/2908316307 learned_addr learned my addr 172.21.15.33:0/2908316307 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.367+0000 7f3291b89700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 0x7f328c0f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329238a700 1 -- 172.21.15.33:0/2908316307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 msgr2=0x7f328c0f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329238a700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 0x7f328c0f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329238a700 1 -- 172.21.15.33:0/2908316307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c005040 con 0x7f328c060310 2022-02-02T14:26:50.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329238a700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f327c000c00 tx=0x7f327c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c019070 con 0x7f328c060310 2022-02-02T14:26:50.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f327c007e70 con 0x7f328c060310 2022-02-02T14:26:50.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c0f5930 con 0x7f328c060310 2022-02-02T14:26:50.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f327c014ce0 con 0x7f328c060310 2022-02-02T14:26:50.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.368+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c0f5e90 con 0x7f328c060310 2022-02-02T14:26:50.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.369+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c045ad0 con 0x7f328c060310 2022-02-02T14:26:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.370+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f327c025070 con 0x7f328c060310 2022-02-02T14:26:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.370+0000 7f3282ffd700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 0x7f32780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.370+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f327c0829f0 con 0x7f328c060310 2022-02-02T14:26:50.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.370+0000 7f3291b89700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 0x7f32780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.371+0000 7f3291b89700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 0x7f32780672e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f3288009fd0 tx=0x7f328800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.375+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f327c084e60 con 0x7f328c060310 2022-02-02T14:26:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:50 smithi037 ceph-mon[69017]: pgmap v1443: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:50.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.563+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f328c0feec0 con 0x7f3278064e20 2022-02-02T14:26:50.564 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:50 smithi033 ceph-mon[101165]: pgmap v1443: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.565+0000 7f3282ffd700 1 -- 172.21.15.33:0/2908316307 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f328800f040 con 0x7f3278064e20 2022-02-02T14:26:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 msgr2=0x7f32780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 0x7f32780672e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f3288009fd0 tx=0x7f328800b040).stop 2022-02-02T14:26:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 msgr2=0x7f328c0f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f327c000c00 tx=0x7f327c00b040).stop 2022-02-02T14:26:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 shutdown_connections 2022-02-02T14:26:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3278064e20 0x7f32780672e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c060310 0x7f328c0f6b90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 --2- 172.21.15.33:0/2908316307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f328c0f9690 0x7f328c0f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 >> 172.21.15.33:0/2908316307 conn(0x7f328c0f0b90 msgr2=0x7f328c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:50.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 shutdown_connections 2022-02-02T14:26:50.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.567+0000 7f329338c700 1 -- 172.21.15.33:0/2908316307 wait complete. 2022-02-02T14:26:50.577 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:26:50.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.667+0000 7f1128505700 1 -- 172.21.15.33:0/1759571463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 msgr2=0x7f11200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.667+0000 7f1128505700 1 --2- 172.21.15.33:0/1759571463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11200f6cc0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f1110004660 tx=0x7f1110009b30).stop 2022-02-02T14:26:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- 172.21.15.33:0/1759571463 shutdown_connections 2022-02-02T14:26:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 --2- 172.21.15.33:0/1759571463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11200f6cc0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 --2- 172.21.15.33:0/1759571463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 0x7f11200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- 172.21.15.33:0/1759571463 >> 172.21.15.33:0/1759571463 conn(0x7f11200f0d40 msgr2=0x7f11200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- 172.21.15.33:0/1759571463 shutdown_connections 2022-02-02T14:26:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- 172.21.15.33:0/1759571463 wait complete. 2022-02-02T14:26:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 Processor -- start 2022-02-02T14:26:50.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- start start 2022-02-02T14:26:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 0x7f1120105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201069b0 con 0x7f11200f6860 2022-02-02T14:26:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.668+0000 7f1128505700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11201071c0 con 0x7f11200f55c0 2022-02-02T14:26:50.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32948/0 (socket says 172.21.15.33:32948) 2022-02-02T14:26:50.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 -- 172.21.15.33:0/1913882859 learned_addr learned my addr 172.21.15.33:0/1913882859 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:50.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f11262a1700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 0x7f1120105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 -- 172.21.15.33:0/1913882859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 msgr2=0x7f1120105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 0x7f1120105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 -- 172.21.15.33:0/1913882859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110005040 con 0x7f11200f6860 2022-02-02T14:26:50.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1125aa0700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f1110009990 tx=0x7f1110009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1110018070 con 0x7f11200f6860 2022-02-02T14:26:50.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1110007ba0 con 0x7f11200f6860 2022-02-02T14:26:50.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120107360 con 0x7f11200f6860 2022-02-02T14:26:50.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f111001c3c0 con 0x7f11200f6860 2022-02-02T14:26:50.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.669+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11201078c0 con 0x7f11200f6860 2022-02-02T14:26:50.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.670+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120045ad0 con 0x7f11200f6860 2022-02-02T14:26:50.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.671+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f111001d420 con 0x7f11200f6860 2022-02-02T14:26:50.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.671+0000 7f1116ffd700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 0x7f110c067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.671+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1110083730 con 0x7f11200f6860 2022-02-02T14:26:50.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.671+0000 7f11262a1700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 0x7f110c067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.672+0000 7f11262a1700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 0x7f110c067280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1120105c30 tx=0x7f111c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.676+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1110051780 con 0x7f11200f6860 2022-02-02T14:26:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.858+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11200ff7e0 con 0x7f110c064dc0 2022-02-02T14:26:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.873+0000 7f1116ffd700 1 -- 172.21.15.33:0/1913882859 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f11200ff7e0 con 0x7f110c064dc0 2022-02-02T14:26:50.874 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:26:50.874 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (52m) 14m ago 53m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:26:50.874 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (45m) 14m ago 53m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:26:50.875 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (45m) 14m ago 52m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:26:50.875 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (51m) 14m ago 52m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:26:50.875 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (45m) 14m ago 49m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:26:50.875 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (46m) 14m ago 49m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:26:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (47m) 14m ago 49m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:26:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (49m) 14m ago 49m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:26:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (46m) 14m ago 54m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:26:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (46m) 14m ago 52m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:26:50.876 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (46m) 14m ago 54m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:26:50.877 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (45m) 14m ago 52m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:26:50.877 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (52m) 14m ago 52m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:26:50.877 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (52m) 14m ago 52m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:26:50.877 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 14m ago 51m - 4096M 2022-02-02T14:26:50.877 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (51m) 14m ago 51m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:26:50.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (51m) 14m ago 51m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:26:50.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (51m) 14m ago 51m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:26:50.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (50m) 14m ago 50m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:26:50.878 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (50m) 14m ago 50m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:26:50.879 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (51m) 14m ago 52m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:26:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 msgr2=0x7f110c067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 0x7f110c067280 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1120105c30 tx=0x7f111c00b040).stop 2022-02-02T14:26:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 msgr2=0x7f11201063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f1110009990 tx=0x7f1110009b30).stop 2022-02-02T14:26:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 shutdown_connections 2022-02-02T14:26:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f110c064dc0 0x7f110c067280 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11200f55c0 0x7f1120105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 --2- 172.21.15.33:0/1913882859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11200f6860 0x7f11201063b0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 >> 172.21.15.33:0/1913882859 conn(0x7f11200f0d40 msgr2=0x7f11200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:50.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 shutdown_connections 2022-02-02T14:26:50.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.875+0000 7f1128505700 1 -- 172.21.15.33:0/1913882859 wait complete. 2022-02-02T14:26:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 -- 172.21.15.33:0/2944790320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800602b0 msgr2=0x7f1e800f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 --2- 172.21.15.33:0/2944790320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800602b0 0x7f1e800f9300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f1e74004660 tx=0x7f1e74009b30).stop 2022-02-02T14:26:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 -- 172.21.15.33:0/2944790320 shutdown_connections 2022-02-02T14:26:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 --2- 172.21.15.33:0/2944790320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800f9880 0x7f1e800fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 --2- 172.21.15.33:0/2944790320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800602b0 0x7f1e800f9300 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 -- 172.21.15.33:0/2944790320 >> 172.21.15.33:0/2944790320 conn(0x7f1e800f0d40 msgr2=0x7f1e800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.974+0000 7f1e8786a700 1 -- 172.21.15.33:0/2944790320 shutdown_connections 2022-02-02T14:26:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 -- 172.21.15.33:0/2944790320 wait complete. 2022-02-02T14:26:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 Processor -- start 2022-02-02T14:26:50.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 -- start start 2022-02-02T14:26:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 0x7f1e80109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80109bb0 con 0x7f1e800f9880 2022-02-02T14:26:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e8786a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e80109cf0 con 0x7f1e800602b0 2022-02-02T14:26:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e84e05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e84e05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32956/0 (socket says 172.21.15.33:32956) 2022-02-02T14:26:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.975+0000 7f1e84e05700 1 -- 172.21.15.33:0/1016084324 learned_addr learned my addr 172.21.15.33:0/1016084324 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:50.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e85606700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 0x7f1e80109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e85606700 1 -- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 msgr2=0x7f1e80109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:50.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e85606700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:50.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e85606700 1 -- 172.21.15.33:0/1016084324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74005040 con 0x7f1e800602b0 2022-02-02T14:26:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e84e05700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:26:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e85606700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 0x7f1e80109110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e74000c00 tx=0x7f1e74009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e74018070 con 0x7f1e800602b0 2022-02-02T14:26:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8010a630 con 0x7f1e800602b0 2022-02-02T14:26:50.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1e74007ba0 con 0x7f1e800602b0 2022-02-02T14:26:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.976+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e7401c3c0 con 0x7f1e800602b0 2022-02-02T14:26:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.977+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8010ab90 con 0x7f1e800602b0 2022-02-02T14:26:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.977+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e80045ad0 con 0x7f1e800602b0 2022-02-02T14:26:50.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.978+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1e7401d420 con 0x7f1e800602b0 2022-02-02T14:26:50.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.978+0000 7f1e71ffb700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 0x7f1e6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:50.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.978+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1e740838e0 con 0x7f1e800602b0 2022-02-02T14:26:50.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.978+0000 7f1e84e05700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 0x7f1e6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.979+0000 7f1e84e05700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 0x7f1e6c067290 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f1e7c004fa0 tx=0x7f1e7c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:50.984+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1e740553c0 con 0x7f1e800602b0 2022-02-02T14:26:51.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.229+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1e800feea0 con 0x7f1e800602b0 2022-02-02T14:26:51.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.229+0000 7f1e71ffb700 1 -- 172.21.15.33:0/1016084324 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f1e74054fb0 con 0x7f1e800602b0 2022-02-02T14:26:51.230 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:26:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:26:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:26:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:26:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:26:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:26:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:26:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:26:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:26:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:26:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:26:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:26:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:26:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:26:51.235 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:26:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 msgr2=0x7f1e6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 0x7f1e6c067290 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f1e7c004fa0 tx=0x7f1e7c009040).stop 2022-02-02T14:26:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 msgr2=0x7f1e80109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 0x7f1e80109110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f1e74000c00 tx=0x7f1e74009b30).stop 2022-02-02T14:26:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 shutdown_connections 2022-02-02T14:26:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1e6c064dd0 0x7f1e6c067290 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e800602b0 0x7f1e80109110 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 --2- 172.21.15.33:0/1016084324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e800f9880 0x7f1e80109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 >> 172.21.15.33:0/1016084324 conn(0x7f1e800f0d40 msgr2=0x7f1e800f5190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:51.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 shutdown_connections 2022-02-02T14:26:51.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.232+0000 7f1e8786a700 1 -- 172.21.15.33:0/1016084324 wait complete. 2022-02-02T14:26:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 -- 172.21.15.33:0/3025622412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f7980 msgr2=0x7fe6b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/3025622412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f7980 0x7fe6b40f7de0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fe6a8004660 tx=0x7fe6a8009b30).stop 2022-02-02T14:26:51.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 -- 172.21.15.33:0/3025622412 shutdown_connections 2022-02-02T14:26:51.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/3025622412 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f7980 0x7fe6b40f7de0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/3025622412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f66e0 0x7fe6b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 -- 172.21.15.33:0/3025622412 >> 172.21.15.33:0/3025622412 conn(0x7fe6b40f1e40 msgr2=0x7fe6b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:51.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 -- 172.21.15.33:0/3025622412 shutdown_connections 2022-02-02T14:26:51.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.333+0000 7fe6bbac2700 1 -- 172.21.15.33:0/3025622412 wait complete. 2022-02-02T14:26:51.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 Processor -- start 2022-02-02T14:26:51.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 -- start start 2022-02-02T14:26:51.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:51.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f7980 0x7fe6b4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:51.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b4107a00 con 0x7fe6b40f66e0 2022-02-02T14:26:51.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6bbac2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b4107b40 con 0x7fe6b40f7980 2022-02-02T14:26:51.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6b985e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:51.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6b985e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32964/0 (socket says 172.21.15.33:32964) 2022-02-02T14:26:51.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6b985e700 1 -- 172.21.15.33:0/414373298 learned_addr learned my addr 172.21.15.33:0/414373298 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:26:51.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.334+0000 7fe6b905d700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f7980 0x7fe6b4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:51.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6b985e700 1 -- 172.21.15.33:0/414373298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f7980 msgr2=0x7fe6b4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6b985e700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f7980 0x7fe6b4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6b985e700 1 -- 172.21.15.33:0/414373298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a8005040 con 0x7fe6b40f66e0 2022-02-02T14:26:51.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6b985e700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fe6b0002700 tx=0x7fe6b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:51.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b00079c0 con 0x7fe6b40f66e0 2022-02-02T14:26:51.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b41084e0 con 0x7fe6b40f66e0 2022-02-02T14:26:51.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe6b000f040 con 0x7fe6b40f66e0 2022-02-02T14:26:51.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6b0014860 con 0x7fe6b40f66e0 2022-02-02T14:26:51.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.335+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b4108aa0 con 0x7fe6b40f66e0 2022-02-02T14:26:51.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.336+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b4045ad0 con 0x7fe6b40f66e0 2022-02-02T14:26:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.336+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe6b001b060 con 0x7fe6b40f66e0 2022-02-02T14:26:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.337+0000 7fe6a67fc700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 0x7fe6a0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:26:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.337+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe6b0081930 con 0x7fe6b40f66e0 2022-02-02T14:26:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.337+0000 7fe6b905d700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 0x7fe6a0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:26:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.337+0000 7fe6b905d700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 0x7fe6a0067270 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fe6a8004e30 tx=0x7fe6a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:26:51.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.341+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe6b0053410 con 0x7fe6b40f66e0 2022-02-02T14:26:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.553+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6b40ff020 con 0x7fe6b40f66e0 2022-02-02T14:26:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.554+0000 7fe6a67fc700 1 -- 172.21.15.33:0/414373298 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe6b0019070 con 0x7fe6b40f66e0 2022-02-02T14:26:51.555 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:26:51.555 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:26:51.555 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:26:51.556 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:26:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:51.556 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:26:51.556 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:26:51.557 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:26:51.557 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:26:51.557 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:26:51.557 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:26:51.558 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:26:51.558 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:26:51.558 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:26:51.558 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:26:51.559 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:26:51.559 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:26:51.559 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:26:51.559 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:26:51.559 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:26:51.560 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:26:51.560 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:26:51.560 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:26:51.560 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:26:51.561 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:26:51.561 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:26:51.561 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:26:51.561 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:26:51.561 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:26:51.562 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:26:51.562 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:26:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:51.567 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:26:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:26:51.568 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:51.568 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:51.569 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:51.569 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:26:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 msgr2=0x7fe6a0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 0x7fe6a0067270 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fe6a8004e30 tx=0x7fe6a8009b30).stop 2022-02-02T14:26:51.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 msgr2=0x7fe6b4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:26:51.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7fe6b0002700 tx=0x7fe6b0009d80).stop 2022-02-02T14:26:51.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 shutdown_connections 2022-02-02T14:26:51.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6a0064db0 0x7fe6a0067270 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6b40f66e0 0x7fe6b4106f60 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 --2- 172.21.15.33:0/414373298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6b40f7980 0x7fe6b4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:26:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 >> 172.21.15.33:0/414373298 conn(0x7fe6b40f1e40 msgr2=0x7fe6b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:26:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 shutdown_connections 2022-02-02T14:26:51.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:26:51.556+0000 7fe6bbac2700 1 -- 172.21.15.33:0/414373298 wait complete. 2022-02-02T14:26:51.573 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:26:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:52 smithi033 ceph-mon[101165]: from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:52 smithi033 ceph-mon[101165]: from='client.35562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:52 smithi033 ceph-mon[101165]: pgmap v1444: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1016084324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:26:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/414373298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:26:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:52 smithi037 ceph-mon[69017]: from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:52 smithi037 ceph-mon[69017]: from='client.35562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:26:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:52 smithi037 ceph-mon[69017]: pgmap v1444: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1016084324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:26:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/414373298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:26:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:54 smithi033 ceph-mon[101165]: pgmap v1445: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:54 smithi037 ceph-mon[69017]: pgmap v1445: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:26:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:26:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:26:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:26:56.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:56 smithi033 ceph-mon[101165]: pgmap v1446: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:56 smithi037 ceph-mon[69017]: pgmap v1446: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:58.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:26:58 smithi033 ceph-mon[101165]: pgmap v1447: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:26:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:26:58 smithi037 ceph-mon[69017]: pgmap v1447: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:00 smithi033 ceph-mon[101165]: pgmap v1448: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:00 smithi037 ceph-mon[69017]: pgmap v1448: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:02 smithi033 ceph-mon[101165]: pgmap v1449: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:02 smithi037 ceph-mon[69017]: pgmap v1449: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:04.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:04 smithi033 ceph-mon[101165]: pgmap v1450: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:04 smithi037 ceph-mon[69017]: pgmap v1450: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:06.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:06 smithi033 ceph-mon[101165]: pgmap v1451: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:06 smithi037 ceph-mon[69017]: pgmap v1451: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:08.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:08 smithi033 ceph-mon[101165]: pgmap v1452: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:08.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:08 smithi037 ceph-mon[69017]: pgmap v1452: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:10.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:10 smithi033 ceph-mon[101165]: pgmap v1453: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:10 smithi037 ceph-mon[69017]: pgmap v1453: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:12 smithi037 ceph-mon[69017]: pgmap v1454: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:12 smithi033 ceph-mon[101165]: pgmap v1454: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:14 smithi037 ceph-mon[69017]: pgmap v1455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:14 smithi033 ceph-mon[101165]: pgmap v1455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:16 smithi037 ceph-mon[69017]: pgmap v1456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:16 smithi033 ceph-mon[101165]: pgmap v1456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:18 smithi037 ceph-mon[69017]: pgmap v1457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:18 smithi033 ceph-mon[101165]: pgmap v1457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:20 smithi037 ceph-mon[69017]: pgmap v1458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:20 smithi033 ceph-mon[101165]: pgmap v1458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:21.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 -- 172.21.15.33:0/2110871847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 msgr2=0x7f90100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 --2- 172.21.15.33:0/2110871847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f90100f6cc0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f9000004660 tx=0x7f9000009b30).stop 2022-02-02T14:27:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 -- 172.21.15.33:0/2110871847 shutdown_connections 2022-02-02T14:27:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 --2- 172.21.15.33:0/2110871847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f90100f6cc0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 --2- 172.21.15.33:0/2110871847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 0x7f90100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.671+0000 7f9017737700 1 -- 172.21.15.33:0/2110871847 >> 172.21.15.33:0/2110871847 conn(0x7f90100f0d40 msgr2=0x7f90100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:21.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 -- 172.21.15.33:0/2110871847 shutdown_connections 2022-02-02T14:27:21.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 -- 172.21.15.33:0/2110871847 wait complete. 2022-02-02T14:27:21.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 Processor -- start 2022-02-02T14:27:21.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 -- start start 2022-02-02T14:27:21.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 0x7f901010bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100602b0 con 0x7f90100f6860 2022-02-02T14:27:21.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.672+0000 7f9017737700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100603f0 con 0x7f90100f55c0 2022-02-02T14:27:21.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:21.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32976/0 (socket says 172.21.15.33:32976) 2022-02-02T14:27:21.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 -- 172.21.15.33:0/1044504633 learned_addr learned my addr 172.21.15.33:0/1044504633 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:21.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f90154d3700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 0x7f901010bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:21.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 -- 172.21.15.33:0/1044504633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 msgr2=0x7f901010bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 0x7f901010bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 -- 172.21.15.33:0/1044504633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9000005040 con 0x7f90100f6860 2022-02-02T14:27:21.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9014cd2700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f9000002040 tx=0x7f900000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:21.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9000019070 con 0x7f90100f6860 2022-02-02T14:27:21.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901010e9d0 con 0x7f90100f6860 2022-02-02T14:27:21.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9000007e70 con 0x7f90100f6860 2022-02-02T14:27:21.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.673+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9000014db0 con 0x7f90100f6860 2022-02-02T14:27:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.674+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901010eda0 con 0x7f90100f6860 2022-02-02T14:27:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.675+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9010045ad0 con 0x7f90100f6860 2022-02-02T14:27:21.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.675+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9000025070 con 0x7f90100f6860 2022-02-02T14:27:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.676+0000 7f9005ffb700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 0x7f8ffc067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.676+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9000082a10 con 0x7f90100f6860 2022-02-02T14:27:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.676+0000 7f90154d3700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 0x7f8ffc067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.676+0000 7f90154d3700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 0x7f8ffc067210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f9010060040 tx=0x7f900c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:21.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.680+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9000050ac0 con 0x7f90100f6860 2022-02-02T14:27:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.868+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9010057f10 con 0x7f8ffc064d50 2022-02-02T14:27:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.870+0000 7f9005ffb700 1 -- 172.21.15.33:0/1044504633 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9010057f10 con 0x7f8ffc064d50 2022-02-02T14:27:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 msgr2=0x7f8ffc067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 0x7f8ffc067210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f9010060040 tx=0x7f900c00b040).stop 2022-02-02T14:27:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 msgr2=0x7f901010e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f9000002040 tx=0x7f900000b040).stop 2022-02-02T14:27:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 shutdown_connections 2022-02-02T14:27:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ffc064d50 0x7f8ffc067210 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90100f55c0 0x7f901010bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 --2- 172.21.15.33:0/1044504633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90100f6860 0x7f901010e4e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 >> 172.21.15.33:0/1044504633 conn(0x7f90100f0d40 msgr2=0x7f90100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:21.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 shutdown_connections 2022-02-02T14:27:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.872+0000 7f9017737700 1 -- 172.21.15.33:0/1044504633 wait complete. 2022-02-02T14:27:21.881 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:27:21.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 -- 172.21.15.33:0/1126924276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 msgr2=0x7f00b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 --2- 172.21.15.33:0/1126924276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b40f59e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f00b0004660 tx=0x7f00b0009b30).stop 2022-02-02T14:27:21.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 -- 172.21.15.33:0/1126924276 shutdown_connections 2022-02-02T14:27:21.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 --2- 172.21.15.33:0/1126924276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b40f6860 0x7f00b40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 --2- 172.21.15.33:0/1126924276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b40f59e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:21.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 -- 172.21.15.33:0/1126924276 >> 172.21.15.33:0/1126924276 conn(0x7f00b40f0d40 msgr2=0x7f00b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:21.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 -- 172.21.15.33:0/1126924276 shutdown_connections 2022-02-02T14:27:21.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.972+0000 7f00bbb58700 1 -- 172.21.15.33:0/1126924276 wait complete. 2022-02-02T14:27:21.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 Processor -- start 2022-02-02T14:27:21.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 -- start start 2022-02-02T14:27:21.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b40f6860 0x7f00b410c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b40603e0 con 0x7f00b40f55c0 2022-02-02T14:27:21.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.973+0000 7f00bbb58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b4060520 con 0x7f00b40f6860 2022-02-02T14:27:21.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:21.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32984/0 (socket says 172.21.15.33:32984) 2022-02-02T14:27:21.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 -- 172.21.15.33:0/167310541 learned_addr learned my addr 172.21.15.33:0/167310541 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:21.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 -- 172.21.15.33:0/167310541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b40f6860 msgr2=0x7f00b410c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b40f6860 0x7f00b410c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:27:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 -- 172.21.15.33:0/167310541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0005040 con 0x7f00b40f55c0 2022-02-02T14:27:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.974+0000 7f00b98f4700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f00b0013a70 tx=0x7f00b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:21.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.975+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b0018070 con 0x7f00b40f55c0 2022-02-02T14:27:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.975+0000 7f00bbb58700 1 -- 172.21.15.33:0/167310541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b410c650 con 0x7f00b40f55c0 2022-02-02T14:27:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.975+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00b00097d0 con 0x7f00b40f55c0 2022-02-02T14:27:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.975+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00b001c3c0 con 0x7f00b40f55c0 2022-02-02T14:27:21.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.975+0000 7f00bbb58700 1 -- 172.21.15.33:0/167310541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b410cbb0 con 0x7f00b40f55c0 2022-02-02T14:27:21.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.976+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0090004fa0 con 0x7f00b40f55c0 2022-02-02T14:27:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.977+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f00b001c680 con 0x7f00b40f55c0 2022-02-02T14:27:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.977+0000 7f00aa7fc700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 0x7f00a006b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:21.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.977+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f00b00837b0 con 0x7f00b40f55c0 2022-02-02T14:27:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.977+0000 7f00b90f3700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 0x7f00a006b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.977+0000 7f00b90f3700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 0x7f00a006b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f00a4004a10 tx=0x7f00a40099e0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:21.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:21.981+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00b0051940 con 0x7f00b40f55c0 2022-02-02T14:27:22.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.163+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0090000bc0 con 0x7f00a00691e0 2022-02-02T14:27:22.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.178+0000 7f00aa7fc700 1 -- 172.21.15.33:0/167310541 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0090000bc0 con 0x7f00a00691e0 2022-02-02T14:27:22.179 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:27:22.179 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (52m) 14m ago 53m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:27:22.179 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (45m) 14m ago 53m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:27:22.180 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (45m) 14m ago 53m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:27:22.180 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (52m) 14m ago 53m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:27:22.181 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (46m) 14m ago 49m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:27:22.181 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (46m) 14m ago 49m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:27:22.182 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (47m) 14m ago 49m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:27:22.182 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (49m) 14m ago 49m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:27:22.182 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (47m) 14m ago 54m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:27:22.183 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (46m) 14m ago 53m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:27:22.184 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (46m) 14m ago 55m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:27:22.184 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (46m) 14m ago 53m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:27:22.184 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (53m) 14m ago 53m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:27:22.184 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (52m) 14m ago 52m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:27:22.185 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 14m ago 52m - 4096M 2022-02-02T14:27:22.185 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (52m) 14m ago 52m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:27:22.185 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (51m) 14m ago 51m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:27:22.186 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (51m) 14m ago 51m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:27:22.186 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (51m) 14m ago 51m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:27:22.186 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (50m) 14m ago 50m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:27:22.187 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (52m) 14m ago 53m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:27:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 msgr2=0x7f00a006b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 0x7f00a006b6a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f00a4004a10 tx=0x7f00a40099e0).stop 2022-02-02T14:27:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 msgr2=0x7f00b4109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f00b0013a70 tx=0x7f00b0009b30).stop 2022-02-02T14:27:22.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 shutdown_connections 2022-02-02T14:27:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00a00691e0 0x7f00a006b6a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00b40f55c0 0x7f00b4109c00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 --2- 172.21.15.33:0/167310541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00b40f6860 0x7f00b410c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:27:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 >> 172.21.15.33:0/167310541 conn(0x7f00b40f0d40 msgr2=0x7f00b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 shutdown_connections 2022-02-02T14:27:22.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.180+0000 7f0097fff700 1 -- 172.21.15.33:0/167310541 wait complete. 2022-02-02T14:27:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 -- 172.21.15.33:0/3760986017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 msgr2=0x7f5c440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/3760986017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c440f6b00 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f5c40004660 tx=0x7f5c40009b30).stop 2022-02-02T14:27:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 -- 172.21.15.33:0/3760986017 shutdown_connections 2022-02-02T14:27:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/3760986017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 0x7f5c440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/3760986017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c440f6b00 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 -- 172.21.15.33:0/3760986017 >> 172.21.15.33:0/3760986017 conn(0x7f5c440f1e40 msgr2=0x7f5c440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 -- 172.21.15.33:0/3760986017 shutdown_connections 2022-02-02T14:27:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.280+0000 7f5c4c63c700 1 -- 172.21.15.33:0/3760986017 wait complete. 2022-02-02T14:27:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 Processor -- start 2022-02-02T14:27:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 -- start start 2022-02-02T14:27:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 0x7f5c44069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4406a380 con 0x7f5c440f66e0 2022-02-02T14:27:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4c63c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4406a4c0 con 0x7f5c440f7980 2022-02-02T14:27:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4a3d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4a3d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32994/0 (socket says 172.21.15.33:32994) 2022-02-02T14:27:22.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c4a3d8700 1 -- 172.21.15.33:0/496882935 learned_addr learned my addr 172.21.15.33:0/496882935 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.281+0000 7f5c49bd7700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 0x7f5c44069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4a3d8700 1 -- 172.21.15.33:0/496882935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 msgr2=0x7f5c44069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4a3d8700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 0x7f5c44069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4a3d8700 1 -- 172.21.15.33:0/496882935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40005040 con 0x7f5c440f66e0 2022-02-02T14:27:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4a3d8700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f5c40013a70 tx=0x7f5c40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c40018070 con 0x7f5c440f66e0 2022-02-02T14:27:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4406a740 con 0x7f5c440f66e0 2022-02-02T14:27:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c400097d0 con 0x7f5c440f66e0 2022-02-02T14:27:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c4001de80 con 0x7f5c440f66e0 2022-02-02T14:27:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.282+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c4406aca0 con 0x7f5c440f66e0 2022-02-02T14:27:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.283+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c44045ad0 con 0x7f5c440f66e0 2022-02-02T14:27:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.284+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c40007ba0 con 0x7f5c440f66e0 2022-02-02T14:27:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.284+0000 7f5c36ffd700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 0x7f5c30067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.284+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5c400836b0 con 0x7f5c440f66e0 2022-02-02T14:27:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.284+0000 7f5c49bd7700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 0x7f5c30067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.284+0000 7f5c49bd7700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 0x7f5c30067290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5c38004e20 tx=0x7f5c3800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:22.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.288+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c40051760 con 0x7f5c440f66e0 2022-02-02T14:27:22.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.531+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c440586e0 con 0x7f5c440f66e0 2022-02-02T14:27:22.531 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:22 smithi033 ceph-mon[101165]: pgmap v1459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:22.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.532+0000 7f5c36ffd700 1 -- 172.21.15.33:0/496882935 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5c40054d80 con 0x7f5c440f66e0 2022-02-02T14:27:22.532 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:27:22.532 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:27:22.533 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:27:22.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:22.533 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:27:22.533 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:27:22.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:22.534 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:27:22.534 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:27:22.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:22.534 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:27:22.535 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:27:22.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:22.535 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:27:22.535 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:27:22.536 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:27:22.536 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:27:22.536 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:27:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.533+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 msgr2=0x7f5c30067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.533+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 0x7f5c30067290 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f5c38004e20 tx=0x7f5c3800b040).stop 2022-02-02T14:27:22.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.533+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 msgr2=0x7f5c4406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.533+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7f5c40013a70 tx=0x7f5c40009b30).stop 2022-02-02T14:27:22.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 shutdown_connections 2022-02-02T14:27:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c30064dd0 0x7f5c30067290 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440f66e0 0x7f5c4406b9a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 --2- 172.21.15.33:0/496882935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c440f7980 0x7f5c44069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 >> 172.21.15.33:0/496882935 conn(0x7f5c440f1e40 msgr2=0x7f5c440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 shutdown_connections 2022-02-02T14:27:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.534+0000 7f5c4c63c700 1 -- 172.21.15.33:0/496882935 wait complete. 2022-02-02T14:27:22.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:22 smithi037 ceph-mon[69017]: pgmap v1459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 -- 172.21.15.33:0/2150376833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 msgr2=0x7f076c0f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 --2- 172.21.15.33:0/2150376833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c0f9170 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f075c004660 tx=0x7f075c009b30).stop 2022-02-02T14:27:22.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 -- 172.21.15.33:0/2150376833 shutdown_connections 2022-02-02T14:27:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 --2- 172.21.15.33:0/2150376833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c0fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 --2- 172.21.15.33:0/2150376833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c0f9170 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.634+0000 7f0771190700 1 -- 172.21.15.33:0/2150376833 >> 172.21.15.33:0/2150376833 conn(0x7f076c0f0b90 msgr2=0x7f076c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 -- 172.21.15.33:0/2150376833 shutdown_connections 2022-02-02T14:27:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 -- 172.21.15.33:0/2150376833 wait complete. 2022-02-02T14:27:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 Processor -- start 2022-02-02T14:27:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 -- start start 2022-02-02T14:27:22.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1055e0 con 0x7f076c0602b0 2022-02-02T14:27:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.635+0000 7f0771190700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c105720 con 0x7f076c0f96f0 2022-02-02T14:27:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33002/0 (socket says 172.21.15.33:33002) 2022-02-02T14:27:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 -- 172.21.15.33:0/1015511084 learned_addr learned my addr 172.21.15.33:0/1015511084 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076b7fe700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 -- 172.21.15.33:0/1015511084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 msgr2=0x7f076c104fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c104fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 -- 172.21.15.33:0/1015511084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c005040 con 0x7f076c0602b0 2022-02-02T14:27:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076b7fe700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:27:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f076bfff700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f075c009990 tx=0x7f075c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:22.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f075c018070 con 0x7f076c0602b0 2022-02-02T14:27:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f075c007ca0 con 0x7f076c0602b0 2022-02-02T14:27:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c106030 con 0x7f076c0602b0 2022-02-02T14:27:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f075c01c620 con 0x7f076c0602b0 2022-02-02T14:27:22.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.636+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c106590 con 0x7f076c0602b0 2022-02-02T14:27:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.637+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c045ad0 con 0x7f076c0602b0 2022-02-02T14:27:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.638+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f075c01d960 con 0x7f076c0602b0 2022-02-02T14:27:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.638+0000 7f0768ff9700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 0x7f07540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:22.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.638+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f075c083820 con 0x7f076c0602b0 2022-02-02T14:27:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.638+0000 7f076b7fe700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 0x7f07540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.639+0000 7f076b7fe700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 0x7f07540672e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f076c060080 tx=0x7f0760009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:22.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.642+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f075c051a40 con 0x7f076c0602b0 2022-02-02T14:27:22.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.851+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f076c106c90 con 0x7f076c0602b0 2022-02-02T14:27:22.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.852+0000 7f0768ff9700 1 -- 172.21.15.33:0/1015511084 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f075c055060 con 0x7f076c0602b0 2022-02-02T14:27:22.852 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:27:22.852 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:27:22.853 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:27:22.853 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:27:22.854 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:22.854 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:27:22.854 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:27:22.854 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:27:22.855 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:27:22.855 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:27:22.855 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:27:22.855 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:27:22.857 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:27:22.857 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:27:22.858 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:27:22.858 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:27:22.858 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:27:22.858 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:27:22.859 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:27:22.859 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:27:22.859 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:27:22.859 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:27:22.859 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:27:22.860 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:27:22.860 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:27:22.860 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:27:22.860 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:27:22.861 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:27:22.861 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:27:22.861 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:27:22.861 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:27:22.861 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:22.862 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:27:22.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:22.862 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:22.863 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:22.863 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:22.864 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 msgr2=0x7f07540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 0x7f07540672e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f076c060080 tx=0x7f0760009040).stop 2022-02-02T14:27:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 msgr2=0x7f076c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:22.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f075c009990 tx=0x7f075c009b30).stop 2022-02-02T14:27:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 shutdown_connections 2022-02-02T14:27:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0754064e20 0x7f07540672e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f076c0602b0 0x7f076c104af0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 --2- 172.21.15.33:0/1015511084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f076c0f96f0 0x7f076c104fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.854+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 >> 172.21.15.33:0/1015511084 conn(0x7f076c0f0b90 msgr2=0x7f076c0f5020 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.855+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 shutdown_connections 2022-02-02T14:27:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:22.855+0000 7f0771190700 1 -- 172.21.15.33:0/1015511084 wait complete. 2022-02-02T14:27:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:27:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:23 smithi037 ceph-mon[69017]: from='client.35574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:23 smithi037 ceph-mon[69017]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:23.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/496882935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:27:23.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1015511084' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:27:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:23 smithi033 ceph-mon[101165]: from='client.35574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:23 smithi033 ceph-mon[101165]: from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/496882935' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:27:23.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1015511084' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:27:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:24 smithi037 ceph-mon[69017]: pgmap v1460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:24 smithi033 ceph-mon[101165]: pgmap v1460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:26 smithi037 ceph-mon[69017]: pgmap v1461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:26 smithi033 ceph-mon[101165]: pgmap v1461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:28 smithi037 ceph-mon[69017]: pgmap v1462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:28 smithi033 ceph-mon[101165]: pgmap v1462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:30 smithi037 ceph-mon[69017]: pgmap v1463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:30 smithi033 ceph-mon[101165]: pgmap v1463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:32 smithi037 ceph-mon[69017]: pgmap v1464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:32 smithi033 ceph-mon[101165]: pgmap v1464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:34 smithi037 ceph-mon[69017]: pgmap v1465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:34 smithi033 ceph-mon[101165]: pgmap v1465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:36 smithi037 ceph-mon[69017]: pgmap v1466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:36 smithi033 ceph-mon[101165]: pgmap v1466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:38 smithi037 ceph-mon[69017]: pgmap v1467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:38 smithi033 ceph-mon[101165]: pgmap v1467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:40 smithi037 ceph-mon[69017]: pgmap v1468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:40 smithi033 ceph-mon[101165]: pgmap v1468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:42 smithi037 ceph-mon[69017]: pgmap v1469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:42 smithi033 ceph-mon[101165]: pgmap v1469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:44 smithi037 ceph-mon[69017]: pgmap v1470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:44 smithi033 ceph-mon[101165]: pgmap v1470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:46.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:46 smithi033 ceph-mon[101165]: pgmap v1471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:46 smithi037 ceph-mon[69017]: pgmap v1471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:48 smithi033 ceph-mon[101165]: pgmap v1472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:48 smithi037 ceph-mon[69017]: pgmap v1472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:50 smithi033 ceph-mon[101165]: pgmap v1473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:50 smithi037 ceph-mon[69017]: pgmap v1473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:52 smithi033 ceph-mon[101165]: pgmap v1474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:52 smithi037 ceph-mon[69017]: pgmap v1474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:52.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.969+0000 7fd3be7dd700 1 -- 172.21.15.33:0/37469221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 msgr2=0x7fd3b80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:52.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.969+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/37469221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b80f59e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fd3a8004660 tx=0x7fd3a8009b30).stop 2022-02-02T14:27:52.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.969+0000 7fd3be7dd700 1 -- 172.21.15.33:0/37469221 shutdown_connections 2022-02-02T14:27:52.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.969+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/37469221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 0x7fd3b80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:52.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/37469221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b80f59e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:52.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 -- 172.21.15.33:0/37469221 >> 172.21.15.33:0/37469221 conn(0x7fd3b80f0d40 msgr2=0x7fd3b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:52.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 -- 172.21.15.33:0/37469221 shutdown_connections 2022-02-02T14:27:52.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 -- 172.21.15.33:0/37469221 wait complete. 2022-02-02T14:27:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 Processor -- start 2022-02-02T14:27:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.970+0000 7fd3be7dd700 1 -- start start 2022-02-02T14:27:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3be7dd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3be7dd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 0x7fd3b810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3be7dd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80603e0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3be7dd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8060520 con 0x7fd3b80f6860 2022-02-02T14:27:52.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:52.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33010/0 (socket says 172.21.15.33:33010) 2022-02-02T14:27:52.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 -- 172.21.15.33:0/108440592 learned_addr learned my addr 172.21.15.33:0/108440592 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:52.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b77fe700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 0x7fd3b810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:52.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 -- 172.21.15.33:0/108440592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 msgr2=0x7fd3b810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 0x7fd3b810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 -- 172.21.15.33:0/108440592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8005040 con 0x7fd3b80f55c0 2022-02-02T14:27:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b7fff700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd3a8013a70 tx=0x7fd3a8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.971+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a8018070 con 0x7fd3b80f55c0 2022-02-02T14:27:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.972+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd3a80097d0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.972+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b810c6c0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.972+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a801de80 con 0x7fd3b80f55c0 2022-02-02T14:27:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.972+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b810cc20 con 0x7fd3b80f55c0 2022-02-02T14:27:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.973+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b8045ad0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.973+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd3a8007ba0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.974+0000 7fd3b4ff9700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 0x7fd3a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:52.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.974+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd3a80836b0 con 0x7fd3b80f55c0 2022-02-02T14:27:52.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.974+0000 7fd3b77fe700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 0x7fd3a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:52.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.974+0000 7fd3b77fe700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 0x7fd3a0067290 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fd3ac004c40 tx=0x7fd3ac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:52.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:52.979+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd3a8051760 con 0x7fd3b80f55c0 2022-02-02T14:27:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.167+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b8057f10 con 0x7fd3a0064dd0 2022-02-02T14:27:53.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.169+0000 7fd3b4ff9700 1 -- 172.21.15.33:0/108440592 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd3b8057f10 con 0x7fd3a0064dd0 2022-02-02T14:27:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.170+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 msgr2=0x7fd3a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.170+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 0x7fd3a0067290 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fd3ac004c40 tx=0x7fd3ac00b040).stop 2022-02-02T14:27:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 msgr2=0x7fd3b8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fd3a8013a70 tx=0x7fd3a8009b30).stop 2022-02-02T14:27:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 shutdown_connections 2022-02-02T14:27:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd3a0064dd0 0x7fd3a0067290 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3b80f55c0 0x7fd3b8109c70 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 --2- 172.21.15.33:0/108440592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b80f6860 0x7fd3b810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 >> 172.21.15.33:0/108440592 conn(0x7fd3b80f0d40 msgr2=0x7fd3b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 shutdown_connections 2022-02-02T14:27:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.171+0000 7fd3be7dd700 1 -- 172.21.15.33:0/108440592 wait complete. 2022-02-02T14:27:53.181 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:27:53.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 -- 172.21.15.33:0/2838474746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f6530 msgr2=0x7f3b7c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 --2- 172.21.15.33:0/2838474746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c0f6950 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f3b78004660 tx=0x7f3b78009b30).stop 2022-02-02T14:27:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 -- 172.21.15.33:0/2838474746 shutdown_connections 2022-02-02T14:27:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 --2- 172.21.15.33:0/2838474746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 --2- 172.21.15.33:0/2838474746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c0f6950 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 -- 172.21.15.33:0/2838474746 >> 172.21.15.33:0/2838474746 conn(0x7f3b7c0f1c90 msgr2=0x7f3b7c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.271+0000 7f3b827d3700 1 -- 172.21.15.33:0/2838474746 shutdown_connections 2022-02-02T14:27:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 -- 172.21.15.33:0/2838474746 wait complete. 2022-02-02T14:27:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 Processor -- start 2022-02-02T14:27:53.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 -- start start 2022-02-02T14:27:53.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c1078f0 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.272+0000 7f3b827d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c108100 con 0x7f3b7c0f6530 2022-02-02T14:27:53.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33022/0 (socket says 172.21.15.33:33022) 2022-02-02T14:27:53.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 -- 172.21.15.33:0/3564211403 learned_addr learned my addr 172.21.15.33:0/3564211403 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:53.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b817d1700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 -- 172.21.15.33:0/3564211403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f6530 msgr2=0x7f3b7c106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 -- 172.21.15.33:0/3564211403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78005040 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b80fd0700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f3b6c00c530 tx=0x7f3b6c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c00f650 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b6c00fc60 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c108380 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.273+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b6c012c20 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.274+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c108940 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.274+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5c004fa0 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.275+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b6c010070 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.275+0000 7f3b71ffb700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 0x7f3b680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.275+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3b6c0816f0 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.275+0000 7f3b817d1700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 0x7f3b680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.276+0000 7f3b817d1700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 0x7f3b680672e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f3b78013690 tx=0x7f3b78009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.280+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b6c04f880 con 0x7f3b7c0f77d0 2022-02-02T14:27:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.461+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b5c000bc0 con 0x7f3b68064e20 2022-02-02T14:27:53.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.476+0000 7f3b71ffb700 1 -- 172.21.15.33:0/3564211403 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3b5c000bc0 con 0x7f3b68064e20 2022-02-02T14:27:53.477 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:27:53.478 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (53m) 15m ago 54m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:27:53.478 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (46m) 15m ago 54m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:27:53.478 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (46m) 15m ago 53m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:27:53.478 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (53m) 15m ago 53m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:27:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (46m) 15m ago 50m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:27:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (47m) 15m ago 50m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:27:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (48m) 15m ago 50m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:27:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (50m) 15m ago 50m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:27:53.480 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (47m) 15m ago 55m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:27:53.480 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (47m) 15m ago 53m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:27:53.480 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (47m) 15m ago 55m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:27:53.480 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (46m) 15m ago 53m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:27:53.480 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (53m) 15m ago 53m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:27:53.481 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (53m) 15m ago 53m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:27:53.481 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 15m ago 52m - 4096M 2022-02-02T14:27:53.481 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (52m) 15m ago 52m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:27:53.481 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (52m) 15m ago 52m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:27:53.482 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (52m) 15m ago 52m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:27:53.482 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (51m) 15m ago 51m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:27:53.482 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (51m) 15m ago 51m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:27:53.482 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (52m) 15m ago 53m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:27:53.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 msgr2=0x7f3b680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 0x7f3b680672e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f3b78013690 tx=0x7f3b78009b30).stop 2022-02-02T14:27:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 msgr2=0x7f3b7c1072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f3b6c00c530 tx=0x7f3b6c007e20).stop 2022-02-02T14:27:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 shutdown_connections 2022-02-02T14:27:53.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b68064e20 0x7f3b680672e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b7c0f6530 0x7f3b7c106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 --2- 172.21.15.33:0/3564211403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7c0f77d0 0x7f3b7c1072f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.478+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 >> 172.21.15.33:0/3564211403 conn(0x7f3b7c0f1c90 msgr2=0x7f3b7c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.479+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 shutdown_connections 2022-02-02T14:27:53.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.479+0000 7f3b827d3700 1 -- 172.21.15.33:0/3564211403 wait complete. 2022-02-02T14:27:53.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 -- 172.21.15.33:0/279984154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06b9c0 msgr2=0x7fb39c069ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 --2- 172.21.15.33:0/279984154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06b9c0 0x7fb39c069ec0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fb38c004660 tx=0x7fb38c009b30).stop 2022-02-02T14:27:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 -- 172.21.15.33:0/279984154 shutdown_connections 2022-02-02T14:27:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 --2- 172.21.15.33:0/279984154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06a3b0 0x7fb39c06a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 --2- 172.21.15.33:0/279984154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06b9c0 0x7fb39c069ec0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 -- 172.21.15.33:0/279984154 >> 172.21.15.33:0/279984154 conn(0x7fb39c0f1e40 msgr2=0x7fb39c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 -- 172.21.15.33:0/279984154 shutdown_connections 2022-02-02T14:27:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.579+0000 7fb3a093f700 1 -- 172.21.15.33:0/279984154 wait complete. 2022-02-02T14:27:53.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 Processor -- start 2022-02-02T14:27:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 -- start start 2022-02-02T14:27:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06b9c0 0x7fb39c109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c109c20 con 0x7fb39c06a3b0 2022-02-02T14:27:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb3a093f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb39c109d60 con 0x7fb39c06b9c0 2022-02-02T14:27:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb39a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb39a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33030/0 (socket says 172.21.15.33:33030) 2022-02-02T14:27:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb39a59c700 1 -- 172.21.15.33:0/3731711838 learned_addr learned my addr 172.21.15.33:0/3731711838 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.580+0000 7fb399d9b700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06b9c0 0x7fb39c109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb39a59c700 1 -- 172.21.15.33:0/3731711838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06b9c0 msgr2=0x7fb39c109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb39a59c700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06b9c0 0x7fb39c109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb39a59c700 1 -- 172.21.15.33:0/3731711838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb38c005040 con 0x7fb39c06a3b0 2022-02-02T14:27:53.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb39a59c700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb38c009990 tx=0x7fb38c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38c018070 con 0x7fb39c06a3b0 2022-02-02T14:27:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb38c007ba0 con 0x7fb39c06a3b0 2022-02-02T14:27:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb39c10a6a0 con 0x7fb39c06a3b0 2022-02-02T14:27:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb39c10ac00 con 0x7fb39c06a3b0 2022-02-02T14:27:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.581+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb38c01c3c0 con 0x7fb39c06a3b0 2022-02-02T14:27:53.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.582+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb39c045ad0 con 0x7fb39c06a3b0 2022-02-02T14:27:53.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.583+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb38c01d420 con 0x7fb39c06a3b0 2022-02-02T14:27:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.583+0000 7fb392ffd700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 0x7fb388067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.583+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb38c0836f0 con 0x7fb39c06a3b0 2022-02-02T14:27:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.583+0000 7fb399d9b700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 0x7fb388067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.584+0000 7fb399d9b700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 0x7fb388067290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fb384004c40 tx=0x7fb38400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.587+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb38c055290 con 0x7fb39c06a3b0 2022-02-02T14:27:53.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.831+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb39c101160 con 0x7fb39c06a3b0 2022-02-02T14:27:53.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.832+0000 7fb392ffd700 1 -- 172.21.15.33:0/3731711838 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb38c054e80 con 0x7fb39c06a3b0 2022-02-02T14:27:53.832 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:27:53.832 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:27:53.832 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:27:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:27:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:27:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:27:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:27:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:27:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:27:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:27:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:27:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:27:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:27:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:27:53.836 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:27:53.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 msgr2=0x7fb388067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 0x7fb388067290 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7fb384004c40 tx=0x7fb38400b040).stop 2022-02-02T14:27:53.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 msgr2=0x7fb39c109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb38c009990 tx=0x7fb38c009b30).stop 2022-02-02T14:27:53.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 shutdown_connections 2022-02-02T14:27:53.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb388064dd0 0x7fb388067290 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb39c06a3b0 0x7fb39c109180 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 --2- 172.21.15.33:0/3731711838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb39c06b9c0 0x7fb39c109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 >> 172.21.15.33:0/3731711838 conn(0x7fb39c0f1e40 msgr2=0x7fb39c0fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 shutdown_connections 2022-02-02T14:27:53.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.834+0000 7fb3a093f700 1 -- 172.21.15.33:0/3731711838 wait complete. 2022-02-02T14:27:53.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- 172.21.15.33:0/2800385826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f66e0 msgr2=0x7fd2400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 --2- 172.21.15.33:0/2800385826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f66e0 0x7fd2400f6b00 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7fd23c004660 tx=0x7fd23c009b30).stop 2022-02-02T14:27:53.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- 172.21.15.33:0/2800385826 shutdown_connections 2022-02-02T14:27:53.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 --2- 172.21.15.33:0/2800385826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f7980 0x7fd2400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 --2- 172.21.15.33:0/2800385826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f66e0 0x7fd2400f6b00 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- 172.21.15.33:0/2800385826 >> 172.21.15.33:0/2800385826 conn(0x7fd2400f1e40 msgr2=0x7fd2400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:53.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- 172.21.15.33:0/2800385826 shutdown_connections 2022-02-02T14:27:53.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- 172.21.15.33:0/2800385826 wait complete. 2022-02-02T14:27:53.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 Processor -- start 2022-02-02T14:27:53.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- start start 2022-02-02T14:27:53.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f66e0 0x7fd240106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.935+0000 7fd24862b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240107a50 con 0x7fd2400f7980 2022-02-02T14:27:53.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd24862b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd240107b90 con 0x7fd2400f66e0 2022-02-02T14:27:53.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33042/0 (socket says 172.21.15.33:33042) 2022-02-02T14:27:53.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 -- 172.21.15.33:0/125237581 learned_addr learned my addr 172.21.15.33:0/125237581 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:27:53.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd2463c7700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f66e0 0x7fd240106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 -- 172.21.15.33:0/125237581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f66e0 msgr2=0x7fd240106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:53.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f66e0 0x7fd240106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:53.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 -- 172.21.15.33:0/125237581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c005040 con 0x7fd2400f7980 2022-02-02T14:27:53.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd245bc6700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fd2300026d0 tx=0x7fd230009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd230009320 con 0x7fd2400f7980 2022-02-02T14:27:53.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd23000f040 con 0x7fd2400f7980 2022-02-02T14:27:53.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2300147e0 con 0x7fd2400f7980 2022-02-02T14:27:53.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd240108530 con 0x7fd2400f7980 2022-02-02T14:27:53.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.936+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd240108af0 con 0x7fd2400f7980 2022-02-02T14:27:53.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.937+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240045ad0 con 0x7fd2400f7980 2022-02-02T14:27:53.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.938+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd230009480 con 0x7fd2400f7980 2022-02-02T14:27:53.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.938+0000 7fd236ffd700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 0x7fd22c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:27:53.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.938+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd230082170 con 0x7fd2400f7980 2022-02-02T14:27:53.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.938+0000 7fd2463c7700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 0x7fd22c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:27:53.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.939+0000 7fd2463c7700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 0x7fd22c067290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fd23c004630 tx=0x7fd23c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:27:53.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:53.942+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd230053c50 con 0x7fd2400f7980 2022-02-02T14:27:54.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.157+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd240027a00 con 0x7fd2400f7980 2022-02-02T14:27:54.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.157+0000 7fd236ffd700 1 -- 172.21.15.33:0/125237581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd230053840 con 0x7fd2400f7980 2022-02-02T14:27:54.157 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:27:54.158 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:27:54.158 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:27:54.158 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:27:54.159 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:54.159 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:27:54.159 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:27:54.159 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:27:54.159 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:27:54.160 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:27:54.160 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:27:54.160 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:27:54.160 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:27:54.161 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:27:54.161 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:27:54.161 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:27:54.161 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:27:54.161 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:27:54.162 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:27:54.162 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:27:54.162 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:27:54.162 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:27:54.163 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:27:54.163 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:27:54.163 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:27:54.163 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:27:54.163 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:27:54.164 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:27:54.164 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:27:54.164 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:27:54.164 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:27:54.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:54.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:54.165 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:27:54.165 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:27:54.165 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:54.166 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:54.166 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:54.166 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:27:54.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 msgr2=0x7fd22c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:54.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 0x7fd22c067290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fd23c004630 tx=0x7fd23c009b30).stop 2022-02-02T14:27:54.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 msgr2=0x7fd2401074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:27:54.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fd2300026d0 tx=0x7fd230009de0).stop 2022-02-02T14:27:54.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 shutdown_connections 2022-02-02T14:27:54.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd22c064dd0 0x7fd22c067290 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:54.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2400f66e0 0x7fd240106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:54.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 --2- 172.21.15.33:0/125237581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2400f7980 0x7fd2401074a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:27:54.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 >> 172.21.15.33:0/125237581 conn(0x7fd2400f1e40 msgr2=0x7fd2400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:27:54.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 shutdown_connections 2022-02-02T14:27:54.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:27:54.160+0000 7fd24862b700 1 -- 172.21.15.33:0/125237581 wait complete. 2022-02-02T14:27:54.170 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:27:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:54 smithi033 ceph-mon[101165]: pgmap v1475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:54 smithi033 ceph-mon[101165]: from='client.35590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3731711838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:27:54.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/125237581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:27:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:54 smithi037 ceph-mon[69017]: pgmap v1475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:54 smithi037 ceph-mon[69017]: from='client.35590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3731711838' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:27:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/125237581' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:27:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:55 smithi033 ceph-mon[101165]: from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:27:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:27:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:55 smithi037 ceph-mon[69017]: from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:27:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:27:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:27:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:56 smithi033 ceph-mon[101165]: pgmap v1476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:56 smithi037 ceph-mon[69017]: pgmap v1476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:27:58 smithi033 ceph-mon[101165]: pgmap v1477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:27:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:27:58 smithi037 ceph-mon[69017]: pgmap v1477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:00 smithi033 ceph-mon[101165]: pgmap v1478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:00 smithi037 ceph-mon[69017]: pgmap v1478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:02 smithi033 ceph-mon[101165]: pgmap v1479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:02 smithi037 ceph-mon[69017]: pgmap v1479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:04 smithi033 ceph-mon[101165]: pgmap v1480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:04 smithi037 ceph-mon[69017]: pgmap v1480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:06 smithi033 ceph-mon[101165]: pgmap v1481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:06 smithi037 ceph-mon[69017]: pgmap v1481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:08 smithi033 ceph-mon[101165]: pgmap v1482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:08 smithi037 ceph-mon[69017]: pgmap v1482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:10 smithi033 ceph-mon[101165]: pgmap v1483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:10 smithi037 ceph-mon[69017]: pgmap v1483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:12.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:12 smithi033 ceph-mon[101165]: pgmap v1484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:12.943 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:12 smithi037 ceph-mon[69017]: pgmap v1484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:14 smithi033 ceph-mon[101165]: pgmap v1485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:14 smithi037 ceph-mon[69017]: pgmap v1485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:16 smithi033 ceph-mon[101165]: pgmap v1486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:16 smithi037 ceph-mon[69017]: pgmap v1486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:18 smithi033 ceph-mon[101165]: pgmap v1487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:18 smithi037 ceph-mon[69017]: pgmap v1487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:20 smithi033 ceph-mon[101165]: pgmap v1488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:20 smithi037 ceph-mon[69017]: pgmap v1488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:22 smithi033 ceph-mon[101165]: pgmap v1489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:22 smithi037 ceph-mon[69017]: pgmap v1489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:24.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 -- 172.21.15.33:0/3418139238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006a330 msgr2=0x7f80c006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 --2- 172.21.15.33:0/3418139238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006a330 0x7f80c006a7b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f80ac004660 tx=0x7f80ac009b30).stop 2022-02-02T14:28:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 -- 172.21.15.33:0/3418139238 shutdown_connections 2022-02-02T14:28:24.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 --2- 172.21.15.33:0/3418139238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006a330 0x7f80c006a7b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 --2- 172.21.15.33:0/3418139238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006b940 0x7f80c0069e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 -- 172.21.15.33:0/3418139238 >> 172.21.15.33:0/3418139238 conn(0x7f80c00f1e40 msgr2=0x7f80c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 -- 172.21.15.33:0/3418139238 shutdown_connections 2022-02-02T14:28:24.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.277+0000 7f80c6baa700 1 -- 172.21.15.33:0/3418139238 wait complete. 2022-02-02T14:28:24.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 Processor -- start 2022-02-02T14:28:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 -- start start 2022-02-02T14:28:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006a330 0x7f80c01090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0109b60 con 0x7f80c006b940 2022-02-02T14:28:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c6baa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c0109ca0 con 0x7f80c006a330 2022-02-02T14:28:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33052/0 (socket says 172.21.15.33:33052) 2022-02-02T14:28:24.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80bffff700 1 -- 172.21.15.33:0/408078872 learned_addr learned my addr 172.21.15.33:0/408078872 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.278+0000 7f80c4946700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006a330 0x7f80c01090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bffff700 1 -- 172.21.15.33:0/408078872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006a330 msgr2=0x7f80c01090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bffff700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006a330 0x7f80c01090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bffff700 1 -- 172.21.15.33:0/408078872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac005040 con 0x7f80c006b940 2022-02-02T14:28:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bffff700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f80ac000c00 tx=0x7f80ac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ac019070 con 0x7f80c006b940 2022-02-02T14:28:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c010a5e0 con 0x7f80c006b940 2022-02-02T14:28:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f80ac007e70 con 0x7f80c006b940 2022-02-02T14:28:24.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80ac014ce0 con 0x7f80c006b940 2022-02-02T14:28:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.279+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c010ab40 con 0x7f80c006b940 2022-02-02T14:28:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.281+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c0045ad0 con 0x7f80c006b940 2022-02-02T14:28:24.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.281+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f80ac014420 con 0x7f80c006b940 2022-02-02T14:28:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.282+0000 7f80bd7fa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 0x7f80b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.282+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f80ac082930 con 0x7f80c006b940 2022-02-02T14:28:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.282+0000 7f80c4946700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 0x7f80b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.282+0000 7f80c4946700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 0x7f80b0067290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f80b4009fd0 tx=0x7f80b400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.286+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f80ac054410 con 0x7f80c006b940 2022-02-02T14:28:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.478+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80c01011d0 con 0x7f80b0064dd0 2022-02-02T14:28:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.479+0000 7f80bd7fa700 1 -- 172.21.15.33:0/408078872 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f80c01011d0 con 0x7f80b0064dd0 2022-02-02T14:28:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 msgr2=0x7f80b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 0x7f80b0067290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f80b4009fd0 tx=0x7f80b400b040).stop 2022-02-02T14:28:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 msgr2=0x7f80c01095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f80ac000c00 tx=0x7f80ac00b040).stop 2022-02-02T14:28:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 shutdown_connections 2022-02-02T14:28:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f80b0064dd0 0x7f80b0067290 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80c006a330 0x7f80c01090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 --2- 172.21.15.33:0/408078872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80c006b940 0x7f80c01095b0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 >> 172.21.15.33:0/408078872 conn(0x7f80c00f1e40 msgr2=0x7f80c00fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 shutdown_connections 2022-02-02T14:28:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.481+0000 7f80c6baa700 1 -- 172.21.15.33:0/408078872 wait complete. 2022-02-02T14:28:24.491 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:28:24.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 -- 172.21.15.33:0/3408161378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0f96f0 msgr2=0x7f2b6c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3408161378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0fbae0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f2b58004660 tx=0x7f2b58009b30).stop 2022-02-02T14:28:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 -- 172.21.15.33:0/3408161378 shutdown_connections 2022-02-02T14:28:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3408161378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0fbae0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3408161378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.583+0000 7f2b71c40700 1 -- 172.21.15.33:0/3408161378 >> 172.21.15.33:0/3408161378 conn(0x7f2b6c0f0b90 msgr2=0x7f2b6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:24.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.584+0000 7f2b71c40700 1 -- 172.21.15.33:0/3408161378 shutdown_connections 2022-02-02T14:28:24.586 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:24 smithi033 ceph-mon[101165]: pgmap v1490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.584+0000 7f2b71c40700 1 -- 172.21.15.33:0/3408161378 wait complete. 2022-02-02T14:28:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.584+0000 7f2b71c40700 1 Processor -- start 2022-02-02T14:28:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.584+0000 7f2b71c40700 1 -- start start 2022-02-02T14:28:24.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b71c40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b71c40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b71c40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0f55d0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b71c40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c0f5710 con 0x7f2b6c0f96f0 2022-02-02T14:28:24.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33058/0 (socket says 172.21.15.33:33058) 2022-02-02T14:28:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 -- 172.21.15.33:0/3971862206 learned_addr learned my addr 172.21.15.33:0/3971862206 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b6bfff700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 -- 172.21.15.33:0/3971862206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0f96f0 msgr2=0x7f2b6c0f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 -- 172.21.15.33:0/3971862206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58005040 con 0x7f2b6c0602b0 2022-02-02T14:28:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b70c3e700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f2b600026d0 tx=0x7f2b60009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b600079c0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c0f59f0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.585+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b6000f040 con 0x7f2b6c0602b0 2022-02-02T14:28:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.586+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b600148b0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.586+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c10ed60 con 0x7f2b6c0602b0 2022-02-02T14:28:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.587+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6c045ad0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.587+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b60007b20 con 0x7f2b6c0602b0 2022-02-02T14:28:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.587+0000 7f2b697fa700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 0x7f2b5c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.588+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2b60081a30 con 0x7f2b6c0602b0 2022-02-02T14:28:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.588+0000 7f2b6bfff700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 0x7f2b5c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.588+0000 7f2b6bfff700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 0x7f2b5c0672e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2b58004630 tx=0x7f2b58009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.592+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b6004fae0 con 0x7f2b6c0602b0 2022-02-02T14:28:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.772+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6c0fee60 con 0x7f2b5c064e20 2022-02-02T14:28:24.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.787+0000 7f2b697fa700 1 -- 172.21.15.33:0/3971862206 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2b6c0fee60 con 0x7f2b5c064e20 2022-02-02T14:28:24.787 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:28:24.787 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (53m) 15m ago 54m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:28:24.788 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (46m) 15m ago 54m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:28:24.788 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (46m) 15m ago 54m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:28:24.788 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (53m) 15m ago 54m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:28:24.788 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (47m) 15m ago 50m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:28:24.789 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (47m) 15m ago 50m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:28:24.789 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (48m) 15m ago 50m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:28:24.789 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (50m) 15m ago 50m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:28:24.789 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (48m) 15m ago 56m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:28:24.790 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (47m) 15m ago 54m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:28:24.790 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (47m) 15m ago 56m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:28:24.790 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (47m) 15m ago 54m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:28:24.790 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (54m) 15m ago 54m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:28:24.790 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (53m) 15m ago 53m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:28:24.791 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 15m ago 53m - 4096M 2022-02-02T14:28:24.791 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (53m) 15m ago 53m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:28:24.791 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (52m) 15m ago 52m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:28:24.791 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (52m) 15m ago 52m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:28:24.792 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (52m) 15m ago 52m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:28:24.792 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (52m) 15m ago 52m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:28:24.792 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (53m) 15m ago 54m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:28:24.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:24 smithi037 ceph-mon[69017]: pgmap v1490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 msgr2=0x7f2b5c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 0x7f2b5c0672e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f2b58004630 tx=0x7f2b58009b30).stop 2022-02-02T14:28:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 msgr2=0x7f2b6c0f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f2b600026d0 tx=0x7f2b60009de0).stop 2022-02-02T14:28:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 shutdown_connections 2022-02-02T14:28:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b5c064e20 0x7f2b5c0672e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b6c0602b0 0x7f2b6c0f6bf0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 --2- 172.21.15.33:0/3971862206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b6c0f96f0 0x7f2b6c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 >> 172.21.15.33:0/3971862206 conn(0x7f2b6c0f0b90 msgr2=0x7f2b6c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 shutdown_connections 2022-02-02T14:28:24.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.789+0000 7f2b71c40700 1 -- 172.21.15.33:0/3971862206 wait complete. 2022-02-02T14:28:24.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 -- 172.21.15.33:0/936527290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900602b0 msgr2=0x7fc7900f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 --2- 172.21.15.33:0/936527290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900602b0 0x7fc7900f9300 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fc780004660 tx=0x7fc780009b30).stop 2022-02-02T14:28:24.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 -- 172.21.15.33:0/936527290 shutdown_connections 2022-02-02T14:28:24.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 --2- 172.21.15.33:0/936527290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900f9880 0x7fc7900fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 --2- 172.21.15.33:0/936527290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900602b0 0x7fc7900f9300 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 -- 172.21.15.33:0/936527290 >> 172.21.15.33:0/936527290 conn(0x7fc7900f0d40 msgr2=0x7fc7900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:24.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 -- 172.21.15.33:0/936527290 shutdown_connections 2022-02-02T14:28:24.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.889+0000 7fc795ee5700 1 -- 172.21.15.33:0/936527290 wait complete. 2022-02-02T14:28:24.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 Processor -- start 2022-02-02T14:28:24.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 -- start start 2022-02-02T14:28:24.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 0x7fc790107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7901079c0 con 0x7fc7900f9880 2022-02-02T14:28:24.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.890+0000 7fc795ee5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc790107b00 con 0x7fc7900602b0 2022-02-02T14:28:24.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 0x7fc790107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 0x7fc790107410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33070/0 (socket says 172.21.15.33:33070) 2022-02-02T14:28:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43784/0 (socket says 172.21.15.33:43784) 2022-02-02T14:28:24.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78effd700 1 -- 172.21.15.33:0/415926089 learned_addr learned my addr 172.21.15.33:0/415926089 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 -- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 msgr2=0x7fc790107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 0x7fc790107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 -- 172.21.15.33:0/415926089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc780005040 con 0x7fc7900602b0 2022-02-02T14:28:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc78f7fe700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc780000c00 tx=0x7fc780009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc780018070 con 0x7fc7900602b0 2022-02-02T14:28:24.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc790108440 con 0x7fc7900602b0 2022-02-02T14:28:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc7800097d0 con 0x7fc7900602b0 2022-02-02T14:28:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc78001ddb0 con 0x7fc7900602b0 2022-02-02T14:28:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.891+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7901089a0 con 0x7fc7900602b0 2022-02-02T14:28:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.892+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790045ad0 con 0x7fc7900602b0 2022-02-02T14:28:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.893+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc780007ca0 con 0x7fc7900602b0 2022-02-02T14:28:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.893+0000 7fc777fff700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 0x7fc778067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.894+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc780083710 con 0x7fc7900602b0 2022-02-02T14:28:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.894+0000 7fc78effd700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 0x7fc778067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.894+0000 7fc78effd700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 0x7fc778067290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc784004ce0 tx=0x7fc78400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:24.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:24.898+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc7800552b0 con 0x7fc7900602b0 2022-02-02T14:28:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.142+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc7900fefb0 con 0x7fc7900602b0 2022-02-02T14:28:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.142+0000 7fc777fff700 1 -- 172.21.15.33:0/415926089 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc780054ea0 con 0x7fc7900602b0 2022-02-02T14:28:25.142 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:28:25.142 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:28:25.143 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:28:25.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:25.143 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:28:25.143 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:28:25.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:25.144 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:28:25.144 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:28:25.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:25.144 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:28:25.145 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:28:25.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:25.145 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:28:25.145 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:28:25.145 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:28:25.146 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:28:25.146 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:28:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 msgr2=0x7fc778067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 0x7fc778067290 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fc784004ce0 tx=0x7fc78400b040).stop 2022-02-02T14:28:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 msgr2=0x7fc790106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc780000c00 tx=0x7fc780009b30).stop 2022-02-02T14:28:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 shutdown_connections 2022-02-02T14:28:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc778064dd0 0x7fc778067290 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7900602b0 0x7fc790106f20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 --2- 172.21.15.33:0/415926089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7900f9880 0x7fc790107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 >> 172.21.15.33:0/415926089 conn(0x7fc7900f0d40 msgr2=0x7fc7900f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 shutdown_connections 2022-02-02T14:28:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.144+0000 7fc795ee5700 1 -- 172.21.15.33:0/415926089 wait complete. 2022-02-02T14:28:25.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.245+0000 7f0089a89700 1 -- 172.21.15.33:0/2958325723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 msgr2=0x7f00840f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.245+0000 7f0089a89700 1 --2- 172.21.15.33:0/2958325723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f00840f92a0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f0074004660 tx=0x7f0074009b30).stop 2022-02-02T14:28:25.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 -- 172.21.15.33:0/2958325723 shutdown_connections 2022-02-02T14:28:25.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 --2- 172.21.15.33:0/2958325723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 0x7f00840fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 --2- 172.21.15.33:0/2958325723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f00840f92a0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 -- 172.21.15.33:0/2958325723 >> 172.21.15.33:0/2958325723 conn(0x7f00840f0d40 msgr2=0x7f00840f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 -- 172.21.15.33:0/2958325723 shutdown_connections 2022-02-02T14:28:25.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.246+0000 7f0089a89700 1 -- 172.21.15.33:0/2958325723 wait complete. 2022-02-02T14:28:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 Processor -- start 2022-02-02T14:28:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 -- start start 2022-02-02T14:28:25.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:25.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 0x7f0084107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:25.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841079f0 con 0x7f0084060310 2022-02-02T14:28:25.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f0089a89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084107b30 con 0x7f00840f9820 2022-02-02T14:28:25.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f00837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:25.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f00837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33078/0 (socket says 172.21.15.33:33078) 2022-02-02T14:28:25.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.247+0000 7f00837fe700 1 -- 172.21.15.33:0/3905099489 learned_addr learned my addr 172.21.15.33:0/3905099489 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:25.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f0082ffd700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 0x7f0084107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:25.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f00837fe700 1 -- 172.21.15.33:0/3905099489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 msgr2=0x7f0084107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f00837fe700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 0x7f0084107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f00837fe700 1 -- 172.21.15.33:0/3905099489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074005040 con 0x7f0084060310 2022-02-02T14:28:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f00837fe700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f0074009990 tx=0x7f0074009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0074018070 con 0x7f0084060310 2022-02-02T14:28:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0074007ba0 con 0x7f0084060310 2022-02-02T14:28:25.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0084108470 con 0x7f0084060310 2022-02-02T14:28:25.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f007401c620 con 0x7f0084060310 2022-02-02T14:28:25.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.248+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00841089d0 con 0x7f0084060310 2022-02-02T14:28:25.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.249+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084045ad0 con 0x7f0084060310 2022-02-02T14:28:25.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.250+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f007401c890 con 0x7f0084060310 2022-02-02T14:28:25.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.250+0000 7f007bfff700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 0x7f0070067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:25.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.250+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0074083810 con 0x7f0084060310 2022-02-02T14:28:25.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.250+0000 7f0082ffd700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 0x7f0070067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:25.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.251+0000 7f0082ffd700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 0x7f0070067290 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f006c007fd0 tx=0x7f006c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:25.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.254+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00740552f0 con 0x7f0084060310 2022-02-02T14:28:25.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.468+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f00840008d0 con 0x7f0084060310 2022-02-02T14:28:25.468 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:25 smithi033 ceph-mon[101165]: from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:25.468 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:25 smithi033 ceph-mon[101165]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:25.469 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:25 smithi033 ceph-mon[101165]: pgmap v1491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:25.469 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/415926089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:28:25.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.468+0000 7f007bfff700 1 -- 172.21.15.33:0/3905099489 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0074054ee0 con 0x7f0084060310 2022-02-02T14:28:25.470 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:28:25.470 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:28:25.470 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:28:25.470 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:28:25.471 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:25.471 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:28:25.471 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:28:25.471 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:28:25.472 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:28:25.472 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:28:25.472 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:28:25.472 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:28:25.472 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:28:25.473 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:28:25.473 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:28:25.473 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:28:25.474 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:28:25.474 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:28:25.474 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:28:25.474 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:28:25.475 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:28:25.475 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:28:25.475 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:28:25.475 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:28:25.476 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:28:25.476 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:28:25.476 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:28:25.476 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:28:25.477 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:28:25.477 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:28:25.477 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:28:25.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:25.477 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:25.478 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:28:25.478 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:25.478 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:25.478 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:25.479 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:25.479 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:25.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 msgr2=0x7f0070067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 0x7f0070067290 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f006c007fd0 tx=0x7f006c009040).stop 2022-02-02T14:28:25.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 msgr2=0x7f0084106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:25.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f0074009990 tx=0x7f0074009b30).stop 2022-02-02T14:28:25.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 shutdown_connections 2022-02-02T14:28:25.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0070064dd0 0x7f0070067290 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0084060310 0x7f0084106f50 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 --2- 172.21.15.33:0/3905099489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00840f9820 0x7f0084107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 >> 172.21.15.33:0/3905099489 conn(0x7f00840f0d40 msgr2=0x7f00840f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 shutdown_connections 2022-02-02T14:28:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:25.472+0000 7f0089a89700 1 -- 172.21.15.33:0/3905099489 wait complete. 2022-02-02T14:28:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:28:25.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:25 smithi037 ceph-mon[69017]: from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:25.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:25 smithi037 ceph-mon[69017]: from='client.35610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:25.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:25 smithi037 ceph-mon[69017]: pgmap v1491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:25.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/415926089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:28:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:26 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3905099489' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:28:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:26 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3905099489' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:28:27.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:27 smithi033 ceph-mon[101165]: pgmap v1492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:27.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:27 smithi037 ceph-mon[69017]: pgmap v1492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:30.240 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:29 smithi033 ceph-mon[101165]: pgmap v1493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:30.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:29 smithi037 ceph-mon[69017]: pgmap v1493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:32.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:32 smithi033 ceph-mon[101165]: pgmap v1494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:32 smithi037 ceph-mon[69017]: pgmap v1494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:34.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:34 smithi033 ceph-mon[101165]: pgmap v1495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:34.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:34 smithi037 ceph-mon[69017]: pgmap v1495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:36.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:36 smithi033 ceph-mon[101165]: pgmap v1496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:36.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:36 smithi037 ceph-mon[69017]: pgmap v1496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:38.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:38 smithi037 ceph-mon[69017]: pgmap v1497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:38 smithi033 ceph-mon[101165]: pgmap v1497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:40.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:40 smithi037 ceph-mon[69017]: pgmap v1498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:40 smithi033 ceph-mon[101165]: pgmap v1498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:42.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:42 smithi037 ceph-mon[69017]: pgmap v1499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:42 smithi033 ceph-mon[101165]: pgmap v1499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:44.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:44 smithi037 ceph-mon[69017]: pgmap v1500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:44 smithi033 ceph-mon[101165]: pgmap v1500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:46.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:46 smithi037 ceph-mon[69017]: pgmap v1501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:46 smithi033 ceph-mon[101165]: pgmap v1501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:48.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:48 smithi037 ceph-mon[69017]: pgmap v1502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:48 smithi033 ceph-mon[101165]: pgmap v1502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:50 smithi037 ceph-mon[69017]: pgmap v1503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:50 smithi033 ceph-mon[101165]: pgmap v1503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:52 smithi037 ceph-mon[69017]: pgmap v1504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:52 smithi033 ceph-mon[101165]: pgmap v1504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:54.544 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:54 smithi037 ceph-mon[69017]: pgmap v1505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:54 smithi033 ceph-mon[101165]: pgmap v1505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:28:55.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:28:55.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 -- 172.21.15.33:0/3230850463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f55c0 msgr2=0x7f00d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 --2- 172.21.15.33:0/3230850463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f55c0 0x7f00d00f59e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f00c0004660 tx=0x7f00c0009b30).stop 2022-02-02T14:28:55.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 -- 172.21.15.33:0/3230850463 shutdown_connections 2022-02-02T14:28:55.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 --2- 172.21.15.33:0/3230850463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f6860 0x7f00d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 --2- 172.21.15.33:0/3230850463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f55c0 0x7f00d00f59e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 -- 172.21.15.33:0/3230850463 >> 172.21.15.33:0/3230850463 conn(0x7f00d00f0d40 msgr2=0x7f00d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:55.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:28:55.591 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:28:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 -- 172.21.15.33:0/3230850463 shutdown_connections 2022-02-02T14:28:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.589+0000 7f00d647a700 1 -- 172.21.15.33:0/3230850463 wait complete. 2022-02-02T14:28:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 Processor -- start 2022-02-02T14:28:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 -- start start 2022-02-02T14:28:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f55c0 0x7f00d0105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0106940 con 0x7f00d00f6860 2022-02-02T14:28:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00d647a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0107140 con 0x7f00d00f55c0 2022-02-02T14:28:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33090/0 (socket says 172.21.15.33:33090) 2022-02-02T14:28:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00cffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f55c0 0x7f00d0105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.590+0000 7f00cf7fe700 1 -- 172.21.15.33:0/3800723989 learned_addr learned my addr 172.21.15.33:0/3800723989 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00cf7fe700 1 -- 172.21.15.33:0/3800723989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f55c0 msgr2=0x7f00d0105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00cf7fe700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f55c0 0x7f00d0105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00cf7fe700 1 -- 172.21.15.33:0/3800723989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c0005040 con 0x7f00d00f6860 2022-02-02T14:28:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00cf7fe700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f00c40026d0 tx=0x7f00c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00c40079c0 con 0x7f00d00f6860 2022-02-02T14:28:55.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f00c400f040 con 0x7f00d00f6860 2022-02-02T14:28:55.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d01073c0 con 0x7f00d00f6860 2022-02-02T14:28:55.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00c40148b0 con 0x7f00d00f6860 2022-02-02T14:28:55.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.591+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0107930 con 0x7f00d00f6860 2022-02-02T14:28:55.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.592+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d00f49b0 con 0x7f00d00f6860 2022-02-02T14:28:55.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.593+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f00c4007b20 con 0x7f00d00f6860 2022-02-02T14:28:55.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.593+0000 7f00ccff9700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 0x7f00b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.593+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f00c4081a30 con 0x7f00d00f6860 2022-02-02T14:28:55.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.593+0000 7f00cffff700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 0x7f00b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.594+0000 7f00cffff700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 0x7f00b8067290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f00c0004630 tx=0x7f00c0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:55.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.597+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f00c4053510 con 0x7f00d00f6860 2022-02-02T14:28:55.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.785+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00d00ff800 con 0x7f00b8064dd0 2022-02-02T14:28:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.787+0000 7f00ccff9700 1 -- 172.21.15.33:0/3800723989 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f00d00ff800 con 0x7f00b8064dd0 2022-02-02T14:28:55.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 msgr2=0x7f00b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 0x7f00b8067290 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f00c0004630 tx=0x7f00c0009b30).stop 2022-02-02T14:28:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 msgr2=0x7f00d0106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f00c40026d0 tx=0x7f00c4009de0).stop 2022-02-02T14:28:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 shutdown_connections 2022-02-02T14:28:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f00b8064dd0 0x7f00b8067290 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d00f55c0 0x7f00d0105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 --2- 172.21.15.33:0/3800723989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00d00f6860 0x7f00d0106390 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 >> 172.21.15.33:0/3800723989 conn(0x7f00d00f0d40 msgr2=0x7f00d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:55.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 shutdown_connections 2022-02-02T14:28:55.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.789+0000 7f00d647a700 1 -- 172.21.15.33:0/3800723989 wait complete. 2022-02-02T14:28:55.798 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:28:55.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 -- 172.21.15.33:0/1934590462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f66e0 msgr2=0x7ff5f00f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 --2- 172.21.15.33:0/1934590462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f66e0 0x7ff5f00f6b40 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7ff5e4004660 tx=0x7ff5e4009b30).stop 2022-02-02T14:28:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 -- 172.21.15.33:0/1934590462 shutdown_connections 2022-02-02T14:28:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 --2- 172.21.15.33:0/1934590462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f66e0 0x7ff5f00f6b40 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 --2- 172.21.15.33:0/1934590462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f5440 0x7ff5f00f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 -- 172.21.15.33:0/1934590462 >> 172.21.15.33:0/1934590462 conn(0x7ff5f00f0ba0 msgr2=0x7ff5f00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.890+0000 7ff5f4879700 1 -- 172.21.15.33:0/1934590462 shutdown_connections 2022-02-02T14:28:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.891+0000 7ff5f4879700 1 -- 172.21.15.33:0/1934590462 wait complete. 2022-02-02T14:28:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.891+0000 7ff5f4879700 1 Processor -- start 2022-02-02T14:28:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.891+0000 7ff5f4879700 1 -- start start 2022-02-02T14:28:55.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5f4879700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5f4879700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f01061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5f4879700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0106770 con 0x7ff5f00f5440 2022-02-02T14:28:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5f4879700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0106f70 con 0x7ff5f00f66e0 2022-02-02T14:28:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33098/0 (socket says 172.21.15.33:33098) 2022-02-02T14:28:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 -- 172.21.15.33:0/3959396233 learned_addr learned my addr 172.21.15.33:0/3959396233 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5eeffd700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f01061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 -- 172.21.15.33:0/3959396233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 msgr2=0x7ff5f01061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f01061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 -- 172.21.15.33:0/3959396233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4005040 con 0x7ff5f00f5440 2022-02-02T14:28:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5ef7fe700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7ff5e0002700 tx=0x7ff5e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.892+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e00079c0 con 0x7ff5f00f5440 2022-02-02T14:28:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.893+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5e000f040 con 0x7ff5f00f5440 2022-02-02T14:28:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.893+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0107250 con 0x7ff5f00f5440 2022-02-02T14:28:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.893+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e0014860 con 0x7ff5f00f5440 2022-02-02T14:28:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.893+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0107810 con 0x7ff5f00f5440 2022-02-02T14:28:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.894+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f0059100 con 0x7ff5f00f5440 2022-02-02T14:28:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.894+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff5e001b060 con 0x7ff5f00f5440 2022-02-02T14:28:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.895+0000 7ff5d7fff700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 0x7ff5d80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.895+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff5e0081930 con 0x7ff5f00f5440 2022-02-02T14:28:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.895+0000 7ff5eeffd700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 0x7ff5d80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.896+0000 7ff5eeffd700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 0x7ff5d80672e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff5e4004630 tx=0x7ff5e4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:55.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:55.899+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5e0053410 con 0x7ff5f00f5440 2022-02-02T14:28:56.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.081+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f00008d0 con 0x7ff5d8064e20 2022-02-02T14:28:56.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.096+0000 7ff5d7fff700 1 -- 172.21.15.33:0/3959396233 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff5f00008d0 con 0x7ff5d8064e20 2022-02-02T14:28:56.096 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:28:56.096 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (54m) 16m ago 55m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:28:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (47m) 16m ago 55m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:28:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (47m) 16m ago 54m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:28:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (54m) 16m ago 54m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:28:56.097 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (47m) 16m ago 51m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:28:56.098 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (48m) 16m ago 51m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:28:56.098 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (49m) 16m ago 51m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:28:56.098 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (51m) 16m ago 51m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:28:56.098 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (48m) 16m ago 56m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:28:56.098 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (48m) 16m ago 54m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:28:56.099 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (48m) 16m ago 56m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:28:56.099 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (47m) 16m ago 54m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:28:56.099 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (54m) 16m ago 54m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:28:56.099 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (54m) 16m ago 54m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:28:56.100 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 16m ago 53m - 4096M 2022-02-02T14:28:56.100 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (53m) 16m ago 53m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:28:56.100 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (53m) 16m ago 53m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:28:56.100 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (53m) 16m ago 53m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:28:56.100 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (52m) 16m ago 52m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:28:56.101 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (52m) 16m ago 52m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:28:56.101 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (54m) 16m ago 54m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:28:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.098+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 msgr2=0x7ff5d80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.098+0000 7ff5f4879700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 0x7ff5d80672e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff5e4004630 tx=0x7ff5e4009b30).stop 2022-02-02T14:28:56.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 msgr2=0x7ff5f0105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7ff5e0002700 tx=0x7ff5e0009d80).stop 2022-02-02T14:28:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 shutdown_connections 2022-02-02T14:28:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064e20 0x7ff5d80672e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f5440 0x7ff5f0105cd0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 --2- 172.21.15.33:0/3959396233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f01061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 >> 172.21.15.33:0/3959396233 conn(0x7ff5f00f0ba0 msgr2=0x7ff5f00fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 shutdown_connections 2022-02-02T14:28:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.099+0000 7ff5f4879700 1 -- 172.21.15.33:0/3959396233 wait complete. 2022-02-02T14:28:56.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 -- 172.21.15.33:0/271749679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 msgr2=0x7f3e400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/271749679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e400f6b00 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f3e34004660 tx=0x7f3e34009b30).stop 2022-02-02T14:28:56.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 -- 172.21.15.33:0/271749679 shutdown_connections 2022-02-02T14:28:56.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/271749679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 0x7f3e400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/271749679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e400f6b00 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 -- 172.21.15.33:0/271749679 >> 172.21.15.33:0/271749679 conn(0x7f3e400f1e40 msgr2=0x7f3e400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:56.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 -- 172.21.15.33:0/271749679 shutdown_connections 2022-02-02T14:28:56.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.199+0000 7f3e45a2e700 1 -- 172.21.15.33:0/271749679 wait complete. 2022-02-02T14:28:56.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 Processor -- start 2022-02-02T14:28:56.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 -- start start 2022-02-02T14:28:56.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 0x7f3e40069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4006a380 con 0x7f3e400f66e0 2022-02-02T14:28:56.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e45a2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4006a4c0 con 0x7f3e400f7980 2022-02-02T14:28:56.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33108/0 (socket says 172.21.15.33:33108) 2022-02-02T14:28:56.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e3effd700 1 -- 172.21.15.33:0/4153926302 learned_addr learned my addr 172.21.15.33:0/4153926302 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:56.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.200+0000 7f3e3e7fc700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 0x7f3e40069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e3effd700 1 -- 172.21.15.33:0/4153926302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 msgr2=0x7f3e40069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e3effd700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 0x7f3e40069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e3effd700 1 -- 172.21.15.33:0/4153926302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34005040 con 0x7f3e400f66e0 2022-02-02T14:28:56.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e3effd700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3e34013a70 tx=0x7f3e34009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:56.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e34018070 con 0x7f3e400f66e0 2022-02-02T14:28:56.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e340097d0 con 0x7f3e400f66e0 2022-02-02T14:28:56.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4006a740 con 0x7f3e400f66e0 2022-02-02T14:28:56.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4006aca0 con 0x7f3e400f66e0 2022-02-02T14:28:56.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.201+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e3401de80 con 0x7f3e400f66e0 2022-02-02T14:28:56.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.202+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e3401d420 con 0x7f3e400f66e0 2022-02-02T14:28:56.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.203+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e20004fa0 con 0x7f3e400f66e0 2022-02-02T14:28:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.203+0000 7f3e277fe700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 0x7f3e28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.203+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e34083670 con 0x7f3e400f66e0 2022-02-02T14:28:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.203+0000 7f3e3e7fc700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 0x7f3e28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.203+0000 7f3e3e7fc700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 0x7f3e28067290 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f3e30004e20 tx=0x7f3e3000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:56.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.207+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e340517e0 con 0x7f3e400f66e0 2022-02-02T14:28:56.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.453+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e20005e80 con 0x7f3e400f66e0 2022-02-02T14:28:56.453 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:56 smithi033 ceph-mon[101165]: pgmap v1506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:56.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.454+0000 7f3e277fe700 1 -- 172.21.15.33:0/4153926302 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3e34054e00 con 0x7f3e400f66e0 2022-02-02T14:28:56.454 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:28:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:28:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:28:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:56.455 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:28:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:28:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:56.456 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:28:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:28:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:28:56.457 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:28:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:28:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:28:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:28:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:28:56.459 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:28:56.459 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:28:56.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 msgr2=0x7f3e28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 0x7f3e28067290 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7f3e30004e20 tx=0x7f3e3000b040).stop 2022-02-02T14:28:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 msgr2=0x7f3e4006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f3e34013a70 tx=0x7f3e34009b30).stop 2022-02-02T14:28:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 shutdown_connections 2022-02-02T14:28:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e28064dd0 0x7f3e28067290 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e400f66e0 0x7f3e4006b9a0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 --2- 172.21.15.33:0/4153926302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e400f7980 0x7f3e40069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 >> 172.21.15.33:0/4153926302 conn(0x7f3e400f1e40 msgr2=0x7f3e400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:56.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 shutdown_connections 2022-02-02T14:28:56.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.456+0000 7f3e45a2e700 1 -- 172.21.15.33:0/4153926302 wait complete. 2022-02-02T14:28:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:56 smithi037 ceph-mon[69017]: pgmap v1506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:56.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 -- 172.21.15.33:0/1646255222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 msgr2=0x7fd4540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 --2- 172.21.15.33:0/1646255222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd4540f6cc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fd448004660 tx=0x7fd448009b30).stop 2022-02-02T14:28:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 -- 172.21.15.33:0/1646255222 shutdown_connections 2022-02-02T14:28:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 --2- 172.21.15.33:0/1646255222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd4540f6cc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 --2- 172.21.15.33:0/1646255222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 0x7fd4540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 -- 172.21.15.33:0/1646255222 >> 172.21.15.33:0/1646255222 conn(0x7fd4540f0d40 msgr2=0x7fd4540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 -- 172.21.15.33:0/1646255222 shutdown_connections 2022-02-02T14:28:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.557+0000 7fd45c514700 1 -- 172.21.15.33:0/1646255222 wait complete. 2022-02-02T14:28:56.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 Processor -- start 2022-02-02T14:28:56.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 -- start start 2022-02-02T14:28:56.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 0x7fd454109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540603e0 con 0x7fd4540f6860 2022-02-02T14:28:56.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45c514700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd454060520 con 0x7fd4540f55c0 2022-02-02T14:28:56.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33120/0 (socket says 172.21.15.33:33120) 2022-02-02T14:28:56.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 -- 172.21.15.33:0/2363275962 learned_addr learned my addr 172.21.15.33:0/2363275962 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:28:56.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd45a2b0700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 0x7fd454109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 -- 172.21.15.33:0/2363275962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 msgr2=0x7fd454109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 0x7fd454109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.558+0000 7fd459aaf700 1 -- 172.21.15.33:0/2363275962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448005040 con 0x7fd4540f6860 2022-02-02T14:28:56.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd459aaf700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd448009990 tx=0x7fd448009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:56.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd448018070 con 0x7fd4540f6860 2022-02-02T14:28:56.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45410c6a0 con 0x7fd4540f6860 2022-02-02T14:28:56.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd448007ba0 con 0x7fd4540f6860 2022-02-02T14:28:56.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd44801c620 con 0x7fd4540f6860 2022-02-02T14:28:56.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.559+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45410cc00 con 0x7fd4540f6860 2022-02-02T14:28:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.560+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd454045ad0 con 0x7fd4540f6860 2022-02-02T14:28:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.560+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd44801c890 con 0x7fd4540f6860 2022-02-02T14:28:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.561+0000 7fd446ffd700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 0x7fd440067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:28:56.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.561+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd448083810 con 0x7fd4540f6860 2022-02-02T14:28:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.561+0000 7fd45a2b0700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 0x7fd440067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:28:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.561+0000 7fd45a2b0700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 0x7fd440067290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd454060060 tx=0x7fd450009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:28:56.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.565+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd4480518c0 con 0x7fd4540f6860 2022-02-02T14:28:56.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.781+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd454027a00 con 0x7fd4540f6860 2022-02-02T14:28:56.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.781+0000 7fd446ffd700 1 -- 172.21.15.33:0/2363275962 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd448054ee0 con 0x7fd4540f6860 2022-02-02T14:28:56.781 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:28:56.782 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:28:56.782 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:28:56.782 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:28:56.782 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:56.782 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:28:56.783 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:28:56.783 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:28:56.783 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:28:56.783 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:28:56.784 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:28:56.784 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:28:56.784 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:28:56.784 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:28:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:28:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:28:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:28:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:28:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:28:56.786 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:28:56.786 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:28:56.786 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:28:56.786 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:28:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:28:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:28:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:28:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:28:56.787 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:56.788 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:28:56.789 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:28:56.789 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:56.789 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:56.789 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:56.790 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:28:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 msgr2=0x7fd440067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 0x7fd440067290 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7fd454060060 tx=0x7fd450009040).stop 2022-02-02T14:28:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 msgr2=0x7fd45410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:28:56.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7fd448009990 tx=0x7fd448009b30).stop 2022-02-02T14:28:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 shutdown_connections 2022-02-02T14:28:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd440064dd0 0x7fd440067290 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4540f55c0 0x7fd454109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 --2- 172.21.15.33:0/2363275962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4540f6860 0x7fd45410c150 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:28:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 >> 172.21.15.33:0/2363275962 conn(0x7fd4540f0d40 msgr2=0x7fd4540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:28:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 shutdown_connections 2022-02-02T14:28:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:28:56.783+0000 7fd45c514700 1 -- 172.21.15.33:0/2363275962 wait complete. 2022-02-02T14:28:56.793 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:28:57.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:57 smithi037 ceph-mon[69017]: from='client.35622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:57.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:57 smithi037 ceph-mon[69017]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:57.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4153926302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:28:57.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2363275962' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:28:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:57 smithi033 ceph-mon[101165]: from='client.35622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:57 smithi033 ceph-mon[101165]: from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:28:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4153926302' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:28:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2363275962' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:28:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:28:58 smithi037 ceph-mon[69017]: pgmap v1507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:28:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:28:58 smithi033 ceph-mon[101165]: pgmap v1507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:00 smithi037 ceph-mon[69017]: pgmap v1508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:00 smithi033 ceph-mon[101165]: pgmap v1508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:02 smithi037 ceph-mon[69017]: pgmap v1509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:02 smithi033 ceph-mon[101165]: pgmap v1509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:04 smithi033 ceph-mon[101165]: pgmap v1510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:04 smithi037 ceph-mon[69017]: pgmap v1510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:06 smithi033 ceph-mon[101165]: pgmap v1511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:06 smithi037 ceph-mon[69017]: pgmap v1511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:08 smithi033 ceph-mon[101165]: pgmap v1512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:08.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:08 smithi037 ceph-mon[69017]: pgmap v1512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:10 smithi033 ceph-mon[101165]: pgmap v1513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:10 smithi037 ceph-mon[69017]: pgmap v1513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:12 smithi033 ceph-mon[101165]: pgmap v1514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:12 smithi037 ceph-mon[69017]: pgmap v1514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:14 smithi033 ceph-mon[101165]: pgmap v1515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:14 smithi037 ceph-mon[69017]: pgmap v1515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:16 smithi033 ceph-mon[101165]: pgmap v1516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:16 smithi037 ceph-mon[69017]: pgmap v1516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:18.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:18 smithi033 ceph-mon[101165]: pgmap v1517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:18 smithi037 ceph-mon[69017]: pgmap v1517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:20 smithi033 ceph-mon[101165]: pgmap v1518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:20 smithi037 ceph-mon[69017]: pgmap v1518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:22 smithi033 ceph-mon[101165]: pgmap v1519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:22 smithi037 ceph-mon[69017]: pgmap v1519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:24 smithi033 ceph-mon[101165]: pgmap v1520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:24 smithi037 ceph-mon[69017]: pgmap v1520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:26 smithi033 ceph-mon[101165]: pgmap v1521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:26 smithi037 ceph-mon[69017]: pgmap v1521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:26.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.898+0000 7f986e8ca700 1 -- 172.21.15.33:0/627964156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f55c0 msgr2=0x7f98680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.898+0000 7f986e8ca700 1 --2- 172.21.15.33:0/627964156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f55c0 0x7f98680f59e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f9858004660 tx=0x7f9858009b30).stop 2022-02-02T14:29:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.898+0000 7f986e8ca700 1 -- 172.21.15.33:0/627964156 shutdown_connections 2022-02-02T14:29:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.898+0000 7f986e8ca700 1 --2- 172.21.15.33:0/627964156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f6860 0x7f98680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.898+0000 7f986e8ca700 1 --2- 172.21.15.33:0/627964156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f55c0 0x7f98680f59e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.899+0000 7f986e8ca700 1 -- 172.21.15.33:0/627964156 >> 172.21.15.33:0/627964156 conn(0x7f98680f0d40 msgr2=0x7f98680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.899+0000 7f986e8ca700 1 -- 172.21.15.33:0/627964156 shutdown_connections 2022-02-02T14:29:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.899+0000 7f986e8ca700 1 -- 172.21.15.33:0/627964156 wait complete. 2022-02-02T14:29:26.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.899+0000 7f986e8ca700 1 Processor -- start 2022-02-02T14:29:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.899+0000 7f986e8ca700 1 -- start start 2022-02-02T14:29:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f986e8ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f55c0 0x7f98680f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f986e8ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f986e8ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98680f8100 con 0x7f98680f6860 2022-02-02T14:29:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f986e8ca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98680f8240 con 0x7f98680f55c0 2022-02-02T14:29:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33130/0 (socket says 172.21.15.33:33130) 2022-02-02T14:29:26.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 -- 172.21.15.33:0/3705579378 learned_addr learned my addr 172.21.15.33:0/3705579378 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f9867fff700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f55c0 0x7f98680f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 -- 172.21.15.33:0/3705579378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f55c0 msgr2=0x7f98680f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f55c0 0x7f98680f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:26.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 -- 172.21.15.33:0/3705579378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9858005040 con 0x7f98680f6860 2022-02-02T14:29:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f98677fe700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f985c00e7f0 tx=0x7f985c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985c0092e0 con 0x7f98680f6860 2022-02-02T14:29:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f985c00f040 con 0x7f98680f6860 2022-02-02T14:29:26.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.900+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98680f8520 con 0x7f98680f6860 2022-02-02T14:29:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.901+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f985c014750 con 0x7f98680f6860 2022-02-02T14:29:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.901+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986810ef20 con 0x7f98680f6860 2022-02-02T14:29:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.902+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9868045ad0 con 0x7f98680f6860 2022-02-02T14:29:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.902+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f985c01b030 con 0x7f98680f6860 2022-02-02T14:29:26.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.902+0000 7f9864ff9700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 0x7f9850067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.902+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f985c081740 con 0x7f98680f6860 2022-02-02T14:29:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.903+0000 7f9867fff700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 0x7f9850067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:26.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.903+0000 7f9867fff700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 0x7f9850067290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f9858000c00 tx=0x7f985800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:26.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:26.907+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f985c04f8a0 con 0x7f98680f6860 2022-02-02T14:29:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.096+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98680faca0 con 0x7f9850064dd0 2022-02-02T14:29:27.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.097+0000 7f9864ff9700 1 -- 172.21.15.33:0/3705579378 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f98680faca0 con 0x7f9850064dd0 2022-02-02T14:29:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 msgr2=0x7f9850067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 0x7f9850067290 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f9858000c00 tx=0x7f985800b040).stop 2022-02-02T14:29:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 msgr2=0x7f98680f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f985c00e7f0 tx=0x7f985c00b040).stop 2022-02-02T14:29:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 shutdown_connections 2022-02-02T14:29:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9850064dd0 0x7f9850067290 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98680f55c0 0x7f98680f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 --2- 172.21.15.33:0/3705579378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f98680f6860 0x7f98680f7ba0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 >> 172.21.15.33:0/3705579378 conn(0x7f98680f0d40 msgr2=0x7f986805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 shutdown_connections 2022-02-02T14:29:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.099+0000 7f986e8ca700 1 -- 172.21.15.33:0/3705579378 wait complete. 2022-02-02T14:29:27.108 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:29:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 -- 172.21.15.33:0/2446286001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f55c0 msgr2=0x7f24d40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/2446286001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f55c0 0x7f24d40f59e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f24d0004660 tx=0x7f24d0009b30).stop 2022-02-02T14:29:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 -- 172.21.15.33:0/2446286001 shutdown_connections 2022-02-02T14:29:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/2446286001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f6860 0x7f24d40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/2446286001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f55c0 0x7f24d40f59e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 -- 172.21.15.33:0/2446286001 >> 172.21.15.33:0/2446286001 conn(0x7f24d40f0d40 msgr2=0x7f24d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 -- 172.21.15.33:0/2446286001 shutdown_connections 2022-02-02T14:29:27.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.200+0000 7f24dbaa4700 1 -- 172.21.15.33:0/2446286001 wait complete. 2022-02-02T14:29:27.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 Processor -- start 2022-02-02T14:29:27.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 -- start start 2022-02-02T14:29:27.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f55c0 0x7f24d40f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40f8920 con 0x7f24d40f6860 2022-02-02T14:29:27.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24dbaa4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d40f8a60 con 0x7f24d40f55c0 2022-02-02T14:29:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24d903f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24d903f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33140/0 (socket says 172.21.15.33:33140) 2022-02-02T14:29:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24d903f700 1 -- 172.21.15.33:0/1503213671 learned_addr learned my addr 172.21.15.33:0/1503213671 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.201+0000 7f24d9840700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f55c0 0x7f24d40f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24d903f700 1 -- 172.21.15.33:0/1503213671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f55c0 msgr2=0x7f24d40f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24d903f700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f55c0 0x7f24d40f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24d903f700 1 -- 172.21.15.33:0/1503213671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0005040 con 0x7f24d40f6860 2022-02-02T14:29:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24d903f700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f24c800c530 tx=0x7f24c8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c800f650 con 0x7f24d40f6860 2022-02-02T14:29:27.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d40f8d40 con 0x7f24d40f6860 2022-02-02T14:29:27.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24c800fc60 con 0x7f24d40f6860 2022-02-02T14:29:27.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c8012c20 con 0x7f24d40f6860 2022-02-02T14:29:27.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.202+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d410efa0 con 0x7f24d40f6860 2022-02-02T14:29:27.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.203+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d4045ad0 con 0x7f24d40f6860 2022-02-02T14:29:27.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.204+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24c8010070 con 0x7f24d40f6860 2022-02-02T14:29:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.204+0000 7f24c67fc700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 0x7f24c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.204+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f24c8081700 con 0x7f24d40f6860 2022-02-02T14:29:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.204+0000 7f24d9840700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 0x7f24c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.205+0000 7f24d9840700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 0x7f24c0067290 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f24d0013690 tx=0x7f24d0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.209+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24c804f7b0 con 0x7f24d40f6860 2022-02-02T14:29:27.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.391+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24d405fd30 con 0x7f24c0064dd0 2022-02-02T14:29:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.406+0000 7f24c67fc700 1 -- 172.21.15.33:0/1503213671 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f24d405fd30 con 0x7f24c0064dd0 2022-02-02T14:29:27.406 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:29:27.406 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (54m) 16m ago 55m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:29:27.406 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (47m) 16m ago 55m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:29:27.406 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (47m) 16m ago 55m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:29:27.407 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (54m) 16m ago 55m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:29:27.407 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (48m) 16m ago 51m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:29:27.407 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (48m) 16m ago 51m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:29:27.407 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (49m) 16m ago 51m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:29:27.408 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (51m) 16m ago 51m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:29:27.408 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (49m) 16m ago 57m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:29:27.408 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (48m) 16m ago 55m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:29:27.408 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (48m) 16m ago 57m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:29:27.408 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (48m) 16m ago 55m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:29:27.409 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (55m) 16m ago 55m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:29:27.409 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (54m) 16m ago 54m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:29:27.409 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 16m ago 54m - 4096M 2022-02-02T14:29:27.409 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (54m) 16m ago 54m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:29:27.410 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (53m) 16m ago 53m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:29:27.410 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (53m) 16m ago 53m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:29:27.410 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (53m) 16m ago 53m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:29:27.410 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (53m) 16m ago 53m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:29:27.411 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (54m) 16m ago 55m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:29:27.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 msgr2=0x7f24c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 0x7f24c0067290 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f24d0013690 tx=0x7f24d0009b30).stop 2022-02-02T14:29:27.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 msgr2=0x7f24d40f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f24c800c530 tx=0x7f24c8007e20).stop 2022-02-02T14:29:27.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 shutdown_connections 2022-02-02T14:29:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24c0064dd0 0x7f24c0067290 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d40f55c0 0x7f24d40f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 --2- 172.21.15.33:0/1503213671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d40f6860 0x7f24d40f83c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 >> 172.21.15.33:0/1503213671 conn(0x7f24d40f0d40 msgr2=0x7f24d405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 shutdown_connections 2022-02-02T14:29:27.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.408+0000 7f24dbaa4700 1 -- 172.21.15.33:0/1503213671 wait complete. 2022-02-02T14:29:27.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.509+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2467616533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 msgr2=0x7fdaa40f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.509+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2467616533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa40f6920 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7fda98004660 tx=0x7fda98009b30).stop 2022-02-02T14:29:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.509+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2467616533 shutdown_connections 2022-02-02T14:29:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.509+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2467616533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa40f6920 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.509+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2467616533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 0x7fdaa40f5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.510+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2467616533 >> 172.21.15.33:0/2467616533 conn(0x7fdaa40f0de0 msgr2=0x7fdaa40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.510+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2467616533 shutdown_connections 2022-02-02T14:29:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.510+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2467616533 wait complete. 2022-02-02T14:29:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.510+0000 7fdaa9c62700 1 Processor -- start 2022-02-02T14:29:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa9c62700 1 -- start start 2022-02-02T14:29:27.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa9c62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 0x7fdaa4109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa9c62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa9c62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4060500 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa9c62700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4060640 con 0x7fdaa40f55e0 2022-02-02T14:29:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33150/0 (socket says 172.21.15.33:33150) 2022-02-02T14:29:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 -- 172.21.15.33:0/2042971057 learned_addr learned my addr 172.21.15.33:0/2042971057 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa37fe700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 0x7fdaa4109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 -- 172.21.15.33:0/2042971057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 msgr2=0x7fdaa4109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 0x7fdaa4109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 -- 172.21.15.33:0/2042971057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98005040 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fdaa2ffd700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fda98009830 tx=0x7fda98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.511+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda98018070 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.512+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa410c6e0 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.512+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda98007ba0 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.512+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda9801c3c0 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.512+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa410cc40 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.513+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa4045ad0 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.513+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda98007d10 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.514+0000 7fda8bfff700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 0x7fda8c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.514+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fda98083670 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.514+0000 7fdaa37fe700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 0x7fda8c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.514+0000 7fdaa37fe700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 0x7fda8c067270 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fdaa4060180 tx=0x7fda9400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.518+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda980517e0 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.761+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdaa4027a00 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.761+0000 7fda8bfff700 1 -- 172.21.15.33:0/2042971057 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fda98054e00 con 0x7fdaa40f5ef0 2022-02-02T14:29:27.761 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:29:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:29:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:29:27.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:27.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:29:27.763 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:29:27.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:27.763 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:29:27.764 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:29:27.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:27.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:29:27.764 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:29:27.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:27.765 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:29:27.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:29:27.765 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:29:27.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:29:27.766 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:29:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 msgr2=0x7fda8c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 0x7fda8c067270 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fdaa4060180 tx=0x7fda9400b040).stop 2022-02-02T14:29:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 msgr2=0x7fdaa410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fda98009830 tx=0x7fda98009b30).stop 2022-02-02T14:29:27.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 shutdown_connections 2022-02-02T14:29:27.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda8c064db0 0x7fda8c067270 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdaa40f55e0 0x7fdaa4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 --2- 172.21.15.33:0/2042971057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdaa40f5ef0 0x7fdaa410c190 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 >> 172.21.15.33:0/2042971057 conn(0x7fdaa40f0de0 msgr2=0x7fdaa40fa370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 shutdown_connections 2022-02-02T14:29:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.764+0000 7fdaa9c62700 1 -- 172.21.15.33:0/2042971057 wait complete. 2022-02-02T14:29:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/2837364845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f6530 msgr2=0x7f4c880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/2837364845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f6530 0x7f4c880f6950 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f4c84004660 tx=0x7f4c84009b30).stop 2022-02-02T14:29:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/2837364845 shutdown_connections 2022-02-02T14:29:27.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/2837364845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f77d0 0x7f4c880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/2837364845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f6530 0x7f4c880f6950 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/2837364845 >> 172.21.15.33:0/2837364845 conn(0x7f4c880f1c90 msgr2=0x7f4c880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:27.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/2837364845 shutdown_connections 2022-02-02T14:29:27.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.865+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/2837364845 wait complete. 2022-02-02T14:29:27.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 Processor -- start 2022-02-02T14:29:27.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 -- start start 2022-02-02T14:29:27.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 0x7f4c88106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881078f0 con 0x7f4c880f77d0 2022-02-02T14:29:27.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8ee0d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88108100 con 0x7f4c880f6530 2022-02-02T14:29:27.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8d60a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8de0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 0x7f4c88106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8d60a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33160/0 (socket says 172.21.15.33:33160) 2022-02-02T14:29:27.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.866+0000 7f4c8d60a700 1 -- 172.21.15.33:0/767625725 learned_addr learned my addr 172.21.15.33:0/767625725 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:27.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8de0b700 1 -- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 msgr2=0x7f4c881072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:27.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8de0b700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:27.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8de0b700 1 -- 172.21.15.33:0/767625725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c84005040 con 0x7f4c880f6530 2022-02-02T14:29:27.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8d60a700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:29:27.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8de0b700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 0x7f4c88106e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c84000c00 tx=0x7f4c84009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c84018070 con 0x7f4c880f6530 2022-02-02T14:29:27.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88108320 con 0x7f4c880f6530 2022-02-02T14:29:27.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c840097d0 con 0x7f4c880f6530 2022-02-02T14:29:27.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8401ddb0 con 0x7f4c880f6530 2022-02-02T14:29:27.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.867+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c88108880 con 0x7f4c880f6530 2022-02-02T14:29:27.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.868+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c88059100 con 0x7f4c880f6530 2022-02-02T14:29:27.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.869+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c84007ca0 con 0x7f4c880f6530 2022-02-02T14:29:27.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.869+0000 7f4c7e7fc700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 0x7f4c740672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:27.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.869+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c84083670 con 0x7f4c880f6530 2022-02-02T14:29:27.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.869+0000 7f4c8d60a700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 0x7f4c740672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:27.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.869+0000 7f4c8d60a700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 0x7f4c740672e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f4c780041d0 tx=0x7f4c7800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:27.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:27.874+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c84051720 con 0x7f4c880f6530 2022-02-02T14:29:28.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.084+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4c88045ad0 con 0x7f4c880f6530 2022-02-02T14:29:28.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.084+0000 7f4c7e7fc700 1 -- 172.21.15.33:0/767625725 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4c84054d40 con 0x7f4c880f6530 2022-02-02T14:29:28.084 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:29:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:29:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:29:28.085 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:29:28.085 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:29:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:29:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:29:28.086 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:29:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:29:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:29:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:29:28.087 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:29:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:29:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:29:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:29:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:29:28.088 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:29:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:29:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:29:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:29:28.089 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:29:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:29:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:29:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:29:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:29:28.090 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:29:28.091 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:29:28.091 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:29:28.091 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:29:28.091 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:29:28.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:28.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:28.092 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:29:28.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:28.092 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:28.093 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:28.093 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:28.093 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 msgr2=0x7f4c740672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 0x7f4c740672e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f4c780041d0 tx=0x7f4c7800b040).stop 2022-02-02T14:29:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 msgr2=0x7f4c88106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 0x7f4c88106e00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4c84000c00 tx=0x7f4c84009b30).stop 2022-02-02T14:29:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 shutdown_connections 2022-02-02T14:29:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c74064e20 0x7f4c740672e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c880f6530 0x7f4c88106e00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 --2- 172.21.15.33:0/767625725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c880f77d0 0x7f4c881072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.086+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 >> 172.21.15.33:0/767625725 conn(0x7f4c880f1c90 msgr2=0x7f4c880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.087+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 shutdown_connections 2022-02-02T14:29:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:28.087+0000 7f4c8ee0d700 1 -- 172.21.15.33:0/767625725 wait complete. 2022-02-02T14:29:28.097 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:29:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:28 smithi033 ceph-mon[101165]: pgmap v1522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:28 smithi033 ceph-mon[101165]: from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:29:28.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2042971057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:29:28.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/767625725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:29:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:28 smithi037 ceph-mon[69017]: pgmap v1522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:28 smithi037 ceph-mon[69017]: from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:29:28.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2042971057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:29:28.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/767625725' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:29:29.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:29 smithi033 ceph-mon[101165]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:29:29.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:29 smithi037 ceph-mon[69017]: from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:29:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:30 smithi033 ceph-mon[101165]: pgmap v1523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:30 smithi037 ceph-mon[69017]: pgmap v1523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:32 smithi033 ceph-mon[101165]: pgmap v1524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:32 smithi037 ceph-mon[69017]: pgmap v1524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:34 smithi033 ceph-mon[101165]: pgmap v1525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:34.967 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:34 smithi037 ceph-mon[69017]: pgmap v1525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:36 smithi033 ceph-mon[101165]: pgmap v1526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:36 smithi037 ceph-mon[69017]: pgmap v1526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:38 smithi033 ceph-mon[101165]: pgmap v1527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:38 smithi037 ceph-mon[69017]: pgmap v1527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:40 smithi033 ceph-mon[101165]: pgmap v1528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:40 smithi037 ceph-mon[69017]: pgmap v1528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:42 smithi033 ceph-mon[101165]: pgmap v1529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:42 smithi037 ceph-mon[69017]: pgmap v1529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:44 smithi033 ceph-mon[101165]: pgmap v1530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:44 smithi037 ceph-mon[69017]: pgmap v1530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:46 smithi033 ceph-mon[101165]: pgmap v1531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:46 smithi037 ceph-mon[69017]: pgmap v1531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:48.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:48 smithi033 ceph-mon[101165]: pgmap v1532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:48 smithi037 ceph-mon[69017]: pgmap v1532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:50 smithi033 ceph-mon[101165]: pgmap v1533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:50 smithi037 ceph-mon[69017]: pgmap v1533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:52.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:52 smithi033 ceph-mon[101165]: pgmap v1534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:52 smithi037 ceph-mon[69017]: pgmap v1534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:54 smithi033 ceph-mon[101165]: pgmap v1535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:54 smithi037 ceph-mon[69017]: pgmap v1535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:29:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:29:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:55 smithi033 ceph-mon[101165]: pgmap v1536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:29:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:29:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:55 smithi037 ceph-mon[69017]: pgmap v1536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:58.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 -- 172.21.15.33:0/3548743987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0f9860 msgr2=0x7fa40c0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 --2- 172.21.15.33:0/3548743987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0f9860 0x7fa40c0fbc70 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fa3f4004660 tx=0x7fa3f4009b30).stop 2022-02-02T14:29:58.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 -- 172.21.15.33:0/3548743987 shutdown_connections 2022-02-02T14:29:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 --2- 172.21.15.33:0/3548743987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0f9860 0x7fa40c0fbc70 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 --2- 172.21.15.33:0/3548743987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.201+0000 7fa412037700 1 -- 172.21.15.33:0/3548743987 >> 172.21.15.33:0/3548743987 conn(0x7fa40c0f0d40 msgr2=0x7fa40c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.202+0000 7fa412037700 1 -- 172.21.15.33:0/3548743987 shutdown_connections 2022-02-02T14:29:58.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.202+0000 7fa412037700 1 -- 172.21.15.33:0/3548743987 wait complete. 2022-02-02T14:29:58.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.202+0000 7fa412037700 1 Processor -- start 2022-02-02T14:29:58.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.202+0000 7fa412037700 1 -- start start 2022-02-02T14:29:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa412037700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa412037700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 0x7fa40c0f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa412037700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0f5740 con 0x7fa40c0602d0 2022-02-02T14:29:58.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa412037700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40c0f5880 con 0x7fa40c0f9860 2022-02-02T14:29:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33168/0 (socket says 172.21.15.33:33168) 2022-02-02T14:29:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 -- 172.21.15.33:0/753212657 learned_addr learned my addr 172.21.15.33:0/753212657 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:58.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40affd700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 0x7fa40c0f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 -- 172.21.15.33:0/753212657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 msgr2=0x7fa40c0f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 0x7fa40c0f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 -- 172.21.15.33:0/753212657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4005040 con 0x7fa40c0602d0 2022-02-02T14:29:58.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40affd700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 0x7fa40c0f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:29:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.203+0000 7fa40b7fe700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fa3fc00e7f0 tx=0x7fa3fc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.204+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc0092e0 con 0x7fa40c0602d0 2022-02-02T14:29:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.204+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa40c0f5b60 con 0x7fa40c0602d0 2022-02-02T14:29:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.204+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa3fc00f040 con 0x7fa40c0602d0 2022-02-02T14:29:58.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.204+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa40c10eef0 con 0x7fa40c0602d0 2022-02-02T14:29:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.204+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3fc014720 con 0x7fa40c0602d0 2022-02-02T14:29:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.205+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40c045ad0 con 0x7fa40c0602d0 2022-02-02T14:29:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.205+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa3fc01b030 con 0x7fa40c0602d0 2022-02-02T14:29:58.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.206+0000 7fa403fff700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 0x7fa3f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.206+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa3fc0817e0 con 0x7fa40c0602d0 2022-02-02T14:29:58.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.206+0000 7fa40affd700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 0x7fa3f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.206+0000 7fa40affd700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 0x7fa3f8067290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa3f4005010 tx=0x7fa3f400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.210+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa3fc04f940 con 0x7fa40c0602d0 2022-02-02T14:29:58.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.399+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa40c0feff0 con 0x7fa3f8064dd0 2022-02-02T14:29:58.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.401+0000 7fa403fff700 1 -- 172.21.15.33:0/753212657 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa40c0feff0 con 0x7fa3f8064dd0 2022-02-02T14:29:58.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 msgr2=0x7fa3f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 0x7fa3f8067290 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fa3f4005010 tx=0x7fa3f400b040).stop 2022-02-02T14:29:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 msgr2=0x7fa40c0f6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fa3fc00e7f0 tx=0x7fa3fc00b040).stop 2022-02-02T14:29:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 shutdown_connections 2022-02-02T14:29:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa3f8064dd0 0x7fa3f8067290 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa40c0602d0 0x7fa40c0f6d60 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 --2- 172.21.15.33:0/753212657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40c0f9860 0x7fa40c0f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.402+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 >> 172.21.15.33:0/753212657 conn(0x7fa40c0f0d40 msgr2=0x7fa40c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.403+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 shutdown_connections 2022-02-02T14:29:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.403+0000 7fa412037700 1 -- 172.21.15.33:0/753212657 wait complete. 2022-02-02T14:29:58.412 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:29:58.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:58 smithi033 ceph-mon[101165]: pgmap v1537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 -- 172.21.15.33:0/708863754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f55c0 msgr2=0x7f00a00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/708863754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f55c0 0x7f00a00f59e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f0090004660 tx=0x7f0090009b30).stop 2022-02-02T14:29:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 -- 172.21.15.33:0/708863754 shutdown_connections 2022-02-02T14:29:58.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/708863754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f6860 0x7f00a00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/708863754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f55c0 0x7f00a00f59e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 -- 172.21.15.33:0/708863754 >> 172.21.15.33:0/708863754 conn(0x7f00a00f0d40 msgr2=0x7f00a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:58.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 -- 172.21.15.33:0/708863754 shutdown_connections 2022-02-02T14:29:58.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.504+0000 7f00a4e0a700 1 -- 172.21.15.33:0/708863754 wait complete. 2022-02-02T14:29:58.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 Processor -- start 2022-02-02T14:29:58.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 -- start start 2022-02-02T14:29:58.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f55c0 0x7f00a0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a00603e0 con 0x7f00a00f6860 2022-02-02T14:29:58.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f00a4e0a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a0060520 con 0x7f00a00f55c0 2022-02-02T14:29:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33178/0 (socket says 172.21.15.33:33178) 2022-02-02T14:29:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 -- 172.21.15.33:0/930081348 learned_addr learned my addr 172.21.15.33:0/930081348 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:58.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009e59c700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f55c0 0x7f00a0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 -- 172.21.15.33:0/930081348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f55c0 msgr2=0x7f00a0109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f55c0 0x7f00a0109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 -- 172.21.15.33:0/930081348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0090005040 con 0x7f00a00f6860 2022-02-02T14:29:58.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.505+0000 7f009dd9b700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f00940026d0 tx=0x7f0094009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.506+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00940079c0 con 0x7f00a00f6860 2022-02-02T14:29:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.506+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a010c720 con 0x7f00a00f6860 2022-02-02T14:29:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.506+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f009400f040 con 0x7f00a00f6860 2022-02-02T14:29:58.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.506+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00940148b0 con 0x7f00a00f6860 2022-02-02T14:29:58.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.506+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a010cce0 con 0x7f00a00f6860 2022-02-02T14:29:58.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.507+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00a0045ad0 con 0x7f00a00f6860 2022-02-02T14:29:58.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.507+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0094007b20 con 0x7f00a00f6860 2022-02-02T14:29:58.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.507+0000 7f008effd700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 0x7f0088067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.508+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0094081a30 con 0x7f00a00f6860 2022-02-02T14:29:58.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.508+0000 7f009e59c700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 0x7f0088067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.508+0000 7f009e59c700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 0x7f0088067290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f0090013690 tx=0x7f0090009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.512+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f009404fae0 con 0x7f00a00f6860 2022-02-02T14:29:58.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:58 smithi037 ceph-mon[69017]: pgmap v1537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:29:58.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.694+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f00a0057f10 con 0x7f0088064dd0 2022-02-02T14:29:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.709+0000 7f008effd700 1 -- 172.21.15.33:0/930081348 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f00a0057f10 con 0x7f0088064dd0 2022-02-02T14:29:58.708 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:29:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (55m) 17m ago 56m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:29:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (48m) 17m ago 56m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:29:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (48m) 17m ago 55m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:29:58.709 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (55m) 17m ago 56m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:29:58.710 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (48m) 17m ago 52m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:29:58.710 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (49m) 17m ago 52m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:29:58.710 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (50m) 17m ago 52m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:29:58.711 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (52m) 17m ago 52m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:29:58.711 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (49m) 17m ago 57m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:29:58.711 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (49m) 17m ago 55m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:29:58.711 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (49m) 17m ago 57m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:29:58.712 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (48m) 17m ago 55m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:29:58.712 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (55m) 17m ago 55m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:29:58.712 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (55m) 17m ago 55m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:29:58.712 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 17m ago 54m - 4096M 2022-02-02T14:29:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (54m) 17m ago 54m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:29:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (54m) 17m ago 54m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:29:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (54m) 17m ago 54m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:29:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (53m) 17m ago 53m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:29:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (53m) 17m ago 53m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:29:58.714 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (55m) 17m ago 55m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:29:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 msgr2=0x7f0088067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 0x7f0088067290 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f0090013690 tx=0x7f0090009b30).stop 2022-02-02T14:29:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 msgr2=0x7f00a010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f00940026d0 tx=0x7f0094009de0).stop 2022-02-02T14:29:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 shutdown_connections 2022-02-02T14:29:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0088064dd0 0x7f0088067290 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00a00f55c0 0x7f00a0109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 --2- 172.21.15.33:0/930081348 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00a00f6860 0x7f00a010c170 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.710+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 >> 172.21.15.33:0/930081348 conn(0x7f00a00f0d40 msgr2=0x7f00a00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.711+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 shutdown_connections 2022-02-02T14:29:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.711+0000 7f00a4e0a700 1 -- 172.21.15.33:0/930081348 wait complete. 2022-02-02T14:29:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 -- 172.21.15.33:0/3479748108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 msgr2=0x7f49740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 --2- 172.21.15.33:0/3479748108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f49740f59e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f4964004660 tx=0x7f4964009b30).stop 2022-02-02T14:29:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 -- 172.21.15.33:0/3479748108 shutdown_connections 2022-02-02T14:29:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 --2- 172.21.15.33:0/3479748108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f49740f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 --2- 172.21.15.33:0/3479748108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f49740f59e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 -- 172.21.15.33:0/3479748108 >> 172.21.15.33:0/3479748108 conn(0x7f49740f0de0 msgr2=0x7f49740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 -- 172.21.15.33:0/3479748108 shutdown_connections 2022-02-02T14:29:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.810+0000 7f49797f6700 1 -- 172.21.15.33:0/3479748108 wait complete. 2022-02-02T14:29:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 Processor -- start 2022-02-02T14:29:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 -- start start 2022-02-02T14:29:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f4974107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49741079e0 con 0x7f49740f55c0 2022-02-02T14:29:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49797f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4974107b20 con 0x7f49740f5ed0 2022-02-02T14:29:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f4972ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f49727fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f4974107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f4972ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33186/0 (socket says 172.21.15.33:33186) 2022-02-02T14:29:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.811+0000 7f4972ffd700 1 -- 172.21.15.33:0/2653502550 learned_addr learned my addr 172.21.15.33:0/2653502550 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f4972ffd700 1 -- 172.21.15.33:0/2653502550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 msgr2=0x7f4974107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f4972ffd700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f4974107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f4972ffd700 1 -- 172.21.15.33:0/2653502550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964005040 con 0x7f49740f55c0 2022-02-02T14:29:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f49727fc700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f4974107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:29:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f4972ffd700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f4964009990 tx=0x7f4964009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4964018070 con 0x7f49740f55c0 2022-02-02T14:29:58.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4964007ba0 con 0x7f49740f55c0 2022-02-02T14:29:58.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4974108460 con 0x7f49740f55c0 2022-02-02T14:29:58.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f496401c3c0 con 0x7f49740f55c0 2022-02-02T14:29:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.812+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49741089c0 con 0x7f49740f55c0 2022-02-02T14:29:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.814+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4974045ad0 con 0x7f49740f55c0 2022-02-02T14:29:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.814+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f496401d420 con 0x7f49740f55c0 2022-02-02T14:29:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.815+0000 7f495b7fe700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.815+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4964083680 con 0x7f49740f55c0 2022-02-02T14:29:58.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.815+0000 7f49727fc700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:58.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.815+0000 7f49727fc700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 0x7f495c067290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f496800f580 tx=0x7f4968011040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:58.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:58.820+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4964055160 con 0x7f49740f55c0 2022-02-02T14:29:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.062+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f49740f7b20 con 0x7f49740f55c0 2022-02-02T14:29:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.063+0000 7f495b7fe700 1 -- 172.21.15.33:0/2653502550 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4964054d50 con 0x7f49740f55c0 2022-02-02T14:29:59.063 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:29:59.063 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:29:59.064 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:29:59.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:59.064 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:29:59.064 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:29:59.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:59.065 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:29:59.065 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:29:59.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:59.065 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:29:59.066 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:29:59.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:29:59.066 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:29:59.066 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:29:59.066 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:29:59.067 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:29:59.067 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:29:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 msgr2=0x7f495c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 0x7f495c067290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f496800f580 tx=0x7f4968011040).stop 2022-02-02T14:29:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 msgr2=0x7f4974106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f4964009990 tx=0x7f4964009b30).stop 2022-02-02T14:29:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 shutdown_connections 2022-02-02T14:29:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f495c064dd0 0x7f495c067290 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49740f55c0 0x7f4974106f40 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 --2- 172.21.15.33:0/2653502550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49740f5ed0 0x7f4974107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 >> 172.21.15.33:0/2653502550 conn(0x7f49740f0de0 msgr2=0x7f497405ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 shutdown_connections 2022-02-02T14:29:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.065+0000 7f49797f6700 1 -- 172.21.15.33:0/2653502550 wait complete. 2022-02-02T14:29:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/3301406735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 msgr2=0x7fe0c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/3301406735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c00f6b00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7fe0b4004660 tx=0x7fe0b4009b30).stop 2022-02-02T14:29:59.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/3301406735 shutdown_connections 2022-02-02T14:29:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/3301406735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/3301406735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c00f6b00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/3301406735 >> 172.21.15.33:0/3301406735 conn(0x7fe0c00f1e40 msgr2=0x7fe0c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:59.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/3301406735 shutdown_connections 2022-02-02T14:29:59.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.166+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/3301406735 wait complete. 2022-02-02T14:29:59.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 Processor -- start 2022-02-02T14:29:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 -- start start 2022-02-02T14:29:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:59.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006a380 con 0x7fe0c00f66e0 2022-02-02T14:29:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0c5f3a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c006a4c0 con 0x7fe0c00f7980 2022-02-02T14:29:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0bf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:59.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0beffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43914/0 (socket says 172.21.15.33:43914) 2022-02-02T14:29:59.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.167+0000 7fe0beffd700 1 -- 172.21.15.33:0/301666615 learned_addr learned my addr 172.21.15.33:0/301666615 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:29:59.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0bf7fe700 1 -- 172.21.15.33:0/301666615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 msgr2=0x7fe0c0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0bf7fe700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0bf7fe700 1 -- 172.21.15.33:0/301666615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4005040 con 0x7fe0c00f66e0 2022-02-02T14:29:59.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0beffd700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:29:59.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0bf7fe700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c006b9a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fe0c00f77e0 tx=0x7fe0b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:59.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b4019070 con 0x7fe0c00f66e0 2022-02-02T14:29:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c006a740 con 0x7fe0c00f66e0 2022-02-02T14:29:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0b4007e70 con 0x7fe0c00f66e0 2022-02-02T14:29:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c006aca0 con 0x7fe0c00f66e0 2022-02-02T14:29:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.168+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0b4014c20 con 0x7fe0c00f66e0 2022-02-02T14:29:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.170+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0004fa0 con 0x7fe0c00f66e0 2022-02-02T14:29:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.170+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0b4025070 con 0x7fe0c00f66e0 2022-02-02T14:29:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.170+0000 7fe0a7fff700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 0x7fe0a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:29:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.170+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe0b4082940 con 0x7fe0c00f66e0 2022-02-02T14:29:59.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.170+0000 7fe0beffd700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 0x7fe0a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:29:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.171+0000 7fe0beffd700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 0x7fe0a8067290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe0b0004fd0 tx=0x7fe0b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:29:59.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.174+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0b40509f0 con 0x7fe0c00f66e0 2022-02-02T14:29:59.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.388+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe0a0005e80 con 0x7fe0c00f66e0 2022-02-02T14:29:59.388 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:29:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2653502550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:29:59.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.389+0000 7fe0a7fff700 1 -- 172.21.15.33:0/301666615 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe0b4023020 con 0x7fe0c00f66e0 2022-02-02T14:29:59.389 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:29:59.390 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:29:59.390 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:29:59.390 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:29:59.390 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:59.391 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:29:59.391 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:29:59.391 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:29:59.391 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:29:59.391 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:29:59.392 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:29:59.392 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:29:59.392 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:29:59.392 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:29:59.393 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:29:59.393 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:29:59.393 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:29:59.393 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:29:59.393 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:29:59.394 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:29:59.394 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:29:59.394 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:29:59.394 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:29:59.395 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:29:59.395 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:29:59.395 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:29:59.395 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:29:59.396 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:29:59.396 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:29:59.396 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:29:59.396 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:29:59.396 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:59.397 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:59.397 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:29:59.397 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:29:59.397 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:59.397 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:59.398 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:59.398 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:29:59.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 msgr2=0x7fe0a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 0x7fe0a8067290 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fe0b0004fd0 tx=0x7fe0b000b040).stop 2022-02-02T14:29:59.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 msgr2=0x7fe0c006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:29:59.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c006b9a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fe0c00f77e0 tx=0x7fe0b400b040).stop 2022-02-02T14:29:59.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 shutdown_connections 2022-02-02T14:29:59.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a8064dd0 0x7fe0a8067290 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0c00f66e0 0x7fe0c006b9a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 --2- 172.21.15.33:0/301666615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0c00f7980 0x7fe0c0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:29:59.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 >> 172.21.15.33:0/301666615 conn(0x7fe0c00f1e40 msgr2=0x7fe0c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:29:59.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 shutdown_connections 2022-02-02T14:29:59.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:29:59.392+0000 7fe0c5f3a700 1 -- 172.21.15.33:0/301666615 wait complete. 2022-02-02T14:29:59.402 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:29:59.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:29:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2653502550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:30:00.258 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 conmon[101141]: 2022-02-02T14:29:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:30:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:00 smithi037 ceph-mon[69017]: from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:00 smithi037 ceph-mon[69017]: from='client.35658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:00 smithi037 ceph-mon[69017]: pgmap v1538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:00 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/301666615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:30:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:30:00.743 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 ceph-mon[101165]: from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:00.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 ceph-mon[101165]: from='client.35658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:00.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 ceph-mon[101165]: pgmap v1538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:00.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/301666615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:30:00.745 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:30:02.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:02 smithi037 ceph-mon[69017]: pgmap v1539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:02 smithi033 ceph-mon[101165]: pgmap v1539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:04.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:04 smithi037 ceph-mon[69017]: pgmap v1540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:04 smithi033 ceph-mon[101165]: pgmap v1540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:06.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:06 smithi037 ceph-mon[69017]: pgmap v1541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:06 smithi033 ceph-mon[101165]: pgmap v1541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:08.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:08 smithi037 ceph-mon[69017]: pgmap v1542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:08 smithi033 ceph-mon[101165]: pgmap v1542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:10.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:10 smithi037 ceph-mon[69017]: pgmap v1543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:10 smithi033 ceph-mon[101165]: pgmap v1543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:12.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:12 smithi037 ceph-mon[69017]: pgmap v1544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:12 smithi033 ceph-mon[101165]: pgmap v1544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:14.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:14 smithi037 ceph-mon[69017]: pgmap v1545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:14 smithi033 ceph-mon[101165]: pgmap v1545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:16.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:16 smithi037 ceph-mon[69017]: pgmap v1546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:16 smithi033 ceph-mon[101165]: pgmap v1546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:18.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:18 smithi037 ceph-mon[69017]: pgmap v1547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:18 smithi033 ceph-mon[101165]: pgmap v1547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:20.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:20 smithi037 ceph-mon[69017]: pgmap v1548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:20 smithi033 ceph-mon[101165]: pgmap v1548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:22 smithi033 ceph-mon[101165]: pgmap v1549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:22 smithi037 ceph-mon[69017]: pgmap v1549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:24 smithi033 ceph-mon[101165]: pgmap v1550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:24 smithi037 ceph-mon[69017]: pgmap v1550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:26 smithi033 ceph-mon[101165]: pgmap v1551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:26 smithi037 ceph-mon[69017]: pgmap v1551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:28 smithi033 ceph-mon[101165]: pgmap v1552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:28 smithi037 ceph-mon[69017]: pgmap v1552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:29.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 -- 172.21.15.33:0/1305463095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 msgr2=0x7f56000f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 --2- 172.21.15.33:0/1305463095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f56000f5850 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f55f0004660 tx=0x7f55f0009b30).stop 2022-02-02T14:30:29.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 -- 172.21.15.33:0/1305463095 shutdown_connections 2022-02-02T14:30:29.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 --2- 172.21.15.33:0/1305463095 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f56000f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 --2- 172.21.15.33:0/1305463095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f56000f5850 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 -- 172.21.15.33:0/1305463095 >> 172.21.15.33:0/1305463095 conn(0x7f56000f0b90 msgr2=0x7f56000f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:29.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 -- 172.21.15.33:0/1305463095 shutdown_connections 2022-02-02T14:30:29.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 -- 172.21.15.33:0/1305463095 wait complete. 2022-02-02T14:30:29.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.508+0000 7f55ff59e700 1 Processor -- start 2022-02-02T14:30:29.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55ff59e700 1 -- start start 2022-02-02T14:30:29.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55ff59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f5600107320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55ff59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600107920 con 0x7f56000f5430 2022-02-02T14:30:29.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55ff59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5600108130 con 0x7f56000f66d0 2022-02-02T14:30:29.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33206/0 (socket says 172.21.15.33:33206) 2022-02-02T14:30:29.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 -- 172.21.15.33:0/2051162670 learned_addr learned my addr 172.21.15.33:0/2051162670 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:30:29.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fdd9b700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f5600107320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 -- 172.21.15.33:0/2051162670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 msgr2=0x7f5600107320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f5600107320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 -- 172.21.15.33:0/2051162670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0005040 con 0x7f56000f5430 2022-02-02T14:30:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fdd9b700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f5600107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:30:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.509+0000 7f55fe59c700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f55f0013a70 tx=0x7f55f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:29.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.510+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f0018070 con 0x7f56000f5430 2022-02-02T14:30:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.510+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55f00097d0 con 0x7f56000f5430 2022-02-02T14:30:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.510+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5600108350 con 0x7f56000f5430 2022-02-02T14:30:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.510+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f001c3c0 con 0x7f56000f5430 2022-02-02T14:30:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.510+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56001088b0 con 0x7f56000f5430 2022-02-02T14:30:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.511+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5600059100 con 0x7f56000f5430 2022-02-02T14:30:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.511+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55f0007ba0 con 0x7f56000f5430 2022-02-02T14:30:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.512+0000 7f55eeffd700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 0x7f55e80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.512+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f55f0083720 con 0x7f56000f5430 2022-02-02T14:30:29.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.512+0000 7f55fdd9b700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 0x7f55e80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.512+0000 7f55fdd9b700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 0x7f55e80672e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f55f4004bb0 tx=0x7f55f400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.516+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55f0051710 con 0x7f56000f5430 2022-02-02T14:30:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.705+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56000fab10 con 0x7f55e8064e20 2022-02-02T14:30:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.706+0000 7f55eeffd700 1 -- 172.21.15.33:0/2051162670 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f56000fab10 con 0x7f55e8064e20 2022-02-02T14:30:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 msgr2=0x7f55e80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 0x7f55e80672e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f55f4004bb0 tx=0x7f55f400b040).stop 2022-02-02T14:30:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 msgr2=0x7f5600106e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f55f0013a70 tx=0x7f55f0009b30).stop 2022-02-02T14:30:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 shutdown_connections 2022-02-02T14:30:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55e8064e20 0x7f55e80672e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56000f5430 0x7f5600106e30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 --2- 172.21.15.33:0/2051162670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56000f66d0 0x7f5600107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.708+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 >> 172.21.15.33:0/2051162670 conn(0x7f56000f0b90 msgr2=0x7f560005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.709+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 shutdown_connections 2022-02-02T14:30:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.709+0000 7f55ff59e700 1 -- 172.21.15.33:0/2051162670 wait complete. 2022-02-02T14:30:29.718 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:30:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 -- 172.21.15.33:0/2219669741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f6860 msgr2=0x7ff4800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 --2- 172.21.15.33:0/2219669741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f6860 0x7ff4800f6cc0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7ff468004660 tx=0x7ff468009b30).stop 2022-02-02T14:30:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 -- 172.21.15.33:0/2219669741 shutdown_connections 2022-02-02T14:30:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 --2- 172.21.15.33:0/2219669741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f6860 0x7ff4800f6cc0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 --2- 172.21.15.33:0/2219669741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f55c0 0x7ff4800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 -- 172.21.15.33:0/2219669741 >> 172.21.15.33:0/2219669741 conn(0x7ff4800f0d40 msgr2=0x7ff4800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 -- 172.21.15.33:0/2219669741 shutdown_connections 2022-02-02T14:30:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.810+0000 7ff484e43700 1 -- 172.21.15.33:0/2219669741 wait complete. 2022-02-02T14:30:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 Processor -- start 2022-02-02T14:30:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 -- start start 2022-02-02T14:30:29.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f6860 0x7ff4801073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480107990 con 0x7ff4800f55c0 2022-02-02T14:30:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff484e43700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480107ad0 con 0x7ff4800f6860 2022-02-02T14:30:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33216/0 (socket says 172.21.15.33:33216) 2022-02-02T14:30:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 -- 172.21.15.33:0/1032491074 learned_addr learned my addr 172.21.15.33:0/1032491074 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:30:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47dd9b700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f6860 0x7ff4801073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 -- 172.21.15.33:0/1032491074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f6860 msgr2=0x7ff4801073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f6860 0x7ff4801073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.811+0000 7ff47e59c700 1 -- 172.21.15.33:0/1032491074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468005040 con 0x7ff4800f55c0 2022-02-02T14:30:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff47e59c700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7ff47000e7c0 tx=0x7ff47000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4700092e0 con 0x7ff4800f55c0 2022-02-02T14:30:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff47000f040 con 0x7ff4800f55c0 2022-02-02T14:30:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480108470 con 0x7ff4800f55c0 2022-02-02T14:30:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4700147e0 con 0x7ff4800f55c0 2022-02-02T14:30:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.812+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff480108a30 con 0x7ff4800f55c0 2022-02-02T14:30:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.813+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff480045ad0 con 0x7ff4800f55c0 2022-02-02T14:30:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.814+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff47001b030 con 0x7ff4800f55c0 2022-02-02T14:30:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.814+0000 7ff476ffd700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 0x7ff46c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.814+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff470081a00 con 0x7ff4800f55c0 2022-02-02T14:30:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.814+0000 7ff47dd9b700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 0x7ff46c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.815+0000 7ff47dd9b700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 0x7ff46c067290 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7ff468005010 tx=0x7ff468016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:29.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:29.818+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff4700534e0 con 0x7ff4800f55c0 2022-02-02T14:30:30.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.001+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4800faca0 con 0x7ff46c064dd0 2022-02-02T14:30:30.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.015+0000 7ff476ffd700 1 -- 172.21.15.33:0/1032491074 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff4800faca0 con 0x7ff46c064dd0 2022-02-02T14:30:30.016 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:30:30.016 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (55m) 17m ago 56m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:30:30.017 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (48m) 17m ago 56m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:30:30.017 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (48m) 17m ago 56m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:30:30.018 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (55m) 17m ago 56m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:30:30.018 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (49m) 17m ago 52m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:30:30.019 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (49m) 17m ago 52m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:30:30.019 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (50m) 17m ago 53m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:30:30.019 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (52m) 17m ago 52m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:30:30.020 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (50m) 17m ago 58m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:30:30.020 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (49m) 17m ago 56m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:30:30.021 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (49m) 17m ago 58m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:30:30.021 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (49m) 17m ago 56m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:30:30.022 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (56m) 17m ago 56m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:30:30.022 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (56m) 17m ago 56m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:30:30.023 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 17m ago 55m - 4096M 2022-02-02T14:30:30.023 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (55m) 17m ago 55m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:30:30.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (54m) 17m ago 54m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:30:30.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (54m) 17m ago 54m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:30:30.024 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (54m) 17m ago 54m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:30:30.025 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (54m) 17m ago 54m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:30:30.025 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (55m) 17m ago 56m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:30:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 msgr2=0x7ff46c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 0x7ff46c067290 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7ff468005010 tx=0x7ff468016040).stop 2022-02-02T14:30:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 msgr2=0x7ff480106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7ff47000e7c0 tx=0x7ff47000b040).stop 2022-02-02T14:30:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 shutdown_connections 2022-02-02T14:30:30.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff46c064dd0 0x7ff46c067290 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4800f55c0 0x7ff480106ef0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 --2- 172.21.15.33:0/1032491074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4800f6860 0x7ff4801073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 >> 172.21.15.33:0/1032491074 conn(0x7ff4800f0d40 msgr2=0x7ff48005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 shutdown_connections 2022-02-02T14:30:30.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.017+0000 7ff484e43700 1 -- 172.21.15.33:0/1032491074 wait complete. 2022-02-02T14:30:30.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 -- 172.21.15.33:0/938715225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 msgr2=0x7f7bec0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/938715225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec0f7de0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7be4009a30 tx=0x7f7be4004c50).stop 2022-02-02T14:30:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 -- 172.21.15.33:0/938715225 shutdown_connections 2022-02-02T14:30:30.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/938715225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec0f7de0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/938715225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 -- 172.21.15.33:0/938715225 >> 172.21.15.33:0/938715225 conn(0x7f7bec0f1e40 msgr2=0x7f7bec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:30.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.117+0000 7f7bf2e69700 1 -- 172.21.15.33:0/938715225 shutdown_connections 2022-02-02T14:30:30.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 -- 172.21.15.33:0/938715225 wait complete. 2022-02-02T14:30:30.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 Processor -- start 2022-02-02T14:30:30.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 -- start start 2022-02-02T14:30:30.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec107990 con 0x7f7bec0f66e0 2022-02-02T14:30:30.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.118+0000 7f7bf2e69700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec107ad0 con 0x7f7bec0f7980 2022-02-02T14:30:30.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33226/0 (socket says 172.21.15.33:33226) 2022-02-02T14:30:30.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 -- 172.21.15.33:0/459601793 learned_addr learned my addr 172.21.15.33:0/459601793 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:30:30.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bebfff700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 -- 172.21.15.33:0/459601793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 msgr2=0x7f7bec1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 -- 172.21.15.33:0/459601793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4009640 con 0x7f7bec0f66e0 2022-02-02T14:30:30.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bebfff700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:30:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf0c05700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f7bd40041d0 tx=0x7f7bd400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd40092e0 con 0x7f7bec0f66e0 2022-02-02T14:30:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec108470 con 0x7f7bec0f66e0 2022-02-02T14:30:30.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7bd400f040 con 0x7f7bec0f66e0 2022-02-02T14:30:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.119+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd4014860 con 0x7f7bec0f66e0 2022-02-02T14:30:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.120+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec108a30 con 0x7f7bec0f66e0 2022-02-02T14:30:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.121+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec045ad0 con 0x7f7bec0f66e0 2022-02-02T14:30:30.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.121+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7bd401b030 con 0x7f7bec0f66e0 2022-02-02T14:30:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.121+0000 7f7be97fa700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 0x7f7bd8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.122+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7bd40819d0 con 0x7f7bec0f66e0 2022-02-02T14:30:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.122+0000 7f7bebfff700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 0x7f7bd8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.122+0000 7f7bebfff700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 0x7f7bd8067270 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f7be400b3b0 tx=0x7f7be4004c50).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:30.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.126+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7bd40534b0 con 0x7f7bec0f66e0 2022-02-02T14:30:30.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.371+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7bec0fef70 con 0x7f7bec0f66e0 2022-02-02T14:30:30.371 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:30 smithi033 ceph-mon[101165]: pgmap v1553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.371+0000 7f7be97fa700 1 -- 172.21.15.33:0/459601793 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7bd40530a0 con 0x7f7bec0f66e0 2022-02-02T14:30:30.372 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:30:30.373 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:30:30.373 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:30:30.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:30:30.374 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:30:30.374 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:30:30.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:30:30.374 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:30:30.375 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:30:30.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:30:30.375 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:30:30.375 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:30:30.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:30:30.376 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:30:30.376 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:30:30.376 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:30:30.376 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:30:30.377 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:30:30.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 msgr2=0x7f7bd8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 0x7f7bd8067270 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f7be400b3b0 tx=0x7f7be4004c50).stop 2022-02-02T14:30:30.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 msgr2=0x7f7bec106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f7bd40041d0 tx=0x7f7bd400b040).stop 2022-02-02T14:30:30.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 shutdown_connections 2022-02-02T14:30:30.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bd8064db0 0x7f7bd8067270 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bec0f66e0 0x7f7bec106ef0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 --2- 172.21.15.33:0/459601793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec0f7980 0x7f7bec1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 >> 172.21.15.33:0/459601793 conn(0x7f7bec0f1e40 msgr2=0x7f7bec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:30.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 shutdown_connections 2022-02-02T14:30:30.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.373+0000 7f7bf2e69700 1 -- 172.21.15.33:0/459601793 wait complete. 2022-02-02T14:30:30.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.476+0000 7ff9f1470700 1 -- 172.21.15.33:0/2493565086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 msgr2=0x7ff9ec0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.476+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2493565086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec0f5850 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7ff9dc004660 tx=0x7ff9dc009b30).stop 2022-02-02T14:30:30.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 -- 172.21.15.33:0/2493565086 shutdown_connections 2022-02-02T14:30:30.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2493565086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 0x7ff9ec0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2493565086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec0f5850 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 -- 172.21.15.33:0/2493565086 >> 172.21.15.33:0/2493565086 conn(0x7ff9ec0f0b90 msgr2=0x7ff9ec0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:30.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 -- 172.21.15.33:0/2493565086 shutdown_connections 2022-02-02T14:30:30.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 -- 172.21.15.33:0/2493565086 wait complete. 2022-02-02T14:30:30.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.477+0000 7ff9f1470700 1 Processor -- start 2022-02-02T14:30:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9f1470700 1 -- start start 2022-02-02T14:30:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9f1470700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9f1470700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 0x7ff9ec1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9f1470700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec106760 con 0x7ff9ec0f5430 2022-02-02T14:30:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9f1470700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec106f60 con 0x7ff9ec0f66d0 2022-02-02T14:30:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33236/0 (socket says 172.21.15.33:33236) 2022-02-02T14:30:30.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 -- 172.21.15.33:0/2824410339 learned_addr learned my addr 172.21.15.33:0/2824410339 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:30:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 0x7ff9ec1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 -- 172.21.15.33:0/2824410339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 msgr2=0x7ff9ec1061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 0x7ff9ec1061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 -- 172.21.15.33:0/2824410339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc005040 con 0x7ff9ec0f5430 2022-02-02T14:30:30.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.478+0000 7ff9ebfff700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7ff9dc014040 tx=0x7ff9dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.479+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc019070 con 0x7ff9ec0f5430 2022-02-02T14:30:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.479+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9dc007e70 con 0x7ff9ec0f5430 2022-02-02T14:30:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.479+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec107160 con 0x7ff9ec0f5430 2022-02-02T14:30:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.479+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9dc014d10 con 0x7ff9ec0f5430 2022-02-02T14:30:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.479+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec107690 con 0x7ff9ec0f5430 2022-02-02T14:30:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.480+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec059100 con 0x7ff9ec0f5430 2022-02-02T14:30:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.480+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9dc025070 con 0x7ff9ec0f5430 2022-02-02T14:30:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.480+0000 7ff9e8ff9700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 0x7ff9d40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:30:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.480+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9dc082a90 con 0x7ff9ec0f5430 2022-02-02T14:30:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.481+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 0x7ff9d40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:30:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.481+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 0x7ff9d40672e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff9e0009fd0 tx=0x7ff9e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:30:30.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.485+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9dc054570 con 0x7ff9ec0f5430 2022-02-02T14:30:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.696+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff9ec0ff600 con 0x7ff9ec0f5430 2022-02-02T14:30:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.697+0000 7ff9e8ff9700 1 -- 172.21.15.33:0/2824410339 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff9dc023070 con 0x7ff9ec0f5430 2022-02-02T14:30:30.697 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:30:30.697 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:30:30.697 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:30:30.697 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:30:30.698 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:30:30.698 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:30:30.698 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:30:30.698 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:30:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:30:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:30:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:30:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:30:30.699 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:30:30.700 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:30:30.700 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:30:30.700 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:30:30.701 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:30:30.701 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:30:30.702 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:30:30.702 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:30:30.702 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:30:30.702 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:30:30.702 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:30:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:30:30.703 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:30:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:30:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:30:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:30:30.704 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:30:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:30:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:30:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:30:30.705 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:30:30.705 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:30:30.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:30:30.706 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:30:30.706 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:30:30.706 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:30:30.707 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:30:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.698+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 msgr2=0x7ff9d40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.698+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 0x7ff9d40672e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7ff9e0009fd0 tx=0x7ff9e000b040).stop 2022-02-02T14:30:30.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.698+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 msgr2=0x7ff9ec105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:30:30.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.698+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7ff9dc014040 tx=0x7ff9dc00b040).stop 2022-02-02T14:30:30.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 shutdown_connections 2022-02-02T14:30:30.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9d4064e20 0x7ff9d40672e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0f5430 0x7ff9ec105cc0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 --2- 172.21.15.33:0/2824410339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9ec0f66d0 0x7ff9ec1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:30:30.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 >> 172.21.15.33:0/2824410339 conn(0x7ff9ec0f0b90 msgr2=0x7ff9ec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:30:30.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 shutdown_connections 2022-02-02T14:30:30.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:30:30.699+0000 7ff9f1470700 1 -- 172.21.15.33:0/2824410339 wait complete. 2022-02-02T14:30:30.712 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:30:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:30 smithi037 ceph-mon[69017]: pgmap v1553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:31.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:31 smithi033 ceph-mon[101165]: from='client.35670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:31.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:31 smithi033 ceph-mon[101165]: from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:31.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/459601793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:30:31.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2824410339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:30:31.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:31 smithi037 ceph-mon[69017]: from='client.35670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:31 smithi037 ceph-mon[69017]: from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:30:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/459601793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:30:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2824410339' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:30:32.581 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:32 smithi033 ceph-mon[101165]: pgmap v1554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:32 smithi037 ceph-mon[69017]: pgmap v1554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:34 smithi033 ceph-mon[101165]: pgmap v1555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:34 smithi037 ceph-mon[69017]: pgmap v1555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:36 smithi033 ceph-mon[101165]: pgmap v1556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:36 smithi037 ceph-mon[69017]: pgmap v1556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:38 smithi033 ceph-mon[101165]: pgmap v1557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:38 smithi037 ceph-mon[69017]: pgmap v1557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:40 smithi033 ceph-mon[101165]: pgmap v1558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:40 smithi037 ceph-mon[69017]: pgmap v1558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:42 smithi033 ceph-mon[101165]: pgmap v1559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:42 smithi037 ceph-mon[69017]: pgmap v1559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:44 smithi033 ceph-mon[101165]: pgmap v1560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:44 smithi037 ceph-mon[69017]: pgmap v1560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:46 smithi033 ceph-mon[101165]: pgmap v1561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:46 smithi037 ceph-mon[69017]: pgmap v1561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:48 smithi033 ceph-mon[101165]: pgmap v1562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:48 smithi037 ceph-mon[69017]: pgmap v1562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:50 smithi033 ceph-mon[101165]: pgmap v1563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:50 smithi037 ceph-mon[69017]: pgmap v1563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:52 smithi033 ceph-mon[101165]: pgmap v1564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:52 smithi037 ceph-mon[69017]: pgmap v1564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:54 smithi033 ceph-mon[101165]: pgmap v1565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:54 smithi037 ceph-mon[69017]: pgmap v1565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:30:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:30:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:30:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:30:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:56 smithi033 ceph-mon[101165]: pgmap v1566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:56 smithi037 ceph-mon[69017]: pgmap v1566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:58.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:30:58 smithi033 ceph-mon[101165]: pgmap v1567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:30:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:30:58 smithi037 ceph-mon[69017]: pgmap v1567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:00 smithi033 ceph-mon[101165]: pgmap v1568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:00 smithi037 ceph-mon[69017]: pgmap v1568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:00.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 -- 172.21.15.33:0/4090350643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f6860 msgr2=0x7f62100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:00.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 --2- 172.21.15.33:0/4090350643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f6860 0x7f62100f6cc0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f620c004660 tx=0x7f620c009b30).stop 2022-02-02T14:31:00.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 -- 172.21.15.33:0/4090350643 shutdown_connections 2022-02-02T14:31:00.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 --2- 172.21.15.33:0/4090350643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f6860 0x7f62100f6cc0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:00.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 --2- 172.21.15.33:0/4090350643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f55c0 0x7f62100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 -- 172.21.15.33:0/4090350643 >> 172.21.15.33:0/4090350643 conn(0x7f62100f0d40 msgr2=0x7f62100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 -- 172.21.15.33:0/4090350643 shutdown_connections 2022-02-02T14:31:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.814+0000 7f62172ab700 1 -- 172.21.15.33:0/4090350643 wait complete. 2022-02-02T14:31:00.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 Processor -- start 2022-02-02T14:31:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 -- start start 2022-02-02T14:31:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f6860 0x7f621010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100603e0 con 0x7f62100f55c0 2022-02-02T14:31:00.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f62172ab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6210060520 con 0x7f62100f6860 2022-02-02T14:31:00.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:00.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33244/0 (socket says 172.21.15.33:33244) 2022-02-02T14:31:00.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 -- 172.21.15.33:0/2540511368 learned_addr learned my addr 172.21.15.33:0/2540511368 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:00.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6214846700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f6860 0x7f621010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 -- 172.21.15.33:0/2540511368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f6860 msgr2=0x7f621010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f6860 0x7f621010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:00.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.815+0000 7f6215047700 1 -- 172.21.15.33:0/2540511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c005040 con 0x7f62100f55c0 2022-02-02T14:31:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f6215047700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f6200002700 tx=0x7f6200009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62000079c0 con 0x7f62100f55c0 2022-02-02T14:31:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f620000f040 con 0x7f62100f55c0 2022-02-02T14:31:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621010c700 con 0x7f62100f55c0 2022-02-02T14:31:00.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6200014860 con 0x7f62100f55c0 2022-02-02T14:31:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.816+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621010ccc0 con 0x7f62100f55c0 2022-02-02T14:31:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.817+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6210045ad0 con 0x7f62100f55c0 2022-02-02T14:31:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.817+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f620001b060 con 0x7f62100f55c0 2022-02-02T14:31:00.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.818+0000 7f6205ffb700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 0x7f61fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.818+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6200081930 con 0x7f62100f55c0 2022-02-02T14:31:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.818+0000 7f6214846700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 0x7f61fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:00.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.819+0000 7f6214846700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 0x7f61fc067290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f620c004630 tx=0x7f620c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:00.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:00.822+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f620004f9e0 con 0x7f62100f55c0 2022-02-02T14:31:01.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.011+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62100fdf30 con 0x7f61fc064dd0 2022-02-02T14:31:01.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.013+0000 7f6205ffb700 1 -- 172.21.15.33:0/2540511368 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f620c019040 con 0x7f61fc064dd0 2022-02-02T14:31:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 msgr2=0x7f61fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 0x7f61fc067290 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f620c004630 tx=0x7f620c009b30).stop 2022-02-02T14:31:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 msgr2=0x7f6210109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f6200002700 tx=0x7f6200009d80).stop 2022-02-02T14:31:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 shutdown_connections 2022-02-02T14:31:01.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61fc064dd0 0x7f61fc067290 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62100f55c0 0x7f6210109c50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 --2- 172.21.15.33:0/2540511368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62100f6860 0x7f621010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.014+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 >> 172.21.15.33:0/2540511368 conn(0x7f62100f0d40 msgr2=0x7f62100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.015+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 shutdown_connections 2022-02-02T14:31:01.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.015+0000 7f62172ab700 1 -- 172.21.15.33:0/2540511368 wait complete. 2022-02-02T14:31:01.024 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:31:01.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 -- 172.21.15.33:0/3988625544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f66e0 msgr2=0x7f0ad00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 --2- 172.21.15.33:0/3988625544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f66e0 0x7f0ad00f6b00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f0acc004660 tx=0x7f0acc009b30).stop 2022-02-02T14:31:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 -- 172.21.15.33:0/3988625544 shutdown_connections 2022-02-02T14:31:01.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 --2- 172.21.15.33:0/3988625544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f7980 0x7f0ad00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 --2- 172.21.15.33:0/3988625544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f66e0 0x7f0ad00f6b00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.116+0000 7f0ad7457700 1 -- 172.21.15.33:0/3988625544 >> 172.21.15.33:0/3988625544 conn(0x7f0ad00f1e40 msgr2=0x7f0ad00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 -- 172.21.15.33:0/3988625544 shutdown_connections 2022-02-02T14:31:01.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 -- 172.21.15.33:0/3988625544 wait complete. 2022-02-02T14:31:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 Processor -- start 2022-02-02T14:31:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 -- start start 2022-02-02T14:31:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.117+0000 7f0ad7457700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0107a50 con 0x7f0ad00f7980 2022-02-02T14:31:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad7457700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad0107b90 con 0x7f0ad00f66e0 2022-02-02T14:31:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad49f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad49f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33256/0 (socket says 172.21.15.33:33256) 2022-02-02T14:31:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:43970/0 (socket says 172.21.15.33:43970) 2022-02-02T14:31:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad49f2700 1 -- 172.21.15.33:0/37412736 learned_addr learned my addr 172.21.15.33:0/37412736 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 -- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 msgr2=0x7f0ad01074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 -- 172.21.15.33:0/37412736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc005040 con 0x7f0ad00f66e0 2022-02-02T14:31:01.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad49f2700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:31:01.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad51f3700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0acc000c00 tx=0x7f0acc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc01c070 con 0x7f0ad00f66e0 2022-02-02T14:31:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.118+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ad01084d0 con 0x7f0ad00f66e0 2022-02-02T14:31:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.119+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0acc009630 con 0x7f0ad00f66e0 2022-02-02T14:31:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.119+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0acc021710 con 0x7f0ad00f66e0 2022-02-02T14:31:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.119+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ad0108a30 con 0x7f0ad00f66e0 2022-02-02T14:31:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.120+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ad0045ad0 con 0x7f0ad00f66e0 2022-02-02T14:31:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.121+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0acc012b10 con 0x7f0ad00f66e0 2022-02-02T14:31:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.121+0000 7f0ac1ffb700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.121+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0acc087b10 con 0x7f0ad00f66e0 2022-02-02T14:31:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.121+0000 7f0ad49f2700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.122+0000 7f0ad49f2700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 0x7f0abc067290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f0ac40041d0 tx=0x7f0ac400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.126+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0acc0596b0 con 0x7f0ad00f66e0 2022-02-02T14:31:01.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.308+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ad00ff020 con 0x7f0abc064dd0 2022-02-02T14:31:01.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.323+0000 7f0ac1ffb700 1 -- 172.21.15.33:0/37412736 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f0ad00ff020 con 0x7f0abc064dd0 2022-02-02T14:31:01.323 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:31:01.323 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (56m) 18m ago 57m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:31:01.323 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (49m) 18m ago 57m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:31:01.323 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (49m) 18m ago 56m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:31:01.324 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (56m) 18m ago 57m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:31:01.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (49m) 18m ago 53m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:31:01.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (50m) 18m ago 53m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:31:01.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (51m) 18m ago 53m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:31:01.324 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (53m) 18m ago 53m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:31:01.325 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (50m) 18m ago 58m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:31:01.325 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (50m) 18m ago 56m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:31:01.325 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (50m) 18m ago 58m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:31:01.326 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (49m) 18m ago 56m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:31:01.326 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (57m) 18m ago 57m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:31:01.326 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (56m) 18m ago 56m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:31:01.326 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 18m ago 56m - 4096M 2022-02-02T14:31:01.327 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (55m) 18m ago 55m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:31:01.327 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (55m) 18m ago 55m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:31:01.327 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (55m) 18m ago 55m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:31:01.327 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (54m) 18m ago 54m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:31:01.328 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (54m) 18m ago 54m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:31:01.328 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (56m) 18m ago 56m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:31:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.324+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 msgr2=0x7f0abc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.324+0000 7f0ad7457700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 0x7f0abc067290 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f0ac40041d0 tx=0x7f0ac400b040).stop 2022-02-02T14:31:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.324+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 msgr2=0x7f0ad0106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.324+0000 7f0ad7457700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0acc000c00 tx=0x7f0acc009b30).stop 2022-02-02T14:31:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 shutdown_connections 2022-02-02T14:31:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0abc064dd0 0x7f0abc067290 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ad00f66e0 0x7f0ad0106fb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 --2- 172.21.15.33:0/37412736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ad00f7980 0x7f0ad01074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 >> 172.21.15.33:0/37412736 conn(0x7f0ad00f1e40 msgr2=0x7f0ad00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 shutdown_connections 2022-02-02T14:31:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.325+0000 7f0ad7457700 1 -- 172.21.15.33:0/37412736 wait complete. 2022-02-02T14:31:01.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 -- 172.21.15.33:0/2774726880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f77c0 msgr2=0x7facf80f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 --2- 172.21.15.33:0/2774726880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f77c0 0x7facf80f7c20 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7facf4004660 tx=0x7facf4009b30).stop 2022-02-02T14:31:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 -- 172.21.15.33:0/2774726880 shutdown_connections 2022-02-02T14:31:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 --2- 172.21.15.33:0/2774726880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f77c0 0x7facf80f7c20 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 --2- 172.21.15.33:0/2774726880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f6520 0x7facf80f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 -- 172.21.15.33:0/2774726880 >> 172.21.15.33:0/2774726880 conn(0x7facf80f1ca0 msgr2=0x7facf80f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 -- 172.21.15.33:0/2774726880 shutdown_connections 2022-02-02T14:31:01.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.426+0000 7facfe3fb700 1 -- 172.21.15.33:0/2774726880 wait complete. 2022-02-02T14:31:01.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 Processor -- start 2022-02-02T14:31:01.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 -- start start 2022-02-02T14:31:01.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f77c0 0x7facf8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf806a380 con 0x7facf80f6520 2022-02-02T14:31:01.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfe3fb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf806a4c0 con 0x7facf80f77c0 2022-02-02T14:31:01.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfd3f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfd3f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33264/0 (socket says 172.21.15.33:33264) 2022-02-02T14:31:01.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.427+0000 7facfd3f9700 1 -- 172.21.15.33:0/3091042899 learned_addr learned my addr 172.21.15.33:0/3091042899 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:01.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfcbf8700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f77c0 0x7facf8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfd3f9700 1 -- 172.21.15.33:0/3091042899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f77c0 msgr2=0x7facf8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfd3f9700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f77c0 0x7facf8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfd3f9700 1 -- 172.21.15.33:0/3091042899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf4005040 con 0x7facf80f6520 2022-02-02T14:31:01.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfd3f9700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7face800e7c0 tx=0x7face800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face80092e0 con 0x7facf80f6520 2022-02-02T14:31:01.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7face800f040 con 0x7facf80f6520 2022-02-02T14:31:01.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf806a7a0 con 0x7facf80f6520 2022-02-02T14:31:01.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7face80147e0 con 0x7facf80f6520 2022-02-02T14:31:01.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.428+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf810ece0 con 0x7facf80f6520 2022-02-02T14:31:01.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.430+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7face801b030 con 0x7facf80f6520 2022-02-02T14:31:01.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.430+0000 7facedffb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 0x7face40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.431+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf8045ad0 con 0x7facf80f6520 2022-02-02T14:31:01.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.431+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7face8081940 con 0x7facf80f6520 2022-02-02T14:31:01.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.431+0000 7facfcbf8700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 0x7face40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.431+0000 7facfcbf8700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 0x7face40672e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7facf4005010 tx=0x7facf4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.435+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7face804f9f0 con 0x7facf80f6520 2022-02-02T14:31:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.686+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7facf80008d0 con 0x7facf80f6520 2022-02-02T14:31:01.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.686+0000 7facedffb700 1 -- 172.21.15.33:0/3091042899 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7face8019020 con 0x7facf80f6520 2022-02-02T14:31:01.686 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:31:01.687 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:31:01.687 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:31:01.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:01.687 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:31:01.688 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:31:01.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:01.688 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:31:01.688 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:31:01.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:01.689 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:31:01.689 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:31:01.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:01.689 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:31:01.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:31:01.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:31:01.690 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:31:01.690 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:31:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 msgr2=0x7face40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 0x7face40672e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7facf4005010 tx=0x7facf4016040).stop 2022-02-02T14:31:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 msgr2=0x7facf806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7face800e7c0 tx=0x7face800b040).stop 2022-02-02T14:31:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 shutdown_connections 2022-02-02T14:31:01.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.688+0000 7facfe3fb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7face4064e20 0x7face40672e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.689+0000 7facfe3fb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf80f6520 0x7facf806b9a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.689+0000 7facfe3fb700 1 --2- 172.21.15.33:0/3091042899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7facf80f77c0 0x7facf8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.689+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 >> 172.21.15.33:0/3091042899 conn(0x7facf80f1ca0 msgr2=0x7facf80fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.689+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 shutdown_connections 2022-02-02T14:31:01.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.689+0000 7facfe3fb700 1 -- 172.21.15.33:0/3091042899 wait complete. 2022-02-02T14:31:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 -- 172.21.15.33:0/1806026130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 msgr2=0x7f11400f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 --2- 172.21.15.33:0/1806026130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f11400f6b30 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f112c004660 tx=0x7f112c009b30).stop 2022-02-02T14:31:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 -- 172.21.15.33:0/1806026130 shutdown_connections 2022-02-02T14:31:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 --2- 172.21.15.33:0/1806026130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f11400f6b30 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 --2- 172.21.15.33:0/1806026130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f11400f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 -- 172.21.15.33:0/1806026130 >> 172.21.15.33:0/1806026130 conn(0x7f11400f0b90 msgr2=0x7f11400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:01.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 -- 172.21.15.33:0/1806026130 shutdown_connections 2022-02-02T14:31:01.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.790+0000 7f1145be4700 1 -- 172.21.15.33:0/1806026130 wait complete. 2022-02-02T14:31:01.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 Processor -- start 2022-02-02T14:31:01.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 -- start start 2022-02-02T14:31:01.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f1140109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11400603c0 con 0x7f11400f66d0 2022-02-02T14:31:01.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.791+0000 7f1145be4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140060500 con 0x7f11400f5430 2022-02-02T14:31:01.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33276/0 (socket says 172.21.15.33:33276) 2022-02-02T14:31:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 -- 172.21.15.33:0/2829668408 learned_addr learned my addr 172.21.15.33:0/2829668408 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f1144be2700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f1140109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 -- 172.21.15.33:0/2829668408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 msgr2=0x7f1140109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f1140109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 -- 172.21.15.33:0/2829668408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c005040 con 0x7f11400f66d0 2022-02-02T14:31:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f1144be2700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f1140109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:31:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113ffff700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f112c009990 tx=0x7f112c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c018070 con 0x7f11400f66d0 2022-02-02T14:31:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f112c007ba0 con 0x7f11400f66d0 2022-02-02T14:31:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114010c490 con 0x7f11400f66d0 2022-02-02T14:31:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.792+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f112c01c3c0 con 0x7f11400f66d0 2022-02-02T14:31:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.793+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114010c9c0 con 0x7f11400f66d0 2022-02-02T14:31:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.793+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140059100 con 0x7f11400f66d0 2022-02-02T14:31:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.794+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f112c01d420 con 0x7f11400f66d0 2022-02-02T14:31:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.794+0000 7f113d7fa700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 0x7f11300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.794+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f112c0836f0 con 0x7f11400f66d0 2022-02-02T14:31:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.794+0000 7f1144be2700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 0x7f11300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.795+0000 7f1144be2700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 0x7f11300672e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f1140060040 tx=0x7f113400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:01.799+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f112c051860 con 0x7f11400f66d0 2022-02-02T14:31:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.011+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1140045ad0 con 0x7f11400f66d0 2022-02-02T14:31:02.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.012+0000 7f113d7fa700 1 -- 172.21.15.33:0/2829668408 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f112c054e80 con 0x7f11400f66d0 2022-02-02T14:31:02.012 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:31:02.012 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:31:02.012 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:31:02.012 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:31:02.013 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:02.013 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:31:02.013 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:31:02.013 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:31:02.014 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:31:02.014 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:31:02.014 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:31:02.014 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:31:02.015 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:31:02.015 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:31:02.015 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:31:02.015 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:31:02.016 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:31:02.016 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:31:02.016 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:31:02.016 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:31:02.016 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:31:02.017 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:31:02.017 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:31:02.017 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:31:02.017 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:31:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:31:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:31:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:31:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:31:02.018 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:31:02.019 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:31:02.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:02.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:02.019 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:31:02.020 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:02.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:02.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:02.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:02.020 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.013+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 msgr2=0x7f11300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.013+0000 7f1145be4700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 0x7f11300672e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f1140060040 tx=0x7f113400b040).stop 2022-02-02T14:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.013+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 msgr2=0x7f114010bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:02.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.013+0000 7f1145be4700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f112c009990 tx=0x7f112c009b30).stop 2022-02-02T14:31:02.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 shutdown_connections 2022-02-02T14:31:02.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1130064e20 0x7f11300672e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:02.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11400f5430 0x7f1140109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:02.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 --2- 172.21.15.33:0/2829668408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11400f66d0 0x7f114010bf40 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:02.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 >> 172.21.15.33:0/2829668408 conn(0x7f11400f0b90 msgr2=0x7f11400fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:02.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 shutdown_connections 2022-02-02T14:31:02.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:02.014+0000 7f1145be4700 1 -- 172.21.15.33:0/2829668408 wait complete. 2022-02-02T14:31:02.024 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:31:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:02 smithi033 ceph-mon[101165]: pgmap v1569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:02 smithi033 ceph-mon[101165]: from='client.35686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:02 smithi033 ceph-mon[101165]: from='client.45327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3091042899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:31:02.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2829668408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:31:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:02 smithi037 ceph-mon[69017]: pgmap v1569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:02 smithi037 ceph-mon[69017]: from='client.35686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:02 smithi037 ceph-mon[69017]: from='client.45327 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3091042899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:31:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2829668408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:31:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:04 smithi033 ceph-mon[101165]: pgmap v1570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:04 smithi037 ceph-mon[69017]: pgmap v1570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:06 smithi033 ceph-mon[101165]: pgmap v1571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:06 smithi037 ceph-mon[69017]: pgmap v1571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:08 smithi033 ceph-mon[101165]: pgmap v1572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:08 smithi037 ceph-mon[69017]: pgmap v1572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:10 smithi033 ceph-mon[101165]: pgmap v1573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:10 smithi037 ceph-mon[69017]: pgmap v1573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:12.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:12 smithi033 ceph-mon[101165]: pgmap v1574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:12 smithi037 ceph-mon[69017]: pgmap v1574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:14 smithi033 ceph-mon[101165]: pgmap v1575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:14 smithi037 ceph-mon[69017]: pgmap v1575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:16 smithi033 ceph-mon[101165]: pgmap v1576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:16 smithi037 ceph-mon[69017]: pgmap v1576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:18 smithi033 ceph-mon[101165]: pgmap v1577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:18 smithi037 ceph-mon[69017]: pgmap v1577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:19.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:19 smithi033 ceph-mon[101165]: pgmap v1578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:19.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:19 smithi037 ceph-mon[69017]: pgmap v1578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:22.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:22 smithi037 ceph-mon[69017]: pgmap v1579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:22 smithi033 ceph-mon[101165]: pgmap v1579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:24.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:24 smithi037 ceph-mon[69017]: pgmap v1580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:24 smithi033 ceph-mon[101165]: pgmap v1580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:26.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:26 smithi037 ceph-mon[69017]: pgmap v1581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:26 smithi033 ceph-mon[101165]: pgmap v1581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:28.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:28 smithi037 ceph-mon[69017]: pgmap v1582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:28 smithi033 ceph-mon[101165]: pgmap v1582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:30.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:30 smithi037 ceph-mon[69017]: pgmap v1583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:30 smithi033 ceph-mon[101165]: pgmap v1583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 -- 172.21.15.33:0/2084315596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f55e0 msgr2=0x7f3f540f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 --2- 172.21.15.33:0/2084315596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f55e0 0x7f3f540f5a00 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f3f44004660 tx=0x7f3f44009b30).stop 2022-02-02T14:31:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 -- 172.21.15.33:0/2084315596 shutdown_connections 2022-02-02T14:31:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 --2- 172.21.15.33:0/2084315596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f5ef0 0x7f3f540f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 --2- 172.21.15.33:0/2084315596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f55e0 0x7f3f540f5a00 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 -- 172.21.15.33:0/2084315596 >> 172.21.15.33:0/2084315596 conn(0x7f3f540f0de0 msgr2=0x7f3f540f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.128+0000 7f3f59514700 1 -- 172.21.15.33:0/2084315596 shutdown_connections 2022-02-02T14:31:32.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.129+0000 7f3f59514700 1 -- 172.21.15.33:0/2084315596 wait complete. 2022-02-02T14:31:32.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.129+0000 7f3f59514700 1 Processor -- start 2022-02-02T14:31:32.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.129+0000 7f3f59514700 1 -- start start 2022-02-02T14:31:32.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f59514700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f55e0 0x7f3f54109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f59514700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f59514700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54109bf0 con 0x7f3f540f5ef0 2022-02-02T14:31:32.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f59514700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f54109d30 con 0x7f3f540f55e0 2022-02-02T14:31:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33286/0 (socket says 172.21.15.33:33286) 2022-02-02T14:31:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 -- 172.21.15.33:0/4210146127 learned_addr learned my addr 172.21.15.33:0/4210146127 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f52ffd700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f55e0 0x7f3f54109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 -- 172.21.15.33:0/4210146127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f55e0 msgr2=0x7f3f54109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f55e0 0x7f3f54109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 -- 172.21.15.33:0/4210146127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44005040 con 0x7f3f540f5ef0 2022-02-02T14:31:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f527fc700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f3f480026d0 tx=0x7f3f48009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.130+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f480079c0 con 0x7f3f540f5ef0 2022-02-02T14:31:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.131+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f4800f040 con 0x7f3f540f5ef0 2022-02-02T14:31:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.131+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5410a6d0 con 0x7f3f540f5ef0 2022-02-02T14:31:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.131+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f480148b0 con 0x7f3f540f5ef0 2022-02-02T14:31:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.131+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5410ac90 con 0x7f3f540f5ef0 2022-02-02T14:31:32.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.132+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f48007b20 con 0x7f3f540f5ef0 2022-02-02T14:31:32.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.132+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f54045ad0 con 0x7f3f540f5ef0 2022-02-02T14:31:32.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.133+0000 7f3f3b7fe700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 0x7f3f3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.133+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f48081950 con 0x7f3f540f5ef0 2022-02-02T14:31:32.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.133+0000 7f3f52ffd700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 0x7f3f3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.133+0000 7f3f52ffd700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 0x7f3f3c067290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3f44004630 tx=0x7f3f44009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.137+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f48053430 con 0x7f3f540f5ef0 2022-02-02T14:31:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.326+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f540fab60 con 0x7f3f3c064dd0 2022-02-02T14:31:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.327+0000 7f3f3b7fe700 1 -- 172.21.15.33:0/4210146127 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f3f540fab60 con 0x7f3f3c064dd0 2022-02-02T14:31:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 msgr2=0x7f3f3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 0x7f3f3c067290 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7f3f44004630 tx=0x7f3f44009b30).stop 2022-02-02T14:31:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 msgr2=0x7f3f54109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7f3f480026d0 tx=0x7f3f48009de0).stop 2022-02-02T14:31:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 shutdown_connections 2022-02-02T14:31:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f3c064dd0 0x7f3f3c067290 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f540f55e0 0x7f3f54109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 --2- 172.21.15.33:0/4210146127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f540f5ef0 0x7f3f54109640 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 >> 172.21.15.33:0/4210146127 conn(0x7f3f540f0de0 msgr2=0x7f3f5405ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 shutdown_connections 2022-02-02T14:31:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.329+0000 7f3f59514700 1 -- 172.21.15.33:0/4210146127 wait complete. 2022-02-02T14:31:32.339 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:31:32.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 -- 172.21.15.33:0/3961354073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f55c0 msgr2=0x7efd5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 --2- 172.21.15.33:0/3961354073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f59e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7efd58004660 tx=0x7efd58009b30).stop 2022-02-02T14:31:32.431 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:32 smithi033 ceph-mon[101165]: pgmap v1584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:32.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 -- 172.21.15.33:0/3961354073 shutdown_connections 2022-02-02T14:31:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 --2- 172.21.15.33:0/3961354073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:31:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 --2- 172.21.15.33:0/3961354073 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f59e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 -- 172.21.15.33:0/3961354073 >> 172.21.15.33:0/3961354073 conn(0x7efd5c0f0d40 msgr2=0x7efd5c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 -- 172.21.15.33:0/3961354073 shutdown_connections 2022-02-02T14:31:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.430+0000 7efd64637700 1 -- 172.21.15.33:0/3961354073 wait complete. 2022-02-02T14:31:32.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 Processor -- start 2022-02-02T14:31:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 -- start start 2022-02-02T14:31:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0f8190 con 0x7efd5c0f6860 2022-02-02T14:31:32.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd64637700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c0f82d0 con 0x7efd5c0f55c0 2022-02-02T14:31:32.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd61bd2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd61bd2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33296/0 (socket says 172.21.15.33:33296) 2022-02-02T14:31:32.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.431+0000 7efd61bd2700 1 -- 172.21.15.33:0/331322067 learned_addr learned my addr 172.21.15.33:0/331322067 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:32.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd623d3700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd61bd2700 1 -- 172.21.15.33:0/331322067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f55c0 msgr2=0x7efd5c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd61bd2700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd61bd2700 1 -- 172.21.15.33:0/331322067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58005040 con 0x7efd5c0f6860 2022-02-02T14:31:32.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd61bd2700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7efd4c00b410 tx=0x7efd4c006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c0125f0 con 0x7efd5c0f6860 2022-02-02T14:31:32.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c0f85b0 con 0x7efd5c0f6860 2022-02-02T14:31:32.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd4c00be30 con 0x7efd5c0f6860 2022-02-02T14:31:32.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c002a70 con 0x7efd5c0f6860 2022-02-02T14:31:32.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.432+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c10ef90 con 0x7efd5c0f6860 2022-02-02T14:31:32.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.433+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c045ad0 con 0x7efd5c0f6860 2022-02-02T14:31:32.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.434+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd4c00f030 con 0x7efd5c0f6860 2022-02-02T14:31:32.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.435+0000 7efd52ffd700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 0x7efd48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.435+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efd4c082200 con 0x7efd5c0f6860 2022-02-02T14:31:32.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.435+0000 7efd623d3700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 0x7efd48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.435+0000 7efd623d3700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 0x7efd48067290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7efd58013690 tx=0x7efd58009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.439+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd4c0502b0 con 0x7efd5c0f6860 2022-02-02T14:31:32.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:32 smithi037 ceph-mon[69017]: pgmap v1584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:32.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.621+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd5c0faca0 con 0x7efd48064dd0 2022-02-02T14:31:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.636+0000 7efd52ffd700 1 -- 172.21.15.33:0/331322067 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7efd5c0faca0 con 0x7efd48064dd0 2022-02-02T14:31:32.635 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:31:32.636 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (56m) 18m ago 57m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:31:32.636 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (49m) 18m ago 57m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:31:32.636 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (49m) 18m ago 57m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:31:32.636 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (56m) 18m ago 57m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:31:32.637 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (50m) 18m ago 54m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:31:32.637 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (50m) 18m ago 53m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:31:32.637 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (51m) 18m ago 54m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:31:32.637 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (54m) 18m ago 53m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:31:32.637 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (51m) 18m ago 59m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:31:32.638 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (51m) 18m ago 57m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:31:32.638 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (50m) 18m ago 59m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:31:32.638 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (50m) 18m ago 57m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:31:32.638 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (57m) 18m ago 57m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:31:32.639 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (57m) 18m ago 57m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:31:32.639 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 18m ago 56m - 4096M 2022-02-02T14:31:32.639 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (56m) 18m ago 56m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:31:32.639 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (55m) 18m ago 55m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:31:32.639 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (55m) 18m ago 55m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:31:32.640 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (55m) 18m ago 55m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:31:32.640 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (55m) 18m ago 55m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:31:32.640 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (56m) 18m ago 57m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:31:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 msgr2=0x7efd48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 0x7efd48067290 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7efd58013690 tx=0x7efd58009b30).stop 2022-02-02T14:31:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 msgr2=0x7efd5c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7efd4c00b410 tx=0x7efd4c006ef0).stop 2022-02-02T14:31:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 shutdown_connections 2022-02-02T14:31:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd48064dd0 0x7efd48067290 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd5c0f55c0 0x7efd5c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 --2- 172.21.15.33:0/331322067 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd5c0f6860 0x7efd5c0f7ba0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 >> 172.21.15.33:0/331322067 conn(0x7efd5c0f0d40 msgr2=0x7efd5c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.638+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 shutdown_connections 2022-02-02T14:31:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.639+0000 7efd64637700 1 -- 172.21.15.33:0/331322067 wait complete. 2022-02-02T14:31:32.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 -- 172.21.15.33:0/4104710299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 msgr2=0x7f60bc0f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 --2- 172.21.15.33:0/4104710299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f8120 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 rx=0x7f60ac004660 tx=0x7f60ac009b30).stop 2022-02-02T14:31:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 -- 172.21.15.33:0/4104710299 shutdown_connections 2022-02-02T14:31:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 --2- 172.21.15.33:0/4104710299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 --2- 172.21.15.33:0/4104710299 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f8120 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 -- 172.21.15.33:0/4104710299 >> 172.21.15.33:0/4104710299 conn(0x7f60bc0f0540 msgr2=0x7f60bc0f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:32.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 -- 172.21.15.33:0/4104710299 shutdown_connections 2022-02-02T14:31:32.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.739+0000 7f60c180a700 1 -- 172.21.15.33:0/4104710299 wait complete. 2022-02-02T14:31:32.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 Processor -- start 2022-02-02T14:31:32.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 -- start start 2022-02-02T14:31:32.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0f5fb0 con 0x7f60bc0f7d00 2022-02-02T14:31:32.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60c180a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0f60f0 con 0x7f60bc0f8610 2022-02-02T14:31:32.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:44020/0 (socket says 172.21.15.33:44020) 2022-02-02T14:31:32.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60b3fff700 1 -- 172.21.15.33:0/243462818 learned_addr learned my addr 172.21.15.33:0/243462818 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:32.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.740+0000 7f60baffd700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b3fff700 1 -- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 msgr2=0x7f60bc0f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:32.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b3fff700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:32.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b3fff700 1 -- 172.21.15.33:0/243462818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac005040 con 0x7f60bc0f8610 2022-02-02T14:31:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60baffd700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:31:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b3fff700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f60a400e7f0 tx=0x7f60a400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a40092e0 con 0x7f60bc0f8610 2022-02-02T14:31:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc0f63d0 con 0x7f60bc0f8610 2022-02-02T14:31:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f60a400f040 con 0x7f60bc0f8610 2022-02-02T14:31:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a4014750 con 0x7f60bc0f8610 2022-02-02T14:31:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.741+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc10ef00 con 0x7f60bc0f8610 2022-02-02T14:31:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.742+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc045ad0 con 0x7f60bc0f8610 2022-02-02T14:31:32.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.743+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f60a401b030 con 0x7f60bc0f8610 2022-02-02T14:31:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.743+0000 7f60b37fe700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 0x7f60a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.743+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f60a40818a0 con 0x7f60bc0f8610 2022-02-02T14:31:32.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.743+0000 7f60baffd700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 0x7f60a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.743+0000 7f60baffd700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 0x7f60a8067290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f60ac004d80 tx=0x7f60ac016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:32.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.748+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f60a404fa00 con 0x7f60bc0f8610 2022-02-02T14:31:32.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.995+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f60bc027a00 con 0x7f60bc0f8610 2022-02-02T14:31:32.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.996+0000 7f60b37fe700 1 -- 172.21.15.33:0/243462818 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f60a40192d0 con 0x7f60bc0f8610 2022-02-02T14:31:32.995 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:31:32.996 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:31:32.996 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:31:32.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:32.996 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:31:32.997 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:31:32.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:32.997 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:31:32.997 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:31:32.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:32.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:31:32.998 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:31:32.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:31:32.999 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:31:32.999 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:31:32.999 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:31:32.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:31:33.000 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:31:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.997+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 msgr2=0x7f60a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.997+0000 7f60c180a700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 0x7f60a8067290 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f60ac004d80 tx=0x7f60ac016040).stop 2022-02-02T14:31:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.997+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 msgr2=0x7f60bc0f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.997+0000 7f60c180a700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f60a400e7f0 tx=0x7f60a400b040).stop 2022-02-02T14:31:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 shutdown_connections 2022-02-02T14:31:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f60a8064dd0 0x7f60a8067290 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60bc0f7d00 0x7f60bc0f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 --2- 172.21.15.33:0/243462818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60bc0f8610 0x7f60bc0f5a50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 >> 172.21.15.33:0/243462818 conn(0x7f60bc0f0540 msgr2=0x7f60bc0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 shutdown_connections 2022-02-02T14:31:33.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:32.998+0000 7f60c180a700 1 -- 172.21.15.33:0/243462818 wait complete. 2022-02-02T14:31:33.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/2505375148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f6530 msgr2=0x7ffb180f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/2505375148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f6530 0x7ffb180f6950 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7ffb08004660 tx=0x7ffb08009b30).stop 2022-02-02T14:31:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/2505375148 shutdown_connections 2022-02-02T14:31:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/2505375148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f77d0 0x7ffb180f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/2505375148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f6530 0x7ffb180f6950 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/2505375148 >> 172.21.15.33:0/2505375148 conn(0x7ffb180f1c90 msgr2=0x7ffb180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/2505375148 shutdown_connections 2022-02-02T14:31:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.098+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/2505375148 wait complete. 2022-02-02T14:31:33.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 Processor -- start 2022-02-02T14:31:33.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 -- start start 2022-02-02T14:31:33.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 0x7ffb18106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:33.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:33.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb181078f0 con 0x7ffb180f77d0 2022-02-02T14:31:33.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.099+0000 7ffb1cf1c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb18108100 con 0x7ffb180f6530 2022-02-02T14:31:33.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:33.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33314/0 (socket says 172.21.15.33:33314) 2022-02-02T14:31:33.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 -- 172.21.15.33:0/1363076176 learned_addr learned my addr 172.21.15.33:0/1363076176 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:31:33.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb177fe700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 0x7ffb18106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 -- 172.21.15.33:0/1363076176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 msgr2=0x7ffb18106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 0x7ffb18106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 -- 172.21.15.33:0/1363076176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb08005040 con 0x7ffb180f77d0 2022-02-02T14:31:33.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb177fe700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 0x7ffb18106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:31:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb16ffd700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ffb0c00fae0 tx=0x7ffb0c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c014070 con 0x7ffb180f77d0 2022-02-02T14:31:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb18108320 con 0x7ffb180f77d0 2022-02-02T14:31:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb0c009500 con 0x7ffb180f77d0 2022-02-02T14:31:33.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb0c002c50 con 0x7ffb180f77d0 2022-02-02T14:31:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.100+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb181088b0 con 0x7ffb180f77d0 2022-02-02T14:31:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.101+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb18045ad0 con 0x7ffb180f77d0 2022-02-02T14:31:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.102+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb0c0077b0 con 0x7ffb180f77d0 2022-02-02T14:31:33.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.102+0000 7ffafffff700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 0x7ffb000672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:31:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.102+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffb0c085fe0 con 0x7ffb180f77d0 2022-02-02T14:31:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.102+0000 7ffb177fe700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 0x7ffb000672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:31:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.103+0000 7ffb177fe700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 0x7ffb000672e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ffb08004e30 tx=0x7ffb08009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:31:33.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.107+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb0c054090 con 0x7ffb180f77d0 2022-02-02T14:31:33.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.318+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb18108b30 con 0x7ffb180f77d0 2022-02-02T14:31:33.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.318+0000 7ffafffff700 1 -- 172.21.15.33:0/1363076176 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ffb0c0576b0 con 0x7ffb180f77d0 2022-02-02T14:31:33.318 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:31:33.319 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:31:33.319 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:31:33.319 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:31:33.319 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:33.320 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:31:33.320 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:31:33.320 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:31:33.320 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:31:33.321 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:31:33.321 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:31:33.321 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:31:33.321 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:31:33.321 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:31:33.322 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:31:33.322 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:31:33.322 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:31:33.322 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:31:33.323 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:31:33.323 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:31:33.323 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:31:33.323 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:31:33.323 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:31:33.324 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:31:33.324 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:31:33.324 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:31:33.324 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:31:33.324 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:31:33.325 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:31:33.325 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:31:33.325 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:31:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:33.326 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:31:33.326 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:31:33.327 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:33.327 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:33.327 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:33.327 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:31:33.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 msgr2=0x7ffb000672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 0x7ffb000672e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7ffb08004e30 tx=0x7ffb08009b30).stop 2022-02-02T14:31:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 msgr2=0x7ffb181072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:31:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7ffb0c00fae0 tx=0x7ffb0c009de0).stop 2022-02-02T14:31:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 shutdown_connections 2022-02-02T14:31:33.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb00064e20 0x7ffb000672e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb180f6530 0x7ffb18106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 --2- 172.21.15.33:0/1363076176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb180f77d0 0x7ffb181072f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:31:33.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.320+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 >> 172.21.15.33:0/1363076176 conn(0x7ffb180f1c90 msgr2=0x7ffb180fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:31:33.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.321+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 shutdown_connections 2022-02-02T14:31:33.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:31:33.321+0000 7ffb1cf1c700 1 -- 172.21.15.33:0/1363076176 wait complete. 2022-02-02T14:31:33.331 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:31:33.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:33 smithi033 ceph-mon[101165]: from='client.35702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/243462818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:31:33.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:33 smithi037 ceph-mon[69017]: from='client.35702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:33.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/243462818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:31:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:34 smithi033 ceph-mon[101165]: from='client.35706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:34 smithi033 ceph-mon[101165]: pgmap v1585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:34 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1363076176' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:31:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:34 smithi037 ceph-mon[69017]: from='client.35706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:31:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:34 smithi037 ceph-mon[69017]: pgmap v1585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:34.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:34 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1363076176' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:31:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:36 smithi033 ceph-mon[101165]: pgmap v1586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:36 smithi037 ceph-mon[69017]: pgmap v1586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:38 smithi033 ceph-mon[101165]: pgmap v1587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:38 smithi037 ceph-mon[69017]: pgmap v1587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:40 smithi033 ceph-mon[101165]: pgmap v1588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:40 smithi037 ceph-mon[69017]: pgmap v1588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:42.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:42 smithi033 ceph-mon[101165]: pgmap v1589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:42 smithi037 ceph-mon[69017]: pgmap v1589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:44 smithi033 ceph-mon[101165]: pgmap v1590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:44 smithi037 ceph-mon[69017]: pgmap v1590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:46 smithi033 ceph-mon[101165]: pgmap v1591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:46 smithi037 ceph-mon[69017]: pgmap v1591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:48 smithi033 ceph-mon[101165]: pgmap v1592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:48 smithi037 ceph-mon[69017]: pgmap v1592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:50 smithi033 ceph-mon[101165]: pgmap v1593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:50 smithi037 ceph-mon[69017]: pgmap v1593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:52 smithi033 ceph-mon[101165]: pgmap v1594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:52 smithi037 ceph-mon[69017]: pgmap v1594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:54 smithi033 ceph-mon[101165]: pgmap v1595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:54 smithi037 ceph-mon[69017]: pgmap v1595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:31:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:31:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:31:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:31:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:56 smithi033 ceph-mon[101165]: pgmap v1596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:56 smithi037 ceph-mon[69017]: pgmap v1596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:31:58 smithi033 ceph-mon[101165]: pgmap v1597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:31:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:31:58 smithi037 ceph-mon[69017]: pgmap v1597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:00 smithi033 ceph-mon[101165]: pgmap v1598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:00.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:00 smithi037 ceph-mon[69017]: pgmap v1598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:02.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:02 smithi033 ceph-mon[101165]: pgmap v1599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:02 smithi037 ceph-mon[69017]: pgmap v1599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 -- 172.21.15.33:0/2766412944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06b960 msgr2=0x7fc54c069e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 --2- 172.21.15.33:0/2766412944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06b960 0x7fc54c069e60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fc53c004660 tx=0x7fc53c009b30).stop 2022-02-02T14:32:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 -- 172.21.15.33:0/2766412944 shutdown_connections 2022-02-02T14:32:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 --2- 172.21.15.33:0/2766412944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc54c06a350 0x7fc54c06a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 --2- 172.21.15.33:0/2766412944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06b960 0x7fc54c069e60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 -- 172.21.15.33:0/2766412944 >> 172.21.15.33:0/2766412944 conn(0x7fc54c0f1e40 msgr2=0x7fc54c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 -- 172.21.15.33:0/2766412944 shutdown_connections 2022-02-02T14:32:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 -- 172.21.15.33:0/2766412944 wait complete. 2022-02-02T14:32:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.438+0000 7fc552722700 1 Processor -- start 2022-02-02T14:32:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc552722700 1 -- start start 2022-02-02T14:32:03.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc552722700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc552722700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc54c06b960 0x7fc54c109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc552722700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c109c00 con 0x7fc54c06a350 2022-02-02T14:32:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc552722700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc54c109d40 con 0x7fc54c06b960 2022-02-02T14:32:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc54bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:03.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc54bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33322/0 (socket says 172.21.15.33:33322) 2022-02-02T14:32:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.439+0000 7fc54bfff700 1 -- 172.21.15.33:0/3454902724 learned_addr learned my addr 172.21.15.33:0/3454902724 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc54bfff700 1 -- 172.21.15.33:0/3454902724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc54c06b960 msgr2=0x7fc54c109650 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T14:32:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc54bfff700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc54c06b960 0x7fc54c109650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:32:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc54bfff700 1 -- 172.21.15.33:0/3454902724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c005040 con 0x7fc54c06a350 2022-02-02T14:32:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc54bfff700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fc53c009990 tx=0x7fc53c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53c018070 con 0x7fc54c06a350 2022-02-02T14:32:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc53c007ba0 con 0x7fc54c06a350 2022-02-02T14:32:03.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc54c10a680 con 0x7fc54c06a350 2022-02-02T14:32:03.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc53c01c3c0 con 0x7fc54c06a350 2022-02-02T14:32:03.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.440+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc54c10abe0 con 0x7fc54c06a350 2022-02-02T14:32:03.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.442+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc54c045ad0 con 0x7fc54c06a350 2022-02-02T14:32:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.443+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc53c01d420 con 0x7fc54c06a350 2022-02-02T14:32:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.443+0000 7fc548ff9700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 0x7fc534067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.444+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc53c083850 con 0x7fc54c06a350 2022-02-02T14:32:03.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.444+0000 7fc54b7fe700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 0x7fc534067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:03.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.444+0000 7fc54b7fe700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 0x7fc534067290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc540004a10 tx=0x7fc5400099e0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:03.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.447+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc53c0553d0 con 0x7fc54c06a350 2022-02-02T14:32:03.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.636+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc54c10ae50 con 0x7fc534064dd0 2022-02-02T14:32:03.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.638+0000 7fc548ff9700 1 -- 172.21.15.33:0/3454902724 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc54c10ae50 con 0x7fc534064dd0 2022-02-02T14:32:03.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 msgr2=0x7fc534067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 0x7fc534067290 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fc540004a10 tx=0x7fc5400099e0).stop 2022-02-02T14:32:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 msgr2=0x7fc54c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fc53c009990 tx=0x7fc53c009b30).stop 2022-02-02T14:32:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 shutdown_connections 2022-02-02T14:32:03.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc534064dd0 0x7fc534067290 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc54c06a350 0x7fc54c109160 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 --2- 172.21.15.33:0/3454902724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc54c06b960 0x7fc54c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:32:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 >> 172.21.15.33:0/3454902724 conn(0x7fc54c0f1e40 msgr2=0x7fc54c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:03.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 shutdown_connections 2022-02-02T14:32:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.640+0000 7fc552722700 1 -- 172.21.15.33:0/3454902724 wait complete. 2022-02-02T14:32:03.649 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:32:03.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.740+0000 7fab62d63700 1 -- 172.21.15.33:0/3274817694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f66d0 msgr2=0x7fab5c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.740+0000 7fab62d63700 1 --2- 172.21.15.33:0/3274817694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f66d0 0x7fab5c0f6b30 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fab4c004660 tx=0x7fab4c009b30).stop 2022-02-02T14:32:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.740+0000 7fab62d63700 1 -- 172.21.15.33:0/3274817694 shutdown_connections 2022-02-02T14:32:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.740+0000 7fab62d63700 1 --2- 172.21.15.33:0/3274817694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f66d0 0x7fab5c0f6b30 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.740+0000 7fab62d63700 1 --2- 172.21.15.33:0/3274817694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f5430 0x7fab5c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.741+0000 7fab62d63700 1 -- 172.21.15.33:0/3274817694 >> 172.21.15.33:0/3274817694 conn(0x7fab5c0f0b90 msgr2=0x7fab5c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.741+0000 7fab62d63700 1 -- 172.21.15.33:0/3274817694 shutdown_connections 2022-02-02T14:32:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.741+0000 7fab62d63700 1 -- 172.21.15.33:0/3274817694 wait complete. 2022-02-02T14:32:03.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.741+0000 7fab62d63700 1 Processor -- start 2022-02-02T14:32:03.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.741+0000 7fab62d63700 1 -- start start 2022-02-02T14:32:03.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab62d63700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab62d63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f66d0 0x7fab5c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab62d63700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c106760 con 0x7fab5c0f5430 2022-02-02T14:32:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab62d63700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c106f60 con 0x7fab5c0f66d0 2022-02-02T14:32:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:03.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33330/0 (socket says 172.21.15.33:33330) 2022-02-02T14:32:03.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 -- 172.21.15.33:0/3827770295 learned_addr learned my addr 172.21.15.33:0/3827770295 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:03.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61560700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f66d0 0x7fab5c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:03.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 -- 172.21.15.33:0/3827770295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f66d0 msgr2=0x7fab5c1061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f66d0 0x7fab5c1061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 -- 172.21.15.33:0/3827770295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c005040 con 0x7fab5c0f5430 2022-02-02T14:32:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab61d61700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fab5800e9a0 tx=0x7fab58007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:03.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.742+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab5800c9b0 con 0x7fab5c0f5430 2022-02-02T14:32:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.743+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5c1071e0 con 0x7fab5c0f5430 2022-02-02T14:32:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.743+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5c107750 con 0x7fab5c0f5430 2022-02-02T14:32:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.743+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab58011470 con 0x7fab5c0f5430 2022-02-02T14:32:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.743+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab58010610 con 0x7fab5c0f5430 2022-02-02T14:32:03.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.744+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab44004fa0 con 0x7fab5c0f5430 2022-02-02T14:32:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.744+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fab58011a80 con 0x7fab5c0f5430 2022-02-02T14:32:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.745+0000 7fab527fc700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 0x7fab480672c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.745+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fab58084940 con 0x7fab5c0f5430 2022-02-02T14:32:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.745+0000 7fab61560700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 0x7fab480672c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.745+0000 7fab61560700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 0x7fab480672c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fab4c009da0 tx=0x7fab4c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:03.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.749+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fab580563c0 con 0x7fab5c0f5430 2022-02-02T14:32:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.933+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fab44000bc0 con 0x7fab48064e00 2022-02-02T14:32:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.948+0000 7fab527fc700 1 -- 172.21.15.33:0/3827770295 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fab44000bc0 con 0x7fab48064e00 2022-02-02T14:32:03.947 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:32:03.947 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (57m) 19m ago 58m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:32:03.948 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (50m) 19m ago 58m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:32:03.948 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (50m) 19m ago 57m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:32:03.948 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (57m) 19m ago 58m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:32:03.948 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (50m) 19m ago 54m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:32:03.949 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (51m) 19m ago 54m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:32:03.949 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (52m) 19m ago 54m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:32:03.949 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (54m) 19m ago 54m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:32:03.949 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (51m) 19m ago 59m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:32:03.949 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (51m) 19m ago 57m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:32:03.950 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (51m) 19m ago 59m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:32:03.950 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (50m) 19m ago 57m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:32:03.950 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (58m) 19m ago 58m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:32:03.950 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (57m) 19m ago 57m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:32:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 19m ago 57m - 4096M 2022-02-02T14:32:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (56m) 19m ago 56m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:32:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (56m) 19m ago 56m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:32:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (56m) 19m ago 56m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:32:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (55m) 19m ago 55m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:32:03.952 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (55m) 19m ago 55m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:32:03.952 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (57m) 19m ago 57m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:32:03.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.950+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 msgr2=0x7fab480672c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.950+0000 7fab62d63700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 0x7fab480672c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fab4c009da0 tx=0x7fab4c009b30).stop 2022-02-02T14:32:03.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.950+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 msgr2=0x7fab5c105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:03.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.950+0000 7fab62d63700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fab5800e9a0 tx=0x7fab58007e20).stop 2022-02-02T14:32:03.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.950+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 shutdown_connections 2022-02-02T14:32:03.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab48064e00 0x7fab480672c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab5c0f5430 0x7fab5c105cc0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 --2- 172.21.15.33:0/3827770295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab5c0f66d0 0x7fab5c1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 >> 172.21.15.33:0/3827770295 conn(0x7fab5c0f0b90 msgr2=0x7fab5c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 shutdown_connections 2022-02-02T14:32:03.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:03.951+0000 7fab62d63700 1 -- 172.21.15.33:0/3827770295 wait complete. 2022-02-02T14:32:04.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 -- 172.21.15.33:0/987005347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f55c0 msgr2=0x7fa6800f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 --2- 172.21.15.33:0/987005347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f55c0 0x7fa6800f59e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fa670004660 tx=0x7fa670009b30).stop 2022-02-02T14:32:04.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 -- 172.21.15.33:0/987005347 shutdown_connections 2022-02-02T14:32:04.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 --2- 172.21.15.33:0/987005347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f6860 0x7fa6800f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 --2- 172.21.15.33:0/987005347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f55c0 0x7fa6800f59e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 -- 172.21.15.33:0/987005347 >> 172.21.15.33:0/987005347 conn(0x7fa6800f0d40 msgr2=0x7fa6800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 -- 172.21.15.33:0/987005347 shutdown_connections 2022-02-02T14:32:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.050+0000 7fa685fe1700 1 -- 172.21.15.33:0/987005347 wait complete. 2022-02-02T14:32:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 Processor -- start 2022-02-02T14:32:04.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 -- start start 2022-02-02T14:32:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f55c0 0x7fa680105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa680106950 con 0x7fa6800f6860 2022-02-02T14:32:04.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa685fe1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa680107160 con 0x7fa6800f55c0 2022-02-02T14:32:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa67effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa67effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33342/0 (socket says 172.21.15.33:33342) 2022-02-02T14:32:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa67effd700 1 -- 172.21.15.33:0/3542663108 learned_addr learned my addr 172.21.15.33:0/3542663108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.051+0000 7fa67f7fe700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f55c0 0x7fa680105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa67effd700 1 -- 172.21.15.33:0/3542663108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f55c0 msgr2=0x7fa680105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa67effd700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f55c0 0x7fa680105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa67effd700 1 -- 172.21.15.33:0/3542663108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670005040 con 0x7fa6800f6860 2022-02-02T14:32:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa67effd700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fa67400e7f0 tx=0x7fa67400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:04.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6740092e0 con 0x7fa6800f6860 2022-02-02T14:32:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa680107380 con 0x7fa6800f6860 2022-02-02T14:32:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa67400f040 con 0x7fa6800f6860 2022-02-02T14:32:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa674014750 con 0x7fa6800f6860 2022-02-02T14:32:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.052+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa680107910 con 0x7fa6800f6860 2022-02-02T14:32:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.053+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800f49b0 con 0x7fa6800f6860 2022-02-02T14:32:04.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.054+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa67401b030 con 0x7fa6800f6860 2022-02-02T14:32:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.054+0000 7fa667fff700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 0x7fa668067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.054+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa674081880 con 0x7fa6800f6860 2022-02-02T14:32:04.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.054+0000 7fa67f7fe700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 0x7fa668067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.055+0000 7fa67f7fe700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 0x7fa668067290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa670000c00 tx=0x7fa670018040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:04.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.059+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa67404f9e0 con 0x7fa6800f6860 2022-02-02T14:32:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.299+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa680045ad0 con 0x7fa6800f6860 2022-02-02T14:32:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.300+0000 7fa667fff700 1 -- 172.21.15.33:0/3542663108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa674053000 con 0x7fa6800f6860 2022-02-02T14:32:04.300 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:32:04.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:32:04.300 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:32:04.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:32:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:32:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:32:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:32:04.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:04.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:32:04.302 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:32:04.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:04.303 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:32:04.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:32:04.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:32:04.303 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:32:04.303 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:32:04.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 msgr2=0x7fa668067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 0x7fa668067290 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fa670000c00 tx=0x7fa670018040).stop 2022-02-02T14:32:04.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 msgr2=0x7fa680106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fa67400e7f0 tx=0x7fa67400b040).stop 2022-02-02T14:32:04.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 shutdown_connections 2022-02-02T14:32:04.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa668064dd0 0x7fa668067290 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6800f55c0 0x7fa680105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 --2- 172.21.15.33:0/3542663108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6800f6860 0x7fa680106350 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 >> 172.21.15.33:0/3542663108 conn(0x7fa6800f0d40 msgr2=0x7fa6800fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 shutdown_connections 2022-02-02T14:32:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.302+0000 7fa685fe1700 1 -- 172.21.15.33:0/3542663108 wait complete. 2022-02-02T14:32:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 -- 172.21.15.33:0/1047168384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f6860 msgr2=0x7f74d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 --2- 172.21.15.33:0/1047168384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f6860 0x7f74d40f6cc0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7f74c8004660 tx=0x7f74c8009b30).stop 2022-02-02T14:32:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 -- 172.21.15.33:0/1047168384 shutdown_connections 2022-02-02T14:32:04.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 --2- 172.21.15.33:0/1047168384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f6860 0x7f74d40f6cc0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 --2- 172.21.15.33:0/1047168384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f55c0 0x7f74d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 -- 172.21.15.33:0/1047168384 >> 172.21.15.33:0/1047168384 conn(0x7f74d40f0d40 msgr2=0x7f74d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 -- 172.21.15.33:0/1047168384 shutdown_connections 2022-02-02T14:32:04.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.404+0000 7f74da290700 1 -- 172.21.15.33:0/1047168384 wait complete. 2022-02-02T14:32:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 Processor -- start 2022-02-02T14:32:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 -- start start 2022-02-02T14:32:04.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f6860 0x7f74d410c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4060420 con 0x7f74d40f55c0 2022-02-02T14:32:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74da290700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d4060560 con 0x7f74d40f6860 2022-02-02T14:32:04.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33348/0 (socket says 172.21.15.33:33348) 2022-02-02T14:32:04.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74d3fff700 1 -- 172.21.15.33:0/3545796899 learned_addr learned my addr 172.21.15.33:0/3545796899 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.405+0000 7f74d37fe700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f6860 0x7f74d410c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d3fff700 1 -- 172.21.15.33:0/3545796899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f6860 msgr2=0x7f74d410c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d3fff700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f6860 0x7f74d410c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d3fff700 1 -- 172.21.15.33:0/3545796899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8005040 con 0x7f74d40f55c0 2022-02-02T14:32:04.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d3fff700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f74c400c790 tx=0x7f74c4007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c4013630 con 0x7f74d40f55c0 2022-02-02T14:32:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f74c4012860 con 0x7f74d40f55c0 2022-02-02T14:32:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d410c720 con 0x7f74d40f55c0 2022-02-02T14:32:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74c4002780 con 0x7f74d40f55c0 2022-02-02T14:32:04.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.406+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d410ccb0 con 0x7f74d40f55c0 2022-02-02T14:32:04.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.407+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d40f49b0 con 0x7f74d40f55c0 2022-02-02T14:32:04.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.408+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f74c4010070 con 0x7f74d40f55c0 2022-02-02T14:32:04.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.408+0000 7f74d0ff9700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 0x7f74bc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.408+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f74c4081b80 con 0x7f74d40f55c0 2022-02-02T14:32:04.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.408+0000 7f74d37fe700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 0x7f74bc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.408+0000 7f74d37fe700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 0x7f74bc067270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f74c8004e30 tx=0x7f74c8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:04.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.412+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f74c404fd80 con 0x7f74d40f55c0 2022-02-02T14:32:04.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.624+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f74d40fdd80 con 0x7f74d40f55c0 2022-02-02T14:32:04.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:04 smithi033 ceph-mon[101165]: pgmap v1600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:04.624 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3542663108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:32:04.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.624+0000 7f74d0ff9700 1 -- 172.21.15.33:0/3545796899 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f74c40533a0 con 0x7f74d40f55c0 2022-02-02T14:32:04.625 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:32:04.625 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:32:04.625 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:32:04.626 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:32:04.626 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:04.627 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:32:04.627 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:32:04.627 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:32:04.628 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:32:04.628 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:32:04.628 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:32:04.628 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:32:04.629 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:32:04.629 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:32:04.629 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:32:04.629 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:32:04.630 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:32:04.630 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:32:04.630 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:32:04.630 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:32:04.631 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:32:04.631 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:32:04.631 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:32:04.631 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:32:04.631 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:32:04.632 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:32:04.632 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:32:04.632 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:32:04.632 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:32:04.633 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:32:04.633 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:32:04.633 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:04.633 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:04.634 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:32:04.634 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:04.634 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:04.634 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:04.635 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:04.635 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 msgr2=0x7f74bc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 0x7f74bc067270 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f74c8004e30 tx=0x7f74c8009b30).stop 2022-02-02T14:32:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 msgr2=0x7f74d4109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f74c400c790 tx=0x7f74c4007d90).stop 2022-02-02T14:32:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 shutdown_connections 2022-02-02T14:32:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74bc064db0 0x7f74bc067270 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d40f55c0 0x7f74d4109c10 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 --2- 172.21.15.33:0/3545796899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74d40f6860 0x7f74d410c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 >> 172.21.15.33:0/3545796899 conn(0x7f74d40f0d40 msgr2=0x7f74d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 shutdown_connections 2022-02-02T14:32:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:04.627+0000 7f74da290700 1 -- 172.21.15.33:0/3545796899 wait complete. 2022-02-02T14:32:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:32:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:04 smithi037 ceph-mon[69017]: pgmap v1600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:04.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3542663108' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:32:05.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:05 smithi033 ceph-mon[101165]: from='client.35718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:05.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:05 smithi033 ceph-mon[101165]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3545796899' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:32:05.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:05 smithi037 ceph-mon[69017]: from='client.35718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:05.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:05 smithi037 ceph-mon[69017]: from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3545796899' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:32:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:06 smithi033 ceph-mon[101165]: pgmap v1601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:06 smithi037 ceph-mon[69017]: pgmap v1601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:08 smithi033 ceph-mon[101165]: pgmap v1602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:08 smithi037 ceph-mon[69017]: pgmap v1602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:10 smithi033 ceph-mon[101165]: pgmap v1603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:10 smithi037 ceph-mon[69017]: pgmap v1603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:12.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:12 smithi033 ceph-mon[101165]: pgmap v1604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:12 smithi037 ceph-mon[69017]: pgmap v1604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:14 smithi033 ceph-mon[101165]: pgmap v1605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:14.921 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:14 smithi037 ceph-mon[69017]: pgmap v1605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:16 smithi033 ceph-mon[101165]: pgmap v1606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:16 smithi037 ceph-mon[69017]: pgmap v1606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:18 smithi033 ceph-mon[101165]: pgmap v1607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:18 smithi037 ceph-mon[69017]: pgmap v1607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:20 smithi033 ceph-mon[101165]: pgmap v1608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:20 smithi037 ceph-mon[69017]: pgmap v1608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:22 smithi033 ceph-mon[101165]: pgmap v1609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:22 smithi037 ceph-mon[69017]: pgmap v1609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:24 smithi033 ceph-mon[101165]: pgmap v1610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:24 smithi037 ceph-mon[69017]: pgmap v1610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:26 smithi033 ceph-mon[101165]: pgmap v1611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:26 smithi037 ceph-mon[69017]: pgmap v1611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:28 smithi033 ceph-mon[101165]: pgmap v1612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:28 smithi037 ceph-mon[69017]: pgmap v1612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:30 smithi033 ceph-mon[101165]: pgmap v1613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:30 smithi037 ceph-mon[69017]: pgmap v1613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:32 smithi033 ceph-mon[101165]: pgmap v1614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:32 smithi037 ceph-mon[69017]: pgmap v1614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:34 smithi033 ceph-mon[101165]: pgmap v1615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:34.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 -- 172.21.15.33:0/2265216671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 msgr2=0x7fb7d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:34.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 --2- 172.21.15.33:0/2265216671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d00f59e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fb7c4004660 tx=0x7fb7c4009b30).stop 2022-02-02T14:32:34.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 -- 172.21.15.33:0/2265216671 shutdown_connections 2022-02-02T14:32:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 --2- 172.21.15.33:0/2265216671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 0x7fb7d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 --2- 172.21.15.33:0/2265216671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d00f59e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 -- 172.21.15.33:0/2265216671 >> 172.21.15.33:0/2265216671 conn(0x7fb7d00f0d40 msgr2=0x7fb7d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 -- 172.21.15.33:0/2265216671 shutdown_connections 2022-02-02T14:32:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.742+0000 7fb7d480a700 1 -- 172.21.15.33:0/2265216671 wait complete. 2022-02-02T14:32:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 Processor -- start 2022-02-02T14:32:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 -- start start 2022-02-02T14:32:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 0x7fb7d010c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d00603c0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7d480a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d0060500 con 0x7fb7d00f6860 2022-02-02T14:32:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33358/0 (socket says 172.21.15.33:33358) 2022-02-02T14:32:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 -- 172.21.15.33:0/1162488565 learned_addr learned my addr 172.21.15.33:0/1162488565 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7cdd9b700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 0x7fb7d010c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 -- 172.21.15.33:0/1162488565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 msgr2=0x7fb7d010c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:34.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 0x7fb7d010c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.743+0000 7fb7ce59c700 1 -- 172.21.15.33:0/1162488565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4005040 con 0x7fb7d00f55c0 2022-02-02T14:32:34.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7ce59c700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fb7c4013a70 tx=0x7fb7c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:34.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c4018070 con 0x7fb7d00f55c0 2022-02-02T14:32:34.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb7c40097d0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d010c660 con 0x7fb7d00f55c0 2022-02-02T14:32:34.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c401de80 con 0x7fb7d00f55c0 2022-02-02T14:32:34.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.744+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d010cb90 con 0x7fb7d00f55c0 2022-02-02T14:32:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.745+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d00f49b0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.745+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb7c4007ba0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.746+0000 7fb7beffd700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 0x7fb7b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.746+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb7c40835f0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.746+0000 7fb7cdd9b700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 0x7fb7b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.746+0000 7fb7cdd9b700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 0x7fb7b8067290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fb7c0004ce0 tx=0x7fb7c000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.750+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb7c40516a0 con 0x7fb7d00f55c0 2022-02-02T14:32:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:34 smithi037 ceph-mon[69017]: pgmap v1615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:34.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.937+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7d00fdf00 con 0x7fb7b8064dd0 2022-02-02T14:32:34.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.938+0000 7fb7beffd700 1 -- 172.21.15.33:0/1162488565 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb7d00fdf00 con 0x7fb7b8064dd0 2022-02-02T14:32:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 msgr2=0x7fb7b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 0x7fb7b8067290 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7fb7c0004ce0 tx=0x7fb7c000b040).stop 2022-02-02T14:32:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 msgr2=0x7fb7d0109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fb7c4013a70 tx=0x7fb7c4009b30).stop 2022-02-02T14:32:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 shutdown_connections 2022-02-02T14:32:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb7b8064dd0 0x7fb7b8067290 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7d00f55c0 0x7fb7d0109c10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 --2- 172.21.15.33:0/1162488565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7d00f6860 0x7fb7d010c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 >> 172.21.15.33:0/1162488565 conn(0x7fb7d00f0d40 msgr2=0x7fb7d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 shutdown_connections 2022-02-02T14:32:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:34.940+0000 7fb7d480a700 1 -- 172.21.15.33:0/1162488565 wait complete. 2022-02-02T14:32:34.949 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:32:35.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/849814054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f7980 msgr2=0x7fa7cc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/849814054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc0f7de0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7fa7b4004660 tx=0x7fa7b4009b30).stop 2022-02-02T14:32:35.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/849814054 shutdown_connections 2022-02-02T14:32:35.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/849814054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc0f7de0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/849814054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/849814054 >> 172.21.15.33:0/849814054 conn(0x7fa7cc0f1e40 msgr2=0x7fa7cc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/849814054 shutdown_connections 2022-02-02T14:32:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/849814054 wait complete. 2022-02-02T14:32:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.041+0000 7fa7d0d5f700 1 Processor -- start 2022-02-02T14:32:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7d0d5f700 1 -- start start 2022-02-02T14:32:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7d0d5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7d0d5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7d0d5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc1079b0 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7d0d5f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7cc107af0 con 0x7fa7cc0f7980 2022-02-02T14:32:35.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33368/0 (socket says 172.21.15.33:33368) 2022-02-02T14:32:35.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 -- 172.21.15.33:0/2792825588 learned_addr learned my addr 172.21.15.33:0/2792825588 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:35.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7c9d9b700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 -- 172.21.15.33:0/2792825588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 msgr2=0x7fa7cc107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 -- 172.21.15.33:0/2792825588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4005040 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7c9d9b700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:32:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.042+0000 7fa7ca59c700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fa7bc00e7c0 tx=0x7fa7bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.043+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7bc0092e0 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.043+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7cc108490 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.043+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7bc00f040 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.043+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7bc0147e0 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.043+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7cc108a50 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.044+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa7bc01b030 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.045+0000 7fa7c2ffd700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 0x7fa7b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.045+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7cc045ad0 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.045+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa7bc081a50 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.045+0000 7fa7c9d9b700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 0x7fa7b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.045+0000 7fa7c9d9b700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 0x7fa7b8067290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fa7b4005010 tx=0x7fa7b4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.049+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa7bc019080 con 0x7fa7cc0f66e0 2022-02-02T14:32:35.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.230+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7cc0fefa0 con 0x7fa7b8064dd0 2022-02-02T14:32:35.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.245+0000 7fa7c2ffd700 1 -- 172.21.15.33:0/2792825588 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa7cc0fefa0 con 0x7fa7b8064dd0 2022-02-02T14:32:35.244 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:32:35.245 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (57m) 19m ago 58m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:32:35.245 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (50m) 19m ago 58m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:32:35.245 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (50m) 20m ago 58m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:32:35.246 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (57m) 19m ago 58m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:32:35.246 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (51m) 19m ago 55m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:32:35.246 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (52m) 19m ago 55m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:32:35.247 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (52m) 20m ago 55m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:32:35.247 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (55m) 20m ago 55m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:32:35.247 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (52m) 19m ago 60m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:32:35.247 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (52m) 20m ago 58m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:32:35.248 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (51m) 19m ago 60m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:32:35.248 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (51m) 20m ago 58m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:32:35.248 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (58m) 19m ago 58m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:32:35.248 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (58m) 20m ago 58m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:32:35.249 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 19m ago 57m - 4096M 2022-02-02T14:32:35.249 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (57m) 19m ago 57m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:32:35.249 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (57m) 19m ago 56m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:32:35.249 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (56m) 20m ago 56m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:32:35.250 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (56m) 20m ago 56m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:32:35.250 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (56m) 20m ago 56m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:32:35.250 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (57m) 19m ago 58m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:32:35.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 msgr2=0x7fa7b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 0x7fa7b8067290 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7fa7b4005010 tx=0x7fa7b4016040).stop 2022-02-02T14:32:35.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 msgr2=0x7fa7cc106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fa7bc00e7c0 tx=0x7fa7bc00b040).stop 2022-02-02T14:32:35.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 shutdown_connections 2022-02-02T14:32:35.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa7b8064dd0 0x7fa7b8067290 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7cc0f66e0 0x7fa7cc106f10 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 --2- 172.21.15.33:0/2792825588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7cc0f7980 0x7fa7cc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.246+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 >> 172.21.15.33:0/2792825588 conn(0x7fa7cc0f1e40 msgr2=0x7fa7cc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.247+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 shutdown_connections 2022-02-02T14:32:35.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.247+0000 7fa7d0d5f700 1 -- 172.21.15.33:0/2792825588 wait complete. 2022-02-02T14:32:35.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 -- 172.21.15.33:0/2307236402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 msgr2=0x7fcb2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 --2- 172.21.15.33:0/2307236402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c0f59e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fcb28004660 tx=0x7fcb28009b30).stop 2022-02-02T14:32:35.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 -- 172.21.15.33:0/2307236402 shutdown_connections 2022-02-02T14:32:35.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 --2- 172.21.15.33:0/2307236402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 0x7fcb2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 --2- 172.21.15.33:0/2307236402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c0f59e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.346+0000 7fcb339d4700 1 -- 172.21.15.33:0/2307236402 >> 172.21.15.33:0/2307236402 conn(0x7fcb2c0f0d40 msgr2=0x7fcb2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.347+0000 7fcb339d4700 1 -- 172.21.15.33:0/2307236402 shutdown_connections 2022-02-02T14:32:35.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.347+0000 7fcb339d4700 1 -- 172.21.15.33:0/2307236402 wait complete. 2022-02-02T14:32:35.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.347+0000 7fcb339d4700 1 Processor -- start 2022-02-02T14:32:35.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.347+0000 7fcb339d4700 1 -- start start 2022-02-02T14:32:35.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb339d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb339d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 0x7fcb2c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb339d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c0603c0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb339d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2c060500 con 0x7fcb2c0f6860 2022-02-02T14:32:35.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33376/0 (socket says 172.21.15.33:33376) 2022-02-02T14:32:35.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 -- 172.21.15.33:0/4206543675 learned_addr learned my addr 172.21.15.33:0/4206543675 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:35.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb30f6f700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 0x7fcb2c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 -- 172.21.15.33:0/4206543675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 msgr2=0x7fcb2c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 0x7fcb2c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 -- 172.21.15.33:0/4206543675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb28005040 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb31770700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fcb28013a70 tx=0x7fcb28009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.348+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb28018070 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.349+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb280097d0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.349+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2c10c6e0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.349+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb2801de80 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.349+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2c10cc10 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.350+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2c045ad0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.351+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb28007ba0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.352+0000 7fcb1dffb700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 0x7fcb18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.352+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb28083ca0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.352+0000 7fcb30f6f700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 0x7fcb18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.352+0000 7fcb30f6f700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 0x7fcb18067290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcb20004c40 tx=0x7fcb2000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.355+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb28051df0 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.604+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb2c0fdf00 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:35 smithi033 ceph-mon[101165]: from='client.35734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:35.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:35 smithi033 ceph-mon[101165]: pgmap v1616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:35.604 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:35 smithi033 ceph-mon[101165]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.604+0000 7fcb1dffb700 1 -- 172.21.15.33:0/4206543675 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fcb28055410 con 0x7fcb2c0f55c0 2022-02-02T14:32:35.605 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:32:35.605 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:32:35.606 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:32:35.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:35.606 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:32:35.607 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:32:35.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:35.607 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:32:35.607 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:32:35.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:35.608 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:32:35.608 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:32:35.608 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:32:35.609 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:32:35.609 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:32:35.609 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:32:35.609 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:32:35.609 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:32:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 msgr2=0x7fcb18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 0x7fcb18067290 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7fcb20004c40 tx=0x7fcb2000b040).stop 2022-02-02T14:32:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 msgr2=0x7fcb2c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7fcb28013a70 tx=0x7fcb28009b30).stop 2022-02-02T14:32:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 shutdown_connections 2022-02-02T14:32:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb18064dd0 0x7fcb18067290 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb2c0f55c0 0x7fcb2c109c90 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 --2- 172.21.15.33:0/4206543675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb2c0f6860 0x7fcb2c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 >> 172.21.15.33:0/4206543675 conn(0x7fcb2c0f0d40 msgr2=0x7fcb2c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 shutdown_connections 2022-02-02T14:32:35.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.606+0000 7fcb339d4700 1 -- 172.21.15.33:0/4206543675 wait complete. 2022-02-02T14:32:35.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 -- 172.21.15.33:0/4265317283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 msgr2=0x7f5a8c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 --2- 172.21.15.33:0/4265317283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c0f59e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f5a7c004660 tx=0x7f5a7c009b30).stop 2022-02-02T14:32:35.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 -- 172.21.15.33:0/4265317283 shutdown_connections 2022-02-02T14:32:35.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 --2- 172.21.15.33:0/4265317283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 0x7f5a8c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 --2- 172.21.15.33:0/4265317283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c0f59e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 -- 172.21.15.33:0/4265317283 >> 172.21.15.33:0/4265317283 conn(0x7f5a8c0f0d40 msgr2=0x7f5a8c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 -- 172.21.15.33:0/4265317283 shutdown_connections 2022-02-02T14:32:35.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.707+0000 7f5a908b2700 1 -- 172.21.15.33:0/4265317283 wait complete. 2022-02-02T14:32:35.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 Processor -- start 2022-02-02T14:32:35.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 -- start start 2022-02-02T14:32:35.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 0x7f5a8c10c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0603e0 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a908b2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c060520 con 0x7f5a8c0f6860 2022-02-02T14:32:35.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a8a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a8a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33386/0 (socket says 172.21.15.33:33386) 2022-02-02T14:32:35.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a8a59c700 1 -- 172.21.15.33:0/1231797005 learned_addr learned my addr 172.21.15.33:0/1231797005 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:32:35.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.708+0000 7f5a89d9b700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 0x7f5a8c10c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a8a59c700 1 -- 172.21.15.33:0/1231797005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 msgr2=0x7f5a8c10c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a8a59c700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 0x7f5a8c10c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a8a59c700 1 -- 172.21.15.33:0/1231797005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c005040 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a8a59c700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f5a7c013a70 tx=0x7f5a7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c018070 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c10c640 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a7c0097d0 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a7c01de80 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.709+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c105d20 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.710+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c045ad0 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.711+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a7c007ba0 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.711+0000 7f5a82ffd700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 0x7f5a78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:32:35.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.711+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5a7c0836a0 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.711+0000 7f5a89d9b700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 0x7f5a78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:32:35.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.712+0000 7f5a89d9b700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 0x7f5a78067290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5a74004ce0 tx=0x7f5a7400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:32:35.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.715+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a7c051750 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:35 smithi037 ceph-mon[69017]: from='client.35734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:35 smithi037 ceph-mon[69017]: pgmap v1616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:35.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:35 smithi037 ceph-mon[69017]: from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:32:35.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.932+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5a8c027a00 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.933+0000 7f5a82ffd700 1 -- 172.21.15.33:0/1231797005 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f5a7c054d70 con 0x7f5a8c0f55c0 2022-02-02T14:32:35.933 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:32:35.934 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:32:35.934 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:32:35.934 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:32:35.934 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:35.935 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:32:35.935 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:32:35.935 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:32:35.935 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:32:35.936 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:32:35.936 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:32:35.936 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:32:35.936 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:32:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:32:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:32:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:32:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:32:35.937 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:32:35.938 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:32:35.938 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:32:35.938 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:32:35.938 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:32:35.939 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:32:35.939 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:32:35.939 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:32:35.939 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:32:35.940 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:32:35.940 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:32:35.940 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:32:35.940 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:32:35.940 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:32:35.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:35.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:35.941 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:32:35.941 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:32:35.942 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:35.942 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:35.942 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:35.942 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:32:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 msgr2=0x7f5a78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 0x7f5a78067290 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f5a74004ce0 tx=0x7f5a7400b040).stop 2022-02-02T14:32:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 msgr2=0x7f5a8c109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:32:35.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f5a7c013a70 tx=0x7f5a7c009b30).stop 2022-02-02T14:32:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 shutdown_connections 2022-02-02T14:32:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a78064dd0 0x7f5a78067290 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a8c0f55c0 0x7f5a8c109bf0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 --2- 172.21.15.33:0/1231797005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c0f6860 0x7f5a8c10c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:32:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 >> 172.21.15.33:0/1231797005 conn(0x7f5a8c0f0d40 msgr2=0x7f5a8c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:32:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 shutdown_connections 2022-02-02T14:32:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:32:35.935+0000 7f5a908b2700 1 -- 172.21.15.33:0/1231797005 wait complete. 2022-02-02T14:32:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:32:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4206543675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:32:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1231797005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:32:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4206543675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:32:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1231797005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:32:37.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:37 smithi033 ceph-mon[101165]: pgmap v1617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:37.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:37 smithi037 ceph-mon[69017]: pgmap v1617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:40.290 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:40 smithi037 ceph-mon[69017]: pgmap v1618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:40.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:40 smithi033 ceph-mon[101165]: pgmap v1618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:42.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:42 smithi033 ceph-mon[101165]: pgmap v1619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:42 smithi037 ceph-mon[69017]: pgmap v1619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:44 smithi033 ceph-mon[101165]: pgmap v1620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:44 smithi037 ceph-mon[69017]: pgmap v1620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:46 smithi033 ceph-mon[101165]: pgmap v1621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:46 smithi037 ceph-mon[69017]: pgmap v1621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:48 smithi033 ceph-mon[101165]: pgmap v1622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:48 smithi037 ceph-mon[69017]: pgmap v1622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:50 smithi033 ceph-mon[101165]: pgmap v1623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:50 smithi037 ceph-mon[69017]: pgmap v1623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:52 smithi033 ceph-mon[101165]: pgmap v1624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:52 smithi037 ceph-mon[69017]: pgmap v1624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:54 smithi033 ceph-mon[101165]: pgmap v1625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:54 smithi037 ceph-mon[69017]: pgmap v1625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:32:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:32:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:32:55.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:32:56.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:56 smithi033 ceph-mon[101165]: pgmap v1626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:56 smithi037 ceph-mon[69017]: pgmap v1626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:32:58 smithi033 ceph-mon[101165]: pgmap v1627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:32:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:32:58 smithi037 ceph-mon[69017]: pgmap v1627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:00 smithi033 ceph-mon[101165]: pgmap v1628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:00 smithi037 ceph-mon[69017]: pgmap v1628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:02 smithi033 ceph-mon[101165]: pgmap v1629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:02 smithi037 ceph-mon[69017]: pgmap v1629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:04 smithi033 ceph-mon[101165]: pgmap v1630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:04 smithi037 ceph-mon[69017]: pgmap v1630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.049+0000 7fedf80f2700 1 -- 172.21.15.33:0/3723058414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6860 msgr2=0x7fedf00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.049+0000 7fedf80f2700 1 --2- 172.21.15.33:0/3723058414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6860 0x7fedf00f6cc0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7fede4004660 tx=0x7fede4009b30).stop 2022-02-02T14:33:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.049+0000 7fedf80f2700 1 -- 172.21.15.33:0/3723058414 shutdown_connections 2022-02-02T14:33:06.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.049+0000 7fedf80f2700 1 --2- 172.21.15.33:0/3723058414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6860 0x7fedf00f6cc0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.049+0000 7fedf80f2700 1 --2- 172.21.15.33:0/3723058414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f55c0 0x7fedf00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.050+0000 7fedf80f2700 1 -- 172.21.15.33:0/3723058414 >> 172.21.15.33:0/3723058414 conn(0x7fedf00f0d40 msgr2=0x7fedf00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.050+0000 7fedf80f2700 1 -- 172.21.15.33:0/3723058414 shutdown_connections 2022-02-02T14:33:06.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.050+0000 7fedf80f2700 1 -- 172.21.15.33:0/3723058414 wait complete. 2022-02-02T14:33:06.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 Processor -- start 2022-02-02T14:33:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 -- start start 2022-02-02T14:33:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6860 0x7fedf010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00603c0 con 0x7fedf00f55c0 2022-02-02T14:33:06.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf80f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0060500 con 0x7fedf00f6860 2022-02-02T14:33:06.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf5e8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf5e8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33396/0 (socket says 172.21.15.33:33396) 2022-02-02T14:33:06.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf5e8e700 1 -- 172.21.15.33:0/2469049713 learned_addr learned my addr 172.21.15.33:0/2469049713 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:06.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.051+0000 7fedf568d700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6860 0x7fedf010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf5e8e700 1 -- 172.21.15.33:0/2469049713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6860 msgr2=0x7fedf010c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf5e8e700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6860 0x7fedf010c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf5e8e700 1 -- 172.21.15.33:0/2469049713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede4005040 con 0x7fedf00f55c0 2022-02-02T14:33:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf5e8e700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fede800d7f0 tx=0x7fede8004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede800f490 con 0x7fedf00f55c0 2022-02-02T14:33:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf010c720 con 0x7fedf00f55c0 2022-02-02T14:33:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fede800f040 con 0x7fedf00f55c0 2022-02-02T14:33:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede80139b0 con 0x7fedf00f55c0 2022-02-02T14:33:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.052+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf010ccb0 con 0x7fedf00f55c0 2022-02-02T14:33:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.053+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf0045ad0 con 0x7fedf00f55c0 2022-02-02T14:33:06.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.054+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fede801a030 con 0x7fedf00f55c0 2022-02-02T14:33:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.054+0000 7fedee7fc700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 0x7fedd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.054+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fede8081900 con 0x7fedf00f55c0 2022-02-02T14:33:06.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.054+0000 7fedf568d700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 0x7fedd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.055+0000 7fedf568d700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 0x7fedd8067290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fede4004630 tx=0x7fede4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.059+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fede804f9b0 con 0x7fedf00f55c0 2022-02-02T14:33:06.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.247+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedf0057f10 con 0x7fedd8064dd0 2022-02-02T14:33:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.248+0000 7fedee7fc700 1 -- 172.21.15.33:0/2469049713 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fedf0057f10 con 0x7fedd8064dd0 2022-02-02T14:33:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 msgr2=0x7fedd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 0x7fedd8067290 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7fede4004630 tx=0x7fede4009b30).stop 2022-02-02T14:33:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 msgr2=0x7fedf0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fede800d7f0 tx=0x7fede8004e80).stop 2022-02-02T14:33:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 shutdown_connections 2022-02-02T14:33:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064dd0 0x7fedd8067290 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f55c0 0x7fedf0109c70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 --2- 172.21.15.33:0/2469049713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6860 0x7fedf010c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.250+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 >> 172.21.15.33:0/2469049713 conn(0x7fedf00f0d40 msgr2=0x7fedf00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.251+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 shutdown_connections 2022-02-02T14:33:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.251+0000 7fedf80f2700 1 -- 172.21.15.33:0/2469049713 wait complete. 2022-02-02T14:33:06.260 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:33:06.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 -- 172.21.15.33:0/689287122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f6860 msgr2=0x7fba100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 --2- 172.21.15.33:0/689287122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f6860 0x7fba100f6cc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7fba0c004660 tx=0x7fba0c009b30).stop 2022-02-02T14:33:06.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 -- 172.21.15.33:0/689287122 shutdown_connections 2022-02-02T14:33:06.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 --2- 172.21.15.33:0/689287122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f6860 0x7fba100f6cc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 --2- 172.21.15.33:0/689287122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f55c0 0x7fba100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 -- 172.21.15.33:0/689287122 >> 172.21.15.33:0/689287122 conn(0x7fba100f0d40 msgr2=0x7fba100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 -- 172.21.15.33:0/689287122 shutdown_connections 2022-02-02T14:33:06.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 -- 172.21.15.33:0/689287122 wait complete. 2022-02-02T14:33:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.352+0000 7fba184a5700 1 Processor -- start 2022-02-02T14:33:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba184a5700 1 -- start start 2022-02-02T14:33:06.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba184a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba184a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f6860 0x7fba101063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba184a5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101069b0 con 0x7fba100f55c0 2022-02-02T14:33:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba184a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101071c0 con 0x7fba100f6860 2022-02-02T14:33:06.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33406/0 (socket says 172.21.15.33:33406) 2022-02-02T14:33:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 -- 172.21.15.33:0/2369209786 learned_addr learned my addr 172.21.15.33:0/2369209786 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba15a40700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f6860 0x7fba101063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 -- 172.21.15.33:0/2369209786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f6860 msgr2=0x7fba101063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f6860 0x7fba101063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 -- 172.21.15.33:0/2369209786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c005040 con 0x7fba100f55c0 2022-02-02T14:33:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.353+0000 7fba16241700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fba0000e9a0 tx=0x7fba00007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.354+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba0000c980 con 0x7fba100f55c0 2022-02-02T14:33:06.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.354+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fba00011470 con 0x7fba100f55c0 2022-02-02T14:33:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.354+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba101073e0 con 0x7fba100f55c0 2022-02-02T14:33:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.354+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba00010610 con 0x7fba100f55c0 2022-02-02T14:33:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.354+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba10107970 con 0x7fba100f55c0 2022-02-02T14:33:06.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.355+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100f49b0 con 0x7fba100f55c0 2022-02-02T14:33:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.355+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fba00021070 con 0x7fba100f55c0 2022-02-02T14:33:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.356+0000 7fba06ffd700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 0x7fb9fc067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.356+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fba000845e0 con 0x7fba100f55c0 2022-02-02T14:33:06.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.356+0000 7fba15a40700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 0x7fb9fc067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.356+0000 7fba15a40700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 0x7fb9fc067230 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fba0c004630 tx=0x7fba0c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.360+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fba00052690 con 0x7fba100f55c0 2022-02-02T14:33:06.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.542+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fba100ff8a0 con 0x7fb9fc064d70 2022-02-02T14:33:06.544 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:06 smithi033 ceph-mon[101165]: pgmap v1631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.557+0000 7fba06ffd700 1 -- 172.21.15.33:0/2369209786 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fba100ff8a0 con 0x7fb9fc064d70 2022-02-02T14:33:06.557 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:33:06.558 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (58m) 20m ago 59m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:33:06.558 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (51m) 20m ago 59m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:33:06.558 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (51m) 20m ago 58m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:33:06.558 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (58m) 20m ago 59m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:33:06.559 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (51m) 20m ago 55m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:33:06.559 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (52m) 20m ago 55m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:33:06.559 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (53m) 20m ago 55m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:33:06.559 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (55m) 20m ago 55m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:33:06.560 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (53m) 20m ago 60m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:33:06.560 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (52m) 20m ago 58m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:33:06.560 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (52m) 20m ago 60m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:33:06.560 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (51m) 20m ago 58m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:33:06.561 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (59m) 20m ago 59m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:33:06.561 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (58m) 20m ago 58m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:33:06.561 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 20m ago 58m - 4096M 2022-02-02T14:33:06.561 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (57m) 20m ago 57m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:33:06.561 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (57m) 20m ago 57m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:33:06.562 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (57m) 20m ago 57m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:33:06.562 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (56m) 20m ago 56m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:33:06.562 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (56m) 20m ago 56m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:33:06.562 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (58m) 20m ago 58m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:33:06.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 msgr2=0x7fb9fc067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 0x7fb9fc067230 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fba0c004630 tx=0x7fba0c009b30).stop 2022-02-02T14:33:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 msgr2=0x7fba10105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7fba0000e9a0 tx=0x7fba00007ea0).stop 2022-02-02T14:33:06.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 shutdown_connections 2022-02-02T14:33:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb9fc064d70 0x7fb9fc067230 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba100f55c0 0x7fba10105ec0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 --2- 172.21.15.33:0/2369209786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba100f6860 0x7fba101063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 >> 172.21.15.33:0/2369209786 conn(0x7fba100f0d40 msgr2=0x7fba100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 shutdown_connections 2022-02-02T14:33:06.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.559+0000 7fba184a5700 1 -- 172.21.15.33:0/2369209786 wait complete. 2022-02-02T14:33:06.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 -- 172.21.15.33:0/156934042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 msgr2=0x7f55cc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 --2- 172.21.15.33:0/156934042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f6b30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f55bc004660 tx=0x7f55bc009b30).stop 2022-02-02T14:33:06.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 -- 172.21.15.33:0/156934042 shutdown_connections 2022-02-02T14:33:06.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 --2- 172.21.15.33:0/156934042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f6b30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 --2- 172.21.15.33:0/156934042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 0x7f55cc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 -- 172.21.15.33:0/156934042 >> 172.21.15.33:0/156934042 conn(0x7f55cc0f0b90 msgr2=0x7f55cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 -- 172.21.15.33:0/156934042 shutdown_connections 2022-02-02T14:33:06.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.660+0000 7f55d3407700 1 -- 172.21.15.33:0/156934042 wait complete. 2022-02-02T14:33:06.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 Processor -- start 2022-02-02T14:33:06.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 -- start start 2022-02-02T14:33:06.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 0x7f55cc0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0f7f70 con 0x7f55cc0f66d0 2022-02-02T14:33:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d3407700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc0f80b0 con 0x7f55cc0f5430 2022-02-02T14:33:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33418/0 (socket says 172.21.15.33:33418) 2022-02-02T14:33:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 -- 172.21.15.33:0/4180572697 learned_addr learned my addr 172.21.15.33:0/4180572697 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d2405700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 0x7f55cc0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 -- 172.21.15.33:0/4180572697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 msgr2=0x7f55cc0f9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 0x7f55cc0f9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.661+0000 7f55d1c04700 1 -- 172.21.15.33:0/4180572697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc005040 con 0x7f55cc0f66d0 2022-02-02T14:33:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55d1c04700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f55bc000c00 tx=0x7f55bc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55bc019070 con 0x7f55cc0f66d0 2022-02-02T14:33:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f55bc007e70 con 0x7f55cc0f66d0 2022-02-02T14:33:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55cc0f8330 con 0x7f55cc0f66d0 2022-02-02T14:33:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55bc014ce0 con 0x7f55cc0f66d0 2022-02-02T14:33:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.662+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55cc0f8890 con 0x7f55cc0f66d0 2022-02-02T14:33:06.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.663+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55cc045ad0 con 0x7f55cc0f66d0 2022-02-02T14:33:06.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.663+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f55bc025070 con 0x7f55cc0f66d0 2022-02-02T14:33:06.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.664+0000 7f55c2ffd700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 0x7f55b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.664+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f55bc082960 con 0x7f55cc0f66d0 2022-02-02T14:33:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.664+0000 7f55d2405700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 0x7f55b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.664+0000 7f55d2405700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 0x7f55b80672e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f55cc0f9320 tx=0x7f55c800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.668+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f55bc050a10 con 0x7f55cc0f66d0 2022-02-02T14:33:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:06 smithi037 ceph-mon[69017]: pgmap v1631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.913+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f55cc0fdbf0 con 0x7f55cc0f66d0 2022-02-02T14:33:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.914+0000 7f55c2ffd700 1 -- 172.21.15.33:0/4180572697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f55bc023070 con 0x7f55cc0f66d0 2022-02-02T14:33:06.914 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:33:06.914 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:33:06.914 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:33:06.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:06.915 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:33:06.915 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:33:06.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:06.916 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:33:06.916 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:33:06.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:06.916 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:33:06.917 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:33:06.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:06.917 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:33:06.917 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:33:06.918 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:33:06.918 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:33:06.918 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:33:06.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 msgr2=0x7f55b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 0x7f55b80672e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f55cc0f9320 tx=0x7f55c800b040).stop 2022-02-02T14:33:06.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 msgr2=0x7f55cc0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:06.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f55bc000c00 tx=0x7f55bc00b040).stop 2022-02-02T14:33:06.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 shutdown_connections 2022-02-02T14:33:06.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f55b8064e20 0x7f55b80672e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55cc0f5430 0x7f55cc0f9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 --2- 172.21.15.33:0/4180572697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55cc0f66d0 0x7f55cc0f7a10 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:06.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 >> 172.21.15.33:0/4180572697 conn(0x7f55cc0f0b90 msgr2=0x7f55cc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:06.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 shutdown_connections 2022-02-02T14:33:06.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:06.916+0000 7f55d3407700 1 -- 172.21.15.33:0/4180572697 wait complete. 2022-02-02T14:33:07.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 -- 172.21.15.33:0/3930583759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14380f9830 msgr2=0x7f14380fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:07.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3930583759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14380f9830 0x7f14380fbc80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f1420004660 tx=0x7f1420009b30).stop 2022-02-02T14:33:07.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 -- 172.21.15.33:0/3930583759 shutdown_connections 2022-02-02T14:33:07.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3930583759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14380f9830 0x7f14380fbc80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3930583759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1438060270 0x7f14380f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 -- 172.21.15.33:0/3930583759 >> 172.21.15.33:0/3930583759 conn(0x7f14380f0d40 msgr2=0x7f14380f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:07.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 -- 172.21.15.33:0/3930583759 shutdown_connections 2022-02-02T14:33:07.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.017+0000 7f143d1c6700 1 -- 172.21.15.33:0/3930583759 wait complete. 2022-02-02T14:33:07.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 Processor -- start 2022-02-02T14:33:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 -- start start 2022-02-02T14:33:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:07.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14380f9830 0x7f14380f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:07.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380f57a0 con 0x7f1438060270 2022-02-02T14:33:07.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143d1c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14380f58e0 con 0x7f14380f9830 2022-02-02T14:33:07.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f1436d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:07.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f143659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14380f9830 0x7f14380f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f1436d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33426/0 (socket says 172.21.15.33:33426) 2022-02-02T14:33:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.018+0000 7f1436d9d700 1 -- 172.21.15.33:0/3460323182 learned_addr learned my addr 172.21.15.33:0/3460323182 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f1436d9d700 1 -- 172.21.15.33:0/3460323182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14380f9830 msgr2=0x7f14380f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f1436d9d700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14380f9830 0x7f14380f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f1436d9d700 1 -- 172.21.15.33:0/3460323182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420005040 con 0x7f1438060270 2022-02-02T14:33:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f1436d9d700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f14280026d0 tx=0x7f1428009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14280079c0 con 0x7f1438060270 2022-02-02T14:33:07.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14380f5bc0 con 0x7f1438060270 2022-02-02T14:33:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f142800f040 con 0x7f1438060270 2022-02-02T14:33:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14280148b0 con 0x7f1438060270 2022-02-02T14:33:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.019+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143810ef70 con 0x7f1438060270 2022-02-02T14:33:07.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.020+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1438045ad0 con 0x7f1438060270 2022-02-02T14:33:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.021+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1428007b20 con 0x7f1438060270 2022-02-02T14:33:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.021+0000 7f142f7fe700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 0x7f1424067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.021+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f14280819e0 con 0x7f1438060270 2022-02-02T14:33:07.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.021+0000 7f143659c700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 0x7f1424067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.022+0000 7f143659c700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 0x7f1424067290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f1420005010 tx=0x7f1420009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:07.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.025+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f142804fa90 con 0x7f1438060270 2022-02-02T14:33:07.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.237+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14380f5d50 con 0x7f1438060270 2022-02-02T14:33:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.237+0000 7f142f7fe700 1 -- 172.21.15.33:0/3460323182 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f14380f5d50 con 0x7f1438060270 2022-02-02T14:33:07.238 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:33:07.238 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:33:07.239 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:33:07.239 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:33:07.239 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:07.239 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:33:07.240 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:33:07.240 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:33:07.240 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:33:07.240 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:33:07.241 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:33:07.241 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:33:07.241 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:33:07.241 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:33:07.242 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:33:07.242 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:33:07.242 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:33:07.242 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:33:07.243 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:33:07.243 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:33:07.243 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:33:07.243 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:33:07.243 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:33:07.244 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:33:07.244 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:33:07.244 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:33:07.244 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:33:07.245 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:33:07.245 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:33:07.245 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:33:07.245 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:33:07.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:07.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:07.246 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:33:07.246 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:07.247 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:07.247 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:07.247 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:07.247 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:07.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 msgr2=0x7f1424067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:07.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 0x7f1424067290 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f1420005010 tx=0x7f1420009b30).stop 2022-02-02T14:33:07.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 msgr2=0x7f14380f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:07.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f14280026d0 tx=0x7f1428009de0).stop 2022-02-02T14:33:07.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 shutdown_connections 2022-02-02T14:33:07.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1424064dd0 0x7f1424067290 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1438060270 0x7f14380f6dc0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 --2- 172.21.15.33:0/3460323182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14380f9830 0x7f14380f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:07.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 >> 172.21.15.33:0/3460323182 conn(0x7f14380f0d40 msgr2=0x7f14380f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:07.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 shutdown_connections 2022-02-02T14:33:07.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:07.241+0000 7f143d1c6700 1 -- 172.21.15.33:0/3460323182 wait complete. 2022-02-02T14:33:07.252 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:33:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:07 smithi033 ceph-mon[101165]: from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4180572697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:33:07.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3460323182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:33:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:07 smithi037 ceph-mon[69017]: from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4180572697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:33:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3460323182' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:33:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:08 smithi033 ceph-mon[101165]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:08 smithi033 ceph-mon[101165]: pgmap v1632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:08 smithi037 ceph-mon[69017]: from='client.35754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:08.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:08 smithi037 ceph-mon[69017]: pgmap v1632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:10 smithi033 ceph-mon[101165]: pgmap v1633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:10 smithi037 ceph-mon[69017]: pgmap v1633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:12 smithi033 ceph-mon[101165]: pgmap v1634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:12 smithi037 ceph-mon[69017]: pgmap v1634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:14 smithi033 ceph-mon[101165]: pgmap v1635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:14 smithi037 ceph-mon[69017]: pgmap v1635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:16 smithi033 ceph-mon[101165]: pgmap v1636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:16 smithi037 ceph-mon[69017]: pgmap v1636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:18 smithi033 ceph-mon[101165]: pgmap v1637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:18 smithi037 ceph-mon[69017]: pgmap v1637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:20 smithi033 ceph-mon[101165]: pgmap v1638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:20 smithi037 ceph-mon[69017]: pgmap v1638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:22 smithi033 ceph-mon[101165]: pgmap v1639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:22 smithi037 ceph-mon[69017]: pgmap v1639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:24 smithi033 ceph-mon[101165]: pgmap v1640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:24 smithi037 ceph-mon[69017]: pgmap v1640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:26 smithi033 ceph-mon[101165]: pgmap v1641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:26 smithi037 ceph-mon[69017]: pgmap v1641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:28 smithi033 ceph-mon[101165]: pgmap v1642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:28 smithi037 ceph-mon[69017]: pgmap v1642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:30 smithi033 ceph-mon[101165]: pgmap v1643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:30 smithi037 ceph-mon[69017]: pgmap v1643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:32 smithi033 ceph-mon[101165]: pgmap v1644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:32 smithi037 ceph-mon[69017]: pgmap v1644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:34 smithi033 ceph-mon[101165]: pgmap v1645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:34 smithi037 ceph-mon[69017]: pgmap v1645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:36 smithi033 ceph-mon[101165]: pgmap v1646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:36 smithi037 ceph-mon[69017]: pgmap v1646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 -- 172.21.15.33:0/547006822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 msgr2=0x7fedd00fb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 --2- 172.21.15.33:0/547006822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd00fb510 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7fedb8004660 tx=0x7fedb8009b30).stop 2022-02-02T14:33:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 -- 172.21.15.33:0/547006822 shutdown_connections 2022-02-02T14:33:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 --2- 172.21.15.33:0/547006822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 0x7fedd00fddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 --2- 172.21.15.33:0/547006822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd00fb510 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 -- 172.21.15.33:0/547006822 >> 172.21.15.33:0/547006822 conn(0x7fedd00f0b90 msgr2=0x7fedd00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 -- 172.21.15.33:0/547006822 shutdown_connections 2022-02-02T14:33:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.356+0000 7fedd4c33700 1 -- 172.21.15.33:0/547006822 wait complete. 2022-02-02T14:33:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 Processor -- start 2022-02-02T14:33:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 -- start start 2022-02-02T14:33:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 0x7fedd0109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0109a00 con 0x7fedd0060310 2022-02-02T14:33:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedd4c33700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0109b40 con 0x7fedd00fba00 2022-02-02T14:33:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedcf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33436/0 (socket says 172.21.15.33:33436) 2022-02-02T14:33:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.357+0000 7fedcf7fe700 1 -- 172.21.15.33:0/910829352 learned_addr learned my addr 172.21.15.33:0/910829352 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedceffd700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 0x7fedd0109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedcf7fe700 1 -- 172.21.15.33:0/910829352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 msgr2=0x7fedd0109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedcf7fe700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 0x7fedd0109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedcf7fe700 1 -- 172.21.15.33:0/910829352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8005040 con 0x7fedd0060310 2022-02-02T14:33:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedcf7fe700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fedb8009990 tx=0x7fedb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb8018070 con 0x7fedd0060310 2022-02-02T14:33:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fedb8007ba0 con 0x7fedd0060310 2022-02-02T14:33:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd010a480 con 0x7fedd0060310 2022-02-02T14:33:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedb801c3c0 con 0x7fedd0060310 2022-02-02T14:33:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.358+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd010a9e0 con 0x7fedd0060310 2022-02-02T14:33:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.359+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0045ad0 con 0x7fedd0060310 2022-02-02T14:33:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.360+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fedb801d420 con 0x7fedd0060310 2022-02-02T14:33:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.360+0000 7fedc7fff700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 0x7fedbc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.360+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fedb8083820 con 0x7fedd0060310 2022-02-02T14:33:37.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.360+0000 7fedceffd700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 0x7fedbc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.361+0000 7fedceffd700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 0x7fedbc0672e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fedd00600e0 tx=0x7fedc000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.365+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fedb80552a0 con 0x7fedd0060310 2022-02-02T14:33:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.555+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fedd0101030 con 0x7fedbc064e20 2022-02-02T14:33:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.556+0000 7fedc7fff700 1 -- 172.21.15.33:0/910829352 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fedd0101030 con 0x7fedbc064e20 2022-02-02T14:33:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 msgr2=0x7fedbc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 0x7fedbc0672e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fedd00600e0 tx=0x7fedc000b040).stop 2022-02-02T14:33:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 msgr2=0x7fedd0108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7fedb8009990 tx=0x7fedb8009b30).stop 2022-02-02T14:33:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 shutdown_connections 2022-02-02T14:33:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedbc064e20 0x7fedbc0672e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedd0060310 0x7fedd0108f60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 --2- 172.21.15.33:0/910829352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedd00fba00 0x7fedd0109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 >> 172.21.15.33:0/910829352 conn(0x7fedd00f0b90 msgr2=0x7fedd00f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 shutdown_connections 2022-02-02T14:33:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.558+0000 7fedd4c33700 1 -- 172.21.15.33:0/910829352 wait complete. 2022-02-02T14:33:37.567 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:33:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.659+0000 7f6b364af700 1 -- 172.21.15.33:0/3332019295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 msgr2=0x7f6b300fb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.659+0000 7f6b364af700 1 --2- 172.21.15.33:0/3332019295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b300fb6a0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f6b20004660 tx=0x7f6b20009b30).stop 2022-02-02T14:33:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 -- 172.21.15.33:0/3332019295 shutdown_connections 2022-02-02T14:33:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 --2- 172.21.15.33:0/3332019295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 0x7f6b300fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 --2- 172.21.15.33:0/3332019295 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b300fb6a0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 -- 172.21.15.33:0/3332019295 >> 172.21.15.33:0/3332019295 conn(0x7f6b300f0d40 msgr2=0x7f6b300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 -- 172.21.15.33:0/3332019295 shutdown_connections 2022-02-02T14:33:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 -- 172.21.15.33:0/3332019295 wait complete. 2022-02-02T14:33:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 Processor -- start 2022-02-02T14:33:37.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.660+0000 7f6b364af700 1 -- start start 2022-02-02T14:33:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b364af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b364af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 0x7f6b30109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b364af700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30109bf0 con 0x7f6b30060310 2022-02-02T14:33:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b364af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b30109d30 con 0x7f6b300fbb90 2022-02-02T14:33:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33446/0 (socket says 172.21.15.33:33446) 2022-02-02T14:33:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 -- 172.21.15.33:0/3488506948 learned_addr learned my addr 172.21.15.33:0/3488506948 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:37.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2f7fe700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 0x7f6b30109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 -- 172.21.15.33:0/3488506948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 msgr2=0x7f6b30109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 0x7f6b30109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 -- 172.21.15.33:0/3488506948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20005040 con 0x7f6b30060310 2022-02-02T14:33:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2ffff700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f6b20009990 tx=0x7f6b20009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b20018070 con 0x7f6b30060310 2022-02-02T14:33:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3010a670 con 0x7f6b30060310 2022-02-02T14:33:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b20007ca0 con 0x7f6b30060310 2022-02-02T14:33:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.661+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b2001c600 con 0x7f6b30060310 2022-02-02T14:33:37.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.662+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3010abd0 con 0x7f6b30060310 2022-02-02T14:33:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.662+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30045ad0 con 0x7f6b30060310 2022-02-02T14:33:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.663+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b2001d9d0 con 0x7f6b30060310 2022-02-02T14:33:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.663+0000 7f6b2cff9700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 0x7f6b18067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.663+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6b20083910 con 0x7f6b30060310 2022-02-02T14:33:37.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.663+0000 7f6b2f7fe700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 0x7f6b18067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.664+0000 7f6b2f7fe700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 0x7f6b18067290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6b240041d0 tx=0x7f6b24009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.668+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b200553f0 con 0x7f6b30060310 2022-02-02T14:33:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.851+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b301011c0 con 0x7f6b18064dd0 2022-02-02T14:33:37.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.866+0000 7f6b2cff9700 1 -- 172.21.15.33:0/3488506948 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6b301011c0 con 0x7f6b18064dd0 2022-02-02T14:33:37.865 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:33:37.866 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (58m) 21m ago 59m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:33:37.866 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (51m) 21m ago 59m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:33:37.866 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (51m) 21m ago 59m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:33:37.866 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (58m) 21m ago 59m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:33:37.867 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (52m) 21m ago 56m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:33:37.867 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (53m) 21m ago 56m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:33:37.867 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (53m) 21m ago 56m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:33:37.867 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (56m) 21m ago 56m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:33:37.868 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (53m) 21m ago 61m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:33:37.868 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (53m) 21m ago 59m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:33:37.868 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (52m) 21m ago 61m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:33:37.868 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (52m) 21m ago 59m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:33:37.869 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (59m) 21m ago 59m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:33:37.869 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (59m) 21m ago 59m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:33:37.869 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 21m ago 58m - 4096M 2022-02-02T14:33:37.869 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (58m) 21m ago 58m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:33:37.869 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (58m) 21m ago 58m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:33:37.870 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (57m) 21m ago 57m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:33:37.870 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (57m) 21m ago 57m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:33:37.870 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (57m) 21m ago 57m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:33:37.870 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (58m) 21m ago 59m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:33:37.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 msgr2=0x7f6b18067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 0x7f6b18067290 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f6b240041d0 tx=0x7f6b24009040).stop 2022-02-02T14:33:37.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 msgr2=0x7f6b30109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f6b20009990 tx=0x7f6b20009b30).stop 2022-02-02T14:33:37.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 shutdown_connections 2022-02-02T14:33:37.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b18064dd0 0x7f6b18067290 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b30060310 0x7f6b30109150 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 --2- 172.21.15.33:0/3488506948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b300fbb90 0x7f6b30109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 >> 172.21.15.33:0/3488506948 conn(0x7f6b300f0d40 msgr2=0x7f6b300f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 shutdown_connections 2022-02-02T14:33:37.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.868+0000 7f6b364af700 1 -- 172.21.15.33:0/3488506948 wait complete. 2022-02-02T14:33:37.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- 172.21.15.33:0/1521488269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 msgr2=0x7fb2b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 --2- 172.21.15.33:0/1521488269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b40f7de0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fb2a0004660 tx=0x7fb2a0009b30).stop 2022-02-02T14:33:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- 172.21.15.33:0/1521488269 shutdown_connections 2022-02-02T14:33:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 --2- 172.21.15.33:0/1521488269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b40f7de0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 --2- 172.21.15.33:0/1521488269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 0x7fb2b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- 172.21.15.33:0/1521488269 >> 172.21.15.33:0/1521488269 conn(0x7fb2b40f1e40 msgr2=0x7fb2b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- 172.21.15.33:0/1521488269 shutdown_connections 2022-02-02T14:33:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- 172.21.15.33:0/1521488269 wait complete. 2022-02-02T14:33:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 Processor -- start 2022-02-02T14:33:37.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.968+0000 7fb2baece700 1 -- start start 2022-02-02T14:33:37.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2baece700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 0x7fb2b4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2baece700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2baece700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41079b0 con 0x7fb2b40f7980 2022-02-02T14:33:37.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2baece700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4107af0 con 0x7fb2b40f66e0 2022-02-02T14:33:37.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33458/0 (socket says 172.21.15.33:33458) 2022-02-02T14:33:37.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2582344249 learned_addr learned my addr 172.21.15.33:0/2582344249 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:37.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b8c6a700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 0x7fb2b4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2582344249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 msgr2=0x7fb2b4106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:37.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 0x7fb2b4106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:37.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2582344249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0005040 con 0x7fb2b40f7980 2022-02-02T14:33:37.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.969+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fb2a0009990 tx=0x7fb2a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.970+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a0018070 con 0x7fb2b40f7980 2022-02-02T14:33:37.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.970+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b4108430 con 0x7fb2b40f7980 2022-02-02T14:33:37.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.970+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2a0007ba0 con 0x7fb2b40f7980 2022-02-02T14:33:37.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.970+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a001c3c0 con 0x7fb2b40f7980 2022-02-02T14:33:37.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.970+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4108990 con 0x7fb2b40f7980 2022-02-02T14:33:37.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.971+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4045ad0 con 0x7fb2b40f7980 2022-02-02T14:33:37.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.971+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2a001d420 con 0x7fb2b40f7980 2022-02-02T14:33:37.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.972+0000 7fb2b17fa700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 0x7fb2a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:37.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.972+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2a00836d0 con 0x7fb2b40f7980 2022-02-02T14:33:37.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.972+0000 7fb2b8c6a700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 0x7fb2a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:37.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.972+0000 7fb2b8c6a700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 0x7fb2a4067290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fb2b40f77e0 tx=0x7fb2a8009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:37.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:37.976+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2a0055150 con 0x7fb2b40f7980 2022-02-02T14:33:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.220+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb2b4027a00 con 0x7fb2b40f7980 2022-02-02T14:33:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.221+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2582344249 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb2a0054d40 con 0x7fb2b40f7980 2022-02-02T14:33:38.221 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:33:38.221 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:33:38.221 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:33:38.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:38.222 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:33:38.222 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:33:38.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:38.222 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:33:38.222 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:33:38.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:38.223 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:33:38.223 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:33:38.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:33:38.224 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:33:38.224 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:33:38.224 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:33:38.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:33:38.224 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:33:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.223+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 msgr2=0x7fb2a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.223+0000 7fb2baece700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 0x7fb2a4067290 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fb2b40f77e0 tx=0x7fb2a8009c80).stop 2022-02-02T14:33:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.223+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 msgr2=0x7fb2b4107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.223+0000 7fb2baece700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fb2a0009990 tx=0x7fb2a0009b30).stop 2022-02-02T14:33:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 shutdown_connections 2022-02-02T14:33:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a4064dd0 0x7fb2a4067290 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f66e0 0x7fb2b4106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 --2- 172.21.15.33:0/2582344249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f7980 0x7fb2b4107400 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 >> 172.21.15.33:0/2582344249 conn(0x7fb2b40f1e40 msgr2=0x7fb2b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 shutdown_connections 2022-02-02T14:33:38.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.224+0000 7fb2baece700 1 -- 172.21.15.33:0/2582344249 wait complete. 2022-02-02T14:33:38.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- 172.21.15.33:0/3625369923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f5430 msgr2=0x7fd9b00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/3625369923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f5430 0x7fd9b00f5850 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7fd9ac004660 tx=0x7fd9ac009b30).stop 2022-02-02T14:33:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- 172.21.15.33:0/3625369923 shutdown_connections 2022-02-02T14:33:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/3625369923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f66d0 0x7fd9b00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/3625369923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f5430 0x7fd9b00f5850 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- 172.21.15.33:0/3625369923 >> 172.21.15.33:0/3625369923 conn(0x7fd9b00f0b90 msgr2=0x7fd9b00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:38.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- 172.21.15.33:0/3625369923 shutdown_connections 2022-02-02T14:33:38.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- 172.21.15.33:0/3625369923 wait complete. 2022-02-02T14:33:38.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 Processor -- start 2022-02-02T14:33:38.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.325+0000 7fd9b6b59700 1 -- start start 2022-02-02T14:33:38.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b6b59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 0x7fd9b01099e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:38.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b6b59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:38.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b6b59700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0060420 con 0x7fd9b00f66d0 2022-02-02T14:33:38.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b6b59700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0060560 con 0x7fd9b00f5430 2022-02-02T14:33:38.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:38.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33468/0 (socket says 172.21.15.33:33468) 2022-02-02T14:33:38.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 -- 172.21.15.33:0/1598818737 learned_addr learned my addr 172.21.15.33:0/1598818737 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:33:38.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5b57700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 0x7fd9b01099e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:38.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 -- 172.21.15.33:0/1598818737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 msgr2=0x7fd9b01099e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 0x7fd9b01099e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 -- 172.21.15.33:0/1598818737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac005040 con 0x7fd9b00f66d0 2022-02-02T14:33:38.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5b57700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 0x7fd9b01099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:33:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.326+0000 7fd9b5356700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd9a000e7f0 tx=0x7fd9a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.327+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a00092e0 con 0x7fd9b00f66d0 2022-02-02T14:33:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.327+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b010c4f0 con 0x7fd9b00f66d0 2022-02-02T14:33:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.327+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd9a000f040 con 0x7fd9b00f66d0 2022-02-02T14:33:38.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.327+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9a0014750 con 0x7fd9b00f66d0 2022-02-02T14:33:38.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.327+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b010ca80 con 0x7fd9b00f66d0 2022-02-02T14:33:38.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.328+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b0045ad0 con 0x7fd9b00f66d0 2022-02-02T14:33:38.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.328+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd9a001b030 con 0x7fd9b00f66d0 2022-02-02T14:33:38.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.329+0000 7fd9a67fc700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 0x7fd99c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:33:38.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.329+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd9a0081810 con 0x7fd9b00f66d0 2022-02-02T14:33:38.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.329+0000 7fd9b5b57700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 0x7fd99c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:33:38.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.329+0000 7fd9b5b57700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 0x7fd99c0672e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd9ac000c00 tx=0x7fd9ac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:33:38.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.333+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd9a004f970 con 0x7fd9b00f66d0 2022-02-02T14:33:38.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:38 smithi033 ceph-mon[101165]: pgmap v1647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:38.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2582344249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:33:38.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.547+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd9b0027a00 con 0x7fd9b00f66d0 2022-02-02T14:33:38.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.548+0000 7fd9a67fc700 1 -- 172.21.15.33:0/1598818737 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd9a0019070 con 0x7fd9b00f66d0 2022-02-02T14:33:38.548 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:33:38.548 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:33:38.548 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:33:38.549 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:33:38.549 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:38.549 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:33:38.550 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:33:38.550 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:33:38.550 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:33:38.550 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:33:38.551 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:33:38.551 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:33:38.551 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:33:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:33:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:33:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:33:38.552 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:33:38.553 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:33:38.553 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:33:38.553 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:33:38.553 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:33:38.554 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:33:38.554 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:33:38.554 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:33:38.554 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:33:38.555 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:33:38.555 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:33:38.555 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:33:38.555 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:33:38.556 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:33:38.556 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:33:38.556 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:38.556 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:38.557 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:33:38.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:33:38.557 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:38.557 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:38.558 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:38.558 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:33:38.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 msgr2=0x7fd99c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 0x7fd99c0672e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fd9ac000c00 tx=0x7fd9ac00b040).stop 2022-02-02T14:33:38.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 msgr2=0x7fd9b010bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:33:38.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fd9a000e7f0 tx=0x7fd9a000b040).stop 2022-02-02T14:33:38.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 shutdown_connections 2022-02-02T14:33:38.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd99c064e20 0x7fd99c0672e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9b00f5430 0x7fd9b01099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 --2- 172.21.15.33:0/1598818737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9b00f66d0 0x7fd9b010bee0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:33:38.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.549+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 >> 172.21.15.33:0/1598818737 conn(0x7fd9b00f0b90 msgr2=0x7fd9b00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:33:38.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.550+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 shutdown_connections 2022-02-02T14:33:38.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:33:38.550+0000 7fd9b6b59700 1 -- 172.21.15.33:0/1598818737 wait complete. 2022-02-02T14:33:38.562 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:33:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:38 smithi037 ceph-mon[69017]: pgmap v1647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:38.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2582344249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:33:39.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:39 smithi033 ceph-mon[101165]: from='client.35766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:39.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:39 smithi033 ceph-mon[101165]: from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:39.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:39 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1598818737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:33:39.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:39 smithi037 ceph-mon[69017]: from='client.35766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:39.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:39 smithi037 ceph-mon[69017]: from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:33:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:39 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1598818737' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:33:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:40 smithi033 ceph-mon[101165]: pgmap v1648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:40 smithi037 ceph-mon[69017]: pgmap v1648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:42 smithi033 ceph-mon[101165]: pgmap v1649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:42 smithi037 ceph-mon[69017]: pgmap v1649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:44 smithi033 ceph-mon[101165]: pgmap v1650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:44 smithi037 ceph-mon[69017]: pgmap v1650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:46.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:46 smithi033 ceph-mon[101165]: pgmap v1651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:46 smithi037 ceph-mon[69017]: pgmap v1651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:48 smithi033 ceph-mon[101165]: pgmap v1652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:48 smithi037 ceph-mon[69017]: pgmap v1652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:50 smithi033 ceph-mon[101165]: pgmap v1653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:50 smithi037 ceph-mon[69017]: pgmap v1653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:52 smithi033 ceph-mon[101165]: pgmap v1654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:52 smithi037 ceph-mon[69017]: pgmap v1654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:54 smithi033 ceph-mon[101165]: pgmap v1655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:33:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:33:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:54 smithi037 ceph-mon[69017]: pgmap v1655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:33:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:33:56.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:56 smithi033 ceph-mon[101165]: pgmap v1656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:56 smithi037 ceph-mon[69017]: pgmap v1656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:33:57 smithi033 ceph-mon[101165]: pgmap v1657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:33:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:33:57 smithi037 ceph-mon[69017]: pgmap v1657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:00 smithi033 ceph-mon[101165]: pgmap v1658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:00 smithi037 ceph-mon[69017]: pgmap v1658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:02 smithi033 ceph-mon[101165]: pgmap v1659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:02 smithi037 ceph-mon[69017]: pgmap v1659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:04 smithi033 ceph-mon[101165]: pgmap v1660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:04 smithi037 ceph-mon[69017]: pgmap v1660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:06 smithi033 ceph-mon[101165]: pgmap v1661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:06 smithi037 ceph-mon[69017]: pgmap v1661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:08.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 -- 172.21.15.33:0/500936118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc0f9820 msgr2=0x7f47dc0fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 --2- 172.21.15.33:0/500936118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc0f9820 0x7f47dc0fbc70 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f47d0004660 tx=0x7f47d0009b30).stop 2022-02-02T14:34:08.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 -- 172.21.15.33:0/500936118 shutdown_connections 2022-02-02T14:34:08.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 --2- 172.21.15.33:0/500936118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc0f9820 0x7f47dc0fbc70 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 --2- 172.21.15.33:0/500936118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc060310 0x7f47dc0f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 -- 172.21.15.33:0/500936118 >> 172.21.15.33:0/500936118 conn(0x7f47dc0f0d40 msgr2=0x7f47dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:08.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:08 smithi033 ceph-mon[101165]: pgmap v1662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:08.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 -- 172.21.15.33:0/500936118 shutdown_connections 2022-02-02T14:34:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.664+0000 7f47e1c64700 1 -- 172.21.15.33:0/500936118 wait complete. 2022-02-02T14:34:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 Processor -- start 2022-02-02T14:34:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 -- start start 2022-02-02T14:34:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc0f9820 0x7f47dc0f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0f5700 con 0x7f47dc060310 2022-02-02T14:34:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47e1c64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc0f5840 con 0x7f47dc0f9820 2022-02-02T14:34:08.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47db7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33476/0 (socket says 172.21.15.33:33476) 2022-02-02T14:34:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47daffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc0f9820 0x7f47dc0f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.665+0000 7f47db7fe700 1 -- 172.21.15.33:0/2099091724 learned_addr learned my addr 172.21.15.33:0/2099091724 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47db7fe700 1 -- 172.21.15.33:0/2099091724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc0f9820 msgr2=0x7f47dc0f51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47db7fe700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc0f9820 0x7f47dc0f51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47db7fe700 1 -- 172.21.15.33:0/2099091724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0005040 con 0x7f47dc060310 2022-02-02T14:34:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47db7fe700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f47cc00c790 tx=0x7f47cc007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47cc002590 con 0x7f47dc060310 2022-02-02T14:34:08.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47cc002ba0 con 0x7f47dc060310 2022-02-02T14:34:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc0f5b20 con 0x7f47dc060310 2022-02-02T14:34:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47cc013d90 con 0x7f47dc060310 2022-02-02T14:34:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.666+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc10ef70 con 0x7f47dc060310 2022-02-02T14:34:08.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.667+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc045ad0 con 0x7f47dc060310 2022-02-02T14:34:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.668+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47cc01a060 con 0x7f47dc060310 2022-02-02T14:34:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.668+0000 7f47c3fff700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 0x7f47c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.668+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f47cc081c40 con 0x7f47dc060310 2022-02-02T14:34:08.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.668+0000 7f47daffd700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 0x7f47c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.669+0000 7f47daffd700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 0x7f47c4067290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f47d0004630 tx=0x7f47d0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:08.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.673+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47cc04fcf0 con 0x7f47dc060310 2022-02-02T14:34:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:08 smithi037 ceph-mon[69017]: pgmap v1662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.861+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47dc0feef0 con 0x7f47c4064dd0 2022-02-02T14:34:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.863+0000 7f47c3fff700 1 -- 172.21.15.33:0/2099091724 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f47dc0feef0 con 0x7f47c4064dd0 2022-02-02T14:34:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 msgr2=0x7f47c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 0x7f47c4067290 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f47d0004630 tx=0x7f47d0009b30).stop 2022-02-02T14:34:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 msgr2=0x7f47dc0f6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f47cc00c790 tx=0x7f47cc007d70).stop 2022-02-02T14:34:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 shutdown_connections 2022-02-02T14:34:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c4064dd0 0x7f47c4067290 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc060310 0x7f47dc0f6d20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 --2- 172.21.15.33:0/2099091724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47dc0f9820 0x7f47dc0f51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 >> 172.21.15.33:0/2099091724 conn(0x7f47dc0f0d40 msgr2=0x7f47dc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 shutdown_connections 2022-02-02T14:34:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.865+0000 7f47e1c64700 1 -- 172.21.15.33:0/2099091724 wait complete. 2022-02-02T14:34:08.874 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:34:08.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 -- 172.21.15.33:0/2428844643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f6860 msgr2=0x7f445c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 --2- 172.21.15.33:0/2428844643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f6860 0x7f445c0f6cc0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f444c004660 tx=0x7f444c009b30).stop 2022-02-02T14:34:08.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 -- 172.21.15.33:0/2428844643 shutdown_connections 2022-02-02T14:34:08.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 --2- 172.21.15.33:0/2428844643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f6860 0x7f445c0f6cc0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 --2- 172.21.15.33:0/2428844643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f55c0 0x7f445c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 -- 172.21.15.33:0/2428844643 >> 172.21.15.33:0/2428844643 conn(0x7f445c0f0d40 msgr2=0x7f445c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:08.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 -- 172.21.15.33:0/2428844643 shutdown_connections 2022-02-02T14:34:08.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.966+0000 7f44619c5700 1 -- 172.21.15.33:0/2428844643 wait complete. 2022-02-02T14:34:08.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 Processor -- start 2022-02-02T14:34:08.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 -- start start 2022-02-02T14:34:08.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 0x7f445c109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c109bb0 con 0x7f445c0f55c0 2022-02-02T14:34:08.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f44619c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445c109cf0 con 0x7f445c0f6860 2022-02-02T14:34:08.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33486/0 (socket says 172.21.15.33:33486) 2022-02-02T14:34:08.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 -- 172.21.15.33:0/1126322565 learned_addr learned my addr 172.21.15.33:0/1126322565 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:08.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445a7fc700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 0x7f445c109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 -- 172.21.15.33:0/1126322565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 msgr2=0x7f445c109600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 0x7f445c109600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445affd700 1 -- 172.21.15.33:0/1126322565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c005040 con 0x7f445c0f55c0 2022-02-02T14:34:08.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.967+0000 7f445a7fc700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 0x7f445c109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:34:08.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f445affd700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f4450002700 tx=0x7f4450009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:08.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4450009320 con 0x7f445c0f55c0 2022-02-02T14:34:08.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f445000f040 con 0x7f445c0f55c0 2022-02-02T14:34:08.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44500148e0 con 0x7f445c0f55c0 2022-02-02T14:34:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f445c10a690 con 0x7f445c0f55c0 2022-02-02T14:34:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.968+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f445c10ac50 con 0x7f445c0f55c0 2022-02-02T14:34:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.969+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445c045ad0 con 0x7f445c0f55c0 2022-02-02T14:34:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.970+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4450009480 con 0x7f445c0f55c0 2022-02-02T14:34:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.970+0000 7f44437fe700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 0x7f4444067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:08.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.971+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4450082190 con 0x7f445c0f55c0 2022-02-02T14:34:08.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.971+0000 7f445a7fc700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 0x7f4444067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:08.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.971+0000 7f445a7fc700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 0x7f4444067270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f444c004630 tx=0x7f444c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:08.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:08.974+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4450053cf0 con 0x7f445c0f55c0 2022-02-02T14:34:09.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.160+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f445c0faaa0 con 0x7f4444064db0 2022-02-02T14:34:09.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.175+0000 7f44437fe700 1 -- 172.21.15.33:0/1126322565 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f445c0faaa0 con 0x7f4444064db0 2022-02-02T14:34:09.174 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:34:09.174 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (59m) 21m ago 60m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:34:09.175 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (52m) 21m ago 60m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:34:09.175 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (52m) 21m ago 59m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:34:09.175 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (59m) 21m ago 60m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:34:09.175 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (52m) 21m ago 56m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:34:09.176 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (53m) 21m ago 56m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:34:09.176 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (54m) 21m ago 56m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:34:09.176 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (56m) 21m ago 56m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:34:09.176 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (54m) 21m ago 61m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:34:09.176 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (53m) 21m ago 59m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:34:09.177 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (53m) 21m ago 61m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:34:09.177 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (53m) 21m ago 59m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:34:09.177 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (60m) 21m ago 60m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:34:09.177 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (59m) 21m ago 59m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:34:09.178 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 21m ago 59m - 4096M 2022-02-02T14:34:09.178 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (58m) 21m ago 58m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:34:09.178 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (58m) 21m ago 58m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:34:09.178 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (58m) 21m ago 58m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:34:09.178 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (58m) 21m ago 58m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:34:09.179 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (57m) 21m ago 57m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:34:09.179 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (59m) 21m ago 60m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:34:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 msgr2=0x7f4444067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 0x7f4444067270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f444c004630 tx=0x7f444c009b30).stop 2022-02-02T14:34:09.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 msgr2=0x7f445c109110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f4450002700 tx=0x7f4450009e00).stop 2022-02-02T14:34:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 shutdown_connections 2022-02-02T14:34:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4444064db0 0x7f4444067270 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445c0f55c0 0x7f445c109110 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 --2- 172.21.15.33:0/1126322565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c0f6860 0x7f445c109600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 >> 172.21.15.33:0/1126322565 conn(0x7f445c0f0d40 msgr2=0x7f445c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:09.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 shutdown_connections 2022-02-02T14:34:09.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.177+0000 7f44619c5700 1 -- 172.21.15.33:0/1126322565 wait complete. 2022-02-02T14:34:09.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- 172.21.15.33:0/1707786171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 msgr2=0x7f3dbc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 --2- 172.21.15.33:0/1707786171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc0f6b00 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f3db8004660 tx=0x7f3db8009b30).stop 2022-02-02T14:34:09.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- 172.21.15.33:0/1707786171 shutdown_connections 2022-02-02T14:34:09.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 --2- 172.21.15.33:0/1707786171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 0x7f3dbc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 --2- 172.21.15.33:0/1707786171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc0f6b00 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- 172.21.15.33:0/1707786171 >> 172.21.15.33:0/1707786171 conn(0x7f3dbc0f1e40 msgr2=0x7f3dbc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:09.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- 172.21.15.33:0/1707786171 shutdown_connections 2022-02-02T14:34:09.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- 172.21.15.33:0/1707786171 wait complete. 2022-02-02T14:34:09.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 Processor -- start 2022-02-02T14:34:09.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.278+0000 7f3dc3691700 1 -- start start 2022-02-02T14:34:09.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc3691700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc3691700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 0x7f3dbc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc3691700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc06a380 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc3691700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc06a4c0 con 0x7f3dbc0f7980 2022-02-02T14:34:09.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33496/0 (socket says 172.21.15.33:33496) 2022-02-02T14:34:09.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 -- 172.21.15.33:0/955727246 learned_addr learned my addr 172.21.15.33:0/955727246 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:09.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc0c2c700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 0x7f3dbc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 -- 172.21.15.33:0/955727246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 msgr2=0x7f3dbc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 0x7f3dbc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 -- 172.21.15.33:0/955727246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8005040 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.279+0000 7f3dc142d700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f3db8013a70 tx=0x7f3db8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:09.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.280+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db8018070 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.280+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3db80097d0 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.280+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc06a740 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.280+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3db801c3c0 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.280+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc06aca0 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.281+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc045ad0 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.281+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3db8007ba0 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.282+0000 7f3db1ffb700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 0x7f3da8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.282+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3db8083690 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.282+0000 7f3dc0c2c700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 0x7f3da8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.282+0000 7f3dc0c2c700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 0x7f3da8067290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3dac009760 tx=0x7f3dac009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:09.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.286+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3db8051800 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.529+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3dbc0fef70 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.529+0000 7f3db1ffb700 1 -- 172.21.15.33:0/955727246 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3db8054e20 con 0x7f3dbc0f66e0 2022-02-02T14:34:09.530 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:34:09.530 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:34:09.530 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:34:09.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:09.531 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:34:09.531 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:34:09.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:09.531 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:34:09.531 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:34:09.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:09.532 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:34:09.532 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:34:09.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:09.533 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:34:09.533 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:34:09.533 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:34:09.533 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:34:09.533 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:34:09.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 msgr2=0x7f3da8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 0x7f3da8067290 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f3dac009760 tx=0x7f3dac009c60).stop 2022-02-02T14:34:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 msgr2=0x7f3dbc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f3db8013a70 tx=0x7f3db8009b30).stop 2022-02-02T14:34:09.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 shutdown_connections 2022-02-02T14:34:09.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3da8064dd0 0x7f3da8067290 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dbc0f66e0 0x7f3dbc06b9a0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 --2- 172.21.15.33:0/955727246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dbc0f7980 0x7f3dbc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.531+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 >> 172.21.15.33:0/955727246 conn(0x7f3dbc0f1e40 msgr2=0x7f3dbc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.532+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 shutdown_connections 2022-02-02T14:34:09.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.532+0000 7f3dc3691700 1 -- 172.21.15.33:0/955727246 wait complete. 2022-02-02T14:34:09.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 -- 172.21.15.33:0/1745111301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f55e0 msgr2=0x7f18f00f5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 --2- 172.21.15.33:0/1745111301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f55e0 0x7f18f00f5a00 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f18e0004660 tx=0x7f18e0009b30).stop 2022-02-02T14:34:09.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 -- 172.21.15.33:0/1745111301 shutdown_connections 2022-02-02T14:34:09.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 --2- 172.21.15.33:0/1745111301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f5ef0 0x7f18f00f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 --2- 172.21.15.33:0/1745111301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f55e0 0x7f18f00f5a00 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 -- 172.21.15.33:0/1745111301 >> 172.21.15.33:0/1745111301 conn(0x7f18f00f0de0 msgr2=0x7f18f00f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:09.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 -- 172.21.15.33:0/1745111301 shutdown_connections 2022-02-02T14:34:09.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.632+0000 7f18f543f700 1 -- 172.21.15.33:0/1745111301 wait complete. 2022-02-02T14:34:09.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.633+0000 7f18f543f700 1 Processor -- start 2022-02-02T14:34:09.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.633+0000 7f18f543f700 1 -- start start 2022-02-02T14:34:09.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f55e0 0x7f18f0109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0109bf0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0109d30 con 0x7f18f00f55e0 2022-02-02T14:34:09.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33508/0 (socket says 172.21.15.33:33508) 2022-02-02T14:34:09.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 -- 172.21.15.33:0/4187779719 learned_addr learned my addr 172.21.15.33:0/4187779719 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:09.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18eeffd700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f55e0 0x7f18f0109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 -- 172.21.15.33:0/4187779719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f55e0 msgr2=0x7f18f0109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f55e0 0x7f18f0109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 -- 172.21.15.33:0/4187779719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0005040 con 0x7f18f00f5ef0 2022-02-02T14:34:09.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18ee7fc700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f18e400c530 tx=0x7f18e4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:09.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e400f650 con 0x7f18f00f5ef0 2022-02-02T14:34:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f18e400fc60 con 0x7f18f00f5ef0 2022-02-02T14:34:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f010a6d0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18e4012c20 con 0x7f18f00f5ef0 2022-02-02T14:34:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.634+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f010ac90 con 0x7f18f00f5ef0 2022-02-02T14:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.636+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f0045ad0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.636+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f18e4010070 con 0x7f18f00f5ef0 2022-02-02T14:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.636+0000 7f18d77fe700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 0x7f18d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.636+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f18e4081700 con 0x7f18f00f5ef0 2022-02-02T14:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.637+0000 7f18eeffd700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 0x7f18d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:09.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.637+0000 7f18eeffd700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 0x7f18d8067290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f18e0004630 tx=0x7f18e0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:09.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.641+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f18e40531e0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.852+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f18f010b2d0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.852+0000 7f18d77fe700 1 -- 172.21.15.33:0/4187779719 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f18e4052dd0 con 0x7f18f00f5ef0 2022-02-02T14:34:09.852 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:34:09.852 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:34:09.853 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:34:09.853 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:34:09.853 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:09.853 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:34:09.854 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:34:09.854 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:34:09.854 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:34:09.854 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:34:09.855 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:34:09.855 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:34:09.855 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:34:09.856 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:34:09.856 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:34:09.856 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:34:09.856 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:34:09.857 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:34:09.857 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:34:09.857 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:34:09.857 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:34:09.857 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:34:09.858 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:34:09.858 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:34:09.858 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:34:09.858 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:34:09.859 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:34:09.859 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:34:09.859 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:34:09.859 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:34:09.859 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:34:09.860 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:09.860 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:09.860 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:34:09.860 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:09.860 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:09.861 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:09.861 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:09.861 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 msgr2=0x7f18d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 0x7f18d8067290 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f18e0004630 tx=0x7f18e0009b30).stop 2022-02-02T14:34:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 msgr2=0x7f18f0109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f18e400c530 tx=0x7f18e4007e20).stop 2022-02-02T14:34:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 shutdown_connections 2022-02-02T14:34:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f18d8064dd0 0x7f18d8067290 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f00f55e0 0x7f18f0109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 --2- 172.21.15.33:0/4187779719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18f00f5ef0 0x7f18f0109640 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 >> 172.21.15.33:0/4187779719 conn(0x7f18f00f0de0 msgr2=0x7f18f005ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.854+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 shutdown_connections 2022-02-02T14:34:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:09.855+0000 7f18f543f700 1 -- 172.21.15.33:0/4187779719 wait complete. 2022-02-02T14:34:09.865 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:34:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:10 smithi033 ceph-mon[101165]: from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:10 smithi033 ceph-mon[101165]: pgmap v1663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:10 smithi033 ceph-mon[101165]: from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/955727246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:34:10.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4187779719' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:34:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:10 smithi037 ceph-mon[69017]: from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:10 smithi037 ceph-mon[69017]: pgmap v1663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:10 smithi037 ceph-mon[69017]: from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/955727246' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:34:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4187779719' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:34:12.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:12 smithi033 ceph-mon[101165]: pgmap v1664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:12 smithi037 ceph-mon[69017]: pgmap v1664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:14 smithi033 ceph-mon[101165]: pgmap v1665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:14 smithi037 ceph-mon[69017]: pgmap v1665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:16 smithi033 ceph-mon[101165]: pgmap v1666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:16 smithi037 ceph-mon[69017]: pgmap v1666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:18 smithi033 ceph-mon[101165]: pgmap v1667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:18 smithi037 ceph-mon[69017]: pgmap v1667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:20 smithi033 ceph-mon[101165]: pgmap v1668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:20.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:20 smithi037 ceph-mon[69017]: pgmap v1668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:22 smithi033 ceph-mon[101165]: pgmap v1669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:22 smithi037 ceph-mon[69017]: pgmap v1669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:24 smithi033 ceph-mon[101165]: pgmap v1670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:24 smithi037 ceph-mon[69017]: pgmap v1670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:26 smithi033 ceph-mon[101165]: pgmap v1671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:26 smithi037 ceph-mon[69017]: pgmap v1671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:28 smithi033 ceph-mon[101165]: pgmap v1672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:28 smithi037 ceph-mon[69017]: pgmap v1672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:30 smithi033 ceph-mon[101165]: pgmap v1673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:30 smithi037 ceph-mon[69017]: pgmap v1673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:32 smithi033 ceph-mon[101165]: pgmap v1674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:32 smithi037 ceph-mon[69017]: pgmap v1674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:34 smithi033 ceph-mon[101165]: pgmap v1675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:34 smithi037 ceph-mon[69017]: pgmap v1675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:36 smithi033 ceph-mon[101165]: pgmap v1676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:36 smithi037 ceph-mon[69017]: pgmap v1676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:38 smithi033 ceph-mon[101165]: pgmap v1677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:38 smithi037 ceph-mon[69017]: pgmap v1677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 -- 172.21.15.33:0/2106780062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f66e0 msgr2=0x7ff8880f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2106780062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f66e0 0x7ff8880f6b00 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7ff8800099e0 tx=0x7ff880004d10).stop 2022-02-02T14:34:39.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 -- 172.21.15.33:0/2106780062 shutdown_connections 2022-02-02T14:34:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2106780062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f7980 0x7ff8880f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2106780062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f66e0 0x7ff8880f6b00 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 -- 172.21.15.33:0/2106780062 >> 172.21.15.33:0/2106780062 conn(0x7ff8880f1e40 msgr2=0x7ff8880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 -- 172.21.15.33:0/2106780062 shutdown_connections 2022-02-02T14:34:39.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.969+0000 7ff88e02d700 1 -- 172.21.15.33:0/2106780062 wait complete. 2022-02-02T14:34:39.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 Processor -- start 2022-02-02T14:34:39.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 -- start start 2022-02-02T14:34:39.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f66e0 0x7ff88806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:39.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:39.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88806a380 con 0x7ff8880f7980 2022-02-02T14:34:39.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.970+0000 7ff88e02d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88806a4c0 con 0x7ff8880f66e0 2022-02-02T14:34:39.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:39.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33518/0 (socket says 172.21.15.33:33518) 2022-02-02T14:34:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 -- 172.21.15.33:0/2593091337 learned_addr learned my addr 172.21.15.33:0/2593091337 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff8877fe700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f66e0 0x7ff88806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 -- 172.21.15.33:0/2593091337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f66e0 msgr2=0x7ff88806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f66e0 0x7ff88806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:39.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 -- 172.21.15.33:0/2593091337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009640 con 0x7ff8880f7980 2022-02-02T14:34:39.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff886ffd700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7ff87c0026d0 tx=0x7ff87c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:39.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.971+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87c0079c0 con 0x7ff8880f7980 2022-02-02T14:34:39.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.972+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff87c00f040 con 0x7ff8880f7980 2022-02-02T14:34:39.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.972+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88806a7a0 con 0x7ff8880f7980 2022-02-02T14:34:39.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.972+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff87c0148b0 con 0x7ff8880f7980 2022-02-02T14:34:39.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.972+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88810f100 con 0x7ff8880f7980 2022-02-02T14:34:39.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.973+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff888045ad0 con 0x7ff8880f7980 2022-02-02T14:34:39.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.973+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff87c007b20 con 0x7ff8880f7980 2022-02-02T14:34:39.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.974+0000 7ff86ffff700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 0x7ff870067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:39.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.974+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff87c081e40 con 0x7ff8880f7980 2022-02-02T14:34:39.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.974+0000 7ff8877fe700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 0x7ff870067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:39.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.974+0000 7ff8877fe700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 0x7ff870067290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff8800099b0 tx=0x7ff880004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:39.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:39.978+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff87c04fef0 con 0x7ff8880f7980 2022-02-02T14:34:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.166+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff888057f10 con 0x7ff870064dd0 2022-02-02T14:34:40.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.167+0000 7ff86ffff700 1 -- 172.21.15.33:0/2593091337 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff888057f10 con 0x7ff870064dd0 2022-02-02T14:34:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 msgr2=0x7ff870067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 0x7ff870067290 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7ff8800099b0 tx=0x7ff880004d10).stop 2022-02-02T14:34:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 msgr2=0x7ff888069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7ff87c0026d0 tx=0x7ff87c009de0).stop 2022-02-02T14:34:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 shutdown_connections 2022-02-02T14:34:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff870064dd0 0x7ff870067290 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8880f66e0 0x7ff88806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 --2- 172.21.15.33:0/2593091337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8880f7980 0x7ff888069e20 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 >> 172.21.15.33:0/2593091337 conn(0x7ff8880f1e40 msgr2=0x7ff8880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 shutdown_connections 2022-02-02T14:34:40.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.169+0000 7ff88e02d700 1 -- 172.21.15.33:0/2593091337 wait complete. 2022-02-02T14:34:40.179 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:34:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 -- 172.21.15.33:0/2763560865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 msgr2=0x7ff4300f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 --2- 172.21.15.33:0/2763560865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f5850 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7ff42c004660 tx=0x7ff42c009b30).stop 2022-02-02T14:34:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 -- 172.21.15.33:0/2763560865 shutdown_connections 2022-02-02T14:34:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 --2- 172.21.15.33:0/2763560865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 --2- 172.21.15.33:0/2763560865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f5850 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.270+0000 7ff4371cc700 1 -- 172.21.15.33:0/2763560865 >> 172.21.15.33:0/2763560865 conn(0x7ff4300f0b90 msgr2=0x7ff4300f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.271+0000 7ff4371cc700 1 -- 172.21.15.33:0/2763560865 shutdown_connections 2022-02-02T14:34:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.271+0000 7ff4371cc700 1 -- 172.21.15.33:0/2763560865 wait complete. 2022-02-02T14:34:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.271+0000 7ff4371cc700 1 Processor -- start 2022-02-02T14:34:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.271+0000 7ff4371cc700 1 -- start start 2022-02-02T14:34:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.271+0000 7ff4371cc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4371cc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4371cc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300f7f70 con 0x7ff4300f5430 2022-02-02T14:34:40.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4371cc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300f80b0 con 0x7ff4300f66d0 2022-02-02T14:34:40.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33526/0 (socket says 172.21.15.33:33526) 2022-02-02T14:34:40.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 -- 172.21.15.33:0/3204585021 learned_addr learned my addr 172.21.15.33:0/3204585021 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:40.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4359c9700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 -- 172.21.15.33:0/3204585021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 msgr2=0x7ff4300f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 -- 172.21.15.33:0/3204585021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c005040 con 0x7ff4300f5430 2022-02-02T14:34:40.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4359c9700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:34:40.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4361ca700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff42c013a70 tx=0x7ff42c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42c018070 con 0x7ff4300f5430 2022-02-02T14:34:40.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300f8330 con 0x7ff4300f5430 2022-02-02T14:34:40.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff42c0097d0 con 0x7ff4300f5430 2022-02-02T14:34:40.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff42c01c3c0 con 0x7ff4300f5430 2022-02-02T14:34:40.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.272+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4300f8890 con 0x7ff4300f5430 2022-02-02T14:34:40.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.274+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430045ad0 con 0x7ff4300f5430 2022-02-02T14:34:40.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.274+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff42c007ba0 con 0x7ff4300f5430 2022-02-02T14:34:40.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.274+0000 7ff426ffd700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 0x7ff41c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.275+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff42c083780 con 0x7ff4300f5430 2022-02-02T14:34:40.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.275+0000 7ff4359c9700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 0x7ff41c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.275+0000 7ff4359c9700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 0x7ff41c0672e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff420009780 tx=0x7ff420009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.279+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff42c0518f0 con 0x7ff4300f5430 2022-02-02T14:34:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.462+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4300fab10 con 0x7ff41c064e20 2022-02-02T14:34:40.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.477+0000 7ff426ffd700 1 -- 172.21.15.33:0/3204585021 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff4300fab10 con 0x7ff41c064e20 2022-02-02T14:34:40.476 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:34:40.477 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (59m) 22m ago 60m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:34:40.477 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (52m) 22m ago 60m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:34:40.477 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (52m) 22m ago 60m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:34:40.477 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (59m) 22m ago 60m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:34:40.477 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (53m) 22m ago 57m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:34:40.478 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (54m) 22m ago 57m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:34:40.478 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (54m) 22m ago 57m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:34:40.478 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (57m) 22m ago 57m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:34:40.478 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (54m) 22m ago 62m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:34:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (54m) 22m ago 60m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:34:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (53m) 22m ago 62m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:34:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (53m) 22m ago 60m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:34:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (60m) 22m ago 60m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:34:40.479 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (60m) 22m ago 60m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:34:40.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 22m ago 59m - 4096M 2022-02-02T14:34:40.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (59m) 22m ago 59m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:34:40.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (59m) 22m ago 59m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:34:40.480 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (58m) 22m ago 58m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:34:40.481 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (58m) 22m ago 58m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:34:40.481 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (58m) 22m ago 58m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:34:40.481 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (59m) 22m ago 60m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:34:40.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.478+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 msgr2=0x7ff41c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.478+0000 7ff4371cc700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 0x7ff41c0672e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff420009780 tx=0x7ff420009c80).stop 2022-02-02T14:34:40.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.478+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 msgr2=0x7ff4300f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.478+0000 7ff4371cc700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7ff42c013a70 tx=0x7ff42c009b30).stop 2022-02-02T14:34:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 shutdown_connections 2022-02-02T14:34:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff41c064e20 0x7ff41c0672e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4300f5430 0x7ff4300f9590 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 --2- 172.21.15.33:0/3204585021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4300f66d0 0x7ff4300f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 >> 172.21.15.33:0/3204585021 conn(0x7ff4300f0b90 msgr2=0x7ff43005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 shutdown_connections 2022-02-02T14:34:40.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.479+0000 7ff4371cc700 1 -- 172.21.15.33:0/3204585021 wait complete. 2022-02-02T14:34:40.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 -- 172.21.15.33:0/3408274266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f6a10 msgr2=0x7f3f1c0f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 --2- 172.21.15.33:0/3408274266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c0f6e30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f3f0c004660 tx=0x7f3f0c009b30).stop 2022-02-02T14:34:40.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 -- 172.21.15.33:0/3408274266 shutdown_connections 2022-02-02T14:34:40.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 --2- 172.21.15.33:0/3408274266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c0f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 --2- 172.21.15.33:0/3408274266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c0f6e30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 -- 172.21.15.33:0/3408274266 >> 172.21.15.33:0/3408274266 conn(0x7f3f1c0f0320 msgr2=0x7f3f1c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.578+0000 7f3f20b96700 1 -- 172.21.15.33:0/3408274266 shutdown_connections 2022-02-02T14:34:40.580 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:40 smithi033 ceph-mon[101165]: pgmap v1678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.579+0000 7f3f20b96700 1 -- 172.21.15.33:0/3408274266 wait complete. 2022-02-02T14:34:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.579+0000 7f3f20b96700 1 Processor -- start 2022-02-02T14:34:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.579+0000 7f3f20b96700 1 -- start start 2022-02-02T14:34:40.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f20b96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f20b96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c10bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f20b96700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0f53c0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f20b96700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0f5500 con 0x7f3f1c0f6a10 2022-02-02T14:34:40.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33536/0 (socket says 172.21.15.33:33536) 2022-02-02T14:34:40.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 -- 172.21.15.33:0/1338213916 learned_addr learned my addr 172.21.15.33:0/1338213916 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:40.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1affd700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c10bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 -- 172.21.15.33:0/1338213916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f6a10 msgr2=0x7f3f1c10bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c10bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 -- 172.21.15.33:0/1338213916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c005040 con 0x7f3f1c0f5710 2022-02-02T14:34:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f1b7fe700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f3f0c013a70 tx=0x7f3f0c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.580+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c018070 con 0x7f3f1c0f5710 2022-02-02T14:34:40.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.581+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c10c4f0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.581+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3f0c0097d0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.581+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0c01de80 con 0x7f3f1c0f5710 2022-02-02T14:34:40.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.581+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c10ca50 con 0x7f3f1c0f5710 2022-02-02T14:34:40.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.582+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c045ad0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.582+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3f0c01c4e0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.582+0000 7f3f03fff700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.583+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3f0c083730 con 0x7f3f1c0f5710 2022-02-02T14:34:40.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.583+0000 7f3f1affd700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.583+0000 7f3f1affd700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 0x7f3f040672e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f3f1c0f67e0 tx=0x7f3f1000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.587+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3f0c0518c0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:40 smithi037 ceph-mon[69017]: pgmap v1678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:40.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.827+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f1c0fdd40 con 0x7f3f1c0f5710 2022-02-02T14:34:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.827+0000 7f3f03fff700 1 -- 172.21.15.33:0/1338213916 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3f0c054ee0 con 0x7f3f1c0f5710 2022-02-02T14:34:40.827 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:34:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:34:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:34:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:40.828 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:34:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:34:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:34:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:34:40.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:34:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:34:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:34:40.830 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:34:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:34:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:34:40.831 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:34:40.831 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:34:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 msgr2=0x7f3f040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 0x7f3f040672e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f3f1c0f67e0 tx=0x7f3f1000b040).stop 2022-02-02T14:34:40.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 msgr2=0x7f3f1c109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f3f0c013a70 tx=0x7f3f0c009b30).stop 2022-02-02T14:34:40.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 shutdown_connections 2022-02-02T14:34:40.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3f04064e20 0x7f3f040672e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f1c0f5710 0x7f3f1c109aa0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 --2- 172.21.15.33:0/1338213916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f1c0f6a10 0x7f3f1c10bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.829+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 >> 172.21.15.33:0/1338213916 conn(0x7f3f1c0f0320 msgr2=0x7f3f1c0fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.830+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 shutdown_connections 2022-02-02T14:34:40.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.830+0000 7f3f20b96700 1 -- 172.21.15.33:0/1338213916 wait complete. 2022-02-02T14:34:40.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 -- 172.21.15.33:0/2022362948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f55c0 msgr2=0x7f3bf80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 --2- 172.21.15.33:0/2022362948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f55c0 0x7f3bf80f59e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f3be8004660 tx=0x7f3be8009b30).stop 2022-02-02T14:34:40.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 -- 172.21.15.33:0/2022362948 shutdown_connections 2022-02-02T14:34:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 --2- 172.21.15.33:0/2022362948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f6860 0x7f3bf80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 --2- 172.21.15.33:0/2022362948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f55c0 0x7f3bf80f59e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 -- 172.21.15.33:0/2022362948 >> 172.21.15.33:0/2022362948 conn(0x7f3bf80f0d40 msgr2=0x7f3bf80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:40.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 -- 172.21.15.33:0/2022362948 shutdown_connections 2022-02-02T14:34:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 -- 172.21.15.33:0/2022362948 wait complete. 2022-02-02T14:34:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.931+0000 7f3bfce65700 1 Processor -- start 2022-02-02T14:34:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bfce65700 1 -- start start 2022-02-02T14:34:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bfce65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 0x7f3bf8105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bfce65700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bfce65700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8106910 con 0x7f3bf80f6860 2022-02-02T14:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bfce65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf8106a50 con 0x7f3bf80f55c0 2022-02-02T14:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33548/0 (socket says 172.21.15.33:33548) 2022-02-02T14:34:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 -- 172.21.15.33:0/3403240603 learned_addr learned my addr 172.21.15.33:0/3403240603 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:34:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf659c700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 0x7f3bf8105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 -- 172.21.15.33:0/3403240603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 msgr2=0x7f3bf8105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 0x7f3bf8105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:40.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 -- 172.21.15.33:0/3403240603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8005040 con 0x7f3bf80f6860 2022-02-02T14:34:40.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf659c700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 0x7f3bf8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:34:40.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3bf5d9b700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f3bec0026d0 tx=0x7f3bec009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec009320 con 0x7f3bf80f6860 2022-02-02T14:34:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.932+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3bec00f040 con 0x7f3bf80f6860 2022-02-02T14:34:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.933+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf81073f0 con 0x7f3bf80f6860 2022-02-02T14:34:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.933+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3bec0147e0 con 0x7f3bf80f6860 2022-02-02T14:34:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.933+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf81079b0 con 0x7f3bf80f6860 2022-02-02T14:34:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.934+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf8045ad0 con 0x7f3bf80f6860 2022-02-02T14:34:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.934+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3bec009480 con 0x7f3bf80f6860 2022-02-02T14:34:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.934+0000 7f3be6ffd700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 0x7f3be0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:34:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.935+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3bec0820e0 con 0x7f3bf80f6860 2022-02-02T14:34:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.935+0000 7f3bf659c700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 0x7f3be0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:34:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.935+0000 7f3bf659c700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 0x7f3be0067290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f3be8009da0 tx=0x7f3be8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:34:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:40.939+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3bec053bc0 con 0x7f3bf80f6860 2022-02-02T14:34:41.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.154+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bf8107c80 con 0x7f3bf80f6860 2022-02-02T14:34:41.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.154+0000 7f3be6ffd700 1 -- 172.21.15.33:0/3403240603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f3bec0537b0 con 0x7f3bf80f6860 2022-02-02T14:34:41.154 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:34:41.154 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:34:41.155 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:34:41.155 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:34:41.155 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:41.155 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:34:41.156 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:34:41.156 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:34:41.156 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:34:41.156 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:34:41.157 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:34:41.157 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:34:41.157 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:34:41.157 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:34:41.157 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:34:41.158 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:34:41.158 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:34:41.158 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:34:41.158 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:34:41.159 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:34:41.159 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:34:41.159 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:34:41.159 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:34:41.160 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:34:41.160 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:34:41.160 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:34:41.160 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:34:41.160 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:34:41.161 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:34:41.161 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:34:41.161 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:34:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:41.161 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:41.162 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:34:41.162 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:34:41.162 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:41.162 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:41.163 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:41.163 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:34:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 msgr2=0x7f3be0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:41.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 0x7f3be0067290 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f3be8009da0 tx=0x7f3be8009b30).stop 2022-02-02T14:34:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 msgr2=0x7f3bf8106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:34:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f3bec0026d0 tx=0x7f3bec009de0).stop 2022-02-02T14:34:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 shutdown_connections 2022-02-02T14:34:41.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3be0064dd0 0x7f3be0067290 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf80f55c0 0x7f3bf8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 --2- 172.21.15.33:0/3403240603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bf80f6860 0x7f3bf8106360 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:34:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 >> 172.21.15.33:0/3403240603 conn(0x7f3bf80f0d40 msgr2=0x7f3bf80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:34:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 shutdown_connections 2022-02-02T14:34:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:34:41.156+0000 7f3bfce65700 1 -- 172.21.15.33:0/3403240603 wait complete. 2022-02-02T14:34:41.167 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:34:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:41 smithi033 ceph-mon[101165]: from='client.35798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1338213916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:34:41.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3403240603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:34:41.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:41 smithi037 ceph-mon[69017]: from='client.35798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:41.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1338213916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:34:41.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3403240603' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:34:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:42 smithi033 ceph-mon[101165]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:42 smithi033 ceph-mon[101165]: pgmap v1679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:42 smithi037 ceph-mon[69017]: from='client.35802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:34:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:42 smithi037 ceph-mon[69017]: pgmap v1679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:44 smithi033 ceph-mon[101165]: pgmap v1680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:44 smithi037 ceph-mon[69017]: pgmap v1680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:46 smithi033 ceph-mon[101165]: pgmap v1681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:46 smithi037 ceph-mon[69017]: pgmap v1681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:48 smithi033 ceph-mon[101165]: pgmap v1682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:48 smithi037 ceph-mon[69017]: pgmap v1682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:50 smithi033 ceph-mon[101165]: pgmap v1683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:50 smithi037 ceph-mon[69017]: pgmap v1683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:52.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:52 smithi033 ceph-mon[101165]: pgmap v1684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:52 smithi037 ceph-mon[69017]: pgmap v1684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:54 smithi033 ceph-mon[101165]: pgmap v1685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:54 smithi037 ceph-mon[69017]: pgmap v1685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:34:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:34:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:34:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:34:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:56 smithi033 ceph-mon[101165]: pgmap v1686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:56 smithi037 ceph-mon[69017]: pgmap v1686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:58.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:34:58 smithi033 ceph-mon[101165]: pgmap v1687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:34:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:34:58 smithi037 ceph-mon[69017]: pgmap v1687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:00 smithi033 ceph-mon[101165]: pgmap v1688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:00 smithi037 ceph-mon[69017]: pgmap v1688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:02 smithi033 ceph-mon[101165]: pgmap v1689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:02 smithi037 ceph-mon[69017]: pgmap v1689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:04 smithi033 ceph-mon[101165]: pgmap v1690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:04 smithi037 ceph-mon[69017]: pgmap v1690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:06 smithi033 ceph-mon[101165]: pgmap v1691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:06 smithi037 ceph-mon[69017]: pgmap v1691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:08 smithi033 ceph-mon[101165]: pgmap v1692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:08 smithi037 ceph-mon[69017]: pgmap v1692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:10 smithi033 ceph-mon[101165]: pgmap v1693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:10.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:10 smithi037 ceph-mon[69017]: pgmap v1693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:11.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 -- 172.21.15.33:0/2753600368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 msgr2=0x7fa72c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 --2- 172.21.15.33:0/2753600368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c0f59e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fa728004660 tx=0x7fa728009b30).stop 2022-02-02T14:35:11.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 -- 172.21.15.33:0/2753600368 shutdown_connections 2022-02-02T14:35:11.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 --2- 172.21.15.33:0/2753600368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 0x7fa72c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 --2- 172.21.15.33:0/2753600368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c0f59e0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 -- 172.21.15.33:0/2753600368 >> 172.21.15.33:0/2753600368 conn(0x7fa72c0f0d40 msgr2=0x7fa72c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:11.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.271+0000 7fa733a4d700 1 -- 172.21.15.33:0/2753600368 shutdown_connections 2022-02-02T14:35:11.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 -- 172.21.15.33:0/2753600368 wait complete. 2022-02-02T14:35:11.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 Processor -- start 2022-02-02T14:35:11.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 -- start start 2022-02-02T14:35:11.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 0x7fa72c1052f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c1058f0 con 0x7fa72c0f55c0 2022-02-02T14:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.272+0000 7fa733a4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72c106100 con 0x7fa72c0f6860 2022-02-02T14:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33560/0 (socket says 172.21.15.33:33560) 2022-02-02T14:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 -- 172.21.15.33:0/1557720491 learned_addr learned my addr 172.21.15.33:0/1557720491 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa730fe8700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 0x7fa72c1052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 -- 172.21.15.33:0/1557720491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 msgr2=0x7fa72c1052f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 0x7fa72c1052f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 -- 172.21.15.33:0/1557720491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728005040 con 0x7fa72c0f55c0 2022-02-02T14:35:11.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa7317e9700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fa7280097a0 tx=0x7fa72800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa728010da0 con 0x7fa72c0f55c0 2022-02-02T14:35:11.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa7280125c0 con 0x7fa72c0f55c0 2022-02-02T14:35:11.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72801b760 con 0x7fa72c0f55c0 2022-02-02T14:35:11.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.273+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa72c106320 con 0x7fa72c0f55c0 2022-02-02T14:35:11.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.274+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72c106880 con 0x7fa72c0f55c0 2022-02-02T14:35:11.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.275+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72c0f49b0 con 0x7fa72c0f55c0 2022-02-02T14:35:11.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.275+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa72802b070 con 0x7fa72c0f55c0 2022-02-02T14:35:11.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.275+0000 7fa71dffb700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 0x7fa718067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.275+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa728087610 con 0x7fa72c0f55c0 2022-02-02T14:35:11.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.276+0000 7fa730fe8700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 0x7fa718067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.276+0000 7fa730fe8700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 0x7fa718067290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fa720007f80 tx=0x7fa72000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.280+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa728055660 con 0x7fa72c0f55c0 2022-02-02T14:35:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.469+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa72c0008d0 con 0x7fa718064dd0 2022-02-02T14:35:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.470+0000 7fa71dffb700 1 -- 172.21.15.33:0/1557720491 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa72c0008d0 con 0x7fa718064dd0 2022-02-02T14:35:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 msgr2=0x7fa718067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 0x7fa718067290 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fa720007f80 tx=0x7fa72000b040).stop 2022-02-02T14:35:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 msgr2=0x7fa72c104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fa7280097a0 tx=0x7fa72800b040).stop 2022-02-02T14:35:11.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 shutdown_connections 2022-02-02T14:35:11.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa718064dd0 0x7fa718067290 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa72c0f55c0 0x7fa72c104e00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 --2- 172.21.15.33:0/1557720491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa72c0f6860 0x7fa72c1052f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 >> 172.21.15.33:0/1557720491 conn(0x7fa72c0f0d40 msgr2=0x7fa72c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:11.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 shutdown_connections 2022-02-02T14:35:11.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.472+0000 7fa733a4d700 1 -- 172.21.15.33:0/1557720491 wait complete. 2022-02-02T14:35:11.481 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:35:11.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 -- 172.21.15.33:0/3310942886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 msgr2=0x7f57440f5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 --2- 172.21.15.33:0/3310942886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57440f5c50 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7f572c004660 tx=0x7f572c009b30).stop 2022-02-02T14:35:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 -- 172.21.15.33:0/3310942886 shutdown_connections 2022-02-02T14:35:11.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 --2- 172.21.15.33:0/3310942886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57440f5c50 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 --2- 172.21.15.33:0/3310942886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f57440f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.572+0000 7f574359e700 1 -- 172.21.15.33:0/3310942886 >> 172.21.15.33:0/3310942886 conn(0x7f57440f0320 msgr2=0x7f57440f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 -- 172.21.15.33:0/3310942886 shutdown_connections 2022-02-02T14:35:11.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 -- 172.21.15.33:0/3310942886 wait complete. 2022-02-02T14:35:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 Processor -- start 2022-02-02T14:35:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 -- start start 2022-02-02T14:35:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f574410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440f5480 con 0x7f57440f57d0 2022-02-02T14:35:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440f55c0 con 0x7f57440f6ac0 2022-02-02T14:35:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.573+0000 7f574259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33570/0 (socket says 172.21.15.33:33570) 2022-02-02T14:35:11.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 -- 172.21.15.33:0/3986043009 learned_addr learned my addr 172.21.15.33:0/3986043009 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f5741d9b700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f574410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 -- 172.21.15.33:0/3986043009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 msgr2=0x7f574410beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f574410beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 -- 172.21.15.33:0/3986043009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c005040 con 0x7f57440f57d0 2022-02-02T14:35:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f5741d9b700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f574410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:35:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574259c700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5734002700 tx=0x7f5734009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5734009320 con 0x7f57440f57d0 2022-02-02T14:35:11.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f573400f040 con 0x7f57440f57d0 2022-02-02T14:35:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574410c460 con 0x7f57440f57d0 2022-02-02T14:35:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5734014820 con 0x7f57440f57d0 2022-02-02T14:35:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.574+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574410ca20 con 0x7f57440f57d0 2022-02-02T14:35:11.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.575+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744045ad0 con 0x7f57440f57d0 2022-02-02T14:35:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.576+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5734009480 con 0x7f57440f57d0 2022-02-02T14:35:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.576+0000 7f573affd700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 0x7f57300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.577+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5734081d60 con 0x7f57440f57d0 2022-02-02T14:35:11.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.577+0000 7f5741d9b700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 0x7f57300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.577+0000 7f5741d9b700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 0x7f57300672e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f572c004630 tx=0x7f572c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.581+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f573404fe10 con 0x7f57440f57d0 2022-02-02T14:35:11.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.762+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57440fde50 con 0x7f5730064e20 2022-02-02T14:35:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.777+0000 7f573affd700 1 -- 172.21.15.33:0/3986043009 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f572c019040 con 0x7f5730064e20 2022-02-02T14:35:11.776 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:35:11.777 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (60m) 22m ago 61m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:35:11.777 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (53m) 22m ago 61m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:35:11.777 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (53m) 22m ago 60m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:35:11.777 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (60m) 22m ago 61m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:35:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (53m) 22m ago 57m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:35:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (54m) 22m ago 57m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:35:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (55m) 22m ago 57m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:35:11.778 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (57m) 22m ago 57m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:35:11.779 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (55m) 22m ago 62m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:35:11.779 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (54m) 22m ago 60m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:35:11.779 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (54m) 22m ago 62m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:35:11.779 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (54m) 22m ago 60m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:35:11.779 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (61m) 22m ago 61m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:35:11.780 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (60m) 22m ago 60m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:35:11.780 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 22m ago 60m - 4096M 2022-02-02T14:35:11.780 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (59m) 22m ago 59m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:35:11.780 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (59m) 22m ago 59m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:35:11.781 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (59m) 22m ago 59m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:35:11.781 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (59m) 22m ago 59m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:35:11.781 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (58m) 22m ago 58m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:35:11.781 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (60m) 22m ago 61m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:35:11.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 msgr2=0x7f57300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 0x7f57300672e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f572c004630 tx=0x7f572c009b30).stop 2022-02-02T14:35:11.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 msgr2=0x7f57441099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f5734002700 tx=0x7f5734009e00).stop 2022-02-02T14:35:11.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 shutdown_connections 2022-02-02T14:35:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5730064e20 0x7f57300672e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57440f57d0 0x7f57441099b0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 --2- 172.21.15.33:0/3986043009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57440f6ac0 0x7f574410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 >> 172.21.15.33:0/3986043009 conn(0x7f57440f0320 msgr2=0x7f57440fa230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 shutdown_connections 2022-02-02T14:35:11.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.779+0000 7f574359e700 1 -- 172.21.15.33:0/3986043009 wait complete. 2022-02-02T14:35:11.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 -- 172.21.15.33:0/1380989817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 msgr2=0x7fb5dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1380989817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc0f59e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7fb5cc004660 tx=0x7fb5cc009b30).stop 2022-02-02T14:35:11.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 -- 172.21.15.33:0/1380989817 shutdown_connections 2022-02-02T14:35:11.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1380989817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 0x7fb5dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1380989817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc0f59e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 -- 172.21.15.33:0/1380989817 >> 172.21.15.33:0/1380989817 conn(0x7fb5dc0f0d40 msgr2=0x7fb5dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:11.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 -- 172.21.15.33:0/1380989817 shutdown_connections 2022-02-02T14:35:11.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.879+0000 7fb5e2666700 1 -- 172.21.15.33:0/1380989817 wait complete. 2022-02-02T14:35:11.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 Processor -- start 2022-02-02T14:35:11.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 -- start start 2022-02-02T14:35:11.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 0x7fb5dc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0603c0 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5e2666700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc060500 con 0x7fb5dc0f6860 2022-02-02T14:35:11.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.880+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33580/0 (socket says 172.21.15.33:33580) 2022-02-02T14:35:11.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 -- 172.21.15.33:0/1765010539 learned_addr learned my addr 172.21.15.33:0/1765010539 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:11.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5db7fe700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 0x7fb5dc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 -- 172.21.15.33:0/1765010539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 msgr2=0x7fb5dc10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 0x7fb5dc10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 -- 172.21.15.33:0/1765010539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc005040 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5dbfff700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fb5cc004f60 tx=0x7fb5cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc018070 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb5cc007ba0 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc10c6e0 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5cc01c620 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.893 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.881+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc10cc10 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.882+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc0f49b0 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.883+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb5cc01d420 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.883+0000 7fb5d8ff9700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 0x7fb5c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:11.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.883+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb5cc0838f0 con 0x7fb5dc0f55c0 2022-02-02T14:35:11.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.884+0000 7fb5db7fe700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 0x7fb5c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:11.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.884+0000 7fb5db7fe700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 0x7fb5c4067290 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fb5d00041d0 tx=0x7fb5d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:11.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:11.888+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb5cc0519a0 con 0x7fb5dc0f55c0 2022-02-02T14:35:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.130+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5dc0fdec0 con 0x7fb5dc0f55c0 2022-02-02T14:35:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.131+0000 7fb5d8ff9700 1 -- 172.21.15.33:0/1765010539 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb5cc054fc0 con 0x7fb5dc0f55c0 2022-02-02T14:35:12.131 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:35:12.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:35:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:35:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:35:12.132 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:35:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:35:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:35:12.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:35:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:35:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:35:12.134 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:35:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:35:12.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:35:12.135 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:35:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 msgr2=0x7fb5c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 0x7fb5c4067290 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7fb5d00041d0 tx=0x7fb5d0009040).stop 2022-02-02T14:35:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 msgr2=0x7fb5dc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fb5cc004f60 tx=0x7fb5cc009b30).stop 2022-02-02T14:35:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 shutdown_connections 2022-02-02T14:35:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5c4064dd0 0x7fb5c4067290 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5dc0f55c0 0x7fb5dc109c90 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 --2- 172.21.15.33:0/1765010539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5dc0f6860 0x7fb5dc10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 >> 172.21.15.33:0/1765010539 conn(0x7fb5dc0f0d40 msgr2=0x7fb5dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 shutdown_connections 2022-02-02T14:35:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.133+0000 7fb5e2666700 1 -- 172.21.15.33:0/1765010539 wait complete. 2022-02-02T14:35:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3983825418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 msgr2=0x7fb2b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3983825418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b40f59e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fb2b0004660 tx=0x7fb2b0009b30).stop 2022-02-02T14:35:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3983825418 shutdown_connections 2022-02-02T14:35:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3983825418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 0x7fb2b40f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:35:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3983825418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b40f59e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3983825418 >> 172.21.15.33:0/3983825418 conn(0x7fb2b40f0de0 msgr2=0x7fb2b40f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3983825418 shutdown_connections 2022-02-02T14:35:12.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.234+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3983825418 wait complete. 2022-02-02T14:35:12.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 Processor -- start 2022-02-02T14:35:12.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 -- start start 2022-02-02T14:35:12.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:12.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 0x7fb2b410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:12.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4060550 con 0x7fb2b40f55c0 2022-02-02T14:35:12.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2bb4a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4060690 con 0x7fb2b40f5ed0 2022-02-02T14:35:12.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:12.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33590/0 (socket says 172.21.15.33:33590) 2022-02-02T14:35:12.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 -- 172.21.15.33:0/3251787690 learned_addr learned my addr 172.21.15.33:0/3251787690 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:12.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b8a3d700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 0x7fb2b410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:12.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 -- 172.21.15.33:0/3251787690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 msgr2=0x7fb2b410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 0x7fb2b410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.235+0000 7fb2b923e700 1 -- 172.21.15.33:0/3251787690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0005040 con 0x7fb2b40f55c0 2022-02-02T14:35:12.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2b923e700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fb2b0009990 tx=0x7fb2b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b0018070 con 0x7fb2b40f55c0 2022-02-02T14:35:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2b0007ca0 con 0x7fb2b40f55c0 2022-02-02T14:35:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b410c750 con 0x7fb2b40f55c0 2022-02-02T14:35:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2b001c620 con 0x7fb2b40f55c0 2022-02-02T14:35:12.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.236+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b410cc80 con 0x7fb2b40f55c0 2022-02-02T14:35:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.237+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b4045ad0 con 0x7fb2b40f55c0 2022-02-02T14:35:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.237+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2b001d960 con 0x7fb2b40f55c0 2022-02-02T14:35:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.238+0000 7fb2a5ffb700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 0x7fb2a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:12.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.238+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2b0083820 con 0x7fb2b40f55c0 2022-02-02T14:35:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.238+0000 7fb2b8a3d700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 0x7fb2a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.239+0000 7fb2b8a3d700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 0x7fb2a0067290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb2a800a6f0 tx=0x7fb2a8008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:12.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.242+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2b0051a40 con 0x7fb2b40f55c0 2022-02-02T14:35:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.458+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb2b40fde30 con 0x7fb2b40f55c0 2022-02-02T14:35:12.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.459+0000 7fb2a5ffb700 1 -- 172.21.15.33:0/3251787690 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb2b0055060 con 0x7fb2b40f55c0 2022-02-02T14:35:12.459 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:35:12.459 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:35:12.459 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:35:12.459 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:35:12.460 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:12.460 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:35:12.460 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:35:12.460 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:35:12.461 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:35:12.461 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:35:12.461 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:35:12.461 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:35:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:35:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:35:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:35:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:35:12.462 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:35:12.463 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:35:12.463 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:35:12.463 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:35:12.463 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:35:12.464 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:35:12.464 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:35:12.464 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:35:12.464 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:35:12.464 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:35:12.465 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:35:12.465 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:35:12.465 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:35:12.465 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:35:12.466 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:35:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:12.466 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:12.466 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:35:12.467 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:12.467 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:12.467 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:12.467 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:12.467 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:12.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 msgr2=0x7fb2a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 0x7fb2a0067290 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7fb2a800a6f0 tx=0x7fb2a8008040).stop 2022-02-02T14:35:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 msgr2=0x7fb2b4109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7fb2b0009990 tx=0x7fb2b0009b30).stop 2022-02-02T14:35:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 shutdown_connections 2022-02-02T14:35:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a0064dd0 0x7fb2a0067290 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 --2- 172.21.15.33:0/3251787690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f5ed0 0x7fb2b410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 >> 172.21.15.33:0/3251787690 conn(0x7fb2b40f0de0 msgr2=0x7fb2b40fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 shutdown_connections 2022-02-02T14:35:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:12.462+0000 7fb2bb4a2700 1 -- 172.21.15.33:0/3251787690 wait complete. 2022-02-02T14:35:12.471 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:35:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:12 smithi033 ceph-mon[101165]: pgmap v1694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:12.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1765010539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:35:12.992 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:12 smithi037 ceph-mon[69017]: pgmap v1694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:12.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1765010539' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:35:13.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:13 smithi033 ceph-mon[101165]: from='client.35814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:13 smithi033 ceph-mon[101165]: from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:13.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3251787690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:35:13.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:13 smithi037 ceph-mon[69017]: from='client.35814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:13.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:13 smithi037 ceph-mon[69017]: from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:13.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3251787690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:35:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:14 smithi033 ceph-mon[101165]: pgmap v1695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:14 smithi037 ceph-mon[69017]: pgmap v1695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:15.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:15 smithi033 ceph-mon[101165]: pgmap v1696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:15.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:15 smithi037 ceph-mon[69017]: pgmap v1696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:18 smithi033 ceph-mon[101165]: pgmap v1697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:18 smithi037 ceph-mon[69017]: pgmap v1697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:20 smithi033 ceph-mon[101165]: pgmap v1698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:20 smithi037 ceph-mon[69017]: pgmap v1698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:22.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:22 smithi033 ceph-mon[101165]: pgmap v1699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:22 smithi037 ceph-mon[69017]: pgmap v1699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:24 smithi033 ceph-mon[101165]: pgmap v1700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:24 smithi037 ceph-mon[69017]: pgmap v1700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:26 smithi033 ceph-mon[101165]: pgmap v1701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:26 smithi037 ceph-mon[69017]: pgmap v1701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:28 smithi033 ceph-mon[101165]: pgmap v1702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:28 smithi037 ceph-mon[69017]: pgmap v1702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:30 smithi033 ceph-mon[101165]: pgmap v1703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:30 smithi037 ceph-mon[69017]: pgmap v1703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:32 smithi033 ceph-mon[101165]: pgmap v1704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:32 smithi037 ceph-mon[69017]: pgmap v1704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:34 smithi033 ceph-mon[101165]: pgmap v1705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:34 smithi037 ceph-mon[69017]: pgmap v1705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:36 smithi033 ceph-mon[101165]: pgmap v1706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:36 smithi037 ceph-mon[69017]: pgmap v1706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:38 smithi033 ceph-mon[101165]: pgmap v1707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:38 smithi037 ceph-mon[69017]: pgmap v1707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:40 smithi033 ceph-mon[101165]: pgmap v1708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:40 smithi037 ceph-mon[69017]: pgmap v1708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 -- 172.21.15.33:0/4045303517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f6860 msgr2=0x7feb480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 --2- 172.21.15.33:0/4045303517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f6860 0x7feb480f6cc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7feb30004660 tx=0x7feb30009b30).stop 2022-02-02T14:35:42.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 -- 172.21.15.33:0/4045303517 shutdown_connections 2022-02-02T14:35:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 --2- 172.21.15.33:0/4045303517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f6860 0x7feb480f6cc0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 --2- 172.21.15.33:0/4045303517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f55c0 0x7feb480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 -- 172.21.15.33:0/4045303517 >> 172.21.15.33:0/4045303517 conn(0x7feb480f0d40 msgr2=0x7feb480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 -- 172.21.15.33:0/4045303517 shutdown_connections 2022-02-02T14:35:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.578+0000 7feb4e133700 1 -- 172.21.15.33:0/4045303517 wait complete. 2022-02-02T14:35:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 Processor -- start 2022-02-02T14:35:42.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 -- start start 2022-02-02T14:35:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f6860 0x7feb481073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb48107970 con 0x7feb480f55c0 2022-02-02T14:35:42.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb4e133700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb48107ab0 con 0x7feb480f6860 2022-02-02T14:35:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33600/0 (socket says 172.21.15.33:33600) 2022-02-02T14:35:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb477fe700 1 -- 172.21.15.33:0/584592741 learned_addr learned my addr 172.21.15.33:0/584592741 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:42.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb3ffff700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f6860 0x7feb481073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb477fe700 1 -- 172.21.15.33:0/584592741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f6860 msgr2=0x7feb481073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.579+0000 7feb477fe700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f6860 0x7feb481073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb477fe700 1 -- 172.21.15.33:0/584592741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30005040 con 0x7feb480f55c0 2022-02-02T14:35:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb477fe700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7feb3800e7c0 tx=0x7feb3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb380092e0 con 0x7feb480f55c0 2022-02-02T14:35:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb3800f040 con 0x7feb480f55c0 2022-02-02T14:35:42.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb48108450 con 0x7feb480f55c0 2022-02-02T14:35:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.580+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb48108a10 con 0x7feb480f55c0 2022-02-02T14:35:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.581+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb38007990 con 0x7feb480f55c0 2022-02-02T14:35:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.581+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb48045ad0 con 0x7feb480f55c0 2022-02-02T14:35:42.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.582+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb3801b030 con 0x7feb480f55c0 2022-02-02T14:35:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.582+0000 7feb44ff9700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 0x7feb34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.583+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feb38082070 con 0x7feb480f55c0 2022-02-02T14:35:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.583+0000 7feb3ffff700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 0x7feb34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.583+0000 7feb3ffff700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 0x7feb34067290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7feb30005010 tx=0x7feb30016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:42.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.586+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb38053a90 con 0x7feb480f55c0 2022-02-02T14:35:42.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:42 smithi033 ceph-mon[101165]: pgmap v1709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.776+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb4805fd30 con 0x7feb34064dd0 2022-02-02T14:35:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.777+0000 7feb44ff9700 1 -- 172.21.15.33:0/584592741 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7feb4805fd30 con 0x7feb34064dd0 2022-02-02T14:35:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 msgr2=0x7feb34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 0x7feb34067290 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7feb30005010 tx=0x7feb30016040).stop 2022-02-02T14:35:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 msgr2=0x7feb48106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7feb3800e7c0 tx=0x7feb3800b040).stop 2022-02-02T14:35:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 shutdown_connections 2022-02-02T14:35:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb34064dd0 0x7feb34067290 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb480f55c0 0x7feb48106ed0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 --2- 172.21.15.33:0/584592741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb480f6860 0x7feb481073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 >> 172.21.15.33:0/584592741 conn(0x7feb480f0d40 msgr2=0x7feb4805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 shutdown_connections 2022-02-02T14:35:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.779+0000 7feb4e133700 1 -- 172.21.15.33:0/584592741 wait complete. 2022-02-02T14:35:42.788 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:35:42.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:42 smithi037 ceph-mon[69017]: pgmap v1709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:42.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 -- 172.21.15.33:0/4186489618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 msgr2=0x7feec00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 --2- 172.21.15.33:0/4186489618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec00f6b00 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7feeb0004660 tx=0x7feeb0009b30).stop 2022-02-02T14:35:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 -- 172.21.15.33:0/4186489618 shutdown_connections 2022-02-02T14:35:42.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 --2- 172.21.15.33:0/4186489618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 0x7feec00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 --2- 172.21.15.33:0/4186489618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec00f6b00 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 -- 172.21.15.33:0/4186489618 >> 172.21.15.33:0/4186489618 conn(0x7feec00f1e40 msgr2=0x7feec00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:42.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 -- 172.21.15.33:0/4186489618 shutdown_connections 2022-02-02T14:35:42.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 -- 172.21.15.33:0/4186489618 wait complete. 2022-02-02T14:35:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.881+0000 7feec5bc8700 1 Processor -- start 2022-02-02T14:35:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feec5bc8700 1 -- start start 2022-02-02T14:35:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feec5bc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feec5bc8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 0x7feec0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feec5bc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec010ac40 con 0x7feec00f66e0 2022-02-02T14:35:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feec5bc8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec010ad80 con 0x7feec00f7980 2022-02-02T14:35:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33610/0 (socket says 172.21.15.33:33610) 2022-02-02T14:35:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 -- 172.21.15.33:0/3024162954 learned_addr learned my addr 172.21.15.33:0/3024162954 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebeffd700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 0x7feec0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 -- 172.21.15.33:0/3024162954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 msgr2=0x7feec0069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:42.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 0x7feec0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 -- 172.21.15.33:0/3024162954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb0005040 con 0x7feec00f66e0 2022-02-02T14:35:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.882+0000 7feebf7fe700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7feeb0013a70 tx=0x7feeb0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.883+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb0018070 con 0x7feec00f66e0 2022-02-02T14:35:42.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.883+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feeb00097d0 con 0x7feec00f66e0 2022-02-02T14:35:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.883+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feeb001c3c0 con 0x7feec00f66e0 2022-02-02T14:35:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.883+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec006a370 con 0x7feec00f66e0 2022-02-02T14:35:42.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.883+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec006a8d0 con 0x7feec00f66e0 2022-02-02T14:35:42.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.884+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec0045ad0 con 0x7feec00f66e0 2022-02-02T14:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.884+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feeb0007ba0 con 0x7feec00f66e0 2022-02-02T14:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.885+0000 7feeb7fff700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 0x7feeac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.885+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feeb0083690 con 0x7feec00f66e0 2022-02-02T14:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.885+0000 7feebeffd700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 0x7feeac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.885+0000 7feebeffd700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 0x7feeac067290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7feea8004b00 tx=0x7feea800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:42.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:42.889+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feeb0051800 con 0x7feec00f66e0 2022-02-02T14:35:43.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.070+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feec00ff050 con 0x7feeac064dd0 2022-02-02T14:35:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.085+0000 7feeb7fff700 1 -- 172.21.15.33:0/3024162954 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7feea800f040 con 0x7feeac064dd0 2022-02-02T14:35:43.084 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:35:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (61m) 23m ago 62m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:35:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (54m) 23m ago 61m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:35:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (53m) 23m ago 61m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:35:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (60m) 23m ago 61m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:35:43.085 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (54m) 23m ago 58m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:35:43.086 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (55m) 23m ago 58m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:35:43.086 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (55m) 23m ago 58m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:35:43.086 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (58m) 23m ago 58m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:35:43.086 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (55m) 23m ago 63m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:35:43.087 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (55m) 23m ago 61m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:35:43.087 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (54m) 23m ago 63m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:35:43.087 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (54m) 23m ago 61m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:35:43.088 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (61m) 23m ago 61m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:35:43.088 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (61m) 23m ago 61m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:35:43.088 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 23m ago 60m - 4096M 2022-02-02T14:35:43.088 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (60m) 23m ago 60m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:35:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (60m) 23m ago 60m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:35:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (59m) 23m ago 59m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:35:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (59m) 23m ago 59m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:35:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (59m) 23m ago 59m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:35:43.089 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (60m) 23m ago 61m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:35:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 msgr2=0x7feeac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 0x7feeac067290 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7feea8004b00 tx=0x7feea800b040).stop 2022-02-02T14:35:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 msgr2=0x7feec006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7feeb0013a70 tx=0x7feeb0009b30).stop 2022-02-02T14:35:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 shutdown_connections 2022-02-02T14:35:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feeac064dd0 0x7feeac067290 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feec00f66e0 0x7feec006b9a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 --2- 172.21.15.33:0/3024162954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feec00f7980 0x7feec0069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 >> 172.21.15.33:0/3024162954 conn(0x7feec00f1e40 msgr2=0x7feec00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 shutdown_connections 2022-02-02T14:35:43.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.087+0000 7feec5bc8700 1 -- 172.21.15.33:0/3024162954 wait complete. 2022-02-02T14:35:43.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/2400117952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 msgr2=0x7fe0b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/2400117952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b00f59e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fe0a4004660 tx=0x7fe0a4009b30).stop 2022-02-02T14:35:43.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/2400117952 shutdown_connections 2022-02-02T14:35:43.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/2400117952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/2400117952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b00f59e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/2400117952 >> 172.21.15.33:0/2400117952 conn(0x7fe0b00f0d40 msgr2=0x7fe0b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:43.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/2400117952 shutdown_connections 2022-02-02T14:35:43.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/2400117952 wait complete. 2022-02-02T14:35:43.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 Processor -- start 2022-02-02T14:35:43.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.187+0000 7fe0b6f4e700 1 -- start start 2022-02-02T14:35:43.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b6f4e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b6f4e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b6f4e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0107a10 con 0x7fe0b00f55c0 2022-02-02T14:35:43.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b6f4e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b0107b50 con 0x7fe0b00f6860 2022-02-02T14:35:43.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33620/0 (socket says 172.21.15.33:33620) 2022-02-02T14:35:43.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 -- 172.21.15.33:0/199637525 learned_addr learned my addr 172.21.15.33:0/199637525 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:43.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0affff700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 -- 172.21.15.33:0/199637525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 msgr2=0x7fe0b0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 -- 172.21.15.33:0/199637525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4005040 con 0x7fe0b00f55c0 2022-02-02T14:35:43.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0affff700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:35:43.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b4cea700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fe0a4013a70 tx=0x7fe0a4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:43.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a4018070 con 0x7fe0b00f55c0 2022-02-02T14:35:43.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe0a40097d0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.188+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b0108490 con 0x7fe0b00f55c0 2022-02-02T14:35:43.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.189+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0a401c3c0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.189+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b01089f0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.190+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b0045ad0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.190+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe0a4007ba0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.190+0000 7fe0ad7fa700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 0x7fe0a0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.191+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe0a4083850 con 0x7fe0b00f55c0 2022-02-02T14:35:43.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.191+0000 7fe0affff700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 0x7fe0a0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.191+0000 7fe0affff700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 0x7fe0a0067290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe09c009740 tx=0x7fe09c009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:43.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.195+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe0a4055330 con 0x7fe0b00f55c0 2022-02-02T14:35:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.435+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe0b00fded0 con 0x7fe0b00f55c0 2022-02-02T14:35:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.436+0000 7fe0ad7fa700 1 -- 172.21.15.33:0/199637525 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe0a4054f20 con 0x7fe0b00f55c0 2022-02-02T14:35:43.436 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:35:43.436 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:35:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:35:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:35:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:35:43.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:35:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:35:43.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:35:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:35:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:35:43.439 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:35:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:35:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:35:43.440 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:35:43.440 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:35:43.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 msgr2=0x7fe0a0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 0x7fe0a0067290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7fe09c009740 tx=0x7fe09c009be0).stop 2022-02-02T14:35:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 msgr2=0x7fe0b0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7fe0a4013a70 tx=0x7fe0a4009b30).stop 2022-02-02T14:35:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 shutdown_connections 2022-02-02T14:35:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe0a0064dd0 0x7fe0a0067290 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0b00f55c0 0x7fe0b0106f70 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 --2- 172.21.15.33:0/199637525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0b00f6860 0x7fe0b0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 >> 172.21.15.33:0/199637525 conn(0x7fe0b00f0d40 msgr2=0x7fe0b005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 shutdown_connections 2022-02-02T14:35:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.438+0000 7fe0b6f4e700 1 -- 172.21.15.33:0/199637525 wait complete. 2022-02-02T14:35:43.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 -- 172.21.15.33:0/775938159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 msgr2=0x7f4ccc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 --2- 172.21.15.33:0/775938159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc0f59e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f4cbc004660 tx=0x7f4cbc009b30).stop 2022-02-02T14:35:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 -- 172.21.15.33:0/775938159 shutdown_connections 2022-02-02T14:35:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 --2- 172.21.15.33:0/775938159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 --2- 172.21.15.33:0/775938159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc0f59e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 -- 172.21.15.33:0/775938159 >> 172.21.15.33:0/775938159 conn(0x7f4ccc0f0d40 msgr2=0x7f4ccc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 -- 172.21.15.33:0/775938159 shutdown_connections 2022-02-02T14:35:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.539+0000 7f4cd082a700 1 -- 172.21.15.33:0/775938159 wait complete. 2022-02-02T14:35:43.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 Processor -- start 2022-02-02T14:35:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 -- start start 2022-02-02T14:35:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0602b0 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cd082a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ccc0603f0 con 0x7f4ccc0f6860 2022-02-02T14:35:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33630/0 (socket says 172.21.15.33:33630) 2022-02-02T14:35:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cca59c700 1 -- 172.21.15.33:0/1743212840 learned_addr learned my addr 172.21.15.33:0/1743212840 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:35:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.540+0000 7f4cc9d9b700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cca59c700 1 -- 172.21.15.33:0/1743212840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 msgr2=0x7f4ccc10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cca59c700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc10e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cca59c700 1 -- 172.21.15.33:0/1743212840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cbc005040 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cc9d9b700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:35:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cca59c700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f4cbc014040 tx=0x7f4cbc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cbc019070 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4cbc007e70 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cbc014d50 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ccc10ea00 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.541+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ccc10edd0 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.542+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ccc045ad0 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.543+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4cbc025070 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.543+0000 7f4cc2ffd700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 0x7f4cb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:35:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.543+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4cbc082d70 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.544+0000 7f4cc9d9b700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 0x7f4cb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:35:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.544+0000 7f4cc9d9b700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 0x7f4cb8067290 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f4cb4009da0 tx=0x7f4cb400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:35:43.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.547+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4cbc050ea0 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.756+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ccc027a00 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.757+0000 7f4cc2ffd700 1 -- 172.21.15.33:0/1743212840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4cbc023020 con 0x7f4ccc0f55c0 2022-02-02T14:35:43.757 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:35:43.757 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:35:43.757 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:35:43.757 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:35:43.757 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:43.758 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:35:43.758 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:35:43.758 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:35:43.758 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:35:43.759 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:35:43.759 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:35:43.759 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:35:43.759 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:35:43.760 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:35:43.760 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:35:43.760 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:35:43.760 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:35:43.760 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:35:43.761 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:35:43.761 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:35:43.761 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:35:43.761 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:35:43.762 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:35:43.762 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:35:43.762 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:35:43.762 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:35:43.762 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:35:43.763 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:35:43.763 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:35:43.763 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:35:43.763 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:35:43.764 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:43.764 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:43.764 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:35:43.764 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:35:43.764 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:43.765 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:43.765 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:43.765 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:35:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 msgr2=0x7f4cb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 0x7f4cb8067290 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f4cb4009da0 tx=0x7f4cb400b040).stop 2022-02-02T14:35:43.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 msgr2=0x7f4ccc10c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:35:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7f4cbc014040 tx=0x7f4cbc00b040).stop 2022-02-02T14:35:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 shutdown_connections 2022-02-02T14:35:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4cb8064dd0 0x7f4cb8067290 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ccc0f55c0 0x7f4ccc10c010 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 --2- 172.21.15.33:0/1743212840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ccc0f6860 0x7f4ccc10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:35:43.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 >> 172.21.15.33:0/1743212840 conn(0x7f4ccc0f0d40 msgr2=0x7f4ccc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:35:43.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 shutdown_connections 2022-02-02T14:35:43.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:35:43.760+0000 7f4cd082a700 1 -- 172.21.15.33:0/1743212840 wait complete. 2022-02-02T14:35:43.769 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:35:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:44 smithi033 ceph-mon[101165]: from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:44 smithi033 ceph-mon[101165]: pgmap v1710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:44 smithi033 ceph-mon[101165]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/199637525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:35:44.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1743212840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:35:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:44 smithi037 ceph-mon[69017]: from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:44 smithi037 ceph-mon[69017]: pgmap v1710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:44 smithi037 ceph-mon[69017]: from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:35:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/199637525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:35:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1743212840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:35:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:46 smithi033 ceph-mon[101165]: pgmap v1711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:46 smithi037 ceph-mon[69017]: pgmap v1711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:48.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:48 smithi033 ceph-mon[101165]: pgmap v1712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:48 smithi037 ceph-mon[69017]: pgmap v1712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:50 smithi033 ceph-mon[101165]: pgmap v1713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:50 smithi037 ceph-mon[69017]: pgmap v1713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:52 smithi033 ceph-mon[101165]: pgmap v1714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:52 smithi037 ceph-mon[69017]: pgmap v1714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:54 smithi033 ceph-mon[101165]: pgmap v1715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:54 smithi037 ceph-mon[69017]: pgmap v1715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:35:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:35:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:35:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:35:56.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:56 smithi033 ceph-mon[101165]: pgmap v1716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:56 smithi037 ceph-mon[69017]: pgmap v1716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:58.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:35:58 smithi033 ceph-mon[101165]: pgmap v1717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:35:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:35:58 smithi037 ceph-mon[69017]: pgmap v1717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:00.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:00 smithi033 ceph-mon[101165]: pgmap v1718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:00 smithi037 ceph-mon[69017]: pgmap v1718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:02 smithi033 ceph-mon[101165]: pgmap v1719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:02 smithi037 ceph-mon[69017]: pgmap v1719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:04 smithi033 ceph-mon[101165]: pgmap v1720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:04 smithi037 ceph-mon[69017]: pgmap v1720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:06 smithi033 ceph-mon[101165]: pgmap v1721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:06.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:06 smithi037 ceph-mon[69017]: pgmap v1721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:08 smithi033 ceph-mon[101165]: pgmap v1722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:08 smithi037 ceph-mon[69017]: pgmap v1722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:10 smithi033 ceph-mon[101165]: pgmap v1723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:10 smithi037 ceph-mon[69017]: pgmap v1723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:12.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:12 smithi033 ceph-mon[101165]: pgmap v1724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:12 smithi037 ceph-mon[69017]: pgmap v1724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.875+0000 7fd7fd235700 1 -- 172.21.15.33:0/1217247837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 msgr2=0x7fd7f80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.875+0000 7fd7fd235700 1 --2- 172.21.15.33:0/1217247837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f80f6cc0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7fd7ec004660 tx=0x7fd7ec009b30).stop 2022-02-02T14:36:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.875+0000 7fd7fd235700 1 -- 172.21.15.33:0/1217247837 shutdown_connections 2022-02-02T14:36:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.875+0000 7fd7fd235700 1 --2- 172.21.15.33:0/1217247837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f80f6cc0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.875+0000 7fd7fd235700 1 --2- 172.21.15.33:0/1217247837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 0x7fd7f80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.876+0000 7fd7fd235700 1 -- 172.21.15.33:0/1217247837 >> 172.21.15.33:0/1217247837 conn(0x7fd7f80f0d40 msgr2=0x7fd7f80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.876+0000 7fd7fd235700 1 -- 172.21.15.33:0/1217247837 shutdown_connections 2022-02-02T14:36:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.876+0000 7fd7fd235700 1 -- 172.21.15.33:0/1217247837 wait complete. 2022-02-02T14:36:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.876+0000 7fd7fd235700 1 Processor -- start 2022-02-02T14:36:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.876+0000 7fd7fd235700 1 -- start start 2022-02-02T14:36:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7fd235700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 0x7fd7f8109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7fd235700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7fd235700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8109c20 con 0x7fd7f80f6860 2022-02-02T14:36:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7fd235700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f8109d60 con 0x7fd7f80f55c0 2022-02-02T14:36:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33642/0 (socket says 172.21.15.33:33642) 2022-02-02T14:36:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 -- 172.21.15.33:0/3197856078 learned_addr learned my addr 172.21.15.33:0/3197856078 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f6d9d700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 0x7fd7f8109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 -- 172.21.15.33:0/3197856078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 msgr2=0x7fd7f8109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 0x7fd7f8109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 -- 172.21.15.33:0/3197856078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec005040 con 0x7fd7f80f6860 2022-02-02T14:36:13.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7f659c700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fd7ec009990 tx=0x7fd7ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:13.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec018070 con 0x7fd7f80f6860 2022-02-02T14:36:13.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.877+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd7ec007ba0 con 0x7fd7f80f6860 2022-02-02T14:36:13.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.878+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f810a6a0 con 0x7fd7f80f6860 2022-02-02T14:36:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.878+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7ec01c620 con 0x7fd7f80f6860 2022-02-02T14:36:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.878+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f810ac00 con 0x7fd7f80f6860 2022-02-02T14:36:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.879+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f8045ad0 con 0x7fd7f80f6860 2022-02-02T14:36:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.879+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd7ec01c890 con 0x7fd7f80f6860 2022-02-02T14:36:13.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.879+0000 7fd7df7fe700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 0x7fd7e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.880+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd7ec083810 con 0x7fd7f80f6860 2022-02-02T14:36:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.880+0000 7fd7f6d9d700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 0x7fd7e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:13.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.880+0000 7fd7f6d9d700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 0x7fd7e0067290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd7f80f66c0 tx=0x7fd7e8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:13.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:13.884+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd7ec0552f0 con 0x7fd7f80f6860 2022-02-02T14:36:14.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.071+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f80faaa0 con 0x7fd7e0064dd0 2022-02-02T14:36:14.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.072+0000 7fd7df7fe700 1 -- 172.21.15.33:0/3197856078 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd7f80faaa0 con 0x7fd7e0064dd0 2022-02-02T14:36:14.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 msgr2=0x7fd7e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 0x7fd7e0067290 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fd7f80f66c0 tx=0x7fd7e8009040).stop 2022-02-02T14:36:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 msgr2=0x7fd7f8109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7fd7ec009990 tx=0x7fd7ec009b30).stop 2022-02-02T14:36:14.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 shutdown_connections 2022-02-02T14:36:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd7e0064dd0 0x7fd7e0067290 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f80f55c0 0x7fd7f8109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 --2- 172.21.15.33:0/3197856078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7f80f6860 0x7fd7f8109670 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 >> 172.21.15.33:0/3197856078 conn(0x7fd7f80f0d40 msgr2=0x7fd7f805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 shutdown_connections 2022-02-02T14:36:14.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.074+0000 7fd7fd235700 1 -- 172.21.15.33:0/3197856078 wait complete. 2022-02-02T14:36:14.083 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:36:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 -- 172.21.15.33:0/1989575424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 msgr2=0x7fa34c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 --2- 172.21.15.33:0/1989575424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c0f59e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fa33c004660 tx=0x7fa33c009b30).stop 2022-02-02T14:36:14.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 -- 172.21.15.33:0/1989575424 shutdown_connections 2022-02-02T14:36:14.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 --2- 172.21.15.33:0/1989575424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 0x7fa34c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 --2- 172.21.15.33:0/1989575424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c0f59e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 -- 172.21.15.33:0/1989575424 >> 172.21.15.33:0/1989575424 conn(0x7fa34c0f0d40 msgr2=0x7fa34c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 -- 172.21.15.33:0/1989575424 shutdown_connections 2022-02-02T14:36:14.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.175+0000 7fa352424700 1 -- 172.21.15.33:0/1989575424 wait complete. 2022-02-02T14:36:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 Processor -- start 2022-02-02T14:36:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 -- start start 2022-02-02T14:36:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 0x7fa34c1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c107990 con 0x7fa34c0f55c0 2022-02-02T14:36:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa352424700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34c107ad0 con 0x7fa34c0f6860 2022-02-02T14:36:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa34bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa34bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33650/0 (socket says 172.21.15.33:33650) 2022-02-02T14:36:14.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa34bfff700 1 -- 172.21.15.33:0/2133745321 learned_addr learned my addr 172.21.15.33:0/2133745321 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:14.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.176+0000 7fa34b7fe700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 0x7fa34c1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa34bfff700 1 -- 172.21.15.33:0/2133745321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 msgr2=0x7fa34c1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa34bfff700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 0x7fa34c1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa34bfff700 1 -- 172.21.15.33:0/2133745321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c005040 con 0x7fa34c0f55c0 2022-02-02T14:36:14.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa34bfff700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fa33c013a70 tx=0x7fa33c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33c018070 con 0x7fa34c0f55c0 2022-02-02T14:36:14.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa34c108410 con 0x7fa34c0f55c0 2022-02-02T14:36:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa33c0097d0 con 0x7fa34c0f55c0 2022-02-02T14:36:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa33c01de80 con 0x7fa34c0f55c0 2022-02-02T14:36:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.177+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa34c108970 con 0x7fa34c0f55c0 2022-02-02T14:36:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.178+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32c004fa0 con 0x7fa34c0f55c0 2022-02-02T14:36:14.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.179+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa33c01c4e0 con 0x7fa34c0f55c0 2022-02-02T14:36:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.179+0000 7fa348ff9700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 0x7fa334067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.179+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa33c083680 con 0x7fa34c0f55c0 2022-02-02T14:36:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.179+0000 7fa34b7fe700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 0x7fa334067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.180+0000 7fa34b7fe700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 0x7fa334067290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fa340004ce0 tx=0x7fa34000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.183+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa33c055160 con 0x7fa34c0f55c0 2022-02-02T14:36:14.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.368+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa32c000bc0 con 0x7fa334064dd0 2022-02-02T14:36:14.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.382+0000 7fa348ff9700 1 -- 172.21.15.33:0/2133745321 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa32c000bc0 con 0x7fa334064dd0 2022-02-02T14:36:14.382 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:36:14.382 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (61m) 23m ago 62m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:36:14.382 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (54m) 23m ago 62m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:36:14.382 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (54m) 23m ago 61m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:36:14.383 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (61m) 23m ago 62m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:36:14.383 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (55m) 23m ago 58m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:36:14.383 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (55m) 23m ago 58m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:36:14.383 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (56m) 23m ago 58m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:36:14.384 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (58m) 23m ago 58m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:36:14.384 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (56m) 23m ago 63m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:36:14.384 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (55m) 23m ago 61m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:36:14.384 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (55m) 23m ago 63m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:36:14.385 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (55m) 23m ago 61m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:36:14.385 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (62m) 23m ago 62m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:36:14.385 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (61m) 23m ago 61m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:36:14.385 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 23m ago 61m - 4096M 2022-02-02T14:36:14.385 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (60m) 23m ago 60m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:36:14.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (60m) 23m ago 60m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:36:14.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (60m) 23m ago 60m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:36:14.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (60m) 23m ago 60m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:36:14.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (59m) 23m ago 59m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:36:14.387 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (61m) 23m ago 62m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:36:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 msgr2=0x7fa334067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 0x7fa334067290 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fa340004ce0 tx=0x7fa34000b040).stop 2022-02-02T14:36:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 msgr2=0x7fa34c106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fa33c013a70 tx=0x7fa33c009b30).stop 2022-02-02T14:36:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 shutdown_connections 2022-02-02T14:36:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa334064dd0 0x7fa334067290 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa34c0f55c0 0x7fa34c106ef0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 --2- 172.21.15.33:0/2133745321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34c0f6860 0x7fa34c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 >> 172.21.15.33:0/2133745321 conn(0x7fa34c0f0d40 msgr2=0x7fa34c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 shutdown_connections 2022-02-02T14:36:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.384+0000 7fa352424700 1 -- 172.21.15.33:0/2133745321 wait complete. 2022-02-02T14:36:14.484 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:14 smithi033 ceph-mon[101165]: pgmap v1725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 -- 172.21.15.33:0/3809224646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f6860 msgr2=0x7f9fdc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/3809224646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc0f6cc0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f9fcc004660 tx=0x7f9fcc009b30).stop 2022-02-02T14:36:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 -- 172.21.15.33:0/3809224646 shutdown_connections 2022-02-02T14:36:14.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/3809224646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc0f6cc0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/3809224646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 -- 172.21.15.33:0/3809224646 >> 172.21.15.33:0/3809224646 conn(0x7f9fdc0f0d40 msgr2=0x7f9fdc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 -- 172.21.15.33:0/3809224646 shutdown_connections 2022-02-02T14:36:14.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.484+0000 7f9fe45ef700 1 -- 172.21.15.33:0/3809224646 wait complete. 2022-02-02T14:36:14.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 Processor -- start 2022-02-02T14:36:14.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 -- start start 2022-02-02T14:36:14.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc10c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc0603e0 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe45ef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc060520 con 0x7f9fdc0f6860 2022-02-02T14:36:14.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.485+0000 7f9fe238b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33660/0 (socket says 172.21.15.33:33660) 2022-02-02T14:36:14.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 -- 172.21.15.33:0/4003781900 learned_addr learned my addr 172.21.15.33:0/4003781900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe1b8a700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc10c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 -- 172.21.15.33:0/4003781900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f6860 msgr2=0x7f9fdc10c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc10c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 -- 172.21.15.33:0/4003781900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc005040 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe238b700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f9fd800c530 tx=0x7f9fd8007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd800f650 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc10c710 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9fd800fc60 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fd8012cb0 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.486+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc10ccd0 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.487+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc045ad0 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.488+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9fd8019030 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.488+0000 7f9fd2ffd700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 0x7f9fc8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.488+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9fd8081b50 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.489+0000 7f9fe1b8a700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 0x7f9fc8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.489+0000 7f9fe1b8a700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 0x7f9fc8067290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f9fcc004630 tx=0x7f9fcc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.492+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9fd804fc50 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.735+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9fdc0fdf00 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.735+0000 7f9fd2ffd700 1 -- 172.21.15.33:0/4003781900 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9fd80212d0 con 0x7f9fdc0f55c0 2022-02-02T14:36:14.735 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:36:14.736 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:36:14.736 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:36:14.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:14.736 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:36:14.737 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:36:14.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:14.737 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:36:14.737 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:36:14.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:14.738 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:36:14.738 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:36:14.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:14.739 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:36:14.739 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:36:14.739 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:36:14.739 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:36:14.740 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:36:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 msgr2=0x7f9fc8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 0x7f9fc8067290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f9fcc004630 tx=0x7f9fcc009b30).stop 2022-02-02T14:36:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 msgr2=0x7f9fdc109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f9fd800c530 tx=0x7f9fd8007e10).stop 2022-02-02T14:36:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 shutdown_connections 2022-02-02T14:36:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9fc8064dd0 0x7f9fc8067290 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9fdc0f55c0 0x7f9fdc109c60 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 --2- 172.21.15.33:0/4003781900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fdc0f6860 0x7f9fdc10c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.737+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 >> 172.21.15.33:0/4003781900 conn(0x7f9fdc0f0d40 msgr2=0x7f9fdc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.738+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 shutdown_connections 2022-02-02T14:36:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.738+0000 7f9fe45ef700 1 -- 172.21.15.33:0/4003781900 wait complete. 2022-02-02T14:36:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:14 smithi037 ceph-mon[69017]: pgmap v1725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:14.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 -- 172.21.15.33:0/3134940312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 msgr2=0x7fb6100f4cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 --2- 172.21.15.33:0/3134940312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f4cc0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fb60c004660 tx=0x7fb60c009b30).stop 2022-02-02T14:36:14.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 -- 172.21.15.33:0/3134940312 shutdown_connections 2022-02-02T14:36:14.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 --2- 172.21.15.33:0/3134940312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 0x7fb6100f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 --2- 172.21.15.33:0/3134940312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f4cc0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.838+0000 7fb616084700 1 -- 172.21.15.33:0/3134940312 >> 172.21.15.33:0/3134940312 conn(0x7fb6100f0320 msgr2=0x7fb6100f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 -- 172.21.15.33:0/3134940312 shutdown_connections 2022-02-02T14:36:14.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 -- 172.21.15.33:0/3134940312 wait complete. 2022-02-02T14:36:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 Processor -- start 2022-02-02T14:36:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 -- start start 2022-02-02T14:36:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 0x7fb6100f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100f5e70 con 0x7fb6100f48a0 2022-02-02T14:36:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb616084700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100f5fb0 con 0x7fb6100f5240 2022-02-02T14:36:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb615082700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb615082700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33670/0 (socket says 172.21.15.33:33670) 2022-02-02T14:36:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb615082700 1 -- 172.21.15.33:0/2671774653 learned_addr learned my addr 172.21.15.33:0/2671774653 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.839+0000 7fb614881700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 0x7fb6100f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb615082700 1 -- 172.21.15.33:0/2671774653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 msgr2=0x7fb6100f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:14.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb615082700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 0x7fb6100f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb615082700 1 -- 172.21.15.33:0/2671774653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c005040 con 0x7fb6100f48a0 2022-02-02T14:36:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb615082700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb60c009990 tx=0x7fb60c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60c018070 con 0x7fb6100f48a0 2022-02-02T14:36:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb60c007ba0 con 0x7fb6100f48a0 2022-02-02T14:36:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6100f6230 con 0x7fb6100f48a0 2022-02-02T14:36:14.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb60c01c3c0 con 0x7fb6100f48a0 2022-02-02T14:36:14.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.840+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100f6790 con 0x7fb6100f48a0 2022-02-02T14:36:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.842+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb610045ad0 con 0x7fb6100f48a0 2022-02-02T14:36:14.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.842+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb60c01d420 con 0x7fb6100f48a0 2022-02-02T14:36:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.842+0000 7fb605ffb700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 0x7fb5fc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.843+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb60c083700 con 0x7fb6100f48a0 2022-02-02T14:36:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.843+0000 7fb614881700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 0x7fb5fc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.843+0000 7fb614881700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 0x7fb5fc0672e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb6100f56c0 tx=0x7fb60000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:14.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:14.847+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb60c051810 con 0x7fb6100f48a0 2022-02-02T14:36:15.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.057+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb6100fef50 con 0x7fb6100f48a0 2022-02-02T14:36:15.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.057+0000 7fb605ffb700 1 -- 172.21.15.33:0/2671774653 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb60c054e30 con 0x7fb6100f48a0 2022-02-02T14:36:15.057 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:36:15.057 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:36:15.058 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:36:15.058 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:36:15.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:15.058 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:36:15.058 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:36:15.059 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:36:15.059 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:36:15.059 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:36:15.059 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:36:15.060 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:36:15.060 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:36:15.060 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:36:15.060 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:36:15.060 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:36:15.061 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:36:15.061 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:36:15.061 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:36:15.061 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:36:15.062 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:36:15.062 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:36:15.062 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:36:15.062 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:36:15.062 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:36:15.063 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:36:15.063 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:36:15.063 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:36:15.063 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:36:15.064 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:36:15.064 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:36:15.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:15.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:15.064 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:36:15.065 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:15.065 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:15.065 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:15.065 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:15.065 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:15.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 msgr2=0x7fb5fc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 0x7fb5fc0672e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fb6100f56c0 tx=0x7fb60000b040).stop 2022-02-02T14:36:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 msgr2=0x7fb6100f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb60c009990 tx=0x7fb60c009b30).stop 2022-02-02T14:36:15.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 shutdown_connections 2022-02-02T14:36:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb5fc064e20 0x7fb5fc0672e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6100f48a0 0x7fb6100f7490 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 --2- 172.21.15.33:0/2671774653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6100f5240 0x7fb6100f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 >> 172.21.15.33:0/2671774653 conn(0x7fb6100f0320 msgr2=0x7fb6100fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:15.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 shutdown_connections 2022-02-02T14:36:15.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:15.059+0000 7fb616084700 1 -- 172.21.15.33:0/2671774653 wait complete. 2022-02-02T14:36:15.069 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:36:15.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:15 smithi033 ceph-mon[101165]: from='client.35846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:15.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:15 smithi033 ceph-mon[101165]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:15.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4003781900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:36:15.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2671774653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:36:15.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:15 smithi037 ceph-mon[69017]: from='client.35846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:15.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:15 smithi037 ceph-mon[69017]: from='client.35850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:15.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4003781900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:36:15.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2671774653' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:36:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:16 smithi033 ceph-mon[101165]: pgmap v1726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:16 smithi037 ceph-mon[69017]: pgmap v1726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:18 smithi033 ceph-mon[101165]: pgmap v1727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:18 smithi037 ceph-mon[69017]: pgmap v1727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:20.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:20 smithi033 ceph-mon[101165]: pgmap v1728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:20 smithi037 ceph-mon[69017]: pgmap v1728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:22 smithi033 ceph-mon[101165]: pgmap v1729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:22 smithi037 ceph-mon[69017]: pgmap v1729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:24 smithi033 ceph-mon[101165]: pgmap v1730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:24 smithi037 ceph-mon[69017]: pgmap v1730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:26 smithi033 ceph-mon[101165]: pgmap v1731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:26 smithi037 ceph-mon[69017]: pgmap v1731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:28 smithi033 ceph-mon[101165]: pgmap v1732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:28 smithi037 ceph-mon[69017]: pgmap v1732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:29.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:29 smithi033 ceph-mon[101165]: pgmap v1733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:29.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:29 smithi037 ceph-mon[69017]: pgmap v1733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:32 smithi033 ceph-mon[101165]: pgmap v1734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:32 smithi037 ceph-mon[69017]: pgmap v1734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:34 smithi033 ceph-mon[101165]: pgmap v1735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:34 smithi037 ceph-mon[69017]: pgmap v1735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:36 smithi033 ceph-mon[101165]: pgmap v1736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:36 smithi037 ceph-mon[69017]: pgmap v1736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:38 smithi033 ceph-mon[101165]: pgmap v1737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:38 smithi037 ceph-mon[69017]: pgmap v1737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:40 smithi033 ceph-mon[101165]: pgmap v1738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:40 smithi037 ceph-mon[69017]: pgmap v1738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:42 smithi033 ceph-mon[101165]: pgmap v1739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:42 smithi037 ceph-mon[69017]: pgmap v1739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:44 smithi033 ceph-mon[101165]: pgmap v1740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:44 smithi037 ceph-mon[69017]: pgmap v1740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 -- 172.21.15.33:0/3811651474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 msgr2=0x7f0d280f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/3811651474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d280f9170 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f0d18004660 tx=0x7f0d18009b30).stop 2022-02-02T14:36:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 -- 172.21.15.33:0/3811651474 shutdown_connections 2022-02-02T14:36:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/3811651474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 0x7f0d280fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/3811651474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d280f9170 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 -- 172.21.15.33:0/3811651474 >> 172.21.15.33:0/3811651474 conn(0x7f0d280f0b90 msgr2=0x7f0d280f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 -- 172.21.15.33:0/3811651474 shutdown_connections 2022-02-02T14:36:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 -- 172.21.15.33:0/3811651474 wait complete. 2022-02-02T14:36:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.175+0000 7f0d2ce77700 1 Processor -- start 2022-02-02T14:36:45.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d2ce77700 1 -- start start 2022-02-02T14:36:45.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d2ce77700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d2ce77700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 0x7f0d28109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d2ce77700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28109a00 con 0x7f0d280602b0 2022-02-02T14:36:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d2ce77700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d28109b40 con 0x7f0d280f96f0 2022-02-02T14:36:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33680/0 (socket says 172.21.15.33:33680) 2022-02-02T14:36:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d277fe700 1 -- 172.21.15.33:0/181509685 learned_addr learned my addr 172.21.15.33:0/181509685 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.176+0000 7f0d26ffd700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 0x7f0d28109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d277fe700 1 -- 172.21.15.33:0/181509685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 msgr2=0x7f0d28109450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d277fe700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 0x7f0d28109450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d277fe700 1 -- 172.21.15.33:0/181509685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d18005040 con 0x7f0d280602b0 2022-02-02T14:36:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d277fe700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f0d18009990 tx=0x7f0d18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d18018070 con 0x7f0d280602b0 2022-02-02T14:36:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0d18007ba0 con 0x7f0d280602b0 2022-02-02T14:36:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2810a480 con 0x7f0d280602b0 2022-02-02T14:36:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1801c3c0 con 0x7f0d280602b0 2022-02-02T14:36:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.177+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2810a9e0 con 0x7f0d280602b0 2022-02-02T14:36:45.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.178+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d28045ad0 con 0x7f0d280602b0 2022-02-02T14:36:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.179+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0d1801d420 con 0x7f0d280602b0 2022-02-02T14:36:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.179+0000 7f0d1ffff700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 0x7f0d140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.179+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0d18083700 con 0x7f0d280602b0 2022-02-02T14:36:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.179+0000 7f0d26ffd700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 0x7f0d140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.180+0000 7f0d26ffd700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 0x7f0d140672e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f0d28060080 tx=0x7f0d1000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.184+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0d18055240 con 0x7f0d280602b0 2022-02-02T14:36:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.373+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d280feed0 con 0x7f0d14064e20 2022-02-02T14:36:45.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.374+0000 7f0d1ffff700 1 -- 172.21.15.33:0/181509685 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f0d280feed0 con 0x7f0d14064e20 2022-02-02T14:36:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 msgr2=0x7f0d140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 0x7f0d140672e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f0d28060080 tx=0x7f0d1000b040).stop 2022-02-02T14:36:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 msgr2=0x7f0d28108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f0d18009990 tx=0x7f0d18009b30).stop 2022-02-02T14:36:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 shutdown_connections 2022-02-02T14:36:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0d14064e20 0x7f0d140672e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d280602b0 0x7f0d28108f60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 --2- 172.21.15.33:0/181509685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d280f96f0 0x7f0d28109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 >> 172.21.15.33:0/181509685 conn(0x7f0d280f0b90 msgr2=0x7f0d280f4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 shutdown_connections 2022-02-02T14:36:45.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.376+0000 7f0d2ce77700 1 -- 172.21.15.33:0/181509685 wait complete. 2022-02-02T14:36:45.385 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:36:45.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.479+0000 7f2c68aae700 1 -- 172.21.15.33:0/4073966423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f47a0 msgr2=0x7f2c640f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.479+0000 7f2c68aae700 1 --2- 172.21.15.33:0/4073966423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f47a0 0x7f2c640f4c20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f2c54004660 tx=0x7f2c54009b30).stop 2022-02-02T14:36:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.479+0000 7f2c68aae700 1 -- 172.21.15.33:0/4073966423 shutdown_connections 2022-02-02T14:36:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.479+0000 7f2c68aae700 1 --2- 172.21.15.33:0/4073966423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f47a0 0x7f2c640f4c20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.479+0000 7f2c68aae700 1 --2- 172.21.15.33:0/4073966423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f5a50 0x7f2c640f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.480+0000 7f2c68aae700 1 -- 172.21.15.33:0/4073966423 >> 172.21.15.33:0/4073966423 conn(0x7f2c640f04c0 msgr2=0x7f2c640f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.480+0000 7f2c68aae700 1 -- 172.21.15.33:0/4073966423 shutdown_connections 2022-02-02T14:36:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.480+0000 7f2c68aae700 1 -- 172.21.15.33:0/4073966423 wait complete. 2022-02-02T14:36:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 Processor -- start 2022-02-02T14:36:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 -- start start 2022-02-02T14:36:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f47a0 0x7f2c6410d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6410e030 con 0x7f2c640f5a50 2022-02-02T14:36:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c68aae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6410e170 con 0x7f2c640f47a0 2022-02-02T14:36:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c61d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c61d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33692/0 (socket says 172.21.15.33:33692) 2022-02-02T14:36:45.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c61d9b700 1 -- 172.21.15.33:0/211398230 learned_addr learned my addr 172.21.15.33:0/211398230 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:45.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.481+0000 7f2c6259c700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f47a0 0x7f2c6410d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c61d9b700 1 -- 172.21.15.33:0/211398230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f47a0 msgr2=0x7f2c6410d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c61d9b700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f47a0 0x7f2c6410d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c61d9b700 1 -- 172.21.15.33:0/211398230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c54005040 con 0x7f2c640f5a50 2022-02-02T14:36:45.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c61d9b700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f2c54004e30 tx=0x7f2c54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c54018070 con 0x7f2c640f5a50 2022-02-02T14:36:45.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2c54004290 con 0x7f2c640f5a50 2022-02-02T14:36:45.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c68aae700 1 -- 172.21.15.33:0/211398230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6410eab0 con 0x7f2c640f5a50 2022-02-02T14:36:45.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c5401de70 con 0x7f2c640f5a50 2022-02-02T14:36:45.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.482+0000 7f2c68aae700 1 -- 172.21.15.33:0/211398230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6410f010 con 0x7f2c640f5a50 2022-02-02T14:36:45.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.483+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64045ad0 con 0x7f2c640f5a50 2022-02-02T14:36:45.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.484+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2c54007d30 con 0x7f2c640f5a50 2022-02-02T14:36:45.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.485+0000 7f2c52ffd700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 0x7f2c4c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.485+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2c54083620 con 0x7f2c640f5a50 2022-02-02T14:36:45.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.485+0000 7f2c6259c700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 0x7f2c4c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.485+0000 7f2c6259c700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 0x7f2c4c067270 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2c5c007e30 tx=0x7f2c5c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.490+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2c540551c0 con 0x7f2c640f5a50 2022-02-02T14:36:45.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.673+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c641054f0 con 0x7f2c4c064db0 2022-02-02T14:36:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.688+0000 7f2c52ffd700 1 -- 172.21.15.33:0/211398230 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2c641054f0 con 0x7f2c4c064db0 2022-02-02T14:36:45.687 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:36:45.687 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (62m) 24m ago 63m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:36:45.688 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (55m) 24m ago 63m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:36:45.688 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (55m) 24m ago 62m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:36:45.688 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (61m) 24m ago 62m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:36:45.688 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (55m) 24m ago 59m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:36:45.689 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (56m) 24m ago 59m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:36:45.689 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (56m) 24m ago 59m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:36:45.689 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (59m) 24m ago 59m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:36:45.689 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (56m) 24m ago 64m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:36:45.690 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (56m) 24m ago 62m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:36:45.690 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (56m) 24m ago 64m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:36:45.690 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (55m) 24m ago 62m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:36:45.690 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (62m) 24m ago 62m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:36:45.691 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (62m) 24m ago 62m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:36:45.691 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 24m ago 61m - 4096M 2022-02-02T14:36:45.691 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (61m) 24m ago 61m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:36:45.691 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (61m) 24m ago 61m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:36:45.692 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (60m) 24m ago 60m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:36:45.692 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (60m) 24m ago 60m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:36:45.692 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (60m) 24m ago 60m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:36:45.692 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (61m) 24m ago 62m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:36:45.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 msgr2=0x7f2c4c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 0x7f2c4c067270 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2c5c007e30 tx=0x7f2c5c009040).stop 2022-02-02T14:36:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 msgr2=0x7f2c6410da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f2c54004e30 tx=0x7f2c54009b30).stop 2022-02-02T14:36:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 shutdown_connections 2022-02-02T14:36:45.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2c4c064db0 0x7f2c4c067270 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c640f47a0 0x7f2c6410d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/211398230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c640f5a50 0x7f2c6410da80 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.690+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 >> 172.21.15.33:0/211398230 conn(0x7f2c640f04c0 msgr2=0x7f2c640f9200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:45.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.691+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 shutdown_connections 2022-02-02T14:36:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.691+0000 7f2c50ff9700 1 -- 172.21.15.33:0/211398230 wait complete. 2022-02-02T14:36:45.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 -- 172.21.15.33:0/465423700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 msgr2=0x7f15700f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 --2- 172.21.15.33:0/465423700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f15700f5880 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f1560004660 tx=0x7f1560009b30).stop 2022-02-02T14:36:45.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 -- 172.21.15.33:0/465423700 shutdown_connections 2022-02-02T14:36:45.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 --2- 172.21.15.33:0/465423700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 0x7f15700f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 --2- 172.21.15.33:0/465423700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f15700f5880 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.791+0000 7f1575a15700 1 -- 172.21.15.33:0/465423700 >> 172.21.15.33:0/465423700 conn(0x7f15700f0bc0 msgr2=0x7f15700f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:45.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 -- 172.21.15.33:0/465423700 shutdown_connections 2022-02-02T14:36:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 -- 172.21.15.33:0/465423700 wait complete. 2022-02-02T14:36:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 Processor -- start 2022-02-02T14:36:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 -- start start 2022-02-02T14:36:45.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 0x7f1570106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15701067d0 con 0x7f15700f5460 2022-02-02T14:36:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.792+0000 7f1575a15700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1570106fd0 con 0x7f15700f6700 2022-02-02T14:36:45.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33700/0 (socket says 172.21.15.33:33700) 2022-02-02T14:36:45.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 -- 172.21.15.33:0/2710280172 learned_addr learned my addr 172.21.15.33:0/2710280172 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:45.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156e7fc700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 0x7f1570106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 -- 172.21.15.33:0/2710280172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 msgr2=0x7f1570106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:45.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 0x7f1570106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:45.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 -- 172.21.15.33:0/2710280172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1560005040 con 0x7f15700f5460 2022-02-02T14:36:45.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f156effd700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f1560013a70 tx=0x7f1560009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1560018070 con 0x7f15700f5460 2022-02-02T14:36:45.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f15600097d0 con 0x7f15700f5460 2022-02-02T14:36:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156001de80 con 0x7f15700f5460 2022-02-02T14:36:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1570107250 con 0x7f15700f5460 2022-02-02T14:36:45.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.793+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15701077b0 con 0x7f15700f5460 2022-02-02T14:36:45.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.794+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1570059100 con 0x7f15700f5460 2022-02-02T14:36:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.795+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1560007ba0 con 0x7f15700f5460 2022-02-02T14:36:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.795+0000 7f15577fe700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.795+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f15600836b0 con 0x7f15700f5460 2022-02-02T14:36:45.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.795+0000 7f156e7fc700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:45.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.796+0000 7f156e7fc700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 0x7f15580672e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1564004c40 tx=0x7f156400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:45.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:45.800+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1560055190 con 0x7f15700f5460 2022-02-02T14:36:46.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.048+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f15700fdc20 con 0x7f15700f5460 2022-02-02T14:36:46.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.048+0000 7f15577fe700 1 -- 172.21.15.33:0/2710280172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f1560054d80 con 0x7f15700f5460 2022-02-02T14:36:46.048 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:36:46.048 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:36:46.049 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:36:46.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:46.049 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:36:46.049 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:36:46.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:46.050 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:36:46.050 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:36:46.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:46.051 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:36:46.051 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:36:46.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:36:46.051 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:36:46.051 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:36:46.052 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:36:46.052 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:36:46.052 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:36:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 msgr2=0x7f15580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 0x7f15580672e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1564004c40 tx=0x7f156400b040).stop 2022-02-02T14:36:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 msgr2=0x7f1570105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f1560013a70 tx=0x7f1560009b30).stop 2022-02-02T14:36:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 shutdown_connections 2022-02-02T14:36:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1558064e20 0x7f15580672e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15700f5460 0x7f1570105d30 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 --2- 172.21.15.33:0/2710280172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15700f6700 0x7f1570106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 >> 172.21.15.33:0/2710280172 conn(0x7f15700f0bc0 msgr2=0x7f15700fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 shutdown_connections 2022-02-02T14:36:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.050+0000 7f1575a15700 1 -- 172.21.15.33:0/2710280172 wait complete. 2022-02-02T14:36:46.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 -- 172.21.15.33:0/4291519215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 msgr2=0x7f31800f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 --2- 172.21.15.33:0/4291519215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31800f6cc0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f317c004660 tx=0x7f317c009b30).stop 2022-02-02T14:36:46.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 -- 172.21.15.33:0/4291519215 shutdown_connections 2022-02-02T14:36:46.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 --2- 172.21.15.33:0/4291519215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31800f6cc0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 --2- 172.21.15.33:0/4291519215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f31800f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 -- 172.21.15.33:0/4291519215 >> 172.21.15.33:0/4291519215 conn(0x7f31800f0d40 msgr2=0x7f31800f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 -- 172.21.15.33:0/4291519215 shutdown_connections 2022-02-02T14:36:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 -- 172.21.15.33:0/4291519215 wait complete. 2022-02-02T14:36:46.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.152+0000 7f318747e700 1 Processor -- start 2022-02-02T14:36:46.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318747e700 1 -- start start 2022-02-02T14:36:46.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318747e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f3180106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:46.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318747e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:46.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318747e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180107970 con 0x7f31800f6860 2022-02-02T14:36:46.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318747e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180107ab0 con 0x7f31800f55c0 2022-02-02T14:36:46.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:46.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33712/0 (socket says 172.21.15.33:33712) 2022-02-02T14:36:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 -- 172.21.15.33:0/1765599305 learned_addr learned my addr 172.21.15.33:0/1765599305 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:36:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318521a700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f3180106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 -- 172.21.15.33:0/1765599305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 msgr2=0x7f3180106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f3180106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 -- 172.21.15.33:0/1765599305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317c005040 con 0x7f31800f6860 2022-02-02T14:36:46.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f318521a700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f3180106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:36:46.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.153+0000 7f3184a19700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f317c009990 tx=0x7f317c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:46.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.154+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c018070 con 0x7f31800f6860 2022-02-02T14:36:46.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.154+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31801083f0 con 0x7f31800f6860 2022-02-02T14:36:46.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.154+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f317c007ba0 con 0x7f31800f6860 2022-02-02T14:36:46.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.154+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f317c01c3c0 con 0x7f31800f6860 2022-02-02T14:36:46.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.154+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3180108950 con 0x7f31800f6860 2022-02-02T14:36:46.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.155+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3180045ad0 con 0x7f31800f6860 2022-02-02T14:36:46.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.155+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f317c01d420 con 0x7f31800f6860 2022-02-02T14:36:46.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.156+0000 7f3175ffb700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 0x7f316c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:36:46.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.156+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f317c0837b0 con 0x7f31800f6860 2022-02-02T14:36:46.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.156+0000 7f318521a700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 0x7f316c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:36:46.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.156+0000 7f318521a700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 0x7f316c067290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f31800f66c0 tx=0x7f3170009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:36:46.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.160+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f317c055230 con 0x7f31800f6860 2022-02-02T14:36:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.374+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3180109050 con 0x7f31800f6860 2022-02-02T14:36:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.374+0000 7f3175ffb700 1 -- 172.21.15.33:0/1765599305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f317c054e20 con 0x7f31800f6860 2022-02-02T14:36:46.374 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:36:46.374 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:36:46.375 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:36:46.375 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:36:46.375 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:46.375 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:36:46.376 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:36:46.376 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:36:46.376 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:36:46.376 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:36:46.376 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:36:46.377 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:36:46.377 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:36:46.377 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:36:46.377 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:36:46.378 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:36:46.378 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:36:46.378 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:36:46.378 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:36:46.378 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:36:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:36:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:36:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:36:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:36:46.379 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:36:46.380 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:36:46.380 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:36:46.380 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:36:46.380 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:36:46.381 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:36:46.381 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:36:46.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:46.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:46.381 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:36:46.382 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:36:46.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:46.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:46.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:46.383 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:36:46.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 msgr2=0x7f316c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 0x7f316c067290 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f31800f66c0 tx=0x7f3170009c80).stop 2022-02-02T14:36:46.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 msgr2=0x7f31801073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:36:46.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7f317c009990 tx=0x7f317c009b30).stop 2022-02-02T14:36:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 shutdown_connections 2022-02-02T14:36:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f316c064dd0 0x7f316c067290 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800f55c0 0x7f3180106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 --2- 172.21.15.33:0/1765599305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31800f6860 0x7f31801073c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:36:46.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 >> 172.21.15.33:0/1765599305 conn(0x7f31800f0d40 msgr2=0x7f318005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:36:46.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 shutdown_connections 2022-02-02T14:36:46.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:36:46.376+0000 7f318747e700 1 -- 172.21.15.33:0/1765599305 wait complete. 2022-02-02T14:36:46.386 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:36:46.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:46 smithi033 ceph-mon[101165]: pgmap v1741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:46 smithi033 ceph-mon[101165]: from='client.35862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2710280172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:36:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:46 smithi037 ceph-mon[69017]: pgmap v1741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:46 smithi037 ceph-mon[69017]: from='client.35862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2710280172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:36:47.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:47 smithi033 ceph-mon[101165]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:47.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:47 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1765599305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:36:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:47 smithi037 ceph-mon[69017]: from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:36:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:47 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1765599305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:36:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:48 smithi033 ceph-mon[101165]: pgmap v1742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:48 smithi037 ceph-mon[69017]: pgmap v1742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:50.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:50 smithi033 ceph-mon[101165]: pgmap v1743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:50 smithi037 ceph-mon[69017]: pgmap v1743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:52 smithi033 ceph-mon[101165]: pgmap v1744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:52 smithi037 ceph-mon[69017]: pgmap v1744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:54 smithi033 ceph-mon[101165]: pgmap v1745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:54 smithi037 ceph-mon[69017]: pgmap v1745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:36:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:36:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:36:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:36:56.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:56 smithi033 ceph-mon[101165]: pgmap v1746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:56 smithi037 ceph-mon[69017]: pgmap v1746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:36:58 smithi033 ceph-mon[101165]: pgmap v1747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:36:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:36:58 smithi037 ceph-mon[69017]: pgmap v1747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:00.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:00 smithi033 ceph-mon[101165]: pgmap v1748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:00 smithi037 ceph-mon[69017]: pgmap v1748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:02 smithi033 ceph-mon[101165]: pgmap v1749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:02 smithi037 ceph-mon[69017]: pgmap v1749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:04 smithi033 ceph-mon[101165]: pgmap v1750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:04 smithi037 ceph-mon[69017]: pgmap v1750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:06 smithi033 ceph-mon[101165]: pgmap v1751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:06 smithi037 ceph-mon[69017]: pgmap v1751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:08 smithi033 ceph-mon[101165]: pgmap v1752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:08 smithi037 ceph-mon[69017]: pgmap v1752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:10 smithi033 ceph-mon[101165]: pgmap v1753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:10 smithi037 ceph-mon[69017]: pgmap v1753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:12 smithi033 ceph-mon[101165]: pgmap v1754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:12 smithi037 ceph-mon[69017]: pgmap v1754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:14 smithi033 ceph-mon[101165]: pgmap v1755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:14 smithi037 ceph-mon[69017]: pgmap v1755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:16.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 -- 172.21.15.33:0/3601062639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f77d0 msgr2=0x7f41080f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 --2- 172.21.15.33:0/3601062639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f77d0 0x7f41080f7c30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f40fc004660 tx=0x7f40fc009b30).stop 2022-02-02T14:37:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 -- 172.21.15.33:0/3601062639 shutdown_connections 2022-02-02T14:37:16.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 --2- 172.21.15.33:0/3601062639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f77d0 0x7f41080f7c30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 --2- 172.21.15.33:0/3601062639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f6530 0x7f41080f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 -- 172.21.15.33:0/3601062639 >> 172.21.15.33:0/3601062639 conn(0x7f41080f1c90 msgr2=0x7f41080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:16.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 -- 172.21.15.33:0/3601062639 shutdown_connections 2022-02-02T14:37:16.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 -- 172.21.15.33:0/3601062639 wait complete. 2022-02-02T14:37:16.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.493+0000 7f410c91f700 1 Processor -- start 2022-02-02T14:37:16.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f410c91f700 1 -- start start 2022-02-02T14:37:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f410c91f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f410c91f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f77d0 0x7f4108069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f410c91f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410806a380 con 0x7f41080f6530 2022-02-02T14:37:16.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f410c91f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410806a4c0 con 0x7f41080f77d0 2022-02-02T14:37:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33720/0 (socket says 172.21.15.33:33720) 2022-02-02T14:37:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 -- 172.21.15.33:0/1066024788 learned_addr learned my addr 172.21.15.33:0/1066024788 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:16.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f4106ffd700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f77d0 0x7f4108069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 -- 172.21.15.33:0/1066024788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f77d0 msgr2=0x7f4108069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f77d0 0x7f4108069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 -- 172.21.15.33:0/1066024788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc005040 con 0x7f41080f6530 2022-02-02T14:37:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.494+0000 7f41077fe700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f40f800e7c0 tx=0x7f40f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:16.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.495+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f80092e0 con 0x7f41080f6530 2022-02-02T14:37:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.495+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410806a7a0 con 0x7f41080f6530 2022-02-02T14:37:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.495+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f40f800f040 con 0x7f41080f6530 2022-02-02T14:37:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.495+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40f80147e0 con 0x7f41080f6530 2022-02-02T14:37:16.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.495+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410810ed00 con 0x7f41080f6530 2022-02-02T14:37:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.496+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4108045ad0 con 0x7f41080f6530 2022-02-02T14:37:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.496+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f40f801b030 con 0x7f41080f6530 2022-02-02T14:37:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.497+0000 7f40effff700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 0x7f40f00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.497+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f40f80817b0 con 0x7f41080f6530 2022-02-02T14:37:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.497+0000 7f4106ffd700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 0x7f40f00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.497+0000 7f4106ffd700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 0x7f40f00672e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f40fc005010 tx=0x7f40fc016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.501+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f40f804f910 con 0x7f41080f6530 2022-02-02T14:37:16.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.690+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f41080fee30 con 0x7f40f0064e20 2022-02-02T14:37:16.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:16 smithi033 ceph-mon[101165]: pgmap v1756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:16.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.691+0000 7f40effff700 1 -- 172.21.15.33:0/1066024788 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f41080fee30 con 0x7f40f0064e20 2022-02-02T14:37:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 msgr2=0x7f40f00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 0x7f40f00672e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f40fc005010 tx=0x7f40fc016040).stop 2022-02-02T14:37:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 msgr2=0x7f410806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f40f800e7c0 tx=0x7f40f800b040).stop 2022-02-02T14:37:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 shutdown_connections 2022-02-02T14:37:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f40f0064e20 0x7f40f00672e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080f6530 0x7f410806b9a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 --2- 172.21.15.33:0/1066024788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41080f77d0 0x7f4108069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 >> 172.21.15.33:0/1066024788 conn(0x7f41080f1c90 msgr2=0x7f41080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:16.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 shutdown_connections 2022-02-02T14:37:16.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.693+0000 7f410c91f700 1 -- 172.21.15.33:0/1066024788 wait complete. 2022-02-02T14:37:16.703 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:37:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:16 smithi037 ceph-mon[69017]: pgmap v1756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:16.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 -- 172.21.15.33:0/1125982165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 msgr2=0x7fee7c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 --2- 172.21.15.33:0/1125982165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c0f59e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7fee78004660 tx=0x7fee78009b30).stop 2022-02-02T14:37:16.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 -- 172.21.15.33:0/1125982165 shutdown_connections 2022-02-02T14:37:16.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 --2- 172.21.15.33:0/1125982165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 0x7fee7c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 --2- 172.21.15.33:0/1125982165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c0f59e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 -- 172.21.15.33:0/1125982165 >> 172.21.15.33:0/1125982165 conn(0x7fee7c0f0d40 msgr2=0x7fee7c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:16.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 -- 172.21.15.33:0/1125982165 shutdown_connections 2022-02-02T14:37:16.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.794+0000 7fee833b3700 1 -- 172.21.15.33:0/1125982165 wait complete. 2022-02-02T14:37:16.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 Processor -- start 2022-02-02T14:37:16.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 -- start start 2022-02-02T14:37:16.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 0x7fee7c1074b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c107a60 con 0x7fee7c0f55c0 2022-02-02T14:37:16.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee833b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c107ba0 con 0x7fee7c0f6860 2022-02-02T14:37:16.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33730/0 (socket says 172.21.15.33:33730) 2022-02-02T14:37:16.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 -- 172.21.15.33:0/1702223230 learned_addr learned my addr 172.21.15.33:0/1702223230 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:16.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8094e700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 0x7fee7c1074b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 -- 172.21.15.33:0/1702223230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 msgr2=0x7fee7c1074b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:16.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 0x7fee7c1074b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:16.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.795+0000 7fee8114f700 1 -- 172.21.15.33:0/1702223230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78005040 con 0x7fee7c0f55c0 2022-02-02T14:37:16.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee8114f700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fee78004f60 tx=0x7fee78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:16.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee78018070 con 0x7fee7c0f55c0 2022-02-02T14:37:16.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fee78007ba0 con 0x7fee7c0f55c0 2022-02-02T14:37:16.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c1084e0 con 0x7fee7c0f55c0 2022-02-02T14:37:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7801c620 con 0x7fee7c0f55c0 2022-02-02T14:37:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.796+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c108a40 con 0x7fee7c0f55c0 2022-02-02T14:37:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.797+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c045ad0 con 0x7fee7c0f55c0 2022-02-02T14:37:16.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.797+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fee7801d420 con 0x7fee7c0f55c0 2022-02-02T14:37:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.798+0000 7fee71ffb700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 0x7fee68067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.798+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fee780838e0 con 0x7fee7c0f55c0 2022-02-02T14:37:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.798+0000 7fee8094e700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 0x7fee68067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:16.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.798+0000 7fee8094e700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 0x7fee68067290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fee6c0041d0 tx=0x7fee6c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:16.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.802+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fee78055480 con 0x7fee7c0f55c0 2022-02-02T14:37:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.983+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7c05fd30 con 0x7fee68064dd0 2022-02-02T14:37:16.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.997+0000 7fee71ffb700 1 -- 172.21.15.33:0/1702223230 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fee7c05fd30 con 0x7fee68064dd0 2022-02-02T14:37:16.997 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:37:16.997 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (62m) 24m ago 63m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:37:16.997 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (55m) 24m ago 63m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:37:16.998 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (55m) 24m ago 63m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:37:16.998 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (62m) 24m ago 63m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:37:16.998 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (56m) 24m ago 59m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:37:16.999 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (56m) 24m ago 59m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:37:16.999 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (57m) 24m ago 59m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:37:16.999 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (59m) 24m ago 59m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:37:16.999 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (57m) 24m ago 64m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:37:17.000 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (56m) 24m ago 63m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:37:17.000 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (56m) 24m ago 64m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:37:17.000 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (56m) 24m ago 62m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:37:17.000 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (63m) 24m ago 63m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:37:17.000 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (62m) 24m ago 62m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:37:17.001 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 24m ago 62m - 4096M 2022-02-02T14:37:17.001 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (61m) 24m ago 61m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:37:17.001 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (61m) 24m ago 61m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:37:17.001 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (61m) 24m ago 61m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:37:17.001 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (61m) 24m ago 61m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:37:17.002 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (60m) 24m ago 60m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:37:17.002 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (62m) 24m ago 63m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:37:17.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 msgr2=0x7fee68067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 0x7fee68067290 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fee6c0041d0 tx=0x7fee6c009040).stop 2022-02-02T14:37:17.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 msgr2=0x7fee7c106fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7fee78004f60 tx=0x7fee78009b30).stop 2022-02-02T14:37:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 shutdown_connections 2022-02-02T14:37:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fee68064dd0 0x7fee68067290 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee7c0f55c0 0x7fee7c106fc0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 --2- 172.21.15.33:0/1702223230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee7c0f6860 0x7fee7c1074b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 >> 172.21.15.33:0/1702223230 conn(0x7fee7c0f0d40 msgr2=0x7fee7c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 shutdown_connections 2022-02-02T14:37:17.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:16.999+0000 7fee833b3700 1 -- 172.21.15.33:0/1702223230 wait complete. 2022-02-02T14:37:17.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3850633142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f6530 msgr2=0x7f4ed00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3850633142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f6530 0x7f4ed00f6950 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f4ec4004660 tx=0x7f4ec4009b30).stop 2022-02-02T14:37:17.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3850633142 shutdown_connections 2022-02-02T14:37:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3850633142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f77d0 0x7f4ed00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3850633142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f6530 0x7f4ed00f6950 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3850633142 >> 172.21.15.33:0/3850633142 conn(0x7f4ed00f1c90 msgr2=0x7f4ed00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3850633142 shutdown_connections 2022-02-02T14:37:17.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3850633142 wait complete. 2022-02-02T14:37:17.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 Processor -- start 2022-02-02T14:37:17.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.099+0000 7f4ed4f82700 1 -- start start 2022-02-02T14:37:17.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4ed4f82700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f6530 0x7f4ed0106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4ed4f82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4ed4f82700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed01078f0 con 0x7f4ed00f77d0 2022-02-02T14:37:17.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4ed4f82700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed0108100 con 0x7f4ed00f6530 2022-02-02T14:37:17.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33742/0 (socket says 172.21.15.33:33742) 2022-02-02T14:37:17.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 -- 172.21.15.33:0/3492980683 learned_addr learned my addr 172.21.15.33:0/3492980683 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4ecf7fe700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f6530 0x7f4ed0106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 -- 172.21.15.33:0/3492980683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f6530 msgr2=0x7f4ed0106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f6530 0x7f4ed0106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 -- 172.21.15.33:0/3492980683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4005040 con 0x7f4ed00f77d0 2022-02-02T14:37:17.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.100+0000 7f4eceffd700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4ec00026d0 tx=0x7f4ec0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.101+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec00079c0 con 0x7f4ed00f77d0 2022-02-02T14:37:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.101+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ec000f040 con 0x7f4ed00f77d0 2022-02-02T14:37:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.101+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed0108380 con 0x7f4ed00f77d0 2022-02-02T14:37:17.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.101+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec00148b0 con 0x7f4ed00f77d0 2022-02-02T14:37:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.101+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed0108940 con 0x7f4ed00f77d0 2022-02-02T14:37:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.102+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed0059100 con 0x7f4ed00f77d0 2022-02-02T14:37:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.102+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ec0007b20 con 0x7f4ed00f77d0 2022-02-02T14:37:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.102+0000 7f4eb7fff700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 0x7f4eb80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.103+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ec0081950 con 0x7f4ed00f77d0 2022-02-02T14:37:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.103+0000 7f4ecf7fe700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 0x7f4eb80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.103+0000 7f4ecf7fe700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 0x7f4eb80672e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4ec4013690 tx=0x7f4ec4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:17.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.107+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ec004fa00 con 0x7f4ed00f77d0 2022-02-02T14:37:17.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.350+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ed0027a00 con 0x7f4ed00f77d0 2022-02-02T14:37:17.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.351+0000 7f4eb7fff700 1 -- 172.21.15.33:0/3492980683 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4ec0053020 con 0x7f4ed00f77d0 2022-02-02T14:37:17.350 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:37:17.351 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:37:17.351 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:37:17.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:17.351 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:37:17.352 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:37:17.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:17.352 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:37:17.352 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:37:17.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:17.353 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:37:17.353 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:37:17.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:17.354 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:37:17.354 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:37:17.354 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:37:17.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:37:17.354 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:37:17.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 msgr2=0x7f4eb80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 0x7f4eb80672e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4ec4013690 tx=0x7f4ec4009b30).stop 2022-02-02T14:37:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 msgr2=0x7f4ed01072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4ec00026d0 tx=0x7f4ec0009de0).stop 2022-02-02T14:37:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 shutdown_connections 2022-02-02T14:37:17.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4eb8064e20 0x7f4eb80672e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ed00f6530 0x7f4ed0106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 --2- 172.21.15.33:0/3492980683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ed00f77d0 0x7f4ed01072f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.352+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 >> 172.21.15.33:0/3492980683 conn(0x7f4ed00f1c90 msgr2=0x7f4ed00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:17.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.353+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 shutdown_connections 2022-02-02T14:37:17.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.353+0000 7f4ed4f82700 1 -- 172.21.15.33:0/3492980683 wait complete. 2022-02-02T14:37:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 -- 172.21.15.33:0/734836530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f7d20 msgr2=0x7ff5600f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 --2- 172.21.15.33:0/734836530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f7d20 0x7ff5600f8140 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7ff550004660 tx=0x7ff550009b30).stop 2022-02-02T14:37:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 -- 172.21.15.33:0/734836530 shutdown_connections 2022-02-02T14:37:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 --2- 172.21.15.33:0/734836530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f86c0 0x7ff5600f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 --2- 172.21.15.33:0/734836530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f7d20 0x7ff5600f8140 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.454+0000 7ff565885700 1 -- 172.21.15.33:0/734836530 >> 172.21.15.33:0/734836530 conn(0x7ff5600f04c0 msgr2=0x7ff5600f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.455+0000 7ff565885700 1 -- 172.21.15.33:0/734836530 shutdown_connections 2022-02-02T14:37:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.455+0000 7ff565885700 1 -- 172.21.15.33:0/734836530 wait complete. 2022-02-02T14:37:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.455+0000 7ff565885700 1 Processor -- start 2022-02-02T14:37:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.455+0000 7ff565885700 1 -- start start 2022-02-02T14:37:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff565885700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f7d20 0x7ff560107010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff565885700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff565885700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560107ab0 con 0x7ff5600f86c0 2022-02-02T14:37:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff565885700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff560107bf0 con 0x7ff5600f7d20 2022-02-02T14:37:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33752/0 (socket says 172.21.15.33:33752) 2022-02-02T14:37:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 -- 172.21.15.33:0/977699880 learned_addr learned my addr 172.21.15.33:0/977699880 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55effd700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f7d20 0x7ff560107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 -- 172.21.15.33:0/977699880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f7d20 msgr2=0x7ff560107010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f7d20 0x7ff560107010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 -- 172.21.15.33:0/977699880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff550005040 con 0x7ff5600f86c0 2022-02-02T14:37:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.456+0000 7ff55e7fc700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7ff55400c530 tx=0x7ff554007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.457+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff55400f650 con 0x7ff5600f86c0 2022-02-02T14:37:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.457+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff55400fc60 con 0x7ff5600f86c0 2022-02-02T14:37:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.457+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff560108590 con 0x7ff5600f86c0 2022-02-02T14:37:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.457+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff554012cd0 con 0x7ff5600f86c0 2022-02-02T14:37:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.457+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff560108b50 con 0x7ff5600f86c0 2022-02-02T14:37:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.458+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff560045ad0 con 0x7ff5600f86c0 2022-02-02T14:37:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.458+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff554010070 con 0x7ff5600f86c0 2022-02-02T14:37:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.458+0000 7ff5477fe700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.459+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff554081800 con 0x7ff5600f86c0 2022-02-02T14:37:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.459+0000 7ff55effd700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.459+0000 7ff55effd700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7ff550004e30 tx=0x7ff550009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.463+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5540532e0 con 0x7ff5600f86c0 2022-02-02T14:37:17.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.675+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff5600fefa0 con 0x7ff5600f86c0 2022-02-02T14:37:17.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3492980683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:37:17.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.675+0000 7ff5477fe700 1 -- 172.21.15.33:0/977699880 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ff554052ed0 con 0x7ff5600f86c0 2022-02-02T14:37:17.676 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:37:17.676 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:37:17.677 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:37:17.677 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:37:17.677 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:17.677 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:37:17.677 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:37:17.678 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:37:17.678 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:37:17.678 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:37:17.678 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:37:17.679 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:37:17.679 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:37:17.679 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:37:17.679 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:37:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:37:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:37:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:37:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:37:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:37:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:37:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:37:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:37:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:37:17.681 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:37:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:37:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:37:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:37:17.682 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:37:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:37:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:37:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:17.683 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:17.683 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:37:17.684 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 msgr2=0x7ff548067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7ff550004e30 tx=0x7ff550009b30).stop 2022-02-02T14:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 msgr2=0x7ff560107500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7ff55400c530 tx=0x7ff554007e20).stop 2022-02-02T14:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 shutdown_connections 2022-02-02T14:37:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff548064dd0 0x7ff548067290 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5600f7d20 0x7ff560107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 --2- 172.21.15.33:0/977699880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5600f86c0 0x7ff560107500 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 >> 172.21.15.33:0/977699880 conn(0x7ff5600f04c0 msgr2=0x7ff5600fb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:17.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 shutdown_connections 2022-02-02T14:37:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:17.679+0000 7ff565885700 1 -- 172.21.15.33:0/977699880 wait complete. 2022-02-02T14:37:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:37:17.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3492980683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:37:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:18 smithi033 ceph-mon[101165]: from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:18 smithi033 ceph-mon[101165]: from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:18 smithi033 ceph-mon[101165]: pgmap v1757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:18.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/977699880' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:37:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:18 smithi037 ceph-mon[69017]: from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:18 smithi037 ceph-mon[69017]: from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:18.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:18 smithi037 ceph-mon[69017]: pgmap v1757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:18.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/977699880' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:37:20.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:20 smithi033 ceph-mon[101165]: pgmap v1758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:20 smithi037 ceph-mon[69017]: pgmap v1758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:22 smithi033 ceph-mon[101165]: pgmap v1759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:22 smithi037 ceph-mon[69017]: pgmap v1759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:24 smithi033 ceph-mon[101165]: pgmap v1760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:24 smithi037 ceph-mon[69017]: pgmap v1760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:26 smithi033 ceph-mon[101165]: pgmap v1761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:26 smithi037 ceph-mon[69017]: pgmap v1761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:28 smithi033 ceph-mon[101165]: pgmap v1762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:28 smithi037 ceph-mon[69017]: pgmap v1762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:30 smithi033 ceph-mon[101165]: pgmap v1763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:30 smithi037 ceph-mon[69017]: pgmap v1763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:32 smithi033 ceph-mon[101165]: pgmap v1764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:32 smithi037 ceph-mon[69017]: pgmap v1764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:34 smithi033 ceph-mon[101165]: pgmap v1765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:34 smithi037 ceph-mon[69017]: pgmap v1765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:36.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:36 smithi033 ceph-mon[101165]: pgmap v1766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:36 smithi037 ceph-mon[69017]: pgmap v1766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:38 smithi033 ceph-mon[101165]: pgmap v1767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:38 smithi037 ceph-mon[69017]: pgmap v1767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:40 smithi033 ceph-mon[101165]: pgmap v1768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:40 smithi037 ceph-mon[69017]: pgmap v1768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:42 smithi033 ceph-mon[101165]: pgmap v1769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:42 smithi037 ceph-mon[69017]: pgmap v1769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:44 smithi033 ceph-mon[101165]: pgmap v1770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:44 smithi037 ceph-mon[69017]: pgmap v1770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:46.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:46 smithi033 ceph-mon[101165]: pgmap v1771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:46 smithi037 ceph-mon[69017]: pgmap v1771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:47.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.794+0000 7f3796f20700 1 -- 172.21.15.33:0/1995518280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f55c0 msgr2=0x7f37900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:47.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.794+0000 7f3796f20700 1 --2- 172.21.15.33:0/1995518280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f55c0 0x7f37900f59e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f3784004660 tx=0x7f3784009b30).stop 2022-02-02T14:37:47.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 -- 172.21.15.33:0/1995518280 shutdown_connections 2022-02-02T14:37:47.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 --2- 172.21.15.33:0/1995518280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f6860 0x7f37900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:47.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 --2- 172.21.15.33:0/1995518280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f55c0 0x7f37900f59e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:47.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 -- 172.21.15.33:0/1995518280 >> 172.21.15.33:0/1995518280 conn(0x7f37900f0d40 msgr2=0x7f37900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:47.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 -- 172.21.15.33:0/1995518280 shutdown_connections 2022-02-02T14:37:47.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 -- 172.21.15.33:0/1995518280 wait complete. 2022-02-02T14:37:47.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 Processor -- start 2022-02-02T14:37:47.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.795+0000 7f3796f20700 1 -- start start 2022-02-02T14:37:47.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f3796f20700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f55c0 0x7f3790106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:47.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f3796f20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:47.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f3796f20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790107a10 con 0x7f37900f6860 2022-02-02T14:37:47.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f3796f20700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3790107b50 con 0x7f37900f55c0 2022-02-02T14:37:47.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:47.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33762/0 (socket says 172.21.15.33:33762) 2022-02-02T14:37:47.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 -- 172.21.15.33:0/1275218711 learned_addr learned my addr 172.21.15.33:0/1275218711 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:47.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f3794cbc700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f55c0 0x7f3790106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:47.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 -- 172.21.15.33:0/1275218711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f55c0 msgr2=0x7f3790106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:47.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f55c0 0x7f3790106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:47.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 -- 172.21.15.33:0/1275218711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784005040 con 0x7f37900f6860 2022-02-02T14:37:47.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.796+0000 7f378ffff700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f377c0026d0 tx=0x7f377c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:47.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.797+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f377c0079c0 con 0x7f37900f6860 2022-02-02T14:37:47.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.797+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f377c00f040 con 0x7f37900f6860 2022-02-02T14:37:47.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.797+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f377c0148b0 con 0x7f37900f6860 2022-02-02T14:37:47.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.797+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37901084f0 con 0x7f37900f6860 2022-02-02T14:37:47.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.797+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3790108ab0 con 0x7f37900f6860 2022-02-02T14:37:47.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.798+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790045ad0 con 0x7f37900f6860 2022-02-02T14:37:47.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.799+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f377c007b20 con 0x7f37900f6860 2022-02-02T14:37:47.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.799+0000 7f378d7fa700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 0x7f3780067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:47.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.799+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f377c081d50 con 0x7f37900f6860 2022-02-02T14:37:47.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.799+0000 7f3794cbc700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 0x7f3780067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:47.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.800+0000 7f3794cbc700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 0x7f3780067290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3784004630 tx=0x7f3784009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:47.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.803+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f377c0538b0 con 0x7f37900f6860 2022-02-02T14:37:47.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.996+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f37900faca0 con 0x7f3780064dd0 2022-02-02T14:37:47.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.997+0000 7f378d7fa700 1 -- 172.21.15.33:0/1275218711 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f37900faca0 con 0x7f3780064dd0 2022-02-02T14:37:47.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 msgr2=0x7f3780067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 0x7f3780067290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f3784004630 tx=0x7f3784009b30).stop 2022-02-02T14:37:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 msgr2=0x7f3790107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f377c0026d0 tx=0x7f377c009de0).stop 2022-02-02T14:37:47.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 shutdown_connections 2022-02-02T14:37:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3780064dd0 0x7f3780067290 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37900f55c0 0x7f3790106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 --2- 172.21.15.33:0/1275218711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37900f6860 0x7f3790107460 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 >> 172.21.15.33:0/1275218711 conn(0x7f37900f0d40 msgr2=0x7f379005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 shutdown_connections 2022-02-02T14:37:48.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:47.999+0000 7f3796f20700 1 -- 172.21.15.33:0/1275218711 wait complete. 2022-02-02T14:37:48.008 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:37:48.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 -- 172.21.15.33:0/4155734191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f66e0 msgr2=0x7f3fcc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 --2- 172.21.15.33:0/4155734191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc0f6b00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f3fbc004660 tx=0x7f3fbc009b30).stop 2022-02-02T14:37:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 -- 172.21.15.33:0/4155734191 shutdown_connections 2022-02-02T14:37:48.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 --2- 172.21.15.33:0/4155734191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 --2- 172.21.15.33:0/4155734191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc0f6b00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 -- 172.21.15.33:0/4155734191 >> 172.21.15.33:0/4155734191 conn(0x7f3fcc0f1e40 msgr2=0x7f3fcc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 -- 172.21.15.33:0/4155734191 shutdown_connections 2022-02-02T14:37:48.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.100+0000 7f3fd208e700 1 -- 172.21.15.33:0/4155734191 wait complete. 2022-02-02T14:37:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 Processor -- start 2022-02-02T14:37:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 -- start start 2022-02-02T14:37:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc1091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc109c40 con 0x7f3fcc0f7980 2022-02-02T14:37:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.101+0000 7f3fd208e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fcc109d80 con 0x7f3fcc0f66e0 2022-02-02T14:37:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33772/0 (socket says 172.21.15.33:33772) 2022-02-02T14:37:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 -- 172.21.15.33:0/553590360 learned_addr learned my addr 172.21.15.33:0/553590360 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcb7fe700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc1091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 -- 172.21.15.33:0/553590360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 msgr2=0x7f3fcc1091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc1091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 -- 172.21.15.33:0/553590360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc005040 con 0x7f3fcc0f7980 2022-02-02T14:37:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcb7fe700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc1091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:37:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fcaffd700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f3fb40026d0 tx=0x7f3fb4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb4009320 con 0x7f3fcc0f7980 2022-02-02T14:37:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fcc10a720 con 0x7f3fcc0f7980 2022-02-02T14:37:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3fb400f040 con 0x7f3fcc0f7980 2022-02-02T14:37:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.102+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fb40147e0 con 0x7f3fcc0f7980 2022-02-02T14:37:48.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.103+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fcc10ace0 con 0x7f3fcc0f7980 2022-02-02T14:37:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.104+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fcc045ad0 con 0x7f3fcc0f7980 2022-02-02T14:37:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.104+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3fb4009480 con 0x7f3fcc0f7980 2022-02-02T14:37:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.105+0000 7f3fc3fff700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 0x7f3fb8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.105+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3fb40820e0 con 0x7f3fcc0f7980 2022-02-02T14:37:48.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.105+0000 7f3fcb7fe700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 0x7f3fb8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.105+0000 7f3fcb7fe700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 0x7f3fb8067290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3fbc005010 tx=0x7f3fbc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.109+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3fb4053bc0 con 0x7f3fcc0f7980 2022-02-02T14:37:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.290+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fcc10afb0 con 0x7f3fb8064dd0 2022-02-02T14:37:48.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.305+0000 7f3fc3fff700 1 -- 172.21.15.33:0/553590360 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3fcc10afb0 con 0x7f3fb8064dd0 2022-02-02T14:37:48.305 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:37:48.305 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (63m) 25m ago 64m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:37:48.305 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (56m) 25m ago 64m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:37:48.305 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (56m) 25m ago 63m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:37:48.306 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (62m) 25m ago 63m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:37:48.306 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (56m) 25m ago 60m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:37:48.306 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (57m) 25m ago 60m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:37:48.306 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (57m) 25m ago 60m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:37:48.307 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (60m) 25m ago 60m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:37:48.307 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (57m) 25m ago 65m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:37:48.307 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (57m) 25m ago 63m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:37:48.307 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (57m) 25m ago 65m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:37:48.307 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (56m) 25m ago 63m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:37:48.308 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (63m) 25m ago 63m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:37:48.308 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (63m) 25m ago 63m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:37:48.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 25m ago 62m - 4096M 2022-02-02T14:37:48.308 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (62m) 25m ago 62m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:37:48.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (62m) 25m ago 62m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:37:48.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (61m) 25m ago 61m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:37:48.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (61m) 25m ago 61m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:37:48.309 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (61m) 25m ago 61m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:37:48.309 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (62m) 25m ago 63m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:37:48.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.306+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 msgr2=0x7f3fb8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.306+0000 7f3fd208e700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 0x7f3fb8067290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3fbc005010 tx=0x7f3fbc009b30).stop 2022-02-02T14:37:48.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.306+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 msgr2=0x7f3fcc109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.306+0000 7f3fd208e700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f3fb40026d0 tx=0x7f3fb4009de0).stop 2022-02-02T14:37:48.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 shutdown_connections 2022-02-02T14:37:48.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3fb8064dd0 0x7f3fb8067290 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fcc0f66e0 0x7f3fcc1091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 --2- 172.21.15.33:0/553590360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fcc0f7980 0x7f3fcc109690 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 >> 172.21.15.33:0/553590360 conn(0x7f3fcc0f1e40 msgr2=0x7f3fcc0f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 shutdown_connections 2022-02-02T14:37:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.307+0000 7f3fd208e700 1 -- 172.21.15.33:0/553590360 wait complete. 2022-02-02T14:37:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 -- 172.21.15.33:0/1001142421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 msgr2=0x7ff9bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/1001142421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc0f59e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7ff9b0004660 tx=0x7ff9b0009b30).stop 2022-02-02T14:37:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 -- 172.21.15.33:0/1001142421 shutdown_connections 2022-02-02T14:37:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/1001142421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 0x7ff9bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/1001142421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc0f59e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 -- 172.21.15.33:0/1001142421 >> 172.21.15.33:0/1001142421 conn(0x7ff9bc0f0d40 msgr2=0x7ff9bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 -- 172.21.15.33:0/1001142421 shutdown_connections 2022-02-02T14:37:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 -- 172.21.15.33:0/1001142421 wait complete. 2022-02-02T14:37:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.407+0000 7ff9c0d40700 1 Processor -- start 2022-02-02T14:37:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9c0d40700 1 -- start start 2022-02-02T14:37:48.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9c0d40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9c0d40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 0x7ff9bc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9c0d40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc107a10 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9c0d40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9bc107b50 con 0x7ff9bc0f6860 2022-02-02T14:37:48.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33778/0 (socket says 172.21.15.33:33778) 2022-02-02T14:37:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 -- 172.21.15.33:0/2497373616 learned_addr learned my addr 172.21.15.33:0/2497373616 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9b9d9b700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 0x7ff9bc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 -- 172.21.15.33:0/2497373616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 msgr2=0x7ff9bc107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 0x7ff9bc107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 -- 172.21.15.33:0/2497373616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b0005040 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9ba59c700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff9b0013a70 tx=0x7ff9b0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b0018070 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.408+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff9b00097d0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.409+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9bc108490 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.409+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9bc1089f0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.409+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9b001de80 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.409+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a0004fa0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.410+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff9b0007ba0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.411+0000 7ff9aaffd700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 0x7ff9a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.411+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff9b0083c40 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.411+0000 7ff9b9d9b700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 0x7ff9a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.411+0000 7ff9b9d9b700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 0x7ff9a4067290 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff9ac004c40 tx=0x7ff9ac00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.414+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9b00557e0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.665+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff9a0005940 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.665 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:48 smithi033 ceph-mon[101165]: pgmap v1772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:48.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.666+0000 7ff9aaffd700 1 -- 172.21.15.33:0/2497373616 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff9b00553d0 con 0x7ff9bc0f55c0 2022-02-02T14:37:48.666 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:37:48.666 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:37:48.667 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:37:48.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:48.667 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:37:48.667 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:37:48.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:48.668 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:37:48.668 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:37:48.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:48.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:37:48.668 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:37:48.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:37:48.669 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:37:48.669 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:37:48.669 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:37:48.670 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:37:48.670 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:37:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.667+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 msgr2=0x7ff9a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.667+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 0x7ff9a4067290 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7ff9ac004c40 tx=0x7ff9ac00b040).stop 2022-02-02T14:37:48.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.667+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 msgr2=0x7ff9bc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.667+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff9b0013a70 tx=0x7ff9b0009b30).stop 2022-02-02T14:37:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 shutdown_connections 2022-02-02T14:37:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff9a4064dd0 0x7ff9a4067290 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9bc0f55c0 0x7ff9bc106f70 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 --2- 172.21.15.33:0/2497373616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9bc0f6860 0x7ff9bc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 >> 172.21.15.33:0/2497373616 conn(0x7ff9bc0f0d40 msgr2=0x7ff9bc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 shutdown_connections 2022-02-02T14:37:48.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.668+0000 7ff9c0d40700 1 -- 172.21.15.33:0/2497373616 wait complete. 2022-02-02T14:37:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 -- 172.21.15.33:0/3975268652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 msgr2=0x7fac980f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 --2- 172.21.15.33:0/3975268652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac980f6b40 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fac88004660 tx=0x7fac88009b30).stop 2022-02-02T14:37:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 -- 172.21.15.33:0/3975268652 shutdown_connections 2022-02-02T14:37:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 --2- 172.21.15.33:0/3975268652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac980f6b40 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 --2- 172.21.15.33:0/3975268652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 0x7fac980f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 -- 172.21.15.33:0/3975268652 >> 172.21.15.33:0/3975268652 conn(0x7fac980f0ba0 msgr2=0x7fac980f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 -- 172.21.15.33:0/3975268652 shutdown_connections 2022-02-02T14:37:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 -- 172.21.15.33:0/3975268652 wait complete. 2022-02-02T14:37:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.769+0000 7fac9c835700 1 Processor -- start 2022-02-02T14:37:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac9c835700 1 -- start start 2022-02-02T14:37:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac9c835700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 0x7fac98109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac9c835700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac9c835700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac980603e0 con 0x7fac980f66e0 2022-02-02T14:37:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac9c835700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac98060520 con 0x7fac980f5440 2022-02-02T14:37:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33790/0 (socket says 172.21.15.33:33790) 2022-02-02T14:37:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 -- 172.21.15.33:0/1205667845 learned_addr learned my addr 172.21.15.33:0/1205667845 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:37:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac977fe700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 0x7fac98109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 -- 172.21.15.33:0/1205667845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 msgr2=0x7fac98109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 0x7fac98109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 -- 172.21.15.33:0/1205667845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88005040 con 0x7fac980f66e0 2022-02-02T14:37:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac96ffd700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fac88009990 tx=0x7fac88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.770+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac88018070 con 0x7fac980f66e0 2022-02-02T14:37:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.771+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fac88007ca0 con 0x7fac980f66e0 2022-02-02T14:37:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.771+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac8801c620 con 0x7fac980f66e0 2022-02-02T14:37:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.771+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9810c4e0 con 0x7fac980f66e0 2022-02-02T14:37:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.771+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9810c9f0 con 0x7fac980f66e0 2022-02-02T14:37:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.772+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac98045ad0 con 0x7fac980f66e0 2022-02-02T14:37:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.772+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fac8801d960 con 0x7fac980f66e0 2022-02-02T14:37:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.772+0000 7fac7ffff700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 0x7fac800672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:37:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.773+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fac88083830 con 0x7fac980f66e0 2022-02-02T14:37:48.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.773+0000 7fac977fe700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 0x7fac800672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:37:48.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.773+0000 7fac977fe700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 0x7fac800672e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fac98060060 tx=0x7fac8c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:37:48.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.777+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fac880519a0 con 0x7fac980f66e0 2022-02-02T14:37:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:48 smithi037 ceph-mon[69017]: pgmap v1772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:48.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.987+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fac98027a00 con 0x7fac980f66e0 2022-02-02T14:37:48.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.988+0000 7fac7ffff700 1 -- 172.21.15.33:0/1205667845 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fac88054fc0 con 0x7fac980f66e0 2022-02-02T14:37:48.988 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:37:48.988 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:37:48.989 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:37:48.989 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:37:48.989 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:48.989 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:37:48.990 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:37:48.990 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:37:48.990 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:37:48.990 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:37:48.990 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:37:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:37:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:37:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:37:48.991 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:37:48.992 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:37:48.992 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:37:48.992 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:37:48.992 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:37:48.992 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:37:48.993 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:37:48.993 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:37:48.993 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:37:48.993 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:37:48.994 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:37:48.994 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:37:48.994 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:37:48.994 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:37:48.995 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:37:48.995 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:37:48.995 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:37:48.995 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:48.995 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:48.996 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:37:48.996 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:37:48.996 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:48.996 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:48.997 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:48.997 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:37:48.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 msgr2=0x7fac800672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 0x7fac800672e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7fac98060060 tx=0x7fac8c009040).stop 2022-02-02T14:37:48.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 msgr2=0x7fac9810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:37:48.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fac88009990 tx=0x7fac88009b30).stop 2022-02-02T14:37:48.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 shutdown_connections 2022-02-02T14:37:49.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fac80064e20 0x7fac800672e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:49.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac980f5440 0x7fac98109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:49.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 --2- 172.21.15.33:0/1205667845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac980f66e0 0x7fac9810bf90 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:37:49.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 >> 172.21.15.33:0/1205667845 conn(0x7fac980f0ba0 msgr2=0x7fac980fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:37:49.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 shutdown_connections 2022-02-02T14:37:49.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:37:48.990+0000 7fac9c835700 1 -- 172.21.15.33:0/1205667845 wait complete. 2022-02-02T14:37:49.001 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:37:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:49 smithi033 ceph-mon[101165]: from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:49 smithi033 ceph-mon[101165]: from='client.35898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:49.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2497373616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:37:49.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1205667845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:37:49.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:49 smithi037 ceph-mon[69017]: from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:49.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:49 smithi037 ceph-mon[69017]: from='client.35898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:37:49.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2497373616' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:37:49.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1205667845' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:37:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:50 smithi033 ceph-mon[101165]: pgmap v1773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:50 smithi037 ceph-mon[69017]: pgmap v1773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:52 smithi033 ceph-mon[101165]: pgmap v1774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:52 smithi037 ceph-mon[69017]: pgmap v1774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:54 smithi033 ceph-mon[101165]: pgmap v1775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:54 smithi037 ceph-mon[69017]: pgmap v1775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:37:55.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:37:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:37:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:37:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:56 smithi033 ceph-mon[101165]: pgmap v1776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:56 smithi037 ceph-mon[69017]: pgmap v1776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:58.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:37:58 smithi033 ceph-mon[101165]: pgmap v1777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:37:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:37:58 smithi037 ceph-mon[69017]: pgmap v1777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:00.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:00 smithi033 ceph-mon[101165]: pgmap v1778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:00 smithi037 ceph-mon[69017]: pgmap v1778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:02 smithi033 ceph-mon[101165]: pgmap v1779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:02 smithi037 ceph-mon[69017]: pgmap v1779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:04 smithi033 ceph-mon[101165]: pgmap v1780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:04 smithi037 ceph-mon[69017]: pgmap v1780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:06 smithi033 ceph-mon[101165]: pgmap v1781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:06 smithi037 ceph-mon[69017]: pgmap v1781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:08 smithi033 ceph-mon[101165]: pgmap v1782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:08 smithi037 ceph-mon[69017]: pgmap v1782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:10 smithi033 ceph-mon[101165]: pgmap v1783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:10 smithi037 ceph-mon[69017]: pgmap v1783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:12 smithi033 ceph-mon[101165]: pgmap v1784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:12 smithi037 ceph-mon[69017]: pgmap v1784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:14 smithi033 ceph-mon[101165]: pgmap v1785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:14 smithi037 ceph-mon[69017]: pgmap v1785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:16 smithi033 ceph-mon[101165]: pgmap v1786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:16 smithi037 ceph-mon[69017]: pgmap v1786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:18 smithi033 ceph-mon[101165]: pgmap v1787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:18 smithi037 ceph-mon[69017]: pgmap v1787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:19.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.105+0000 7f4727c1d700 1 -- 172.21.15.33:0/1077740135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 msgr2=0x7f47200f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.105+0000 7f4727c1d700 1 --2- 172.21.15.33:0/1077740135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f47200f6b00 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7f471c004660 tx=0x7f471c009b30).stop 2022-02-02T14:38:19.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 -- 172.21.15.33:0/1077740135 shutdown_connections 2022-02-02T14:38:19.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 --2- 172.21.15.33:0/1077740135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f47200f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 --2- 172.21.15.33:0/1077740135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f47200f6b00 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 -- 172.21.15.33:0/1077740135 >> 172.21.15.33:0/1077740135 conn(0x7f47200f1e40 msgr2=0x7f47200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 -- 172.21.15.33:0/1077740135 shutdown_connections 2022-02-02T14:38:19.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.106+0000 7f4727c1d700 1 -- 172.21.15.33:0/1077740135 wait complete. 2022-02-02T14:38:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 Processor -- start 2022-02-02T14:38:19.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 -- start start 2022-02-02T14:38:19.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f4720069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472006a380 con 0x7f47200f66e0 2022-02-02T14:38:19.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f4727c1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472006a4c0 con 0x7f47200f7980 2022-02-02T14:38:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f47259b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f47259b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33798/0 (socket says 172.21.15.33:33798) 2022-02-02T14:38:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f47259b9700 1 -- 172.21.15.33:0/3088044907 learned_addr learned my addr 172.21.15.33:0/3088044907 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:19.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.107+0000 7f47251b8700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f4720069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47259b9700 1 -- 172.21.15.33:0/3088044907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 msgr2=0x7f4720069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47259b9700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f4720069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47259b9700 1 -- 172.21.15.33:0/3088044907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471c005040 con 0x7f47200f66e0 2022-02-02T14:38:19.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47251b8700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f4720069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:38:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47259b9700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f471c013a70 tx=0x7f471c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471c018070 con 0x7f47200f66e0 2022-02-02T14:38:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f471c0097d0 con 0x7f47200f66e0 2022-02-02T14:38:19.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472006a740 con 0x7f47200f66e0 2022-02-02T14:38:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f471c01c3c0 con 0x7f47200f66e0 2022-02-02T14:38:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.108+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472006aca0 con 0x7f47200f66e0 2022-02-02T14:38:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.109+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4720045ad0 con 0x7f47200f66e0 2022-02-02T14:38:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.110+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f471c007ba0 con 0x7f47200f66e0 2022-02-02T14:38:19.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.110+0000 7f47127fc700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.110+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f471c083780 con 0x7f47200f66e0 2022-02-02T14:38:19.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.110+0000 7f47251b8700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.111+0000 7f47251b8700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 0x7f470c067290 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4714004bb0 tx=0x7f471400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.114+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f471c0518f0 con 0x7f47200f66e0 2022-02-02T14:38:19.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.302+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47200ff070 con 0x7f470c064dd0 2022-02-02T14:38:19.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.303+0000 7f47127fc700 1 -- 172.21.15.33:0/3088044907 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f471400f040 con 0x7f470c064dd0 2022-02-02T14:38:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 msgr2=0x7f470c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 0x7f470c067290 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4714004bb0 tx=0x7f471400b040).stop 2022-02-02T14:38:19.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 msgr2=0x7f472006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f471c013a70 tx=0x7f471c009b30).stop 2022-02-02T14:38:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 shutdown_connections 2022-02-02T14:38:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f470c064dd0 0x7f470c067290 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47200f66e0 0x7f472006b9a0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 --2- 172.21.15.33:0/3088044907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47200f7980 0x7f4720069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 >> 172.21.15.33:0/3088044907 conn(0x7f47200f1e40 msgr2=0x7f47200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 shutdown_connections 2022-02-02T14:38:19.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.305+0000 7f4727c1d700 1 -- 172.21.15.33:0/3088044907 wait complete. 2022-02-02T14:38:19.314 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:38:19.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 -- 172.21.15.33:0/594780404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f6860 msgr2=0x7f2b000f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/594780404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f6860 0x7f2b000f6cc0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f2af4004660 tx=0x7f2af4009b30).stop 2022-02-02T14:38:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 -- 172.21.15.33:0/594780404 shutdown_connections 2022-02-02T14:38:19.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/594780404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f6860 0x7f2b000f6cc0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/594780404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f55c0 0x7f2b000f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 -- 172.21.15.33:0/594780404 >> 172.21.15.33:0/594780404 conn(0x7f2b000f0d40 msgr2=0x7f2b000f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 -- 172.21.15.33:0/594780404 shutdown_connections 2022-02-02T14:38:19.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.405+0000 7f2b05b9c700 1 -- 172.21.15.33:0/594780404 wait complete. 2022-02-02T14:38:19.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.406+0000 7f2b05b9c700 1 Processor -- start 2022-02-02T14:38:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.406+0000 7f2b05b9c700 1 -- start start 2022-02-02T14:38:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.406+0000 7f2b05b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.406+0000 7f2b05b9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 0x7f2b0010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2b05b9c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000602d0 con 0x7f2b000f55c0 2022-02-02T14:38:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2b05b9c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00060410 con 0x7f2b000f6860 2022-02-02T14:38:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33808/0 (socket says 172.21.15.33:33808) 2022-02-02T14:38:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 -- 172.21.15.33:0/1096236231 learned_addr learned my addr 172.21.15.33:0/1096236231 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2afeffd700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 0x7f2b0010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 -- 172.21.15.33:0/1096236231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 msgr2=0x7f2b0010e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 0x7f2b0010e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 -- 172.21.15.33:0/1096236231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af4005040 con 0x7f2b000f55c0 2022-02-02T14:38:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2afeffd700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 0x7f2b0010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:38:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2aff7fe700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f2af000e7c0 tx=0x7f2af000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af00092e0 con 0x7f2b000f55c0 2022-02-02T14:38:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x7f2b000f55c0 2022-02-02T14:38:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2af0014750 con 0x7f2b000f55c0 2022-02-02T14:38:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.407+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0010e9b0 con 0x7f2b000f55c0 2022-02-02T14:38:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.408+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0010ee30 con 0x7f2b000f55c0 2022-02-02T14:38:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.409+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b00045ad0 con 0x7f2b000f55c0 2022-02-02T14:38:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.409+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2af001b030 con 0x7f2b000f55c0 2022-02-02T14:38:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.410+0000 7f2ae7fff700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 0x7f2ae8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.410+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2af0081a10 con 0x7f2b000f55c0 2022-02-02T14:38:19.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.410+0000 7f2afeffd700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 0x7f2ae8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.410+0000 7f2afeffd700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 0x7f2ae8067290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f2af40043d0 tx=0x7f2af400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.414+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2af004fa60 con 0x7f2b000f55c0 2022-02-02T14:38:19.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.594+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b00057f10 con 0x7f2ae8064dd0 2022-02-02T14:38:19.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.609+0000 7f2ae7fff700 1 -- 172.21.15.33:0/1096236231 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f2b00057f10 con 0x7f2ae8064dd0 2022-02-02T14:38:19.608 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:38:19.609 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (63m) 25m ago 64m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:38:19.609 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (56m) 25m ago 64m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:38:19.609 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (56m) 25m ago 64m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:38:19.609 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (63m) 25m ago 64m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:38:19.610 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (57m) 25m ago 60m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:38:19.610 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (57m) 25m ago 60m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:38:19.610 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (58m) 25m ago 60m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:38:19.610 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (60m) 25m ago 60m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:38:19.611 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (58m) 25m ago 65m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:38:19.611 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (57m) 25m ago 64m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:38:19.611 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (57m) 25m ago 66m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:38:19.611 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (57m) 25m ago 63m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:38:19.612 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (64m) 25m ago 64m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:38:19.612 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (63m) 25m ago 63m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:38:19.612 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 25m ago 63m - 4096M 2022-02-02T14:38:19.612 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (63m) 25m ago 63m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:38:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (62m) 25m ago 62m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:38:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (62m) 25m ago 62m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:38:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (62m) 25m ago 62m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:38:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (61m) 25m ago 61m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:38:19.613 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (63m) 25m ago 64m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:38:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.610+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 msgr2=0x7f2ae8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.610+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 0x7f2ae8067290 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f2af40043d0 tx=0x7f2af400b040).stop 2022-02-02T14:38:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.610+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 msgr2=0x7f2b0010bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.610+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f2af000e7c0 tx=0x7f2af000b040).stop 2022-02-02T14:38:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.610+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 shutdown_connections 2022-02-02T14:38:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ae8064dd0 0x7f2ae8067290 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b000f55c0 0x7f2b0010bfc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 --2- 172.21.15.33:0/1096236231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b000f6860 0x7f2b0010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 >> 172.21.15.33:0/1096236231 conn(0x7f2b000f0d40 msgr2=0x7f2b000fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 shutdown_connections 2022-02-02T14:38:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.611+0000 7f2b05b9c700 1 -- 172.21.15.33:0/1096236231 wait complete. 2022-02-02T14:38:19.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4191706241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 msgr2=0x7f57e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4191706241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e40f59e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f57cc004660 tx=0x7f57cc009b30).stop 2022-02-02T14:38:19.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4191706241 shutdown_connections 2022-02-02T14:38:19.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4191706241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 0x7f57e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4191706241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e40f59e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4191706241 >> 172.21.15.33:0/4191706241 conn(0x7f57e40f0d40 msgr2=0x7f57e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4191706241 shutdown_connections 2022-02-02T14:38:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.711+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4191706241 wait complete. 2022-02-02T14:38:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 Processor -- start 2022-02-02T14:38:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 -- start start 2022-02-02T14:38:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 0x7f57e410c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e40603e0 con 0x7f57e40f55c0 2022-02-02T14:38:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e9ecb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4060520 con 0x7f57e40f6860 2022-02-02T14:38:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33818/0 (socket says 172.21.15.33:33818) 2022-02-02T14:38:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.712+0000 7f57e37fe700 1 -- 172.21.15.33:0/4144320167 learned_addr learned my addr 172.21.15.33:0/4144320167 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e2ffd700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 0x7f57e410c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e37fe700 1 -- 172.21.15.33:0/4144320167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 msgr2=0x7f57e410c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e37fe700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 0x7f57e410c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e37fe700 1 -- 172.21.15.33:0/4144320167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc005040 con 0x7f57e40f55c0 2022-02-02T14:38:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e37fe700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f57cc014040 tx=0x7f57cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc019070 con 0x7f57e40f55c0 2022-02-02T14:38:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e410c640 con 0x7f57e40f55c0 2022-02-02T14:38:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f57cc007e70 con 0x7f57e40f55c0 2022-02-02T14:38:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57cc014d10 con 0x7f57e40f55c0 2022-02-02T14:38:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.713+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e410cba0 con 0x7f57e40f55c0 2022-02-02T14:38:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.715+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4045ad0 con 0x7f57e40f55c0 2022-02-02T14:38:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.715+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f57cc025070 con 0x7f57e40f55c0 2022-02-02T14:38:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.715+0000 7f57dbfff700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 0x7f57d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.715+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f57cc082a80 con 0x7f57e40f55c0 2022-02-02T14:38:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.715+0000 7f57e2ffd700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 0x7f57d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.716+0000 7f57e2ffd700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 0x7f57d0067290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f57d4009fd0 tx=0x7f57d400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:19.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.720+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f57cc050b30 con 0x7f57e40f55c0 2022-02-02T14:38:19.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.965+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f57e40fde50 con 0x7f57e40f55c0 2022-02-02T14:38:19.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.965+0000 7f57dbfff700 1 -- 172.21.15.33:0/4144320167 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f57cc023070 con 0x7f57e40f55c0 2022-02-02T14:38:19.965 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:38:19.966 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:38:19.966 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:38:19.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:19.966 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:38:19.967 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:38:19.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:19.967 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:38:19.967 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:38:19.967 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:19.968 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:38:19.968 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:38:19.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:19.968 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:38:19.969 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:38:19.969 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:38:19.969 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:38:19.969 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:38:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 msgr2=0x7f57d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 0x7f57d0067290 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f57d4009fd0 tx=0x7f57d400b040).stop 2022-02-02T14:38:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 msgr2=0x7f57e4109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f57cc014040 tx=0x7f57cc00b040).stop 2022-02-02T14:38:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 shutdown_connections 2022-02-02T14:38:19.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064dd0 0x7f57d0067290 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f55c0 0x7f57e4109bf0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 --2- 172.21.15.33:0/4144320167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6860 0x7f57e410c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.967+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 >> 172.21.15.33:0/4144320167 conn(0x7f57e40f0d40 msgr2=0x7f57e40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.968+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 shutdown_connections 2022-02-02T14:38:19.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:19.968+0000 7f57e9ecb700 1 -- 172.21.15.33:0/4144320167 wait complete. 2022-02-02T14:38:20.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 -- 172.21.15.33:0/824767185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 msgr2=0x7f75c40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:20.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 --2- 172.21.15.33:0/824767185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c40f7de0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f75b8004660 tx=0x7f75b8009b30).stop 2022-02-02T14:38:20.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 -- 172.21.15.33:0/824767185 shutdown_connections 2022-02-02T14:38:20.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 --2- 172.21.15.33:0/824767185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c40f7de0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 --2- 172.21.15.33:0/824767185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 0x7f75c40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.068+0000 7f75c9854700 1 -- 172.21.15.33:0/824767185 >> 172.21.15.33:0/824767185 conn(0x7f75c40f1e40 msgr2=0x7f75c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:20.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.069+0000 7f75c9854700 1 -- 172.21.15.33:0/824767185 shutdown_connections 2022-02-02T14:38:20.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.069+0000 7f75c9854700 1 -- 172.21.15.33:0/824767185 wait complete. 2022-02-02T14:38:20.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.069+0000 7f75c9854700 1 Processor -- start 2022-02-02T14:38:20.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.069+0000 7f75c9854700 1 -- start start 2022-02-02T14:38:20.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c9854700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:20.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c9854700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:20.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c9854700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c406a380 con 0x7f75c40f7980 2022-02-02T14:38:20.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c9854700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c406a4c0 con 0x7f75c40f66e0 2022-02-02T14:38:20.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:20.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33830/0 (socket says 172.21.15.33:33830) 2022-02-02T14:38:20.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 -- 172.21.15.33:0/1626434705 learned_addr learned my addr 172.21.15.33:0/1626434705 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:20.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c2ffd700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:20.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 -- 172.21.15.33:0/1626434705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 msgr2=0x7f75c406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:20.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 -- 172.21.15.33:0/1626434705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b8005040 con 0x7f75c40f7980 2022-02-02T14:38:20.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75c27fc700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f75b8000c00 tx=0x7f75b800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:20.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.070+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b8019070 con 0x7f75c40f7980 2022-02-02T14:38:20.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.071+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75b8007e70 con 0x7f75c40f7980 2022-02-02T14:38:20.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.071+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c406a740 con 0x7f75c40f7980 2022-02-02T14:38:20.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.071+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75b8014ce0 con 0x7f75c40f7980 2022-02-02T14:38:20.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.071+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c406aca0 con 0x7f75c40f7980 2022-02-02T14:38:20.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.072+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c4045ad0 con 0x7f75c40f7980 2022-02-02T14:38:20.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.072+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f75b8025070 con 0x7f75c40f7980 2022-02-02T14:38:20.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.072+0000 7f75ab7fe700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 0x7f75ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:20.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.073+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f75b80829f0 con 0x7f75c40f7980 2022-02-02T14:38:20.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.073+0000 7f75c2ffd700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 0x7f75ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:20.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.073+0000 7f75c2ffd700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 0x7f75ac067290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f75c406b730 tx=0x7f75b400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:20.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.077+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f75b8084e60 con 0x7f75c40f7980 2022-02-02T14:38:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.291+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f75c4027a00 con 0x7f75c40f7980 2022-02-02T14:38:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.292+0000 7f75ab7fe700 1 -- 172.21.15.33:0/1626434705 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f75b8023020 con 0x7f75c40f7980 2022-02-02T14:38:20.292 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:38:20.292 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:38:20.292 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:38:20.292 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:38:20.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:20.293 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:38:20.293 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:38:20.293 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:38:20.294 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:38:20.294 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:38:20.294 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:38:20.294 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:38:20.295 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:38:20.295 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:38:20.295 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:38:20.295 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:38:20.295 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:20.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.293+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 msgr2=0x7f75ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:20.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.293+0000 7f75c9854700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 0x7f75ac067290 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f75c406b730 tx=0x7f75b400b040).stop 2022-02-02T14:38:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.293+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 msgr2=0x7f75c4069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.293+0000 7f75c9854700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f75b8000c00 tx=0x7f75b800b040).stop 2022-02-02T14:38:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 shutdown_connections 2022-02-02T14:38:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75ac064dd0 0x7f75ac067290 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75c40f66e0 0x7f75c406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 --2- 172.21.15.33:0/1626434705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c40f7980 0x7f75c4069e20 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:20.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 >> 172.21.15.33:0/1626434705 conn(0x7f75c40f1e40 msgr2=0x7f75c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:20.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 shutdown_connections 2022-02-02T14:38:20.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:20.294+0000 7f75c9854700 1 -- 172.21.15.33:0/1626434705 wait complete. 2022-02-02T14:38:20.304 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:38:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:20 smithi033 ceph-mon[101165]: pgmap v1788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:20 smithi033 ceph-mon[101165]: from='client.35910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4144320167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:38:20.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1626434705' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:38:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:20 smithi037 ceph-mon[69017]: pgmap v1788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:20 smithi037 ceph-mon[69017]: from='client.35910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4144320167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:38:20.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1626434705' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:38:21.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:21 smithi033 ceph-mon[101165]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:21.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:21 smithi037 ceph-mon[69017]: from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:22.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:22 smithi033 ceph-mon[101165]: pgmap v1789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:22 smithi037 ceph-mon[69017]: pgmap v1789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:24 smithi033 ceph-mon[101165]: pgmap v1790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:24 smithi037 ceph-mon[69017]: pgmap v1790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:26 smithi033 ceph-mon[101165]: pgmap v1791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:26 smithi037 ceph-mon[69017]: pgmap v1791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:28 smithi033 ceph-mon[101165]: pgmap v1792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:28 smithi037 ceph-mon[69017]: pgmap v1792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:30.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:30 smithi033 ceph-mon[101165]: pgmap v1793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:30 smithi037 ceph-mon[69017]: pgmap v1793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:32 smithi033 ceph-mon[101165]: pgmap v1794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:32 smithi037 ceph-mon[69017]: pgmap v1794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:34 smithi033 ceph-mon[101165]: pgmap v1795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:34 smithi037 ceph-mon[69017]: pgmap v1795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:36.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:36 smithi033 ceph-mon[101165]: pgmap v1796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:36 smithi037 ceph-mon[69017]: pgmap v1796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:38 smithi033 ceph-mon[101165]: pgmap v1797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:38 smithi037 ceph-mon[69017]: pgmap v1797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:40 smithi033 ceph-mon[101165]: pgmap v1798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:40 smithi037 ceph-mon[69017]: pgmap v1798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:42 smithi033 ceph-mon[101165]: pgmap v1799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:42 smithi037 ceph-mon[69017]: pgmap v1799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:44 smithi033 ceph-mon[101165]: pgmap v1800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:44 smithi037 ceph-mon[69017]: pgmap v1800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:46 smithi033 ceph-mon[101165]: pgmap v1801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:46 smithi037 ceph-mon[69017]: pgmap v1801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:47 smithi037 ceph-mon[69017]: pgmap v1802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:47.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:47 smithi033 ceph-mon[101165]: pgmap v1802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 -- 172.21.15.33:0/2411047192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 msgr2=0x7f30240f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 --2- 172.21.15.33:0/2411047192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f6cc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f3010004660 tx=0x7f3010009b30).stop 2022-02-02T14:38:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 -- 172.21.15.33:0/2411047192 shutdown_connections 2022-02-02T14:38:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 --2- 172.21.15.33:0/2411047192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f6cc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 --2- 172.21.15.33:0/2411047192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 0x7f30240f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 -- 172.21.15.33:0/2411047192 >> 172.21.15.33:0/2411047192 conn(0x7f30240f0d40 msgr2=0x7f30240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:50.409 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:50 smithi033 ceph-mon[101165]: pgmap v1803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 -- 172.21.15.33:0/2411047192 shutdown_connections 2022-02-02T14:38:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.408+0000 7f302aee0700 1 -- 172.21.15.33:0/2411047192 wait complete. 2022-02-02T14:38:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 Processor -- start 2022-02-02T14:38:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 -- start start 2022-02-02T14:38:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 0x7f30240f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240f8100 con 0x7f30240f6860 2022-02-02T14:38:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.409+0000 7f302aee0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30240f8240 con 0x7f30240f55c0 2022-02-02T14:38:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33840/0 (socket says 172.21.15.33:33840) 2022-02-02T14:38:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 -- 172.21.15.33:0/3779819531 learned_addr learned my addr 172.21.15.33:0/3779819531 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3028c7c700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 0x7f30240f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 -- 172.21.15.33:0/3779819531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 msgr2=0x7f30240f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 0x7f30240f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 -- 172.21.15.33:0/3779819531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010005040 con 0x7f30240f6860 2022-02-02T14:38:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f3023fff700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3010002040 tx=0x7f301000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:50.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3010019070 con 0x7f30240f6860 2022-02-02T14:38:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30240f84c0 con 0x7f30240f6860 2022-02-02T14:38:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3010007e70 con 0x7f30240f6860 2022-02-02T14:38:50.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3010014db0 con 0x7f30240f6860 2022-02-02T14:38:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.410+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30240f8a20 con 0x7f30240f6860 2022-02-02T14:38:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.411+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3024045ad0 con 0x7f30240f6860 2022-02-02T14:38:50.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.412+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3010025070 con 0x7f30240f6860 2022-02-02T14:38:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.412+0000 7f30217fa700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 0x7f3014067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.412+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3010082a40 con 0x7f30240f6860 2022-02-02T14:38:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.412+0000 7f3028c7c700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 0x7f3014067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.413+0000 7f3028c7c700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 0x7f3014067210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f30240f94b0 tx=0x7f301800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:50.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.417+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3010050a90 con 0x7f30240f6860 2022-02-02T14:38:50.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:50 smithi037 ceph-mon[69017]: pgmap v1803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:50.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.607+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30240faca0 con 0x7f3014064d50 2022-02-02T14:38:50.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.608+0000 7f30217fa700 1 -- 172.21.15.33:0/3779819531 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f30240faca0 con 0x7f3014064d50 2022-02-02T14:38:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 msgr2=0x7f3014067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 0x7f3014067210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f30240f94b0 tx=0x7f301800b040).stop 2022-02-02T14:38:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 msgr2=0x7f30240f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3010002040 tx=0x7f301000b040).stop 2022-02-02T14:38:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 shutdown_connections 2022-02-02T14:38:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3014064d50 0x7f3014067210 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30240f55c0 0x7f30240f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 --2- 172.21.15.33:0/3779819531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30240f6860 0x7f30240f7ba0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 >> 172.21.15.33:0/3779819531 conn(0x7f30240f0d40 msgr2=0x7f302405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 shutdown_connections 2022-02-02T14:38:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.610+0000 7f302aee0700 1 -- 172.21.15.33:0/3779819531 wait complete. 2022-02-02T14:38:50.620 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:38:50.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 -- 172.21.15.33:0/1828837951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 msgr2=0x7fa1400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 --2- 172.21.15.33:0/1828837951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa1400f6cc0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7fa134004660 tx=0x7fa134009b30).stop 2022-02-02T14:38:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 -- 172.21.15.33:0/1828837951 shutdown_connections 2022-02-02T14:38:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 --2- 172.21.15.33:0/1828837951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa1400f6cc0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 --2- 172.21.15.33:0/1828837951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 0x7fa1400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 -- 172.21.15.33:0/1828837951 >> 172.21.15.33:0/1828837951 conn(0x7fa1400f0d40 msgr2=0x7fa1400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 -- 172.21.15.33:0/1828837951 shutdown_connections 2022-02-02T14:38:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.712+0000 7fa148797700 1 -- 172.21.15.33:0/1828837951 wait complete. 2022-02-02T14:38:50.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 Processor -- start 2022-02-02T14:38:50.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 -- start start 2022-02-02T14:38:50.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 0x7fa140109110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140109bb0 con 0x7fa1400f6860 2022-02-02T14:38:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.713+0000 7fa148797700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140109cf0 con 0x7fa1400f55c0 2022-02-02T14:38:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33850/0 (socket says 172.21.15.33:33850) 2022-02-02T14:38:50.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 -- 172.21.15.33:0/3547226737 learned_addr learned my addr 172.21.15.33:0/3547226737 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:50.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa146533700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 0x7fa140109110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 -- 172.21.15.33:0/3547226737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 msgr2=0x7fa140109110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 0x7fa140109110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 -- 172.21.15.33:0/3547226737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa134005040 con 0x7fa1400f6860 2022-02-02T14:38:50.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa145d32700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fa134000c00 tx=0x7fa13400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:50.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa134019070 con 0x7fa1400f6860 2022-02-02T14:38:50.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa134007e70 con 0x7fa1400f6860 2022-02-02T14:38:50.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa134014ce0 con 0x7fa1400f6860 2022-02-02T14:38:50.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14010a630 con 0x7fa1400f6860 2022-02-02T14:38:50.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.714+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14010ab90 con 0x7fa1400f6860 2022-02-02T14:38:50.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.715+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa140045ad0 con 0x7fa1400f6860 2022-02-02T14:38:50.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.716+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa134025070 con 0x7fa1400f6860 2022-02-02T14:38:50.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.716+0000 7fa132ffd700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 0x7fa12c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:50.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.717+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa134082960 con 0x7fa1400f6860 2022-02-02T14:38:50.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.717+0000 7fa146533700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 0x7fa12c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:50.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.717+0000 7fa146533700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 0x7fa12c067290 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa13c009fd0 tx=0x7fa13c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:50.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.721+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa134054440 con 0x7fa1400f6860 2022-02-02T14:38:50.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.901+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1400faaa0 con 0x7fa12c064dd0 2022-02-02T14:38:50.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.916+0000 7fa132ffd700 1 -- 172.21.15.33:0/3547226737 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa1400faaa0 con 0x7fa12c064dd0 2022-02-02T14:38:50.916 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:38:50.917 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (64m) 26m ago 65m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:38:50.917 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (57m) 26m ago 65m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:38:50.918 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (57m) 26m ago 64m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:38:50.919 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (63m) 26m ago 64m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:38:50.919 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (57m) 26m ago 61m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:38:50.920 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (58m) 26m ago 61m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:38:50.920 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (59m) 26m ago 61m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:38:50.921 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (61m) 26m ago 61m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:38:50.921 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (58m) 26m ago 66m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:38:50.921 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (58m) 26m ago 64m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:38:50.922 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (58m) 26m ago 66m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:38:50.922 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (57m) 26m ago 64m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:38:50.923 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (64m) 26m ago 64m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:38:50.923 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (64m) 26m ago 64m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:38:50.923 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 26m ago 63m - 4096M 2022-02-02T14:38:50.924 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (63m) 26m ago 63m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:38:50.924 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (63m) 26m ago 63m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:38:50.924 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (63m) 26m ago 63m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:38:50.925 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (62m) 26m ago 62m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:38:50.925 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (62m) 26m ago 62m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:38:50.925 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (63m) 26m ago 64m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:38:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 msgr2=0x7fa12c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 0x7fa12c067290 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7fa13c009fd0 tx=0x7fa13c00b040).stop 2022-02-02T14:38:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 msgr2=0x7fa140109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fa134000c00 tx=0x7fa13400b040).stop 2022-02-02T14:38:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 shutdown_connections 2022-02-02T14:38:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa12c064dd0 0x7fa12c067290 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1400f55c0 0x7fa140109110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 --2- 172.21.15.33:0/3547226737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1400f6860 0x7fa140109600 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 >> 172.21.15.33:0/3547226737 conn(0x7fa1400f0d40 msgr2=0x7fa14005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 shutdown_connections 2022-02-02T14:38:50.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:50.918+0000 7fa148797700 1 -- 172.21.15.33:0/3547226737 wait complete. 2022-02-02T14:38:51.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 -- 172.21.15.33:0/2210052499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 msgr2=0x7f26380f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 --2- 172.21.15.33:0/2210052499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f26380f7de0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f2624004660 tx=0x7f2624009b30).stop 2022-02-02T14:38:51.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 -- 172.21.15.33:0/2210052499 shutdown_connections 2022-02-02T14:38:51.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 --2- 172.21.15.33:0/2210052499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f26380f7de0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 --2- 172.21.15.33:0/2210052499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 0x7f26380f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 -- 172.21.15.33:0/2210052499 >> 172.21.15.33:0/2210052499 conn(0x7f26380f1e40 msgr2=0x7f26380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:51.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 -- 172.21.15.33:0/2210052499 shutdown_connections 2022-02-02T14:38:51.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.018+0000 7f263ec28700 1 -- 172.21.15.33:0/2210052499 wait complete. 2022-02-02T14:38:51.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 Processor -- start 2022-02-02T14:38:51.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 -- start start 2022-02-02T14:38:51.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 0x7f263806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263806a380 con 0x7f26380f7980 2022-02-02T14:38:51.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263ec28700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263806a4c0 con 0x7f26380f66e0 2022-02-02T14:38:51.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33860/0 (socket says 172.21.15.33:33860) 2022-02-02T14:38:51.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 -- 172.21.15.33:0/2926067599 learned_addr learned my addr 172.21.15.33:0/2926067599 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:51.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f263c9c4700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 0x7f263806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 -- 172.21.15.33:0/2926067599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 msgr2=0x7f263806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 0x7f263806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.019+0000 7f2637fff700 1 -- 172.21.15.33:0/2926067599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2624005040 con 0x7f26380f7980 2022-02-02T14:38:51.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f2637fff700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f2624000c00 tx=0x7f262400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:51.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2624019070 con 0x7f26380f7980 2022-02-02T14:38:51.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263806a740 con 0x7f26380f7980 2022-02-02T14:38:51.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2624007e70 con 0x7f26380f7980 2022-02-02T14:38:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263806aca0 con 0x7f26380f7980 2022-02-02T14:38:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.020+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2624014ce0 con 0x7f26380f7980 2022-02-02T14:38:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.021+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2638045ad0 con 0x7f26380f7980 2022-02-02T14:38:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.022+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2624025070 con 0x7f26380f7980 2022-02-02T14:38:51.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.022+0000 7f26357fa700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 0x7f2628067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.022+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2624082a40 con 0x7f26380f7980 2022-02-02T14:38:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.022+0000 7f263c9c4700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 0x7f2628067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.022+0000 7f263c9c4700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 0x7f2628067290 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f263806b730 tx=0x7f262c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:51.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.026+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2624050af0 con 0x7f26380f7980 2022-02-02T14:38:51.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.273+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26380fef40 con 0x7f26380f7980 2022-02-02T14:38:51.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.274+0000 7f26357fa700 1 -- 172.21.15.33:0/2926067599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2624023070 con 0x7f26380f7980 2022-02-02T14:38:51.274 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:38:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:38:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:38:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:38:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:38:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:38:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:38:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:38:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:38:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:38:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:38:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:38:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:38:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:38:51.280 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:38:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.276+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 msgr2=0x7f2628067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.276+0000 7f263ec28700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 0x7f2628067290 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f263806b730 tx=0x7f262c00b040).stop 2022-02-02T14:38:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 msgr2=0x7f2638069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f2624000c00 tx=0x7f262400b040).stop 2022-02-02T14:38:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 shutdown_connections 2022-02-02T14:38:51.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2628064dd0 0x7f2628067290 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26380f66e0 0x7f263806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 --2- 172.21.15.33:0/2926067599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26380f7980 0x7f2638069e20 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 >> 172.21.15.33:0/2926067599 conn(0x7f26380f1e40 msgr2=0x7f26380fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:51.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 shutdown_connections 2022-02-02T14:38:51.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.277+0000 7f263ec28700 1 -- 172.21.15.33:0/2926067599 wait complete. 2022-02-02T14:38:51.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 -- 172.21.15.33:0/2949683001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f6530 msgr2=0x7f57e40f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 --2- 172.21.15.33:0/2949683001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f6530 0x7f57e40f6950 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f57e0004660 tx=0x7f57e0009b30).stop 2022-02-02T14:38:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 -- 172.21.15.33:0/2949683001 shutdown_connections 2022-02-02T14:38:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 --2- 172.21.15.33:0/2949683001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f77d0 0x7f57e40f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 --2- 172.21.15.33:0/2949683001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f6530 0x7f57e40f6950 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 -- 172.21.15.33:0/2949683001 >> 172.21.15.33:0/2949683001 conn(0x7f57e40f1c90 msgr2=0x7f57e40f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 -- 172.21.15.33:0/2949683001 shutdown_connections 2022-02-02T14:38:51.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.378+0000 7f57eab09700 1 -- 172.21.15.33:0/2949683001 wait complete. 2022-02-02T14:38:51.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 Processor -- start 2022-02-02T14:38:51.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 -- start start 2022-02-02T14:38:51.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6530 0x7f57e4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4107880 con 0x7f57e40f77d0 2022-02-02T14:38:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57eab09700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e4108090 con 0x7f57e40f6530 2022-02-02T14:38:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33870/0 (socket says 172.21.15.33:33870) 2022-02-02T14:38:51.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 -- 172.21.15.33:0/2312843220 learned_addr learned my addr 172.21.15.33:0/2312843220 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:38:51.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9b07700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6530 0x7f57e4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 -- 172.21.15.33:0/2312843220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6530 msgr2=0x7f57e4106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6530 0x7f57e4106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.379+0000 7f57e9306700 1 -- 172.21.15.33:0/2312843220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e0005040 con 0x7f57e40f77d0 2022-02-02T14:38:51.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57e9306700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f57d400e7f0 tx=0x7f57d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:51.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d40092e0 con 0x7f57e40f77d0 2022-02-02T14:38:51.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f57d400f040 con 0x7f57e40f77d0 2022-02-02T14:38:51.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e4108310 con 0x7f57e40f77d0 2022-02-02T14:38:51.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57d4014750 con 0x7f57e40f77d0 2022-02-02T14:38:51.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.380+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e41088d0 con 0x7f57e40f77d0 2022-02-02T14:38:51.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.381+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e4059100 con 0x7f57e40f77d0 2022-02-02T14:38:51.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.381+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f57d401b030 con 0x7f57e40f77d0 2022-02-02T14:38:51.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.382+0000 7f57da7fc700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 0x7f57d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:38:51.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.382+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f57d4081780 con 0x7f57e40f77d0 2022-02-02T14:38:51.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.382+0000 7f57e9b07700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 0x7f57d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:38:51.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.382+0000 7f57e9b07700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 0x7f57d00672e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f57e0000c00 tx=0x7f57e0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:38:51.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.386+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f57d404f8e0 con 0x7f57e40f77d0 2022-02-02T14:38:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.598+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f57e40fee80 con 0x7f57e40f77d0 2022-02-02T14:38:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.598+0000 7f57da7fc700 1 -- 172.21.15.33:0/2312843220 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f57d4019750 con 0x7f57e40f77d0 2022-02-02T14:38:51.598 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:38:51.599 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:38:51.599 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:38:51.599 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:38:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:51.600 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:38:51.600 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:38:51.601 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:38:51.601 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:38:51.601 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:38:51.601 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:38:51.602 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:38:51.602 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:38:51.605 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:38:51.605 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:38:51.605 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:38:51.606 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:38:51.606 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:38:51.606 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:38:51.606 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:38:51.607 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:38:51.607 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:38:51.607 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:38:51.607 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:38:51.607 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:38:51.608 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:38:51.608 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:38:51.608 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:38:51.608 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:38:51.608 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:38:51.609 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:38:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:51.609 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:38:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:38:51.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:51.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:51.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:51.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:38:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 msgr2=0x7f57d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 0x7f57d00672e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f57e0000c00 tx=0x7f57e0016040).stop 2022-02-02T14:38:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 msgr2=0x7f57e4107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:38:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f57d400e7f0 tx=0x7f57d400b040).stop 2022-02-02T14:38:51.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 shutdown_connections 2022-02-02T14:38:51.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57d0064e20 0x7f57d00672e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57e40f6530 0x7f57e4106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 --2- 172.21.15.33:0/2312843220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57e40f77d0 0x7f57e4107280 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:38:51.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 >> 172.21.15.33:0/2312843220 conn(0x7f57e40f1c90 msgr2=0x7f57e40fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:38:51.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 shutdown_connections 2022-02-02T14:38:51.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:38:51.600+0000 7f57eab09700 1 -- 172.21.15.33:0/2312843220 wait complete. 2022-02-02T14:38:51.615 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:38:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:52 smithi033 ceph-mon[101165]: from='client.35926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:52 smithi033 ceph-mon[101165]: from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:52.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:52 smithi033 ceph-mon[101165]: pgmap v1804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2926067599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:38:52.491 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2312843220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:38:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:52 smithi037 ceph-mon[69017]: from='client.35926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:52 smithi037 ceph-mon[69017]: from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:38:52.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:52 smithi037 ceph-mon[69017]: pgmap v1804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2926067599' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:38:52.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2312843220' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:38:54.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:54 smithi033 ceph-mon[101165]: pgmap v1805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:54.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:54 smithi037 ceph-mon[69017]: pgmap v1805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:38:55.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:38:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:38:55.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:38:56.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:56 smithi033 ceph-mon[101165]: pgmap v1806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:56.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:56 smithi037 ceph-mon[69017]: pgmap v1806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:58.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:38:58 smithi033 ceph-mon[101165]: pgmap v1807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:38:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:38:58 smithi037 ceph-mon[69017]: pgmap v1807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:00.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:00 smithi033 ceph-mon[101165]: pgmap v1808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:00 smithi037 ceph-mon[69017]: pgmap v1808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:02 smithi033 ceph-mon[101165]: pgmap v1809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:02 smithi037 ceph-mon[69017]: pgmap v1809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:04 smithi033 ceph-mon[101165]: pgmap v1810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:04 smithi037 ceph-mon[69017]: pgmap v1810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:06 smithi033 ceph-mon[101165]: pgmap v1811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:06 smithi037 ceph-mon[69017]: pgmap v1811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:08 smithi033 ceph-mon[101165]: pgmap v1812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:08 smithi037 ceph-mon[69017]: pgmap v1812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:10 smithi033 ceph-mon[101165]: pgmap v1813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:10 smithi037 ceph-mon[69017]: pgmap v1813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:12 smithi033 ceph-mon[101165]: pgmap v1814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:12 smithi037 ceph-mon[69017]: pgmap v1814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:14 smithi033 ceph-mon[101165]: pgmap v1815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:14 smithi037 ceph-mon[69017]: pgmap v1815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:16 smithi033 ceph-mon[101165]: pgmap v1816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:16 smithi037 ceph-mon[69017]: pgmap v1816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:18 smithi033 ceph-mon[101165]: pgmap v1817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:18 smithi037 ceph-mon[69017]: pgmap v1817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:20.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:20 smithi033 ceph-mon[101165]: pgmap v1818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:20 smithi037 ceph-mon[69017]: pgmap v1818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:21.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.715+0000 7fed3131e700 1 -- 172.21.15.33:0/1195249331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f66e0 msgr2=0x7fed2c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.715+0000 7fed3131e700 1 --2- 172.21.15.33:0/1195249331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f66e0 0x7fed2c0f6b00 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7fed1c004660 tx=0x7fed1c009b30).stop 2022-02-02T14:39:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 -- 172.21.15.33:0/1195249331 shutdown_connections 2022-02-02T14:39:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 --2- 172.21.15.33:0/1195249331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f7980 0x7fed2c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 --2- 172.21.15.33:0/1195249331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f66e0 0x7fed2c0f6b00 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 -- 172.21.15.33:0/1195249331 >> 172.21.15.33:0/1195249331 conn(0x7fed2c0f1e40 msgr2=0x7fed2c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 -- 172.21.15.33:0/1195249331 shutdown_connections 2022-02-02T14:39:21.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 -- 172.21.15.33:0/1195249331 wait complete. 2022-02-02T14:39:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.716+0000 7fed3131e700 1 Processor -- start 2022-02-02T14:39:21.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed3131e700 1 -- start start 2022-02-02T14:39:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed3131e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f66e0 0x7fed2c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed3131e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed3131e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c06a380 con 0x7fed2c0f7980 2022-02-02T14:39:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed3131e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2c06a4c0 con 0x7fed2c0f66e0 2022-02-02T14:39:21.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33880/0 (socket says 172.21.15.33:33880) 2022-02-02T14:39:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 -- 172.21.15.33:0/590941131 learned_addr learned my addr 172.21.15.33:0/590941131 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2affd700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f66e0 0x7fed2c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:21.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 -- 172.21.15.33:0/590941131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f66e0 msgr2=0x7fed2c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f66e0 0x7fed2c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 -- 172.21.15.33:0/590941131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c005040 con 0x7fed2c0f7980 2022-02-02T14:39:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.717+0000 7fed2a7fc700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fed20002700 tx=0x7fed20009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:21.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.718+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20009320 con 0x7fed2c0f7980 2022-02-02T14:39:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.718+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed2000f040 con 0x7fed2c0f7980 2022-02-02T14:39:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.718+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2c06a7a0 con 0x7fed2c0f7980 2022-02-02T14:39:21.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.718+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed20014820 con 0x7fed2c0f7980 2022-02-02T14:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.718+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2c10ef90 con 0x7fed2c0f7980 2022-02-02T14:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.719+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2c045ad0 con 0x7fed2c0f7980 2022-02-02T14:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.720+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed20009480 con 0x7fed2c0f7980 2022-02-02T14:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.720+0000 7fed137fe700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.720+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fed200822c0 con 0x7fed2c0f7980 2022-02-02T14:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.720+0000 7fed2affd700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.721+0000 7fed2affd700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 0x7fed14067290 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fed1c004e30 tx=0x7fed1c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.724+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed200504e0 con 0x7fed2c0f7980 2022-02-02T14:39:21.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.914+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed2c057f10 con 0x7fed14064dd0 2022-02-02T14:39:21.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.915+0000 7fed137fe700 1 -- 172.21.15.33:0/590941131 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fed2c057f10 con 0x7fed14064dd0 2022-02-02T14:39:21.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 msgr2=0x7fed14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:21.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 0x7fed14067290 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7fed1c004e30 tx=0x7fed1c009b30).stop 2022-02-02T14:39:21.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 msgr2=0x7fed2c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:21.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7fed20002700 tx=0x7fed20009e00).stop 2022-02-02T14:39:21.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 shutdown_connections 2022-02-02T14:39:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed14064dd0 0x7fed14067290 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed2c0f66e0 0x7fed2c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 --2- 172.21.15.33:0/590941131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed2c0f7980 0x7fed2c069e20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 >> 172.21.15.33:0/590941131 conn(0x7fed2c0f1e40 msgr2=0x7fed2c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:21.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 shutdown_connections 2022-02-02T14:39:21.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:21.917+0000 7fed3131e700 1 -- 172.21.15.33:0/590941131 wait complete. 2022-02-02T14:39:21.926 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:39:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 -- 172.21.15.33:0/985951809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 msgr2=0x7fc1bc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/985951809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc0f6b00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7fc1ac004660 tx=0x7fc1ac009b30).stop 2022-02-02T14:39:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 -- 172.21.15.33:0/985951809 shutdown_connections 2022-02-02T14:39:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/985951809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 0x7fc1bc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/985951809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc0f6b00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 -- 172.21.15.33:0/985951809 >> 172.21.15.33:0/985951809 conn(0x7fc1bc0f1e40 msgr2=0x7fc1bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 -- 172.21.15.33:0/985951809 shutdown_connections 2022-02-02T14:39:22.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.018+0000 7fc1c0eab700 1 -- 172.21.15.33:0/985951809 wait complete. 2022-02-02T14:39:22.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 Processor -- start 2022-02-02T14:39:22.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 -- start start 2022-02-02T14:39:22.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 0x7fc1bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc06a380 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1c0eab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1bc06a4c0 con 0x7fc1bc0f7980 2022-02-02T14:39:22.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33888/0 (socket says 172.21.15.33:33888) 2022-02-02T14:39:22.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.019+0000 7fc1ba59c700 1 -- 172.21.15.33:0/1711566418 learned_addr learned my addr 172.21.15.33:0/1711566418 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:22.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1b9d9b700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 0x7fc1bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1ba59c700 1 -- 172.21.15.33:0/1711566418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 msgr2=0x7fc1bc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1ba59c700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 0x7fc1bc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1ba59c700 1 -- 172.21.15.33:0/1711566418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac005040 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1ba59c700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fc1ac013a70 tx=0x7fc1ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ac018070 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc06a740 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc1ac0097d0 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1ac01c3c0 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.020+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc06aca0 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.021+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1bc045ad0 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.021+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc1ac007ba0 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.022+0000 7fc1b2ffd700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 0x7fc1a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.022+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc1ac083690 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.022+0000 7fc1b9d9b700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 0x7fc1a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.022+0000 7fc1b9d9b700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 0x7fc1a8067290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc1a4009760 tx=0x7fc1a4009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.026+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc1ac051800 con 0x7fc1bc0f66e0 2022-02-02T14:39:22.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.207+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1bc057f10 con 0x7fc1a8064dd0 2022-02-02T14:39:22.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.221+0000 7fc1b2ffd700 1 -- 172.21.15.33:0/1711566418 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc1bc057f10 con 0x7fc1a8064dd0 2022-02-02T14:39:22.221 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:39:22.221 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (64m) 26m ago 65m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:39:22.221 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (57m) 26m ago 65m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:39:22.222 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (57m) 26m ago 65m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:39:22.222 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (64m) 26m ago 65m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:39:22.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (58m) 26m ago 61m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:39:22.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (58m) 26m ago 61m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:39:22.223 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (59m) 26m ago 61m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:39:22.223 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (61m) 26m ago 61m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:39:22.223 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (59m) 26m ago 66m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:39:22.223 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (58m) 26m ago 65m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:39:22.224 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (58m) 26m ago 67m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:39:22.224 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (58m) 26m ago 65m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:39:22.224 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (65m) 26m ago 65m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:39:22.224 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (64m) 26m ago 64m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:39:22.224 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 26m ago 64m - 4096M 2022-02-02T14:39:22.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (64m) 26m ago 64m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:39:22.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (63m) 26m ago 63m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:39:22.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (63m) 26m ago 63m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:39:22.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (63m) 26m ago 63m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:39:22.226 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (62m) 26m ago 62m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:39:22.226 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (64m) 26m ago 65m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:39:22.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 msgr2=0x7fc1a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 0x7fc1a8067290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7fc1a4009760 tx=0x7fc1a4009c60).stop 2022-02-02T14:39:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 msgr2=0x7fc1bc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7fc1ac013a70 tx=0x7fc1ac009b30).stop 2022-02-02T14:39:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 shutdown_connections 2022-02-02T14:39:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc1a8064dd0 0x7fc1a8067290 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1bc0f66e0 0x7fc1bc06b9a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 --2- 172.21.15.33:0/1711566418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1bc0f7980 0x7fc1bc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.223+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 >> 172.21.15.33:0/1711566418 conn(0x7fc1bc0f1e40 msgr2=0x7fc1bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.224+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 shutdown_connections 2022-02-02T14:39:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.224+0000 7fc1c0eab700 1 -- 172.21.15.33:0/1711566418 wait complete. 2022-02-02T14:39:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 -- 172.21.15.33:0/3214350459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740f98d0 msgr2=0x7fa0740fbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 --2- 172.21.15.33:0/3214350459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740f98d0 0x7fa0740fbcc0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 rx=0x7fa068004660 tx=0x7fa068009b30).stop 2022-02-02T14:39:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 -- 172.21.15.33:0/3214350459 shutdown_connections 2022-02-02T14:39:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 --2- 172.21.15.33:0/3214350459 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740f98d0 0x7fa0740fbcc0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 --2- 172.21.15.33:0/3214350459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740602f0 0x7fa0740f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 -- 172.21.15.33:0/3214350459 >> 172.21.15.33:0/3214350459 conn(0x7fa0740f0de0 msgr2=0x7fa0740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.323+0000 7fa07a82d700 1 -- 172.21.15.33:0/3214350459 shutdown_connections 2022-02-02T14:39:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.324+0000 7fa07a82d700 1 -- 172.21.15.33:0/3214350459 wait complete. 2022-02-02T14:39:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.324+0000 7fa07a82d700 1 Processor -- start 2022-02-02T14:39:22.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.324+0000 7fa07a82d700 1 -- start start 2022-02-02T14:39:22.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa07a82d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa07a82d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740f98d0 0x7fa0740f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa07a82d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740f5840 con 0x7fa0740602f0 2022-02-02T14:39:22.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa07a82d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0740f5980 con 0x7fa0740f98d0 2022-02-02T14:39:22.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33898/0 (socket says 172.21.15.33:33898) 2022-02-02T14:39:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 -- 172.21.15.33:0/2047909074 learned_addr learned my addr 172.21.15.33:0/2047909074 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa0737fe700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740f98d0 0x7fa0740f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 -- 172.21.15.33:0/2047909074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740f98d0 msgr2=0x7fa0740f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740f98d0 0x7fa0740f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 -- 172.21.15.33:0/2047909074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa068005040 con 0x7fa0740602f0 2022-02-02T14:39:22.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa073fff700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fa06400e7c0 tx=0x7fa06400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.325+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0640092e0 con 0x7fa0740602f0 2022-02-02T14:39:22.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.326+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0740f5c60 con 0x7fa0740602f0 2022-02-02T14:39:22.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.326+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa06400f040 con 0x7fa0740602f0 2022-02-02T14:39:22.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.326+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0640147e0 con 0x7fa0740602f0 2022-02-02T14:39:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.326+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa07410ef40 con 0x7fa0740602f0 2022-02-02T14:39:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.327+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa074045ad0 con 0x7fa0740602f0 2022-02-02T14:39:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.327+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa06401b030 con 0x7fa0740602f0 2022-02-02T14:39:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.328+0000 7fa070ff9700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 0x7fa05c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.328+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa064081a00 con 0x7fa0740602f0 2022-02-02T14:39:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.328+0000 7fa0737fe700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 0x7fa05c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.328+0000 7fa0737fe700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 0x7fa05c067270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fa068009720 tx=0x7fa068016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.332+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa06404fab0 con 0x7fa0740602f0 2022-02-02T14:39:22.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.576+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0740fef80 con 0x7fa0740602f0 2022-02-02T14:39:22.576 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:22 smithi033 ceph-mon[101165]: pgmap v1819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:22.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.576+0000 7fa070ff9700 1 -- 172.21.15.33:0/2047909074 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa0640192d0 con 0x7fa0740602f0 2022-02-02T14:39:22.578 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:39:22.578 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:39:22.578 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:39:22.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:22.579 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:39:22.579 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:39:22.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:22.579 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:39:22.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:39:22.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:22.580 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:39:22.580 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:39:22.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:22.581 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:39:22.581 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:39:22.581 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:39:22.581 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:39:22.582 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:39:22.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 msgr2=0x7fa05c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 0x7fa05c067270 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fa068009720 tx=0x7fa068016040).stop 2022-02-02T14:39:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 msgr2=0x7fa0740f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fa06400e7c0 tx=0x7fa06400b040).stop 2022-02-02T14:39:22.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 shutdown_connections 2022-02-02T14:39:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa05c064db0 0x7fa05c067270 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0740602f0 0x7fa0740f6e60 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 --2- 172.21.15.33:0/2047909074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0740f98d0 0x7fa0740f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 >> 172.21.15.33:0/2047909074 conn(0x7fa0740f0de0 msgr2=0x7fa0740f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 shutdown_connections 2022-02-02T14:39:22.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.578+0000 7fa07a82d700 1 -- 172.21.15.33:0/2047909074 wait complete. 2022-02-02T14:39:22.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 -- 172.21.15.33:0/2171749995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f7970 msgr2=0x7f27500f7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 --2- 172.21.15.33:0/2171749995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f7970 0x7f27500f7dd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f274c004660 tx=0x7f274c009b30).stop 2022-02-02T14:39:22.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 -- 172.21.15.33:0/2171749995 shutdown_connections 2022-02-02T14:39:22.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 --2- 172.21.15.33:0/2171749995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f7970 0x7f27500f7dd0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 --2- 172.21.15.33:0/2171749995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f66d0 0x7f27500f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 -- 172.21.15.33:0/2171749995 >> 172.21.15.33:0/2171749995 conn(0x7f27500f1e10 msgr2=0x7f27500f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 -- 172.21.15.33:0/2171749995 shutdown_connections 2022-02-02T14:39:22.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.679+0000 7f275857e700 1 -- 172.21.15.33:0/2171749995 wait complete. 2022-02-02T14:39:22.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 Processor -- start 2022-02-02T14:39:22.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 -- start start 2022-02-02T14:39:22.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f7970 0x7f2750107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27501079d0 con 0x7f27500f66d0 2022-02-02T14:39:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275857e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750107b10 con 0x7f27500f7970 2022-02-02T14:39:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275631a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275631a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33908/0 (socket says 172.21.15.33:33908) 2022-02-02T14:39:22.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f275631a700 1 -- 172.21.15.33:0/3990819080 learned_addr learned my addr 172.21.15.33:0/3990819080 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:22.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.680+0000 7f2755b19700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f7970 0x7f2750107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275631a700 1 -- 172.21.15.33:0/3990819080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f7970 msgr2=0x7f2750107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275631a700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f7970 0x7f2750107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275631a700 1 -- 172.21.15.33:0/3990819080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c005040 con 0x7f27500f66d0 2022-02-02T14:39:22.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275631a700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f274000c530 tx=0x7f2740007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f274000f650 con 0x7f27500f66d0 2022-02-02T14:39:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f274000fc60 con 0x7f27500f66d0 2022-02-02T14:39:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2740012cb0 con 0x7f27500f66d0 2022-02-02T14:39:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27501084b0 con 0x7f27500f66d0 2022-02-02T14:39:22.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.681+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2750108a70 con 0x7f27500f66d0 2022-02-02T14:39:22.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.682+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2750045ad0 con 0x7f27500f66d0 2022-02-02T14:39:22.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.682+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2740019030 con 0x7f27500f66d0 2022-02-02T14:39:22.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.683+0000 7f2746ffd700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 0x7f273c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:22.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.683+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2740081580 con 0x7f27500f66d0 2022-02-02T14:39:22.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.683+0000 7f2755b19700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 0x7f273c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:22.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.683+0000 7f2755b19700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 0x7f273c067290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f274c004630 tx=0x7f274c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:22.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.687+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27400487d0 con 0x7f27500f66d0 2022-02-02T14:39:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:22 smithi037 ceph-mon[69017]: pgmap v1819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:22.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.903+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f27500ff010 con 0x7f27500f66d0 2022-02-02T14:39:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.904+0000 7f2746ffd700 1 -- 172.21.15.33:0/3990819080 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2740017070 con 0x7f27500f66d0 2022-02-02T14:39:22.904 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:39:22.905 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:39:22.905 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:39:22.906 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:39:22.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:22.906 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:39:22.906 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:39:22.907 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:39:22.907 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:39:22.907 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:39:22.907 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:39:22.908 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:39:22.908 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:39:22.908 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:39:22.908 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:39:22.909 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:39:22.909 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:39:22.909 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:39:22.910 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:39:22.910 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:39:22.911 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:39:22.911 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:39:22.912 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:39:22.912 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:39:22.912 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:39:22.913 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:39:22.913 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:39:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:39:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:39:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:39:22.914 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:39:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:22.915 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:39:22.915 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:22.916 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:22.916 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:22.916 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:22.916 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:22.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 msgr2=0x7f273c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 0x7f273c067290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f274c004630 tx=0x7f274c009b30).stop 2022-02-02T14:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 msgr2=0x7f2750106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f274000c530 tx=0x7f2740007e10).stop 2022-02-02T14:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 shutdown_connections 2022-02-02T14:39:22.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f273c064dd0 0x7f273c067290 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27500f66d0 0x7f2750106f30 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 --2- 172.21.15.33:0/3990819080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27500f7970 0x7f2750107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:22.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 >> 172.21.15.33:0/3990819080 conn(0x7f27500f1e10 msgr2=0x7f27500fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:22.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 shutdown_connections 2022-02-02T14:39:22.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:22.907+0000 7f275857e700 1 -- 172.21.15.33:0/3990819080 wait complete. 2022-02-02T14:39:22.921 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:39:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:23 smithi033 ceph-mon[101165]: from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:23 smithi033 ceph-mon[101165]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2047909074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:39:23.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3990819080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:39:23.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:23 smithi037 ceph-mon[69017]: from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:23.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:23 smithi037 ceph-mon[69017]: from='client.35946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:23.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2047909074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:39:23.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3990819080' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:39:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:24 smithi033 ceph-mon[101165]: pgmap v1820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:24 smithi037 ceph-mon[69017]: pgmap v1820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:26 smithi033 ceph-mon[101165]: pgmap v1821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:26 smithi037 ceph-mon[69017]: pgmap v1821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:28 smithi033 ceph-mon[101165]: pgmap v1822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:28 smithi037 ceph-mon[69017]: pgmap v1822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:30 smithi033 ceph-mon[101165]: pgmap v1823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:30 smithi037 ceph-mon[69017]: pgmap v1823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:32 smithi033 ceph-mon[101165]: pgmap v1824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:32 smithi037 ceph-mon[69017]: pgmap v1824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:34 smithi033 ceph-mon[101165]: pgmap v1825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:34 smithi037 ceph-mon[69017]: pgmap v1825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:36.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:36 smithi033 ceph-mon[101165]: pgmap v1826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:36 smithi037 ceph-mon[69017]: pgmap v1826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:38 smithi033 ceph-mon[101165]: pgmap v1827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:38 smithi037 ceph-mon[69017]: pgmap v1827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:40 smithi033 ceph-mon[101165]: pgmap v1828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:40 smithi037 ceph-mon[69017]: pgmap v1828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:42 smithi033 ceph-mon[101165]: pgmap v1829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:42 smithi037 ceph-mon[69017]: pgmap v1829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:44 smithi033 ceph-mon[101165]: pgmap v1830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:44 smithi037 ceph-mon[69017]: pgmap v1830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:46 smithi033 ceph-mon[101165]: pgmap v1831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:46 smithi037 ceph-mon[69017]: pgmap v1831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:48.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:48 smithi033 ceph-mon[101165]: pgmap v1832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:48 smithi037 ceph-mon[69017]: pgmap v1832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:50 smithi033 ceph-mon[101165]: pgmap v1833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:50 smithi037 ceph-mon[69017]: pgmap v1833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:52 smithi033 ceph-mon[101165]: pgmap v1834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:52 smithi037 ceph-mon[69017]: pgmap v1834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 -- 172.21.15.33:0/1657885225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 msgr2=0x7f8ddc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/1657885225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f59e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f8dcc004660 tx=0x7f8dcc009b30).stop 2022-02-02T14:39:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 -- 172.21.15.33:0/1657885225 shutdown_connections 2022-02-02T14:39:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/1657885225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 0x7f8ddc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/1657885225 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f59e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 -- 172.21.15.33:0/1657885225 >> 172.21.15.33:0/1657885225 conn(0x7f8ddc0f0d40 msgr2=0x7f8ddc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.022+0000 7f8de0cdc700 1 -- 172.21.15.33:0/1657885225 shutdown_connections 2022-02-02T14:39:53.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.023+0000 7f8de0cdc700 1 -- 172.21.15.33:0/1657885225 wait complete. 2022-02-02T14:39:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 Processor -- start 2022-02-02T14:39:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 -- start start 2022-02-02T14:39:53.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 0x7f8ddc0f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0f8920 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8de0cdc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0f8a60 con 0x7f8ddc0f6860 2022-02-02T14:39:53.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33918/0 (socket says 172.21.15.33:33918) 2022-02-02T14:39:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 -- 172.21.15.33:0/2859791504 learned_addr learned my addr 172.21.15.33:0/2859791504 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dd9d9b700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 0x7f8ddc0f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 -- 172.21.15.33:0/2859791504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 msgr2=0x7f8ddc0f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 0x7f8ddc0f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.024+0000 7f8dda59c700 1 -- 172.21.15.33:0/2859791504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc005040 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8dda59c700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8dcc014040 tx=0x7f8dcc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dcc019070 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8dcc007e70 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc0f8ce0 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8dcc014d10 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.025+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc0f9240 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.026+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc045ad0 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.026+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8dcc025070 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.027+0000 7f8dcaffd700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 0x7f8dc4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.027+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8dcc082a80 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.027+0000 7f8dd9d9b700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 0x7f8dc4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.028+0000 7f8dd9d9b700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 0x7f8dc4067290 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f8dd0009fd0 tx=0x7f8dd000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.031+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8dcc050b30 con 0x7f8ddc0f55c0 2022-02-02T14:39:53.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.220+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ddc05fd30 con 0x7f8dc4064dd0 2022-02-02T14:39:53.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.221+0000 7f8dcaffd700 1 -- 172.21.15.33:0/2859791504 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8ddc05fd30 con 0x7f8dc4064dd0 2022-02-02T14:39:53.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 msgr2=0x7f8dc4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 0x7f8dc4067290 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f8dd0009fd0 tx=0x7f8dd000b040).stop 2022-02-02T14:39:53.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 msgr2=0x7f8ddc0f9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f8dcc014040 tx=0x7f8dcc00b040).stop 2022-02-02T14:39:53.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 shutdown_connections 2022-02-02T14:39:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8dc4064dd0 0x7f8dc4067290 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ddc0f55c0 0x7f8ddc0f9f40 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 --2- 172.21.15.33:0/2859791504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ddc0f6860 0x7f8ddc0f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 >> 172.21.15.33:0/2859791504 conn(0x7f8ddc0f0d40 msgr2=0x7f8ddc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 shutdown_connections 2022-02-02T14:39:53.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.223+0000 7f8de0cdc700 1 -- 172.21.15.33:0/2859791504 wait complete. 2022-02-02T14:39:53.232 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:39:53.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 -- 172.21.15.33:0/2383428328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f6860 msgr2=0x7f01ec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 --2- 172.21.15.33:0/2383428328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f6860 0x7f01ec0f6cc0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f01dc004660 tx=0x7f01dc009b30).stop 2022-02-02T14:39:53.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 -- 172.21.15.33:0/2383428328 shutdown_connections 2022-02-02T14:39:53.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 --2- 172.21.15.33:0/2383428328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f6860 0x7f01ec0f6cc0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 --2- 172.21.15.33:0/2383428328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f55c0 0x7f01ec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 -- 172.21.15.33:0/2383428328 >> 172.21.15.33:0/2383428328 conn(0x7f01ec0f0d40 msgr2=0x7f01ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 -- 172.21.15.33:0/2383428328 shutdown_connections 2022-02-02T14:39:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.324+0000 7f01f1823700 1 -- 172.21.15.33:0/2383428328 wait complete. 2022-02-02T14:39:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 Processor -- start 2022-02-02T14:39:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 -- start start 2022-02-02T14:39:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f6860 0x7f01ec107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec1079f0 con 0x7f01ec0f55c0 2022-02-02T14:39:53.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01f1823700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec107b30 con 0x7f01ec0f6860 2022-02-02T14:39:53.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33928/0 (socket says 172.21.15.33:33928) 2022-02-02T14:39:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 -- 172.21.15.33:0/2996922503 learned_addr learned my addr 172.21.15.33:0/2996922503 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01ea7fc700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f6860 0x7f01ec107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 -- 172.21.15.33:0/2996922503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f6860 msgr2=0x7f01ec107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f6860 0x7f01ec107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.325+0000 7f01eaffd700 1 -- 172.21.15.33:0/2996922503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc005040 con 0x7f01ec0f55c0 2022-02-02T14:39:53.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01eaffd700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f01e0004f30 tx=0x7f01e0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01e0009500 con 0x7f01ec0f55c0 2022-02-02T14:39:53.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec1084d0 con 0x7f01ec0f55c0 2022-02-02T14:39:53.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f01e0016070 con 0x7f01ec0f55c0 2022-02-02T14:39:53.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01e0012d00 con 0x7f01ec0f55c0 2022-02-02T14:39:53.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.326+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec108a90 con 0x7f01ec0f55c0 2022-02-02T14:39:53.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.327+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec045ad0 con 0x7f01ec0f55c0 2022-02-02T14:39:53.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.328+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f01e00077b0 con 0x7f01ec0f55c0 2022-02-02T14:39:53.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.328+0000 7f01d37fe700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 0x7f01d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.328+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f01e0085a80 con 0x7f01ec0f55c0 2022-02-02T14:39:53.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.328+0000 7f01ea7fc700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 0x7f01d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.329+0000 7f01ea7fc700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 0x7f01d4067290 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f01dc004630 tx=0x7f01dc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.333+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f01e0057560 con 0x7f01ec0f55c0 2022-02-02T14:39:53.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.514+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01ec108d10 con 0x7f01d4064dd0 2022-02-02T14:39:53.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.528+0000 7f01d37fe700 1 -- 172.21.15.33:0/2996922503 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f01ec108d10 con 0x7f01d4064dd0 2022-02-02T14:39:53.528 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:39:53.529 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (65m) 27m ago 66m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:39:53.529 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (58m) 27m ago 66m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:39:53.529 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (58m) 27m ago 65m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:39:53.529 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (65m) 27m ago 65m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:39:53.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (58m) 27m ago 62m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:39:53.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (59m) 27m ago 62m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:39:53.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (60m) 27m ago 62m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:39:53.530 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (62m) 27m ago 62m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:39:53.530 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (59m) 27m ago 67m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:39:53.531 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (59m) 27m ago 65m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:39:53.531 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (59m) 27m ago 67m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:39:53.531 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (58m) 27m ago 65m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:39:53.531 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (65m) 27m ago 65m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:39:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (65m) 27m ago 65m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:39:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 27m ago 64m - 4096M 2022-02-02T14:39:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (64m) 27m ago 64m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:39:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (64m) 27m ago 64m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:39:53.532 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (64m) 27m ago 64m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:39:53.533 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (63m) 27m ago 63m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:39:53.533 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (63m) 27m ago 63m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:39:53.533 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (64m) 27m ago 65m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:39:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 msgr2=0x7f01d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 0x7f01d4067290 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f01dc004630 tx=0x7f01dc009b30).stop 2022-02-02T14:39:53.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 msgr2=0x7f01ec106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 rx=0x7f01e0004f30 tx=0x7f01e0009d80).stop 2022-02-02T14:39:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 shutdown_connections 2022-02-02T14:39:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f01d4064dd0 0x7f01d4067290 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01ec0f55c0 0x7f01ec106f50 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 --2- 172.21.15.33:0/2996922503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0f6860 0x7f01ec107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 >> 172.21.15.33:0/2996922503 conn(0x7f01ec0f0d40 msgr2=0x7f01ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 shutdown_connections 2022-02-02T14:39:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.531+0000 7f01f1823700 1 -- 172.21.15.33:0/2996922503 wait complete. 2022-02-02T14:39:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 -- 172.21.15.33:0/3350172353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 msgr2=0x7f479c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 --2- 172.21.15.33:0/3350172353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f6cc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f4790004660 tx=0x7f4790009b30).stop 2022-02-02T14:39:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 -- 172.21.15.33:0/3350172353 shutdown_connections 2022-02-02T14:39:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 --2- 172.21.15.33:0/3350172353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f6cc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 --2- 172.21.15.33:0/3350172353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 0x7f479c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 -- 172.21.15.33:0/3350172353 >> 172.21.15.33:0/3350172353 conn(0x7f479c0f0d40 msgr2=0x7f479c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 -- 172.21.15.33:0/3350172353 shutdown_connections 2022-02-02T14:39:53.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.631+0000 7f47a2280700 1 -- 172.21.15.33:0/3350172353 wait complete. 2022-02-02T14:39:53.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 Processor -- start 2022-02-02T14:39:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 -- start start 2022-02-02T14:39:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 0x7f479c0f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0f8920 con 0x7f479c0f6860 2022-02-02T14:39:53.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.632+0000 7f47a2280700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0f8a60 con 0x7f479c0f55c0 2022-02-02T14:39:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33940/0 (socket says 172.21.15.33:33940) 2022-02-02T14:39:53.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 -- 172.21.15.33:0/1854089628 learned_addr learned my addr 172.21.15.33:0/1854089628 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479bfff700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 0x7f479c0f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 -- 172.21.15.33:0/1854089628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 msgr2=0x7f479c0f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 0x7f479c0f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 -- 172.21.15.33:0/1854089628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790005040 con 0x7f479c0f6860 2022-02-02T14:39:53.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f479b7fe700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f4790009990 tx=0x7f4790009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4790018070 con 0x7f479c0f6860 2022-02-02T14:39:53.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c0f8ce0 con 0x7f479c0f6860 2022-02-02T14:39:53.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c0f9240 con 0x7f479c0f6860 2022-02-02T14:39:53.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.633+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4790007ba0 con 0x7f479c0f6860 2022-02-02T14:39:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.634+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f479001c620 con 0x7f479c0f6860 2022-02-02T14:39:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.635+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c004fa0 con 0x7f479c0f6860 2022-02-02T14:39:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.635+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f479001c890 con 0x7f479c0f6860 2022-02-02T14:39:53.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.635+0000 7f4798ff9700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 0x7f4784067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.636+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4790083790 con 0x7f479c0f6860 2022-02-02T14:39:53.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.636+0000 7f479bfff700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 0x7f4784067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.636+0000 7f479bfff700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 0x7f4784067290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f479c0f9cd0 tx=0x7f478c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.640+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47900518a0 con 0x7f479c0f6860 2022-02-02T14:39:53.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.882+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f477c005e80 con 0x7f479c0f6860 2022-02-02T14:39:53.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.883+0000 7f4798ff9700 1 -- 172.21.15.33:0/1854089628 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4790054ec0 con 0x7f479c0f6860 2022-02-02T14:39:53.883 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:39:53.883 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:39:53.883 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:39:53.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:53.884 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:39:53.884 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:39:53.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:53.884 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:39:53.884 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:39:53.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:53.885 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:39:53.885 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:39:53.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:39:53.885 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:39:53.886 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:39:53.886 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:39:53.886 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:39:53.886 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:39:53.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 msgr2=0x7f4784067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 0x7f4784067290 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f479c0f9cd0 tx=0x7f478c009040).stop 2022-02-02T14:39:53.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 msgr2=0x7f479c0f83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f4790009990 tx=0x7f4790009b30).stop 2022-02-02T14:39:53.888 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 shutdown_connections 2022-02-02T14:39:53.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4784064dd0 0x7f4784067290 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f479c0f55c0 0x7f479c0f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 --2- 172.21.15.33:0/1854089628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f479c0f6860 0x7f479c0f83c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.884+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 >> 172.21.15.33:0/1854089628 conn(0x7f479c0f0d40 msgr2=0x7f479c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.885+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 shutdown_connections 2022-02-02T14:39:53.890 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.885+0000 7f47a2280700 1 -- 172.21.15.33:0/1854089628 wait complete. 2022-02-02T14:39:53.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 -- 172.21.15.33:0/167851072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f6860 msgr2=0x7f0fa40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/167851072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f6860 0x7f0fa40f6cc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7f0f90004660 tx=0x7f0f90009b30).stop 2022-02-02T14:39:53.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 -- 172.21.15.33:0/167851072 shutdown_connections 2022-02-02T14:39:53.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/167851072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f6860 0x7f0fa40f6cc0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/167851072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f55c0 0x7f0fa40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 -- 172.21.15.33:0/167851072 >> 172.21.15.33:0/167851072 conn(0x7f0fa40f0d40 msgr2=0x7f0fa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:53.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 -- 172.21.15.33:0/167851072 shutdown_connections 2022-02-02T14:39:53.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.985+0000 7f0fab1ca700 1 -- 172.21.15.33:0/167851072 wait complete. 2022-02-02T14:39:53.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 Processor -- start 2022-02-02T14:39:53.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 -- start start 2022-02-02T14:39:53.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f6860 0x7f0fa410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40603c0 con 0x7f0fa40f55c0 2022-02-02T14:39:53.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fab1ca700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4060500 con 0x7f0fa40f6860 2022-02-02T14:39:53.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fa8f66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fa8f66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33948/0 (socket says 172.21.15.33:33948) 2022-02-02T14:39:53.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fa8f66700 1 -- 172.21.15.33:0/2147777904 learned_addr learned my addr 172.21.15.33:0/2147777904 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:39:53.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.986+0000 7f0fa3fff700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f6860 0x7f0fa410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa8f66700 1 -- 172.21.15.33:0/2147777904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f6860 msgr2=0x7f0fa410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa8f66700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f6860 0x7f0fa410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa8f66700 1 -- 172.21.15.33:0/2147777904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90005040 con 0x7f0fa40f55c0 2022-02-02T14:39:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa8f66700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0f98002700 tx=0x7f0f98009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f980079c0 con 0x7f0fa40f55c0 2022-02-02T14:39:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa410c720 con 0x7f0fa40f55c0 2022-02-02T14:39:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f9800f040 con 0x7f0fa40f55c0 2022-02-02T14:39:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f98014860 con 0x7f0fa40f55c0 2022-02-02T14:39:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.987+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa410ccb0 con 0x7f0fa40f55c0 2022-02-02T14:39:53.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.988+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa40f49b0 con 0x7f0fa40f55c0 2022-02-02T14:39:53.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.988+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f9801b060 con 0x7f0fa40f55c0 2022-02-02T14:39:53.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.989+0000 7f0fa17fa700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 0x7f0f94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:39:53.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.989+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0f98081940 con 0x7f0fa40f55c0 2022-02-02T14:39:53.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.989+0000 7f0fa3fff700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 0x7f0f94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:39:53.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.989+0000 7f0fa3fff700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 0x7f0f94067290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0f90004630 tx=0x7f0f90009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:39:53.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:53.993+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f9804f9f0 con 0x7f0fa40f55c0 2022-02-02T14:39:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.204+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fa4045ad0 con 0x7f0fa40f55c0 2022-02-02T14:39:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.205+0000 7f0fa17fa700 1 -- 172.21.15.33:0/2147777904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0f98019070 con 0x7f0fa40f55c0 2022-02-02T14:39:54.205 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:39:54.205 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:39:54.205 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:39:54.206 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:39:54.206 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:54.206 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:39:54.206 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:39:54.208 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:39:54.208 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:39:54.209 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:39:54.209 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:39:54.209 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:39:54.209 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:39:54.209 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:39:54.210 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:39:54.210 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:39:54.210 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:39:54.210 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:39:54.211 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:39:54.211 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:39:54.211 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:39:54.211 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:39:54.212 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:39:54.212 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:39:54.212 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:39:54.212 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:39:54.213 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:39:54.213 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:39:54.213 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:39:54.213 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:39:54.213 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:39:54.214 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:54.214 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:54.214 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:39:54.214 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:39:54.215 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:54.215 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:54.215 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:54.215 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:39:54.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.207+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 msgr2=0x7f0f94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.207+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 0x7f0f94067290 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f0f90004630 tx=0x7f0f90009b30).stop 2022-02-02T14:39:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.207+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 msgr2=0x7f0fa4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:39:54.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.207+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f0f98002700 tx=0x7f0f98009d80).stop 2022-02-02T14:39:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 shutdown_connections 2022-02-02T14:39:54.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f94064dd0 0x7f0f94067290 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa40f55c0 0x7f0fa4109c70 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 --2- 172.21.15.33:0/2147777904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fa40f6860 0x7f0fa410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:39:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 >> 172.21.15.33:0/2147777904 conn(0x7f0fa40f0d40 msgr2=0x7f0fa40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:39:54.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 shutdown_connections 2022-02-02T14:39:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:39:54.208+0000 7f0fab1ca700 1 -- 172.21.15.33:0/2147777904 wait complete. 2022-02-02T14:39:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:39:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: pgmap v1835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: from='client.35958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1854089628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:39:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2147777904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:39:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:39:54.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:39:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: pgmap v1835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: from='client.35958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1854089628' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:39:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2147777904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:39:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:39:54.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:39:55.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:55 smithi033 ceph-mon[101165]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:55.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:55 smithi037 ceph-mon[69017]: from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:39:56.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:56 smithi033 ceph-mon[101165]: pgmap v1836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:56 smithi037 ceph-mon[69017]: pgmap v1836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:39:57 smithi037 ceph-mon[69017]: pgmap v1837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:39:57.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:39:57 smithi033 ceph-mon[101165]: pgmap v1837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:00 smithi033 conmon[101141]: 2022-02-02T14:39:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:40:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:00 smithi033 ceph-mon[101165]: pgmap v1838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:40:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:00 smithi037 ceph-mon[69017]: pgmap v1838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:00.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:40:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:02 smithi033 ceph-mon[101165]: pgmap v1839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:02 smithi037 ceph-mon[69017]: pgmap v1839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:04 smithi033 ceph-mon[101165]: pgmap v1840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:04 smithi037 ceph-mon[69017]: pgmap v1840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:06 smithi033 ceph-mon[101165]: pgmap v1841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:06 smithi037 ceph-mon[69017]: pgmap v1841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:08 smithi033 ceph-mon[101165]: pgmap v1842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:08 smithi037 ceph-mon[69017]: pgmap v1842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:10 smithi033 ceph-mon[101165]: pgmap v1843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:10 smithi037 ceph-mon[69017]: pgmap v1843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:12 smithi033 ceph-mon[101165]: pgmap v1844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:12 smithi037 ceph-mon[69017]: pgmap v1844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:14 smithi033 ceph-mon[101165]: pgmap v1845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:14 smithi037 ceph-mon[69017]: pgmap v1845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:16 smithi033 ceph-mon[101165]: pgmap v1846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:16 smithi037 ceph-mon[69017]: pgmap v1846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:18 smithi033 ceph-mon[101165]: pgmap v1847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:18 smithi037 ceph-mon[69017]: pgmap v1847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:20 smithi033 ceph-mon[101165]: pgmap v1848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:20 smithi037 ceph-mon[69017]: pgmap v1848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:22 smithi033 ceph-mon[101165]: pgmap v1849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:22 smithi037 ceph-mon[69017]: pgmap v1849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 -- 172.21.15.33:0/2325699583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 msgr2=0x7f5fac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 --2- 172.21.15.33:0/2325699583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac0f6b00 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f5f9c004660 tx=0x7f5f9c009b30).stop 2022-02-02T14:40:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 -- 172.21.15.33:0/2325699583 shutdown_connections 2022-02-02T14:40:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 --2- 172.21.15.33:0/2325699583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac0f7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:40:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 --2- 172.21.15.33:0/2325699583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac0f6b00 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.324+0000 7f5fb1863700 1 -- 172.21.15.33:0/2325699583 >> 172.21.15.33:0/2325699583 conn(0x7f5fac0f1f00 msgr2=0x7f5fac0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.325+0000 7f5fb1863700 1 -- 172.21.15.33:0/2325699583 shutdown_connections 2022-02-02T14:40:24.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.325+0000 7f5fb1863700 1 -- 172.21.15.33:0/2325699583 wait complete. 2022-02-02T14:40:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 Processor -- start 2022-02-02T14:40:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 -- start start 2022-02-02T14:40:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac107ab0 con 0x7f5fac0f66e0 2022-02-02T14:40:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5fb1863700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac108360 con 0x7f5fac0f6ff0 2022-02-02T14:40:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33958/0 (socket says 172.21.15.33:33958) 2022-02-02T14:40:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 -- 172.21.15.33:0/923226591 learned_addr learned my addr 172.21.15.33:0/923226591 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faa7fc700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 -- 172.21.15.33:0/923226591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 msgr2=0x7f5fac107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 -- 172.21.15.33:0/923226591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c005040 con 0x7f5fac0f66e0 2022-02-02T14:40:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faa7fc700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:40:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.326+0000 7f5faaffd700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f5f9c009990 tx=0x7f5f9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.327+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9c018070 con 0x7f5fac0f66e0 2022-02-02T14:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.327+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5f9c007ca0 con 0x7f5fac0f66e0 2022-02-02T14:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.327+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac1085e0 con 0x7f5fac0f66e0 2022-02-02T14:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.327+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f9c01c620 con 0x7f5fac0f66e0 2022-02-02T14:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.327+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac108b40 con 0x7f5fac0f66e0 2022-02-02T14:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.328+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c004fa0 con 0x7f5fac0f66e0 2022-02-02T14:40:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.329+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5f9c01d960 con 0x7f5fac0f66e0 2022-02-02T14:40:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.329+0000 7f5f937fe700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 0x7f5f94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.329+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5f9c083870 con 0x7f5fac0f66e0 2022-02-02T14:40:24.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.329+0000 7f5faa7fc700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 0x7f5f94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.330+0000 7f5faa7fc700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 0x7f5f94067290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f5fa000a7e0 tx=0x7f5fa0008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.333+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5f9c0553d0 con 0x7f5fac0f66e0 2022-02-02T14:40:24.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.526+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f8c000bc0 con 0x7f5f94064dd0 2022-02-02T14:40:24.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.527+0000 7f5f937fe700 1 -- 172.21.15.33:0/923226591 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5f8c000bc0 con 0x7f5f94064dd0 2022-02-02T14:40:24.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 msgr2=0x7f5f94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 0x7f5f94067290 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f5fa000a7e0 tx=0x7f5fa0008040).stop 2022-02-02T14:40:24.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 msgr2=0x7f5fac106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 rx=0x7f5f9c009990 tx=0x7f5f9c009b30).stop 2022-02-02T14:40:24.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 shutdown_connections 2022-02-02T14:40:24.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5f94064dd0 0x7f5f94067290 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5fac0f66e0 0x7f5fac106f80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 --2- 172.21.15.33:0/923226591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fac0f6ff0 0x7f5fac107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 >> 172.21.15.33:0/923226591 conn(0x7f5fac0f1f00 msgr2=0x7f5fac0fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:24.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 shutdown_connections 2022-02-02T14:40:24.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.529+0000 7f5fb1863700 1 -- 172.21.15.33:0/923226591 wait complete. 2022-02-02T14:40:24.538 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:40:24.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- 172.21.15.33:0/493900180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f7980 msgr2=0x7f19bc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 --2- 172.21.15.33:0/493900180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f7980 0x7f19bc0f7de0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f19ac004660 tx=0x7f19ac009b30).stop 2022-02-02T14:40:24.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- 172.21.15.33:0/493900180 shutdown_connections 2022-02-02T14:40:24.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 --2- 172.21.15.33:0/493900180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f7980 0x7f19bc0f7de0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 --2- 172.21.15.33:0/493900180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f66e0 0x7f19bc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- 172.21.15.33:0/493900180 >> 172.21.15.33:0/493900180 conn(0x7f19bc0f1e40 msgr2=0x7f19bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- 172.21.15.33:0/493900180 shutdown_connections 2022-02-02T14:40:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- 172.21.15.33:0/493900180 wait complete. 2022-02-02T14:40:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 Processor -- start 2022-02-02T14:40:24.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.631+0000 7f19c0b61700 1 -- start start 2022-02-02T14:40:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f7980 0x7f19bc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc06a380 con 0x7f19bc0f66e0 2022-02-02T14:40:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc06a4c0 con 0x7f19bc0f7980 2022-02-02T14:40:24.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33966/0 (socket says 172.21.15.33:33966) 2022-02-02T14:40:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 -- 172.21.15.33:0/4000887238 learned_addr learned my addr 172.21.15.33:0/4000887238 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19b9d9b700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f7980 0x7f19bc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 -- 172.21.15.33:0/4000887238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f7980 msgr2=0x7f19bc069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f7980 0x7f19bc069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 -- 172.21.15.33:0/4000887238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac005040 con 0x7f19bc0f66e0 2022-02-02T14:40:24.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19ba59c700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f19b0002700 tx=0x7f19b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19b00079c0 con 0x7f19bc0f66e0 2022-02-02T14:40:24.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19b000f040 con 0x7f19bc0f66e0 2022-02-02T14:40:24.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19b0014860 con 0x7f19bc0f66e0 2022-02-02T14:40:24.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc06a7a0 con 0x7f19bc0f66e0 2022-02-02T14:40:24.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.632+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc10ef90 con 0x7f19bc0f66e0 2022-02-02T14:40:24.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.633+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc045ad0 con 0x7f19bc0f66e0 2022-02-02T14:40:24.639 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:24 smithi033 ceph-mon[101165]: pgmap v1850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:24.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.634+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19b001b060 con 0x7f19bc0f66e0 2022-02-02T14:40:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.635+0000 7f19aaffd700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 0x7f19a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.635+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f19b0081860 con 0x7f19bc0f66e0 2022-02-02T14:40:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.635+0000 7f19b9d9b700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 0x7f19a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.635+0000 7f19b9d9b700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 0x7f19a4067290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f19ac004630 tx=0x7f19ac009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.639+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19b004f910 con 0x7f19bc0f66e0 2022-02-02T14:40:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:24 smithi037 ceph-mon[69017]: pgmap v1850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:24.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.820+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19bc0ff050 con 0x7f19a4064dd0 2022-02-02T14:40:24.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.835+0000 7f19aaffd700 1 -- 172.21.15.33:0/4000887238 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f19ac019040 con 0x7f19a4064dd0 2022-02-02T14:40:24.834 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:40:24.835 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (65m) 27m ago 66m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:40:24.835 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (58m) 27m ago 66m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:40:24.835 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (58m) 27m ago 66m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:40:24.835 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (65m) 27m ago 66m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:40:24.836 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (59m) 27m ago 62m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:40:24.836 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (59m) 27m ago 62m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:40:24.836 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (60m) 27m ago 62m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:40:24.837 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (62m) 27m ago 62m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:40:24.837 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (60m) 27m ago 68m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:40:24.837 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (59m) 27m ago 66m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:40:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (59m) 27m ago 68m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:40:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (59m) 27m ago 66m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:40:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (66m) 27m ago 66m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:40:24.838 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (65m) 27m ago 65m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:40:24.839 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 27m ago 65m - 4096M 2022-02-02T14:40:24.839 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (65m) 27m ago 65m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:40:24.839 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (64m) 27m ago 64m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:40:24.839 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (64m) 27m ago 64m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:40:24.840 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (64m) 27m ago 64m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:40:24.840 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (64m) 27m ago 64m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:40:24.840 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (65m) 27m ago 66m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:40:24.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 msgr2=0x7f19a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 0x7f19a4067290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f19ac004630 tx=0x7f19ac009b30).stop 2022-02-02T14:40:24.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 msgr2=0x7f19bc06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f19b0002700 tx=0x7f19b0009d80).stop 2022-02-02T14:40:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 shutdown_connections 2022-02-02T14:40:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19a4064dd0 0x7f19a4067290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19bc0f66e0 0x7f19bc06b9a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 --2- 172.21.15.33:0/4000887238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19bc0f7980 0x7f19bc069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 >> 172.21.15.33:0/4000887238 conn(0x7f19bc0f1e40 msgr2=0x7f19bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 shutdown_connections 2022-02-02T14:40:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.837+0000 7f19c0b61700 1 -- 172.21.15.33:0/4000887238 wait complete. 2022-02-02T14:40:24.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 -- 172.21.15.33:0/2395207290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f6530 msgr2=0x7f29080f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 --2- 172.21.15.33:0/2395207290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f6530 0x7f29080f6950 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 rx=0x7f28fc004660 tx=0x7f28fc009b30).stop 2022-02-02T14:40:24.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 -- 172.21.15.33:0/2395207290 shutdown_connections 2022-02-02T14:40:24.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 --2- 172.21.15.33:0/2395207290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f77d0 0x7f29080f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 --2- 172.21.15.33:0/2395207290 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f6530 0x7f29080f6950 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.937+0000 7f290d898700 1 -- 172.21.15.33:0/2395207290 >> 172.21.15.33:0/2395207290 conn(0x7f29080f1c90 msgr2=0x7f29080f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:24.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.938+0000 7f290d898700 1 -- 172.21.15.33:0/2395207290 shutdown_connections 2022-02-02T14:40:24.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.938+0000 7f290d898700 1 -- 172.21.15.33:0/2395207290 wait complete. 2022-02-02T14:40:24.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.938+0000 7f290d898700 1 Processor -- start 2022-02-02T14:40:24.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.938+0000 7f290d898700 1 -- start start 2022-02-02T14:40:24.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f290d898700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f6530 0x7f290806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f290d898700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f290d898700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290806a380 con 0x7f29080f77d0 2022-02-02T14:40:24.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f290d898700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290806a4c0 con 0x7f29080f6530 2022-02-02T14:40:24.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33978/0 (socket says 172.21.15.33:33978) 2022-02-02T14:40:24.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 -- 172.21.15.33:0/3378274697 learned_addr learned my addr 172.21.15.33:0/3378274697 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:24.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f290c896700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f6530 0x7f290806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 -- 172.21.15.33:0/3378274697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f6530 msgr2=0x7f290806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:24.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f6530 0x7f290806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:24.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 -- 172.21.15.33:0/3378274697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc005040 con 0x7f29080f77d0 2022-02-02T14:40:24.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f2907fff700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f28f400e7f0 tx=0x7f28f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f40092e0 con 0x7f29080f77d0 2022-02-02T14:40:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28f400f040 con 0x7f29080f77d0 2022-02-02T14:40:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.939+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f28f4014750 con 0x7f29080f77d0 2022-02-02T14:40:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.940+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290806a7a0 con 0x7f29080f77d0 2022-02-02T14:40:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.940+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290810ed50 con 0x7f29080f77d0 2022-02-02T14:40:24.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.941+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f28f401b030 con 0x7f29080f77d0 2022-02-02T14:40:24.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.941+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2908045ad0 con 0x7f29080f77d0 2022-02-02T14:40:24.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.942+0000 7f29057fa700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 0x7f28f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:24.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.942+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f28f4081780 con 0x7f29080f77d0 2022-02-02T14:40:24.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.942+0000 7f290c896700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 0x7f28f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:24.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.942+0000 7f290c896700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 0x7f28f80672e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f28fc000c00 tx=0x7f28fc016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:24.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:24.946+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f28f404f8e0 con 0x7f29080f77d0 2022-02-02T14:40:25.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.189+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2908027a00 con 0x7f29080f77d0 2022-02-02T14:40:25.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.189+0000 7f29057fa700 1 -- 172.21.15.33:0/3378274697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f28f4052f00 con 0x7f29080f77d0 2022-02-02T14:40:25.189 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:40:25.189 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:40:25.190 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:40:25.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:25.192 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:40:25.192 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:40:25.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:25.192 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:40:25.192 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:40:25.193 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:40:25.193 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:40:25.193 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:40:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 msgr2=0x7f28f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 0x7f28f80672e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f28fc000c00 tx=0x7f28fc016040).stop 2022-02-02T14:40:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 msgr2=0x7f2908069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f28f400e7f0 tx=0x7f28f400b040).stop 2022-02-02T14:40:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 shutdown_connections 2022-02-02T14:40:25.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f28f8064e20 0x7f28f80672e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29080f6530 0x7f290806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 --2- 172.21.15.33:0/3378274697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29080f77d0 0x7f2908069e20 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 >> 172.21.15.33:0/3378274697 conn(0x7f29080f1c90 msgr2=0x7f29080fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:25.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 shutdown_connections 2022-02-02T14:40:25.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.191+0000 7f290d898700 1 -- 172.21.15.33:0/3378274697 wait complete. 2022-02-02T14:40:25.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 -- 172.21.15.33:0/3397916739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 msgr2=0x7f9e140f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3397916739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e140f5850 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f9e04004660 tx=0x7f9e04009b30).stop 2022-02-02T14:40:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 -- 172.21.15.33:0/3397916739 shutdown_connections 2022-02-02T14:40:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3397916739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 0x7f9e140f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3397916739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e140f5850 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 -- 172.21.15.33:0/3397916739 >> 172.21.15.33:0/3397916739 conn(0x7f9e140f0b90 msgr2=0x7f9e140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:25.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.292+0000 7f9e1359e700 1 -- 172.21.15.33:0/3397916739 shutdown_connections 2022-02-02T14:40:25.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.293+0000 7f9e1359e700 1 -- 172.21.15.33:0/3397916739 wait complete. 2022-02-02T14:40:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.293+0000 7f9e1359e700 1 Processor -- start 2022-02-02T14:40:25.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.293+0000 7f9e1359e700 1 -- start start 2022-02-02T14:40:25.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.293+0000 7f9e1359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:25.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 0x7f9e1410bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:25.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140603c0 con 0x7f9e140f5430 2022-02-02T14:40:25.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e14060500 con 0x7f9e140f66d0 2022-02-02T14:40:25.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:25.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33986/0 (socket says 172.21.15.33:33986) 2022-02-02T14:40:25.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 -- 172.21.15.33:0/3930667511 learned_addr learned my addr 172.21.15.33:0/3930667511 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:25.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e11d9b700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 0x7f9e1410bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:25.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 -- 172.21.15.33:0/3930667511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 msgr2=0x7f9e1410bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 0x7f9e1410bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 -- 172.21.15.33:0/3930667511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e04005040 con 0x7f9e140f5430 2022-02-02T14:40:25.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1259c700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f9e04014040 tx=0x7f9e0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:25.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e04019070 con 0x7f9e140f5430 2022-02-02T14:40:25.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e04007e70 con 0x7f9e140f5430 2022-02-02T14:40:25.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1410c490 con 0x7f9e140f5430 2022-02-02T14:40:25.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e04014d10 con 0x7f9e140f5430 2022-02-02T14:40:25.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.294+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1410c9c0 con 0x7f9e140f5430 2022-02-02T14:40:25.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.295+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e14059100 con 0x7f9e140f5430 2022-02-02T14:40:25.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.296+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e04025070 con 0x7f9e140f5430 2022-02-02T14:40:25.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.296+0000 7f9e02ffd700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 0x7f9dfc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:25.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.296+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9e040829b0 con 0x7f9e140f5430 2022-02-02T14:40:25.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.296+0000 7f9e11d9b700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 0x7f9dfc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:25.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.297+0000 7f9e11d9b700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 0x7f9dfc0672e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f9e08009fd0 tx=0x7f9e0800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:25.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.300+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e04050a60 con 0x7f9e140f5430 2022-02-02T14:40:25.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3378274697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:40:25.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.518+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9e140fdd00 con 0x7f9e140f5430 2022-02-02T14:40:25.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.519+0000 7f9e02ffd700 1 -- 172.21.15.33:0/3930667511 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f9e04023020 con 0x7f9e140f5430 2022-02-02T14:40:25.519 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:40:25.519 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:40:25.519 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:40:25.519 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:40:25.520 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:25.520 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:40:25.520 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:40:25.520 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:40:25.521 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:40:25.521 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:40:25.521 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:40:25.521 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:40:25.521 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:40:25.522 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:40:25.522 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:40:25.522 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:40:25.522 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:40:25.523 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:40:25.523 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:40:25.523 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:40:25.523 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:40:25.524 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:40:25.524 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:40:25.524 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:40:25.524 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:40:25.524 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:40:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:40:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:40:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:40:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:40:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:40:25.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:25.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:25.526 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:40:25.526 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:25.527 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:25.527 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:25.527 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:25.527 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:25.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 msgr2=0x7f9dfc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 0x7f9dfc0672e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f9e08009fd0 tx=0x7f9e0800b040).stop 2022-02-02T14:40:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 msgr2=0x7f9e14109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 rx=0x7f9e04014040 tx=0x7f9e0400b040).stop 2022-02-02T14:40:25.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 shutdown_connections 2022-02-02T14:40:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9dfc064e20 0x7f9dfc0672e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e140f5430 0x7f9e14109a40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 --2- 172.21.15.33:0/3930667511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e140f66d0 0x7f9e1410bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 >> 172.21.15.33:0/3930667511 conn(0x7f9e140f0b90 msgr2=0x7f9e140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:25.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 shutdown_connections 2022-02-02T14:40:25.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:25.521+0000 7f9e1359e700 1 -- 172.21.15.33:0/3930667511 wait complete. 2022-02-02T14:40:25.531 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:40:25.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3378274697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:40:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:26 smithi033 ceph-mon[101165]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:26 smithi033 ceph-mon[101165]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:26.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:26 smithi033 ceph-mon[101165]: pgmap v1851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:26.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:26 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3930667511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:40:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:26 smithi037 ceph-mon[69017]: from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:26 smithi037 ceph-mon[69017]: from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:26.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:26 smithi037 ceph-mon[69017]: pgmap v1851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:26.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:26 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3930667511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:40:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:28 smithi033 ceph-mon[101165]: pgmap v1852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:28.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:28 smithi037 ceph-mon[69017]: pgmap v1852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:30 smithi033 ceph-mon[101165]: pgmap v1853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:30 smithi037 ceph-mon[69017]: pgmap v1853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:32.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:32 smithi033 ceph-mon[101165]: pgmap v1854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:32 smithi037 ceph-mon[69017]: pgmap v1854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:34 smithi033 ceph-mon[101165]: pgmap v1855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:34 smithi037 ceph-mon[69017]: pgmap v1855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:36 smithi033 ceph-mon[101165]: pgmap v1856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:36 smithi037 ceph-mon[69017]: pgmap v1856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:38 smithi033 ceph-mon[101165]: pgmap v1857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:38 smithi037 ceph-mon[69017]: pgmap v1857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:40 smithi033 ceph-mon[101165]: pgmap v1858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:40 smithi037 ceph-mon[69017]: pgmap v1858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:42.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:42 smithi033 ceph-mon[101165]: pgmap v1859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:42 smithi037 ceph-mon[69017]: pgmap v1859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:44.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:44 smithi033 ceph-mon[101165]: pgmap v1860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:44 smithi037 ceph-mon[69017]: pgmap v1860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:46 smithi033 ceph-mon[101165]: pgmap v1861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:46 smithi037 ceph-mon[69017]: pgmap v1861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:48.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:48 smithi033 ceph-mon[101165]: pgmap v1862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:48 smithi037 ceph-mon[69017]: pgmap v1862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:50 smithi033 ceph-mon[101165]: pgmap v1863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:50 smithi037 ceph-mon[69017]: pgmap v1863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:52 smithi033 ceph-mon[101165]: pgmap v1864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:52 smithi037 ceph-mon[69017]: pgmap v1864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:54 smithi033 ceph-mon[101165]: pgmap v1865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:40:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:40:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:54 smithi037 ceph-mon[69017]: pgmap v1865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:40:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:40:55.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 -- 172.21.15.33:0/3784650926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f66d0 msgr2=0x7efdfc0f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 --2- 172.21.15.33:0/3784650926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f66d0 0x7efdfc0f6af0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7efdec004660 tx=0x7efdec009b30).stop 2022-02-02T14:40:55.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 -- 172.21.15.33:0/3784650926 shutdown_connections 2022-02-02T14:40:55.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 --2- 172.21.15.33:0/3784650926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f7970 0x7efdfc0f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 --2- 172.21.15.33:0/3784650926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f66d0 0x7efdfc0f6af0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 -- 172.21.15.33:0/3784650926 >> 172.21.15.33:0/3784650926 conn(0x7efdfc0f1e10 msgr2=0x7efdfc0f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:55.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 -- 172.21.15.33:0/3784650926 shutdown_connections 2022-02-02T14:40:55.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.635+0000 7efe014e8700 1 -- 172.21.15.33:0/3784650926 wait complete. 2022-02-02T14:40:55.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 Processor -- start 2022-02-02T14:40:55.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 -- start start 2022-02-02T14:40:55.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f66d0 0x7efdfc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06a380 con 0x7efdfc0f7970 2022-02-02T14:40:55.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efe014e8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc06a4c0 con 0x7efdfc0f66d0 2022-02-02T14:40:55.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34018/0 (socket says 172.21.15.33:34018) 2022-02-02T14:40:55.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 -- 172.21.15.33:0/52188818 learned_addr learned my addr 172.21.15.33:0/52188818 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:55.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfaffd700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f66d0 0x7efdfc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 -- 172.21.15.33:0/52188818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f66d0 msgr2=0x7efdfc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f66d0 0x7efdfc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.636+0000 7efdfa7fc700 1 -- 172.21.15.33:0/52188818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdec005040 con 0x7efdfc0f7970 2022-02-02T14:40:55.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efdfa7fc700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7efdf000e7f0 tx=0x7efdf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf00092e0 con 0x7efdfc0f7970 2022-02-02T14:40:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc06a7a0 con 0x7efdfc0f7970 2022-02-02T14:40:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efdf000f040 con 0x7efdfc0f7970 2022-02-02T14:40:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdf0014750 con 0x7efdfc0f7970 2022-02-02T14:40:55.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.637+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc10ef80 con 0x7efdfc0f7970 2022-02-02T14:40:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.638+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc004fa0 con 0x7efdfc0f7970 2022-02-02T14:40:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.639+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efdf001b030 con 0x7efdfc0f7970 2022-02-02T14:40:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.639+0000 7efde37fe700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 0x7efde4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.639+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efdf00817d0 con 0x7efdfc0f7970 2022-02-02T14:40:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.639+0000 7efdfaffd700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 0x7efde4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.640+0000 7efdfaffd700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 0x7efde4067290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7efdec000c00 tx=0x7efdec016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:55.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.644+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efdf004f8d0 con 0x7efdfc0f7970 2022-02-02T14:40:55.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.833+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efddc000bc0 con 0x7efde4064dd0 2022-02-02T14:40:55.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.835+0000 7efde37fe700 1 -- 172.21.15.33:0/52188818 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7efddc000bc0 con 0x7efde4064dd0 2022-02-02T14:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.836+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 msgr2=0x7efde4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.836+0000 7efe014e8700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 0x7efde4067290 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7efdec000c00 tx=0x7efdec016040).stop 2022-02-02T14:40:55.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.836+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 msgr2=0x7efdfc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.836+0000 7efe014e8700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7efdf000e7f0 tx=0x7efdf000b040).stop 2022-02-02T14:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.836+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 shutdown_connections 2022-02-02T14:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064dd0 0x7efde4067290 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0f66d0 0x7efdfc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 --2- 172.21.15.33:0/52188818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdfc0f7970 0x7efdfc069e20 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 >> 172.21.15.33:0/52188818 conn(0x7efdfc0f1e10 msgr2=0x7efdfc0fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 shutdown_connections 2022-02-02T14:40:55.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.837+0000 7efe014e8700 1 -- 172.21.15.33:0/52188818 wait complete. 2022-02-02T14:40:55.847 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:40:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 -- 172.21.15.33:0/362335042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 msgr2=0x7f527c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 --2- 172.21.15.33:0/362335042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c0f59e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f5278004660 tx=0x7f5278009b30).stop 2022-02-02T14:40:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 -- 172.21.15.33:0/362335042 shutdown_connections 2022-02-02T14:40:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 --2- 172.21.15.33:0/362335042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 0x7f527c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 --2- 172.21.15.33:0/362335042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c0f59e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 -- 172.21.15.33:0/362335042 >> 172.21.15.33:0/362335042 conn(0x7f527c0f0d40 msgr2=0x7f527c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 -- 172.21.15.33:0/362335042 shutdown_connections 2022-02-02T14:40:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.938+0000 7f5283b04700 1 -- 172.21.15.33:0/362335042 wait complete. 2022-02-02T14:40:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 Processor -- start 2022-02-02T14:40:55.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 -- start start 2022-02-02T14:40:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 0x7f527c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c060420 con 0x7f527c0f55c0 2022-02-02T14:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f5283b04700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c060560 con 0x7f527c0f6860 2022-02-02T14:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f52818a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f52818a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34026/0 (socket says 172.21.15.33:34026) 2022-02-02T14:40:55.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.939+0000 7f52818a0700 1 -- 172.21.15.33:0/2182466024 learned_addr learned my addr 172.21.15.33:0/2182466024 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f528109f700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 0x7f527c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f52818a0700 1 -- 172.21.15.33:0/2182466024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 msgr2=0x7f527c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f52818a0700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 0x7f527c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f52818a0700 1 -- 172.21.15.33:0/2182466024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278005040 con 0x7f527c0f55c0 2022-02-02T14:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f52818a0700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f5278004f60 tx=0x7f5278009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5278018070 con 0x7f527c0f55c0 2022-02-02T14:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c10c720 con 0x7f527c0f55c0 2022-02-02T14:40:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5278009770 con 0x7f527c0f55c0 2022-02-02T14:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c10cc50 con 0x7f527c0f55c0 2022-02-02T14:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.940+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527801c3c0 con 0x7f527c0f55c0 2022-02-02T14:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.941+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0f49b0 con 0x7f527c0f55c0 2022-02-02T14:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.942+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f527801d420 con 0x7f527c0f55c0 2022-02-02T14:40:55.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.942+0000 7f526e7fc700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 0x7f5268067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.942+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5278083870 con 0x7f527c0f55c0 2022-02-02T14:40:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.942+0000 7f528109f700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 0x7f5268067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.942+0000 7f528109f700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 0x7f5268067290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f5270004aa0 tx=0x7f5270009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:55.946+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5278051920 con 0x7f527c0f55c0 2022-02-02T14:40:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.128+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f527c0008d0 con 0x7f5268064dd0 2022-02-02T14:40:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.143+0000 7f526e7fc700 1 -- 172.21.15.33:0/2182466024 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f527c0008d0 con 0x7f5268064dd0 2022-02-02T14:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (66m) 28m ago 67m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (59m) 28m ago 67m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:40:56.144 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (59m) 28m ago 66m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:40:56.145 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (66m) 28m ago 66m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:40:56.145 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (59m) 28m ago 63m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:40:56.145 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (60m) 28m ago 63m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:40:56.145 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (61m) 28m ago 63m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:40:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (63m) 28m ago 63m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:40:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (60m) 28m ago 68m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:40:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (60m) 28m ago 66m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:40:56.146 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (60m) 28m ago 68m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:40:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (59m) 28m ago 66m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:40:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (66m) 28m ago 66m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:40:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (66m) 28m ago 66m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:40:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 28m ago 65m - 4096M 2022-02-02T14:40:56.147 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (65m) 28m ago 65m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:40:56.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (65m) 28m ago 65m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:40:56.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (65m) 28m ago 65m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:40:56.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (64m) 28m ago 64m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:40:56.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (64m) 28m ago 64m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:40:56.149 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (66m) 28m ago 66m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:40:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 msgr2=0x7f5268067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 0x7f5268067290 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f5270004aa0 tx=0x7f5270009040).stop 2022-02-02T14:40:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 msgr2=0x7f527c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f5278004f60 tx=0x7f5278009b30).stop 2022-02-02T14:40:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 shutdown_connections 2022-02-02T14:40:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5268064dd0 0x7f5268067290 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f527c0f55c0 0x7f527c109c70 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 --2- 172.21.15.33:0/2182466024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f527c0f6860 0x7f527c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 >> 172.21.15.33:0/2182466024 conn(0x7f527c0f0d40 msgr2=0x7f527c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 shutdown_connections 2022-02-02T14:40:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.145+0000 7f5283b04700 1 -- 172.21.15.33:0/2182466024 wait complete. 2022-02-02T14:40:56.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2330671876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 msgr2=0x7fbf400fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2330671876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf400fbae0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7fbf2c004660 tx=0x7fbf2c009b30).stop 2022-02-02T14:40:56.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2330671876 shutdown_connections 2022-02-02T14:40:56.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2330671876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf400fbae0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2330671876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 0x7fbf400f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2330671876 >> 172.21.15.33:0/2330671876 conn(0x7fbf400f0b90 msgr2=0x7fbf400f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:56.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2330671876 shutdown_connections 2022-02-02T14:40:56.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2330671876 wait complete. 2022-02-02T14:40:56.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 Processor -- start 2022-02-02T14:40:56.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.245+0000 7fbf45bbc700 1 -- start start 2022-02-02T14:40:56.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf45bbc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 0x7fbf40108f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf45bbc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf45bbc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40109a10 con 0x7fbf400f9690 2022-02-02T14:40:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf45bbc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40109b50 con 0x7fbf40060310 2022-02-02T14:40:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34038/0 (socket says 172.21.15.33:34038) 2022-02-02T14:40:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 -- 172.21.15.33:0/2758811872 learned_addr learned my addr 172.21.15.33:0/2758811872 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf44bba700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 0x7fbf40108f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 -- 172.21.15.33:0/2758811872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 msgr2=0x7fbf40108f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 0x7fbf40108f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 -- 172.21.15.33:0/2758811872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c005040 con 0x7fbf400f9690 2022-02-02T14:40:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3ffff700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fbf2c013a70 tx=0x7fbf2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2c018070 con 0x7fbf400f9690 2022-02-02T14:40:56.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf2c0097d0 con 0x7fbf400f9690 2022-02-02T14:40:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2c01de80 con 0x7fbf400f9690 2022-02-02T14:40:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.246+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4010a490 con 0x7fbf400f9690 2022-02-02T14:40:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.247+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4010a9a0 con 0x7fbf400f9690 2022-02-02T14:40:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.247+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf40045ad0 con 0x7fbf400f9690 2022-02-02T14:40:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.248+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbf2c007ba0 con 0x7fbf400f9690 2022-02-02T14:40:56.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.248+0000 7fbf3d7fa700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 0x7fbf300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.249+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbf2c0836a0 con 0x7fbf400f9690 2022-02-02T14:40:56.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.249+0000 7fbf44bba700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 0x7fbf300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.249+0000 7fbf44bba700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 0x7fbf300672e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbf34004c40 tx=0x7fbf3400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:56.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.253+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbf2c055180 con 0x7fbf400f9690 2022-02-02T14:40:56.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.498+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf4010b0f0 con 0x7fbf400f9690 2022-02-02T14:40:56.499 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:56 smithi033 ceph-mon[101165]: pgmap v1866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.498+0000 7fbf3d7fa700 1 -- 172.21.15.33:0/2758811872 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fbf2c054d70 con 0x7fbf400f9690 2022-02-02T14:40:56.500 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:40:56.500 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:40:56.500 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:40:56.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:56.501 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:40:56.501 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:40:56.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:56.502 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:40:56.502 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:40:56.502 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:56.502 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:40:56.502 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:40:56.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:40:56.503 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:40:56.503 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:40:56.503 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:40:56.504 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:40:56.504 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:40:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 msgr2=0x7fbf300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 0x7fbf300672e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fbf34004c40 tx=0x7fbf3400b040).stop 2022-02-02T14:40:56.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 msgr2=0x7fbf40109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7fbf2c013a70 tx=0x7fbf2c009b30).stop 2022-02-02T14:40:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 shutdown_connections 2022-02-02T14:40:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf30064e20 0x7fbf300672e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf40060310 0x7fbf40108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 --2- 172.21.15.33:0/2758811872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf400f9690 0x7fbf40109460 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 >> 172.21.15.33:0/2758811872 conn(0x7fbf400f0b90 msgr2=0x7fbf400f4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 shutdown_connections 2022-02-02T14:40:56.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.500+0000 7fbf45bbc700 1 -- 172.21.15.33:0/2758811872 wait complete. 2022-02-02T14:40:56.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 -- 172.21.15.33:0/2835036970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 msgr2=0x7fa5140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 --2- 172.21.15.33:0/2835036970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa5140f59e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7fa510004660 tx=0x7fa510009b30).stop 2022-02-02T14:40:56.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 -- 172.21.15.33:0/2835036970 shutdown_connections 2022-02-02T14:40:56.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 --2- 172.21.15.33:0/2835036970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 0x7fa5140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 --2- 172.21.15.33:0/2835036970 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa5140f59e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 -- 172.21.15.33:0/2835036970 >> 172.21.15.33:0/2835036970 conn(0x7fa5140f0d40 msgr2=0x7fa5140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:56.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 -- 172.21.15.33:0/2835036970 shutdown_connections 2022-02-02T14:40:56.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.601+0000 7fa51c53e700 1 -- 172.21.15.33:0/2835036970 wait complete. 2022-02-02T14:40:56.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 Processor -- start 2022-02-02T14:40:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 -- start start 2022-02-02T14:40:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 0x7fa51410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514060520 con 0x7fa5140f55c0 2022-02-02T14:40:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51c53e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514060660 con 0x7fa5140f6860 2022-02-02T14:40:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34046/0 (socket says 172.21.15.33:34046) 2022-02-02T14:40:56.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 -- 172.21.15.33:0/229433237 learned_addr learned my addr 172.21.15.33:0/229433237 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:40:56.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa519ad9700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 0x7fa51410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 -- 172.21.15.33:0/229433237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 msgr2=0x7fa51410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 0x7fa51410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 -- 172.21.15.33:0/229433237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa510005040 con 0x7fa5140f55c0 2022-02-02T14:40:56.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.602+0000 7fa51a2da700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fa510000c00 tx=0x7fa510009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:56.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.603+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa510018070 con 0x7fa5140f55c0 2022-02-02T14:40:56.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.603+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa510007d70 con 0x7fa5140f55c0 2022-02-02T14:40:56.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.603+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51410c720 con 0x7fa5140f55c0 2022-02-02T14:40:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.603+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa51001c620 con 0x7fa5140f55c0 2022-02-02T14:40:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.603+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51410cc50 con 0x7fa5140f55c0 2022-02-02T14:40:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.604+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa514045ad0 con 0x7fa5140f55c0 2022-02-02T14:40:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.604+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa51001c860 con 0x7fa5140f55c0 2022-02-02T14:40:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.605+0000 7fa50affd700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 0x7fa500067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:40:56.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.605+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa510083940 con 0x7fa5140f55c0 2022-02-02T14:40:56.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.605+0000 7fa519ad9700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 0x7fa500067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:40:56.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.605+0000 7fa519ad9700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 0x7fa500067270 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa5040041d0 tx=0x7fa504009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:40:56.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.609+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa5100519f0 con 0x7fa5140f55c0 2022-02-02T14:40:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:56 smithi037 ceph-mon[69017]: pgmap v1866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.819+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa5140fde70 con 0x7fa5140f55c0 2022-02-02T14:40:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.819+0000 7fa50affd700 1 -- 172.21.15.33:0/229433237 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa510055010 con 0x7fa5140f55c0 2022-02-02T14:40:56.820 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:40:56.820 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:40:56.821 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:40:56.821 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:40:56.821 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:56.821 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:40:56.822 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:40:56.822 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:40:56.822 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:40:56.822 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:40:56.823 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:40:56.823 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:40:56.823 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:40:56.823 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:40:56.824 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:40:56.824 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:40:56.824 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:40:56.824 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:40:56.824 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:40:56.825 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:40:56.825 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:40:56.825 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:40:56.825 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:40:56.826 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:40:56.826 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:40:56.826 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:40:56.826 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:40:56.826 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:40:56.827 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:40:56.827 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:40:56.827 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:40:56.827 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:56.828 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:40:56.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:40:56.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:56.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:56.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:56.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:40:56.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 msgr2=0x7fa500067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 0x7fa500067270 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa5040041d0 tx=0x7fa504009040).stop 2022-02-02T14:40:56.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 msgr2=0x7fa514109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:40:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7fa510000c00 tx=0x7fa510009b30).stop 2022-02-02T14:40:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 shutdown_connections 2022-02-02T14:40:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa500064db0 0x7fa500067270 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5140f55c0 0x7fa514109c70 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.821+0000 7fa51c53e700 1 --2- 172.21.15.33:0/229433237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5140f6860 0x7fa51410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:40:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.822+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 >> 172.21.15.33:0/229433237 conn(0x7fa5140f0d40 msgr2=0x7fa5140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:40:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.822+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 shutdown_connections 2022-02-02T14:40:56.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:40:56.822+0000 7fa51c53e700 1 -- 172.21.15.33:0/229433237 wait complete. 2022-02-02T14:40:56.833 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:40:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:57 smithi033 ceph-mon[101165]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:57 smithi033 ceph-mon[101165]: from='client.35994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2758811872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:40:57.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/229433237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:40:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:57 smithi037 ceph-mon[69017]: from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:57 smithi037 ceph-mon[69017]: from='client.35994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:40:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2758811872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:40:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/229433237' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:40:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:40:58 smithi037 ceph-mon[69017]: pgmap v1867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:40:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:40:58 smithi033 ceph-mon[101165]: pgmap v1867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:00 smithi037 ceph-mon[69017]: pgmap v1868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:00 smithi033 ceph-mon[101165]: pgmap v1868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:02 smithi033 ceph-mon[101165]: pgmap v1869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:02 smithi037 ceph-mon[69017]: pgmap v1869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:04 smithi033 ceph-mon[101165]: pgmap v1870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:04 smithi037 ceph-mon[69017]: pgmap v1870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:06.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:06 smithi033 ceph-mon[101165]: pgmap v1871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:06 smithi037 ceph-mon[69017]: pgmap v1871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:08 smithi033 ceph-mon[101165]: pgmap v1872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:08 smithi037 ceph-mon[69017]: pgmap v1872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:10 smithi033 ceph-mon[101165]: pgmap v1873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:10 smithi037 ceph-mon[69017]: pgmap v1873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:12 smithi033 ceph-mon[101165]: pgmap v1874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:12 smithi037 ceph-mon[69017]: pgmap v1874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:14 smithi033 ceph-mon[101165]: pgmap v1875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:14 smithi037 ceph-mon[69017]: pgmap v1875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:16 smithi033 ceph-mon[101165]: pgmap v1876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:16.792 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:16 smithi037 ceph-mon[69017]: pgmap v1876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:18 smithi033 ceph-mon[101165]: pgmap v1877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:18 smithi037 ceph-mon[69017]: pgmap v1877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:20 smithi033 ceph-mon[101165]: pgmap v1878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:20 smithi037 ceph-mon[69017]: pgmap v1878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:22 smithi033 ceph-mon[101165]: pgmap v1879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:22 smithi037 ceph-mon[69017]: pgmap v1879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:24 smithi033 ceph-mon[101165]: pgmap v1880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:24 smithi037 ceph-mon[69017]: pgmap v1880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:26 smithi033 ceph-mon[101165]: pgmap v1881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:26 smithi037 ceph-mon[69017]: pgmap v1881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1654311671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340602b0 msgr2=0x7f7f340fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1654311671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340602b0 0x7f7f340fb700 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f7f1c004660 tx=0x7f7f1c009b30).stop 2022-02-02T14:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1654311671 shutdown_connections 2022-02-02T14:41:26.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1654311671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340fbbf0 0x7f7f340fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1654311671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340602b0 0x7f7f340fb700 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1654311671 >> 172.21.15.33:0/1654311671 conn(0x7f7f340f0d40 msgr2=0x7f7f340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1654311671 shutdown_connections 2022-02-02T14:41:26.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.938+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1654311671 wait complete. 2022-02-02T14:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 Processor -- start 2022-02-02T14:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 -- start start 2022-02-02T14:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340602b0 0x7f7f341090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:26.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34109b80 con 0x7f7f340fbbf0 2022-02-02T14:41:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f38e3c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34109cc0 con 0x7f7f340602b0 2022-02-02T14:41:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34060/0 (socket says 172.21.15.33:34060) 2022-02-02T14:41:26.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.939+0000 7f7f31d9b700 1 -- 172.21.15.33:0/1285235244 learned_addr learned my addr 172.21.15.33:0/1285235244 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:26.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f3259c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340602b0 0x7f7f341090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:26.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f31d9b700 1 -- 172.21.15.33:0/1285235244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340602b0 msgr2=0x7f7f341090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:26.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f31d9b700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340602b0 0x7f7f341090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:26.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f31d9b700 1 -- 172.21.15.33:0/1285235244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c005040 con 0x7f7f340fbbf0 2022-02-02T14:41:26.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f31d9b700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f7f2400e7c0 tx=0x7f7f2400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:26.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f240092e0 con 0x7f7f340fbbf0 2022-02-02T14:41:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7f2400f040 con 0x7f7f340fbbf0 2022-02-02T14:41:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3410a660 con 0x7f7f340fbbf0 2022-02-02T14:41:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3410ac20 con 0x7f7f340fbbf0 2022-02-02T14:41:26.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.940+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f240147a0 con 0x7f7f340fbbf0 2022-02-02T14:41:26.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.941+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f34045ad0 con 0x7f7f340fbbf0 2022-02-02T14:41:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.942+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7f240077b0 con 0x7f7f340fbbf0 2022-02-02T14:41:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.942+0000 7f7f2affd700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 0x7f7f20067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.943+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7f24081cc0 con 0x7f7f340fbbf0 2022-02-02T14:41:26.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.943+0000 7f7f3259c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 0x7f7f20067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.943+0000 7f7f3259c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 0x7f7f20067290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f7f1c005010 tx=0x7f7f1c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:26.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:26.947+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7f240537a0 con 0x7f7f340fbbf0 2022-02-02T14:41:27.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.138+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f3410ae90 con 0x7f7f20064dd0 2022-02-02T14:41:27.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.140+0000 7f7f2affd700 1 -- 172.21.15.33:0/1285235244 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f7f3410ae90 con 0x7f7f20064dd0 2022-02-02T14:41:27.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 msgr2=0x7f7f20067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 0x7f7f20067290 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f7f1c005010 tx=0x7f7f1c016040).stop 2022-02-02T14:41:27.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 msgr2=0x7f7f341095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f7f2400e7c0 tx=0x7f7f2400b040).stop 2022-02-02T14:41:27.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 shutdown_connections 2022-02-02T14:41:27.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7f20064dd0 0x7f7f20067290 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f340602b0 0x7f7f341090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 --2- 172.21.15.33:0/1285235244 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f340fbbf0 0x7f7f341095d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.141+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 >> 172.21.15.33:0/1285235244 conn(0x7f7f340f0d40 msgr2=0x7f7f340f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.142+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 shutdown_connections 2022-02-02T14:41:27.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.142+0000 7f7f38e3c700 1 -- 172.21.15.33:0/1285235244 wait complete. 2022-02-02T14:41:27.151 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:41:27.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 -- 172.21.15.33:0/2217563107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f55c0 msgr2=0x7f39a40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 --2- 172.21.15.33:0/2217563107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f55c0 0x7f39a40f59e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 rx=0x7f3994004660 tx=0x7f3994009b30).stop 2022-02-02T14:41:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 -- 172.21.15.33:0/2217563107 shutdown_connections 2022-02-02T14:41:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 --2- 172.21.15.33:0/2217563107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f6860 0x7f39a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 --2- 172.21.15.33:0/2217563107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f55c0 0x7f39a40f59e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 -- 172.21.15.33:0/2217563107 >> 172.21.15.33:0/2217563107 conn(0x7f39a40f0d40 msgr2=0x7f39a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 -- 172.21.15.33:0/2217563107 shutdown_connections 2022-02-02T14:41:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 -- 172.21.15.33:0/2217563107 wait complete. 2022-02-02T14:41:27.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.243+0000 7f39a88b1700 1 Processor -- start 2022-02-02T14:41:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a88b1700 1 -- start start 2022-02-02T14:41:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a88b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f55c0 0x7f39a4109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a88b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a88b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4109ba0 con 0x7f39a40f6860 2022-02-02T14:41:27.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a88b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a4109ce0 con 0x7f39a40f55c0 2022-02-02T14:41:27.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34070/0 (socket says 172.21.15.33:34070) 2022-02-02T14:41:27.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 -- 172.21.15.33:0/803329474 learned_addr learned my addr 172.21.15.33:0/803329474 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:27.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a259c700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f55c0 0x7f39a4109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 -- 172.21.15.33:0/803329474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f55c0 msgr2=0x7f39a4109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f55c0 0x7f39a4109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 -- 172.21.15.33:0/803329474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3994005040 con 0x7f39a40f6860 2022-02-02T14:41:27.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f39a1d9b700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f399800e7f0 tx=0x7f399800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.244+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39980092e0 con 0x7f39a40f6860 2022-02-02T14:41:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.245+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f399800f040 con 0x7f39a40f6860 2022-02-02T14:41:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.245+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a410a680 con 0x7f39a40f6860 2022-02-02T14:41:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.245+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3998014750 con 0x7f39a40f6860 2022-02-02T14:41:27.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.245+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a410ac40 con 0x7f39a40f6860 2022-02-02T14:41:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.246+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a4045ad0 con 0x7f39a40f6860 2022-02-02T14:41:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.246+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f399801b030 con 0x7f39a40f6860 2022-02-02T14:41:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.246+0000 7f3992ffd700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 0x7f398c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.246+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f39980818a0 con 0x7f39a40f6860 2022-02-02T14:41:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.246+0000 7f39a259c700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 0x7f398c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.247+0000 7f39a259c700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 0x7f398c067290 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f3994004d80 tx=0x7f3994016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.251+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3998053430 con 0x7f39a40f6860 2022-02-02T14:41:27.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.433+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39a40faaa0 con 0x7f398c064dd0 2022-02-02T14:41:27.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.448+0000 7f3992ffd700 1 -- 172.21.15.33:0/803329474 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f39a40faaa0 con 0x7f398c064dd0 2022-02-02T14:41:27.448 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:41:27.448 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (66m) 28m ago 67m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:41:27.448 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (59m) 28m ago 67m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:41:27.449 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (59m) 28m ago 67m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:41:27.449 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (66m) 28m ago 67m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:41:27.449 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (60m) 28m ago 63m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:41:27.449 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (60m) 28m ago 63m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:41:27.450 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (61m) 28m ago 63m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:41:27.450 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (63m) 28m ago 63m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:41:27.450 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (61m) 28m ago 69m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:41:27.450 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (60m) 28m ago 67m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:41:27.451 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (60m) 28m ago 69m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:41:27.451 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (60m) 28m ago 67m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:41:27.451 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (67m) 28m ago 67m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:41:27.451 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (66m) 28m ago 66m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:41:27.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 28m ago 66m - 4096M 2022-02-02T14:41:27.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (66m) 28m ago 66m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:41:27.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (65m) 28m ago 65m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:41:27.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (65m) 28m ago 65m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:41:27.452 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (65m) 28m ago 65m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:41:27.453 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (65m) 28m ago 65m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:41:27.453 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (66m) 28m ago 67m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:41:27.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.450+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 msgr2=0x7f398c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.450+0000 7f39a88b1700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 0x7f398c067290 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f3994004d80 tx=0x7f3994016040).stop 2022-02-02T14:41:27.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.450+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 msgr2=0x7f39a41095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.450+0000 7f39a88b1700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f399800e7f0 tx=0x7f399800b040).stop 2022-02-02T14:41:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.450+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 shutdown_connections 2022-02-02T14:41:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f398c064dd0 0x7f398c067290 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a40f55c0 0x7f39a4109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 --2- 172.21.15.33:0/803329474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39a40f6860 0x7f39a41095f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 >> 172.21.15.33:0/803329474 conn(0x7f39a40f0d40 msgr2=0x7f39a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 shutdown_connections 2022-02-02T14:41:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.451+0000 7f39a88b1700 1 -- 172.21.15.33:0/803329474 wait complete. 2022-02-02T14:41:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 -- 172.21.15.33:0/1196356838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 msgr2=0x7f2a680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 --2- 172.21.15.33:0/1196356838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a680f7de0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f2a50004660 tx=0x7f2a50009b30).stop 2022-02-02T14:41:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 -- 172.21.15.33:0/1196356838 shutdown_connections 2022-02-02T14:41:27.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 --2- 172.21.15.33:0/1196356838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a680f7de0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 --2- 172.21.15.33:0/1196356838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 0x7f2a680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 -- 172.21.15.33:0/1196356838 >> 172.21.15.33:0/1196356838 conn(0x7f2a680f1e40 msgr2=0x7f2a680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 -- 172.21.15.33:0/1196356838 shutdown_connections 2022-02-02T14:41:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.551+0000 7f2a6d296700 1 -- 172.21.15.33:0/1196356838 wait complete. 2022-02-02T14:41:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 Processor -- start 2022-02-02T14:41:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 -- start start 2022-02-02T14:41:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 0x7f2a6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6806a380 con 0x7f2a680f7980 2022-02-02T14:41:27.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a6d296700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6806a4c0 con 0x7f2a680f66e0 2022-02-02T14:41:27.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34080/0 (socket says 172.21.15.33:34080) 2022-02-02T14:41:27.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.552+0000 7f2a667fc700 1 -- 172.21.15.33:0/2704099737 learned_addr learned my addr 172.21.15.33:0/2704099737 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:27.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a66ffd700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 0x7f2a6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a667fc700 1 -- 172.21.15.33:0/2704099737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 msgr2=0x7f2a6806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a667fc700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 0x7f2a6806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a667fc700 1 -- 172.21.15.33:0/2704099737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50005040 con 0x7f2a680f7980 2022-02-02T14:41:27.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a667fc700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f2a50009990 tx=0x7f2a50009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a50018070 con 0x7f2a680f7980 2022-02-02T14:41:27.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6806a740 con 0x7f2a680f7980 2022-02-02T14:41:27.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a50007ba0 con 0x7f2a680f7980 2022-02-02T14:41:27.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.553+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5001c3c0 con 0x7f2a680f7980 2022-02-02T14:41:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.554+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6806aca0 con 0x7f2a680f7980 2022-02-02T14:41:27.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.554+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a68045ad0 con 0x7f2a680f7980 2022-02-02T14:41:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.555+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a5001d420 con 0x7f2a680f7980 2022-02-02T14:41:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.555+0000 7f2a5f7fe700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 0x7f2a54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.555+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2a500836f0 con 0x7f2a680f7980 2022-02-02T14:41:27.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.556+0000 7f2a66ffd700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 0x7f2a54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.556+0000 7f2a66ffd700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 0x7f2a54067290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f2a6806b730 tx=0x7f2a5800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.560+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a50051860 con 0x7f2a680f7980 2022-02-02T14:41:27.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.806+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2a68027a00 con 0x7f2a680f7980 2022-02-02T14:41:27.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.806+0000 7f2a5f7fe700 1 -- 172.21.15.33:0/2704099737 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2a50054e80 con 0x7f2a680f7980 2022-02-02T14:41:27.807 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:41:27.807 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:41:27.807 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:41:27.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:27.808 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:41:27.808 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:41:27.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:27.808 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:41:27.809 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:41:27.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:27.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:41:27.809 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:41:27.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:27.810 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:41:27.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:41:27.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:41:27.811 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:41:27.811 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:41:27.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 msgr2=0x7f2a54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 0x7f2a54067290 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f2a6806b730 tx=0x7f2a5800b040).stop 2022-02-02T14:41:27.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 msgr2=0x7f2a68069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 rx=0x7f2a50009990 tx=0x7f2a50009b30).stop 2022-02-02T14:41:27.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 shutdown_connections 2022-02-02T14:41:27.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a54064dd0 0x7f2a54067290 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a680f66e0 0x7f2a6806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 --2- 172.21.15.33:0/2704099737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a680f7980 0x7f2a68069e20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 >> 172.21.15.33:0/2704099737 conn(0x7f2a680f1e40 msgr2=0x7f2a680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 shutdown_connections 2022-02-02T14:41:27.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.809+0000 7f2a6d296700 1 -- 172.21.15.33:0/2704099737 wait complete. 2022-02-02T14:41:27.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/3863273483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 msgr2=0x7f4b980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/3863273483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b980f59e0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7f4b88004660 tx=0x7f4b88009b30).stop 2022-02-02T14:41:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/3863273483 shutdown_connections 2022-02-02T14:41:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/3863273483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/3863273483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b980f59e0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/3863273483 >> 172.21.15.33:0/3863273483 conn(0x7f4b980f0d40 msgr2=0x7f4b980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/3863273483 shutdown_connections 2022-02-02T14:41:27.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.910+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/3863273483 wait complete. 2022-02-02T14:41:27.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 Processor -- start 2022-02-02T14:41:27.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 -- start start 2022-02-02T14:41:27.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b9810c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b980603c0 con 0x7f4b980f55c0 2022-02-02T14:41:27.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9cf9d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b98060500 con 0x7f4b980f6860 2022-02-02T14:41:27.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34088/0 (socket says 172.21.15.33:34088) 2022-02-02T14:41:27.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 -- 172.21.15.33:0/1155528054 learned_addr learned my addr 172.21.15.33:0/1155528054 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:27.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b95d9b700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b9810c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 -- 172.21.15.33:0/1155528054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 msgr2=0x7f4b9810c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:27.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b9810c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:27.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b9659c700 1 -- 172.21.15.33:0/1155528054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88005040 con 0x7f4b980f55c0 2022-02-02T14:41:27.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.911+0000 7f4b95d9b700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b9810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:41:27.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b9659c700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f4b88004f60 tx=0x7f4b88009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b88018070 con 0x7f4b980f55c0 2022-02-02T14:41:27.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b88007ba0 con 0x7f4b980f55c0 2022-02-02T14:41:27.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9810c6e0 con 0x7f4b980f55c0 2022-02-02T14:41:27.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b8801c620 con 0x7f4b980f55c0 2022-02-02T14:41:27.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.912+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9810cc10 con 0x7f4b980f55c0 2022-02-02T14:41:27.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.913+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b980f49b0 con 0x7f4b980f55c0 2022-02-02T14:41:27.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.913+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b8801d420 con 0x7f4b980f55c0 2022-02-02T14:41:27.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.914+0000 7f4b8effd700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 0x7f4b84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:27.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.914+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4b880838e0 con 0x7f4b980f55c0 2022-02-02T14:41:27.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.914+0000 7f4b95d9b700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 0x7f4b84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:27.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.914+0000 7f4b95d9b700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 0x7f4b84067290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f4b800041d0 tx=0x7f4b80009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:27.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:27.918+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b88051a50 con 0x7f4b980f55c0 2022-02-02T14:41:28.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.132+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b980fde90 con 0x7f4b980f55c0 2022-02-02T14:41:28.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.133+0000 7f4b8effd700 1 -- 172.21.15.33:0/1155528054 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4b88055070 con 0x7f4b980f55c0 2022-02-02T14:41:28.133 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:41:28.133 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:41:28.133 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:41:28.134 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:41:28.134 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:28.134 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:41:28.134 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:41:28.135 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:41:28.135 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:41:28.135 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:41:28.135 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:41:28.136 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:41:28.136 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:41:28.136 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:41:28.136 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:41:28.136 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:41:28.137 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:41:28.137 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:41:28.137 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:41:28.137 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:41:28.138 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:41:28.138 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:41:28.138 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:41:28.138 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:41:28.138 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:41:28.139 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:41:28.139 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:41:28.139 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:41:28.139 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:41:28.140 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:41:28.140 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:41:28.140 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:28.140 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:28.140 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:41:28.141 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:28.141 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:28.142 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:28.142 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:28.142 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:28.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.135+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 msgr2=0x7f4b84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:28.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.135+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 0x7f4b84067290 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f4b800041d0 tx=0x7f4b80009040).stop 2022-02-02T14:41:28.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.135+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 msgr2=0x7f4b98109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:28.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.135+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 rx=0x7f4b88004f60 tx=0x7f4b88009b30).stop 2022-02-02T14:41:28.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 shutdown_connections 2022-02-02T14:41:28.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b84064dd0 0x7f4b84067290 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:28.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b980f55c0 0x7f4b98109c90 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:28.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 --2- 172.21.15.33:0/1155528054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b980f6860 0x7f4b9810c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:28.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 >> 172.21.15.33:0/1155528054 conn(0x7f4b980f0d40 msgr2=0x7f4b980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:28.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 shutdown_connections 2022-02-02T14:41:28.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:28.136+0000 7f4b9cf9d700 1 -- 172.21.15.33:0/1155528054 wait complete. 2022-02-02T14:41:28.146 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:41:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:28 smithi033 ceph-mon[101165]: from='client.36006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:28 smithi033 ceph-mon[101165]: pgmap v1882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:28 smithi033 ceph-mon[101165]: from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:28.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2704099737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:41:28.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1155528054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:41:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:28 smithi037 ceph-mon[69017]: from='client.36006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:28 smithi037 ceph-mon[69017]: pgmap v1882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:28 smithi037 ceph-mon[69017]: from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:28.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2704099737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:41:28.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1155528054' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:41:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:30 smithi033 ceph-mon[101165]: pgmap v1883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:30 smithi037 ceph-mon[69017]: pgmap v1883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:32 smithi033 ceph-mon[101165]: pgmap v1884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:32 smithi037 ceph-mon[69017]: pgmap v1884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:34 smithi033 ceph-mon[101165]: pgmap v1885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:34 smithi037 ceph-mon[69017]: pgmap v1885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:36.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:36 smithi033 ceph-mon[101165]: pgmap v1886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:36 smithi037 ceph-mon[69017]: pgmap v1886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:38.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:38 smithi033 ceph-mon[101165]: pgmap v1887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:38 smithi037 ceph-mon[69017]: pgmap v1887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:40 smithi033 ceph-mon[101165]: pgmap v1888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:40 smithi037 ceph-mon[69017]: pgmap v1888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:42.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:42 smithi033 ceph-mon[101165]: pgmap v1889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:42 smithi037 ceph-mon[69017]: pgmap v1889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:44.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:44 smithi033 ceph-mon[101165]: pgmap v1890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:44 smithi037 ceph-mon[69017]: pgmap v1890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:46 smithi033 ceph-mon[101165]: pgmap v1891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:46 smithi037 ceph-mon[69017]: pgmap v1891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:48.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:48 smithi033 ceph-mon[101165]: pgmap v1892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:48 smithi037 ceph-mon[69017]: pgmap v1892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:50.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:50 smithi033 ceph-mon[101165]: pgmap v1893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:50 smithi037 ceph-mon[69017]: pgmap v1893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:52 smithi033 ceph-mon[101165]: pgmap v1894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:52 smithi037 ceph-mon[69017]: pgmap v1894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:54 smithi037 ceph-mon[69017]: pgmap v1895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:41:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:41:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:54 smithi033 ceph-mon[101165]: pgmap v1895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:41:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:41:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:56 smithi037 ceph-mon[69017]: pgmap v1896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:56 smithi033 ceph-mon[101165]: pgmap v1896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 -- 172.21.15.33:0/2734437438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 msgr2=0x7efdb80f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 --2- 172.21.15.33:0/2734437438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb80f5180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7efdac004660 tx=0x7efdac009b30).stop 2022-02-02T14:41:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 -- 172.21.15.33:0/2734437438 shutdown_connections 2022-02-02T14:41:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 --2- 172.21.15.33:0/2734437438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 0x7efdb80f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 --2- 172.21.15.33:0/2734437438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb80f5180 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 -- 172.21.15.33:0/2734437438 >> 172.21.15.33:0/2734437438 conn(0x7efdb80f04c0 msgr2=0x7efdb80f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 -- 172.21.15.33:0/2734437438 shutdown_connections 2022-02-02T14:41:58.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.251+0000 7efdbeec8700 1 -- 172.21.15.33:0/2734437438 wait complete. 2022-02-02T14:41:58.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 Processor -- start 2022-02-02T14:41:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 -- start start 2022-02-02T14:41:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 0x7efdb8107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81079f0 con 0x7efdb80f4d60 2022-02-02T14:41:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbeec8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8107b30 con 0x7efdb80f5f60 2022-02-02T14:41:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.252+0000 7efdbcc64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34098/0 (socket says 172.21.15.33:34098) 2022-02-02T14:41:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 -- 172.21.15.33:0/3926715227 learned_addr learned my addr 172.21.15.33:0/3926715227 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdb7fff700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 0x7efdb8107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 -- 172.21.15.33:0/3926715227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 msgr2=0x7efdb8107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 0x7efdb8107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 -- 172.21.15.33:0/3926715227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac005040 con 0x7efdb80f4d60 2022-02-02T14:41:58.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbcc64700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7efdac009990 tx=0x7efdac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdac018070 con 0x7efdb80f4d60 2022-02-02T14:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efdac007ca0 con 0x7efdb80f4d60 2022-02-02T14:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdac01c620 con 0x7efdb80f4d60 2022-02-02T14:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb8108470 con 0x7efdb80f4d60 2022-02-02T14:41:58.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.253+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb81089d0 con 0x7efdb80f4d60 2022-02-02T14:41:58.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.254+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8045ad0 con 0x7efdb80f4d60 2022-02-02T14:41:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.255+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efdac01d960 con 0x7efdb80f4d60 2022-02-02T14:41:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.256+0000 7efdb57fa700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.256+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efdac0838c0 con 0x7efdb80f4d60 2022-02-02T14:41:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.256+0000 7efdb7fff700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.256+0000 7efdb7fff700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 0x7efda8067290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efda4007fd0 tx=0x7efda4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.260+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efdac055420 con 0x7efdb80f4d60 2022-02-02T14:41:58.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.449+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efdb80fd6b0 con 0x7efda8064dd0 2022-02-02T14:41:58.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.450+0000 7efdb57fa700 1 -- 172.21.15.33:0/3926715227 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7efdb80fd6b0 con 0x7efda8064dd0 2022-02-02T14:41:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 msgr2=0x7efda8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 0x7efda8067290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7efda4007fd0 tx=0x7efda4009040).stop 2022-02-02T14:41:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 msgr2=0x7efdb8106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7efdac009990 tx=0x7efdac009b30).stop 2022-02-02T14:41:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 shutdown_connections 2022-02-02T14:41:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efda8064dd0 0x7efda8067290 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdb80f4d60 0x7efdb8106f50 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 --2- 172.21.15.33:0/3926715227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdb80f5f60 0x7efdb8107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 >> 172.21.15.33:0/3926715227 conn(0x7efdb80f04c0 msgr2=0x7efdb80fa530 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 shutdown_connections 2022-02-02T14:41:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.452+0000 7efdbeec8700 1 -- 172.21.15.33:0/3926715227 wait complete. 2022-02-02T14:41:58.462 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:41:58.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 -- 172.21.15.33:0/1402886902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 msgr2=0x7f9c340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 --2- 172.21.15.33:0/1402886902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c340f59e0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f9c30004660 tx=0x7f9c30009b30).stop 2022-02-02T14:41:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 -- 172.21.15.33:0/1402886902 shutdown_connections 2022-02-02T14:41:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 --2- 172.21.15.33:0/1402886902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 0x7f9c340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 --2- 172.21.15.33:0/1402886902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c340f59e0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 -- 172.21.15.33:0/1402886902 >> 172.21.15.33:0/1402886902 conn(0x7f9c340f0d40 msgr2=0x7f9c340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:58.557 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:58 smithi033 ceph-mon[101165]: pgmap v1897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:58.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 -- 172.21.15.33:0/1402886902 shutdown_connections 2022-02-02T14:41:58.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.555+0000 7f9c3c796700 1 -- 172.21.15.33:0/1402886902 wait complete. 2022-02-02T14:41:58.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 Processor -- start 2022-02-02T14:41:58.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 -- start start 2022-02-02T14:41:58.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 0x7f9c34109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34109c00 con 0x7f9c340f55c0 2022-02-02T14:41:58.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3c796700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c34109d40 con 0x7f9c340f6860 2022-02-02T14:41:58.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3a532700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3a532700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34108/0 (socket says 172.21.15.33:34108) 2022-02-02T14:41:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c3a532700 1 -- 172.21.15.33:0/3792526597 learned_addr learned my addr 172.21.15.33:0/3792526597 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.556+0000 7f9c39d31700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 0x7f9c34109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3a532700 1 -- 172.21.15.33:0/3792526597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 msgr2=0x7f9c34109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3a532700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 0x7f9c34109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3a532700 1 -- 172.21.15.33:0/3792526597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30005040 con 0x7f9c340f55c0 2022-02-02T14:41:58.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3a532700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f9c30013a70 tx=0x7f9c30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c30018070 con 0x7f9c340f55c0 2022-02-02T14:41:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c300097d0 con 0x7f9c340f55c0 2022-02-02T14:41:58.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3410a680 con 0x7f9c340f55c0 2022-02-02T14:41:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c3001de80 con 0x7f9c340f55c0 2022-02-02T14:41:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.557+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3410abe0 con 0x7f9c340f55c0 2022-02-02T14:41:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.558+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c34045ad0 con 0x7f9c340f55c0 2022-02-02T14:41:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.559+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c30007ba0 con 0x7f9c340f55c0 2022-02-02T14:41:58.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.559+0000 7f9c26ffd700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 0x7f9c20067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.559+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c300835f0 con 0x7f9c340f55c0 2022-02-02T14:41:58.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.559+0000 7f9c39d31700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 0x7f9c20067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.560+0000 7f9c39d31700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 0x7f9c20067290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f9c28004c40 tx=0x7f9c2800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.563+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c30055240 con 0x7f9c340f55c0 2022-02-02T14:41:58.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.743+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c340faaa0 con 0x7f9c20064dd0 2022-02-02T14:41:58.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.758+0000 7f9c26ffd700 1 -- 172.21.15.33:0/3792526597 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f9c340faaa0 con 0x7f9c20064dd0 2022-02-02T14:41:58.759 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:41:58.759 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (67m) 29m ago 68m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:41:58.759 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (60m) 29m ago 68m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:41:58.759 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (60m) 29m ago 67m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:41:58.760 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (67m) 29m ago 68m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:41:58.760 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (60m) 29m ago 64m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:41:58.760 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (61m) 29m ago 64m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:41:58.760 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (62m) 29m ago 64m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:41:58.760 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (64m) 29m ago 64m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:41:58.761 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (61m) 29m ago 69m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:41:58.761 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (61m) 29m ago 67m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:41:58.761 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (61m) 29m ago 69m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:41:58.761 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (60m) 29m ago 67m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:41:58.762 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (67m) 29m ago 67m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:41:58.762 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (67m) 29m ago 67m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:41:58.762 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 29m ago 66m - 4096M 2022-02-02T14:41:58.762 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (66m) 29m ago 66m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:41:58.763 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (66m) 29m ago 66m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:41:58.763 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (66m) 29m ago 66m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:41:58.763 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (65m) 29m ago 65m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:41:58.763 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (65m) 29m ago 65m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:41:58.763 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (67m) 29m ago 67m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:41:58.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 msgr2=0x7f9c20067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 0x7f9c20067290 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f9c28004c40 tx=0x7f9c2800b040).stop 2022-02-02T14:41:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 msgr2=0x7f9c34109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f9c30013a70 tx=0x7f9c30009b30).stop 2022-02-02T14:41:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 shutdown_connections 2022-02-02T14:41:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c20064dd0 0x7f9c20067290 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c340f55c0 0x7f9c34109160 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 --2- 172.21.15.33:0/3792526597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c340f6860 0x7f9c34109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 >> 172.21.15.33:0/3792526597 conn(0x7f9c340f0d40 msgr2=0x7f9c3405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 shutdown_connections 2022-02-02T14:41:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.760+0000 7f9c3c796700 1 -- 172.21.15.33:0/3792526597 wait complete. 2022-02-02T14:41:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:58 smithi037 ceph-mon[69017]: pgmap v1897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:41:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.859+0000 7f89fd49a700 1 -- 172.21.15.33:0/2398107855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 msgr2=0x7f89f80f7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.859+0000 7f89fd49a700 1 --2- 172.21.15.33:0/2398107855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f80f7c40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7f89ec004660 tx=0x7f89ec009b30).stop 2022-02-02T14:41:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 -- 172.21.15.33:0/2398107855 shutdown_connections 2022-02-02T14:41:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 --2- 172.21.15.33:0/2398107855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f80f7c40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 --2- 172.21.15.33:0/2398107855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 0x7f89f80f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 -- 172.21.15.33:0/2398107855 >> 172.21.15.33:0/2398107855 conn(0x7f89f80f1ca0 msgr2=0x7f89f80f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 -- 172.21.15.33:0/2398107855 shutdown_connections 2022-02-02T14:41:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.860+0000 7f89fd49a700 1 -- 172.21.15.33:0/2398107855 wait complete. 2022-02-02T14:41:58.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 Processor -- start 2022-02-02T14:41:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 -- start start 2022-02-02T14:41:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 0x7f89f806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806a380 con 0x7f89f80f77e0 2022-02-02T14:41:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89fd49a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f806a4c0 con 0x7f89f80f6540 2022-02-02T14:41:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89f67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89f67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34120/0 (socket says 172.21.15.33:34120) 2022-02-02T14:41:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89f67fc700 1 -- 172.21.15.33:0/3148278797 learned_addr learned my addr 172.21.15.33:0/3148278797 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:58.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.861+0000 7f89f6ffd700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 0x7f89f806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89f67fc700 1 -- 172.21.15.33:0/3148278797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 msgr2=0x7f89f806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:58.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89f67fc700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 0x7f89f806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:58.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89f67fc700 1 -- 172.21.15.33:0/3148278797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec005040 con 0x7f89f80f77e0 2022-02-02T14:41:58.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89f67fc700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f89ec000c00 tx=0x7f89ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec019070 con 0x7f89f80f77e0 2022-02-02T14:41:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f89ec007e70 con 0x7f89f80f77e0 2022-02-02T14:41:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f806a740 con 0x7f89f80f77e0 2022-02-02T14:41:58.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89ec014ce0 con 0x7f89f80f77e0 2022-02-02T14:41:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.862+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f806aca0 con 0x7f89f80f77e0 2022-02-02T14:41:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.864+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f89ec025070 con 0x7f89f80f77e0 2022-02-02T14:41:58.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.864+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8045ad0 con 0x7f89f80f77e0 2022-02-02T14:41:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.864+0000 7f89df7fe700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 0x7f89e00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.864+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f89ec0079c0 con 0x7f89f80f77e0 2022-02-02T14:41:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.864+0000 7f89f6ffd700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 0x7f89e00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:58.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.865+0000 7f89f6ffd700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 0x7f89e00672e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f89f806b730 tx=0x7f89e800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:58.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:58.868+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f89ec0518d0 con 0x7f89f80f77e0 2022-02-02T14:41:59.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.110+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f89f8027a00 con 0x7f89f80f77e0 2022-02-02T14:41:59.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.111+0000 7f89df7fe700 1 -- 172.21.15.33:0/3148278797 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f89ec023070 con 0x7f89f80f77e0 2022-02-02T14:41:59.112 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:41:59.113 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:41:59.113 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:41:59.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:59.114 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:41:59.115 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:41:59.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:59.115 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:41:59.116 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:41:59.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:59.117 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:41:59.117 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:41:59.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:41:59.118 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:41:59.118 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:41:59.119 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:41:59.119 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:41:59.120 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:41:59.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.112+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 msgr2=0x7f89e00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.112+0000 7f89fd49a700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 0x7f89e00672e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f89f806b730 tx=0x7f89e800b040).stop 2022-02-02T14:41:59.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 msgr2=0x7f89f8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7f89ec000c00 tx=0x7f89ec00b040).stop 2022-02-02T14:41:59.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 shutdown_connections 2022-02-02T14:41:59.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f89e0064e20 0x7f89e00672e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80f6540 0x7f89f806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 --2- 172.21.15.33:0/3148278797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89f80f77e0 0x7f89f8069e20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 >> 172.21.15.33:0/3148278797 conn(0x7f89f80f1ca0 msgr2=0x7f89f80fb230 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:59.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 shutdown_connections 2022-02-02T14:41:59.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.113+0000 7f89fd49a700 1 -- 172.21.15.33:0/3148278797 wait complete. 2022-02-02T14:41:59.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 -- 172.21.15.33:0/2979838619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 msgr2=0x7f4c240f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 --2- 172.21.15.33:0/2979838619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f4820 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f4c18004660 tx=0x7f4c18009b30).stop 2022-02-02T14:41:59.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 -- 172.21.15.33:0/2979838619 shutdown_connections 2022-02-02T14:41:59.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 --2- 172.21.15.33:0/2979838619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f4820 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 --2- 172.21.15.33:0/2979838619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 0x7f4c240f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 -- 172.21.15.33:0/2979838619 >> 172.21.15.33:0/2979838619 conn(0x7f4c240f0540 msgr2=0x7f4c240f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 -- 172.21.15.33:0/2979838619 shutdown_connections 2022-02-02T14:41:59.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.214+0000 7f4c2997f700 1 -- 172.21.15.33:0/2979838619 wait complete. 2022-02-02T14:41:59.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 Processor -- start 2022-02-02T14:41:59.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 -- start start 2022-02-02T14:41:59.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 0x7f4c240f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:59.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240f5fb0 con 0x7f4c240f8610 2022-02-02T14:41:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c2997f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240f60f0 con 0x7f4c240f7d00 2022-02-02T14:41:59.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:59.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34130/0 (socket says 172.21.15.33:34130) 2022-02-02T14:41:59.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c227fc700 1 -- 172.21.15.33:0/569224758 learned_addr learned my addr 172.21.15.33:0/569224758 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:41:59.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.215+0000 7f4c22ffd700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 0x7f4c240f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:59.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c227fc700 1 -- 172.21.15.33:0/569224758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 msgr2=0x7f4c240f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c227fc700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 0x7f4c240f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c227fc700 1 -- 172.21.15.33:0/569224758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c18005040 con 0x7f4c240f8610 2022-02-02T14:41:59.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c227fc700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f4c18009990 tx=0x7f4c18009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c18018070 con 0x7f4c240f8610 2022-02-02T14:41:59.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c18007ca0 con 0x7f4c240f8610 2022-02-02T14:41:59.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c240f6370 con 0x7f4c240f8610 2022-02-02T14:41:59.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c1801c620 con 0x7f4c240f8610 2022-02-02T14:41:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.216+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c240f68d0 con 0x7f4c240f8610 2022-02-02T14:41:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.217+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c24045ad0 con 0x7f4c240f8610 2022-02-02T14:41:59.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.217+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c1801d960 con 0x7f4c240f8610 2022-02-02T14:41:59.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.218+0000 7f4c0b7fe700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 0x7f4c0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:41:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.218+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c18083750 con 0x7f4c240f8610 2022-02-02T14:41:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.218+0000 7f4c22ffd700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 0x7f4c0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:41:59.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.218+0000 7f4c22ffd700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 0x7f4c0c067290 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4c140041d0 tx=0x7f4c14009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:41:59.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.222+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c18051800 con 0x7f4c240f8610 2022-02-02T14:41:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.430+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4c24027a00 con 0x7f4c240f8610 2022-02-02T14:41:59.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.431+0000 7f4c0b7fe700 1 -- 172.21.15.33:0/569224758 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4c18054e20 con 0x7f4c240f8610 2022-02-02T14:41:59.432 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:41:59.432 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:41:59.432 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:41:59.433 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:41:59.433 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:59.433 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:41:59.433 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:41:59.434 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:41:59.434 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:41:59.434 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:41:59.434 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:41:59.434 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:41:59.435 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:41:59.435 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:41:59.435 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:41:59.435 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:41:59.436 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:41:59.436 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:41:59.436 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:41:59.436 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:41:59.437 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:41:59.437 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:41:59.437 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:41:59.437 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:41:59.437 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:41:59.438 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:41:59.438 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:41:59.438 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:41:59.438 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:41:59.439 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:41:59.439 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:41:59.439 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:59.439 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:59.439 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:41:59.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:41:59.440 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:59.440 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:59.440 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:59.441 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:41:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 msgr2=0x7f4c0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 0x7f4c0c067290 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f4c140041d0 tx=0x7f4c14009040).stop 2022-02-02T14:41:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 msgr2=0x7f4c240f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:41:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f4c18009990 tx=0x7f4c18009b30).stop 2022-02-02T14:41:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 shutdown_connections 2022-02-02T14:41:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c0c064dd0 0x7f4c0c067290 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c240f7d00 0x7f4c240f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 --2- 172.21.15.33:0/569224758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c240f8610 0x7f4c240f5a50 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:41:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 >> 172.21.15.33:0/569224758 conn(0x7f4c240f0540 msgr2=0x7f4c240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:41:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 shutdown_connections 2022-02-02T14:41:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:41:59.433+0000 7f4c2997f700 1 -- 172.21.15.33:0/569224758 wait complete. 2022-02-02T14:41:59.444 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:41:59.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:59 smithi033 ceph-mon[101165]: from='client.36022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:59.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3148278797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:41:59.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:41:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/569224758' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:41:59.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:59 smithi037 ceph-mon[69017]: from='client.36022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:41:59.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3148278797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:41:59.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:41:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/569224758' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:42:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:00 smithi037 ceph-mon[69017]: from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:00 smithi037 ceph-mon[69017]: pgmap v1898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:00 smithi033 ceph-mon[101165]: from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:00 smithi033 ceph-mon[101165]: pgmap v1898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:02 smithi033 ceph-mon[101165]: pgmap v1899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:02 smithi037 ceph-mon[69017]: pgmap v1899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:04 smithi033 ceph-mon[101165]: pgmap v1900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:04 smithi037 ceph-mon[69017]: pgmap v1900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:06 smithi033 ceph-mon[101165]: pgmap v1901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:06 smithi037 ceph-mon[69017]: pgmap v1901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:08 smithi033 ceph-mon[101165]: pgmap v1902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:08 smithi037 ceph-mon[69017]: pgmap v1902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:10 smithi033 ceph-mon[101165]: pgmap v1903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:10 smithi037 ceph-mon[69017]: pgmap v1903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:12 smithi033 ceph-mon[101165]: pgmap v1904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:12 smithi037 ceph-mon[69017]: pgmap v1904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:14 smithi033 ceph-mon[101165]: pgmap v1905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:14 smithi037 ceph-mon[69017]: pgmap v1905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:16 smithi033 ceph-mon[101165]: pgmap v1906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:16 smithi037 ceph-mon[69017]: pgmap v1906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:18 smithi033 ceph-mon[101165]: pgmap v1907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:18 smithi037 ceph-mon[69017]: pgmap v1907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:20 smithi033 ceph-mon[101165]: pgmap v1908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:20 smithi037 ceph-mon[69017]: pgmap v1908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:22.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:22 smithi033 ceph-mon[101165]: pgmap v1909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:22 smithi037 ceph-mon[69017]: pgmap v1909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:24.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:24 smithi033 ceph-mon[101165]: pgmap v1910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:24 smithi037 ceph-mon[69017]: pgmap v1910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:26.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:26 smithi033 ceph-mon[101165]: pgmap v1911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:26 smithi037 ceph-mon[69017]: pgmap v1911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:28 smithi033 ceph-mon[101165]: pgmap v1912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:28 smithi037 ceph-mon[69017]: pgmap v1912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 -- 172.21.15.33:0/3304183266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f77d0 msgr2=0x7f69f80f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 --2- 172.21.15.33:0/3304183266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f77d0 0x7f69f80f7c30 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 rx=0x7f69ec004660 tx=0x7f69ec009b30).stop 2022-02-02T14:42:29.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 -- 172.21.15.33:0/3304183266 shutdown_connections 2022-02-02T14:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 --2- 172.21.15.33:0/3304183266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f77d0 0x7f69f80f7c30 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 --2- 172.21.15.33:0/3304183266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f6530 0x7f69f80f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 -- 172.21.15.33:0/3304183266 >> 172.21.15.33:0/3304183266 conn(0x7f69f80f1c90 msgr2=0x7f69f80f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 -- 172.21.15.33:0/3304183266 shutdown_connections 2022-02-02T14:42:29.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 -- 172.21.15.33:0/3304183266 wait complete. 2022-02-02T14:42:29.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.551+0000 7f69fd13b700 1 Processor -- start 2022-02-02T14:42:29.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69fd13b700 1 -- start start 2022-02-02T14:42:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69fd13b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69fd13b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f77d0 0x7f69f8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69fd13b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8107880 con 0x7f69f80f6530 2022-02-02T14:42:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69fd13b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8108090 con 0x7f69f80f77d0 2022-02-02T14:42:29.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34138/0 (socket says 172.21.15.33:34138) 2022-02-02T14:42:29.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 -- 172.21.15.33:0/2641626759 learned_addr learned my addr 172.21.15.33:0/2641626759 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:42:29.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f77fe700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f77d0 0x7f69f8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 -- 172.21.15.33:0/2641626759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f77d0 msgr2=0x7f69f8107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f77d0 0x7f69f8107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 -- 172.21.15.33:0/2641626759 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec005040 con 0x7f69f80f6530 2022-02-02T14:42:29.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.552+0000 7f69f7fff700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f69e8002700 tx=0x7f69e8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:29.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.553+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e80079c0 con 0x7f69f80f6530 2022-02-02T14:42:29.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.553+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69e800f040 con 0x7f69f80f6530 2022-02-02T14:42:29.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.553+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8108310 con 0x7f69f80f6530 2022-02-02T14:42:29.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.553+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e8014860 con 0x7f69f80f6530 2022-02-02T14:42:29.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.553+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f81088d0 con 0x7f69f80f6530 2022-02-02T14:42:29.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.554+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f8059100 con 0x7f69f80f6530 2022-02-02T14:42:29.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.554+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f69e801b060 con 0x7f69f80f6530 2022-02-02T14:42:29.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.555+0000 7f69f4ff9700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 0x7f69e00673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.555+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f69e8081770 con 0x7f69f80f6530 2022-02-02T14:42:29.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.555+0000 7f69f77fe700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 0x7f69e00673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.555+0000 7f69f77fe700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 0x7f69e00673b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f69ec004630 tx=0x7f69ec009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:29.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.559+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69e804f8a0 con 0x7f69f80f6530 2022-02-02T14:42:29.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.747+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69f80fedd0 con 0x7f69e0064ef0 2022-02-02T14:42:29.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.748+0000 7f69f4ff9700 1 -- 172.21.15.33:0/2641626759 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f69f80fedd0 con 0x7f69e0064ef0 2022-02-02T14:42:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 msgr2=0x7f69e00673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 0x7f69e00673b0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f69ec004630 tx=0x7f69ec009b30).stop 2022-02-02T14:42:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 msgr2=0x7f69f8106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f69e8002700 tx=0x7f69e8009d80).stop 2022-02-02T14:42:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 shutdown_connections 2022-02-02T14:42:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69e0064ef0 0x7f69e00673b0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f80f6530 0x7f69f8106d90 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 --2- 172.21.15.33:0/2641626759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f80f77d0 0x7f69f8107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 >> 172.21.15.33:0/2641626759 conn(0x7f69f80f1c90 msgr2=0x7f69f80fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:29.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 shutdown_connections 2022-02-02T14:42:29.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.750+0000 7f69fd13b700 1 -- 172.21.15.33:0/2641626759 wait complete. 2022-02-02T14:42:29.759 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:42:29.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 -- 172.21.15.33:0/4243723993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef4060310 msgr2=0x7f3ef40f92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 --2- 172.21.15.33:0/4243723993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef4060310 0x7f3ef40f92a0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f3ee8004660 tx=0x7f3ee8009b30).stop 2022-02-02T14:42:29.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 -- 172.21.15.33:0/4243723993 shutdown_connections 2022-02-02T14:42:29.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 --2- 172.21.15.33:0/4243723993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef40f9820 0x7f3ef40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 --2- 172.21.15.33:0/4243723993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef4060310 0x7f3ef40f92a0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 -- 172.21.15.33:0/4243723993 >> 172.21.15.33:0/4243723993 conn(0x7f3ef40f0d40 msgr2=0x7f3ef40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:29.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 -- 172.21.15.33:0/4243723993 shutdown_connections 2022-02-02T14:42:29.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.851+0000 7f3efaca5700 1 -- 172.21.15.33:0/4243723993 wait complete. 2022-02-02T14:42:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 Processor -- start 2022-02-02T14:42:29.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 -- start start 2022-02-02T14:42:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 0x7f3ef4106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4107980 con 0x7f3ef40f9820 2022-02-02T14:42:29.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3efaca5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef4107ac0 con 0x7f3ef4060310 2022-02-02T14:42:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3ef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34150/0 (socket says 172.21.15.33:34150) 2022-02-02T14:42:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.852+0000 7f3ef3fff700 1 -- 172.21.15.33:0/2179989355 learned_addr learned my addr 172.21.15.33:0/2179989355 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:42:29.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef8a41700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 0x7f3ef4106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef3fff700 1 -- 172.21.15.33:0/2179989355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 msgr2=0x7f3ef4106ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef3fff700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 0x7f3ef4106ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef3fff700 1 -- 172.21.15.33:0/2179989355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee8005040 con 0x7f3ef40f9820 2022-02-02T14:42:29.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef8a41700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 0x7f3ef4106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:42:29.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef3fff700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f3ee000e7c0 tx=0x7f3ee000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:29.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee00092e0 con 0x7f3ef40f9820 2022-02-02T14:42:29.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ee000f040 con 0x7f3ef40f9820 2022-02-02T14:42:29.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef4108400 con 0x7f3ef40f9820 2022-02-02T14:42:29.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ee00147a0 con 0x7f3ef40f9820 2022-02-02T14:42:29.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.853+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef41089c0 con 0x7f3ef40f9820 2022-02-02T14:42:29.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.854+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef4045ad0 con 0x7f3ef40f9820 2022-02-02T14:42:29.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.855+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ee0014a60 con 0x7f3ef40f9820 2022-02-02T14:42:29.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.855+0000 7f3ef17fa700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 0x7f3ee4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.855+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3ee0081e70 con 0x7f3ef40f9820 2022-02-02T14:42:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.855+0000 7f3ef8a41700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 0x7f3ee4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:29.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.856+0000 7f3ef8a41700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 0x7f3ee4067290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f3ee8004d80 tx=0x7f3ee800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:29.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:29.860+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ee0053950 con 0x7f3ef40f9820 2022-02-02T14:42:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.044+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ef40fefb0 con 0x7f3ee4064dd0 2022-02-02T14:42:30.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.059+0000 7f3ef17fa700 1 -- 172.21.15.33:0/2179989355 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3ef40fefb0 con 0x7f3ee4064dd0 2022-02-02T14:42:30.058 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:42:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (67m) 29m ago 68m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:42:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (60m) 29m ago 68m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:42:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (60m) 29m ago 68m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:42:30.060 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (67m) 29m ago 68m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:42:30.061 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (61m) 29m ago 64m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:42:30.061 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (61m) 29m ago 64m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:42:30.061 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (62m) 29m ago 65m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:42:30.061 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (64m) 29m ago 64m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:42:30.062 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (62m) 29m ago 70m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:42:30.062 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (61m) 29m ago 68m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:42:30.062 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (61m) 29m ago 70m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:42:30.062 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (61m) 29m ago 68m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:42:30.063 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (68m) 29m ago 68m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:42:30.063 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (68m) 29m ago 68m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:42:30.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 29m ago 67m - 4096M 2022-02-02T14:42:30.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (67m) 29m ago 67m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:42:30.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (66m) 29m ago 66m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:42:30.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (66m) 29m ago 66m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:42:30.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (66m) 29m ago 66m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:42:30.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (66m) 29m ago 66m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:42:30.065 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (67m) 29m ago 68m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:42:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 msgr2=0x7f3ee4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 0x7f3ee4067290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f3ee8004d80 tx=0x7f3ee800b040).stop 2022-02-02T14:42:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 msgr2=0x7f3ef41073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 rx=0x7f3ee000e7c0 tx=0x7f3ee000b040).stop 2022-02-02T14:42:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 shutdown_connections 2022-02-02T14:42:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ee4064dd0 0x7f3ee4067290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ef4060310 0x7f3ef4106ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 --2- 172.21.15.33:0/2179989355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ef40f9820 0x7f3ef41073d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 >> 172.21.15.33:0/2179989355 conn(0x7f3ef40f0d40 msgr2=0x7f3ef40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 shutdown_connections 2022-02-02T14:42:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.061+0000 7f3efaca5700 1 -- 172.21.15.33:0/2179989355 wait complete. 2022-02-02T14:42:30.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 -- 172.21.15.33:0/295492396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f55c0 msgr2=0x7f4ee80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 --2- 172.21.15.33:0/295492396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f55c0 0x7f4ee80f59e0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f4ee4004660 tx=0x7f4ee4009b30).stop 2022-02-02T14:42:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 -- 172.21.15.33:0/295492396 shutdown_connections 2022-02-02T14:42:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 --2- 172.21.15.33:0/295492396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f6860 0x7f4ee80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 --2- 172.21.15.33:0/295492396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f55c0 0x7f4ee80f59e0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 -- 172.21.15.33:0/295492396 >> 172.21.15.33:0/295492396 conn(0x7f4ee80f0d40 msgr2=0x7f4ee80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 -- 172.21.15.33:0/295492396 shutdown_connections 2022-02-02T14:42:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.161+0000 7f4eef42f700 1 -- 172.21.15.33:0/295492396 wait complete. 2022-02-02T14:42:30.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 Processor -- start 2022-02-02T14:42:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 -- start start 2022-02-02T14:42:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 0x7f4ee8109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80603e0 con 0x7f4ee80f6860 2022-02-02T14:42:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eef42f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee8060520 con 0x7f4ee80f55c0 2022-02-02T14:42:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eec9ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eec9ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34160/0 (socket says 172.21.15.33:34160) 2022-02-02T14:42:30.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eec9ca700 1 -- 172.21.15.33:0/660857464 learned_addr learned my addr 172.21.15.33:0/660857464 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:42:30.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.162+0000 7f4eed1cb700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 0x7f4ee8109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eed1cb700 1 -- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 msgr2=0x7f4ee810c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eed1cb700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eed1cb700 1 -- 172.21.15.33:0/660857464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4005040 con 0x7f4ee80f55c0 2022-02-02T14:42:30.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eec9ca700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:42:30.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eed1cb700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 0x7f4ee8109bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4ee80f66c0 tx=0x7f4ee400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:30.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee4019070 con 0x7f4ee80f55c0 2022-02-02T14:42:30.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4ee4007e70 con 0x7f4ee80f55c0 2022-02-02T14:42:30.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ee4014c20 con 0x7f4ee80f55c0 2022-02-02T14:42:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee810c640 con 0x7f4ee80f55c0 2022-02-02T14:42:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.163+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee810cb50 con 0x7f4ee80f55c0 2022-02-02T14:42:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.164+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8045ad0 con 0x7f4ee80f55c0 2022-02-02T14:42:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.165+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4ee4025070 con 0x7f4ee80f55c0 2022-02-02T14:42:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.165+0000 7f4ed9ffb700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 0x7f4ed4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.165+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4ee4082a80 con 0x7f4ee80f55c0 2022-02-02T14:42:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.165+0000 7f4eec9ca700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 0x7f4ed4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.166+0000 7f4eec9ca700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 0x7f4ed4067290 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4edc007a30 tx=0x7f4edc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:30.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.170+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4ee4050a70 con 0x7f4ee80f55c0 2022-02-02T14:42:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.414+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ee80fdf00 con 0x7f4ee80f55c0 2022-02-02T14:42:30.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.415+0000 7f4ed9ffb700 1 -- 172.21.15.33:0/660857464 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4ee4023070 con 0x7f4ee80f55c0 2022-02-02T14:42:30.415 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:42:30.415 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:42:30.415 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:42:30.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:42:30.415 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:42:30.416 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:42:30.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:42:30.416 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:42:30.416 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:42:30.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:42:30.417 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:42:30.417 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:42:30.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:42:30.418 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:42:30.418 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:42:30.418 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:42:30.418 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:42:30.419 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:42:30.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 msgr2=0x7f4ed4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 0x7f4ed4067290 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4edc007a30 tx=0x7f4edc00b040).stop 2022-02-02T14:42:30.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 msgr2=0x7f4ee8109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 0x7f4ee8109bf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f4ee80f66c0 tx=0x7f4ee400b040).stop 2022-02-02T14:42:30.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 shutdown_connections 2022-02-02T14:42:30.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ed4064dd0 0x7f4ed4067290 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ee80f55c0 0x7f4ee8109bf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 --2- 172.21.15.33:0/660857464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ee80f6860 0x7f4ee810c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 >> 172.21.15.33:0/660857464 conn(0x7f4ee80f0d40 msgr2=0x7f4ee80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:30.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 shutdown_connections 2022-02-02T14:42:30.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.417+0000 7f4eef42f700 1 -- 172.21.15.33:0/660857464 wait complete. 2022-02-02T14:42:30.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.518+0000 7f2b53fff700 1 -- 172.21.15.33:0/972177814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 msgr2=0x7f2b540f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.518+0000 7f2b53fff700 1 --2- 172.21.15.33:0/972177814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b540f6b40 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f2b48004660 tx=0x7f2b48009b30).stop 2022-02-02T14:42:30.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.518+0000 7f2b53fff700 1 -- 172.21.15.33:0/972177814 shutdown_connections 2022-02-02T14:42:30.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.518+0000 7f2b53fff700 1 --2- 172.21.15.33:0/972177814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b540f6b40 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.518+0000 7f2b53fff700 1 --2- 172.21.15.33:0/972177814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 0x7f2b540f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- 172.21.15.33:0/972177814 >> 172.21.15.33:0/972177814 conn(0x7f2b540f0ba0 msgr2=0x7f2b540f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:30.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- 172.21.15.33:0/972177814 shutdown_connections 2022-02-02T14:42:30.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- 172.21.15.33:0/972177814 wait complete. 2022-02-02T14:42:30.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 Processor -- start 2022-02-02T14:42:30.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- start start 2022-02-02T14:42:30.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 0x7f2b54105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54106770 con 0x7f2b540f66e0 2022-02-02T14:42:30.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.519+0000 7f2b53fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b54106f70 con 0x7f2b540f5440 2022-02-02T14:42:30.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34170/0 (socket says 172.21.15.33:34170) 2022-02-02T14:42:30.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 -- 172.21.15.33:0/143182490 learned_addr learned my addr 172.21.15.33:0/143182490 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:42:30.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b52ffd700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 0x7f2b54105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 -- 172.21.15.33:0/143182490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 msgr2=0x7f2b54105cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 0x7f2b54105cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 -- 172.21.15.33:0/143182490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b48005040 con 0x7f2b540f66e0 2022-02-02T14:42:30.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b527fc700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f2b48009990 tx=0x7f2b48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:30.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b48018070 con 0x7f2b540f66e0 2022-02-02T14:42:30.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b48007ba0 con 0x7f2b540f66e0 2022-02-02T14:42:30.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b541071f0 con 0x7f2b540f66e0 2022-02-02T14:42:30.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4801c3c0 con 0x7f2b540f66e0 2022-02-02T14:42:30.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.520+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b54107750 con 0x7f2b540f66e0 2022-02-02T14:42:30.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.521+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b54059100 con 0x7f2b540f66e0 2022-02-02T14:42:30.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.522+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b4801d420 con 0x7f2b540f66e0 2022-02-02T14:42:30.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.522+0000 7f2b3b7fe700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 0x7f2b3c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:42:30.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.522+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2b480836f0 con 0x7f2b540f66e0 2022-02-02T14:42:30.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.522+0000 7f2b52ffd700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 0x7f2b3c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:42:30.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.523+0000 7f2b52ffd700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 0x7f2b3c0672e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f2b540f6540 tx=0x7f2b4400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:42:30.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.527+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b48055290 con 0x7f2b540f66e0 2022-02-02T14:42:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:30 smithi033 ceph-mon[101165]: pgmap v1913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/660857464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:42:30.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.740+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b54045ad0 con 0x7f2b540f66e0 2022-02-02T14:42:30.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.741+0000 7f2b3b7fe700 1 -- 172.21.15.33:0/143182490 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2b48054e80 con 0x7f2b540f66e0 2022-02-02T14:42:30.742 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:42:30.742 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:42:30.742 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:42:30.742 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:42:30.743 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:42:30.743 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:42:30.743 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:42:30.744 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:42:30.744 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:42:30.744 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:42:30.744 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:42:30.744 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:42:30.745 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:42:30.745 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:42:30.745 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:42:30.745 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:42:30.745 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:42:30.746 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:42:30.746 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:42:30.746 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:42:30.746 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:42:30.747 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:42:30.747 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:42:30.747 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:42:30.747 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:42:30.747 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:42:30.748 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:42:30.748 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:42:30.748 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:42:30.748 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:42:30.749 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:42:30.749 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:42:30.749 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:42:30.749 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:42:30.750 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:42:30.750 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:42:30.750 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:42:30.750 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:42:30.750 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:42:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 msgr2=0x7f2b3c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 0x7f2b3c0672e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f2b540f6540 tx=0x7f2b4400b040).stop 2022-02-02T14:42:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 msgr2=0x7f2b541061c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:42:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f2b48009990 tx=0x7f2b48009b30).stop 2022-02-02T14:42:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 shutdown_connections 2022-02-02T14:42:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b3c064e20 0x7f2b3c0672e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b540f5440 0x7f2b54105cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 --2- 172.21.15.33:0/143182490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b540f66e0 0x7f2b541061c0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:42:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 >> 172.21.15.33:0/143182490 conn(0x7f2b540f0ba0 msgr2=0x7f2b540fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:42:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 shutdown_connections 2022-02-02T14:42:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:42:30.744+0000 7f2b53fff700 1 -- 172.21.15.33:0/143182490 wait complete. 2022-02-02T14:42:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:42:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:30 smithi037 ceph-mon[69017]: pgmap v1913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/660857464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:42:31.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:31 smithi033 ceph-mon[101165]: from='client.36038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:31.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:31 smithi033 ceph-mon[101165]: from='client.36042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:31.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/143182490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:42:31.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:31 smithi037 ceph-mon[69017]: from='client.36038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:31.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:31 smithi037 ceph-mon[69017]: from='client.36042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:42:31.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/143182490' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:42:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:32 smithi033 ceph-mon[101165]: pgmap v1914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:32 smithi037 ceph-mon[69017]: pgmap v1914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:34 smithi033 ceph-mon[101165]: pgmap v1915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:34 smithi037 ceph-mon[69017]: pgmap v1915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:36.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:36 smithi033 ceph-mon[101165]: pgmap v1916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:36 smithi037 ceph-mon[69017]: pgmap v1916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:38.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:38 smithi033 ceph-mon[101165]: pgmap v1917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:38 smithi037 ceph-mon[69017]: pgmap v1917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:40.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:40 smithi033 ceph-mon[101165]: pgmap v1918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:40 smithi037 ceph-mon[69017]: pgmap v1918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:42 smithi037 ceph-mon[69017]: pgmap v1919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:42.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:42 smithi033 ceph-mon[101165]: pgmap v1919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:44 smithi037 ceph-mon[69017]: pgmap v1920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:44 smithi033 ceph-mon[101165]: pgmap v1920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:46 smithi037 ceph-mon[69017]: pgmap v1921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:46 smithi033 ceph-mon[101165]: pgmap v1921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:48 smithi037 ceph-mon[69017]: pgmap v1922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:48.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:48 smithi033 ceph-mon[101165]: pgmap v1922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:50 smithi037 ceph-mon[69017]: pgmap v1923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:50 smithi033 ceph-mon[101165]: pgmap v1923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:52 smithi037 ceph-mon[69017]: pgmap v1924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:52 smithi033 ceph-mon[101165]: pgmap v1924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:54 smithi037 ceph-mon[69017]: pgmap v1925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:42:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:42:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:54 smithi033 ceph-mon[101165]: pgmap v1925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:42:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:42:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:56 smithi037 ceph-mon[69017]: pgmap v1926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:56 smithi033 ceph-mon[101165]: pgmap v1926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:42:57 smithi037 ceph-mon[69017]: pgmap v1927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:42:57.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:42:57 smithi033 ceph-mon[101165]: pgmap v1927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:00.490 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:00 smithi033 ceph-mon[101165]: pgmap v1928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:00.540 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:00 smithi037 ceph-mon[69017]: pgmap v1928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:00.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 -- 172.21.15.33:0/2581808817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40602d0 msgr2=0x7f8af40f92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:00.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/2581808817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40602d0 0x7f8af40f92e0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f8ae4004660 tx=0x7f8ae4009b30).stop 2022-02-02T14:43:00.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 -- 172.21.15.33:0/2581808817 shutdown_connections 2022-02-02T14:43:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/2581808817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40f9860 0x7f8af40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/2581808817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40602d0 0x7f8af40f92e0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 -- 172.21.15.33:0/2581808817 >> 172.21.15.33:0/2581808817 conn(0x7f8af40f0d40 msgr2=0x7f8af40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 -- 172.21.15.33:0/2581808817 shutdown_connections 2022-02-02T14:43:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.858+0000 7f8af9f7e700 1 -- 172.21.15.33:0/2581808817 wait complete. 2022-02-02T14:43:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 Processor -- start 2022-02-02T14:43:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 -- start start 2022-02-02T14:43:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40602d0 0x7f8af4106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4107950 con 0x7f8af40f9860 2022-02-02T14:43:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af9f7e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af4107a90 con 0x7f8af40602d0 2022-02-02T14:43:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.859+0000 7f8af2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:00.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34180/0 (socket says 172.21.15.33:34180) 2022-02-02T14:43:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 -- 172.21.15.33:0/937995250 learned_addr learned my addr 172.21.15.33:0/937995250 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af37fe700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40602d0 0x7f8af4106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 -- 172.21.15.33:0/937995250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40602d0 msgr2=0x7f8af4106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40602d0 0x7f8af4106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 -- 172.21.15.33:0/937995250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae4005040 con 0x7f8af40f9860 2022-02-02T14:43:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af2ffd700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f8ae800e7c0 tx=0x7f8ae800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae80092e0 con 0x7f8af40f9860 2022-02-02T14:43:00.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ae800f040 con 0x7f8af40f9860 2022-02-02T14:43:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af4108430 con 0x7f8af40f9860 2022-02-02T14:43:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae80147a0 con 0x7f8af40f9860 2022-02-02T14:43:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.860+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af41089f0 con 0x7f8af40f9860 2022-02-02T14:43:00.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.861+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af4045ad0 con 0x7f8af40f9860 2022-02-02T14:43:00.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.862+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ae80077b0 con 0x7f8af40f9860 2022-02-02T14:43:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.862+0000 7f8adbfff700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 0x7f8adc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.863+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ae80823d0 con 0x7f8af40f9860 2022-02-02T14:43:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.863+0000 7f8af37fe700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 0x7f8adc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.863+0000 7f8af37fe700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 0x7f8adc067290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8ae4005010 tx=0x7f8ae4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:00.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:00.866+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ae8053f60 con 0x7f8af40f9860 2022-02-02T14:43:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.056+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8af4108c60 con 0x7f8adc064dd0 2022-02-02T14:43:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.057+0000 7f8adbfff700 1 -- 172.21.15.33:0/937995250 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8af4108c60 con 0x7f8adc064dd0 2022-02-02T14:43:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 msgr2=0x7f8adc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 0x7f8adc067290 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f8ae4005010 tx=0x7f8ae4016040).stop 2022-02-02T14:43:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 msgr2=0x7f8af41073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7f8ae800e7c0 tx=0x7f8ae800b040).stop 2022-02-02T14:43:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 shutdown_connections 2022-02-02T14:43:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8adc064dd0 0x7f8adc067290 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8af40602d0 0x7f8af4106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 --2- 172.21.15.33:0/937995250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8af40f9860 0x7f8af41073a0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 >> 172.21.15.33:0/937995250 conn(0x7f8af40f0d40 msgr2=0x7f8af40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 shutdown_connections 2022-02-02T14:43:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.059+0000 7f8af9f7e700 1 -- 172.21.15.33:0/937995250 wait complete. 2022-02-02T14:43:01.069 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:43:01.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 -- 172.21.15.33:0/1681769711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a4060290 msgr2=0x7ff9a40fb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 --2- 172.21.15.33:0/1681769711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a4060290 0x7ff9a40fb590 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7ff994004690 tx=0x7ff994009b30).stop 2022-02-02T14:43:01.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 -- 172.21.15.33:0/1681769711 shutdown_connections 2022-02-02T14:43:01.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 --2- 172.21.15.33:0/1681769711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a40fba80 0x7ff9a40fde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 --2- 172.21.15.33:0/1681769711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a4060290 0x7ff9a40fb590 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 -- 172.21.15.33:0/1681769711 >> 172.21.15.33:0/1681769711 conn(0x7ff9a40f0b90 msgr2=0x7ff9a40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 -- 172.21.15.33:0/1681769711 shutdown_connections 2022-02-02T14:43:01.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.159+0000 7ff9a359e700 1 -- 172.21.15.33:0/1681769711 wait complete. 2022-02-02T14:43:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 Processor -- start 2022-02-02T14:43:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 -- start start 2022-02-02T14:43:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a4060290 0x7ff9a4108ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4109990 con 0x7ff9a40fba80 2022-02-02T14:43:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a4109ad0 con 0x7ff9a4060290 2022-02-02T14:43:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34190/0 (socket says 172.21.15.33:34190) 2022-02-02T14:43:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.160+0000 7ff9a1d9b700 1 -- 172.21.15.33:0/2204057770 learned_addr learned my addr 172.21.15.33:0/2204057770 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:01.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a259c700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a4060290 0x7ff9a4108ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a1d9b700 1 -- 172.21.15.33:0/2204057770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a4060290 msgr2=0x7ff9a4108ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a1d9b700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a4060290 0x7ff9a4108ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a1d9b700 1 -- 172.21.15.33:0/2204057770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994005040 con 0x7ff9a40fba80 2022-02-02T14:43:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a1d9b700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7ff998002700 tx=0x7ff998009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9980079c0 con 0x7ff9a40fba80 2022-02-02T14:43:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a410a470 con 0x7ff9a40fba80 2022-02-02T14:43:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff99800f040 con 0x7ff9a40fba80 2022-02-02T14:43:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff998014740 con 0x7ff9a40fba80 2022-02-02T14:43:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.161+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a410aa30 con 0x7ff9a40fba80 2022-02-02T14:43:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.162+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a4045ad0 con 0x7ff9a40fba80 2022-02-02T14:43:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.163+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff99801b060 con 0x7ff9a40fba80 2022-02-02T14:43:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.163+0000 7ff992ffd700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 0x7ff98c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.163+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff998081970 con 0x7ff9a40fba80 2022-02-02T14:43:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.163+0000 7ff9a259c700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 0x7ff98c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.164+0000 7ff9a259c700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 0x7ff98c0672e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff994005010 tx=0x7ff994009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.168+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff9980533f0 con 0x7ff9a40fba80 2022-02-02T14:43:01.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.350+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9a410acb0 con 0x7ff98c064e20 2022-02-02T14:43:01.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.364+0000 7ff992ffd700 1 -- 172.21.15.33:0/2204057770 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff9a410acb0 con 0x7ff98c064e20 2022-02-02T14:43:01.365 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:43:01.365 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (68m) 30m ago 69m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:43:01.366 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (61m) 30m ago 69m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:43:01.366 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (61m) 30m ago 68m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:43:01.366 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (68m) 30m ago 69m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:43:01.366 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (61m) 30m ago 65m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:43:01.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (62m) 30m ago 65m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:43:01.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (63m) 30m ago 65m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:43:01.367 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (65m) 30m ago 65m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:43:01.367 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (62m) 30m ago 70m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:43:01.368 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (62m) 30m ago 68m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:43:01.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (62m) 30m ago 70m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:43:01.368 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (61m) 30m ago 68m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:43:01.368 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (69m) 30m ago 69m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:43:01.369 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (68m) 30m ago 68m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:43:01.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 30m ago 68m - 4096M 2022-02-02T14:43:01.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (67m) 30m ago 67m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:43:01.369 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (67m) 30m ago 67m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:43:01.370 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (67m) 30m ago 67m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:43:01.370 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (66m) 30m ago 66m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:43:01.370 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (66m) 30m ago 66m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:43:01.370 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (68m) 30m ago 68m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:43:01.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 msgr2=0x7ff98c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 0x7ff98c0672e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7ff994005010 tx=0x7ff994009b30).stop 2022-02-02T14:43:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 msgr2=0x7ff9a41093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7ff998002700 tx=0x7ff998009d60).stop 2022-02-02T14:43:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 shutdown_connections 2022-02-02T14:43:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff98c064e20 0x7ff98c0672e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9a4060290 0x7ff9a4108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 --2- 172.21.15.33:0/2204057770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9a40fba80 0x7ff9a41093e0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 >> 172.21.15.33:0/2204057770 conn(0x7ff9a40f0b90 msgr2=0x7ff9a40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 shutdown_connections 2022-02-02T14:43:01.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.367+0000 7ff9a359e700 1 -- 172.21.15.33:0/2204057770 wait complete. 2022-02-02T14:43:01.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 -- 172.21.15.33:0/175172311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f6530 msgr2=0x7f8a400f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/175172311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f6530 0x7f8a400f6950 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f8a30004660 tx=0x7f8a30009b30).stop 2022-02-02T14:43:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 -- 172.21.15.33:0/175172311 shutdown_connections 2022-02-02T14:43:01.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/175172311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f77d0 0x7f8a400f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/175172311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f6530 0x7f8a400f6950 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 -- 172.21.15.33:0/175172311 >> 172.21.15.33:0/175172311 conn(0x7f8a400f1c90 msgr2=0x7f8a400f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 -- 172.21.15.33:0/175172311 shutdown_connections 2022-02-02T14:43:01.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.468+0000 7f8a44d1a700 1 -- 172.21.15.33:0/175172311 wait complete. 2022-02-02T14:43:01.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 Processor -- start 2022-02-02T14:43:01.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 -- start start 2022-02-02T14:43:01.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f6530 0x7f8a40106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40107880 con 0x7f8a400f77d0 2022-02-02T14:43:01.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.469+0000 7f8a44d1a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40108090 con 0x7f8a400f6530 2022-02-02T14:43:01.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34200/0 (socket says 172.21.15.33:34200) 2022-02-02T14:43:01.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 -- 172.21.15.33:0/3634306115 learned_addr learned my addr 172.21.15.33:0/3634306115 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:01.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3f7fe700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f6530 0x7f8a40106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 -- 172.21.15.33:0/3634306115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f6530 msgr2=0x7f8a40106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f6530 0x7f8a40106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 -- 172.21.15.33:0/3634306115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30005040 con 0x7f8a400f77d0 2022-02-02T14:43:01.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a3effd700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f8a3400e7f0 tx=0x7f8a3400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a340092e0 con 0x7f8a400f77d0 2022-02-02T14:43:01.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a3400f040 con 0x7f8a400f77d0 2022-02-02T14:43:01.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a34014750 con 0x7f8a400f77d0 2022-02-02T14:43:01.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a40108310 con 0x7f8a400f77d0 2022-02-02T14:43:01.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.470+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a401088d0 con 0x7f8a400f77d0 2022-02-02T14:43:01.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.471+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a40059100 con 0x7f8a400f77d0 2022-02-02T14:43:01.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.472+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a3401b030 con 0x7f8a400f77d0 2022-02-02T14:43:01.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.472+0000 7f8a27fff700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 0x7f8a280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.473+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8a34081800 con 0x7f8a400f77d0 2022-02-02T14:43:01.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.473+0000 7f8a3f7fe700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 0x7f8a280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.473+0000 7f8a3f7fe700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 0x7f8a280672e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8a30000c00 tx=0x7f8a30016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.477+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a3404f960 con 0x7f8a400f77d0 2022-02-02T14:43:01.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.723+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a400fede0 con 0x7f8a400f77d0 2022-02-02T14:43:01.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.724+0000 7f8a27fff700 1 -- 172.21.15.33:0/3634306115 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8a34052f80 con 0x7f8a400f77d0 2022-02-02T14:43:01.725 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:43:01.725 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:43:01.725 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:43:01.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:01.726 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:43:01.726 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:43:01.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:01.727 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:43:01.727 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:43:01.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:01.727 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:43:01.728 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:43:01.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:01.728 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:43:01.728 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:43:01.729 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:43:01.729 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:43:01.729 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:43:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.726+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 msgr2=0x7f8a280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.726+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 0x7f8a280672e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f8a30000c00 tx=0x7f8a30016040).stop 2022-02-02T14:43:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.726+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 msgr2=0x7f8a40107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.726+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f8a3400e7f0 tx=0x7f8a3400b040).stop 2022-02-02T14:43:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 shutdown_connections 2022-02-02T14:43:01.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a28064e20 0x7f8a280672e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a400f6530 0x7f8a40106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 --2- 172.21.15.33:0/3634306115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a400f77d0 0x7f8a40107280 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 >> 172.21.15.33:0/3634306115 conn(0x7f8a400f1c90 msgr2=0x7f8a400fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 shutdown_connections 2022-02-02T14:43:01.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.727+0000 7f8a44d1a700 1 -- 172.21.15.33:0/3634306115 wait complete. 2022-02-02T14:43:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 -- 172.21.15.33:0/826993794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f66e0 msgr2=0x7f22fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 --2- 172.21.15.33:0/826993794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f66e0 0x7f22fc0f6b00 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f22ec004660 tx=0x7f22ec009b30).stop 2022-02-02T14:43:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 -- 172.21.15.33:0/826993794 shutdown_connections 2022-02-02T14:43:01.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 --2- 172.21.15.33:0/826993794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f7980 0x7f22fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 --2- 172.21.15.33:0/826993794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f66e0 0x7f22fc0f6b00 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 -- 172.21.15.33:0/826993794 >> 172.21.15.33:0/826993794 conn(0x7f22fc0f1e40 msgr2=0x7f22fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:01.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 -- 172.21.15.33:0/826993794 shutdown_connections 2022-02-02T14:43:01.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.828+0000 7f23029b6700 1 -- 172.21.15.33:0/826993794 wait complete. 2022-02-02T14:43:01.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 Processor -- start 2022-02-02T14:43:01.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 -- start start 2022-02-02T14:43:01.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f66e0 0x7f22fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc06a380 con 0x7f22fc0f7980 2022-02-02T14:43:01.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f23029b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc06a4c0 con 0x7f22fc0f66e0 2022-02-02T14:43:01.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.829+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34210/0 (socket says 172.21.15.33:34210) 2022-02-02T14:43:01.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 -- 172.21.15.33:0/4084185270 learned_addr learned my addr 172.21.15.33:0/4084185270 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:01.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fbfff700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f66e0 0x7f22fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 -- 172.21.15.33:0/4084185270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f66e0 msgr2=0x7f22fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:01.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f66e0 0x7f22fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 -- 172.21.15.33:0/4084185270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec005040 con 0x7f22fc0f7980 2022-02-02T14:43:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22fb7fe700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f22f00026d0 tx=0x7f22f0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f00079c0 con 0x7f22fc0f7980 2022-02-02T14:43:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22f000f040 con 0x7f22fc0f7980 2022-02-02T14:43:01.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc06a7a0 con 0x7f22fc0f7980 2022-02-02T14:43:01.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22f00148b0 con 0x7f22fc0f7980 2022-02-02T14:43:01.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.830+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc10efe0 con 0x7f22fc0f7980 2022-02-02T14:43:01.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.831+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc045ad0 con 0x7f22fc0f7980 2022-02-02T14:43:01.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.832+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22f0007b20 con 0x7f22fc0f7980 2022-02-02T14:43:01.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.832+0000 7f22f8ff9700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 0x7f22e4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:01.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.832+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f22f0081910 con 0x7f22fc0f7980 2022-02-02T14:43:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.832+0000 7f22fbfff700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 0x7f22e4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.833+0000 7f22fbfff700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 0x7f22e4067290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f22ec013690 tx=0x7f22ec009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:01.836+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22f004f9c0 con 0x7f22fc0f7980 2022-02-02T14:43:02.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.049+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f22fc027a00 con 0x7f22fc0f7980 2022-02-02T14:43:02.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.049+0000 7f22f8ff9700 1 -- 172.21.15.33:0/4084185270 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f22f0052fe0 con 0x7f22fc0f7980 2022-02-02T14:43:02.051 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:43:02.051 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:43:02.051 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:43:02.051 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:43:02.052 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:02.052 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:43:02.052 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:43:02.052 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:43:02.053 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:43:02.053 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:43:02.053 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:43:02.053 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:43:02.053 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:43:02.054 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:43:02.054 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:43:02.054 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:43:02.054 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:43:02.055 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:43:02.055 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:43:02.055 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:43:02.055 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:43:02.056 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:43:02.056 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:43:02.056 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:43:02.056 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:43:02.057 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:43:02.057 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:43:02.057 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:43:02.057 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:43:02.057 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:43:02.058 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:43:02.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:02.058 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:02.058 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:43:02.059 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:02.059 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:02.059 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:02.059 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:02.059 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:02.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 msgr2=0x7f22e4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:02.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 0x7f22e4067290 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f22ec013690 tx=0x7f22ec009b30).stop 2022-02-02T14:43:02.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 msgr2=0x7f22fc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:02.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f22f00026d0 tx=0x7f22f0009de0).stop 2022-02-02T14:43:02.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 shutdown_connections 2022-02-02T14:43:02.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22e4064dd0 0x7f22e4067290 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:02.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22fc0f66e0 0x7f22fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:02.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 --2- 172.21.15.33:0/4084185270 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22fc0f7980 0x7f22fc069e20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:02.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 >> 172.21.15.33:0/4084185270 conn(0x7f22fc0f1e40 msgr2=0x7f22fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 shutdown_connections 2022-02-02T14:43:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:02.051+0000 7f23029b6700 1 -- 172.21.15.33:0/4084185270 wait complete. 2022-02-02T14:43:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:43:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:02 smithi033 ceph-mon[101165]: from='client.36054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:02 smithi033 ceph-mon[101165]: pgmap v1929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:02.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:02 smithi033 ceph-mon[101165]: from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:02.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3634306115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:43:02.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4084185270' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:43:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:02 smithi037 ceph-mon[69017]: from='client.36054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:02 smithi037 ceph-mon[69017]: pgmap v1929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:02 smithi037 ceph-mon[69017]: from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3634306115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:43:02.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4084185270' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:43:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:04 smithi033 ceph-mon[101165]: pgmap v1930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:04 smithi037 ceph-mon[69017]: pgmap v1930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:06 smithi033 ceph-mon[101165]: pgmap v1931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:06 smithi037 ceph-mon[69017]: pgmap v1931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:08.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:08 smithi033 ceph-mon[101165]: pgmap v1932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:08 smithi037 ceph-mon[69017]: pgmap v1932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:10 smithi033 ceph-mon[101165]: pgmap v1933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:10 smithi037 ceph-mon[69017]: pgmap v1933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:12.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:12 smithi033 ceph-mon[101165]: pgmap v1934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:12 smithi037 ceph-mon[69017]: pgmap v1934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:14 smithi033 ceph-mon[101165]: pgmap v1935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:14 smithi037 ceph-mon[69017]: pgmap v1935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:16 smithi033 ceph-mon[101165]: pgmap v1936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:16 smithi037 ceph-mon[69017]: pgmap v1936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:18 smithi033 ceph-mon[101165]: pgmap v1937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:18 smithi037 ceph-mon[69017]: pgmap v1937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:20 smithi033 ceph-mon[101165]: pgmap v1938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:20 smithi037 ceph-mon[69017]: pgmap v1938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:22.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:22 smithi033 ceph-mon[101165]: pgmap v1939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:22 smithi037 ceph-mon[69017]: pgmap v1939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:24 smithi033 ceph-mon[101165]: pgmap v1940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:24 smithi037 ceph-mon[69017]: pgmap v1940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:26 smithi033 ceph-mon[101165]: pgmap v1941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:26 smithi037 ceph-mon[69017]: pgmap v1941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:28.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:28 smithi033 ceph-mon[101165]: pgmap v1942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:28 smithi037 ceph-mon[69017]: pgmap v1942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:30.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:30 smithi033 ceph-mon[101165]: pgmap v1943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:30 smithi037 ceph-mon[69017]: pgmap v1943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:32.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 -- 172.21.15.33:0/2993350516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f6860 msgr2=0x7f5ac80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 --2- 172.21.15.33:0/2993350516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f6860 0x7f5ac80f6cc0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f5ab4004660 tx=0x7f5ab4009b30).stop 2022-02-02T14:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 -- 172.21.15.33:0/2993350516 shutdown_connections 2022-02-02T14:43:32.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 --2- 172.21.15.33:0/2993350516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f6860 0x7f5ac80f6cc0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 --2- 172.21.15.33:0/2993350516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f55c0 0x7f5ac80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.167+0000 7f5acec20700 1 -- 172.21.15.33:0/2993350516 >> 172.21.15.33:0/2993350516 conn(0x7f5ac80f0d40 msgr2=0x7f5ac80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.168+0000 7f5acec20700 1 -- 172.21.15.33:0/2993350516 shutdown_connections 2022-02-02T14:43:32.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.168+0000 7f5acec20700 1 -- 172.21.15.33:0/2993350516 wait complete. 2022-02-02T14:43:32.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.168+0000 7f5acec20700 1 Processor -- start 2022-02-02T14:43:32.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.168+0000 7f5acec20700 1 -- start start 2022-02-02T14:43:32.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acec20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acec20700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 0x7f5ac810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acec20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8060420 con 0x7f5ac80f55c0 2022-02-02T14:43:32.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acec20700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac8060560 con 0x7f5ac80f6860 2022-02-02T14:43:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34218/0 (socket says 172.21.15.33:34218) 2022-02-02T14:43:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 -- 172.21.15.33:0/85913060 learned_addr learned my addr 172.21.15.33:0/85913060 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:32.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5ac7fff700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 0x7f5ac810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 -- 172.21.15.33:0/85913060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 msgr2=0x7f5ac810c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 0x7f5ac810c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 -- 172.21.15.33:0/85913060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab4005040 con 0x7f5ac80f55c0 2022-02-02T14:43:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5ac7fff700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 0x7f5ac810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:43:32.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5acc9bc700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f5abc002700 tx=0x7f5abc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.169+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc009320 con 0x7f5ac80f55c0 2022-02-02T14:43:32.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.170+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5abc00f040 con 0x7f5ac80f55c0 2022-02-02T14:43:32.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.170+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac810c720 con 0x7f5ac80f55c0 2022-02-02T14:43:32.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.170+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5abc014900 con 0x7f5ac80f55c0 2022-02-02T14:43:32.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.170+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac810ccb0 con 0x7f5ac80f55c0 2022-02-02T14:43:32.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.171+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac80f49b0 con 0x7f5ac80f55c0 2022-02-02T14:43:32.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.171+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5abc009480 con 0x7f5ac80f55c0 2022-02-02T14:43:32.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.172+0000 7f5ac57fa700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.172+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5abc081d60 con 0x7f5ac80f55c0 2022-02-02T14:43:32.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.172+0000 7f5ac7fff700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.172+0000 7f5ac7fff700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 0x7f5ab8067290 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f5ab4009da0 tx=0x7f5ab4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.176+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5abc04fe10 con 0x7f5ac80f55c0 2022-02-02T14:43:32.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.366+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ac8057f10 con 0x7f5ab8064dd0 2022-02-02T14:43:32.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.367+0000 7f5ac57fa700 1 -- 172.21.15.33:0/85913060 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5ac8057f10 con 0x7f5ab8064dd0 2022-02-02T14:43:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 msgr2=0x7f5ab8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 0x7f5ab8067290 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f5ab4009da0 tx=0x7f5ab4009b30).stop 2022-02-02T14:43:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 msgr2=0x7f5ac8109c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f5abc002700 tx=0x7f5abc009d80).stop 2022-02-02T14:43:32.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 shutdown_connections 2022-02-02T14:43:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5ab8064dd0 0x7f5ab8067290 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac80f55c0 0x7f5ac8109c10 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 --2- 172.21.15.33:0/85913060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ac80f6860 0x7f5ac810c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 >> 172.21.15.33:0/85913060 conn(0x7f5ac80f0d40 msgr2=0x7f5ac80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 shutdown_connections 2022-02-02T14:43:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.369+0000 7f5acec20700 1 -- 172.21.15.33:0/85913060 wait complete. 2022-02-02T14:43:32.378 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:43:32.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 -- 172.21.15.33:0/1633368458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 msgr2=0x7faf680f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 --2- 172.21.15.33:0/1633368458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf680f6b00 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7faf58004660 tx=0x7faf58009b30).stop 2022-02-02T14:43:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 -- 172.21.15.33:0/1633368458 shutdown_connections 2022-02-02T14:43:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 --2- 172.21.15.33:0/1633368458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 0x7faf680f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 --2- 172.21.15.33:0/1633368458 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf680f6b00 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 -- 172.21.15.33:0/1633368458 >> 172.21.15.33:0/1633368458 conn(0x7faf680f1e40 msgr2=0x7faf680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 -- 172.21.15.33:0/1633368458 shutdown_connections 2022-02-02T14:43:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.470+0000 7faf6d199700 1 -- 172.21.15.33:0/1633368458 wait complete. 2022-02-02T14:43:32.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 Processor -- start 2022-02-02T14:43:32.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 -- start start 2022-02-02T14:43:32.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 0x7faf681074e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68107a90 con 0x7faf680f66e0 2022-02-02T14:43:32.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6d199700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68107bd0 con 0x7faf680f7980 2022-02-02T14:43:32.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34228/0 (socket says 172.21.15.33:34228) 2022-02-02T14:43:32.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 -- 172.21.15.33:0/3037060234 learned_addr learned my addr 172.21.15.33:0/3037060234 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:32.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf6659c700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 0x7faf681074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 -- 172.21.15.33:0/3037060234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 msgr2=0x7faf681074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 0x7faf681074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.471+0000 7faf66d9d700 1 -- 172.21.15.33:0/3037060234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf58005040 con 0x7faf680f66e0 2022-02-02T14:43:32.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf66d9d700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7faf58004f60 tx=0x7faf58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf58018070 con 0x7faf680f66e0 2022-02-02T14:43:32.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf58009770 con 0x7faf680f66e0 2022-02-02T14:43:32.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf5801c3c0 con 0x7faf680f66e0 2022-02-02T14:43:32.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf68108510 con 0x7faf680f66e0 2022-02-02T14:43:32.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.472+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf68108a70 con 0x7faf680f66e0 2022-02-02T14:43:32.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.473+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf68045ad0 con 0x7faf680f66e0 2022-02-02T14:43:32.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.474+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf5801d420 con 0x7faf680f66e0 2022-02-02T14:43:32.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.474+0000 7faf5f7fe700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 0x7faf54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.474+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faf580837d0 con 0x7faf680f66e0 2022-02-02T14:43:32.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.474+0000 7faf6659c700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 0x7faf54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.475+0000 7faf6659c700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 0x7faf54067290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7faf500041d0 tx=0x7faf50009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.479+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf580552b0 con 0x7faf680f66e0 2022-02-02T14:43:32.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.662+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf680fefa0 con 0x7faf54064dd0 2022-02-02T14:43:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.677+0000 7faf5f7fe700 1 -- 172.21.15.33:0/3037060234 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faf680fefa0 con 0x7faf54064dd0 2022-02-02T14:43:32.677 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:43:32.677 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (68m) 30m ago 69m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:43:32.677 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (61m) 30m ago 69m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:43:32.677 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (61m) 30m ago 69m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:43:32.678 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (68m) 30m ago 69m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:43:32.678 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (62m) 30m ago 66m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:43:32.678 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (62m) 30m ago 65m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:43:32.678 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (63m) 30m ago 66m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:43:32.679 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (66m) 30m ago 65m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:43:32.679 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (63m) 30m ago 71m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:43:32.679 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (63m) 30m ago 69m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:43:32.679 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (62m) 30m ago 71m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:43:32.679 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (62m) 30m ago 69m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:43:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (69m) 30m ago 69m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:43:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (69m) 30m ago 69m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:43:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 30m ago 68m - 4096M 2022-02-02T14:43:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (68m) 30m ago 68m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:43:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (67m) 30m ago 67m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:43:32.681 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (67m) 30m ago 67m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:43:32.681 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (67m) 30m ago 67m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:43:32.681 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (67m) 30m ago 67m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:43:32.681 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (68m) 30m ago 69m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:43:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 msgr2=0x7faf54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 0x7faf54067290 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7faf500041d0 tx=0x7faf50009040).stop 2022-02-02T14:43:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 msgr2=0x7faf68106ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7faf58004f60 tx=0x7faf58009b30).stop 2022-02-02T14:43:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 shutdown_connections 2022-02-02T14:43:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf54064dd0 0x7faf54067290 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf680f66e0 0x7faf68106ff0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 --2- 172.21.15.33:0/3037060234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf680f7980 0x7faf681074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 >> 172.21.15.33:0/3037060234 conn(0x7faf680f1e40 msgr2=0x7faf680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:32.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 shutdown_connections 2022-02-02T14:43:32.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.679+0000 7faf6d199700 1 -- 172.21.15.33:0/3037060234 wait complete. 2022-02-02T14:43:32.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:32 smithi033 ceph-mon[101165]: pgmap v1944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:32.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.781+0000 7f476f259700 1 -- 172.21.15.33:0/3143882512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f7980 msgr2=0x7f47680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.781+0000 7f476f259700 1 --2- 172.21.15.33:0/3143882512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f7980 0x7f47680f7de0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7f4754004660 tx=0x7f4754009b30).stop 2022-02-02T14:43:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 -- 172.21.15.33:0/3143882512 shutdown_connections 2022-02-02T14:43:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 --2- 172.21.15.33:0/3143882512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f7980 0x7f47680f7de0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 --2- 172.21.15.33:0/3143882512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f66e0 0x7f47680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 -- 172.21.15.33:0/3143882512 >> 172.21.15.33:0/3143882512 conn(0x7f47680f1e40 msgr2=0x7f47680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 -- 172.21.15.33:0/3143882512 shutdown_connections 2022-02-02T14:43:32.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 -- 172.21.15.33:0/3143882512 wait complete. 2022-02-02T14:43:32.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 Processor -- start 2022-02-02T14:43:32.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.782+0000 7f476f259700 1 -- start start 2022-02-02T14:43:32.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f7980 0x7f4768069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476806a380 con 0x7f47680f66e0 2022-02-02T14:43:32.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476806a4c0 con 0x7f47680f7980 2022-02-02T14:43:32.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34236/0 (socket says 172.21.15.33:34236) 2022-02-02T14:43:32.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 -- 172.21.15.33:0/764131699 learned_addr learned my addr 172.21.15.33:0/764131699 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:32.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f4767fff700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f7980 0x7f4768069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 -- 172.21.15.33:0/764131699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f7980 msgr2=0x7f4768069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:32.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f7980 0x7f4768069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:32.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 -- 172.21.15.33:0/764131699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754005040 con 0x7f47680f66e0 2022-02-02T14:43:32.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476cff5700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f475c00c530 tx=0x7f475c007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475c00f650 con 0x7f47680f66e0 2022-02-02T14:43:32.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476806a7a0 con 0x7f47680f66e0 2022-02-02T14:43:32.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f475c00fc60 con 0x7f47680f66e0 2022-02-02T14:43:32.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f475c012d20 con 0x7f47680f66e0 2022-02-02T14:43:32.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.783+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476810ef90 con 0x7f47680f66e0 2022-02-02T14:43:32.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.784+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4768045ad0 con 0x7f47680f66e0 2022-02-02T14:43:32.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.785+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f475c019030 con 0x7f47680f66e0 2022-02-02T14:43:32.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.785+0000 7f47657fa700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 0x7f4758067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:32.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.785+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f475c081700 con 0x7f47680f66e0 2022-02-02T14:43:32.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.785+0000 7f4767fff700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 0x7f4758067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:32.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.786+0000 7f4767fff700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 0x7f4758067290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4754009da0 tx=0x7f4754009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:32.793 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:32 smithi037 ceph-mon[69017]: pgmap v1944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:32.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:32.790+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f475c04f800 con 0x7f47680f66e0 2022-02-02T14:43:33.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.049+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f47680fefb0 con 0x7f47680f66e0 2022-02-02T14:43:33.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.049+0000 7f47657fa700 1 -- 172.21.15.33:0/764131699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f475c052e20 con 0x7f47680f66e0 2022-02-02T14:43:33.049 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:43:33.049 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:43:33.050 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:43:33.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:33.050 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:43:33.050 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:43:33.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:33.051 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:43:33.051 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:43:33.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:33.052 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:43:33.052 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:43:33.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:43:33.053 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:43:33.053 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:43:33.053 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:43:33.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:43:33.053 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:43:33.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 msgr2=0x7f4758067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 0x7f4758067290 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f4754009da0 tx=0x7f4754009b30).stop 2022-02-02T14:43:33.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 msgr2=0x7f476806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7f475c00c530 tx=0x7f475c007e10).stop 2022-02-02T14:43:33.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 shutdown_connections 2022-02-02T14:43:33.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4758064dd0 0x7f4758067290 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47680f66e0 0x7f476806b9a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 --2- 172.21.15.33:0/764131699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47680f7980 0x7f4768069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 >> 172.21.15.33:0/764131699 conn(0x7f47680f1e40 msgr2=0x7f47680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:33.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 shutdown_connections 2022-02-02T14:43:33.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.052+0000 7f476f259700 1 -- 172.21.15.33:0/764131699 wait complete. 2022-02-02T14:43:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 -- 172.21.15.33:0/2212126236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f55c0 msgr2=0x7f4a980f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 --2- 172.21.15.33:0/2212126236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f55c0 0x7f4a980f59e0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7f4a94004660 tx=0x7f4a94009b30).stop 2022-02-02T14:43:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 -- 172.21.15.33:0/2212126236 shutdown_connections 2022-02-02T14:43:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 --2- 172.21.15.33:0/2212126236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f6860 0x7f4a980f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 --2- 172.21.15.33:0/2212126236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f55c0 0x7f4a980f59e0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 -- 172.21.15.33:0/2212126236 >> 172.21.15.33:0/2212126236 conn(0x7f4a980f0d40 msgr2=0x7f4a980f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 -- 172.21.15.33:0/2212126236 shutdown_connections 2022-02-02T14:43:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.153+0000 7f4a9f274700 1 -- 172.21.15.33:0/2212126236 wait complete. 2022-02-02T14:43:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 Processor -- start 2022-02-02T14:43:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 -- start start 2022-02-02T14:43:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f55c0 0x7f4a98105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98106910 con 0x7f4a980f6860 2022-02-02T14:43:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9f274700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98106a50 con 0x7f4a980f55c0 2022-02-02T14:43:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34248/0 (socket says 172.21.15.33:34248) 2022-02-02T14:43:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 -- 172.21.15.33:0/3817486052 learned_addr learned my addr 172.21.15.33:0/3817486052 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:43:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9d010700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f55c0 0x7f4a98105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 -- 172.21.15.33:0/3817486052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f55c0 msgr2=0x7f4a98105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f55c0 0x7f4a98105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 -- 172.21.15.33:0/3817486052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94005040 con 0x7f4a980f6860 2022-02-02T14:43:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.154+0000 7f4a9c80f700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4a8c0026d0 tx=0x7f4a8c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.155+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8c0079c0 con 0x7f4a980f6860 2022-02-02T14:43:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.155+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a8c00f040 con 0x7f4a980f6860 2022-02-02T14:43:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.155+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a981073f0 con 0x7f4a980f6860 2022-02-02T14:43:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.155+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a8c0148b0 con 0x7f4a980f6860 2022-02-02T14:43:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.155+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a981079b0 con 0x7f4a980f6860 2022-02-02T14:43:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.156+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a98045ad0 con 0x7f4a980f6860 2022-02-02T14:43:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.157+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a8c007b20 con 0x7f4a980f6860 2022-02-02T14:43:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.157+0000 7f4a89ffb700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 0x7f4a84067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:43:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.157+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4a8c081d50 con 0x7f4a980f6860 2022-02-02T14:43:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.157+0000 7f4a9d010700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 0x7f4a84067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:43:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.158+0000 7f4a9d010700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 0x7f4a84067290 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f4a94004630 tx=0x7f4a94009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:43:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.161+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a8c0538b0 con 0x7f4a980f6860 2022-02-02T14:43:33.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.374+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4a98027a00 con 0x7f4a980f6860 2022-02-02T14:43:33.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.374+0000 7f4a89ffb700 1 -- 172.21.15.33:0/3817486052 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4a8c0534a0 con 0x7f4a980f6860 2022-02-02T14:43:33.374 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:43:33.374 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:43:33.375 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:43:33.375 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:43:33.375 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:33.375 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:43:33.376 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:43:33.376 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:43:33.376 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:43:33.376 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:43:33.376 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:43:33.377 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:43:33.377 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:43:33.377 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:43:33.377 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:43:33.378 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:43:33.378 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:43:33.378 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:43:33.378 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:43:33.378 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:43:33.379 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:43:33.379 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:43:33.379 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:43:33.379 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:43:33.380 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:43:33.380 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:43:33.380 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:43:33.380 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:43:33.380 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:43:33.381 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:43:33.381 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:43:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:33.381 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:33.382 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:43:33.382 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:43:33.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:33.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:33.382 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:33.383 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:43:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 msgr2=0x7f4a84067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 0x7f4a84067290 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f4a94004630 tx=0x7f4a94009b30).stop 2022-02-02T14:43:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 msgr2=0x7f4a98106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:43:33.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7f4a8c0026d0 tx=0x7f4a8c009de0).stop 2022-02-02T14:43:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 shutdown_connections 2022-02-02T14:43:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a84064dd0 0x7f4a84067290 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a980f55c0 0x7f4a98105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 --2- 172.21.15.33:0/3817486052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a980f6860 0x7f4a98106360 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:43:33.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 >> 172.21.15.33:0/3817486052 conn(0x7f4a980f0d40 msgr2=0x7f4a980fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:43:33.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 shutdown_connections 2022-02-02T14:43:33.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:43:33.376+0000 7f4a9f274700 1 -- 172.21.15.33:0/3817486052 wait complete. 2022-02-02T14:43:33.386 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:43:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:33 smithi033 ceph-mon[101165]: from='client.36070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/764131699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:43:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3817486052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:43:33.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:33 smithi037 ceph-mon[69017]: from='client.36070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:33.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/764131699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:43:33.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3817486052' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:43:34.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:34 smithi033 ceph-mon[101165]: from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:34.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:34 smithi033 ceph-mon[101165]: pgmap v1945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:34 smithi037 ceph-mon[69017]: from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:43:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:34 smithi037 ceph-mon[69017]: pgmap v1945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:36 smithi037 ceph-mon[69017]: pgmap v1946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:36 smithi033 ceph-mon[101165]: pgmap v1946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:38 smithi037 ceph-mon[69017]: pgmap v1947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:38 smithi033 ceph-mon[101165]: pgmap v1947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:40 smithi037 ceph-mon[69017]: pgmap v1948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:40 smithi033 ceph-mon[101165]: pgmap v1948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:42 smithi037 ceph-mon[69017]: pgmap v1949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:42 smithi033 ceph-mon[101165]: pgmap v1949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:44 smithi037 ceph-mon[69017]: pgmap v1950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:44 smithi033 ceph-mon[101165]: pgmap v1950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:46 smithi037 ceph-mon[69017]: pgmap v1951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:46 smithi033 ceph-mon[101165]: pgmap v1951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:48 smithi037 ceph-mon[69017]: pgmap v1952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:48 smithi033 ceph-mon[101165]: pgmap v1952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:50.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:50 smithi037 ceph-mon[69017]: pgmap v1953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:50.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:50 smithi033 ceph-mon[101165]: pgmap v1953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:52 smithi037 ceph-mon[69017]: pgmap v1954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:52 smithi033 ceph-mon[101165]: pgmap v1954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:54 smithi037 ceph-mon[69017]: pgmap v1955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:43:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:43:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:54 smithi033 ceph-mon[101165]: pgmap v1955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:43:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:43:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:56 smithi037 ceph-mon[69017]: pgmap v1956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:56 smithi033 ceph-mon[101165]: pgmap v1956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:58 smithi037 ceph-mon[69017]: pgmap v1957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:58 smithi033 ceph-mon[101165]: pgmap v1957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:43:59.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:43:59 smithi033 ceph-mon[101165]: pgmap v1958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:00.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:43:59 smithi037 ceph-mon[69017]: pgmap v1958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:02 smithi033 ceph-mon[101165]: pgmap v1959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:02 smithi037 ceph-mon[69017]: pgmap v1959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:03.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 -- 172.21.15.33:0/3386259741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f6860 msgr2=0x7f4a280f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 --2- 172.21.15.33:0/3386259741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f6860 0x7f4a280f6cc0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 rx=0x7f4a24004660 tx=0x7f4a24009b30).stop 2022-02-02T14:44:03.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 -- 172.21.15.33:0/3386259741 shutdown_connections 2022-02-02T14:44:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 --2- 172.21.15.33:0/3386259741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f6860 0x7f4a280f6cc0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 --2- 172.21.15.33:0/3386259741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f55c0 0x7f4a280f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 -- 172.21.15.33:0/3386259741 >> 172.21.15.33:0/3386259741 conn(0x7f4a280f0d40 msgr2=0x7f4a280f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 -- 172.21.15.33:0/3386259741 shutdown_connections 2022-02-02T14:44:03.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.496+0000 7f4a301fd700 1 -- 172.21.15.33:0/3386259741 wait complete. 2022-02-02T14:44:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 Processor -- start 2022-02-02T14:44:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 -- start start 2022-02-02T14:44:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f6860 0x7f4a28106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28106920 con 0x7f4a280f55c0 2022-02-02T14:44:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a301fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28107130 con 0x7f4a280f6860 2022-02-02T14:44:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34256/0 (socket says 172.21.15.33:34256) 2022-02-02T14:44:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 -- 172.21.15.33:0/264492941 learned_addr learned my addr 172.21.15.33:0/264492941 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2d798700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f6860 0x7f4a28106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 -- 172.21.15.33:0/264492941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f6860 msgr2=0x7f4a28106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f6860 0x7f4a28106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.497+0000 7f4a2df99700 1 -- 172.21.15.33:0/264492941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24005040 con 0x7f4a280f55c0 2022-02-02T14:44:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a2df99700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f4a18002700 tx=0x7f4a18009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a180079c0 con 0x7f4a280f55c0 2022-02-02T14:44:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a1800f040 con 0x7f4a280f55c0 2022-02-02T14:44:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a281073b0 con 0x7f4a280f55c0 2022-02-02T14:44:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a18014850 con 0x7f4a280f55c0 2022-02-02T14:44:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.498+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a28107970 con 0x7f4a280f55c0 2022-02-02T14:44:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.499+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a280f49b0 con 0x7f4a280f55c0 2022-02-02T14:44:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.499+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a1801b060 con 0x7f4a280f55c0 2022-02-02T14:44:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.500+0000 7f4a1e7fc700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 0x7f4a14067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.500+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4a180818b0 con 0x7f4a280f55c0 2022-02-02T14:44:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.500+0000 7f4a2d798700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 0x7f4a14067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.500+0000 7f4a2d798700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 0x7f4a14067290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f4a24004630 tx=0x7f4a24009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.504+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a1804f960 con 0x7f4a280f55c0 2022-02-02T14:44:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.693+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a280fde90 con 0x7f4a14064dd0 2022-02-02T14:44:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.694+0000 7f4a1e7fc700 1 -- 172.21.15.33:0/264492941 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4a280fde90 con 0x7f4a14064dd0 2022-02-02T14:44:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 msgr2=0x7f4a14067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 0x7f4a14067290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f4a24004630 tx=0x7f4a24009b30).stop 2022-02-02T14:44:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 msgr2=0x7f4a28105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f4a18002700 tx=0x7f4a18009e00).stop 2022-02-02T14:44:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 shutdown_connections 2022-02-02T14:44:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a14064dd0 0x7f4a14067290 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a280f55c0 0x7f4a28105e30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 --2- 172.21.15.33:0/264492941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a280f6860 0x7f4a28106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.696+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 >> 172.21.15.33:0/264492941 conn(0x7f4a280f0d40 msgr2=0x7f4a280fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:03.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.697+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 shutdown_connections 2022-02-02T14:44:03.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.697+0000 7f4a301fd700 1 -- 172.21.15.33:0/264492941 wait complete. 2022-02-02T14:44:03.706 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:44:03.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 -- 172.21.15.33:0/2357195211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f6ff0 msgr2=0x7f4c8c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 --2- 172.21.15.33:0/2357195211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c0f7a20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 rx=0x7f4c7c004660 tx=0x7f4c7c009b30).stop 2022-02-02T14:44:03.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 -- 172.21.15.33:0/2357195211 shutdown_connections 2022-02-02T14:44:03.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 --2- 172.21.15.33:0/2357195211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c0f7a20 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 --2- 172.21.15.33:0/2357195211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 -- 172.21.15.33:0/2357195211 >> 172.21.15.33:0/2357195211 conn(0x7f4c8c0f1f00 msgr2=0x7f4c8c0f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:03.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 -- 172.21.15.33:0/2357195211 shutdown_connections 2022-02-02T14:44:03.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.797+0000 7f4c913b6700 1 -- 172.21.15.33:0/2357195211 wait complete. 2022-02-02T14:44:03.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 Processor -- start 2022-02-02T14:44:03.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 -- start start 2022-02-02T14:44:03.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c105210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c105810 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.798+0000 7f4c913b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c105950 con 0x7f4c8c0f6ff0 2022-02-02T14:44:03.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34266/0 (socket says 172.21.15.33:34266) 2022-02-02T14:44:03.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 -- 172.21.15.33:0/801083743 learned_addr learned my addr 172.21.15.33:0/801083743 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:03.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8a7fc700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c105210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 -- 172.21.15.33:0/801083743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 msgr2=0x7f4c8c105210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:03.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c105210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:03.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 -- 172.21.15.33:0/801083743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c005040 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8a7fc700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:44:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c8affd700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f4c740026d0 tx=0x7f4c74009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c74009320 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8c10b520 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c7400f040 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c740147e0 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.799+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c8c10bae0 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.800+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c8c045ad0 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.801+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c74009480 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.801+0000 7f4c837fe700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 0x7f4c78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.801+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c740821b0 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.801+0000 7f4c8a7fc700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 0x7f4c78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.802+0000 7f4c8a7fc700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 0x7f4c78067290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4c7c004630 tx=0x7f4c7c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:03.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.805+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c74050260 con 0x7f4c8c0f66e0 2022-02-02T14:44:03.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:03.985+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c8c0fbe40 con 0x7f4c78064dd0 2022-02-02T14:44:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.000+0000 7f4c837fe700 1 -- 172.21.15.33:0/801083743 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4c8c0fbe40 con 0x7f4c78064dd0 2022-02-02T14:44:04.000 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:44:04.001 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (69m) 31m ago 70m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:44:04.001 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (62m) 31m ago 70m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:44:04.001 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (62m) 31m ago 69m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:44:04.001 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (69m) 31m ago 70m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:44:04.002 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (62m) 31m ago 66m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:44:04.002 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (63m) 31m ago 66m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:44:04.002 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (64m) 31m ago 66m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:44:04.002 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (66m) 31m ago 66m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:44:04.002 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (63m) 31m ago 71m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:44:04.003 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (63m) 31m ago 69m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:44:04.003 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (63m) 31m ago 71m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:44:04.003 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (62m) 31m ago 69m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:44:04.003 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (70m) 31m ago 70m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:44:04.004 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (69m) 31m ago 69m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:44:04.004 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 31m ago 69m - 4096M 2022-02-02T14:44:04.004 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (68m) 31m ago 68m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:44:04.004 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (68m) 31m ago 68m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:44:04.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (68m) 31m ago 68m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:44:04.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (67m) 31m ago 67m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:44:04.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (67m) 31m ago 67m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:44:04.005 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (69m) 31m ago 69m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:44:04.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 msgr2=0x7f4c78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 0x7f4c78067290 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f4c7c004630 tx=0x7f4c7c009b30).stop 2022-02-02T14:44:04.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 msgr2=0x7f4c8c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f4c740026d0 tx=0x7f4c74009de0).stop 2022-02-02T14:44:04.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 shutdown_connections 2022-02-02T14:44:04.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c78064dd0 0x7f4c78067290 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8c0f66e0 0x7f4c8c104d20 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 --2- 172.21.15.33:0/801083743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8c0f6ff0 0x7f4c8c105210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 >> 172.21.15.33:0/801083743 conn(0x7f4c8c0f1f00 msgr2=0x7f4c8c06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:04.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 shutdown_connections 2022-02-02T14:44:04.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.002+0000 7f4c913b6700 1 -- 172.21.15.33:0/801083743 wait complete. 2022-02-02T14:44:04.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 -- 172.21.15.33:0/948183084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 msgr2=0x7f4a640f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/948183084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a640f6cc0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f4a60004660 tx=0x7f4a60009b30).stop 2022-02-02T14:44:04.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 -- 172.21.15.33:0/948183084 shutdown_connections 2022-02-02T14:44:04.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/948183084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a640f6cc0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/948183084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 0x7f4a640f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 -- 172.21.15.33:0/948183084 >> 172.21.15.33:0/948183084 conn(0x7f4a640f0d40 msgr2=0x7f4a640f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:04.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 -- 172.21.15.33:0/948183084 shutdown_connections 2022-02-02T14:44:04.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.102+0000 7f4a6c28f700 1 -- 172.21.15.33:0/948183084 wait complete. 2022-02-02T14:44:04.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 Processor -- start 2022-02-02T14:44:04.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 -- start start 2022-02-02T14:44:04.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 0x7f4a64109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a640603e0 con 0x7f4a640f6860 2022-02-02T14:44:04.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6c28f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a64060520 con 0x7f4a640f55c0 2022-02-02T14:44:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6982a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6982a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34278/0 (socket says 172.21.15.33:34278) 2022-02-02T14:44:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6982a700 1 -- 172.21.15.33:0/3790071277 learned_addr learned my addr 172.21.15.33:0/3790071277 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6a02b700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 0x7f4a64109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6982a700 1 -- 172.21.15.33:0/3790071277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 msgr2=0x7f4a64109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.103+0000 7f4a6982a700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 0x7f4a64109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a6982a700 1 -- 172.21.15.33:0/3790071277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60005040 con 0x7f4a640f6860 2022-02-02T14:44:04.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a6982a700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f4a60000c00 tx=0x7f4a6000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:04.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a60019070 con 0x7f4a640f6860 2022-02-02T14:44:04.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a60007e70 con 0x7f4a640f6860 2022-02-02T14:44:04.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a6410c630 con 0x7f4a640f6860 2022-02-02T14:44:04.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a60014ce0 con 0x7f4a640f6860 2022-02-02T14:44:04.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.104+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a6410cb90 con 0x7f4a640f6860 2022-02-02T14:44:04.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.105+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a64045ad0 con 0x7f4a640f6860 2022-02-02T14:44:04.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.106+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a60025070 con 0x7f4a640f6860 2022-02-02T14:44:04.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.107+0000 7f4a5affd700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 0x7f4a50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.107+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4a60082db0 con 0x7f4a640f6860 2022-02-02T14:44:04.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.107+0000 7f4a6a02b700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 0x7f4a50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.107+0000 7f4a6a02b700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 0x7f4a50067290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4a64060060 tx=0x7f4a5400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:04.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.110+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a60050e60 con 0x7f4a640f6860 2022-02-02T14:44:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.349+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4a640fdf20 con 0x7f4a640f6860 2022-02-02T14:44:04.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.350+0000 7f4a5affd700 1 -- 172.21.15.33:0/3790071277 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4a60023020 con 0x7f4a640f6860 2022-02-02T14:44:04.351 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:44:04.351 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:44:04.352 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:44:04.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:04.352 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:44:04.352 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:44:04.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:04.353 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:44:04.353 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:44:04.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:04.354 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:44:04.354 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:44:04.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:04.354 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:44:04.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:44:04.355 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:44:04.355 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:44:04.355 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:44:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.351+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 msgr2=0x7f4a50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.351+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 0x7f4a50067290 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f4a64060060 tx=0x7f4a5400b040).stop 2022-02-02T14:44:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.351+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 msgr2=0x7f4a6410c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.351+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f4a60000c00 tx=0x7f4a6000b040).stop 2022-02-02T14:44:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 shutdown_connections 2022-02-02T14:44:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a50064dd0 0x7f4a50067290 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a640f55c0 0x7f4a64109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 --2- 172.21.15.33:0/3790071277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a640f6860 0x7f4a6410c0e0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 >> 172.21.15.33:0/3790071277 conn(0x7f4a640f0d40 msgr2=0x7f4a640fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 shutdown_connections 2022-02-02T14:44:04.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.352+0000 7f4a6c28f700 1 -- 172.21.15.33:0/3790071277 wait complete. 2022-02-02T14:44:04.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 -- 172.21.15.33:0/887456688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 msgr2=0x7f21d00f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 --2- 172.21.15.33:0/887456688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d00f5d30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f21c0004660 tx=0x7f21c0009b30).stop 2022-02-02T14:44:04.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 -- 172.21.15.33:0/887456688 shutdown_connections 2022-02-02T14:44:04.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 --2- 172.21.15.33:0/887456688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d00f5d30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 --2- 172.21.15.33:0/887456688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 0x7f21d00f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.453+0000 7f21d7efe700 1 -- 172.21.15.33:0/887456688 >> 172.21.15.33:0/887456688 conn(0x7f21d00f04c0 msgr2=0x7f21d00f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:04.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 -- 172.21.15.33:0/887456688 shutdown_connections 2022-02-02T14:44:04.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 -- 172.21.15.33:0/887456688 wait complete. 2022-02-02T14:44:04.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 Processor -- start 2022-02-02T14:44:04.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 -- start start 2022-02-02T14:44:04.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 0x7f21d010e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00f5430 con 0x7f21d00f58b0 2022-02-02T14:44:04.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d7efe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00f5570 con 0x7f21d00f6bb0 2022-02-02T14:44:04.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.454+0000 7f21d5c9a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34286/0 (socket says 172.21.15.33:34286) 2022-02-02T14:44:04.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 -- 172.21.15.33:0/3967492983 learned_addr learned my addr 172.21.15.33:0/3967492983 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:04.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5499700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 0x7f21d010e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 -- 172.21.15.33:0/3967492983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 msgr2=0x7f21d010e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 0x7f21d010e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 -- 172.21.15.33:0/3967492983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21d00f58b0 2022-02-02T14:44:04.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d5c9a700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f21cc002700 tx=0x7f21cc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:04.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21cc0079c0 con 0x7f21d00f58b0 2022-02-02T14:44:04.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f21cc00f040 con 0x7f21d00f58b0 2022-02-02T14:44:04.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d010eac0 con 0x7f21d00f58b0 2022-02-02T14:44:04.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21cc014850 con 0x7f21d00f58b0 2022-02-02T14:44:04.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.455+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d010ef40 con 0x7f21d00f58b0 2022-02-02T14:44:04.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.456+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d0045ad0 con 0x7f21d00f58b0 2022-02-02T14:44:04.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.457+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f21cc01b060 con 0x7f21d00f58b0 2022-02-02T14:44:04.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.457+0000 7f21c67fc700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 0x7f21bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:04.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.457+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f21cc081960 con 0x7f21d00f58b0 2022-02-02T14:44:04.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.457+0000 7f21d5499700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 0x7f21bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:04.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.458+0000 7f21d5499700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 0x7f21bc067290 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f21c0004630 tx=0x7f21c0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:04.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.461+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f21cc04fa10 con 0x7f21d00f58b0 2022-02-02T14:44:04.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.673+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f21d00586e0 con 0x7f21d00f58b0 2022-02-02T14:44:04.674 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:04 smithi033 ceph-mon[101165]: pgmap v1960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:04.675 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3790071277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:44:04.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.674+0000 7f21c67fc700 1 -- 172.21.15.33:0/3967492983 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f21cc019750 con 0x7f21d00f58b0 2022-02-02T14:44:04.676 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:44:04.677 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:44:04.678 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:44:04.678 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:44:04.678 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:04.678 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:44:04.679 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:44:04.679 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:44:04.679 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:44:04.679 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:44:04.680 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:44:04.680 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:44:04.681 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:44:04.681 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:44:04.681 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:44:04.681 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:44:04.682 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:44:04.682 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:44:04.682 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:44:04.683 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:44:04.683 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:44:04.684 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:44:04.684 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:44:04.684 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:44:04.684 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:44:04.684 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:44:04.685 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:44:04.685 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:44:04.685 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:44:04.686 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:44:04.686 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:44:04.686 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:04.687 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:04.687 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:44:04.687 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:04.687 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:04.688 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:04.688 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:04.688 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:04.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 msgr2=0x7f21bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 0x7f21bc067290 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f21c0004630 tx=0x7f21c0009b30).stop 2022-02-02T14:44:04.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 msgr2=0x7f21d010c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:04.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f21cc002700 tx=0x7f21cc009e00).stop 2022-02-02T14:44:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 shutdown_connections 2022-02-02T14:44:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f21bc064dd0 0x7f21bc067290 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21d00f58b0 0x7f21d010c0d0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 --2- 172.21.15.33:0/3967492983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d00f6bb0 0x7f21d010e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.675+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 >> 172.21.15.33:0/3967492983 conn(0x7f21d00f04c0 msgr2=0x7f21d00fa310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.676+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 shutdown_connections 2022-02-02T14:44:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:04.676+0000 7f21d7efe700 1 -- 172.21.15.33:0/3967492983 wait complete. 2022-02-02T14:44:04.692 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:44:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:04 smithi037 ceph-mon[69017]: pgmap v1960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:04.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3790071277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:44:05.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:05 smithi033 ceph-mon[101165]: from='client.36086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:05.742 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:05 smithi033 ceph-mon[101165]: from='client.36090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:05.744 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3967492983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:44:05.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:05 smithi037 ceph-mon[69017]: from='client.36086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:05 smithi037 ceph-mon[69017]: from='client.36090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:05.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3967492983' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:44:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:06 smithi033 ceph-mon[101165]: pgmap v1961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:06 smithi037 ceph-mon[69017]: pgmap v1961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:08 smithi033 ceph-mon[101165]: pgmap v1962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:08 smithi037 ceph-mon[69017]: pgmap v1962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:10.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:10 smithi033 ceph-mon[101165]: pgmap v1963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:10 smithi037 ceph-mon[69017]: pgmap v1963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:12.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:12 smithi033 ceph-mon[101165]: pgmap v1964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:12 smithi037 ceph-mon[69017]: pgmap v1964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:14.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:14 smithi033 ceph-mon[101165]: pgmap v1965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:14 smithi037 ceph-mon[69017]: pgmap v1965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:16.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:16 smithi033 ceph-mon[101165]: pgmap v1966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:16 smithi037 ceph-mon[69017]: pgmap v1966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:18 smithi033 ceph-mon[101165]: pgmap v1967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:18 smithi037 ceph-mon[69017]: pgmap v1967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:20 smithi033 ceph-mon[101165]: pgmap v1968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:20 smithi037 ceph-mon[69017]: pgmap v1968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:22.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:22 smithi033 ceph-mon[101165]: pgmap v1969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:22 smithi037 ceph-mon[69017]: pgmap v1969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:24 smithi033 ceph-mon[101165]: pgmap v1970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:24 smithi037 ceph-mon[69017]: pgmap v1970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:26.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:26 smithi033 ceph-mon[101165]: pgmap v1971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:26 smithi037 ceph-mon[69017]: pgmap v1971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:28.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:28 smithi033 ceph-mon[101165]: pgmap v1972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:28 smithi037 ceph-mon[69017]: pgmap v1972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:30 smithi037 ceph-mon[69017]: pgmap v1973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:30 smithi033 ceph-mon[101165]: pgmap v1973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:32 smithi037 ceph-mon[69017]: pgmap v1974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:32.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:32 smithi033 ceph-mon[101165]: pgmap v1974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:34 smithi037 ceph-mon[69017]: pgmap v1975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:34.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3970539293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 msgr2=0x7f5dc80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:34.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3970539293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc80f6cc0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f5db8004660 tx=0x7f5db8009b30).stop 2022-02-02T14:44:34.792 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:34 smithi033 ceph-mon[101165]: pgmap v1975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:34.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3970539293 shutdown_connections 2022-02-02T14:44:34.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3970539293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc80f6cc0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3970539293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3970539293 >> 172.21.15.33:0/3970539293 conn(0x7f5dc80f0d40 msgr2=0x7f5dc80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:34.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3970539293 shutdown_connections 2022-02-02T14:44:34.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.792+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3970539293 wait complete. 2022-02-02T14:44:34.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 Processor -- start 2022-02-02T14:44:34.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 -- start start 2022-02-02T14:44:34.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:34.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc81051d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:34.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc81057d0 con 0x7f5dc80f6860 2022-02-02T14:44:34.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dccb6a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc8105910 con 0x7f5dc80f55c0 2022-02-02T14:44:34.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dc5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc81051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:34.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dc659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:34.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dc659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:45012/0 (socket says 172.21.15.33:45012) 2022-02-02T14:44:34.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.793+0000 7f5dc659c700 1 -- 172.21.15.33:0/3716138558 learned_addr learned my addr 172.21.15.33:0/3716138558 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:34.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dc5d9b700 1 -- 172.21.15.33:0/3716138558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 msgr2=0x7f5dc8104ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:34.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dc5d9b700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dc5d9b700 1 -- 172.21.15.33:0/3716138558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db8005040 con 0x7f5dc80f6860 2022-02-02T14:44:34.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dc659c700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:44:34.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dc5d9b700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc81051d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f5db8009830 tx=0x7f5db8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:34.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db8018070 con 0x7f5dc80f6860 2022-02-02T14:44:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc810b480 con 0x7f5dc80f6860 2022-02-02T14:44:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5db8007ba0 con 0x7f5dc80f6860 2022-02-02T14:44:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5db801de60 con 0x7f5dc80f6860 2022-02-02T14:44:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.794+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc810b9e0 con 0x7f5dc80f6860 2022-02-02T14:44:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.795+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc8045ad0 con 0x7f5dc80f6860 2022-02-02T14:44:34.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.796+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5db801d420 con 0x7f5dc80f6860 2022-02-02T14:44:34.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.796+0000 7f5dbeffd700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 0x7f5db4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:34.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.796+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5db8083630 con 0x7f5dc80f6860 2022-02-02T14:44:34.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.796+0000 7f5dc659c700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 0x7f5db4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:34.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.797+0000 7f5dc659c700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 0x7f5db4067270 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f5dc8104a70 tx=0x7f5db000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:34.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.801+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5db8051680 con 0x7f5dc80f6860 2022-02-02T14:44:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.990+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dc8106110 con 0x7f5db4064db0 2022-02-02T14:44:34.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.992+0000 7f5dbeffd700 1 -- 172.21.15.33:0/3716138558 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5dc8106110 con 0x7f5db4064db0 2022-02-02T14:44:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 msgr2=0x7f5db4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 0x7f5db4067270 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f5dc8104a70 tx=0x7f5db000b040).stop 2022-02-02T14:44:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 msgr2=0x7f5dc81051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc81051d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f5db8009830 tx=0x7f5db8009b30).stop 2022-02-02T14:44:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 shutdown_connections 2022-02-02T14:44:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5db4064db0 0x7f5db4067270 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dc80f55c0 0x7f5dc8104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 --2- 172.21.15.33:0/3716138558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc80f6860 0x7f5dc81051d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.993+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 >> 172.21.15.33:0/3716138558 conn(0x7f5dc80f0d40 msgr2=0x7f5dc80fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.994+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 shutdown_connections 2022-02-02T14:44:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:34.994+0000 7f5dccb6a700 1 -- 172.21.15.33:0/3716138558 wait complete. 2022-02-02T14:44:35.002 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:44:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 -- 172.21.15.33:0/3283226955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 msgr2=0x7fc9540f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 --2- 172.21.15.33:0/3283226955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc9540f7de0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7fc948004660 tx=0x7fc948009b30).stop 2022-02-02T14:44:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 -- 172.21.15.33:0/3283226955 shutdown_connections 2022-02-02T14:44:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 --2- 172.21.15.33:0/3283226955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc9540f7de0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 --2- 172.21.15.33:0/3283226955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc9540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 -- 172.21.15.33:0/3283226955 >> 172.21.15.33:0/3283226955 conn(0x7fc9540f1e40 msgr2=0x7fc9540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 -- 172.21.15.33:0/3283226955 shutdown_connections 2022-02-02T14:44:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.094+0000 7fc95c56c700 1 -- 172.21.15.33:0/3283226955 wait complete. 2022-02-02T14:44:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 Processor -- start 2022-02-02T14:44:35.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 -- start start 2022-02-02T14:44:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc954106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9541079b0 con 0x7fc9540f7980 2022-02-02T14:44:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.095+0000 7fc95c56c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc954107af0 con 0x7fc9540f66e0 2022-02-02T14:44:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34308/0 (socket says 172.21.15.33:34308) 2022-02-02T14:44:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 -- 172.21.15.33:0/1333608548 learned_addr learned my addr 172.21.15.33:0/1333608548 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc95a308700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc954106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 -- 172.21.15.33:0/1333608548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 msgr2=0x7fc954106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc954106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 -- 172.21.15.33:0/1333608548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948005040 con 0x7fc9540f7980 2022-02-02T14:44:35.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc95a308700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc954106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:44:35.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc959b07700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fc948000c00 tx=0x7fc94800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc948019070 con 0x7fc9540f7980 2022-02-02T14:44:35.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc948007e70 con 0x7fc9540f7980 2022-02-02T14:44:35.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc954108430 con 0x7fc9540f7980 2022-02-02T14:44:35.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc948014ce0 con 0x7fc9540f7980 2022-02-02T14:44:35.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.096+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc954108990 con 0x7fc9540f7980 2022-02-02T14:44:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.098+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc954045ad0 con 0x7fc9540f7980 2022-02-02T14:44:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.099+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc948025070 con 0x7fc9540f7980 2022-02-02T14:44:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.099+0000 7fc946ffd700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 0x7fc940067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.099+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc948082a30 con 0x7fc9540f7980 2022-02-02T14:44:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.099+0000 7fc95a308700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 0x7fc940067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.100+0000 7fc95a308700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 0x7fc940067290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fc950009fd0 tx=0x7fc95000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.103+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc948054510 con 0x7fc9540f7980 2022-02-02T14:44:35.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.286+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9540ff010 con 0x7fc940064dd0 2022-02-02T14:44:35.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.301+0000 7fc946ffd700 1 -- 172.21.15.33:0/1333608548 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc9540ff010 con 0x7fc940064dd0 2022-02-02T14:44:35.300 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:44:35.301 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (69m) 31m ago 70m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:44:35.301 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (62m) 31m ago 70m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:44:35.301 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (62m) 32m ago 70m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:44:35.301 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (69m) 31m ago 70m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:44:35.302 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (63m) 31m ago 67m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:44:35.302 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (64m) 31m ago 67m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:44:35.302 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (64m) 32m ago 67m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:44:35.302 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (67m) 32m ago 67m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:44:35.303 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (64m) 31m ago 72m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:44:35.303 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (64m) 32m ago 70m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:44:35.303 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (63m) 31m ago 72m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:44:35.303 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (63m) 32m ago 70m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:44:35.304 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (70m) 31m ago 70m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:44:35.304 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (70m) 32m ago 70m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:44:35.304 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 31m ago 69m - 4096M 2022-02-02T14:44:35.305 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (69m) 31m ago 69m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:44:35.305 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (69m) 31m ago 68m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:44:35.305 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (68m) 32m ago 68m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:44:35.305 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (68m) 32m ago 68m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:44:35.306 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (68m) 32m ago 68m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:44:35.306 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (69m) 31m ago 70m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:44:35.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 msgr2=0x7fc940067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 0x7fc940067290 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fc950009fd0 tx=0x7fc95000b040).stop 2022-02-02T14:44:35.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 msgr2=0x7fc954107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 rx=0x7fc948000c00 tx=0x7fc94800b040).stop 2022-02-02T14:44:35.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 shutdown_connections 2022-02-02T14:44:35.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc940064dd0 0x7fc940067290 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9540f66e0 0x7fc954106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 --2- 172.21.15.33:0/1333608548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9540f7980 0x7fc954107400 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.302+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 >> 172.21.15.33:0/1333608548 conn(0x7fc9540f1e40 msgr2=0x7fc9540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:35.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.303+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 shutdown_connections 2022-02-02T14:44:35.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.303+0000 7fc95c56c700 1 -- 172.21.15.33:0/1333608548 wait complete. 2022-02-02T14:44:35.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 -- 172.21.15.33:0/1669425589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 msgr2=0x7fcb100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/1669425589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 0x7fcb100f6cc0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7fcb04004660 tx=0x7fcb04009b30).stop 2022-02-02T14:44:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 -- 172.21.15.33:0/1669425589 shutdown_connections 2022-02-02T14:44:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/1669425589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 0x7fcb100f6cc0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/1669425589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:44:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 -- 172.21.15.33:0/1669425589 >> 172.21.15.33:0/1669425589 conn(0x7fcb100f0d40 msgr2=0x7fcb100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.402+0000 7fcb15b5f700 1 -- 172.21.15.33:0/1669425589 shutdown_connections 2022-02-02T14:44:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 -- 172.21.15.33:0/1669425589 wait complete. 2022-02-02T14:44:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 Processor -- start 2022-02-02T14:44:35.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 -- start start 2022-02-02T14:44:35.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 0x7fcb100f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100f8190 con 0x7fcb100f6860 2022-02-02T14:44:35.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.403+0000 7fcb15b5f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100f82d0 con 0x7fcb100f55c0 2022-02-02T14:44:35.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:45032/0 (socket says 172.21.15.33:45032) 2022-02-02T14:44:35.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 -- 172.21.15.33:0/3175062323 learned_addr learned my addr 172.21.15.33:0/3175062323 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:35.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 -- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 msgr2=0x7fcb100f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 0x7fcb100f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:44:35.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 -- 172.21.15.33:0/3175062323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04005040 con 0x7fcb100f55c0 2022-02-02T14:44:35.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.404+0000 7fcb0f7fe700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcb000093f0 tx=0x7fcb00006ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.405+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb00009ea0 con 0x7fcb100f55c0 2022-02-02T14:44:35.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.405+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100f85b0 con 0x7fcb100f55c0 2022-02-02T14:44:35.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.405+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1010efb0 con 0x7fcb100f55c0 2022-02-02T14:44:35.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.405+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb00013af0 con 0x7fcb100f55c0 2022-02-02T14:44:35.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.405+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb0000da00 con 0x7fcb100f55c0 2022-02-02T14:44:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.406+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf0004fa0 con 0x7fcb100f55c0 2022-02-02T14:44:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.406+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb0001a060 con 0x7fcb100f55c0 2022-02-02T14:44:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.406+0000 7fcaf7fff700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 0x7fcaf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.407+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb000819d0 con 0x7fcb100f55c0 2022-02-02T14:44:35.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.407+0000 7fcb0effd700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 0x7fcaf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.407+0000 7fcb0effd700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 0x7fcaf8067290 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fcb04004e30 tx=0x7fcb04009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.411+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb0004fa20 con 0x7fcb100f55c0 2022-02-02T14:44:35.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.661+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcaf0005e80 con 0x7fcb100f55c0 2022-02-02T14:44:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.661+0000 7fcaf7fff700 1 -- 172.21.15.33:0/3175062323 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fcb00053040 con 0x7fcb100f55c0 2022-02-02T14:44:35.661 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:44:35.661 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:44:35.662 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:44:35.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:35.662 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:44:35.663 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:44:35.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:35.663 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:44:35.663 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:44:35.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:35.664 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:44:35.664 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:44:35.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:44:35.664 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:44:35.664 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:44:35.665 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:44:35.665 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:44:35.665 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:44:35.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 msgr2=0x7fcaf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 0x7fcaf8067290 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fcb04004e30 tx=0x7fcb04009b30).stop 2022-02-02T14:44:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 msgr2=0x7fcb100f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fcb000093f0 tx=0x7fcb00006ec0).stop 2022-02-02T14:44:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 shutdown_connections 2022-02-02T14:44:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcaf8064dd0 0x7fcaf8067290 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb100f55c0 0x7fcb100f9720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 --2- 172.21.15.33:0/3175062323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb100f6860 0x7fcb100f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:44:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.663+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 >> 172.21.15.33:0/3175062323 conn(0x7fcb100f0d40 msgr2=0x7fcb1005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.664+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 shutdown_connections 2022-02-02T14:44:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.664+0000 7fcb15b5f700 1 -- 172.21.15.33:0/3175062323 wait complete. 2022-02-02T14:44:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 -- 172.21.15.33:0/3377208758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f77d0 msgr2=0x7fc4980f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 --2- 172.21.15.33:0/3377208758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f77d0 0x7fc4980f7c30 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 rx=0x7fc488004660 tx=0x7fc488009b30).stop 2022-02-02T14:44:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 -- 172.21.15.33:0/3377208758 shutdown_connections 2022-02-02T14:44:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 --2- 172.21.15.33:0/3377208758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f77d0 0x7fc4980f7c30 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 --2- 172.21.15.33:0/3377208758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f6530 0x7fc4980f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.764+0000 7fc49e53b700 1 -- 172.21.15.33:0/3377208758 >> 172.21.15.33:0/3377208758 conn(0x7fc4980f1c90 msgr2=0x7fc4980f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.765+0000 7fc49e53b700 1 -- 172.21.15.33:0/3377208758 shutdown_connections 2022-02-02T14:44:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.765+0000 7fc49e53b700 1 -- 172.21.15.33:0/3377208758 wait complete. 2022-02-02T14:44:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.765+0000 7fc49e53b700 1 Processor -- start 2022-02-02T14:44:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.765+0000 7fc49e53b700 1 -- start start 2022-02-02T14:44:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49e53b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49e53b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f77d0 0x7fc498107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49e53b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498107880 con 0x7fc4980f6530 2022-02-02T14:44:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49e53b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc498108090 con 0x7fc4980f77d0 2022-02-02T14:44:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34326/0 (socket says 172.21.15.33:34326) 2022-02-02T14:44:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 -- 172.21.15.33:0/852163300 learned_addr learned my addr 172.21.15.33:0/852163300 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:44:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49cd38700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f77d0 0x7fc498107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 -- 172.21.15.33:0/852163300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f77d0 msgr2=0x7fc498107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:35.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f77d0 0x7fc498107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 -- 172.21.15.33:0/852163300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488005040 con 0x7fc4980f6530 2022-02-02T14:44:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49d539700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fc494002700 tx=0x7fc494009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4940079c0 con 0x7fc4980f6530 2022-02-02T14:44:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc49400f040 con 0x7fc4980f6530 2022-02-02T14:44:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc498108310 con 0x7fc4980f6530 2022-02-02T14:44:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.766+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc494014860 con 0x7fc4980f6530 2022-02-02T14:44:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.767+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4981088d0 con 0x7fc4980f6530 2022-02-02T14:44:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.767+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc498059100 con 0x7fc4980f6530 2022-02-02T14:44:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.768+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc49401b060 con 0x7fc4980f6530 2022-02-02T14:44:35.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.769+0000 7fc48dffb700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 0x7fc4840672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:44:35.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.769+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc4940819d0 con 0x7fc4980f6530 2022-02-02T14:44:35.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.769+0000 7fc49cd38700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 0x7fc4840672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:44:35.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.769+0000 7fc49cd38700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 0x7fc4840672e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc488004630 tx=0x7fc488009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:44:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.773+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc49404f9c0 con 0x7fc4980f6530 2022-02-02T14:44:35.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.988+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc4980fee00 con 0x7fc4980f6530 2022-02-02T14:44:35.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.988+0000 7fc48dffb700 1 -- 172.21.15.33:0/852163300 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc494019750 con 0x7fc4980f6530 2022-02-02T14:44:35.988 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:44:35.989 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:44:35.989 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:44:35.989 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:44:35.989 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:35.990 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:44:35.990 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:44:35.991 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:44:35.991 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:44:35.991 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:44:35.992 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:44:35.993 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:44:35.993 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:44:35.993 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:44:35.993 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:44:35.994 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:44:35.994 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:44:35.994 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:44:35.994 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:44:35.995 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:44:35.995 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:44:35.995 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:44:35.995 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:44:35.996 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:44:35.996 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:44:35.996 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:44:35.996 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:44:35.996 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:44:35.997 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:44:35.997 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:44:35.997 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:44:35.997 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:35.998 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:35.998 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:44:35.998 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:44:35.998 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:35.998 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:35.999 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:35.999 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:44:36.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 msgr2=0x7fc4840672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:36.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 0x7fc4840672e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc488004630 tx=0x7fc488009b30).stop 2022-02-02T14:44:36.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 msgr2=0x7fc498106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:44:36.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fc494002700 tx=0x7fc494009d80).stop 2022-02-02T14:44:36.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 shutdown_connections 2022-02-02T14:44:36.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc484064e20 0x7fc4840672e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:36.001 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4980f6530 0x7fc498106d90 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 --2- 172.21.15.33:0/852163300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4980f77d0 0x7fc498107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:44:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 >> 172.21.15.33:0/852163300 conn(0x7fc4980f1c90 msgr2=0x7fc4980fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:44:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 shutdown_connections 2022-02-02T14:44:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:44:35.991+0000 7fc49e53b700 1 -- 172.21.15.33:0/852163300 wait complete. 2022-02-02T14:44:36.003 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:44:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:36 smithi037 ceph-mon[69017]: from='client.36102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:36 smithi037 ceph-mon[69017]: pgmap v1976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:36 smithi037 ceph-mon[69017]: from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3175062323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:44:36.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/852163300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:44:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:36 smithi033 ceph-mon[101165]: from='client.36102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:36 smithi033 ceph-mon[101165]: pgmap v1976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:36 smithi033 ceph-mon[101165]: from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:44:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3175062323' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:44:36.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/852163300' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:44:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:38 smithi037 ceph-mon[69017]: pgmap v1977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:38 smithi033 ceph-mon[101165]: pgmap v1977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:40 smithi037 ceph-mon[69017]: pgmap v1978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:40 smithi033 ceph-mon[101165]: pgmap v1978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:42 smithi037 ceph-mon[69017]: pgmap v1979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:42 smithi033 ceph-mon[101165]: pgmap v1979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:44 smithi037 ceph-mon[69017]: pgmap v1980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:44 smithi033 ceph-mon[101165]: pgmap v1980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:46 smithi037 ceph-mon[69017]: pgmap v1981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:46 smithi033 ceph-mon[101165]: pgmap v1981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:48 smithi037 ceph-mon[69017]: pgmap v1982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:48.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:48 smithi033 ceph-mon[101165]: pgmap v1982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:50 smithi037 ceph-mon[69017]: pgmap v1983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:50.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:50 smithi033 ceph-mon[101165]: pgmap v1983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:52 smithi037 ceph-mon[69017]: pgmap v1984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:52.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:52 smithi033 ceph-mon[101165]: pgmap v1984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:54 smithi037 ceph-mon[69017]: pgmap v1985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:44:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:44:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:54 smithi033 ceph-mon[101165]: pgmap v1985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:44:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:44:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:56 smithi037 ceph-mon[69017]: pgmap v1986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:56 smithi033 ceph-mon[101165]: pgmap v1986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:44:58 smithi037 ceph-mon[69017]: pgmap v1987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:44:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:44:58 smithi033 ceph-mon[101165]: pgmap v1987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:00 smithi037 ceph-mon[69017]: pgmap v1988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:00 smithi033 ceph-mon[101165]: pgmap v1988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:02 smithi033 ceph-mon[101165]: pgmap v1989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:02 smithi037 ceph-mon[69017]: pgmap v1989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:04 smithi033 ceph-mon[101165]: pgmap v1990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:04 smithi037 ceph-mon[69017]: pgmap v1990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:06.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 -- 172.21.15.33:0/1158351466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f66e0 msgr2=0x7fa7180f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 --2- 172.21.15.33:0/1158351466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f66e0 0x7fa7180f6b00 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fa708004660 tx=0x7fa708009b30).stop 2022-02-02T14:45:06.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 -- 172.21.15.33:0/1158351466 shutdown_connections 2022-02-02T14:45:06.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 --2- 172.21.15.33:0/1158351466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f7980 0x7fa7180f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 --2- 172.21.15.33:0/1158351466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f66e0 0x7fa7180f6b00 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 -- 172.21.15.33:0/1158351466 >> 172.21.15.33:0/1158351466 conn(0x7fa7180f1e40 msgr2=0x7fa7180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 -- 172.21.15.33:0/1158351466 shutdown_connections 2022-02-02T14:45:06.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.105+0000 7fa7203cf700 1 -- 172.21.15.33:0/1158351466 wait complete. 2022-02-02T14:45:06.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 Processor -- start 2022-02-02T14:45:06.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 -- start start 2022-02-02T14:45:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 0x7fa71806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806a380 con 0x7fa7180f7980 2022-02-02T14:45:06.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa7203cf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71806a4c0 con 0x7fa7180f66e0 2022-02-02T14:45:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa71d96a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa71e16b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 0x7fa71806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa71d96a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34342/0 (socket says 172.21.15.33:34342) 2022-02-02T14:45:06.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.106+0000 7fa71d96a700 1 -- 172.21.15.33:0/2894677497 learned_addr learned my addr 172.21.15.33:0/2894677497 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:06.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa71d96a700 1 -- 172.21.15.33:0/2894677497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 msgr2=0x7fa71806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa71d96a700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 0x7fa71806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa71d96a700 1 -- 172.21.15.33:0/2894677497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa708005040 con 0x7fa7180f7980 2022-02-02T14:45:06.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa71e16b700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 0x7fa71806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:45:06.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa71d96a700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa7140026d0 tx=0x7fa714009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140079c0 con 0x7fa7180f7980 2022-02-02T14:45:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa71400f040 con 0x7fa7180f7980 2022-02-02T14:45:06.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71806a7a0 con 0x7fa7180f7980 2022-02-02T14:45:06.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7140148b0 con 0x7fa7180f7980 2022-02-02T14:45:06.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.107+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71810efe0 con 0x7fa7180f7980 2022-02-02T14:45:06.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.108+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa718045ad0 con 0x7fa7180f7980 2022-02-02T14:45:06.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.109+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa714007b20 con 0x7fa7180f7980 2022-02-02T14:45:06.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.109+0000 7fa70effd700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.109+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa714081f00 con 0x7fa7180f7980 2022-02-02T14:45:06.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.110+0000 7fa71e16b700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.110+0000 7fa71e16b700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 0x7fa704067290 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fa708013690 tx=0x7fa708009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.113+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa71404fef0 con 0x7fa7180f7980 2022-02-02T14:45:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.302+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa718057f10 con 0x7fa704064dd0 2022-02-02T14:45:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.303+0000 7fa70effd700 1 -- 172.21.15.33:0/2894677497 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa718057f10 con 0x7fa704064dd0 2022-02-02T14:45:06.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 msgr2=0x7fa704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 0x7fa704067290 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fa708013690 tx=0x7fa708009b30).stop 2022-02-02T14:45:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 msgr2=0x7fa718069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa7140026d0 tx=0x7fa714009de0).stop 2022-02-02T14:45:06.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 shutdown_connections 2022-02-02T14:45:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa704064dd0 0x7fa704067290 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7180f66e0 0x7fa71806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 --2- 172.21.15.33:0/2894677497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7180f7980 0x7fa718069e20 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 >> 172.21.15.33:0/2894677497 conn(0x7fa7180f1e40 msgr2=0x7fa7180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 shutdown_connections 2022-02-02T14:45:06.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.305+0000 7fa7203cf700 1 -- 172.21.15.33:0/2894677497 wait complete. 2022-02-02T14:45:06.315 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:45:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 -- 172.21.15.33:0/3988670941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f6860 msgr2=0x7fd6540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 --2- 172.21.15.33:0/3988670941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f6860 0x7fd6540f6cc0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fd640004660 tx=0x7fd640009b30).stop 2022-02-02T14:45:06.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 -- 172.21.15.33:0/3988670941 shutdown_connections 2022-02-02T14:45:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 --2- 172.21.15.33:0/3988670941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f6860 0x7fd6540f6cc0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 --2- 172.21.15.33:0/3988670941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f55c0 0x7fd6540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 -- 172.21.15.33:0/3988670941 >> 172.21.15.33:0/3988670941 conn(0x7fd6540f0d40 msgr2=0x7fd6540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 -- 172.21.15.33:0/3988670941 shutdown_connections 2022-02-02T14:45:06.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.406+0000 7fd65af2f700 1 -- 172.21.15.33:0/3988670941 wait complete. 2022-02-02T14:45:06.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 Processor -- start 2022-02-02T14:45:06.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 -- start start 2022-02-02T14:45:06.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 0x7fd654109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654109c20 con 0x7fd6540f55c0 2022-02-02T14:45:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd65af2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd654109d60 con 0x7fd6540f6860 2022-02-02T14:45:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34350/0 (socket says 172.21.15.33:34350) 2022-02-02T14:45:06.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 -- 172.21.15.33:0/509931605 learned_addr learned my addr 172.21.15.33:0/509931605 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd653fff700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 0x7fd654109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 -- 172.21.15.33:0/509931605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 msgr2=0x7fd654109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 0x7fd654109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.407+0000 7fd658ccb700 1 -- 172.21.15.33:0/509931605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640005040 con 0x7fd6540f55c0 2022-02-02T14:45:06.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd653fff700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 0x7fd654109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:45:06.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd658ccb700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd648002700 tx=0x7fd648009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd648009320 con 0x7fd6540f55c0 2022-02-02T14:45:06.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65410a700 con 0x7fd6540f55c0 2022-02-02T14:45:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd64800f040 con 0x7fd6540f55c0 2022-02-02T14:45:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd648014900 con 0x7fd6540f55c0 2022-02-02T14:45:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.408+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65410acc0 con 0x7fd6540f55c0 2022-02-02T14:45:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.409+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd654045ad0 con 0x7fd6540f55c0 2022-02-02T14:45:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.410+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd648009480 con 0x7fd6540f55c0 2022-02-02T14:45:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.410+0000 7fd6517fa700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 0x7fd644067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.410+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd648081d10 con 0x7fd6540f55c0 2022-02-02T14:45:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.410+0000 7fd653fff700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 0x7fd644067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.411+0000 7fd653fff700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 0x7fd644067290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fd640004630 tx=0x7fd640009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.414+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6480538b0 con 0x7fd6540f55c0 2022-02-02T14:45:06.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.598+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6540faaa0 con 0x7fd644064dd0 2022-02-02T14:45:06.599 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:06 smithi033 ceph-mon[101165]: pgmap v1991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.612+0000 7fd6517fa700 1 -- 172.21.15.33:0/509931605 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd6540faaa0 con 0x7fd644064dd0 2022-02-02T14:45:06.613 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:45:06.613 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (70m) 32m ago 71m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:45:06.614 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (63m) 32m ago 71m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:45:06.614 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (63m) 32m ago 70m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:45:06.614 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (70m) 32m ago 71m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:45:06.614 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (63m) 32m ago 67m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:45:06.615 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (64m) 32m ago 67m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:45:06.615 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (65m) 32m ago 67m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:45:06.615 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (67m) 32m ago 67m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:45:06.615 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (65m) 32m ago 72m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:45:06.616 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (64m) 32m ago 70m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:45:06.616 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (64m) 32m ago 72m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:45:06.616 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (63m) 32m ago 70m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:45:06.616 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (71m) 32m ago 71m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:45:06.616 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (70m) 32m ago 70m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:45:06.617 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 32m ago 70m - 4096M 2022-02-02T14:45:06.617 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (69m) 32m ago 69m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:45:06.617 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (69m) 32m ago 69m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:45:06.617 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (69m) 32m ago 69m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:45:06.618 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (68m) 32m ago 68m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:45:06.618 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (68m) 32m ago 68m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:45:06.618 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (70m) 32m ago 70m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:45:06.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 msgr2=0x7fd644067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 0x7fd644067290 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7fd640004630 tx=0x7fd640009b30).stop 2022-02-02T14:45:06.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 msgr2=0x7fd654109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fd648002700 tx=0x7fd648009d80).stop 2022-02-02T14:45:06.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 shutdown_connections 2022-02-02T14:45:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd644064dd0 0x7fd644067290 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6540f55c0 0x7fd654109180 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 --2- 172.21.15.33:0/509931605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6540f6860 0x7fd654109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.614+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 >> 172.21.15.33:0/509931605 conn(0x7fd6540f0d40 msgr2=0x7fd65405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.615+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 shutdown_connections 2022-02-02T14:45:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.615+0000 7fd65af2f700 1 -- 172.21.15.33:0/509931605 wait complete. 2022-02-02T14:45:06.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3196613258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f55c0 msgr2=0x7fdcf80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3196613258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f55c0 0x7fdcf80f59e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 rx=0x7fdce8004660 tx=0x7fdce8009b30).stop 2022-02-02T14:45:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3196613258 shutdown_connections 2022-02-02T14:45:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3196613258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f6860 0x7fdcf80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:45:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3196613258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f55c0 0x7fdcf80f59e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3196613258 >> 172.21.15.33:0/3196613258 conn(0x7fdcf80f0d40 msgr2=0x7fdcf80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3196613258 shutdown_connections 2022-02-02T14:45:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3196613258 wait complete. 2022-02-02T14:45:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.714+0000 7fdcfdb84700 1 Processor -- start 2022-02-02T14:45:06.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcfdb84700 1 -- start start 2022-02-02T14:45:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcfdb84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f55c0 0x7fdcf8109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcfdb84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcfdb84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf8060470 con 0x7fdcf80f6860 2022-02-02T14:45:06.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcfdb84700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf80605b0 con 0x7fdcf80f55c0 2022-02-02T14:45:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34362/0 (socket says 172.21.15.33:34362) 2022-02-02T14:45:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 -- 172.21.15.33:0/3552624553 learned_addr learned my addr 172.21.15.33:0/3552624553 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:06.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf77fe700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f55c0 0x7fdcf8109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 -- 172.21.15.33:0/3552624553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f55c0 msgr2=0x7fdcf8109cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f55c0 0x7fdcf8109cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 -- 172.21.15.33:0/3552624553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8005040 con 0x7fdcf80f6860 2022-02-02T14:45:06.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.715+0000 7fdcf6ffd700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fdcec00b410 tx=0x7fdcec006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.716+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcec0125f0 con 0x7fdcf80f6860 2022-02-02T14:45:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.716+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdcec00be30 con 0x7fdcf80f6860 2022-02-02T14:45:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.716+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf810c820 con 0x7fdcf80f6860 2022-02-02T14:45:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.716+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcec002a70 con 0x7fdcf80f6860 2022-02-02T14:45:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.716+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf810cdb0 con 0x7fdcf80f6860 2022-02-02T14:45:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.717+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf80f49b0 con 0x7fdcf80f6860 2022-02-02T14:45:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.717+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdcec00f030 con 0x7fdcf80f6860 2022-02-02T14:45:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.718+0000 7fdcdffff700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 0x7fdce0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:06.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.718+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdcec081ec0 con 0x7fdcf80f6860 2022-02-02T14:45:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.718+0000 7fdcf77fe700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 0x7fdce0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.718+0000 7fdcf77fe700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 0x7fdce0067270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fdcf8060060 tx=0x7fdce8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.722+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdcec04ff70 con 0x7fdcf80f6860 2022-02-02T14:45:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:06 smithi037 ceph-mon[69017]: pgmap v1991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:06.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.964+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdcf8045ad0 con 0x7fdcf80f6860 2022-02-02T14:45:06.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.965+0000 7fdcdffff700 1 -- 172.21.15.33:0/3552624553 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fdcec053590 con 0x7fdcf80f6860 2022-02-02T14:45:06.967 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:45:06.967 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:45:06.968 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:45:06.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:06.969 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:45:06.969 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:45:06.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:06.970 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:45:06.971 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:45:06.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:06.971 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:45:06.972 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:45:06.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:06.973 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:45:06.973 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:45:06.973 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:45:06.974 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:45:06.974 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:45:06.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 msgr2=0x7fdce0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 0x7fdce0067270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7fdcf8060060 tx=0x7fdce8009b30).stop 2022-02-02T14:45:06.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 msgr2=0x7fdcf810c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:06.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7fdcec00b410 tx=0x7fdcec006ef0).stop 2022-02-02T14:45:06.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 shutdown_connections 2022-02-02T14:45:06.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdce0064db0 0x7fdce0067270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcf80f55c0 0x7fdcf8109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 --2- 172.21.15.33:0/3552624553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcf80f6860 0x7fdcf810c1c0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:06.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 >> 172.21.15.33:0/3552624553 conn(0x7fdcf80f0d40 msgr2=0x7fdcf80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:06.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 shutdown_connections 2022-02-02T14:45:06.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:06.968+0000 7fdcfdb84700 1 -- 172.21.15.33:0/3552624553 wait complete. 2022-02-02T14:45:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 -- 172.21.15.33:0/3510777564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f55c0 msgr2=0x7f9a740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 --2- 172.21.15.33:0/3510777564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f55c0 0x7f9a740f59e0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f9a68004660 tx=0x7f9a68009b30).stop 2022-02-02T14:45:07.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 -- 172.21.15.33:0/3510777564 shutdown_connections 2022-02-02T14:45:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 --2- 172.21.15.33:0/3510777564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f6860 0x7f9a740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 --2- 172.21.15.33:0/3510777564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f55c0 0x7f9a740f59e0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 -- 172.21.15.33:0/3510777564 >> 172.21.15.33:0/3510777564 conn(0x7f9a740f0d40 msgr2=0x7f9a740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:07.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 -- 172.21.15.33:0/3510777564 shutdown_connections 2022-02-02T14:45:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.069+0000 7f9a78852700 1 -- 172.21.15.33:0/3510777564 wait complete. 2022-02-02T14:45:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 Processor -- start 2022-02-02T14:45:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 -- start start 2022-02-02T14:45:07.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f55c0 0x7f9a7410c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:07.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:07.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740602b0 con 0x7f9a740f6860 2022-02-02T14:45:07.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a78852700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a740603f0 con 0x7f9a740f55c0 2022-02-02T14:45:07.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:07.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34372/0 (socket says 172.21.15.33:34372) 2022-02-02T14:45:07.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 -- 172.21.15.33:0/2388166382 learned_addr learned my addr 172.21.15.33:0/2388166382 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:07.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a7259c700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f55c0 0x7f9a7410c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:07.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 -- 172.21.15.33:0/2388166382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f55c0 msgr2=0x7f9a7410c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:07.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f55c0 0x7f9a7410c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.070+0000 7f9a71d9b700 1 -- 172.21.15.33:0/2388166382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a68005040 con 0x7f9a740f6860 2022-02-02T14:45:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a71d9b700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f9a64002700 tx=0x7f9a64009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a64009320 con 0x7f9a740f6860 2022-02-02T14:45:07.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9a6400f040 con 0x7f9a740f6860 2022-02-02T14:45:07.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a64014870 con 0x7f9a740f6860 2022-02-02T14:45:07.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7410ea50 con 0x7f9a740f6860 2022-02-02T14:45:07.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.071+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7410eed0 con 0x7f9a740f6860 2022-02-02T14:45:07.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.072+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a74045ad0 con 0x7f9a740f6860 2022-02-02T14:45:07.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.072+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9a64009480 con 0x7f9a740f6860 2022-02-02T14:45:07.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.073+0000 7f9a62ffd700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 0x7f9a5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:07.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.073+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9a64081d60 con 0x7f9a740f6860 2022-02-02T14:45:07.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.073+0000 7f9a7259c700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 0x7f9a5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:07.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.073+0000 7f9a7259c700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 0x7f9a5c067290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f9a68013690 tx=0x7f9a68009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:07.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.077+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9a6404fe10 con 0x7f9a740f6860 2022-02-02T14:45:07.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.289+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9a74060580 con 0x7f9a740f6860 2022-02-02T14:45:07.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.290+0000 7f9a62ffd700 1 -- 172.21.15.33:0/2388166382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f9a64053430 con 0x7f9a740f6860 2022-02-02T14:45:07.291 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:45:07.291 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:45:07.291 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:45:07.292 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:45:07.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:07.292 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:45:07.292 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:45:07.293 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:45:07.293 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:45:07.293 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:45:07.293 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:45:07.294 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:45:07.294 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:45:07.294 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:45:07.295 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:45:07.295 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:45:07.295 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:45:07.295 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:45:07.296 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:45:07.296 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:45:07.296 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:45:07.296 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:45:07.297 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:45:07.297 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:45:07.297 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:45:07.297 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:45:07.298 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:45:07.298 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:45:07.298 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:45:07.298 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:45:07.299 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:45:07.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:07.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:07.299 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:45:07.299 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:07.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:07.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:07.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:07.300 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:07.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.291+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 msgr2=0x7f9a5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:07.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.291+0000 7f9a78852700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 0x7f9a5c067290 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f9a68013690 tx=0x7f9a68009b30).stop 2022-02-02T14:45:07.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.291+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 msgr2=0x7f9a7410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:07.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.291+0000 7f9a78852700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f9a64002700 tx=0x7f9a64009e00).stop 2022-02-02T14:45:07.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 shutdown_connections 2022-02-02T14:45:07.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9a5c064dd0 0x7f9a5c067290 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a740f55c0 0x7f9a7410c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 --2- 172.21.15.33:0/2388166382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a740f6860 0x7f9a7410e560 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:07.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 >> 172.21.15.33:0/2388166382 conn(0x7f9a740f0d40 msgr2=0x7f9a740fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:07.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 shutdown_connections 2022-02-02T14:45:07.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:07.292+0000 7f9a78852700 1 -- 172.21.15.33:0/2388166382 wait complete. 2022-02-02T14:45:07.305 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:45:07.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:07 smithi033 ceph-mon[101165]: from='client.36116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:07.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3552624553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:45:07.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2388166382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:45:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:07 smithi037 ceph-mon[69017]: from='client.36116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3552624553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:45:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2388166382' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:45:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:08 smithi033 ceph-mon[101165]: from='client.36120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:08.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:08 smithi033 ceph-mon[101165]: pgmap v1992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:08 smithi037 ceph-mon[69017]: from='client.36120 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:08 smithi037 ceph-mon[69017]: pgmap v1992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:10.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:10 smithi033 ceph-mon[101165]: pgmap v1993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:10 smithi037 ceph-mon[69017]: pgmap v1993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:12.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:12 smithi033 ceph-mon[101165]: pgmap v1994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:12 smithi037 ceph-mon[69017]: pgmap v1994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:14.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:14 smithi033 ceph-mon[101165]: pgmap v1995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:14 smithi037 ceph-mon[69017]: pgmap v1995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:16 smithi033 ceph-mon[101165]: pgmap v1996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:16 smithi037 ceph-mon[69017]: pgmap v1996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:18.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:18 smithi033 ceph-mon[101165]: pgmap v1997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:18 smithi037 ceph-mon[69017]: pgmap v1997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:20 smithi037 ceph-mon[69017]: pgmap v1998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:20.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:20 smithi033 ceph-mon[101165]: pgmap v1998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:22 smithi037 ceph-mon[69017]: pgmap v1999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:22 smithi033 ceph-mon[101165]: pgmap v1999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:24 smithi037 ceph-mon[69017]: pgmap v2000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:24 smithi033 ceph-mon[101165]: pgmap v2000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:26 smithi037 ceph-mon[69017]: pgmap v2001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:26 smithi033 ceph-mon[101165]: pgmap v2001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:28 smithi037 ceph-mon[69017]: pgmap v2002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:28 smithi033 ceph-mon[101165]: pgmap v2002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:30 smithi037 ceph-mon[69017]: pgmap v2003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:30.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:30 smithi033 ceph-mon[101165]: pgmap v2003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:32 smithi037 ceph-mon[69017]: pgmap v2004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:32.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:32 smithi033 ceph-mon[101165]: pgmap v2004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:34 smithi037 ceph-mon[69017]: pgmap v2005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:34 smithi033 ceph-mon[101165]: pgmap v2005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:36 smithi037 ceph-mon[69017]: pgmap v2006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:36 smithi033 ceph-mon[101165]: pgmap v2006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:37.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 -- 172.21.15.33:0/3038049798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 msgr2=0x7f1b580f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 --2- 172.21.15.33:0/3038049798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b580f6b30 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f1b44004660 tx=0x7f1b44009b30).stop 2022-02-02T14:45:37.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 -- 172.21.15.33:0/3038049798 shutdown_connections 2022-02-02T14:45:37.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 --2- 172.21.15.33:0/3038049798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b580f6b30 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 --2- 172.21.15.33:0/3038049798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b580f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 -- 172.21.15.33:0/3038049798 >> 172.21.15.33:0/3038049798 conn(0x7f1b580f0b90 msgr2=0x7f1b580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:37.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 -- 172.21.15.33:0/3038049798 shutdown_connections 2022-02-02T14:45:37.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.408+0000 7f1b5d997700 1 -- 172.21.15.33:0/3038049798 wait complete. 2022-02-02T14:45:37.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 Processor -- start 2022-02-02T14:45:37.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 -- start start 2022-02-02T14:45:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b58106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58107830 con 0x7f1b580f66d0 2022-02-02T14:45:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b5d997700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58108040 con 0x7f1b580f5430 2022-02-02T14:45:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34382/0 (socket says 172.21.15.33:34382) 2022-02-02T14:45:37.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.409+0000 7f1b57fff700 1 -- 172.21.15.33:0/2519231017 learned_addr learned my addr 172.21.15.33:0/2519231017 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b5c995700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b58106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b57fff700 1 -- 172.21.15.33:0/2519231017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 msgr2=0x7f1b58106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b57fff700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b58106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b57fff700 1 -- 172.21.15.33:0/2519231017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b44005040 con 0x7f1b580f66d0 2022-02-02T14:45:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b5c995700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b58106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:45:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b57fff700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f1b44009990 tx=0x7f1b44009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b44018070 con 0x7f1b580f66d0 2022-02-02T14:45:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1b44007ba0 con 0x7f1b580f66d0 2022-02-02T14:45:37.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b58108260 con 0x7f1b580f66d0 2022-02-02T14:45:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4401c3c0 con 0x7f1b580f66d0 2022-02-02T14:45:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.410+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b581087c0 con 0x7f1b580f66d0 2022-02-02T14:45:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.411+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58059100 con 0x7f1b580f66d0 2022-02-02T14:45:37.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.412+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1b4401d420 con 0x7f1b580f66d0 2022-02-02T14:45:37.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.412+0000 7f1b557fa700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 0x7f1b480672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.412+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1b440837b0 con 0x7f1b580f66d0 2022-02-02T14:45:37.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.412+0000 7f1b5c995700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 0x7f1b480672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.413+0000 7f1b5c995700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 0x7f1b480672e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f1b4c009880 tx=0x7f1b4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:37.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.416+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1b44051800 con 0x7f1b580f66d0 2022-02-02T14:45:37.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.607+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b580fab10 con 0x7f1b48064e20 2022-02-02T14:45:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.609+0000 7f1b557fa700 1 -- 172.21.15.33:0/2519231017 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1b580fab10 con 0x7f1b48064e20 2022-02-02T14:45:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.610+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 msgr2=0x7f1b480672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.610+0000 7f1b5d997700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 0x7f1b480672e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f1b4c009880 tx=0x7f1b4c00b040).stop 2022-02-02T14:45:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.610+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 msgr2=0x7f1b58107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.610+0000 7f1b5d997700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f1b44009990 tx=0x7f1b44009b30).stop 2022-02-02T14:45:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 shutdown_connections 2022-02-02T14:45:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1b48064e20 0x7f1b480672e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b580f5430 0x7f1b58106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 --2- 172.21.15.33:0/2519231017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b580f66d0 0x7f1b58107230 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 >> 172.21.15.33:0/2519231017 conn(0x7f1b580f0b90 msgr2=0x7f1b5805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 shutdown_connections 2022-02-02T14:45:37.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.611+0000 7f1b5d997700 1 -- 172.21.15.33:0/2519231017 wait complete. 2022-02-02T14:45:37.620 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:45:37.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 -- 172.21.15.33:0/3173347900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f5460 msgr2=0x7f7af80f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 --2- 172.21.15.33:0/3173347900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f5460 0x7f7af80f5880 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f7ae8004660 tx=0x7f7ae8009b30).stop 2022-02-02T14:45:37.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 -- 172.21.15.33:0/3173347900 shutdown_connections 2022-02-02T14:45:37.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 --2- 172.21.15.33:0/3173347900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f6700 0x7f7af80f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 --2- 172.21.15.33:0/3173347900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f5460 0x7f7af80f5880 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 -- 172.21.15.33:0/3173347900 >> 172.21.15.33:0/3173347900 conn(0x7f7af80f0bc0 msgr2=0x7f7af80f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:37.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 -- 172.21.15.33:0/3173347900 shutdown_connections 2022-02-02T14:45:37.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.711+0000 7f7afd979700 1 -- 172.21.15.33:0/3173347900 wait complete. 2022-02-02T14:45:37.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 Processor -- start 2022-02-02T14:45:37.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 -- start start 2022-02-02T14:45:37.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f5460 0x7f7af8109b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af80603c0 con 0x7f7af80f6700 2022-02-02T14:45:37.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7afd979700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8060500 con 0x7f7af80f5460 2022-02-02T14:45:37.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.712+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34392/0 (socket says 172.21.15.33:34392) 2022-02-02T14:45:37.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 -- 172.21.15.33:0/273148820 learned_addr learned my addr 172.21.15.33:0/273148820 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:37.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af6ffd700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f5460 0x7f7af8109b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 -- 172.21.15.33:0/273148820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f5460 msgr2=0x7f7af8109b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f5460 0x7f7af8109b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 -- 172.21.15.33:0/273148820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae8005040 con 0x7f7af80f6700 2022-02-02T14:45:37.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7af67fc700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f7aec00c530 tx=0x7f7aec007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:37.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aec00f650 con 0x7f7af80f6700 2022-02-02T14:45:37.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af810c5d0 con 0x7f7af80f6700 2022-02-02T14:45:37.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7aec00fc60 con 0x7f7af80f6700 2022-02-02T14:45:37.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af810cb60 con 0x7f7af80f6700 2022-02-02T14:45:37.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.713+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aec012c20 con 0x7f7af80f6700 2022-02-02T14:45:37.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.714+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad8004fa0 con 0x7f7af80f6700 2022-02-02T14:45:37.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.715+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7aec010070 con 0x7f7af80f6700 2022-02-02T14:45:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.716+0000 7f7adf7fe700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 0x7f7ae00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.716+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7aec0815d0 con 0x7f7af80f6700 2022-02-02T14:45:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.716+0000 7f7af6ffd700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 0x7f7ae00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:37.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.716+0000 7f7af6ffd700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 0x7f7ae00672e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f7ae8013690 tx=0x7f7ae8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:37.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.720+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7aec0477d0 con 0x7f7af80f6700 2022-02-02T14:45:37.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.901+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ad8000bc0 con 0x7f7ae0064e20 2022-02-02T14:45:37.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.915+0000 7f7adf7fe700 1 -- 172.21.15.33:0/273148820 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7ad8000bc0 con 0x7f7ae0064e20 2022-02-02T14:45:37.915 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:45:37.916 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (70m) 33m ago 71m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:45:37.916 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (63m) 33m ago 71m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:45:37.916 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (63m) 33m ago 71m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:45:37.916 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (70m) 33m ago 71m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:45:37.917 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (64m) 33m ago 68m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:45:37.917 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (65m) 33m ago 68m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:45:37.917 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (65m) 33m ago 68m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:45:37.917 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (68m) 33m ago 68m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:45:37.918 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (65m) 33m ago 73m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:45:37.918 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (65m) 33m ago 71m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:45:37.918 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (64m) 33m ago 73m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:45:37.918 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (64m) 33m ago 71m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:45:37.918 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (71m) 33m ago 71m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:45:37.919 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (71m) 33m ago 71m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:45:37.919 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 33m ago 70m - 4096M 2022-02-02T14:45:37.919 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (70m) 33m ago 70m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:45:37.919 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (70m) 33m ago 70m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:45:37.920 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (69m) 33m ago 69m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:45:37.920 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (69m) 33m ago 69m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:45:37.920 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (69m) 33m ago 69m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:45:37.920 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (70m) 33m ago 71m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:45:37.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 msgr2=0x7f7ae00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 0x7f7ae00672e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f7ae8013690 tx=0x7f7ae8009b30).stop 2022-02-02T14:45:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 msgr2=0x7f7af810c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f7aec00c530 tx=0x7f7aec007e20).stop 2022-02-02T14:45:37.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 shutdown_connections 2022-02-02T14:45:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7ae0064e20 0x7f7ae00672e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7af80f5460 0x7f7af8109b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 --2- 172.21.15.33:0/273148820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7af80f6700 0x7f7af810c020 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:37.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.917+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 >> 172.21.15.33:0/273148820 conn(0x7f7af80f0bc0 msgr2=0x7f7af80fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:37.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.918+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 shutdown_connections 2022-02-02T14:45:37.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:37.918+0000 7f7afd979700 1 -- 172.21.15.33:0/273148820 wait complete. 2022-02-02T14:45:38.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 -- 172.21.15.33:0/3537666278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f6860 msgr2=0x7fd2080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/3537666278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f6860 0x7fd2080f6cc0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fd1f0004660 tx=0x7fd1f0009b30).stop 2022-02-02T14:45:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 -- 172.21.15.33:0/3537666278 shutdown_connections 2022-02-02T14:45:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/3537666278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f6860 0x7fd2080f6cc0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/3537666278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f55c0 0x7fd2080f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.018+0000 7fd20e0fa700 1 -- 172.21.15.33:0/3537666278 >> 172.21.15.33:0/3537666278 conn(0x7fd2080f0d40 msgr2=0x7fd2080f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:38.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.019+0000 7fd20e0fa700 1 -- 172.21.15.33:0/3537666278 shutdown_connections 2022-02-02T14:45:38.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.019+0000 7fd20e0fa700 1 -- 172.21.15.33:0/3537666278 wait complete. 2022-02-02T14:45:38.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.019+0000 7fd20e0fa700 1 Processor -- start 2022-02-02T14:45:38.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.019+0000 7fd20e0fa700 1 -- start start 2022-02-02T14:45:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd20e0fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd20e0fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f6860 0x7fd2081063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd20e0fa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081069b0 con 0x7fd2080f55c0 2022-02-02T14:45:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd20e0fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081071c0 con 0x7fd2080f6860 2022-02-02T14:45:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34400/0 (socket says 172.21.15.33:34400) 2022-02-02T14:45:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 -- 172.21.15.33:0/1014931182 learned_addr learned my addr 172.21.15.33:0/1014931182 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:38.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd1fffff700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f6860 0x7fd2081063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 -- 172.21.15.33:0/1014931182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f6860 msgr2=0x7fd2081063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f6860 0x7fd2081063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 -- 172.21.15.33:0/1014931182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f0005040 con 0x7fd2080f55c0 2022-02-02T14:45:38.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd2077fe700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fd1f800e9a0 tx=0x7fd1f8007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:38.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f800c9b0 con 0x7fd2080f55c0 2022-02-02T14:45:38.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd1f8011470 con 0x7fd2080f55c0 2022-02-02T14:45:38.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081073e0 con 0x7fd2080f55c0 2022-02-02T14:45:38.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.020+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f8010630 con 0x7fd2080f55c0 2022-02-02T14:45:38.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.021+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd208107970 con 0x7fd2080f55c0 2022-02-02T14:45:38.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.021+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208045ad0 con 0x7fd2080f55c0 2022-02-02T14:45:38.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.022+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd1f8017030 con 0x7fd2080f55c0 2022-02-02T14:45:38.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.022+0000 7fd204ff9700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 0x7fd1f4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.022+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd1f8083ff0 con 0x7fd2080f55c0 2022-02-02T14:45:38.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.022+0000 7fd1fffff700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 0x7fd1f4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.023+0000 7fd1fffff700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 0x7fd1f4067270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fd1f0004e30 tx=0x7fd1f0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:38.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.027+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd1f80520a0 con 0x7fd2080f55c0 2022-02-02T14:45:38.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.271+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd2080ff790 con 0x7fd2080f55c0 2022-02-02T14:45:38.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.272+0000 7fd204ff9700 1 -- 172.21.15.33:0/1014931182 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fd1f80152d0 con 0x7fd2080f55c0 2022-02-02T14:45:38.271 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:45:38.272 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:45:38.272 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:45:38.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:38.272 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:45:38.273 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:45:38.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:38.273 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:45:38.273 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:45:38.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:38.274 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:45:38.274 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:45:38.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:45:38.274 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:45:38.275 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:45:38.275 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:45:38.275 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:45:38.275 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:45:38.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.274+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 msgr2=0x7fd1f4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.274+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 0x7fd1f4067270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fd1f0004e30 tx=0x7fd1f0009b30).stop 2022-02-02T14:45:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.274+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 msgr2=0x7fd208105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.274+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fd1f800e9a0 tx=0x7fd1f8007ea0).stop 2022-02-02T14:45:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 shutdown_connections 2022-02-02T14:45:38.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd1f4064db0 0x7fd1f4067270 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2080f55c0 0x7fd208105ec0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 --2- 172.21.15.33:0/1014931182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2080f6860 0x7fd2081063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 >> 172.21.15.33:0/1014931182 conn(0x7fd2080f0d40 msgr2=0x7fd2080fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:38.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 shutdown_connections 2022-02-02T14:45:38.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.275+0000 7fd20e0fa700 1 -- 172.21.15.33:0/1014931182 wait complete. 2022-02-02T14:45:38.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 -- 172.21.15.33:0/1418035521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f66e0 msgr2=0x7f99c00f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 --2- 172.21.15.33:0/1418035521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f66e0 0x7f99c00f6b00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7f99b0004660 tx=0x7f99b0009b30).stop 2022-02-02T14:45:38.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 -- 172.21.15.33:0/1418035521 shutdown_connections 2022-02-02T14:45:38.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 --2- 172.21.15.33:0/1418035521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f7980 0x7f99c00f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 --2- 172.21.15.33:0/1418035521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f66e0 0x7f99c00f6b00 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.376+0000 7f99c5f84700 1 -- 172.21.15.33:0/1418035521 >> 172.21.15.33:0/1418035521 conn(0x7f99c00f1e40 msgr2=0x7f99c00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:38.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 -- 172.21.15.33:0/1418035521 shutdown_connections 2022-02-02T14:45:38.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 -- 172.21.15.33:0/1418035521 wait complete. 2022-02-02T14:45:38.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 Processor -- start 2022-02-02T14:45:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 -- start start 2022-02-02T14:45:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f66e0 0x7f99c0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0107a00 con 0x7f99c00f7980 2022-02-02T14:45:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.377+0000 7f99c5f84700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99c0107b40 con 0x7f99c00f66e0 2022-02-02T14:45:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34412/0 (socket says 172.21.15.33:34412) 2022-02-02T14:45:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 -- 172.21.15.33:0/2471178793 learned_addr learned my addr 172.21.15.33:0/2471178793 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:45:38.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99bf7fe700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f66e0 0x7f99c0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 -- 172.21.15.33:0/2471178793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f66e0 msgr2=0x7f99c0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f66e0 0x7f99c0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 -- 172.21.15.33:0/2471178793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0005040 con 0x7f99c00f7980 2022-02-02T14:45:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99beffd700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f99b400e7f0 tx=0x7f99b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b40092e0 con 0x7f99c00f7980 2022-02-02T14:45:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c01084e0 con 0x7f99c00f7980 2022-02-02T14:45:38.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f99b400f040 con 0x7f99c00f7980 2022-02-02T14:45:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99b4014750 con 0x7f99c00f7980 2022-02-02T14:45:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.378+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c0108aa0 con 0x7f99c00f7980 2022-02-02T14:45:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.379+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99c0045ad0 con 0x7f99c00f7980 2022-02-02T14:45:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.380+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f99b401b030 con 0x7f99c00f7980 2022-02-02T14:45:38.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.380+0000 7f99a7fff700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 0x7f99a8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:45:38.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.380+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f99b4081880 con 0x7f99c00f7980 2022-02-02T14:45:38.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.381+0000 7f99bf7fe700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 0x7f99a8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:45:38.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.381+0000 7f99bf7fe700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 0x7f99a8067290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f99b0004d80 tx=0x7f99b0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:45:38.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.385+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f99b4053410 con 0x7f99c00f7980 2022-02-02T14:45:38.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.600+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f99c0027a00 con 0x7f99c00f7980 2022-02-02T14:45:38.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:38 smithi033 ceph-mon[101165]: pgmap v2007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:38.600 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1014931182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:45:38.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.600+0000 7f99a7fff700 1 -- 172.21.15.33:0/2471178793 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f99b4053000 con 0x7f99c00f7980 2022-02-02T14:45:38.601 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:45:38.601 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:45:38.602 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:45:38.602 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:45:38.602 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:38.602 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:45:38.603 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:45:38.603 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:45:38.603 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:45:38.603 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:45:38.603 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:45:38.604 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:45:38.604 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:45:38.604 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:45:38.604 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:45:38.605 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:45:38.605 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:45:38.605 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:45:38.605 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:45:38.606 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:45:38.606 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:45:38.606 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:45:38.606 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:45:38.607 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:45:38.607 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:45:38.607 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:45:38.607 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:45:38.607 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:45:38.608 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:45:38.608 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:45:38.608 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:45:38.608 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:38.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:38.609 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:45:38.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:45:38.609 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:38.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:38.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:38.610 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:45:38.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 msgr2=0x7f99a8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 0x7f99a8067290 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f99b0004d80 tx=0x7f99b0016040).stop 2022-02-02T14:45:38.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 msgr2=0x7f99c0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:45:38.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7f99b400e7f0 tx=0x7f99b400b040).stop 2022-02-02T14:45:38.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 shutdown_connections 2022-02-02T14:45:38.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f99a8064dd0 0x7f99a8067290 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c00f66e0 0x7f99c0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 --2- 172.21.15.33:0/2471178793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99c00f7980 0x7f99c0107450 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:45:38.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.603+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 >> 172.21.15.33:0/2471178793 conn(0x7f99c00f1e40 msgr2=0x7f99c00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:45:38.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.604+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 shutdown_connections 2022-02-02T14:45:38.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:45:38.604+0000 7f99c5f84700 1 -- 172.21.15.33:0/2471178793 wait complete. 2022-02-02T14:45:38.614 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:45:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:38 smithi037 ceph-mon[69017]: pgmap v2007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1014931182' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:45:39.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:39 smithi037 ceph-mon[69017]: from='client.36132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:39.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:39 smithi037 ceph-mon[69017]: from='client.36136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:39.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:39 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2471178793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:45:39.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:39 smithi033 ceph-mon[101165]: from='client.36132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:39.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:39 smithi033 ceph-mon[101165]: from='client.36136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:45:39.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:39 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2471178793' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:45:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:40 smithi037 ceph-mon[69017]: pgmap v2008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:40 smithi033 ceph-mon[101165]: pgmap v2008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:42 smithi037 ceph-mon[69017]: pgmap v2009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:42.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:42 smithi033 ceph-mon[101165]: pgmap v2009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:44 smithi037 ceph-mon[69017]: pgmap v2010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:44 smithi033 ceph-mon[101165]: pgmap v2010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:46 smithi037 ceph-mon[69017]: pgmap v2011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:46 smithi033 ceph-mon[101165]: pgmap v2011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:48 smithi037 ceph-mon[69017]: pgmap v2012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:48.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:48 smithi033 ceph-mon[101165]: pgmap v2012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:50 smithi037 ceph-mon[69017]: pgmap v2013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:50 smithi033 ceph-mon[101165]: pgmap v2013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:52.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:52 smithi033 ceph-mon[101165]: pgmap v2014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:52 smithi037 ceph-mon[69017]: pgmap v2014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:54 smithi033 ceph-mon[101165]: pgmap v2015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:45:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:45:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:54 smithi037 ceph-mon[69017]: pgmap v2015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:45:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:45:55.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:55 smithi033 ceph-mon[101165]: pgmap v2016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:56.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:55 smithi037 ceph-mon[69017]: pgmap v2016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:58.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:45:58 smithi033 ceph-mon[101165]: pgmap v2017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:45:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:45:58 smithi037 ceph-mon[69017]: pgmap v2017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:00.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:00 smithi033 ceph-mon[101165]: pgmap v2018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:00 smithi037 ceph-mon[69017]: pgmap v2018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:02.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:02 smithi033 ceph-mon[101165]: pgmap v2019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:02 smithi037 ceph-mon[69017]: pgmap v2019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:04 smithi033 ceph-mon[101165]: pgmap v2020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:04 smithi037 ceph-mon[69017]: pgmap v2020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:06 smithi033 ceph-mon[101165]: pgmap v2021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:06 smithi037 ceph-mon[69017]: pgmap v2021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:08.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 -- 172.21.15.33:0/1421953958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f66d0 msgr2=0x7f4df40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:08.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 --2- 172.21.15.33:0/1421953958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f66d0 0x7f4df40f6b30 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7f4de8004660 tx=0x7f4de8009b30).stop 2022-02-02T14:46:08.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 -- 172.21.15.33:0/1421953958 shutdown_connections 2022-02-02T14:46:08.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 --2- 172.21.15.33:0/1421953958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f66d0 0x7f4df40f6b30 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 --2- 172.21.15.33:0/1421953958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f5430 0x7f4df40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 -- 172.21.15.33:0/1421953958 >> 172.21.15.33:0/1421953958 conn(0x7f4df40f0b90 msgr2=0x7f4df40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:08.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 -- 172.21.15.33:0/1421953958 shutdown_connections 2022-02-02T14:46:08.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.719+0000 7f4df359e700 1 -- 172.21.15.33:0/1421953958 wait complete. 2022-02-02T14:46:08.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 Processor -- start 2022-02-02T14:46:08.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 -- start start 2022-02-02T14:46:08.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f66d0 0x7f4df41061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4106760 con 0x7f4df40f5430 2022-02-02T14:46:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4106f60 con 0x7f4df40f66d0 2022-02-02T14:46:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:08.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34420/0 (socket says 172.21.15.33:34420) 2022-02-02T14:46:08.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 -- 172.21.15.33:0/2677939840 learned_addr learned my addr 172.21.15.33:0/2677939840 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:08.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df1d9b700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f66d0 0x7f4df41061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:08.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 -- 172.21.15.33:0/2677939840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f66d0 msgr2=0x7f4df41061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:08.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f66d0 0x7f4df41061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.720+0000 7f4df259c700 1 -- 172.21.15.33:0/2677939840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de8005040 con 0x7f4df40f5430 2022-02-02T14:46:08.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4df259c700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f4de4002700 tx=0x7f4de4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:08.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de4009320 con 0x7f4df40f5430 2022-02-02T14:46:08.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4de400f040 con 0x7f4df40f5430 2022-02-02T14:46:08.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df41071e0 con 0x7f4df40f5430 2022-02-02T14:46:08.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4de4014900 con 0x7f4df40f5430 2022-02-02T14:46:08.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.721+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df4107750 con 0x7f4df40f5430 2022-02-02T14:46:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.722+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df4045ad0 con 0x7f4df40f5430 2022-02-02T14:46:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.723+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4de4009480 con 0x7f4df40f5430 2022-02-02T14:46:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.723+0000 7f4de2ffd700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 0x7f4ddc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.723+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4de4081d10 con 0x7f4df40f5430 2022-02-02T14:46:08.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.723+0000 7f4df1d9b700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 0x7f4ddc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:08.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.724+0000 7f4df1d9b700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 0x7f4ddc0672e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f4de8004630 tx=0x7f4de8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:08.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.728+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4de40538b0 con 0x7f4df40f5430 2022-02-02T14:46:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:08 smithi037 ceph-mon[69017]: pgmap v2022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:08.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.915+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4df40ff710 con 0x7f4ddc064e20 2022-02-02T14:46:08.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:08 smithi033 ceph-mon[101165]: pgmap v2022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:08.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.917+0000 7f4de2ffd700 1 -- 172.21.15.33:0/2677939840 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4df40ff710 con 0x7f4ddc064e20 2022-02-02T14:46:08.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.918+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 msgr2=0x7f4ddc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:08.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.918+0000 7f4df359e700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 0x7f4ddc0672e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7f4de8004630 tx=0x7f4de8009b30).stop 2022-02-02T14:46:08.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.918+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 msgr2=0x7f4df4105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:08.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.918+0000 7f4df359e700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f4de4002700 tx=0x7f4de4009d80).stop 2022-02-02T14:46:08.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 shutdown_connections 2022-02-02T14:46:08.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ddc064e20 0x7f4ddc0672e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df40f5430 0x7f4df4105cc0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 --2- 172.21.15.33:0/2677939840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4df40f66d0 0x7f4df41061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:08.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 >> 172.21.15.33:0/2677939840 conn(0x7f4df40f0b90 msgr2=0x7f4df40fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:08.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 shutdown_connections 2022-02-02T14:46:08.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:08.919+0000 7f4df359e700 1 -- 172.21.15.33:0/2677939840 wait complete. 2022-02-02T14:46:08.929 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:46:09.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- 172.21.15.33:0/3723533360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f55c0 msgr2=0x7f1a100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 --2- 172.21.15.33:0/3723533360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f55c0 0x7f1a100f59e0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f1a00004660 tx=0x7f1a00009b30).stop 2022-02-02T14:46:09.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- 172.21.15.33:0/3723533360 shutdown_connections 2022-02-02T14:46:09.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 --2- 172.21.15.33:0/3723533360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f6860 0x7f1a100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 --2- 172.21.15.33:0/3723533360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f55c0 0x7f1a100f59e0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- 172.21.15.33:0/3723533360 >> 172.21.15.33:0/3723533360 conn(0x7f1a100f0d40 msgr2=0x7f1a100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- 172.21.15.33:0/3723533360 shutdown_connections 2022-02-02T14:46:09.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- 172.21.15.33:0/3723533360 wait complete. 2022-02-02T14:46:09.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 Processor -- start 2022-02-02T14:46:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.020+0000 7f1a14b45700 1 -- start start 2022-02-02T14:46:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a14b45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f55c0 0x7f1a10106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a14b45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a14b45700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10107a10 con 0x7f1a100f6860 2022-02-02T14:46:09.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a14b45700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10107b50 con 0x7f1a100f55c0 2022-02-02T14:46:09.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34432/0 (socket says 172.21.15.33:34432) 2022-02-02T14:46:09.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 -- 172.21.15.33:0/1189112580 learned_addr learned my addr 172.21.15.33:0/1189112580 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:09.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0e59c700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f55c0 0x7f1a10106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 -- 172.21.15.33:0/1189112580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f55c0 msgr2=0x7f1a10106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f55c0 0x7f1a10106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 -- 172.21.15.33:0/1189112580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00005040 con 0x7f1a100f6860 2022-02-02T14:46:09.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a0dd9b700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f19f800c530 tx=0x7f19f8007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.021+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f800f650 con 0x7f1a100f6860 2022-02-02T14:46:09.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.022+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f19f800fc60 con 0x7f1a100f6860 2022-02-02T14:46:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.022+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a101084f0 con 0x7f1a100f6860 2022-02-02T14:46:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.022+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a10108ab0 con 0x7f1a100f6860 2022-02-02T14:46:09.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.022+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19f8012ce0 con 0x7f1a100f6860 2022-02-02T14:46:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.023+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f4004fa0 con 0x7f1a100f6860 2022-02-02T14:46:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.023+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f19f8010070 con 0x7f1a100f6860 2022-02-02T14:46:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.024+0000 7f1a06ffd700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 0x7f19fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.024+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f19f8081750 con 0x7f1a100f6860 2022-02-02T14:46:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.024+0000 7f1a0e59c700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 0x7f19fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.024+0000 7f1a0e59c700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 0x7f19fc067290 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f1a00004e30 tx=0x7f1a00009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.028+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f19f8053230 con 0x7f1a100f6860 2022-02-02T14:46:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.213+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f19f4000bc0 con 0x7f19fc064dd0 2022-02-02T14:46:09.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.227+0000 7f1a06ffd700 1 -- 172.21.15.33:0/1189112580 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f19f4000bc0 con 0x7f19fc064dd0 2022-02-02T14:46:09.228 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:46:09.228 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (71m) 33m ago 72m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:46:09.229 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (64m) 33m ago 72m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:46:09.229 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (64m) 33m ago 71m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:46:09.229 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (71m) 33m ago 72m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:46:09.229 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (64m) 33m ago 68m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:46:09.230 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (65m) 33m ago 68m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:46:09.230 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (66m) 33m ago 68m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:46:09.230 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (68m) 33m ago 68m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:46:09.230 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (66m) 33m ago 73m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:46:09.231 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (65m) 33m ago 71m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:46:09.231 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (65m) 33m ago 73m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:46:09.231 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (65m) 33m ago 71m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:46:09.231 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (72m) 33m ago 72m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:46:09.231 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (71m) 33m ago 71m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:46:09.232 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 33m ago 71m - 4096M 2022-02-02T14:46:09.232 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (70m) 33m ago 70m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:46:09.232 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (70m) 33m ago 70m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:46:09.233 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (70m) 33m ago 70m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:46:09.233 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (70m) 33m ago 70m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:46:09.233 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (69m) 33m ago 69m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:46:09.233 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (71m) 33m ago 72m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:46:09.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 msgr2=0x7f19fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 0x7f19fc067290 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f1a00004e30 tx=0x7f1a00009b30).stop 2022-02-02T14:46:09.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 msgr2=0x7f1a10107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f19f800c530 tx=0x7f19f8007e20).stop 2022-02-02T14:46:09.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 shutdown_connections 2022-02-02T14:46:09.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f19fc064dd0 0x7f19fc067290 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a100f55c0 0x7f1a10106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 --2- 172.21.15.33:0/1189112580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a100f6860 0x7f1a10107460 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 >> 172.21.15.33:0/1189112580 conn(0x7f1a100f0d40 msgr2=0x7f1a1005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 shutdown_connections 2022-02-02T14:46:09.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.229+0000 7f1a14b45700 1 -- 172.21.15.33:0/1189112580 wait complete. 2022-02-02T14:46:09.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 -- 172.21.15.33:0/2897610369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f55c0 msgr2=0x7fafa40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 --2- 172.21.15.33:0/2897610369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f55c0 0x7fafa40f59e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7faf98004660 tx=0x7faf98009b30).stop 2022-02-02T14:46:09.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 -- 172.21.15.33:0/2897610369 shutdown_connections 2022-02-02T14:46:09.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 --2- 172.21.15.33:0/2897610369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f6860 0x7fafa40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 --2- 172.21.15.33:0/2897610369 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f55c0 0x7fafa40f59e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 -- 172.21.15.33:0/2897610369 >> 172.21.15.33:0/2897610369 conn(0x7fafa40f0d40 msgr2=0x7fafa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 -- 172.21.15.33:0/2897610369 shutdown_connections 2022-02-02T14:46:09.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.330+0000 7fafaad20700 1 -- 172.21.15.33:0/2897610369 wait complete. 2022-02-02T14:46:09.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 Processor -- start 2022-02-02T14:46:09.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 -- start start 2022-02-02T14:46:09.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f55c0 0x7fafa4109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4060420 con 0x7fafa40f6860 2022-02-02T14:46:09.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafaad20700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4060560 con 0x7fafa40f55c0 2022-02-02T14:46:09.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34442/0 (socket says 172.21.15.33:34442) 2022-02-02T14:46:09.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafa3fff700 1 -- 172.21.15.33:0/4285903660 learned_addr learned my addr 172.21.15.33:0/4285903660 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:09.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.331+0000 7fafa8abc700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f55c0 0x7fafa4109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa3fff700 1 -- 172.21.15.33:0/4285903660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f55c0 msgr2=0x7fafa4109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa3fff700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f55c0 0x7fafa4109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa3fff700 1 -- 172.21.15.33:0/4285903660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98005040 con 0x7fafa40f6860 2022-02-02T14:46:09.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa3fff700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7faf900026d0 tx=0x7faf90009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf900079c0 con 0x7fafa40f6860 2022-02-02T14:46:09.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf9000f040 con 0x7fafa40f6860 2022-02-02T14:46:09.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa410c740 con 0x7fafa40f6860 2022-02-02T14:46:09.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf900148b0 con 0x7fafa40f6860 2022-02-02T14:46:09.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.332+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa410ccd0 con 0x7fafa40f6860 2022-02-02T14:46:09.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.333+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4045ad0 con 0x7fafa40f6860 2022-02-02T14:46:09.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.334+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf90007b20 con 0x7fafa40f6860 2022-02-02T14:46:09.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.334+0000 7fafa17fa700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 0x7faf94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.334+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faf900819e0 con 0x7fafa40f6860 2022-02-02T14:46:09.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.334+0000 7fafa8abc700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 0x7faf94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.335+0000 7fafa8abc700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 0x7faf94067290 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7faf98013690 tx=0x7faf98009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.338+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf9004fa90 con 0x7fafa40f6860 2022-02-02T14:46:09.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.592+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafa4027a00 con 0x7fafa40f6860 2022-02-02T14:46:09.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.592+0000 7fafa17fa700 1 -- 172.21.15.33:0/4285903660 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7faf900530b0 con 0x7fafa40f6860 2022-02-02T14:46:09.593 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:46:09.593 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:46:09.593 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:46:09.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:09.594 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:46:09.594 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:46:09.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:09.595 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:46:09.595 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:46:09.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:09.595 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:46:09.595 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:46:09.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:09.596 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:46:09.596 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:46:09.596 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:46:09.596 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:46:09.597 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:46:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 msgr2=0x7faf94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 0x7faf94067290 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7faf98013690 tx=0x7faf98009b30).stop 2022-02-02T14:46:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 msgr2=0x7fafa410c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7faf900026d0 tx=0x7faf90009de0).stop 2022-02-02T14:46:09.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 shutdown_connections 2022-02-02T14:46:09.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faf94064dd0 0x7faf94067290 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafa40f55c0 0x7fafa4109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 --2- 172.21.15.33:0/4285903660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafa40f6860 0x7fafa410c130 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 >> 172.21.15.33:0/4285903660 conn(0x7fafa40f0d40 msgr2=0x7fafa40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 shutdown_connections 2022-02-02T14:46:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.595+0000 7fafaad20700 1 -- 172.21.15.33:0/4285903660 wait complete. 2022-02-02T14:46:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.695+0000 7f87758a7700 1 -- 172.21.15.33:0/708940108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8770060310 msgr2=0x7f87700f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 --2- 172.21.15.33:0/708940108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8770060310 0x7f87700f9120 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f8764004660 tx=0x7f8764009b30).stop 2022-02-02T14:46:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 -- 172.21.15.33:0/708940108 shutdown_connections 2022-02-02T14:46:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 --2- 172.21.15.33:0/708940108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87700f96a0 0x7f87700fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 --2- 172.21.15.33:0/708940108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8770060310 0x7f87700f9120 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 -- 172.21.15.33:0/708940108 >> 172.21.15.33:0/708940108 conn(0x7f87700f0ba0 msgr2=0x7f87700f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 -- 172.21.15.33:0/708940108 shutdown_connections 2022-02-02T14:46:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 -- 172.21.15.33:0/708940108 wait complete. 2022-02-02T14:46:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 Processor -- start 2022-02-02T14:46:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.696+0000 7f87758a7700 1 -- start start 2022-02-02T14:46:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87758a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 0x7f87700f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87758a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87758a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700f5580 con 0x7f87700f96a0 2022-02-02T14:46:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87758a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87700f56c0 con 0x7f8770060310 2022-02-02T14:46:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34452/0 (socket says 172.21.15.33:34452) 2022-02-02T14:46:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 -- 172.21.15.33:0/405208093 learned_addr learned my addr 172.21.15.33:0/405208093 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:09.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87748a5700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 0x7f87700f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 -- 172.21.15.33:0/405208093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 msgr2=0x7f87700f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 0x7f87700f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 -- 172.21.15.33:0/405208093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764005040 con 0x7f87700f96a0 2022-02-02T14:46:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f87748a5700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 0x7f87700f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:46:09.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876ffff700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f875c0026d0 tx=0x7f875c009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.697+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875c0079c0 con 0x7f87700f96a0 2022-02-02T14:46:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.698+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f875c00f040 con 0x7f87700f96a0 2022-02-02T14:46:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.698+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87700f59a0 con 0x7f87700f96a0 2022-02-02T14:46:09.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.698+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f875c014840 con 0x7f87700f96a0 2022-02-02T14:46:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.698+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877010ed80 con 0x7f87700f96a0 2022-02-02T14:46:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.699+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8770045ad0 con 0x7f87700f96a0 2022-02-02T14:46:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.699+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f875c01b060 con 0x7f87700f96a0 2022-02-02T14:46:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.699+0000 7f876d7fa700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 0x7f87600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:09.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.699+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f875c081a00 con 0x7f87700f96a0 2022-02-02T14:46:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.700+0000 7f87748a5700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 0x7f87600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.700+0000 7f87748a5700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 0x7f87600672e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8764005010 tx=0x7f8764009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:09.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.704+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f875c04fab0 con 0x7f87700f96a0 2022-02-02T14:46:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.919+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8770027a00 con 0x7f87700f96a0 2022-02-02T14:46:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.919+0000 7f876d7fa700 1 -- 172.21.15.33:0/405208093 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f875c019070 con 0x7f87700f96a0 2022-02-02T14:46:09.920 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:46:09.920 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:46:09.920 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:46:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:46:09.921 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:46:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:46:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:46:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:46:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:46:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:46:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:46:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:46:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:46:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:46:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:46:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:46:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:46:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:46:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:46:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:46:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:46:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:46:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:46:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:46:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:46:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:46:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:46:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:46:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:46:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:46:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:09.927 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:46:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:09.927 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:09.928 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:09.928 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:09.928 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:09.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 msgr2=0x7f87600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 0x7f87600672e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8764005010 tx=0x7f8764009b30).stop 2022-02-02T14:46:09.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 msgr2=0x7f87700f5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:09.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f875c0026d0 tx=0x7f875c009dc0).stop 2022-02-02T14:46:09.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 shutdown_connections 2022-02-02T14:46:09.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8760064e20 0x7f87600672e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8770060310 0x7f87700f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 --2- 172.21.15.33:0/405208093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87700f96a0 0x7f87700f5020 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:09.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 >> 172.21.15.33:0/405208093 conn(0x7f87700f0ba0 msgr2=0x7f87700f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:09.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 shutdown_connections 2022-02-02T14:46:09.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:09.921+0000 7f87758a7700 1 -- 172.21.15.33:0/405208093 wait complete. 2022-02-02T14:46:09.932 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:46:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:10 smithi037 ceph-mon[69017]: from='client.36148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:10 smithi037 ceph-mon[69017]: from='client.36152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:10 smithi037 ceph-mon[69017]: pgmap v2023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4285903660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:46:10.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/405208093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:46:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:10 smithi033 ceph-mon[101165]: from='client.36148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:10 smithi033 ceph-mon[101165]: from='client.36152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:10 smithi033 ceph-mon[101165]: pgmap v2023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4285903660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:46:10.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/405208093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:46:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:12 smithi037 ceph-mon[69017]: pgmap v2024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:12.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:12 smithi033 ceph-mon[101165]: pgmap v2024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:14 smithi037 ceph-mon[69017]: pgmap v2025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:14 smithi033 ceph-mon[101165]: pgmap v2025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:16 smithi037 ceph-mon[69017]: pgmap v2026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:16.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:16 smithi033 ceph-mon[101165]: pgmap v2026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:18 smithi037 ceph-mon[69017]: pgmap v2027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:18 smithi033 ceph-mon[101165]: pgmap v2027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:20 smithi037 ceph-mon[69017]: pgmap v2028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:20 smithi033 ceph-mon[101165]: pgmap v2028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:22 smithi037 ceph-mon[69017]: pgmap v2029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:22 smithi033 ceph-mon[101165]: pgmap v2029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:24 smithi037 ceph-mon[69017]: pgmap v2030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:24 smithi033 ceph-mon[101165]: pgmap v2030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:26 smithi037 ceph-mon[69017]: pgmap v2031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:26 smithi033 ceph-mon[101165]: pgmap v2031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:28 smithi037 ceph-mon[69017]: pgmap v2032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:28 smithi033 ceph-mon[101165]: pgmap v2032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:30 smithi037 ceph-mon[69017]: pgmap v2033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:30.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:30 smithi033 ceph-mon[101165]: pgmap v2033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:32.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:32 smithi037 ceph-mon[69017]: pgmap v2034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:32 smithi033 ceph-mon[101165]: pgmap v2034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:34.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:34 smithi037 ceph-mon[69017]: pgmap v2035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:34 smithi033 ceph-mon[101165]: pgmap v2035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:36 smithi037 ceph-mon[69017]: pgmap v2036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:36 smithi033 ceph-mon[101165]: pgmap v2036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:38 smithi037 ceph-mon[69017]: pgmap v2037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:38.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:38 smithi033 ceph-mon[101165]: pgmap v2037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 -- 172.21.15.33:0/50320063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f55c0 msgr2=0x7f30100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 --2- 172.21.15.33:0/50320063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f55c0 0x7f30100f59e0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 rx=0x7f3000004660 tx=0x7f3000009b30).stop 2022-02-02T14:46:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 -- 172.21.15.33:0/50320063 shutdown_connections 2022-02-02T14:46:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 --2- 172.21.15.33:0/50320063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f6860 0x7f30100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 --2- 172.21.15.33:0/50320063 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f55c0 0x7f30100f59e0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 -- 172.21.15.33:0/50320063 >> 172.21.15.33:0/50320063 conn(0x7f30100f0d40 msgr2=0x7f30100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 -- 172.21.15.33:0/50320063 shutdown_connections 2022-02-02T14:46:40.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.038+0000 7f3018542700 1 -- 172.21.15.33:0/50320063 wait complete. 2022-02-02T14:46:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 Processor -- start 2022-02-02T14:46:40.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 -- start start 2022-02-02T14:46:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f55c0 0x7f3010105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010106950 con 0x7f30100f6860 2022-02-02T14:46:40.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.039+0000 7f3018542700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010107160 con 0x7f30100f55c0 2022-02-02T14:46:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34462/0 (socket says 172.21.15.33:34462) 2022-02-02T14:46:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 -- 172.21.15.33:0/3565647607 learned_addr learned my addr 172.21.15.33:0/3565647607 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f30162de700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f55c0 0x7f3010105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.044 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 -- 172.21.15.33:0/3565647607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f55c0 msgr2=0x7f3010105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f55c0 0x7f3010105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 -- 172.21.15.33:0/3565647607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000005040 con 0x7f30100f6860 2022-02-02T14:46:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3015add700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f300c010a00 tx=0x7f300c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300c0094c0 con 0x7f30100f6860 2022-02-02T14:46:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f300c009620 con 0x7f30100f6860 2022-02-02T14:46:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3010107380 con 0x7f30100f6860 2022-02-02T14:46:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f300c007e50 con 0x7f30100f6860 2022-02-02T14:46:40.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.040+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3010107910 con 0x7f30100f6860 2022-02-02T14:46:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.041+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff8004fa0 con 0x7f30100f6860 2022-02-02T14:46:40.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.042+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f300c022070 con 0x7f30100f6860 2022-02-02T14:46:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.042+0000 7f3006ffd700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 0x7f2ffc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.042+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f300c084190 con 0x7f30100f6860 2022-02-02T14:46:40.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.043+0000 7f30162de700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 0x7f2ffc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.043+0000 7f30162de700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 0x7f2ffc067290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f3000000c00 tx=0x7f300000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.047+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f300c052240 con 0x7f30100f6860 2022-02-02T14:46:40.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.234+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ff8000bc0 con 0x7f2ffc064dd0 2022-02-02T14:46:40.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.235+0000 7f3006ffd700 1 -- 172.21.15.33:0/3565647607 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2ff8000bc0 con 0x7f2ffc064dd0 2022-02-02T14:46:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 msgr2=0x7f2ffc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 0x7f2ffc067290 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f3000000c00 tx=0x7f300000b040).stop 2022-02-02T14:46:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 msgr2=0x7f3010106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f300c010a00 tx=0x7f300c00b040).stop 2022-02-02T14:46:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 shutdown_connections 2022-02-02T14:46:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2ffc064dd0 0x7f2ffc067290 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100f55c0 0x7f3010105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 --2- 172.21.15.33:0/3565647607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30100f6860 0x7f3010106350 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 >> 172.21.15.33:0/3565647607 conn(0x7f30100f0d40 msgr2=0x7f30100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 shutdown_connections 2022-02-02T14:46:40.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.237+0000 7f3018542700 1 -- 172.21.15.33:0/3565647607 wait complete. 2022-02-02T14:46:40.246 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:46:40.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 -- 172.21.15.33:0/3212043838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f66e0 msgr2=0x7f5b140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 --2- 172.21.15.33:0/3212043838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f66e0 0x7f5b140f6b00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f5afc004660 tx=0x7f5afc009b30).stop 2022-02-02T14:46:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 -- 172.21.15.33:0/3212043838 shutdown_connections 2022-02-02T14:46:40.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 --2- 172.21.15.33:0/3212043838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f7980 0x7f5b140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 --2- 172.21.15.33:0/3212043838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f66e0 0x7f5b140f6b00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 -- 172.21.15.33:0/3212043838 >> 172.21.15.33:0/3212043838 conn(0x7f5b140f1e40 msgr2=0x7f5b140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 -- 172.21.15.33:0/3212043838 shutdown_connections 2022-02-02T14:46:40.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.338+0000 7f5b1974c700 1 -- 172.21.15.33:0/3212043838 wait complete. 2022-02-02T14:46:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 Processor -- start 2022-02-02T14:46:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 -- start start 2022-02-02T14:46:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f66e0 0x7f5b1406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1406a380 con 0x7f5b140f7980 2022-02-02T14:46:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b1974c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1406a4c0 con 0x7f5b140f66e0 2022-02-02T14:46:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34472/0 (socket says 172.21.15.33:34472) 2022-02-02T14:46:40.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b127fc700 1 -- 172.21.15.33:0/2299475902 learned_addr learned my addr 172.21.15.33:0/2299475902 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.339+0000 7f5b12ffd700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f66e0 0x7f5b1406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b127fc700 1 -- 172.21.15.33:0/2299475902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f66e0 msgr2=0x7f5b1406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b127fc700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f66e0 0x7f5b1406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b127fc700 1 -- 172.21.15.33:0/2299475902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc005040 con 0x7f5b140f7980 2022-02-02T14:46:40.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b127fc700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f5b0400e7f0 tx=0x7f5b0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b040092e0 con 0x7f5b140f7980 2022-02-02T14:46:40.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b0400f040 con 0x7f5b140f7980 2022-02-02T14:46:40.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1406a7a0 con 0x7f5b140f7980 2022-02-02T14:46:40.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b04014750 con 0x7f5b140f7980 2022-02-02T14:46:40.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.340+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1410ef90 con 0x7f5b140f7980 2022-02-02T14:46:40.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.341+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b14045ad0 con 0x7f5b140f7980 2022-02-02T14:46:40.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.342+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b0401b030 con 0x7f5b140f7980 2022-02-02T14:46:40.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.342+0000 7f5b0b7fe700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 0x7f5b00067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.342+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5b04081890 con 0x7f5b140f7980 2022-02-02T14:46:40.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.346+0000 7f5b12ffd700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 0x7f5b00067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.346+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b0404fad0 con 0x7f5b140f7980 2022-02-02T14:46:40.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.347+0000 7f5b12ffd700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 0x7f5b00067270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f5afc000c00 tx=0x7f5afc016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.532+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b140ff010 con 0x7f5b00064db0 2022-02-02T14:46:40.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.547+0000 7f5b0b7fe700 1 -- 172.21.15.33:0/2299475902 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f5b140ff010 con 0x7f5b00064db0 2022-02-02T14:46:40.547 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:46:40.547 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (71m) 34m ago 72m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:46:40.547 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (64m) 34m ago 72m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:46:40.547 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (64m) 34m ago 72m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:46:40.548 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (71m) 34m ago 72m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:46:40.548 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (65m) 34m ago 69m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:46:40.548 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (66m) 34m ago 69m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:46:40.548 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (66m) 34m ago 69m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:46:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (69m) 34m ago 69m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:46:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (66m) 34m ago 74m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:46:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (66m) 34m ago 72m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:46:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (65m) 34m ago 74m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:46:40.549 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (65m) 34m ago 72m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:46:40.550 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (72m) 34m ago 72m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:46:40.550 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (72m) 34m ago 72m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:46:40.550 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 34m ago 71m - 4096M 2022-02-02T14:46:40.550 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (71m) 34m ago 71m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:46:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (71m) 34m ago 71m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:46:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (70m) 34m ago 70m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:46:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (70m) 34m ago 70m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:46:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (70m) 34m ago 70m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:46:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (71m) 34m ago 72m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:46:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 msgr2=0x7f5b00067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 0x7f5b00067270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f5afc000c00 tx=0x7f5afc016040).stop 2022-02-02T14:46:40.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 msgr2=0x7f5b14069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f5b0400e7f0 tx=0x7f5b0400b040).stop 2022-02-02T14:46:40.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 shutdown_connections 2022-02-02T14:46:40.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5b00064db0 0x7f5b00067270 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b140f66e0 0x7f5b1406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 --2- 172.21.15.33:0/2299475902 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b140f7980 0x7f5b14069e20 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 >> 172.21.15.33:0/2299475902 conn(0x7f5b140f1e40 msgr2=0x7f5b140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 shutdown_connections 2022-02-02T14:46:40.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.549+0000 7f5b1974c700 1 -- 172.21.15.33:0/2299475902 wait complete. 2022-02-02T14:46:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 -- 172.21.15.33:0/3919848557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc060270 msgr2=0x7fc0fc0f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 --2- 172.21.15.33:0/3919848557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f9340 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7fc0ec004660 tx=0x7fc0ec009b30).stop 2022-02-02T14:46:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 -- 172.21.15.33:0/3919848557 shutdown_connections 2022-02-02T14:46:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 --2- 172.21.15.33:0/3919848557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 --2- 172.21.15.33:0/3919848557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f9340 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 -- 172.21.15.33:0/3919848557 >> 172.21.15.33:0/3919848557 conn(0x7fc0fc0f0d40 msgr2=0x7fc0fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 -- 172.21.15.33:0/3919848557 shutdown_connections 2022-02-02T14:46:40.651 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:40 smithi033 ceph-mon[101165]: pgmap v2038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:40.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.649+0000 7fc100f25700 1 -- 172.21.15.33:0/3919848557 wait complete. 2022-02-02T14:46:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 Processor -- start 2022-02-02T14:46:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 -- start start 2022-02-02T14:46:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0f57a0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.650+0000 7fc100f25700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0fc0f58e0 con 0x7fc0fc060270 2022-02-02T14:46:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0fa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:45196/0 (socket says 172.21.15.33:45196) 2022-02-02T14:46:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34482/0 (socket says 172.21.15.33:34482) 2022-02-02T14:46:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0fa59c700 1 -- 172.21.15.33:0/1127063925 learned_addr learned my addr 172.21.15.33:0/1127063925 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:40.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 -- 172.21.15.33:0/1127063925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 msgr2=0x7fc0fc0f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 -- 172.21.15.33:0/1127063925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0ec005040 con 0x7fc0fc0f9830 2022-02-02T14:46:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0fa59c700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:46:40.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0f9d9b700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fc0f00026d0 tx=0x7fc0f0009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f00079c0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc0f000f040 con 0x7fc0fc0f9830 2022-02-02T14:46:40.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0f00147c0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0fc0f5bc0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.651+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0fc10ef50 con 0x7fc0fc0f9830 2022-02-02T14:46:40.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.653+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc0f0007b20 con 0x7fc0fc0f9830 2022-02-02T14:46:40.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.653+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0fc045ad0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.653+0000 7fc0eaffd700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 0x7fc0e4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:40.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.653+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc0f0081a00 con 0x7fc0fc0f9830 2022-02-02T14:46:40.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.653+0000 7fc0fa59c700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 0x7fc0e4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:40.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.654+0000 7fc0fa59c700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 0x7fc0e4067270 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fc0ec004630 tx=0x7fc0ec009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:40.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.658+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc0f004fab0 con 0x7fc0fc0f9830 2022-02-02T14:46:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:40 smithi037 ceph-mon[69017]: pgmap v2038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:40.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.901+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc0fc0f5d50 con 0x7fc0fc0f9830 2022-02-02T14:46:40.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.902+0000 7fc0eaffd700 1 -- 172.21.15.33:0/1127063925 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fc0fc0f5d50 con 0x7fc0fc0f9830 2022-02-02T14:46:40.901 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:46:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:46:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:46:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:40.902 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:46:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:46:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:46:40.903 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:46:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:46:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:46:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:46:40.904 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:46:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:46:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:46:40.905 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:46:40.905 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:46:40.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.903+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 msgr2=0x7fc0e4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.903+0000 7fc100f25700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 0x7fc0e4067270 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fc0ec004630 tx=0x7fc0ec009b30).stop 2022-02-02T14:46:40.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.903+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 msgr2=0x7fc0fc0f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:40.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.903+0000 7fc100f25700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7fc0f00026d0 tx=0x7fc0f0009d40).stop 2022-02-02T14:46:40.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 shutdown_connections 2022-02-02T14:46:40.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc0e4064db0 0x7fc0e4067270 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0fc060270 0x7fc0fc0f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 --2- 172.21.15.33:0/1127063925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0fc0f9830 0x7fc0fc0f5240 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:40.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 >> 172.21.15.33:0/1127063925 conn(0x7fc0fc0f0d40 msgr2=0x7fc0fc0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:40.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 shutdown_connections 2022-02-02T14:46:40.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:40.904+0000 7fc100f25700 1 -- 172.21.15.33:0/1127063925 wait complete. 2022-02-02T14:46:41.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.004+0000 7fad7a092700 1 -- 172.21.15.33:0/175171723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 msgr2=0x7fad740f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:41.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.004+0000 7fad7a092700 1 --2- 172.21.15.33:0/175171723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad740f6950 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7fad70004660 tx=0x7fad70009b30).stop 2022-02-02T14:46:41.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- 172.21.15.33:0/175171723 shutdown_connections 2022-02-02T14:46:41.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 --2- 172.21.15.33:0/175171723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 0x7fad740f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 --2- 172.21.15.33:0/175171723 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad740f6950 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- 172.21.15.33:0/175171723 >> 172.21.15.33:0/175171723 conn(0x7fad740f1c90 msgr2=0x7fad740f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:41.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- 172.21.15.33:0/175171723 shutdown_connections 2022-02-02T14:46:41.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- 172.21.15.33:0/175171723 wait complete. 2022-02-02T14:46:41.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 Processor -- start 2022-02-02T14:46:41.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- start start 2022-02-02T14:46:41.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:41.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 0x7fad74107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:41.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74107880 con 0x7fad740f6530 2022-02-02T14:46:41.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.005+0000 7fad7a092700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74108090 con 0x7fad740f77d0 2022-02-02T14:46:41.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34490/0 (socket says 172.21.15.33:34490) 2022-02-02T14:46:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 -- 172.21.15.33:0/1424301744 learned_addr learned my addr 172.21.15.33:0/1424301744 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:46:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad7888f700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 0x7fad74107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:41.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 -- 172.21.15.33:0/1424301744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 msgr2=0x7fad74107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 0x7fad74107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 -- 172.21.15.33:0/1424301744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad70005040 con 0x7fad740f6530 2022-02-02T14:46:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad79090700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fad70014040 tx=0x7fad7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad70019070 con 0x7fad740f6530 2022-02-02T14:46:41.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad741082b0 con 0x7fad740f6530 2022-02-02T14:46:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fad70007e70 con 0x7fad740f6530 2022-02-02T14:46:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.006+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad70014d10 con 0x7fad740f6530 2022-02-02T14:46:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.007+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad74108810 con 0x7fad740f6530 2022-02-02T14:46:41.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.007+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad74059100 con 0x7fad740f6530 2022-02-02T14:46:41.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.008+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fad70025070 con 0x7fad740f6530 2022-02-02T14:46:41.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.008+0000 7fad69ffb700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 0x7fad600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:46:41.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.008+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fad70082b40 con 0x7fad740f6530 2022-02-02T14:46:41.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.009+0000 7fad7888f700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 0x7fad600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:46:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.009+0000 7fad7888f700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 0x7fad600672e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fad64009fd0 tx=0x7fad6400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:46:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.013+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fad70050b30 con 0x7fad740f6530 2022-02-02T14:46:41.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.223+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fad740fecf0 con 0x7fad740f6530 2022-02-02T14:46:41.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.224+0000 7fad69ffb700 1 -- 172.21.15.33:0/1424301744 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fad70023020 con 0x7fad740f6530 2022-02-02T14:46:41.224 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:46:41.224 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:46:41.224 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:46:41.224 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:46:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:41.225 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:46:41.225 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:46:41.225 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:46:41.226 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:46:41.226 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:46:41.226 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:46:41.227 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:46:41.227 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:46:41.227 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:46:41.227 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:46:41.227 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:46:41.228 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:46:41.228 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:46:41.228 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:46:41.228 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:46:41.229 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:46:41.229 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:46:41.230 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:46:41.230 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:46:41.230 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:46:41.230 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:46:41.231 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:46:41.231 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:46:41.231 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:46:41.231 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:46:41.231 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:46:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:41.232 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:46:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:46:41.233 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:41.233 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:41.233 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:41.233 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:46:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.225+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 msgr2=0x7fad600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.225+0000 7fad7a092700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 0x7fad600672e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fad64009fd0 tx=0x7fad6400b040).stop 2022-02-02T14:46:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.225+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 msgr2=0x7fad74106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:46:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.225+0000 7fad7a092700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7fad70014040 tx=0x7fad7000b040).stop 2022-02-02T14:46:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 shutdown_connections 2022-02-02T14:46:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fad60064e20 0x7fad600672e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad740f6530 0x7fad74106d90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 --2- 172.21.15.33:0/1424301744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740f77d0 0x7fad74107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:46:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 >> 172.21.15.33:0/1424301744 conn(0x7fad740f1c90 msgr2=0x7fad740fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:46:41.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 shutdown_connections 2022-02-02T14:46:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:46:41.226+0000 7fad7a092700 1 -- 172.21.15.33:0/1424301744 wait complete. 2022-02-02T14:46:41.237 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:46:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:41 smithi033 ceph-mon[101165]: from='client.36164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:41 smithi033 ceph-mon[101165]: from='client.36168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1127063925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:46:41.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1424301744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:46:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:41 smithi037 ceph-mon[69017]: from='client.36164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:41 smithi037 ceph-mon[69017]: from='client.36168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:46:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1127063925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:46:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1424301744' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:46:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:42 smithi033 ceph-mon[101165]: pgmap v2039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:42 smithi037 ceph-mon[69017]: pgmap v2039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:44 smithi033 ceph-mon[101165]: pgmap v2040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:44 smithi037 ceph-mon[69017]: pgmap v2040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:46 smithi033 ceph-mon[101165]: pgmap v2041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:46 smithi037 ceph-mon[69017]: pgmap v2041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:48 smithi033 ceph-mon[101165]: pgmap v2042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:48 smithi037 ceph-mon[69017]: pgmap v2042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:49.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:49 smithi033 ceph-mon[101165]: pgmap v2043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:50.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:49 smithi037 ceph-mon[69017]: pgmap v2043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:52.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:52 smithi033 ceph-mon[101165]: pgmap v2044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:52 smithi037 ceph-mon[69017]: pgmap v2044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:54 smithi033 ceph-mon[101165]: pgmap v2045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:54.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:46:54.749 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:46:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:54 smithi037 ceph-mon[69017]: pgmap v2045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:46:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:46:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:56 smithi037 ceph-mon[69017]: pgmap v2046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:56 smithi033 ceph-mon[101165]: pgmap v2046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:46:58 smithi037 ceph-mon[69017]: pgmap v2047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:46:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:46:58 smithi033 ceph-mon[101165]: pgmap v2047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:00 smithi037 ceph-mon[69017]: pgmap v2048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:00 smithi033 ceph-mon[101165]: pgmap v2048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:02 smithi037 ceph-mon[69017]: pgmap v2049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:02 smithi033 ceph-mon[101165]: pgmap v2049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:04 smithi037 ceph-mon[69017]: pgmap v2050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:04 smithi033 ceph-mon[101165]: pgmap v2050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:06 smithi037 ceph-mon[69017]: pgmap v2051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:06 smithi033 ceph-mon[101165]: pgmap v2051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:08 smithi037 ceph-mon[69017]: pgmap v2052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:08 smithi033 ceph-mon[101165]: pgmap v2052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:10 smithi037 ceph-mon[69017]: pgmap v2053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:10 smithi033 ceph-mon[101165]: pgmap v2053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:11.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 -- 172.21.15.33:0/2046000802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 msgr2=0x7f69580f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 --2- 172.21.15.33:0/2046000802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f69580f7de0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7f694c004660 tx=0x7f694c009b30).stop 2022-02-02T14:47:11.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 -- 172.21.15.33:0/2046000802 shutdown_connections 2022-02-02T14:47:11.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 --2- 172.21.15.33:0/2046000802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f69580f7de0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 --2- 172.21.15.33:0/2046000802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 0x7f69580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:47:11.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 -- 172.21.15.33:0/2046000802 >> 172.21.15.33:0/2046000802 conn(0x7f69580f1e40 msgr2=0x7f69580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:11.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 -- 172.21.15.33:0/2046000802 shutdown_connections 2022-02-02T14:47:11.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.340+0000 7f695f681700 1 -- 172.21.15.33:0/2046000802 wait complete. 2022-02-02T14:47:11.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 Processor -- start 2022-02-02T14:47:11.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 -- start start 2022-02-02T14:47:11.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 0x7f695806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695806a410 con 0x7f69580f7980 2022-02-02T14:47:11.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695f681700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695806a550 con 0x7f69580f66e0 2022-02-02T14:47:11.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695cc1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695cc1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34502/0 (socket says 172.21.15.33:34502) 2022-02-02T14:47:11.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695cc1c700 1 -- 172.21.15.33:0/2017969817 learned_addr learned my addr 172.21.15.33:0/2017969817 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.341+0000 7f695d41d700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 0x7f695806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695cc1c700 1 -- 172.21.15.33:0/2017969817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 msgr2=0x7f695806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695cc1c700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 0x7f695806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695cc1c700 1 -- 172.21.15.33:0/2017969817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c005040 con 0x7f69580f7980 2022-02-02T14:47:11.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695cc1c700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f694c009990 tx=0x7f694c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694c018070 con 0x7f69580f7980 2022-02-02T14:47:11.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f694c007ba0 con 0x7f69580f7980 2022-02-02T14:47:11.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695806a7d0 con 0x7f69580f7980 2022-02-02T14:47:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f694c01c620 con 0x7f69580f7980 2022-02-02T14:47:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.342+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695810efe0 con 0x7f69580f7980 2022-02-02T14:47:11.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.343+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958045ad0 con 0x7f69580f7980 2022-02-02T14:47:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.344+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f694c01c8e0 con 0x7f69580f7980 2022-02-02T14:47:11.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.345+0000 7f6949ffb700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 0x7f6944067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.345+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f694c083b30 con 0x7f69580f7980 2022-02-02T14:47:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.345+0000 7f695d41d700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 0x7f6944067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.345+0000 7f695d41d700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 0x7f6944067290 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f695806b730 tx=0x7f6954008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.349+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f694c051be0 con 0x7f69580f7980 2022-02-02T14:47:11.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.538+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6958057f10 con 0x7f6944064dd0 2022-02-02T14:47:11.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.540+0000 7f6949ffb700 1 -- 172.21.15.33:0/2017969817 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6958057f10 con 0x7f6944064dd0 2022-02-02T14:47:11.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 msgr2=0x7f6944067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 0x7f6944067290 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f695806b730 tx=0x7f6954008040).stop 2022-02-02T14:47:11.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 msgr2=0x7f6958069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7f694c009990 tx=0x7f694c009b30).stop 2022-02-02T14:47:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 shutdown_connections 2022-02-02T14:47:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6944064dd0 0x7f6944067290 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69580f66e0 0x7f695806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 --2- 172.21.15.33:0/2017969817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69580f7980 0x7f6958069e20 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.541+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 >> 172.21.15.33:0/2017969817 conn(0x7f69580f1e40 msgr2=0x7f69580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.542+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 shutdown_connections 2022-02-02T14:47:11.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.542+0000 7f695f681700 1 -- 172.21.15.33:0/2017969817 wait complete. 2022-02-02T14:47:11.551 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:47:11.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 -- 172.21.15.33:0/736489010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f55c0 msgr2=0x7f1de40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 --2- 172.21.15.33:0/736489010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f55c0 0x7f1de40f59e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7f1dd4004660 tx=0x7f1dd4009b30).stop 2022-02-02T14:47:11.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 -- 172.21.15.33:0/736489010 shutdown_connections 2022-02-02T14:47:11.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 --2- 172.21.15.33:0/736489010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f6860 0x7f1de40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 --2- 172.21.15.33:0/736489010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f55c0 0x7f1de40f59e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.642+0000 7f1de920e700 1 -- 172.21.15.33:0/736489010 >> 172.21.15.33:0/736489010 conn(0x7f1de40f0d40 msgr2=0x7f1de40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:11.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.643+0000 7f1de920e700 1 -- 172.21.15.33:0/736489010 shutdown_connections 2022-02-02T14:47:11.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.643+0000 7f1de920e700 1 -- 172.21.15.33:0/736489010 wait complete. 2022-02-02T14:47:11.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.643+0000 7f1de920e700 1 Processor -- start 2022-02-02T14:47:11.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.643+0000 7f1de920e700 1 -- start start 2022-02-02T14:47:11.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de920e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 0x7f1de4105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de920e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de920e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4106910 con 0x7f1de40f6860 2022-02-02T14:47:11.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de920e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de4106a50 con 0x7f1de40f55c0 2022-02-02T14:47:11.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34512/0 (socket says 172.21.15.33:34512) 2022-02-02T14:47:11.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 -- 172.21.15.33:0/2492195836 learned_addr learned my addr 172.21.15.33:0/2492195836 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:11.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de2d9d700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 0x7f1de4105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 -- 172.21.15.33:0/2492195836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 msgr2=0x7f1de4105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 0x7f1de4105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 -- 172.21.15.33:0/2492195836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd4005040 con 0x7f1de40f6860 2022-02-02T14:47:11.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de2d9d700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 0x7f1de4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:47:11.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de259c700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f1dd800e970 tx=0x7f1dd8007eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd800c980 con 0x7f1de40f6860 2022-02-02T14:47:11.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1dd8011470 con 0x7f1de40f6860 2022-02-02T14:47:11.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.644+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de41073f0 con 0x7f1de40f6860 2022-02-02T14:47:11.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.645+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de41079b0 con 0x7f1de40f6860 2022-02-02T14:47:11.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.645+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd8010630 con 0x7f1de40f6860 2022-02-02T14:47:11.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.646+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc4004fa0 con 0x7f1de40f6860 2022-02-02T14:47:11.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.646+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1dd8010b00 con 0x7f1de40f6860 2022-02-02T14:47:11.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.646+0000 7f1dcb7fe700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.647+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1dd8084ae0 con 0x7f1de40f6860 2022-02-02T14:47:11.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.647+0000 7f1de2d9d700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.647+0000 7f1de2d9d700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 0x7f1dcc067290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f1dd4004e30 tx=0x7f1dd4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.651+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1dd80565c0 con 0x7f1de40f6860 2022-02-02T14:47:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.830+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1dc4000bc0 con 0x7f1dcc064dd0 2022-02-02T14:47:11.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.844+0000 7f1dcb7fe700 1 -- 172.21.15.33:0/2492195836 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1dc4000bc0 con 0x7f1dcc064dd0 2022-02-02T14:47:11.845 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:47:11.845 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (72m) 34m ago 73m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:47:11.846 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (65m) 34m ago 73m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:47:11.846 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (65m) 34m ago 72m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:47:11.847 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (72m) 34m ago 73m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:47:11.847 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (65m) 34m ago 69m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:47:11.847 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (66m) 34m ago 69m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:47:11.847 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (67m) 34m ago 69m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:47:11.847 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (69m) 34m ago 69m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:47:11.848 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (67m) 34m ago 74m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:47:11.848 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (66m) 34m ago 72m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:47:11.848 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (66m) 34m ago 74m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:47:11.848 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (66m) 34m ago 72m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:47:11.849 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (73m) 34m ago 73m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:47:11.849 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (72m) 34m ago 72m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:47:11.849 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 34m ago 72m - 4096M 2022-02-02T14:47:11.849 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (71m) 34m ago 71m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:47:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (71m) 34m ago 71m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:47:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (71m) 34m ago 71m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:47:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (71m) 34m ago 71m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:47:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (70m) 34m ago 70m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:47:11.850 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (72m) 34m ago 73m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:47:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 msgr2=0x7f1dcc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 0x7f1dcc067290 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f1dd4004e30 tx=0x7f1dd4009b30).stop 2022-02-02T14:47:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 msgr2=0x7f1de4106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f1dd800e970 tx=0x7f1dd8007eb0).stop 2022-02-02T14:47:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 shutdown_connections 2022-02-02T14:47:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dcc064dd0 0x7f1dcc067290 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1de40f55c0 0x7f1de4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 --2- 172.21.15.33:0/2492195836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1de40f6860 0x7f1de4106360 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 >> 172.21.15.33:0/2492195836 conn(0x7f1de40f0d40 msgr2=0x7f1de40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:11.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 shutdown_connections 2022-02-02T14:47:11.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.846+0000 7f1de920e700 1 -- 172.21.15.33:0/2492195836 wait complete. 2022-02-02T14:47:11.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 -- 172.21.15.33:0/2364940307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 msgr2=0x7fe2600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 --2- 172.21.15.33:0/2364940307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe2600f6cc0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fe254004660 tx=0x7fe254009b30).stop 2022-02-02T14:47:11.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 -- 172.21.15.33:0/2364940307 shutdown_connections 2022-02-02T14:47:11.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 --2- 172.21.15.33:0/2364940307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe2600f6cc0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 --2- 172.21.15.33:0/2364940307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 0x7fe2600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 -- 172.21.15.33:0/2364940307 >> 172.21.15.33:0/2364940307 conn(0x7fe2600f0d40 msgr2=0x7fe2600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 -- 172.21.15.33:0/2364940307 shutdown_connections 2022-02-02T14:47:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.946+0000 7fe266950700 1 -- 172.21.15.33:0/2364940307 wait complete. 2022-02-02T14:47:11.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 Processor -- start 2022-02-02T14:47:11.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 -- start start 2022-02-02T14:47:11.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 0x7fe260109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2600603e0 con 0x7fe2600f6860 2022-02-02T14:47:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.947+0000 7fe266950700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260060520 con 0x7fe2600f55c0 2022-02-02T14:47:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34522/0 (socket says 172.21.15.33:34522) 2022-02-02T14:47:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 -- 172.21.15.33:0/3883668214 learned_addr learned my addr 172.21.15.33:0/3883668214 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25ffff700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 0x7fe260109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 -- 172.21.15.33:0/3883668214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 msgr2=0x7fe260109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 0x7fe260109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 -- 172.21.15.33:0/3883668214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254005040 con 0x7fe2600f6860 2022-02-02T14:47:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25f7fe700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fe254009990 tx=0x7fe254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe254018070 con 0x7fe2600f6860 2022-02-02T14:47:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe254007ba0 con 0x7fe2600f6860 2022-02-02T14:47:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26010c6a0 con 0x7fe2600f6860 2022-02-02T14:47:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26010cc00 con 0x7fe2600f6860 2022-02-02T14:47:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.948+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe25401c3c0 con 0x7fe2600f6860 2022-02-02T14:47:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.949+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260045ad0 con 0x7fe2600f6860 2022-02-02T14:47:11.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.950+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe25401d420 con 0x7fe2600f6860 2022-02-02T14:47:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.950+0000 7fe25cff9700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 0x7fe248067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.951+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe2540839c0 con 0x7fe2600f6860 2022-02-02T14:47:11.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.951+0000 7fe25ffff700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 0x7fe248067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.951+0000 7fe25ffff700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 0x7fe248067290 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe260060060 tx=0x7fe25000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:11.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:11.954+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe254051a70 con 0x7fe2600f6860 2022-02-02T14:47:12.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.198+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe260027a00 con 0x7fe2600f6860 2022-02-02T14:47:12.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.198+0000 7fe25cff9700 1 -- 172.21.15.33:0/3883668214 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe254055090 con 0x7fe2600f6860 2022-02-02T14:47:12.199 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:47:12.199 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:47:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:47:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:47:12.200 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:47:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:47:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:47:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:12.201 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:47:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:47:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:47:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:47:12.202 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:47:12.203 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:47:12.203 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:47:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 msgr2=0x7fe248067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 0x7fe248067290 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fe260060060 tx=0x7fe25000b040).stop 2022-02-02T14:47:12.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 msgr2=0x7fe26010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fe254009990 tx=0x7fe254009b30).stop 2022-02-02T14:47:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 shutdown_connections 2022-02-02T14:47:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe248064dd0 0x7fe248067290 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2600f55c0 0x7fe260109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 --2- 172.21.15.33:0/3883668214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2600f6860 0x7fe26010c150 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 >> 172.21.15.33:0/3883668214 conn(0x7fe2600f0d40 msgr2=0x7fe2600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:12.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 shutdown_connections 2022-02-02T14:47:12.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.200+0000 7fe266950700 1 -- 172.21.15.33:0/3883668214 wait complete. 2022-02-02T14:47:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 -- 172.21.15.33:0/1375267699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f55c0 msgr2=0x7f4afc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1375267699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f55c0 0x7f4afc0f59e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f4af8004660 tx=0x7f4af8009b30).stop 2022-02-02T14:47:12.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 -- 172.21.15.33:0/1375267699 shutdown_connections 2022-02-02T14:47:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1375267699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f6860 0x7f4afc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1375267699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f55c0 0x7f4afc0f59e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 -- 172.21.15.33:0/1375267699 >> 172.21.15.33:0/1375267699 conn(0x7f4afc0f0d40 msgr2=0x7f4afc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:12.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 -- 172.21.15.33:0/1375267699 shutdown_connections 2022-02-02T14:47:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.301+0000 7f4b032b3700 1 -- 172.21.15.33:0/1375267699 wait complete. 2022-02-02T14:47:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 Processor -- start 2022-02-02T14:47:12.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 -- start start 2022-02-02T14:47:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f55c0 0x7f4afc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc0603c0 con 0x7f4afc0f6860 2022-02-02T14:47:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b032b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4afc060500 con 0x7f4afc0f55c0 2022-02-02T14:47:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b0084e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b0084e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34530/0 (socket says 172.21.15.33:34530) 2022-02-02T14:47:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b0084e700 1 -- 172.21.15.33:0/1064418386 learned_addr learned my addr 172.21.15.33:0/1064418386 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.302+0000 7f4b0104f700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f55c0 0x7f4afc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b0084e700 1 -- 172.21.15.33:0/1064418386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f55c0 msgr2=0x7f4afc109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b0084e700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f55c0 0x7f4afc109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b0084e700 1 -- 172.21.15.33:0/1064418386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8005040 con 0x7f4afc0f6860 2022-02-02T14:47:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b0084e700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f4af00026d0 tx=0x7f4af0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af0009320 con 0x7f4afc0f6860 2022-02-02T14:47:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4af000f040 con 0x7f4afc0f6860 2022-02-02T14:47:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4af00147e0 con 0x7f4afc0f6860 2022-02-02T14:47:12.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4afc10c740 con 0x7f4afc0f6860 2022-02-02T14:47:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.303+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4afc10ccd0 con 0x7f4afc0f6860 2022-02-02T14:47:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.304+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4afc0f49b0 con 0x7f4afc0f6860 2022-02-02T14:47:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.304+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4af0009480 con 0x7f4afc0f6860 2022-02-02T14:47:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.305+0000 7f4aedffb700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 0x7f4ae8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:12.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.305+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4af00820c0 con 0x7f4afc0f6860 2022-02-02T14:47:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.305+0000 7f4b0104f700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 0x7f4ae8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.305+0000 7f4b0104f700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 0x7f4ae8067290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f4af8004e30 tx=0x7f4af8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:12.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.310+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4af0050170 con 0x7f4afc0f6860 2022-02-02T14:47:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.522+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4afc045ad0 con 0x7f4afc0f6860 2022-02-02T14:47:12.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.523+0000 7f4aedffb700 1 -- 172.21.15.33:0/1064418386 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4af0053790 con 0x7f4afc0f6860 2022-02-02T14:47:12.524 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:47:12.524 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:47:12.524 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:47:12.525 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:47:12.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:12.525 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:47:12.525 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:47:12.526 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:47:12.526 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:47:12.526 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:47:12.526 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:47:12.527 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:47:12.527 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:47:12.527 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:47:12.527 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:47:12.528 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:47:12.528 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:47:12.528 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:47:12.528 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:47:12.528 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:47:12.529 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:47:12.529 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:47:12.529 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:47:12.529 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:47:12.530 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:47:12.530 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:47:12.530 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:47:12.530 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:47:12.530 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:47:12.531 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:47:12.531 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:47:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:12.531 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:47:12.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:12.532 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:12.533 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 msgr2=0x7f4ae8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 0x7f4ae8067290 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f4af8004e30 tx=0x7f4af8009b30).stop 2022-02-02T14:47:12.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 msgr2=0x7f4afc10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f4af00026d0 tx=0x7f4af0009de0).stop 2022-02-02T14:47:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 shutdown_connections 2022-02-02T14:47:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4ae8064dd0 0x7f4ae8067290 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4afc0f55c0 0x7f4afc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 --2- 172.21.15.33:0/1064418386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4afc0f6860 0x7f4afc10c190 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 >> 172.21.15.33:0/1064418386 conn(0x7f4afc0f0d40 msgr2=0x7f4afc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 shutdown_connections 2022-02-02T14:47:12.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:12.525+0000 7f4b032b3700 1 -- 172.21.15.33:0/1064418386 wait complete. 2022-02-02T14:47:12.537 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:47:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:12 smithi037 ceph-mon[69017]: pgmap v2054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:12 smithi037 ceph-mon[69017]: from='client.36180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3883668214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:47:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:12 smithi033 ceph-mon[101165]: pgmap v2054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:12.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:12 smithi033 ceph-mon[101165]: from='client.36180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:12.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3883668214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:47:13.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:13 smithi037 ceph-mon[69017]: from='client.36184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:13.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1064418386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:47:13.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:13 smithi033 ceph-mon[101165]: from='client.36184 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:13.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1064418386' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:47:14.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:14 smithi037 ceph-mon[69017]: pgmap v2055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:14 smithi033 ceph-mon[101165]: pgmap v2055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:16 smithi037 ceph-mon[69017]: pgmap v2056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:16 smithi033 ceph-mon[101165]: pgmap v2056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:18.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:18 smithi037 ceph-mon[69017]: pgmap v2057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:18 smithi033 ceph-mon[101165]: pgmap v2057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:20.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:20 smithi037 ceph-mon[69017]: pgmap v2058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:20 smithi033 ceph-mon[101165]: pgmap v2058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:22 smithi037 ceph-mon[69017]: pgmap v2059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:22 smithi033 ceph-mon[101165]: pgmap v2059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:24 smithi033 ceph-mon[101165]: pgmap v2060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:24 smithi037 ceph-mon[69017]: pgmap v2060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:26 smithi033 ceph-mon[101165]: pgmap v2061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:26 smithi037 ceph-mon[69017]: pgmap v2061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:28 smithi033 ceph-mon[101165]: pgmap v2062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:28 smithi037 ceph-mon[69017]: pgmap v2062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:30 smithi033 ceph-mon[101165]: pgmap v2063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:30 smithi037 ceph-mon[69017]: pgmap v2063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:32.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:32 smithi033 ceph-mon[101165]: pgmap v2064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:32 smithi037 ceph-mon[69017]: pgmap v2064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:34 smithi033 ceph-mon[101165]: pgmap v2065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:34 smithi037 ceph-mon[69017]: pgmap v2065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:36 smithi033 ceph-mon[101165]: pgmap v2066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:36 smithi037 ceph-mon[69017]: pgmap v2066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:38 smithi033 ceph-mon[101165]: pgmap v2067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:38 smithi037 ceph-mon[69017]: pgmap v2067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:39.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:39 smithi033 ceph-mon[101165]: pgmap v2068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:40.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:39 smithi037 ceph-mon[69017]: pgmap v2068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:42.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 -- 172.21.15.33:0/487296629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f66d0 msgr2=0x7fb3080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/487296629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f66d0 0x7fb3080f6b30 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7fb2f4004660 tx=0x7fb2f4009b30).stop 2022-02-02T14:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 -- 172.21.15.33:0/487296629 shutdown_connections 2022-02-02T14:47:42.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/487296629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f66d0 0x7fb3080f6b30 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/487296629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f5430 0x7fb3080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 -- 172.21.15.33:0/487296629 >> 172.21.15.33:0/487296629 conn(0x7fb3080f0b90 msgr2=0x7fb3080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:42.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 -- 172.21.15.33:0/487296629 shutdown_connections 2022-02-02T14:47:42.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.640+0000 7fb30dfd5700 1 -- 172.21.15.33:0/487296629 wait complete. 2022-02-02T14:47:42.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 Processor -- start 2022-02-02T14:47:42.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 -- start start 2022-02-02T14:47:42.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f66d0 0x7fb308109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081099e0 con 0x7fb3080f5430 2022-02-02T14:47:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30dfd5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308109b20 con 0x7fb3080f66d0 2022-02-02T14:47:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30cfd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30cfd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34538/0 (socket says 172.21.15.33:34538) 2022-02-02T14:47:42.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb30cfd3700 1 -- 172.21.15.33:0/1822972946 learned_addr learned my addr 172.21.15.33:0/1822972946 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.641+0000 7fb307fff700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f66d0 0x7fb308109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30cfd3700 1 -- 172.21.15.33:0/1822972946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f66d0 msgr2=0x7fb308109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30cfd3700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f66d0 0x7fb308109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30cfd3700 1 -- 172.21.15.33:0/1822972946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f4005040 con 0x7fb3080f5430 2022-02-02T14:47:42.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30cfd3700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fb2fc002700 tx=0x7fb2fc009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:42.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc009320 con 0x7fb3080f5430 2022-02-02T14:47:42.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30810a4c0 con 0x7fb3080f5430 2022-02-02T14:47:42.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2fc00f040 con 0x7fb3080f5430 2022-02-02T14:47:42.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2fc014900 con 0x7fb3080f5430 2022-02-02T14:47:42.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.642+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30810aa80 con 0x7fb3080f5430 2022-02-02T14:47:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.643+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308045ad0 con 0x7fb3080f5430 2022-02-02T14:47:42.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.644+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2fc009480 con 0x7fb3080f5430 2022-02-02T14:47:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.644+0000 7fb3057fa700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 0x7fb2f80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.644+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2fc081d10 con 0x7fb3080f5430 2022-02-02T14:47:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.644+0000 7fb307fff700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 0x7fb2f80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.645+0000 7fb307fff700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 0x7fb2f80672e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fb2f4004630 tx=0x7fb2f4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:42.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.649+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2fc0538b0 con 0x7fb3080f5430 2022-02-02T14:47:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:42 smithi037 ceph-mon[69017]: pgmap v2069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.838+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3080fa910 con 0x7fb2f8064e20 2022-02-02T14:47:42.838 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:42 smithi033 ceph-mon[101165]: pgmap v2069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.839+0000 7fb3057fa700 1 -- 172.21.15.33:0/1822972946 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fb3080fa910 con 0x7fb2f8064e20 2022-02-02T14:47:42.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 msgr2=0x7fb2f80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 0x7fb2f80672e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fb2f4004630 tx=0x7fb2f4009b30).stop 2022-02-02T14:47:42.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 msgr2=0x7fb308108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7fb2fc002700 tx=0x7fb2fc009d80).stop 2022-02-02T14:47:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 shutdown_connections 2022-02-02T14:47:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2f8064e20 0x7fb2f80672e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3080f5430 0x7fb308108f40 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 --2- 172.21.15.33:0/1822972946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3080f66d0 0x7fb308109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 >> 172.21.15.33:0/1822972946 conn(0x7fb3080f0b90 msgr2=0x7fb30805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 shutdown_connections 2022-02-02T14:47:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.841+0000 7fb30dfd5700 1 -- 172.21.15.33:0/1822972946 wait complete. 2022-02-02T14:47:42.851 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:47:42.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 -- 172.21.15.33:0/1238930786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 msgr2=0x7f12040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 --2- 172.21.15.33:0/1238930786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f12040f6b00 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f1200004660 tx=0x7f1200009b30).stop 2022-02-02T14:47:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 -- 172.21.15.33:0/1238930786 shutdown_connections 2022-02-02T14:47:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 --2- 172.21.15.33:0/1238930786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 0x7f12040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 --2- 172.21.15.33:0/1238930786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f12040f6b00 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 -- 172.21.15.33:0/1238930786 >> 172.21.15.33:0/1238930786 conn(0x7f12040f1e40 msgr2=0x7f12040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 -- 172.21.15.33:0/1238930786 shutdown_connections 2022-02-02T14:47:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.942+0000 7f120bfa3700 1 -- 172.21.15.33:0/1238930786 wait complete. 2022-02-02T14:47:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 Processor -- start 2022-02-02T14:47:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 -- start start 2022-02-02T14:47:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 0x7f12041074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1204107a50 con 0x7f12040f66e0 2022-02-02T14:47:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120bfa3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1204107b90 con 0x7f12040f7980 2022-02-02T14:47:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34548/0 (socket says 172.21.15.33:34548) 2022-02-02T14:47:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 -- 172.21.15.33:0/3052040747 learned_addr learned my addr 172.21.15.33:0/3052040747 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f120953e700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 0x7f12041074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 -- 172.21.15.33:0/3052040747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 msgr2=0x7f12041074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 0x7f12041074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.943+0000 7f1209d3f700 1 -- 172.21.15.33:0/3052040747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200005040 con 0x7f12040f66e0 2022-02-02T14:47:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f1209d3f700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f1200013a70 tx=0x7f1200009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1200018070 con 0x7f12040f66e0 2022-02-02T14:47:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12041084d0 con 0x7f12040f66e0 2022-02-02T14:47:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f12000097d0 con 0x7f12040f66e0 2022-02-02T14:47:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f120001c3c0 con 0x7f12040f66e0 2022-02-02T14:47:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.944+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1204108a30 con 0x7f12040f66e0 2022-02-02T14:47:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.945+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1204045ad0 con 0x7f12040f66e0 2022-02-02T14:47:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.945+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1200007ba0 con 0x7f12040f66e0 2022-02-02T14:47:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.946+0000 7f11f67fc700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:42.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.946+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1200083790 con 0x7f12040f66e0 2022-02-02T14:47:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.946+0000 7f120953e700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.946+0000 7f120953e700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 0x7f11f0067290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f11f80096c0 tx=0x7f11f8009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:42.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:42.950+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1200055330 con 0x7f12040f66e0 2022-02-02T14:47:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.132+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f12040fefe0 con 0x7f11f0064dd0 2022-02-02T14:47:43.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.146+0000 7f11f67fc700 1 -- 172.21.15.33:0/3052040747 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f12040fefe0 con 0x7f11f0064dd0 2022-02-02T14:47:43.146 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:47:43.146 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (73m) 35m ago 74m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:47:43.147 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (66m) 35m ago 73m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:47:43.147 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (65m) 35m ago 73m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:47:43.147 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (72m) 35m ago 73m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:47:43.147 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (66m) 35m ago 70m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:47:43.148 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (67m) 35m ago 70m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:47:43.148 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (67m) 35m ago 70m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:47:43.149 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (70m) 35m ago 70m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:47:43.149 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (67m) 35m ago 75m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:47:43.149 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (67m) 35m ago 73m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:47:43.149 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (66m) 35m ago 75m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:47:43.150 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (66m) 35m ago 73m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:47:43.150 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (73m) 35m ago 73m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:47:43.150 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (73m) 35m ago 73m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:47:43.150 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 35m ago 72m - 4096M 2022-02-02T14:47:43.150 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (72m) 35m ago 72m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:47:43.151 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (72m) 35m ago 72m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:47:43.151 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (71m) 35m ago 71m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:47:43.151 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (71m) 35m ago 71m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:47:43.151 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (71m) 35m ago 71m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:47:43.152 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (72m) 35m ago 73m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:47:43.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 msgr2=0x7f11f0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 0x7f11f0067290 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f11f80096c0 tx=0x7f11f8009be0).stop 2022-02-02T14:47:43.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 msgr2=0x7f1204106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f1200013a70 tx=0x7f1200009b30).stop 2022-02-02T14:47:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 shutdown_connections 2022-02-02T14:47:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11f0064dd0 0x7f11f0067290 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12040f66e0 0x7f1204106fb0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 --2- 172.21.15.33:0/3052040747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12040f7980 0x7f12041074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 >> 172.21.15.33:0/3052040747 conn(0x7f12040f1e40 msgr2=0x7f12040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:43.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 shutdown_connections 2022-02-02T14:47:43.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.148+0000 7f120bfa3700 1 -- 172.21.15.33:0/3052040747 wait complete. 2022-02-02T14:47:43.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 -- 172.21.15.33:0/1555915053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 msgr2=0x7fcb840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/1555915053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb840f5850 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7fcb74004660 tx=0x7fcb74009b30).stop 2022-02-02T14:47:43.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 -- 172.21.15.33:0/1555915053 shutdown_connections 2022-02-02T14:47:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/1555915053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb840f66d0 0x7fcb840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/1555915053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb840f5850 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.248+0000 7fcb88ac2700 1 -- 172.21.15.33:0/1555915053 >> 172.21.15.33:0/1555915053 conn(0x7fcb840f0b90 msgr2=0x7fcb840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:43.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.249+0000 7fcb88ac2700 1 -- 172.21.15.33:0/1555915053 shutdown_connections 2022-02-02T14:47:43.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.249+0000 7fcb88ac2700 1 -- 172.21.15.33:0/1555915053 wait complete. 2022-02-02T14:47:43.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.249+0000 7fcb88ac2700 1 Processor -- start 2022-02-02T14:47:43.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.249+0000 7fcb88ac2700 1 -- start start 2022-02-02T14:47:43.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb88ac2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb88ac2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb840f66d0 0x7fcb84106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb88ac2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb841067d0 con 0x7fcb840f5430 2022-02-02T14:47:43.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb88ac2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb84106fd0 con 0x7fcb840f66d0 2022-02-02T14:47:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34558/0 (socket says 172.21.15.33:34558) 2022-02-02T14:47:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 -- 172.21.15.33:0/230095330 learned_addr learned my addr 172.21.15.33:0/230095330 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:43.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 -- 172.21.15.33:0/230095330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb840f66d0 msgr2=0x7fcb84106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb840f66d0 0x7fcb84106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:47:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 -- 172.21.15.33:0/230095330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb74005040 con 0x7fcb840f5430 2022-02-02T14:47:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb837fe700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fcb74013a70 tx=0x7fcb74009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb74018070 con 0x7fcb840f5430 2022-02-02T14:47:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.250+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb740097d0 con 0x7fcb840f5430 2022-02-02T14:47:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.251+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb841071d0 con 0x7fcb840f5430 2022-02-02T14:47:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.251+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb7401c3c0 con 0x7fcb840f5430 2022-02-02T14:47:43.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.251+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb84107700 con 0x7fcb840f5430 2022-02-02T14:47:43.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.252+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb84059100 con 0x7fcb840f5430 2022-02-02T14:47:43.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.252+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb74007ba0 con 0x7fcb840f5430 2022-02-02T14:47:43.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.252+0000 7fcb6bfff700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 0x7fcb6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.252+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb74083690 con 0x7fcb840f5430 2022-02-02T14:47:43.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.252+0000 7fcb82ffd700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 0x7fcb6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:43.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.253+0000 7fcb82ffd700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 0x7fcb6c0672e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fcb78004a10 tx=0x7fcb780099e0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:43.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.257+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb74055230 con 0x7fcb840f5430 2022-02-02T14:47:43.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.498+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb840ff600 con 0x7fcb840f5430 2022-02-02T14:47:43.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.498+0000 7fcb6bfff700 1 -- 172.21.15.33:0/230095330 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fcb74054e20 con 0x7fcb840f5430 2022-02-02T14:47:43.502 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:47:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:47:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:47:43.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:47:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:47:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:47:43.504 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:47:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:47:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:47:43.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:47:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:47:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:47:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:47:43.506 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:47:43.507 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:47:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 msgr2=0x7fcb6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 0x7fcb6c0672e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fcb78004a10 tx=0x7fcb780099e0).stop 2022-02-02T14:47:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 msgr2=0x7fcb84105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 rx=0x7fcb74013a70 tx=0x7fcb74009b30).stop 2022-02-02T14:47:43.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 shutdown_connections 2022-02-02T14:47:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb6c064e20 0x7fcb6c0672e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb840f5430 0x7fcb84105d30 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 --2- 172.21.15.33:0/230095330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb840f66d0 0x7fcb84106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:47:43.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 >> 172.21.15.33:0/230095330 conn(0x7fcb840f0b90 msgr2=0x7fcb840fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 shutdown_connections 2022-02-02T14:47:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.500+0000 7fcb88ac2700 1 -- 172.21.15.33:0/230095330 wait complete. 2022-02-02T14:47:43.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 -- 172.21.15.33:0/521834308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 msgr2=0x7f71780f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 --2- 172.21.15.33:0/521834308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f71780f5850 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f7168004660 tx=0x7f7168009b30).stop 2022-02-02T14:47:43.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 -- 172.21.15.33:0/521834308 shutdown_connections 2022-02-02T14:47:43.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 --2- 172.21.15.33:0/521834308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 0x7f71780f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:47:43.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 --2- 172.21.15.33:0/521834308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f71780f5850 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 -- 172.21.15.33:0/521834308 >> 172.21.15.33:0/521834308 conn(0x7f71780f0b90 msgr2=0x7f71780f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:43.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 -- 172.21.15.33:0/521834308 shutdown_connections 2022-02-02T14:47:43.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.601+0000 7f717cdd7700 1 -- 172.21.15.33:0/521834308 wait complete. 2022-02-02T14:47:43.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 Processor -- start 2022-02-02T14:47:43.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 -- start start 2022-02-02T14:47:43.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 0x7f717810bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178060470 con 0x7f71780f5430 2022-02-02T14:47:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.602+0000 7f717cdd7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780605b0 con 0x7f71780f66d0 2022-02-02T14:47:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34568/0 (socket says 172.21.15.33:34568) 2022-02-02T14:47:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 -- 172.21.15.33:0/2139355099 learned_addr learned my addr 172.21.15.33:0/2139355099 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:47:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f7176ffd700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 0x7f717810bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 -- 172.21.15.33:0/2139355099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 msgr2=0x7f717810bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 0x7f717810bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 -- 172.21.15.33:0/2139355099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7168005040 con 0x7f71780f5430 2022-02-02T14:47:43.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f71777fe700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f7168004f60 tx=0x7f7168009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:43.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7168018070 con 0x7f71780f5430 2022-02-02T14:47:43.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7168009770 con 0x7f71780f5430 2022-02-02T14:47:43.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717810c5b0 con 0x7f71780f5430 2022-02-02T14:47:43.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716801c3c0 con 0x7f71780f5430 2022-02-02T14:47:43.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.603+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717810cae0 con 0x7f71780f5430 2022-02-02T14:47:43.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.604+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7178059100 con 0x7f71780f5430 2022-02-02T14:47:43.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.605+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f716801d420 con 0x7f71780f5430 2022-02-02T14:47:43.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.605+0000 7f715ffff700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 0x7f71600672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:47:43.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.605+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f71680838a0 con 0x7f71780f5430 2022-02-02T14:47:43.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.605+0000 7f7176ffd700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 0x7f71600672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:47:43.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.606+0000 7f7176ffd700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 0x7f71600672e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f716c006fd0 tx=0x7f716c008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:47:43.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.610+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7168051950 con 0x7f71780f5430 2022-02-02T14:47:43.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.821+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7178027a00 con 0x7f71780f5430 2022-02-02T14:47:43.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.821+0000 7f715ffff700 1 -- 172.21.15.33:0/2139355099 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f7168054f70 con 0x7f71780f5430 2022-02-02T14:47:43.821 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:47:43.821 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:47:43.822 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:47:43.822 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:47:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:43.822 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:47:43.823 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:47:43.823 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:47:43.823 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:47:43.823 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:47:43.823 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:47:43.824 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:47:43.824 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:47:43.824 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:47:43.824 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:47:43.825 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:47:43.825 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:47:43.825 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:47:43.825 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:47:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:47:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:47:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:47:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:47:43.826 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:47:43.827 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:47:43.827 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:47:43.828 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:47:43.828 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:47:43.828 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:47:43.828 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:47:43.829 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:47:43.829 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:43.829 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:43.829 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:47:43.830 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:47:43.830 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:43.830 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:43.830 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:43.831 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:47:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.823+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 msgr2=0x7f71600672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.823+0000 7f717cdd7700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 0x7f71600672e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f716c006fd0 tx=0x7f716c008040).stop 2022-02-02T14:47:43.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.823+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 msgr2=0x7f7178109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:47:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.823+0000 7f717cdd7700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f7168004f60 tx=0x7f7168009b30).stop 2022-02-02T14:47:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 shutdown_connections 2022-02-02T14:47:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7160064e20 0x7f71600672e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71780f5430 0x7f7178109ab0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 --2- 172.21.15.33:0/2139355099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71780f66d0 0x7f717810bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:47:43.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 >> 172.21.15.33:0/2139355099 conn(0x7f71780f0b90 msgr2=0x7f71780fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:47:43.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 shutdown_connections 2022-02-02T14:47:43.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:47:43.824+0000 7f717cdd7700 1 -- 172.21.15.33:0/2139355099 wait complete. 2022-02-02T14:47:43.835 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:47:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:44 smithi037 ceph-mon[69017]: from='client.36196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:44 smithi037 ceph-mon[69017]: from='client.36200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:44 smithi037 ceph-mon[69017]: pgmap v2070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/230095330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:47:44.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2139355099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:47:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:44 smithi033 ceph-mon[101165]: from='client.36196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:44 smithi033 ceph-mon[101165]: from='client.36200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:47:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:44 smithi033 ceph-mon[101165]: pgmap v2070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/230095330' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:47:44.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2139355099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:47:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:46 smithi037 ceph-mon[69017]: pgmap v2071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:46 smithi033 ceph-mon[101165]: pgmap v2071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:48 smithi037 ceph-mon[69017]: pgmap v2072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:48 smithi033 ceph-mon[101165]: pgmap v2072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:50 smithi037 ceph-mon[69017]: pgmap v2073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:50 smithi033 ceph-mon[101165]: pgmap v2073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:52 smithi037 ceph-mon[69017]: pgmap v2074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:52 smithi033 ceph-mon[101165]: pgmap v2074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:54 smithi037 ceph-mon[69017]: pgmap v2075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:47:54.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:47:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:54 smithi033 ceph-mon[101165]: pgmap v2075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:47:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:47:56.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:56 smithi037 ceph-mon[69017]: pgmap v2076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:56 smithi033 ceph-mon[101165]: pgmap v2076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:58.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:47:58 smithi037 ceph-mon[69017]: pgmap v2077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:47:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:47:58 smithi033 ceph-mon[101165]: pgmap v2077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:00.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:00 smithi037 ceph-mon[69017]: pgmap v2078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:00 smithi033 ceph-mon[101165]: pgmap v2078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:02.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:02 smithi037 ceph-mon[69017]: pgmap v2079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:02 smithi033 ceph-mon[101165]: pgmap v2079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:04.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:04 smithi037 ceph-mon[69017]: pgmap v2080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:04 smithi033 ceph-mon[101165]: pgmap v2080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:06 smithi037 ceph-mon[69017]: pgmap v2081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:06 smithi033 ceph-mon[101165]: pgmap v2081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:08 smithi037 ceph-mon[69017]: pgmap v2082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:08 smithi033 ceph-mon[101165]: pgmap v2082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:10 smithi037 ceph-mon[69017]: pgmap v2083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:10 smithi033 ceph-mon[101165]: pgmap v2083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:12 smithi037 ceph-mon[69017]: pgmap v2084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:12 smithi033 ceph-mon[101165]: pgmap v2084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:13.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 -- 172.21.15.33:0/1203031751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 msgr2=0x7fe3c80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/1203031751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c80f6cc0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fe3b4004660 tx=0x7fe3b4009b30).stop 2022-02-02T14:48:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 -- 172.21.15.33:0/1203031751 shutdown_connections 2022-02-02T14:48:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/1203031751 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c80f6cc0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/1203031751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 0x7fe3c80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:13.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 -- 172.21.15.33:0/1203031751 >> 172.21.15.33:0/1203031751 conn(0x7fe3c80f0d40 msgr2=0x7fe3c80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:13.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 -- 172.21.15.33:0/1203031751 shutdown_connections 2022-02-02T14:48:13.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.938+0000 7fe3ceffa700 1 -- 172.21.15.33:0/1203031751 wait complete. 2022-02-02T14:48:13.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 Processor -- start 2022-02-02T14:48:13.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 -- start start 2022-02-02T14:48:13.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 0x7fe3c8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:13.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:13.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c81069b0 con 0x7fe3c80f6860 2022-02-02T14:48:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3ceffa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c81071c0 con 0x7fe3c80f55c0 2022-02-02T14:48:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.939+0000 7fe3c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34580/0 (socket says 172.21.15.33:34580) 2022-02-02T14:48:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 -- 172.21.15.33:0/3298476337 learned_addr learned my addr 172.21.15.33:0/3298476337 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3ccd96700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 0x7fe3c8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 -- 172.21.15.33:0/3298476337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 msgr2=0x7fe3c8105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 0x7fe3c8105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 -- 172.21.15.33:0/3298476337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4005040 con 0x7fe3c80f6860 2022-02-02T14:48:13.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c7fff700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe3b4009990 tx=0x7fe3b4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:13.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b4018070 con 0x7fe3c80f6860 2022-02-02T14:48:13.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe3b4007ba0 con 0x7fe3c80f6860 2022-02-02T14:48:13.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c81073e0 con 0x7fe3c80f6860 2022-02-02T14:48:13.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3b401c620 con 0x7fe3c80f6860 2022-02-02T14:48:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.940+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c8107940 con 0x7fe3c80f6860 2022-02-02T14:48:13.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.941+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c80f49b0 con 0x7fe3c80f6860 2022-02-02T14:48:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.942+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe3b401c890 con 0x7fe3c80f6860 2022-02-02T14:48:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.942+0000 7fe3c57fa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.942+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe3b4083800 con 0x7fe3c80f6860 2022-02-02T14:48:13.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.942+0000 7fe3ccd96700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.943+0000 7fe3ccd96700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fe3c8105c30 tx=0x7fe3bc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:13.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:13.948+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe3b4051960 con 0x7fe3c80f6860 2022-02-02T14:48:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.136+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3c80fdf10 con 0x7fe3b8064dd0 2022-02-02T14:48:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.138+0000 7fe3c57fa700 1 -- 172.21.15.33:0/3298476337 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe3c80fdf10 con 0x7fe3b8064dd0 2022-02-02T14:48:14.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 msgr2=0x7fe3b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fe3c8105c30 tx=0x7fe3bc009040).stop 2022-02-02T14:48:14.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 msgr2=0x7fe3c81063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe3b4009990 tx=0x7fe3b4009b30).stop 2022-02-02T14:48:14.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 shutdown_connections 2022-02-02T14:48:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3c80f55c0 0x7fe3c8105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 --2- 172.21.15.33:0/3298476337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3c80f6860 0x7fe3c81063b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 >> 172.21.15.33:0/3298476337 conn(0x7fe3c80f0d40 msgr2=0x7fe3c80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 shutdown_connections 2022-02-02T14:48:14.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.140+0000 7fe3ceffa700 1 -- 172.21.15.33:0/3298476337 wait complete. 2022-02-02T14:48:14.149 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:48:14.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 -- 172.21.15.33:0/2699482606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f66d0 msgr2=0x7fcf680f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/2699482606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f66d0 0x7fcf680f6b30 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fcf58004660 tx=0x7fcf58009b30).stop 2022-02-02T14:48:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 -- 172.21.15.33:0/2699482606 shutdown_connections 2022-02-02T14:48:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/2699482606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f66d0 0x7fcf680f6b30 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/2699482606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f5430 0x7fcf680f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 -- 172.21.15.33:0/2699482606 >> 172.21.15.33:0/2699482606 conn(0x7fcf680f0b90 msgr2=0x7fcf680f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 -- 172.21.15.33:0/2699482606 shutdown_connections 2022-02-02T14:48:14.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.242+0000 7fcf6e2db700 1 -- 172.21.15.33:0/2699482606 wait complete. 2022-02-02T14:48:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 Processor -- start 2022-02-02T14:48:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 -- start start 2022-02-02T14:48:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f66d0 0x7fcf6810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf680603e0 con 0x7fcf680f5430 2022-02-02T14:48:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6e2db700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68060520 con 0x7fcf680f66d0 2022-02-02T14:48:14.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6d2d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6d2d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34588/0 (socket says 172.21.15.33:34588) 2022-02-02T14:48:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6d2d9700 1 -- 172.21.15.33:0/1573860722 learned_addr learned my addr 172.21.15.33:0/1573860722 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.243+0000 7fcf6cad8700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f66d0 0x7fcf6810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6d2d9700 1 -- 172.21.15.33:0/1573860722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f66d0 msgr2=0x7fcf6810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6d2d9700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f66d0 0x7fcf6810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6d2d9700 1 -- 172.21.15.33:0/1573860722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58005040 con 0x7fcf680f5430 2022-02-02T14:48:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6d2d9700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fcf6400e7c0 tx=0x7fcf6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf640092e0 con 0x7fcf680f5430 2022-02-02T14:48:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6810c480 con 0x7fcf680f5430 2022-02-02T14:48:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf6400f040 con 0x7fcf680f5430 2022-02-02T14:48:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf640147e0 con 0x7fcf680f5430 2022-02-02T14:48:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.244+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6810ca40 con 0x7fcf680f5430 2022-02-02T14:48:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.245+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68045ad0 con 0x7fcf680f5430 2022-02-02T14:48:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.246+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf6401b030 con 0x7fcf680f5430 2022-02-02T14:48:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.246+0000 7fcf5dffb700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 0x7fcf540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.246+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcf64081a00 con 0x7fcf680f5430 2022-02-02T14:48:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.246+0000 7fcf6cad8700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 0x7fcf540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.247+0000 7fcf6cad8700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 0x7fcf540672e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fcf58005010 tx=0x7fcf58016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.250+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf6404fab0 con 0x7fcf680f5430 2022-02-02T14:48:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.436+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf680fdd00 con 0x7fcf54064e20 2022-02-02T14:48:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.450+0000 7fcf5dffb700 1 -- 172.21.15.33:0/1573860722 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fcf680fdd00 con 0x7fcf54064e20 2022-02-02T14:48:14.450 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:48:14.450 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (73m) 35m ago 74m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:48:14.450 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (66m) 35m ago 74m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:48:14.451 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (66m) 35m ago 73m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:48:14.451 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (73m) 35m ago 74m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:48:14.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (67m) 35m ago 70m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:48:14.451 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (67m) 35m ago 70m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:48:14.452 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (68m) 35m ago 70m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:48:14.452 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (70m) 35m ago 70m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:48:14.452 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (68m) 35m ago 75m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:48:14.452 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (67m) 35m ago 73m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:48:14.453 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (67m) 35m ago 75m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:48:14.453 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (67m) 35m ago 73m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:48:14.453 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (74m) 35m ago 74m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:48:14.453 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (73m) 35m ago 73m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:48:14.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 35m ago 73m - 4096M 2022-02-02T14:48:14.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (72m) 35m ago 72m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:48:14.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (72m) 35m ago 72m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:48:14.454 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (72m) 35m ago 72m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:48:14.455 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (72m) 35m ago 72m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:48:14.455 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (71m) 35m ago 71m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:48:14.456 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (73m) 35m ago 74m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:48:14.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 msgr2=0x7fcf540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 0x7fcf540672e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fcf58005010 tx=0x7fcf58016040).stop 2022-02-02T14:48:14.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 msgr2=0x7fcf681099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7fcf6400e7c0 tx=0x7fcf6400b040).stop 2022-02-02T14:48:14.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 shutdown_connections 2022-02-02T14:48:14.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf54064e20 0x7fcf540672e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf680f5430 0x7fcf681099d0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 --2- 172.21.15.33:0/1573860722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf680f66d0 0x7fcf6810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 >> 172.21.15.33:0/1573860722 conn(0x7fcf680f0b90 msgr2=0x7fcf680fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 shutdown_connections 2022-02-02T14:48:14.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.453+0000 7fcf6e2db700 1 -- 172.21.15.33:0/1573860722 wait complete. 2022-02-02T14:48:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 -- 172.21.15.33:0/1688216794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f6860 msgr2=0x7f37600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1688216794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f6860 0x7f37600f6cc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 rx=0x7f3754004660 tx=0x7f3754009b30).stop 2022-02-02T14:48:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 -- 172.21.15.33:0/1688216794 shutdown_connections 2022-02-02T14:48:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1688216794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f6860 0x7f37600f6cc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1688216794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f55c0 0x7f37600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 -- 172.21.15.33:0/1688216794 >> 172.21.15.33:0/1688216794 conn(0x7f37600f0d40 msgr2=0x7f37600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 -- 172.21.15.33:0/1688216794 shutdown_connections 2022-02-02T14:48:14.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.553+0000 7f3767c2a700 1 -- 172.21.15.33:0/1688216794 wait complete. 2022-02-02T14:48:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 Processor -- start 2022-02-02T14:48:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 -- start start 2022-02-02T14:48:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f6860 0x7f37600f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600f8100 con 0x7f37600f55c0 2022-02-02T14:48:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f3767c2a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37600f8240 con 0x7f37600f6860 2022-02-02T14:48:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f37659c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f37659c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34598/0 (socket says 172.21.15.33:34598) 2022-02-02T14:48:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f37659c6700 1 -- 172.21.15.33:0/1638183245 learned_addr learned my addr 172.21.15.33:0/1638183245 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.554+0000 7f37651c5700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f6860 0x7f37600f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37659c6700 1 -- 172.21.15.33:0/1638183245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f6860 msgr2=0x7f37600f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37659c6700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f6860 0x7f37600f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37659c6700 1 -- 172.21.15.33:0/1638183245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754005040 con 0x7f37600f55c0 2022-02-02T14:48:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37659c6700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f375c002700 tx=0x7f375c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375c009320 con 0x7f37600f55c0 2022-02-02T14:48:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f375c00f040 con 0x7f37600f55c0 2022-02-02T14:48:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f375c014900 con 0x7f37600f55c0 2022-02-02T14:48:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37600f8520 con 0x7f37600f55c0 2022-02-02T14:48:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.555+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376010efa0 con 0x7f37600f55c0 2022-02-02T14:48:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.556+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3760045ad0 con 0x7f37600f55c0 2022-02-02T14:48:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.556+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f375c009480 con 0x7f37600f55c0 2022-02-02T14:48:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.557+0000 7f37527fc700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 0x7f374c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.557+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f375c081c30 con 0x7f37600f55c0 2022-02-02T14:48:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.557+0000 7f37651c5700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 0x7f374c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.557+0000 7f37651c5700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 0x7f374c067270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f3754004e30 tx=0x7f3754009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.561+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f375c04fda0 con 0x7f37600f55c0 2022-02-02T14:48:14.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.806+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f376010f720 con 0x7f37600f55c0 2022-02-02T14:48:14.807 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:14 smithi033 ceph-mon[101165]: pgmap v2085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:14.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.807+0000 7f37527fc700 1 -- 172.21.15.33:0/1638183245 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f375c0533c0 con 0x7f37600f55c0 2022-02-02T14:48:14.808 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:48:14.808 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:48:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:48:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:14.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:48:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:48:14.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:14.811 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:48:14.811 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:48:14.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:14.812 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:48:14.812 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:48:14.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:14.813 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:48:14.813 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:48:14.814 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:48:14.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:48:14.814 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:48:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.809+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 msgr2=0x7f374c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.809+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 0x7f374c067270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f3754004e30 tx=0x7f3754009b30).stop 2022-02-02T14:48:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.809+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 msgr2=0x7f37600f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.809+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f375c002700 tx=0x7f375c009d80).stop 2022-02-02T14:48:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 shutdown_connections 2022-02-02T14:48:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f374c064db0 0x7f374c067270 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37600f55c0 0x7f37600f9720 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 --2- 172.21.15.33:0/1638183245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37600f6860 0x7f37600f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 >> 172.21.15.33:0/1638183245 conn(0x7f37600f0d40 msgr2=0x7f376005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 shutdown_connections 2022-02-02T14:48:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.810+0000 7f3767c2a700 1 -- 172.21.15.33:0/1638183245 wait complete. 2022-02-02T14:48:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 -- 172.21.15.33:0/1042831189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f6860 msgr2=0x7f3d6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 --2- 172.21.15.33:0/1042831189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c0f6cc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f3d60004660 tx=0x7f3d60009b30).stop 2022-02-02T14:48:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 -- 172.21.15.33:0/1042831189 shutdown_connections 2022-02-02T14:48:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 --2- 172.21.15.33:0/1042831189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c0f6cc0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 --2- 172.21.15.33:0/1042831189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 -- 172.21.15.33:0/1042831189 >> 172.21.15.33:0/1042831189 conn(0x7f3d6c0f0d40 msgr2=0x7f3d6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 -- 172.21.15.33:0/1042831189 shutdown_connections 2022-02-02T14:48:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.910+0000 7f3d74503700 1 -- 172.21.15.33:0/1042831189 wait complete. 2022-02-02T14:48:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 Processor -- start 2022-02-02T14:48:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 -- start start 2022-02-02T14:48:14.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c0603c0 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.911+0000 7f3d74503700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6c060500 con 0x7f3d6c0f6860 2022-02-02T14:48:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34606/0 (socket says 172.21.15.33:34606) 2022-02-02T14:48:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 -- 172.21.15.33:0/2250914944 learned_addr learned my addr 172.21.15.33:0/2250914944 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:14.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d71a9e700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 -- 172.21.15.33:0/2250914944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f6860 msgr2=0x7f3d6c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 -- 172.21.15.33:0/2250914944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60005040 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d7229f700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f3d6800c530 tx=0x7f3d68007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6800f650 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3d6800fc60 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6c10c720 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d6c10ccb0 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.912+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d68012d20 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.913+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d54004fa0 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.914+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3d68019030 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.914+0000 7f3d5effd700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 0x7f3d58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:14.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.914+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3d680816c0 con 0x7f3d6c0f55c0 2022-02-02T14:48:14.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.914+0000 7f3d71a9e700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 0x7f3d58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:14.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.915+0000 7f3d71a9e700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 0x7f3d58067290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f3d60004e30 tx=0x7f3d60009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:14.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:14.919+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3d6804f880 con 0x7f3d6c0f55c0 2022-02-02T14:48:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:14 smithi037 ceph-mon[69017]: pgmap v2085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:15.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.131+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3d54005e80 con 0x7f3d6c0f55c0 2022-02-02T14:48:15.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.131+0000 7f3d5effd700 1 -- 172.21.15.33:0/2250914944 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f3d68052ea0 con 0x7f3d6c0f55c0 2022-02-02T14:48:15.131 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:48:15.131 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:48:15.132 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:48:15.132 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:48:15.132 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:15.133 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:48:15.133 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:48:15.133 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:48:15.133 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:48:15.134 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:48:15.134 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:48:15.134 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:48:15.134 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:48:15.135 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:48:15.135 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:48:15.135 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:48:15.135 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:48:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:48:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:48:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:48:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:48:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:48:15.137 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:48:15.137 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:48:15.137 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:48:15.137 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:48:15.138 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:48:15.138 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:48:15.138 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:48:15.138 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:48:15.139 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:48:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:15.139 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:48:15.140 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:15.140 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:15.140 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:15.140 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:15.140 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 msgr2=0x7f3d58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 0x7f3d58067290 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f3d60004e30 tx=0x7f3d60009b30).stop 2022-02-02T14:48:15.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 msgr2=0x7f3d6c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7f3d6800c530 tx=0x7f3d68007e10).stop 2022-02-02T14:48:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 shutdown_connections 2022-02-02T14:48:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3d58064dd0 0x7f3d58067290 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d6c0f55c0 0x7f3d6c109c70 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:15.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 --2- 172.21.15.33:0/2250914944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d6c0f6860 0x7f3d6c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 >> 172.21.15.33:0/2250914944 conn(0x7f3d6c0f0d40 msgr2=0x7f3d6c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 shutdown_connections 2022-02-02T14:48:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:15.133+0000 7f3d74503700 1 -- 172.21.15.33:0/2250914944 wait complete. 2022-02-02T14:48:15.144 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:48:15.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:15 smithi033 ceph-mon[101165]: from='client.36212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:15.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:15 smithi033 ceph-mon[101165]: from='client.36216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:15.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1638183245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:48:15.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2250914944' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:48:16.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:15 smithi037 ceph-mon[69017]: from='client.36212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:16.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:15 smithi037 ceph-mon[69017]: from='client.36216 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:16.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1638183245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:48:16.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2250914944' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:48:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:16 smithi033 ceph-mon[101165]: pgmap v2086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:16 smithi037 ceph-mon[69017]: pgmap v2086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:18.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:18 smithi033 ceph-mon[101165]: pgmap v2087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:18 smithi037 ceph-mon[69017]: pgmap v2087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:20 smithi033 ceph-mon[101165]: pgmap v2088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:20 smithi037 ceph-mon[69017]: pgmap v2088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:22 smithi033 ceph-mon[101165]: pgmap v2089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:22 smithi037 ceph-mon[69017]: pgmap v2089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:24.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:24 smithi033 ceph-mon[101165]: pgmap v2090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:24 smithi037 ceph-mon[69017]: pgmap v2090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:26 smithi033 ceph-mon[101165]: pgmap v2091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:26 smithi037 ceph-mon[69017]: pgmap v2091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:28 smithi033 ceph-mon[101165]: pgmap v2092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:28 smithi037 ceph-mon[69017]: pgmap v2092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:30.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:30 smithi033 ceph-mon[101165]: pgmap v2093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:30 smithi037 ceph-mon[69017]: pgmap v2093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:32 smithi033 ceph-mon[101165]: pgmap v2094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:32 smithi037 ceph-mon[69017]: pgmap v2094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:33.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:33 smithi033 ceph-mon[101165]: pgmap v2095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:34.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:33 smithi037 ceph-mon[69017]: pgmap v2095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:36.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:36 smithi033 ceph-mon[101165]: pgmap v2096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:36.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:36 smithi037 ceph-mon[69017]: pgmap v2096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:38.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:38 smithi037 ceph-mon[69017]: pgmap v2097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:38 smithi033 ceph-mon[101165]: pgmap v2097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:40.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:40 smithi037 ceph-mon[69017]: pgmap v2098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:40 smithi033 ceph-mon[101165]: pgmap v2098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:42.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:42 smithi037 ceph-mon[69017]: pgmap v2099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:42.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:42 smithi033 ceph-mon[101165]: pgmap v2099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:44.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:44 smithi037 ceph-mon[69017]: pgmap v2100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:44 smithi033 ceph-mon[101165]: pgmap v2100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 -- 172.21.15.33:0/252620384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f7980 msgr2=0x7f4fa00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 --2- 172.21.15.33:0/252620384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f7980 0x7f4fa00f7de0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f4f9c004660 tx=0x7f4f9c009b30).stop 2022-02-02T14:48:45.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 -- 172.21.15.33:0/252620384 shutdown_connections 2022-02-02T14:48:45.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 --2- 172.21.15.33:0/252620384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f7980 0x7f4fa00f7de0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 --2- 172.21.15.33:0/252620384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f66e0 0x7f4fa00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.248+0000 7f4fa769f700 1 -- 172.21.15.33:0/252620384 >> 172.21.15.33:0/252620384 conn(0x7f4fa00f1e40 msgr2=0x7f4fa00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:45.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.249+0000 7f4fa769f700 1 -- 172.21.15.33:0/252620384 shutdown_connections 2022-02-02T14:48:45.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.249+0000 7f4fa769f700 1 -- 172.21.15.33:0/252620384 wait complete. 2022-02-02T14:48:45.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.249+0000 7f4fa769f700 1 Processor -- start 2022-02-02T14:48:45.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.249+0000 7f4fa769f700 1 -- start start 2022-02-02T14:48:45.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa769f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa769f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 0x7f4fa0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa769f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0107a00 con 0x7f4fa00f66e0 2022-02-02T14:48:45.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa769f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0107b40 con 0x7f4fa00f7980 2022-02-02T14:48:45.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34616/0 (socket says 172.21.15.33:34616) 2022-02-02T14:48:45.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 -- 172.21.15.33:0/143620500 learned_addr learned my addr 172.21.15.33:0/143620500 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:45.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa4c3a700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 0x7f4fa0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 -- 172.21.15.33:0/143620500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 msgr2=0x7f4fa0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 0x7f4fa0107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 -- 172.21.15.33:0/143620500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c005040 con 0x7f4fa00f66e0 2022-02-02T14:48:45.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa4c3a700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 0x7f4fa0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:48:45.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4fa543b700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f4f9000c530 tx=0x7f4f90007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f9000f650 con 0x7f4fa00f66e0 2022-02-02T14:48:45.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.250+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f9000fc60 con 0x7f4fa00f66e0 2022-02-02T14:48:45.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.251+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa01084e0 con 0x7f4fa00f66e0 2022-02-02T14:48:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.251+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f90012d20 con 0x7f4fa00f66e0 2022-02-02T14:48:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.251+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa0108aa0 con 0x7f4fa00f66e0 2022-02-02T14:48:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.252+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa0045ad0 con 0x7f4fa00f66e0 2022-02-02T14:48:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.252+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f90019030 con 0x7f4fa00f66e0 2022-02-02T14:48:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.253+0000 7f4f95ffb700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 0x7f4f8c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.253+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f90081700 con 0x7f4fa00f66e0 2022-02-02T14:48:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.253+0000 7f4fa4c3a700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 0x7f4f8c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.253+0000 7f4fa4c3a700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 0x7f4f8c067270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4f9c004630 tx=0x7f4f9c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.257+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f90053230 con 0x7f4fa00f66e0 2022-02-02T14:48:45.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.454+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fa0108d20 con 0x7f4f8c064db0 2022-02-02T14:48:45.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.455+0000 7f4f95ffb700 1 -- 172.21.15.33:0/143620500 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4fa0108d20 con 0x7f4f8c064db0 2022-02-02T14:48:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 msgr2=0x7f4f8c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 0x7f4f8c067270 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4f9c004630 tx=0x7f4f9c009b30).stop 2022-02-02T14:48:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 msgr2=0x7f4fa0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f4f9000c530 tx=0x7f4f90007e10).stop 2022-02-02T14:48:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 shutdown_connections 2022-02-02T14:48:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f8c064db0 0x7f4f8c067270 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4fa00f66e0 0x7f4fa0106f60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 --2- 172.21.15.33:0/143620500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fa00f7980 0x7f4fa0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 >> 172.21.15.33:0/143620500 conn(0x7f4fa00f1e40 msgr2=0x7f4fa00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 shutdown_connections 2022-02-02T14:48:45.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.457+0000 7f4fa769f700 1 -- 172.21.15.33:0/143620500 wait complete. 2022-02-02T14:48:45.466 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:48:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 -- 172.21.15.33:0/748767670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 msgr2=0x7f70300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 --2- 172.21.15.33:0/748767670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f70300f7de0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7f7018004660 tx=0x7f7018009b30).stop 2022-02-02T14:48:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 -- 172.21.15.33:0/748767670 shutdown_connections 2022-02-02T14:48:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 --2- 172.21.15.33:0/748767670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f70300f7de0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 --2- 172.21.15.33:0/748767670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 0x7f70300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 -- 172.21.15.33:0/748767670 >> 172.21.15.33:0/748767670 conn(0x7f70300f1e40 msgr2=0x7f70300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 -- 172.21.15.33:0/748767670 shutdown_connections 2022-02-02T14:48:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.564+0000 7f7036a12700 1 -- 172.21.15.33:0/748767670 wait complete. 2022-02-02T14:48:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 Processor -- start 2022-02-02T14:48:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 -- start start 2022-02-02T14:48:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 0x7f703006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703006a380 con 0x7f70300f7980 2022-02-02T14:48:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f7036a12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703006a4c0 con 0x7f70300f66e0 2022-02-02T14:48:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34628/0 (socket says 172.21.15.33:34628) 2022-02-02T14:48:45.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f702f7fe700 1 -- 172.21.15.33:0/3734745541 learned_addr learned my addr 172.21.15.33:0/3734745541 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:45.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.565+0000 7f702ffff700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 0x7f703006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702f7fe700 1 -- 172.21.15.33:0/3734745541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 msgr2=0x7f703006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702f7fe700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 0x7f703006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702f7fe700 1 -- 172.21.15.33:0/3734745541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7018005040 con 0x7f70300f7980 2022-02-02T14:48:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702f7fe700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f7018000c00 tx=0x7f701800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7018019070 con 0x7f70300f7980 2022-02-02T14:48:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7018007e70 con 0x7f70300f7980 2022-02-02T14:48:45.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7018014ce0 con 0x7f70300f7980 2022-02-02T14:48:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703006a740 con 0x7f70300f7980 2022-02-02T14:48:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.566+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703006aca0 con 0x7f70300f7980 2022-02-02T14:48:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.567+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7030045ad0 con 0x7f70300f7980 2022-02-02T14:48:45.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.567+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7018025070 con 0x7f70300f7980 2022-02-02T14:48:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.568+0000 7f702cff9700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.568+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7018082a30 con 0x7f70300f7980 2022-02-02T14:48:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.568+0000 7f702ffff700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.568+0000 7f702ffff700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 0x7f701c067290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f703006b730 tx=0x7f702000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.572+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7018050ae0 con 0x7f70300f7980 2022-02-02T14:48:45.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.755+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7030057f10 con 0x7f701c064dd0 2022-02-02T14:48:45.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.770+0000 7f702cff9700 1 -- 172.21.15.33:0/3734745541 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7030057f10 con 0x7f701c064dd0 2022-02-02T14:48:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:48:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (74m) 36m ago 75m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:48:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (67m) 36m ago 75m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:48:45.770 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (67m) 36m ago 74m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:48:45.771 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (73m) 36m ago 74m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:48:45.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (67m) 36m ago 71m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:48:45.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (68m) 36m ago 71m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:48:45.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (68m) 36m ago 71m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:48:45.772 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (71m) 36m ago 71m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:48:45.772 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (68m) 36m ago 76m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:48:45.772 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (68m) 36m ago 74m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:48:45.772 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (68m) 36m ago 76m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:48:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (67m) 36m ago 74m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:48:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (74m) 36m ago 74m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:48:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (74m) 36m ago 74m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:48:45.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 36m ago 73m - 4096M 2022-02-02T14:48:45.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (73m) 36m ago 73m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:48:45.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (73m) 36m ago 73m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:48:45.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (72m) 36m ago 72m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:48:45.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (72m) 36m ago 72m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:48:45.774 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (72m) 36m ago 72m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:48:45.775 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (73m) 36m ago 74m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:48:45.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 msgr2=0x7f701c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 0x7f701c067290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f703006b730 tx=0x7f702000b040).stop 2022-02-02T14:48:45.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 msgr2=0x7f7030069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7f7018000c00 tx=0x7f701800b040).stop 2022-02-02T14:48:45.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 shutdown_connections 2022-02-02T14:48:45.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f701c064dd0 0x7f701c067290 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70300f66e0 0x7f703006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 --2- 172.21.15.33:0/3734745541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70300f7980 0x7f7030069e20 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 >> 172.21.15.33:0/3734745541 conn(0x7f70300f1e40 msgr2=0x7f70300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 shutdown_connections 2022-02-02T14:48:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.772+0000 7f7036a12700 1 -- 172.21.15.33:0/3734745541 wait complete. 2022-02-02T14:48:45.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 -- 172.21.15.33:0/859555096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 msgr2=0x7fcfa40f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 --2- 172.21.15.33:0/859555096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f9300 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fcf9c0099e0 tx=0x7fcf9c004d10).stop 2022-02-02T14:48:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 -- 172.21.15.33:0/859555096 shutdown_connections 2022-02-02T14:48:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 --2- 172.21.15.33:0/859555096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfa40f9880 0x7fcfa40fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 --2- 172.21.15.33:0/859555096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f9300 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 -- 172.21.15.33:0/859555096 >> 172.21.15.33:0/859555096 conn(0x7fcfa40f0d40 msgr2=0x7fcfa40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 -- 172.21.15.33:0/859555096 shutdown_connections 2022-02-02T14:48:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.872+0000 7fcfab077700 1 -- 172.21.15.33:0/859555096 wait complete. 2022-02-02T14:48:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 Processor -- start 2022-02-02T14:48:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 -- start start 2022-02-02T14:48:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfa40f9880 0x7fcfa40f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40f5760 con 0x7fcfa40602b0 2022-02-02T14:48:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfab077700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40f58a0 con 0x7fcfa40f9880 2022-02-02T14:48:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfa8e13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfa8e13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34636/0 (socket says 172.21.15.33:34636) 2022-02-02T14:48:45.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.873+0000 7fcfa8e13700 1 -- 172.21.15.33:0/3177064847 learned_addr learned my addr 172.21.15.33:0/3177064847 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:45.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa8e13700 1 -- 172.21.15.33:0/3177064847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfa40f9880 msgr2=0x7fcfa40f5200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T14:48:45.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa8e13700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfa40f9880 0x7fcfa40f5200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:48:45.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa8e13700 1 -- 172.21.15.33:0/3177064847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c009640 con 0x7fcfa40602b0 2022-02-02T14:48:45.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa8e13700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fcf9c003380 tx=0x7fcf9c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c00e070 con 0x7fcfa40602b0 2022-02-02T14:48:45.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa40f5b20 con 0x7fcfa40602b0 2022-02-02T14:48:45.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf9c007dc0 con 0x7fcfa40602b0 2022-02-02T14:48:45.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9c018070 con 0x7fcfa40602b0 2022-02-02T14:48:45.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.874+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa40f6080 con 0x7fcfa40602b0 2022-02-02T14:48:45.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.875+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa4045ad0 con 0x7fcfa40602b0 2022-02-02T14:48:45.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.876+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf9c0139d0 con 0x7fcfa40602b0 2022-02-02T14:48:45.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.877+0000 7fcfa17fa700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:45.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.877+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcf9c0833e0 con 0x7fcfa40602b0 2022-02-02T14:48:45.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.877+0000 7fcfa3fff700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:45.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.877+0000 7fcfa3fff700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 0x7fcf8c067290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fcfa4060080 tx=0x7fcf9800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:45.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:45.880+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf9c051550 con 0x7fcfa40602b0 2022-02-02T14:48:46.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.126+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcfa4027a00 con 0x7fcfa40602b0 2022-02-02T14:48:46.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.127+0000 7fcfa17fa700 1 -- 172.21.15.33:0/3177064847 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fcf9c054b70 con 0x7fcfa40602b0 2022-02-02T14:48:46.127 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:48:46.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:48:46.128 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:48:46.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:46.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:48:46.129 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:48:46.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:46.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:48:46.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:48:46.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:46.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:48:46.131 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:48:46.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:48:46.132 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:48:46.132 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:48:46.133 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:48:46.133 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:48:46.134 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:48:46.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 msgr2=0x7fcf8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 0x7fcf8c067290 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fcfa4060080 tx=0x7fcf9800b040).stop 2022-02-02T14:48:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 msgr2=0x7fcfa40f6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fcf9c003380 tx=0x7fcf9c004d10).stop 2022-02-02T14:48:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 shutdown_connections 2022-02-02T14:48:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf8c064dd0 0x7fcf8c067290 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcfa40602b0 0x7fcfa40f6d80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 --2- 172.21.15.33:0/3177064847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfa40f9880 0x7fcfa40f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:48:46.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 >> 172.21.15.33:0/3177064847 conn(0x7fcfa40f0d40 msgr2=0x7fcfa40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:46.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 shutdown_connections 2022-02-02T14:48:46.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.129+0000 7fcfab077700 1 -- 172.21.15.33:0/3177064847 wait complete. 2022-02-02T14:48:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.229+0000 7f6478c5b700 1 -- 172.21.15.33:0/3621255056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f7980 msgr2=0x7f64740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.229+0000 7f6478c5b700 1 --2- 172.21.15.33:0/3621255056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f7980 0x7f64740f7de0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f6468004660 tx=0x7f6468009b30).stop 2022-02-02T14:48:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 -- 172.21.15.33:0/3621255056 shutdown_connections 2022-02-02T14:48:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 --2- 172.21.15.33:0/3621255056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f7980 0x7f64740f7de0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 --2- 172.21.15.33:0/3621255056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f66e0 0x7f64740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 -- 172.21.15.33:0/3621255056 >> 172.21.15.33:0/3621255056 conn(0x7f64740f1e40 msgr2=0x7f64740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 -- 172.21.15.33:0/3621255056 shutdown_connections 2022-02-02T14:48:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 -- 172.21.15.33:0/3621255056 wait complete. 2022-02-02T14:48:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 Processor -- start 2022-02-02T14:48:46.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.230+0000 7f6478c5b700 1 -- start start 2022-02-02T14:48:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6478c5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6478c5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f7980 0x7f6474069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6478c5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647406a380 con 0x7f64740f66e0 2022-02-02T14:48:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6478c5b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647406a4c0 con 0x7f64740f7980 2022-02-02T14:48:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34646/0 (socket says 172.21.15.33:34646) 2022-02-02T14:48:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 -- 172.21.15.33:0/680434072 learned_addr learned my addr 172.21.15.33:0/680434072 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:48:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6471d9b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f7980 0x7f6474069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 -- 172.21.15.33:0/680434072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f7980 msgr2=0x7f6474069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f7980 0x7f6474069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 -- 172.21.15.33:0/680434072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468005040 con 0x7f64740f66e0 2022-02-02T14:48:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f647259c700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f646400c790 tx=0x7f6464007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6464013630 con 0x7f64740f66e0 2022-02-02T14:48:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6464012860 con 0x7f64740f66e0 2022-02-02T14:48:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.231+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647406a7a0 con 0x7f64740f66e0 2022-02-02T14:48:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.232+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6464002780 con 0x7f64740f66e0 2022-02-02T14:48:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.232+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647410ef90 con 0x7f64740f66e0 2022-02-02T14:48:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.233+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6474045ad0 con 0x7f64740f66e0 2022-02-02T14:48:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.233+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6464010070 con 0x7f64740f66e0 2022-02-02T14:48:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.233+0000 7f6462ffd700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 0x7f645c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:48:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.233+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6464081ab0 con 0x7f64740f66e0 2022-02-02T14:48:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.233+0000 7f6471d9b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 0x7f645c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:48:46.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.234+0000 7f6471d9b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 0x7f645c067290 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6468004630 tx=0x7f6468009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:48:46.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.238+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f646404fb00 con 0x7f64740f66e0 2022-02-02T14:48:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.453+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f64740008d0 con 0x7f64740f66e0 2022-02-02T14:48:46.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.454+0000 7f6462ffd700 1 -- 172.21.15.33:0/680434072 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6464053120 con 0x7f64740f66e0 2022-02-02T14:48:46.454 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:48:46.454 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:48:46.454 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:48:46.454 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:48:46.455 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:46.455 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:48:46.455 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:48:46.455 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:48:46.456 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:48:46.456 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:48:46.456 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:48:46.456 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:48:46.456 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:48:46.457 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:48:46.457 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:48:46.457 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:48:46.457 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:48:46.458 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:48:46.458 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:48:46.458 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:48:46.458 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:48:46.458 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:48:46.459 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:48:46.459 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:48:46.459 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:48:46.459 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:48:46.460 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:48:46.460 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:48:46.460 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:48:46.460 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:48:46.460 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:48:46.461 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:46.461 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:46.461 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:48:46.461 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:48:46.461 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:46.462 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:46.462 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:46.462 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:48:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 msgr2=0x7f645c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 0x7f645c067290 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6468004630 tx=0x7f6468009b30).stop 2022-02-02T14:48:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 msgr2=0x7f647406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:48:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f646400c790 tx=0x7f6464007d90).stop 2022-02-02T14:48:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 shutdown_connections 2022-02-02T14:48:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f645c064dd0 0x7f645c067290 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64740f66e0 0x7f647406b9a0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 --2- 172.21.15.33:0/680434072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740f7980 0x7f6474069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:48:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 >> 172.21.15.33:0/680434072 conn(0x7f64740f1e40 msgr2=0x7f64740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:48:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 shutdown_connections 2022-02-02T14:48:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:48:46.456+0000 7f6478c5b700 1 -- 172.21.15.33:0/680434072 wait complete. 2022-02-02T14:48:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:48:46.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:46 smithi033 ceph-mon[101165]: pgmap v2101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:46 smithi033 ceph-mon[101165]: from='client.36228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3177064847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:48:46.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/680434072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:48:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:46 smithi037 ceph-mon[69017]: pgmap v2101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:46 smithi037 ceph-mon[69017]: from='client.36228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:46.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3177064847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:48:46.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/680434072' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:48:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:47 smithi037 ceph-mon[69017]: from='client.36232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:47.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:47 smithi033 ceph-mon[101165]: from='client.36232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:48:48.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:48 smithi037 ceph-mon[69017]: pgmap v2102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:48 smithi033 ceph-mon[101165]: pgmap v2102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:50 smithi037 ceph-mon[69017]: pgmap v2103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:50 smithi033 ceph-mon[101165]: pgmap v2103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:52.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:52 smithi037 ceph-mon[69017]: pgmap v2104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:52 smithi033 ceph-mon[101165]: pgmap v2104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:54 smithi037 ceph-mon[69017]: pgmap v2105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:48:54.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:48:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:54 smithi033 ceph-mon[101165]: pgmap v2105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:48:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:48:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:56 smithi033 ceph-mon[101165]: pgmap v2106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:56 smithi037 ceph-mon[69017]: pgmap v2106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:48:58 smithi033 ceph-mon[101165]: pgmap v2107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:48:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:48:58 smithi037 ceph-mon[69017]: pgmap v2107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:00 smithi033 ceph-mon[101165]: pgmap v2108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:00 smithi037 ceph-mon[69017]: pgmap v2108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:02 smithi033 ceph-mon[101165]: pgmap v2109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:02 smithi037 ceph-mon[69017]: pgmap v2109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:04 smithi033 ceph-mon[101165]: pgmap v2110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:04 smithi037 ceph-mon[69017]: pgmap v2110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:06.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:06 smithi033 ceph-mon[101165]: pgmap v2111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:06 smithi037 ceph-mon[69017]: pgmap v2111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:08 smithi033 ceph-mon[101165]: pgmap v2112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:08 smithi037 ceph-mon[69017]: pgmap v2112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:10 smithi033 ceph-mon[101165]: pgmap v2113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:10 smithi037 ceph-mon[69017]: pgmap v2113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:12 smithi033 ceph-mon[101165]: pgmap v2114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:12 smithi037 ceph-mon[69017]: pgmap v2114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:14 smithi033 ceph-mon[101165]: pgmap v2115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:14 smithi037 ceph-mon[69017]: pgmap v2115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:16.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.572+0000 7fa734fdd700 1 -- 172.21.15.33:0/3011505671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f7980 msgr2=0x7fa7300f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.572+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3011505671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f7980 0x7fa7300f7de0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 rx=0x7fa718004660 tx=0x7fa718009b30).stop 2022-02-02T14:49:16.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.572+0000 7fa734fdd700 1 -- 172.21.15.33:0/3011505671 shutdown_connections 2022-02-02T14:49:16.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.572+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3011505671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f7980 0x7fa7300f7de0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.572+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3011505671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f66e0 0x7fa7300f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.573+0000 7fa734fdd700 1 -- 172.21.15.33:0/3011505671 >> 172.21.15.33:0/3011505671 conn(0x7fa7300f1e40 msgr2=0x7fa7300f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:16.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.573+0000 7fa734fdd700 1 -- 172.21.15.33:0/3011505671 shutdown_connections 2022-02-02T14:49:16.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.573+0000 7fa734fdd700 1 -- 172.21.15.33:0/3011505671 wait complete. 2022-02-02T14:49:16.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.573+0000 7fa734fdd700 1 Processor -- start 2022-02-02T14:49:16.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.573+0000 7fa734fdd700 1 -- start start 2022-02-02T14:49:16.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa734fdd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa734fdd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f7980 0x7fa730107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa734fdd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7301079b0 con 0x7fa7300f66e0 2022-02-02T14:49:16.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa734fdd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa730107af0 con 0x7fa7300f7980 2022-02-02T14:49:16.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34656/0 (socket says 172.21.15.33:34656) 2022-02-02T14:49:16.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 -- 172.21.15.33:0/3781419928 learned_addr learned my addr 172.21.15.33:0/3781419928 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:16.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f7980 0x7fa730107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 -- 172.21.15.33:0/3781419928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f7980 msgr2=0x7fa730107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f7980 0x7fa730107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 -- 172.21.15.33:0/3781419928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718005040 con 0x7fa7300f66e0 2022-02-02T14:49:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.574+0000 7fa72e59c700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa72000e7c0 tx=0x7fa72000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.575+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7200092e0 con 0x7fa7300f66e0 2022-02-02T14:49:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.575+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa72000f040 con 0x7fa7300f66e0 2022-02-02T14:49:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.575+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa730108490 con 0x7fa7300f66e0 2022-02-02T14:49:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.575+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7200147e0 con 0x7fa7300f66e0 2022-02-02T14:49:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.575+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa730108a50 con 0x7fa7300f66e0 2022-02-02T14:49:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.576+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa730045ad0 con 0x7fa7300f66e0 2022-02-02T14:49:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.576+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa72001b030 con 0x7fa7300f66e0 2022-02-02T14:49:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.577+0000 7fa726ffd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.577+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa720081a30 con 0x7fa7300f66e0 2022-02-02T14:49:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.577+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.577+0000 7fa72dd9b700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa718005010 tx=0x7fa718016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.581+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa720053510 con 0x7fa7300f66e0 2022-02-02T14:49:16.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.770+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7300008d0 con 0x7fa71c064dd0 2022-02-02T14:49:16.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.772+0000 7fa726ffd700 1 -- 172.21.15.33:0/3781419928 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa7300008d0 con 0x7fa71c064dd0 2022-02-02T14:49:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 msgr2=0x7fa71c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fa718005010 tx=0x7fa718016040).stop 2022-02-02T14:49:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 msgr2=0x7fa730106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7fa72000e7c0 tx=0x7fa72000b040).stop 2022-02-02T14:49:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 shutdown_connections 2022-02-02T14:49:16.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa71c064dd0 0x7fa71c067290 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7300f66e0 0x7fa730106f10 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 --2- 172.21.15.33:0/3781419928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7300f7980 0x7fa730107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 >> 172.21.15.33:0/3781419928 conn(0x7fa7300f1e40 msgr2=0x7fa7300fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:16.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 shutdown_connections 2022-02-02T14:49:16.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.774+0000 7fa734fdd700 1 -- 172.21.15.33:0/3781419928 wait complete. 2022-02-02T14:49:16.783 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:49:16.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 -- 172.21.15.33:0/1867176653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f5460 msgr2=0x7f11d40f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 --2- 172.21.15.33:0/1867176653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f5460 0x7f11d40f5880 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7f11c4004660 tx=0x7f11c4009b30).stop 2022-02-02T14:49:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 -- 172.21.15.33:0/1867176653 shutdown_connections 2022-02-02T14:49:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 --2- 172.21.15.33:0/1867176653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f6700 0x7f11d40f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 --2- 172.21.15.33:0/1867176653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f5460 0x7f11d40f5880 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.874+0000 7f11d952e700 1 -- 172.21.15.33:0/1867176653 >> 172.21.15.33:0/1867176653 conn(0x7f11d40f0bc0 msgr2=0x7f11d40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:16.876 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:16 smithi033 ceph-mon[101165]: pgmap v2116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:16.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.875+0000 7f11d952e700 1 -- 172.21.15.33:0/1867176653 shutdown_connections 2022-02-02T14:49:16.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.875+0000 7f11d952e700 1 -- 172.21.15.33:0/1867176653 wait complete. 2022-02-02T14:49:16.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.875+0000 7f11d952e700 1 Processor -- start 2022-02-02T14:49:16.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.875+0000 7f11d952e700 1 -- start start 2022-02-02T14:49:16.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d952e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f5460 0x7f11d4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d952e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d952e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d40603c0 con 0x7f11d40f6700 2022-02-02T14:49:16.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d952e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d4060500 con 0x7f11d40f5460 2022-02-02T14:49:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34666/0 (socket says 172.21.15.33:34666) 2022-02-02T14:49:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 -- 172.21.15.33:0/2043280924 learned_addr learned my addr 172.21.15.33:0/2043280924 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d2ffd700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f5460 0x7f11d4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 -- 172.21.15.33:0/2043280924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f5460 msgr2=0x7f11d4109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:16.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f5460 0x7f11d4109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:16.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 -- 172.21.15.33:0/2043280924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4005040 con 0x7f11d40f6700 2022-02-02T14:49:16.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.876+0000 7f11d27fc700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f11c80026d0 tx=0x7f11c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:16.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.877+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c80079c0 con 0x7f11d40f6700 2022-02-02T14:49:16.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.877+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d410c560 con 0x7f11d40f6700 2022-02-02T14:49:16.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.877+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d410caf0 con 0x7f11d40f6700 2022-02-02T14:49:16.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.877+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f11c800f040 con 0x7f11d40f6700 2022-02-02T14:49:16.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.877+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11c80148b0 con 0x7f11d40f6700 2022-02-02T14:49:16.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.878+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b4004fa0 con 0x7f11d40f6700 2022-02-02T14:49:16.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.878+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f11c8014a10 con 0x7f11d40f6700 2022-02-02T14:49:16.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.879+0000 7f11bb7fe700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 0x7f11bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:16.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.879+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f11c80817f0 con 0x7f11d40f6700 2022-02-02T14:49:16.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.879+0000 7f11d2ffd700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 0x7f11bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:16.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.879+0000 7f11d2ffd700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 0x7f11bc0672e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f11c4013690 tx=0x7f11c4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:16.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:16.883+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f11c804f8a0 con 0x7f11d40f6700 2022-02-02T14:49:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:16 smithi037 ceph-mon[69017]: pgmap v2116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.066+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f11b4000bc0 con 0x7f11bc064e20 2022-02-02T14:49:17.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.080+0000 7f11bb7fe700 1 -- 172.21.15.33:0/2043280924 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f11b4000bc0 con 0x7f11bc064e20 2022-02-02T14:49:17.080 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:49:17.080 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (74m) 36m ago 75m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:49:17.080 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (67m) 36m ago 75m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:49:17.081 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (67m) 36m ago 75m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:49:17.081 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (74m) 36m ago 75m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:49:17.081 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (68m) 36m ago 71m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:49:17.081 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (68m) 36m ago 71m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:49:17.082 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (69m) 36m ago 71m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:49:17.082 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (71m) 36m ago 71m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:49:17.082 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (69m) 36m ago 76m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:49:17.082 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (68m) 36m ago 75m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:49:17.083 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (68m) 36m ago 76m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:49:17.083 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (68m) 36m ago 74m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:49:17.083 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (75m) 36m ago 75m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:49:17.083 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (74m) 36m ago 74m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:49:17.083 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 36m ago 74m - 4096M 2022-02-02T14:49:17.084 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (73m) 36m ago 73m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:49:17.084 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (73m) 36m ago 73m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:49:17.084 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (73m) 36m ago 73m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:49:17.084 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (73m) 36m ago 73m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:49:17.085 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (72m) 36m ago 72m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:49:17.085 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (74m) 36m ago 75m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:49:17.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 msgr2=0x7f11bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 0x7f11bc0672e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f11c4013690 tx=0x7f11c4009b30).stop 2022-02-02T14:49:17.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 msgr2=0x7f11d410bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f11c80026d0 tx=0x7f11c8009de0).stop 2022-02-02T14:49:17.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 shutdown_connections 2022-02-02T14:49:17.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f11bc064e20 0x7f11bc0672e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11d40f5460 0x7f11d4109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 --2- 172.21.15.33:0/2043280924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11d40f6700 0x7f11d410bfb0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 >> 172.21.15.33:0/2043280924 conn(0x7f11d40f0bc0 msgr2=0x7f11d40fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:17.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 shutdown_connections 2022-02-02T14:49:17.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.082+0000 7f11d952e700 1 -- 172.21.15.33:0/2043280924 wait complete. 2022-02-02T14:49:17.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 -- 172.21.15.33:0/4187598142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006a3b0 msgr2=0x7fe44006a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 --2- 172.21.15.33:0/4187598142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006a3b0 0x7fe44006a830 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fe434004660 tx=0x7fe434009b30).stop 2022-02-02T14:49:17.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 -- 172.21.15.33:0/4187598142 shutdown_connections 2022-02-02T14:49:17.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 --2- 172.21.15.33:0/4187598142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006a3b0 0x7fe44006a830 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 --2- 172.21.15.33:0/4187598142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006b9c0 0x7fe440069ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 -- 172.21.15.33:0/4187598142 >> 172.21.15.33:0/4187598142 conn(0x7fe4400f1e40 msgr2=0x7fe4400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:17.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 -- 172.21.15.33:0/4187598142 shutdown_connections 2022-02-02T14:49:17.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.182+0000 7fe447f36700 1 -- 172.21.15.33:0/4187598142 wait complete. 2022-02-02T14:49:17.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 Processor -- start 2022-02-02T14:49:17.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 -- start start 2022-02-02T14:49:17.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 0x7fe44010d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 0x7fe44010d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44010df50 con 0x7fe44006b9c0 2022-02-02T14:49:17.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe447f36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44010e090 con 0x7fe44006a3b0 2022-02-02T14:49:17.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe4454d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 0x7fe44010d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe445cd2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 0x7fe44010d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe4454d1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 0x7fe44010d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34676/0 (socket says 172.21.15.33:34676) 2022-02-02T14:49:17.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.183+0000 7fe4454d1700 1 -- 172.21.15.33:0/567773049 learned_addr learned my addr 172.21.15.33:0/567773049 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:17.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe445cd2700 1 -- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 msgr2=0x7fe44010d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe445cd2700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 0x7fe44010d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe445cd2700 1 -- 172.21.15.33:0/567773049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434005040 con 0x7fe44006a3b0 2022-02-02T14:49:17.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe445cd2700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 0x7fe44010d4b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe430002700 tx=0x7fe430009d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:17.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4300079c0 con 0x7fe44006a3b0 2022-02-02T14:49:17.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44010ea30 con 0x7fe44006a3b0 2022-02-02T14:49:17.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44010eff0 con 0x7fe44006a3b0 2022-02-02T14:49:17.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe43000f040 con 0x7fe44006a3b0 2022-02-02T14:49:17.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.184+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4300147c0 con 0x7fe44006a3b0 2022-02-02T14:49:17.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.185+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe420004fa0 con 0x7fe44006a3b0 2022-02-02T14:49:17.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.186+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe43001b060 con 0x7fe44006a3b0 2022-02-02T14:49:17.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.186+0000 7fe43e7fc700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 0x7fe428067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.186+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe4300817a0 con 0x7fe44006a3b0 2022-02-02T14:49:17.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.186+0000 7fe4454d1700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 0x7fe428067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.187+0000 7fe4454d1700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 0x7fe428067290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fe434013690 tx=0x7fe434009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:17.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.191+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe430053280 con 0x7fe44006a3b0 2022-02-02T14:49:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.434+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe420005e80 con 0x7fe44006a3b0 2022-02-02T14:49:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.435+0000 7fe43e7fc700 1 -- 172.21.15.33:0/567773049 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe430052e70 con 0x7fe44006a3b0 2022-02-02T14:49:17.435 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:49:17.435 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:49:17.435 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:49:17.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:17.436 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:49:17.436 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:49:17.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:17.436 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:49:17.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:49:17.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:17.437 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:49:17.437 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:49:17.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:17.438 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:49:17.438 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:49:17.438 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:49:17.438 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:49:17.439 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:49:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 msgr2=0x7fe428067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 0x7fe428067290 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fe434013690 tx=0x7fe434009b30).stop 2022-02-02T14:49:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 msgr2=0x7fe44010d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 0x7fe44010d4b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fe430002700 tx=0x7fe430009d40).stop 2022-02-02T14:49:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 shutdown_connections 2022-02-02T14:49:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe428064dd0 0x7fe428067290 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe44006a3b0 0x7fe44010d4b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 --2- 172.21.15.33:0/567773049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe44006b9c0 0x7fe44010d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 >> 172.21.15.33:0/567773049 conn(0x7fe4400f1e40 msgr2=0x7fe4400f88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 shutdown_connections 2022-02-02T14:49:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.437+0000 7fe447f36700 1 -- 172.21.15.33:0/567773049 wait complete. 2022-02-02T14:49:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.537+0000 7f926e956700 1 -- 172.21.15.33:0/2958638995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 msgr2=0x7f92680f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.537+0000 7f926e956700 1 --2- 172.21.15.33:0/2958638995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f92680f6b40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 rx=0x7f9258004660 tx=0x7f9258009b30).stop 2022-02-02T14:49:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- 172.21.15.33:0/2958638995 shutdown_connections 2022-02-02T14:49:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 --2- 172.21.15.33:0/2958638995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f92680f6b40 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 --2- 172.21.15.33:0/2958638995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 0x7f92680f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- 172.21.15.33:0/2958638995 >> 172.21.15.33:0/2958638995 conn(0x7f92680f0ba0 msgr2=0x7f92680f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- 172.21.15.33:0/2958638995 shutdown_connections 2022-02-02T14:49:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- 172.21.15.33:0/2958638995 wait complete. 2022-02-02T14:49:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 Processor -- start 2022-02-02T14:49:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- start start 2022-02-02T14:49:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 0x7f926810beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680602b0 con 0x7f92680f66e0 2022-02-02T14:49:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.538+0000 7f926e956700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680603f0 con 0x7f92680f5440 2022-02-02T14:49:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34686/0 (socket says 172.21.15.33:34686) 2022-02-02T14:49:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 -- 172.21.15.33:0/3836537620 learned_addr learned my addr 172.21.15.33:0/3836537620 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d954700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 0x7f926810beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 -- 172.21.15.33:0/3836537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 msgr2=0x7f926810beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 0x7f926810beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 -- 172.21.15.33:0/3836537620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258005040 con 0x7f92680f66e0 2022-02-02T14:49:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926d153700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f9258009830 tx=0x7f9258009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9258018070 con 0x7f92680f66e0 2022-02-02T14:49:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926810e8a0 con 0x7f92680f66e0 2022-02-02T14:49:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9258007ba0 con 0x7f92680f66e0 2022-02-02T14:49:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f925801c620 con 0x7f92680f66e0 2022-02-02T14:49:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.539+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926810ec70 con 0x7f92680f66e0 2022-02-02T14:49:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.540+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9268059100 con 0x7f92680f66e0 2022-02-02T14:49:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.541+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9258007d10 con 0x7f92680f66e0 2022-02-02T14:49:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.541+0000 7f925e7fc700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 0x7f92540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.541+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f92580837e0 con 0x7f92680f66e0 2022-02-02T14:49:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.541+0000 7f926d954700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 0x7f92540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.542+0000 7f926d954700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 0x7f92540672e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9268060040 tx=0x7f9264009c40).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.546+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9258051950 con 0x7f92680f66e0 2022-02-02T14:49:17.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/567773049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:49:17.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.758+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92680fdc20 con 0x7f92680f66e0 2022-02-02T14:49:17.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.758+0000 7f925e7fc700 1 -- 172.21.15.33:0/3836537620 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f9258054f70 con 0x7f92680f66e0 2022-02-02T14:49:17.758 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:49:17.758 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:49:17.758 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:49:17.759 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:49:17.759 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:17.759 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:49:17.759 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:49:17.759 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:49:17.760 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:49:17.760 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:49:17.760 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:49:17.760 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:49:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:49:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:49:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:49:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:49:17.761 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:49:17.762 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:49:17.762 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:49:17.762 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:49:17.762 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:49:17.762 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:49:17.763 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:49:17.763 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:49:17.763 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:49:17.763 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:49:17.764 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:49:17.764 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:49:17.764 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:49:17.765 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:49:17.765 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:49:17.765 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:17.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:17.766 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:49:17.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:17.766 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:17.767 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:17.767 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:17.767 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:17.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 msgr2=0x7f92540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 0x7f92540672e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f9268060040 tx=0x7f9264009c40).stop 2022-02-02T14:49:17.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 msgr2=0x7f926810e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:17.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f9258009830 tx=0x7f9258009b30).stop 2022-02-02T14:49:17.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 shutdown_connections 2022-02-02T14:49:17.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9254064e20 0x7f92540672e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92680f5440 0x7f926810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 --2- 172.21.15.33:0/3836537620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92680f66e0 0x7f926810e3b0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:17.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 >> 172.21.15.33:0/3836537620 conn(0x7f92680f0ba0 msgr2=0x7f92680fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:17.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 shutdown_connections 2022-02-02T14:49:17.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:17.760+0000 7f926e956700 1 -- 172.21.15.33:0/3836537620 wait complete. 2022-02-02T14:49:17.771 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:49:17.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/567773049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:49:18.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:18 smithi033 ceph-mon[101165]: from='client.36244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:18.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:18 smithi033 ceph-mon[101165]: from='client.36248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:18.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:18 smithi033 ceph-mon[101165]: pgmap v2117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:18.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3836537620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:49:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:18 smithi037 ceph-mon[69017]: from='client.36244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:18 smithi037 ceph-mon[69017]: from='client.36248 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:18 smithi037 ceph-mon[69017]: pgmap v2117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3836537620' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:49:19.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:19 smithi033 ceph-mon[101165]: pgmap v2118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:20.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:19 smithi037 ceph-mon[69017]: pgmap v2118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:22.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:22 smithi037 ceph-mon[69017]: pgmap v2119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:22 smithi033 ceph-mon[101165]: pgmap v2119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:24.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:24 smithi037 ceph-mon[69017]: pgmap v2120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:24 smithi033 ceph-mon[101165]: pgmap v2120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:26.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:26 smithi037 ceph-mon[69017]: pgmap v2121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:26 smithi033 ceph-mon[101165]: pgmap v2121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:28.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:28 smithi037 ceph-mon[69017]: pgmap v2122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:28 smithi033 ceph-mon[101165]: pgmap v2122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:30 smithi037 ceph-mon[69017]: pgmap v2123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:30 smithi033 ceph-mon[101165]: pgmap v2123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:32 smithi033 ceph-mon[101165]: pgmap v2124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:32 smithi037 ceph-mon[69017]: pgmap v2124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:34.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:34 smithi033 ceph-mon[101165]: pgmap v2125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:34 smithi037 ceph-mon[69017]: pgmap v2125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:36 smithi033 ceph-mon[101165]: pgmap v2126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:36 smithi037 ceph-mon[69017]: pgmap v2126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:38 smithi033 ceph-mon[101165]: pgmap v2127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:38 smithi037 ceph-mon[69017]: pgmap v2127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:40 smithi033 ceph-mon[101165]: pgmap v2128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:40 smithi037 ceph-mon[69017]: pgmap v2128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:42 smithi033 ceph-mon[101165]: pgmap v2129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:42 smithi037 ceph-mon[69017]: pgmap v2129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:44 smithi033 ceph-mon[101165]: pgmap v2130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:44 smithi037 ceph-mon[69017]: pgmap v2130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:46 smithi033 ceph-mon[101165]: pgmap v2131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:46 smithi037 ceph-mon[69017]: pgmap v2131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:47.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 -- 172.21.15.33:0/751567642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 msgr2=0x7ff0740f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:47.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/751567642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff0740f6cc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7ff070004660 tx=0x7ff070009b30).stop 2022-02-02T14:49:47.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 -- 172.21.15.33:0/751567642 shutdown_connections 2022-02-02T14:49:47.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/751567642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff0740f6cc0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:47.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/751567642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 0x7ff0740f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:47.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 -- 172.21.15.33:0/751567642 >> 172.21.15.33:0/751567642 conn(0x7ff0740f0d40 msgr2=0x7ff0740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:47.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 -- 172.21.15.33:0/751567642 shutdown_connections 2022-02-02T14:49:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.875+0000 7ff07b7f1700 1 -- 172.21.15.33:0/751567642 wait complete. 2022-02-02T14:49:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 Processor -- start 2022-02-02T14:49:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 -- start start 2022-02-02T14:49:47.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 0x7ff074109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:47.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:47.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff074109c20 con 0x7ff0740f6860 2022-02-02T14:49:47.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07b7f1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff074109d60 con 0x7ff0740f55c0 2022-02-02T14:49:47.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff078d8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:47.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff078d8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34694/0 (socket says 172.21.15.33:34694) 2022-02-02T14:49:47.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff078d8c700 1 -- 172.21.15.33:0/1769421228 learned_addr learned my addr 172.21.15.33:0/1769421228 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:47.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.876+0000 7ff07958d700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 0x7ff074109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:47.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff078d8c700 1 -- 172.21.15.33:0/1769421228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 msgr2=0x7ff074109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:47.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff078d8c700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 0x7ff074109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:47.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff078d8c700 1 -- 172.21.15.33:0/1769421228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070005040 con 0x7ff0740f6860 2022-02-02T14:49:47.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff078d8c700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7ff070009990 tx=0x7ff070009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:47.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070018070 con 0x7ff0740f6860 2022-02-02T14:49:47.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff070007ba0 con 0x7ff0740f6860 2022-02-02T14:49:47.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07410a6a0 con 0x7ff0740f6860 2022-02-02T14:49:47.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff07001c3c0 con 0x7ff0740f6860 2022-02-02T14:49:47.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.877+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07410ac00 con 0x7ff0740f6860 2022-02-02T14:49:47.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.878+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff074045ad0 con 0x7ff0740f6860 2022-02-02T14:49:47.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.879+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff07001d420 con 0x7ff0740f6860 2022-02-02T14:49:47.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.879+0000 7ff069ffb700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 0x7ff060067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.880+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff0700836f0 con 0x7ff0740f6860 2022-02-02T14:49:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.880+0000 7ff07958d700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 0x7ff060067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.880+0000 7ff07958d700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 0x7ff060067290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ff0740f66c0 tx=0x7ff06400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:47.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:47.884+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff0700550b0 con 0x7ff0740f6860 2022-02-02T14:49:48.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.073+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0740faaa0 con 0x7ff060064dd0 2022-02-02T14:49:48.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.075+0000 7ff069ffb700 1 -- 172.21.15.33:0/1769421228 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff0740faaa0 con 0x7ff060064dd0 2022-02-02T14:49:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 msgr2=0x7ff060067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 0x7ff060067290 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7ff0740f66c0 tx=0x7ff06400b040).stop 2022-02-02T14:49:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 msgr2=0x7ff074109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 rx=0x7ff070009990 tx=0x7ff070009b30).stop 2022-02-02T14:49:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 shutdown_connections 2022-02-02T14:49:48.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff060064dd0 0x7ff060067290 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0740f55c0 0x7ff074109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 --2- 172.21.15.33:0/1769421228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0740f6860 0x7ff074109670 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 >> 172.21.15.33:0/1769421228 conn(0x7ff0740f0d40 msgr2=0x7ff07405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 shutdown_connections 2022-02-02T14:49:48.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.077+0000 7ff07b7f1700 1 -- 172.21.15.33:0/1769421228 wait complete. 2022-02-02T14:49:48.086 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:49:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 -- 172.21.15.33:0/2360791867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f5f60 msgr2=0x7f7a040f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 --2- 172.21.15.33:0/2360791867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f5f60 0x7f7a040f63e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f79f4004660 tx=0x7f79f4009b30).stop 2022-02-02T14:49:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 -- 172.21.15.33:0/2360791867 shutdown_connections 2022-02-02T14:49:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 --2- 172.21.15.33:0/2360791867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f5f60 0x7f7a040f63e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 --2- 172.21.15.33:0/2360791867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f4d60 0x7f7a040f5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 -- 172.21.15.33:0/2360791867 >> 172.21.15.33:0/2360791867 conn(0x7f7a040f04c0 msgr2=0x7f7a040f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 -- 172.21.15.33:0/2360791867 shutdown_connections 2022-02-02T14:49:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 -- 172.21.15.33:0/2360791867 wait complete. 2022-02-02T14:49:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.178+0000 7f7a095f8700 1 Processor -- start 2022-02-02T14:49:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a095f8700 1 -- start start 2022-02-02T14:49:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a095f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a095f8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 0x7f7a040f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a095f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040f7890 con 0x7f7a040f4d60 2022-02-02T14:49:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a095f8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040f79d0 con 0x7f7a040f5f60 2022-02-02T14:49:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34704/0 (socket says 172.21.15.33:34704) 2022-02-02T14:49:48.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 -- 172.21.15.33:0/1549354743 learned_addr learned my addr 172.21.15.33:0/1549354743 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:48.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a027fc700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 0x7f7a040f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 -- 172.21.15.33:0/1549354743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 msgr2=0x7f7a040f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 0x7f7a040f7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 -- 172.21.15.33:0/1549354743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4005040 con 0x7f7a040f4d60 2022-02-02T14:49:48.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a027fc700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 0x7f7a040f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:49:48.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.179+0000 7f7a02ffd700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f79f800e7f0 tx=0x7f79f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.180+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f80092e0 con 0x7f7a040f4d60 2022-02-02T14:49:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.180+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a040f7cb0 con 0x7f7a040f4d60 2022-02-02T14:49:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.180+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79f800f040 con 0x7f7a040f4d60 2022-02-02T14:49:48.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.180+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79f8014750 con 0x7f7a040f4d60 2022-02-02T14:49:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.180+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0410ef10 con 0x7f7a040f4d60 2022-02-02T14:49:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.181+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04045ad0 con 0x7f7a040f4d60 2022-02-02T14:49:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.181+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f79f801b030 con 0x7f7a040f4d60 2022-02-02T14:49:48.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.182+0000 7f79eb7fe700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 0x7f79ec067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.182+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f79f8081840 con 0x7f7a040f4d60 2022-02-02T14:49:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.182+0000 7f7a027fc700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 0x7f79ec067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.182+0000 7f7a027fc700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 0x7f79ec067290 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f79f4004d80 tx=0x7f79f400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.186+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79f804f9a0 con 0x7f7a040f4d60 2022-02-02T14:49:48.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.368+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a04057f10 con 0x7f79ec064dd0 2022-02-02T14:49:48.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.383+0000 7f79eb7fe700 1 -- 172.21.15.33:0/1549354743 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7a04057f10 con 0x7f79ec064dd0 2022-02-02T14:49:48.382 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:49:48.383 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (75m) 37m ago 76m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:49:48.383 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (68m) 37m ago 76m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:49:48.383 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (68m) 37m ago 75m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:49:48.383 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (74m) 37m ago 75m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:49:48.384 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (68m) 37m ago 72m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:49:48.384 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (69m) 37m ago 72m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:49:48.384 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (69m) 37m ago 72m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:49:48.384 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (72m) 37m ago 72m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:49:48.385 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (69m) 37m ago 77m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:49:48.385 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (69m) 37m ago 75m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:49:48.385 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (69m) 37m ago 77m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:49:48.385 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (68m) 37m ago 75m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:49:48.386 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (75m) 37m ago 75m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:49:48.386 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (75m) 37m ago 75m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:49:48.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 37m ago 74m - 4096M 2022-02-02T14:49:48.386 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (74m) 37m ago 74m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:49:48.387 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (74m) 37m ago 74m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:49:48.387 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (73m) 37m ago 73m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:49:48.387 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (73m) 37m ago 73m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:49:48.388 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (73m) 37m ago 73m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:49:48.388 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (74m) 37m ago 75m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:49:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 msgr2=0x7f79ec067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 0x7f79ec067290 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f79f4004d80 tx=0x7f79f400b040).stop 2022-02-02T14:49:48.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 msgr2=0x7f7a040f8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f79f800e7f0 tx=0x7f79f800b040).stop 2022-02-02T14:49:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 shutdown_connections 2022-02-02T14:49:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79ec064dd0 0x7f79ec067290 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a040f4d60 0x7f7a040f8eb0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 --2- 172.21.15.33:0/1549354743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a040f5f60 0x7f7a040f7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 >> 172.21.15.33:0/1549354743 conn(0x7f7a040f04c0 msgr2=0x7f7a040fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 shutdown_connections 2022-02-02T14:49:48.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.385+0000 7f7a095f8700 1 -- 172.21.15.33:0/1549354743 wait complete. 2022-02-02T14:49:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 -- 172.21.15.33:0/1637004484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 msgr2=0x7f08700f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 --2- 172.21.15.33:0/1637004484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f08700f6950 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 rx=0x7f0860004660 tx=0x7f0860009b30).stop 2022-02-02T14:49:48.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 -- 172.21.15.33:0/1637004484 shutdown_connections 2022-02-02T14:49:48.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 --2- 172.21.15.33:0/1637004484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 0x7f08700f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 --2- 172.21.15.33:0/1637004484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f08700f6950 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 -- 172.21.15.33:0/1637004484 >> 172.21.15.33:0/1637004484 conn(0x7f08700f1c90 msgr2=0x7f08700f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 -- 172.21.15.33:0/1637004484 shutdown_connections 2022-02-02T14:49:48.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.486+0000 7f086f59e700 1 -- 172.21.15.33:0/1637004484 wait complete. 2022-02-02T14:49:48.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 Processor -- start 2022-02-02T14:49:48.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 -- start start 2022-02-02T14:49:48.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 0x7f0870069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087006a380 con 0x7f08700f6530 2022-02-02T14:49:48.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087006a4c0 con 0x7f08700f77d0 2022-02-02T14:49:48.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34712/0 (socket says 172.21.15.33:34712) 2022-02-02T14:49:48.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.487+0000 7f086e59c700 1 -- 172.21.15.33:0/2793270960 learned_addr learned my addr 172.21.15.33:0/2793270960 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:48.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086dd9b700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 0x7f0870069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086e59c700 1 -- 172.21.15.33:0/2793270960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 msgr2=0x7f0870069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086e59c700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 0x7f0870069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086e59c700 1 -- 172.21.15.33:0/2793270960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860005040 con 0x7f08700f6530 2022-02-02T14:49:48.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086e59c700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f0860013a70 tx=0x7f0860009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0860018070 con 0x7f08700f6530 2022-02-02T14:49:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087006a740 con 0x7f08700f6530 2022-02-02T14:49:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087006aca0 con 0x7f08700f6530 2022-02-02T14:49:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f08600097d0 con 0x7f08700f6530 2022-02-02T14:49:48.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.488+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086001c3c0 con 0x7f08700f6530 2022-02-02T14:49:48.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.490+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0854004fa0 con 0x7f08700f6530 2022-02-02T14:49:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.490+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0860007ba0 con 0x7f08700f6530 2022-02-02T14:49:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.491+0000 7f085effd700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 0x7f08580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.491+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0860083650 con 0x7f08700f6530 2022-02-02T14:49:48.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.491+0000 7f086dd9b700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 0x7f08580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.491+0000 7f086dd9b700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 0x7f08580672e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0864009760 tx=0x7f0864009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.495+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f08600517c0 con 0x7f08700f6530 2022-02-02T14:49:48.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.737+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0854005e80 con 0x7f08700f6530 2022-02-02T14:49:48.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:48 smithi033 ceph-mon[101165]: pgmap v2132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:48.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.738+0000 7f085effd700 1 -- 172.21.15.33:0/2793270960 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0860054de0 con 0x7f08700f6530 2022-02-02T14:49:48.738 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:49:48.738 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:49:48.739 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:49:48.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:48.739 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:49:48.739 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:49:48.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:48.740 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:49:48.740 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:49:48.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:48.740 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:49:48.741 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:49:48.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:49:48.741 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:49:48.741 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:49:48.742 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:49:48.742 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:49:48.742 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:49:48.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 msgr2=0x7f08580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 0x7f08580672e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f0864009760 tx=0x7f0864009c60).stop 2022-02-02T14:49:48.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 msgr2=0x7f087006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f0860013a70 tx=0x7f0860009b30).stop 2022-02-02T14:49:48.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 shutdown_connections 2022-02-02T14:49:48.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0858064e20 0x7f08580672e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08700f6530 0x7f087006b9a0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 --2- 172.21.15.33:0/2793270960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08700f77d0 0x7f0870069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 >> 172.21.15.33:0/2793270960 conn(0x7f08700f1c90 msgr2=0x7f08700fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 shutdown_connections 2022-02-02T14:49:48.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.740+0000 7f086f59e700 1 -- 172.21.15.33:0/2793270960 wait complete. 2022-02-02T14:49:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 -- 172.21.15.33:0/3786289929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 msgr2=0x7f77dc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 --2- 172.21.15.33:0/3786289929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc0f6cc0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7f77d0004660 tx=0x7f77d0009b30).stop 2022-02-02T14:49:48.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 -- 172.21.15.33:0/3786289929 shutdown_connections 2022-02-02T14:49:48.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 --2- 172.21.15.33:0/3786289929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc0f6cc0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 --2- 172.21.15.33:0/3786289929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 -- 172.21.15.33:0/3786289929 >> 172.21.15.33:0/3786289929 conn(0x7f77dc0f0d40 msgr2=0x7f77dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:48.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 -- 172.21.15.33:0/3786289929 shutdown_connections 2022-02-02T14:49:48.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.840+0000 7f77e34f6700 1 -- 172.21.15.33:0/3786289929 wait complete. 2022-02-02T14:49:48.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 Processor -- start 2022-02-02T14:49:48.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 -- start start 2022-02-02T14:49:48.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc0603e0 con 0x7f77dc0f6860 2022-02-02T14:49:48.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e34f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc060520 con 0x7f77dc0f55c0 2022-02-02T14:49:48.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e0a91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e0a91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34724/0 (socket says 172.21.15.33:34724) 2022-02-02T14:49:48.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.841+0000 7f77e0a91700 1 -- 172.21.15.33:0/964894184 learned_addr learned my addr 172.21.15.33:0/964894184 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:49:48.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e1292700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e0a91700 1 -- 172.21.15.33:0/964894184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 msgr2=0x7f77dc109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:48.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e0a91700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:48.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e0a91700 1 -- 172.21.15.33:0/964894184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0005040 con 0x7f77dc0f6860 2022-02-02T14:49:48.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e1292700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:49:48.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e0a91700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f77d0009990 tx=0x7f77d0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d0018070 con 0x7f77dc0f6860 2022-02-02T14:49:48.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77d0007ca0 con 0x7f77dc0f6860 2022-02-02T14:49:48.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77dc10c6a0 con 0x7f77dc0f6860 2022-02-02T14:49:48.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77d001c620 con 0x7f77dc0f6860 2022-02-02T14:49:48.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.842+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77dc10cc00 con 0x7f77dc0f6860 2022-02-02T14:49:48.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.843+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77dc045ad0 con 0x7f77dc0f6860 2022-02-02T14:49:48.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.844+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77d001d960 con 0x7f77dc0f6860 2022-02-02T14:49:48.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.844+0000 7f77cdffb700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 0x7f77c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:49:48.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.844+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f77d0083820 con 0x7f77dc0f6860 2022-02-02T14:49:48.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.844+0000 7f77e1292700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 0x7f77c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:49:48.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.844+0000 7f77e1292700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 0x7f77c8067290 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f77dc060060 tx=0x7f77d8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:49:48.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:48.848+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77d0051a40 con 0x7f77dc0f6860 2022-02-02T14:49:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:48 smithi037 ceph-mon[69017]: pgmap v2132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:49.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.062+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77dc0008d0 con 0x7f77dc0f6860 2022-02-02T14:49:49.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.062+0000 7f77cdffb700 1 -- 172.21.15.33:0/964894184 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f77d0055060 con 0x7f77dc0f6860 2022-02-02T14:49:49.062 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:49:49.063 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:49:49.063 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:49:49.063 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:49:49.063 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:49:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:49:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:49:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:49:49.064 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:49:49.065 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:49:49.065 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:49:49.065 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:49:49.066 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:49:49.066 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:49:49.066 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:49:49.067 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:49:49.067 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:49:49.067 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:49:49.067 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:49:49.067 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:49:49.068 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:49:49.068 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:49:49.068 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:49:49.068 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:49:49.069 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:49:49.069 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:49:49.069 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:49:49.070 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:49:49.070 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:49:49.071 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:49:49.071 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:49.071 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:49.072 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:49:49.072 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:49:49.072 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:49.073 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:49.073 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:49.073 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:49:49.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 msgr2=0x7f77c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:49.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 0x7f77c8067290 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f77dc060060 tx=0x7f77d8009040).stop 2022-02-02T14:49:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 msgr2=0x7f77dc10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:49:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7f77d0009990 tx=0x7f77d0009b30).stop 2022-02-02T14:49:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 shutdown_connections 2022-02-02T14:49:49.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77c8064dd0 0x7f77c8067290 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:49.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77dc0f55c0 0x7f77dc109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:49.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 --2- 172.21.15.33:0/964894184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77dc0f6860 0x7f77dc10c150 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:49:49.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 >> 172.21.15.33:0/964894184 conn(0x7f77dc0f0d40 msgr2=0x7f77dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:49:49.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 shutdown_connections 2022-02-02T14:49:49.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:49:49.064+0000 7f77e34f6700 1 -- 172.21.15.33:0/964894184 wait complete. 2022-02-02T14:49:49.080 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:49:49.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:49 smithi033 ceph-mon[101165]: from='client.36260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:49.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:49 smithi033 ceph-mon[101165]: from='client.36264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:49.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2793270960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:49:49.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/964894184' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:49:50.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:49 smithi037 ceph-mon[69017]: from='client.36260 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:50.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:49 smithi037 ceph-mon[69017]: from='client.36264 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:49:50.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2793270960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:49:50.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/964894184' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:49:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:50 smithi033 ceph-mon[101165]: pgmap v2133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:50 smithi037 ceph-mon[69017]: pgmap v2133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:52 smithi033 ceph-mon[101165]: pgmap v2134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:52 smithi037 ceph-mon[69017]: pgmap v2134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:54 smithi033 ceph-mon[101165]: pgmap v2135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:49:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:49:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:54 smithi037 ceph-mon[69017]: pgmap v2135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:49:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:49:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:56 smithi033 ceph-mon[101165]: pgmap v2136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:56 smithi037 ceph-mon[69017]: pgmap v2136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:49:58 smithi033 ceph-mon[101165]: pgmap v2137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:49:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:49:58 smithi037 ceph-mon[69017]: pgmap v2137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:00.489 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:00 smithi033 conmon[101141]: 2022-02-02T14:50:00.000+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:50:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:00 smithi033 ceph-mon[101165]: pgmap v2138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:50:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:00 smithi037 ceph-mon[69017]: pgmap v2138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T14:50:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:02 smithi033 ceph-mon[101165]: pgmap v2139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:02 smithi037 ceph-mon[69017]: pgmap v2139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:03.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:03 smithi033 ceph-mon[101165]: pgmap v2140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:04.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:03 smithi037 ceph-mon[69017]: pgmap v2140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:06.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:06 smithi033 ceph-mon[101165]: pgmap v2141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:06.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:06 smithi037 ceph-mon[69017]: pgmap v2141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:08.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:08 smithi037 ceph-mon[69017]: pgmap v2142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:08 smithi033 ceph-mon[101165]: pgmap v2142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:10 smithi037 ceph-mon[69017]: pgmap v2143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:10 smithi033 ceph-mon[101165]: pgmap v2143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:12.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:12 smithi037 ceph-mon[69017]: pgmap v2144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:12 smithi033 ceph-mon[101165]: pgmap v2144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:14 smithi033 ceph-mon[101165]: pgmap v2145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:14 smithi037 ceph-mon[69017]: pgmap v2145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:16 smithi033 ceph-mon[101165]: pgmap v2146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:16 smithi037 ceph-mon[69017]: pgmap v2146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:18 smithi033 ceph-mon[101165]: pgmap v2147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:18 smithi037 ceph-mon[69017]: pgmap v2147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 -- 172.21.15.33:0/2618438557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 msgr2=0x7fc62c0f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 --2- 172.21.15.33:0/2618438557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c0f59f0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fc61c004660 tx=0x7fc61c009b30).stop 2022-02-02T14:50:19.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 -- 172.21.15.33:0/2618438557 shutdown_connections 2022-02-02T14:50:19.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 --2- 172.21.15.33:0/2618438557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 0x7fc62c0f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:50:19.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 --2- 172.21.15.33:0/2618438557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c0f59f0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 -- 172.21.15.33:0/2618438557 >> 172.21.15.33:0/2618438557 conn(0x7fc62c0f0d30 msgr2=0x7fc62c0f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 -- 172.21.15.33:0/2618438557 shutdown_connections 2022-02-02T14:50:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.180+0000 7fc631849700 1 -- 172.21.15.33:0/2618438557 wait complete. 2022-02-02T14:50:19.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.181+0000 7fc631849700 1 Processor -- start 2022-02-02T14:50:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.181+0000 7fc631849700 1 -- start start 2022-02-02T14:50:19.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.181+0000 7fc631849700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc631849700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 0x7fc62c10c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc631849700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c060570 con 0x7fc62c0f55d0 2022-02-02T14:50:19.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc631849700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0606b0 con 0x7fc62c0f6870 2022-02-02T14:50:19.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34732/0 (socket says 172.21.15.33:34732) 2022-02-02T14:50:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 -- 172.21.15.33:0/3472537171 learned_addr learned my addr 172.21.15.33:0/3472537171 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62a7fc700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 0x7fc62c10c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 -- 172.21.15.33:0/3472537171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 msgr2=0x7fc62c10c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 0x7fc62c10c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 -- 172.21.15.33:0/3472537171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c005040 con 0x7fc62c0f55d0 2022-02-02T14:50:19.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc62affd700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc61c000c00 tx=0x7fc61c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c018070 con 0x7fc62c0f55d0 2022-02-02T14:50:19.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c10c7a0 con 0x7fc62c0f55d0 2022-02-02T14:50:19.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.182+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc61c007d70 con 0x7fc62c0f55d0 2022-02-02T14:50:19.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.183+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc61c01c620 con 0x7fc62c0f55d0 2022-02-02T14:50:19.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.183+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c10ccd0 con 0x7fc62c0f55d0 2022-02-02T14:50:19.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.184+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c0f49c0 con 0x7fc62c0f55d0 2022-02-02T14:50:19.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.184+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc61c01c860 con 0x7fc62c0f55d0 2022-02-02T14:50:19.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.184+0000 7fc6237fe700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 0x7fc618067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.185+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc61c083940 con 0x7fc62c0f55d0 2022-02-02T14:50:19.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.185+0000 7fc62a7fc700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 0x7fc618067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.185+0000 7fc62a7fc700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 0x7fc618067270 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc61400b790 tx=0x7fc614008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.189+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc61c0519f0 con 0x7fc62c0f55d0 2022-02-02T14:50:19.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.380+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc62c0fde80 con 0x7fc618064db0 2022-02-02T14:50:19.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.381+0000 7fc6237fe700 1 -- 172.21.15.33:0/3472537171 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc62c0fde80 con 0x7fc618064db0 2022-02-02T14:50:19.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 msgr2=0x7fc618067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 0x7fc618067270 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7fc61400b790 tx=0x7fc614008040).stop 2022-02-02T14:50:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 msgr2=0x7fc62c109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc61c000c00 tx=0x7fc61c009b30).stop 2022-02-02T14:50:19.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 shutdown_connections 2022-02-02T14:50:19.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc618064db0 0x7fc618067270 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc62c0f55d0 0x7fc62c109ca0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 --2- 172.21.15.33:0/3472537171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc62c0f6870 0x7fc62c10c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.383+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 >> 172.21.15.33:0/3472537171 conn(0x7fc62c0f0d30 msgr2=0x7fc62c0fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:19.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.384+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 shutdown_connections 2022-02-02T14:50:19.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.384+0000 7fc631849700 1 -- 172.21.15.33:0/3472537171 wait complete. 2022-02-02T14:50:19.393 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:50:19.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 -- 172.21.15.33:0/3812909988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f55c0 msgr2=0x7ff6dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3812909988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc0f59e0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7ff6d0004660 tx=0x7ff6d0009b30).stop 2022-02-02T14:50:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 -- 172.21.15.33:0/3812909988 shutdown_connections 2022-02-02T14:50:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3812909988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3812909988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc0f59e0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 -- 172.21.15.33:0/3812909988 >> 172.21.15.33:0/3812909988 conn(0x7ff6dc0f0d40 msgr2=0x7ff6dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:19.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 -- 172.21.15.33:0/3812909988 shutdown_connections 2022-02-02T14:50:19.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.485+0000 7ff6e3046700 1 -- 172.21.15.33:0/3812909988 wait complete. 2022-02-02T14:50:19.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 Processor -- start 2022-02-02T14:50:19.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 -- start start 2022-02-02T14:50:19.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0603c0 con 0x7ff6dc0f6860 2022-02-02T14:50:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e3046700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc060500 con 0x7ff6dc0f55c0 2022-02-02T14:50:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34742/0 (socket says 172.21.15.33:34742) 2022-02-02T14:50:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6dbfff700 1 -- 172.21.15.33:0/3541888683 learned_addr learned my addr 172.21.15.33:0/3541888683 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.486+0000 7ff6e0de2700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6dbfff700 1 -- 172.21.15.33:0/3541888683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f55c0 msgr2=0x7ff6dc109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6dbfff700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6dbfff700 1 -- 172.21.15.33:0/3541888683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d0005040 con 0x7ff6dc0f6860 2022-02-02T14:50:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6dbfff700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7ff6c80026d0 tx=0x7ff6c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c80079c0 con 0x7ff6dc0f6860 2022-02-02T14:50:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff6c800f040 con 0x7ff6dc0f6860 2022-02-02T14:50:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc10c740 con 0x7ff6dc0f6860 2022-02-02T14:50:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c80148b0 con 0x7ff6dc0f6860 2022-02-02T14:50:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.487+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc10ccd0 con 0x7ff6dc0f6860 2022-02-02T14:50:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.488+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc0f49b0 con 0x7ff6dc0f6860 2022-02-02T14:50:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.489+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff6c8007b20 con 0x7ff6dc0f6860 2022-02-02T14:50:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.489+0000 7ff6d97fa700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 0x7ff6cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.490+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff6c8081950 con 0x7ff6dc0f6860 2022-02-02T14:50:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.490+0000 7ff6e0de2700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 0x7ff6cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.490+0000 7ff6e0de2700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 0x7ff6cc067290 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7ff6d0013690 tx=0x7ff6d0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.494+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff6c804fa00 con 0x7ff6dc0f6860 2022-02-02T14:50:19.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.677+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6dc0fdf10 con 0x7ff6cc064dd0 2022-02-02T14:50:19.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.691+0000 7ff6d97fa700 1 -- 172.21.15.33:0/3541888683 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7ff6dc0fdf10 con 0x7ff6cc064dd0 2022-02-02T14:50:19.691 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:50:19.691 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (75m) 37m ago 76m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:50:19.691 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (68m) 37m ago 76m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:50:19.692 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (68m) 37m ago 76m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:50:19.692 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (75m) 37m ago 76m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:50:19.692 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (69m) 37m ago 72m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:50:19.692 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (69m) 37m ago 72m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:50:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (70m) 37m ago 72m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:50:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (72m) 37m ago 72m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:50:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (70m) 37m ago 77m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:50:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (69m) 37m ago 76m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:50:19.694 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (69m) 37m ago 78m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:50:19.694 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (69m) 37m ago 75m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:50:19.695 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (76m) 37m ago 76m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:50:19.695 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (75m) 37m ago 75m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:50:19.695 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 37m ago 75m - 4096M 2022-02-02T14:50:19.695 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (75m) 37m ago 75m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:50:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (74m) 37m ago 74m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:50:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (74m) 37m ago 74m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:50:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (74m) 37m ago 74m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:50:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (73m) 37m ago 73m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:50:19.696 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (75m) 37m ago 76m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:50:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 msgr2=0x7ff6cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 0x7ff6cc067290 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7ff6d0013690 tx=0x7ff6d0009b30).stop 2022-02-02T14:50:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 msgr2=0x7ff6dc10c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7ff6c80026d0 tx=0x7ff6c8009de0).stop 2022-02-02T14:50:19.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 shutdown_connections 2022-02-02T14:50:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff6cc064dd0 0x7ff6cc067290 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6dc0f55c0 0x7ff6dc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 --2- 172.21.15.33:0/3541888683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff6dc0f6860 0x7ff6dc10c190 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 >> 172.21.15.33:0/3541888683 conn(0x7ff6dc0f0d40 msgr2=0x7ff6dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 shutdown_connections 2022-02-02T14:50:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.693+0000 7ff6e3046700 1 -- 172.21.15.33:0/3541888683 wait complete. 2022-02-02T14:50:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 -- 172.21.15.33:0/2314210161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 msgr2=0x7f56ac0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 --2- 172.21.15.33:0/2314210161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac0f6cc0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f56a0004660 tx=0x7f56a0009b30).stop 2022-02-02T14:50:19.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 -- 172.21.15.33:0/2314210161 shutdown_connections 2022-02-02T14:50:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 --2- 172.21.15.33:0/2314210161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac0f6cc0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 --2- 172.21.15.33:0/2314210161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 0x7f56ac0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 -- 172.21.15.33:0/2314210161 >> 172.21.15.33:0/2314210161 conn(0x7f56ac0f0d40 msgr2=0x7f56ac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:19.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 -- 172.21.15.33:0/2314210161 shutdown_connections 2022-02-02T14:50:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.793+0000 7f56b0e62700 1 -- 172.21.15.33:0/2314210161 wait complete. 2022-02-02T14:50:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 Processor -- start 2022-02-02T14:50:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 -- start start 2022-02-02T14:50:19.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 0x7f56ac1090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac109b80 con 0x7f56ac0f6860 2022-02-02T14:50:19.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56b0e62700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac109cc0 con 0x7f56ac0f55c0 2022-02-02T14:50:19.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56a9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56a9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34752/0 (socket says 172.21.15.33:34752) 2022-02-02T14:50:19.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56a9d9b700 1 -- 172.21.15.33:0/38152573 learned_addr learned my addr 172.21.15.33:0/38152573 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:19.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.794+0000 7f56aa59c700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 0x7f56ac1090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56a9d9b700 1 -- 172.21.15.33:0/38152573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 msgr2=0x7f56ac1090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56a9d9b700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 0x7f56ac1090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56a9d9b700 1 -- 172.21.15.33:0/38152573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0005040 con 0x7f56ac0f6860 2022-02-02T14:50:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56a9d9b700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f56a0000c00 tx=0x7f56a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a0019070 con 0x7f56ac0f6860 2022-02-02T14:50:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56a0007e70 con 0x7f56ac0f6860 2022-02-02T14:50:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac10a600 con 0x7f56ac0f6860 2022-02-02T14:50:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a0014ce0 con 0x7f56ac0f6860 2022-02-02T14:50:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.795+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac10ab60 con 0x7f56ac0f6860 2022-02-02T14:50:19.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.796+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac045ad0 con 0x7f56ac0f6860 2022-02-02T14:50:19.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.797+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56a0025070 con 0x7f56ac0f6860 2022-02-02T14:50:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.797+0000 7f569affd700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.797+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f56a0082940 con 0x7f56ac0f6860 2022-02-02T14:50:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.797+0000 7f56aa59c700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:19.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.797+0000 7f56aa59c700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 0x7f5694067290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f569c009fd0 tx=0x7f569c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:19.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:19.801+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56a0054420 con 0x7f56ac0f6860 2022-02-02T14:50:20.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.045+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56ac10f700 con 0x7f56ac0f6860 2022-02-02T14:50:20.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.045+0000 7f569affd700 1 -- 172.21.15.33:0/38152573 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f56a0023070 con 0x7f56ac0f6860 2022-02-02T14:50:20.046 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:50:20.046 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:50:20.047 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:50:20.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:20.047 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:50:20.048 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:50:20.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:20.049 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:50:20.049 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:50:20.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:20.050 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:50:20.051 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:50:20.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:20.051 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:50:20.052 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:50:20.052 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:50:20.052 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:50:20.053 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:50:20.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 msgr2=0x7f5694067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 0x7f5694067290 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f569c009fd0 tx=0x7f569c00b040).stop 2022-02-02T14:50:20.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 msgr2=0x7f56ac1095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f56a0000c00 tx=0x7f56a000b040).stop 2022-02-02T14:50:20.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 shutdown_connections 2022-02-02T14:50:20.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5694064dd0 0x7f5694067290 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56ac0f55c0 0x7f56ac1090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 --2- 172.21.15.33:0/38152573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56ac0f6860 0x7f56ac1095d0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.047+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 >> 172.21.15.33:0/38152573 conn(0x7f56ac0f0d40 msgr2=0x7f56ac05fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:20.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.048+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 shutdown_connections 2022-02-02T14:50:20.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.048+0000 7f56b0e62700 1 -- 172.21.15.33:0/38152573 wait complete. 2022-02-02T14:50:20.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 -- 172.21.15.33:0/934016795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f5430 msgr2=0x7f087c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 --2- 172.21.15.33:0/934016795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f5430 0x7f087c0f5850 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 rx=0x7f086c004660 tx=0x7f086c009b30).stop 2022-02-02T14:50:20.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 -- 172.21.15.33:0/934016795 shutdown_connections 2022-02-02T14:50:20.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 --2- 172.21.15.33:0/934016795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f66d0 0x7f087c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 --2- 172.21.15.33:0/934016795 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f5430 0x7f087c0f5850 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.148+0000 7f087b59e700 1 -- 172.21.15.33:0/934016795 >> 172.21.15.33:0/934016795 conn(0x7f087c0f0b90 msgr2=0x7f087c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:20.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 -- 172.21.15.33:0/934016795 shutdown_connections 2022-02-02T14:50:20.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 -- 172.21.15.33:0/934016795 wait complete. 2022-02-02T14:50:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 Processor -- start 2022-02-02T14:50:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 -- start start 2022-02-02T14:50:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 0x7f087c108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c109a40 con 0x7f087c0f66d0 2022-02-02T14:50:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.149+0000 7f087b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f087c109b80 con 0x7f087c0f5430 2022-02-02T14:50:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f087a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 0x7f087c108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34762/0 (socket says 172.21.15.33:34762) 2022-02-02T14:50:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 -- 172.21.15.33:0/3791369671 learned_addr learned my addr 172.21.15.33:0/3791369671 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 -- 172.21.15.33:0/3791369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 msgr2=0x7f087c108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 0x7f087c108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 -- 172.21.15.33:0/3791369671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c005040 con 0x7f087c0f66d0 2022-02-02T14:50:20.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f087a59c700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 0x7f087c108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:50:20.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f0879d9b700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f08700026d0 tx=0x7f0870009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:20.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08700079c0 con 0x7f087c0f66d0 2022-02-02T14:50:20.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f087000f040 con 0x7f087c0f66d0 2022-02-02T14:50:20.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f087c10a520 con 0x7f087c0f66d0 2022-02-02T14:50:20.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08700148b0 con 0x7f087c0f66d0 2022-02-02T14:50:20.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.150+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f087c10aae0 con 0x7f087c0f66d0 2022-02-02T14:50:20.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.151+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087c045ad0 con 0x7f087c0f66d0 2022-02-02T14:50:20.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.152+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0870007b20 con 0x7f087c0f66d0 2022-02-02T14:50:20.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.152+0000 7f086affd700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 0x7f08640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:20.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.152+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0870081950 con 0x7f087c0f66d0 2022-02-02T14:50:20.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.152+0000 7f087a59c700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 0x7f08640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:20.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.153+0000 7f087a59c700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 0x7f08640672e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f086c005010 tx=0x7f086c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:20.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.156+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0870053430 con 0x7f087c0f66d0 2022-02-02T14:50:20.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.371+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f087c10b1d0 con 0x7f087c0f66d0 2022-02-02T14:50:20.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.371+0000 7f086affd700 1 -- 172.21.15.33:0/3791369671 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0870053020 con 0x7f087c0f66d0 2022-02-02T14:50:20.371 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:50:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:50:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:50:20.372 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:50:20.372 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:20.373 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:50:20.373 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:50:20.373 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:50:20.373 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:50:20.374 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:50:20.374 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:50:20.374 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:50:20.374 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:50:20.374 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:50:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:50:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:50:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:50:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:50:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:50:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:50:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:50:20.376 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:50:20.377 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:50:20.377 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:50:20.377 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:50:20.377 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:50:20.378 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:50:20.378 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:50:20.378 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:50:20.378 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:50:20.379 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:50:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:20.379 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:50:20.379 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:20.380 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:20.380 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:20.380 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:20.380 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:20.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 msgr2=0x7f08640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 0x7f08640672e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f086c005010 tx=0x7f086c009b30).stop 2022-02-02T14:50:20.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 msgr2=0x7f087c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:20.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f08700026d0 tx=0x7f0870009de0).stop 2022-02-02T14:50:20.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 shutdown_connections 2022-02-02T14:50:20.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0864064e20 0x7f08640672e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f087c0f5430 0x7f087c108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 --2- 172.21.15.33:0/3791369671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f087c0f66d0 0x7f087c109490 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:20.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 >> 172.21.15.33:0/3791369671 conn(0x7f087c0f0b90 msgr2=0x7f087c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:20.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 shutdown_connections 2022-02-02T14:50:20.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:20.375+0000 7f087b59e700 1 -- 172.21.15.33:0/3791369671 wait complete. 2022-02-02T14:50:20.384 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:50:20.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:20 smithi033 ceph-mon[101165]: pgmap v2148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:20 smithi033 ceph-mon[101165]: from='client.36276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/38152573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:50:20.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3791369671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:50:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:20 smithi037 ceph-mon[69017]: pgmap v2148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:20 smithi037 ceph-mon[69017]: from='client.36276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/38152573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:50:21.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3791369671' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:50:21.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:21 smithi033 ceph-mon[101165]: from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:22.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:21 smithi037 ceph-mon[69017]: from='client.36280 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:22 smithi033 ceph-mon[101165]: pgmap v2149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:22 smithi037 ceph-mon[69017]: pgmap v2149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:24 smithi033 ceph-mon[101165]: pgmap v2150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:24 smithi037 ceph-mon[69017]: pgmap v2150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:26 smithi033 ceph-mon[101165]: pgmap v2151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:26 smithi037 ceph-mon[69017]: pgmap v2151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:28 smithi033 ceph-mon[101165]: pgmap v2152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:28 smithi037 ceph-mon[69017]: pgmap v2152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:30 smithi033 ceph-mon[101165]: pgmap v2153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:30 smithi037 ceph-mon[69017]: pgmap v2153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:32 smithi033 ceph-mon[101165]: pgmap v2154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:32 smithi037 ceph-mon[69017]: pgmap v2154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:34 smithi033 ceph-mon[101165]: pgmap v2155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:34 smithi037 ceph-mon[69017]: pgmap v2155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:36 smithi033 ceph-mon[101165]: pgmap v2156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:36 smithi037 ceph-mon[69017]: pgmap v2156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:38 smithi033 ceph-mon[101165]: pgmap v2157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:38 smithi037 ceph-mon[69017]: pgmap v2157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:40 smithi033 ceph-mon[101165]: pgmap v2158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:40 smithi037 ceph-mon[69017]: pgmap v2158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:42 smithi033 ceph-mon[101165]: pgmap v2159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:42 smithi037 ceph-mon[69017]: pgmap v2159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:44 smithi033 ceph-mon[101165]: pgmap v2160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:44 smithi037 ceph-mon[69017]: pgmap v2160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:46 smithi033 ceph-mon[101165]: pgmap v2161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:46 smithi037 ceph-mon[69017]: pgmap v2161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:48 smithi033 ceph-mon[101165]: pgmap v2162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:48 smithi037 ceph-mon[69017]: pgmap v2162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:50.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 -- 172.21.15.33:0/891874254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 msgr2=0x7fe5940f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 --2- 172.21.15.33:0/891874254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe5940f59e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fe588004660 tx=0x7fe588009b30).stop 2022-02-02T14:50:50.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 -- 172.21.15.33:0/891874254 shutdown_connections 2022-02-02T14:50:50.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 --2- 172.21.15.33:0/891874254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 0x7fe5940f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 --2- 172.21.15.33:0/891874254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe5940f59e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 -- 172.21.15.33:0/891874254 >> 172.21.15.33:0/891874254 conn(0x7fe5940f0d40 msgr2=0x7fe5940f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:50.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 -- 172.21.15.33:0/891874254 shutdown_connections 2022-02-02T14:50:50.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.491+0000 7fe59b195700 1 -- 172.21.15.33:0/891874254 wait complete. 2022-02-02T14:50:50.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.492+0000 7fe59b195700 1 Processor -- start 2022-02-02T14:50:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.492+0000 7fe59b195700 1 -- start start 2022-02-02T14:50:50.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe59b195700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe59b195700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 0x7fe594106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe59b195700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594106950 con 0x7fe5940f55c0 2022-02-02T14:50:50.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe59b195700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594107160 con 0x7fe5940f6860 2022-02-02T14:50:50.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34770/0 (socket says 172.21.15.33:34770) 2022-02-02T14:50:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 -- 172.21.15.33:0/3210641990 learned_addr learned my addr 172.21.15.33:0/3210641990 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe593fff700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 0x7fe594106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 -- 172.21.15.33:0/3210641990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 msgr2=0x7fe594106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 0x7fe594106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 -- 172.21.15.33:0/3210641990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588005040 con 0x7fe5940f55c0 2022-02-02T14:50:50.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.493+0000 7fe598f31700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fe588014040 tx=0x7fe58800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:50.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.494+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe588019070 con 0x7fe5940f55c0 2022-02-02T14:50:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.494+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe594107380 con 0x7fe5940f55c0 2022-02-02T14:50:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.494+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe588007e70 con 0x7fe5940f55c0 2022-02-02T14:50:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.494+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe588014d10 con 0x7fe5940f55c0 2022-02-02T14:50:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.494+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5941078e0 con 0x7fe5940f55c0 2022-02-02T14:50:50.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.495+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5940f49b0 con 0x7fe5940f55c0 2022-02-02T14:50:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.495+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe588025070 con 0x7fe5940f55c0 2022-02-02T14:50:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.496+0000 7fe5917fa700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 0x7fe584067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.496+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe588082970 con 0x7fe5940f55c0 2022-02-02T14:50:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.496+0000 7fe593fff700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 0x7fe584067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.496+0000 7fe593fff700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 0x7fe584067290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fe580009fd0 tx=0x7fe58000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:50.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.500+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe588050a20 con 0x7fe5940f55c0 2022-02-02T14:50:50.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.691+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5940008d0 con 0x7fe584064dd0 2022-02-02T14:50:50.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.692+0000 7fe5917fa700 1 -- 172.21.15.33:0/3210641990 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe5940008d0 con 0x7fe584064dd0 2022-02-02T14:50:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 msgr2=0x7fe584067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 0x7fe584067290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fe580009fd0 tx=0x7fe58000b040).stop 2022-02-02T14:50:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 msgr2=0x7fe594105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fe588014040 tx=0x7fe58800b040).stop 2022-02-02T14:50:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 shutdown_connections 2022-02-02T14:50:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe584064dd0 0x7fe584067290 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5940f55c0 0x7fe594105e60 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 --2- 172.21.15.33:0/3210641990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5940f6860 0x7fe594106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 >> 172.21.15.33:0/3210641990 conn(0x7fe5940f0d40 msgr2=0x7fe5940fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:50.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 shutdown_connections 2022-02-02T14:50:50.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.694+0000 7fe59b195700 1 -- 172.21.15.33:0/3210641990 wait complete. 2022-02-02T14:50:50.703 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:50:50.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 -- 172.21.15.33:0/58341666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f7980 msgr2=0x7faf140f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/58341666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f7980 0x7faf140f7de0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7faf08004660 tx=0x7faf08009b30).stop 2022-02-02T14:50:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 -- 172.21.15.33:0/58341666 shutdown_connections 2022-02-02T14:50:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/58341666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f7980 0x7faf140f7de0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/58341666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f66e0 0x7faf140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 -- 172.21.15.33:0/58341666 >> 172.21.15.33:0/58341666 conn(0x7faf140f1e40 msgr2=0x7faf140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:50.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 -- 172.21.15.33:0/58341666 shutdown_connections 2022-02-02T14:50:50.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.795+0000 7faf1a8f9700 1 -- 172.21.15.33:0/58341666 wait complete. 2022-02-02T14:50:50.797 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:50 smithi033 ceph-mon[101165]: pgmap v2163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.796+0000 7faf1a8f9700 1 Processor -- start 2022-02-02T14:50:50.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.796+0000 7faf1a8f9700 1 -- start start 2022-02-02T14:50:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f7980 0x7faf14107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf141079b0 con 0x7faf140f66e0 2022-02-02T14:50:50.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf14107af0 con 0x7faf140f7980 2022-02-02T14:50:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34780/0 (socket says 172.21.15.33:34780) 2022-02-02T14:50:50.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 -- 172.21.15.33:0/1148639869 learned_addr learned my addr 172.21.15.33:0/1148639869 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf137fe700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f7980 0x7faf14107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 -- 172.21.15.33:0/1148639869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f7980 msgr2=0x7faf14107400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:50.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f7980 0x7faf14107400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 -- 172.21.15.33:0/1148639869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08005040 con 0x7faf140f66e0 2022-02-02T14:50:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf13fff700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7faf0400e7c0 tx=0x7faf0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf040092e0 con 0x7faf140f66e0 2022-02-02T14:50:50.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faf0400f040 con 0x7faf140f66e0 2022-02-02T14:50:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf14108490 con 0x7faf140f66e0 2022-02-02T14:50:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf04014750 con 0x7faf140f66e0 2022-02-02T14:50:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.797+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf14108a50 con 0x7faf140f66e0 2022-02-02T14:50:50.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.798+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf14045ad0 con 0x7faf140f66e0 2022-02-02T14:50:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.799+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faf0401b030 con 0x7faf140f66e0 2022-02-02T14:50:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.799+0000 7faf10ff9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 0x7faefc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.799+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faf04081b60 con 0x7faf140f66e0 2022-02-02T14:50:50.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.799+0000 7faf137fe700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 0x7faefc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.800+0000 7faf137fe700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 0x7faefc067290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7faf08004d80 tx=0x7faf0800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:50.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.804+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faf04053640 con 0x7faf140f66e0 2022-02-02T14:50:50.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:50.987+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faf140ff010 con 0x7faefc064dd0 2022-02-02T14:50:51.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.001+0000 7faf10ff9700 1 -- 172.21.15.33:0/1148639869 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faf140ff010 con 0x7faefc064dd0 2022-02-02T14:50:51.001 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:50:51.001 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (76m) 38m ago 77m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:50:51.001 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (69m) 38m ago 77m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:50:51.002 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (69m) 38m ago 76m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:50:51.002 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (75m) 38m ago 76m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:50:51.002 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (69m) 38m ago 73m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:50:51.003 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (70m) 38m ago 73m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:50:51.003 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (71m) 38m ago 73m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:50:51.003 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (73m) 38m ago 73m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:50:51.003 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (70m) 38m ago 78m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:50:51.004 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (70m) 38m ago 76m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:50:51.004 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (70m) 38m ago 78m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:50:51.004 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (69m) 38m ago 76m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:50:51.004 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (76m) 38m ago 76m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:50:51.005 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (76m) 38m ago 76m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:50:51.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 38m ago 75m - 4096M 2022-02-02T14:50:51.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (75m) 38m ago 75m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:50:51.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (75m) 38m ago 75m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:50:51.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (75m) 38m ago 75m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:50:51.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (74m) 38m ago 74m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:50:51.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (74m) 38m ago 74m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:50:51.006 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (75m) 38m ago 76m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:50:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 msgr2=0x7faefc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 0x7faefc067290 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7faf08004d80 tx=0x7faf0800b040).stop 2022-02-02T14:50:51.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 msgr2=0x7faf14106f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7faf0400e7c0 tx=0x7faf0400b040).stop 2022-02-02T14:50:51.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 shutdown_connections 2022-02-02T14:50:51.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faefc064dd0 0x7faefc067290 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf140f66e0 0x7faf14106f10 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 --2- 172.21.15.33:0/1148639869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf140f7980 0x7faf14107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 >> 172.21.15.33:0/1148639869 conn(0x7faf140f1e40 msgr2=0x7faf140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:51.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 shutdown_connections 2022-02-02T14:50:51.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.003+0000 7faf1a8f9700 1 -- 172.21.15.33:0/1148639869 wait complete. 2022-02-02T14:50:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:50 smithi037 ceph-mon[69017]: pgmap v2163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 -- 172.21.15.33:0/2213290268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 msgr2=0x7f8c880f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 --2- 172.21.15.33:0/2213290268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c880f7de0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 rx=0x7f8c78004660 tx=0x7f8c78009b30).stop 2022-02-02T14:50:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 -- 172.21.15.33:0/2213290268 shutdown_connections 2022-02-02T14:50:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 --2- 172.21.15.33:0/2213290268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c880f7de0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 --2- 172.21.15.33:0/2213290268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 0x7f8c880f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:50:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 -- 172.21.15.33:0/2213290268 >> 172.21.15.33:0/2213290268 conn(0x7f8c880f1e40 msgr2=0x7f8c880f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 -- 172.21.15.33:0/2213290268 shutdown_connections 2022-02-02T14:50:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.103+0000 7f8c90428700 1 -- 172.21.15.33:0/2213290268 wait complete. 2022-02-02T14:50:51.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 Processor -- start 2022-02-02T14:50:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 -- start start 2022-02-02T14:50:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 0x7f8c8806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8806a410 con 0x7f8c880f7980 2022-02-02T14:50:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.104+0000 7f8c90428700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8806a550 con 0x7f8c880f66e0 2022-02-02T14:50:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34792/0 (socket says 172.21.15.33:34792) 2022-02-02T14:50:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 -- 172.21.15.33:0/3333025192 learned_addr learned my addr 172.21.15.33:0/3333025192 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8e1c4700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 0x7f8c8806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 -- 172.21.15.33:0/3333025192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 msgr2=0x7f8c8806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 0x7f8c8806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 -- 172.21.15.33:0/3333025192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c78005040 con 0x7f8c880f7980 2022-02-02T14:50:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c8d9c3700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f8c78009990 tx=0x7f8c78009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c78018070 con 0x7f8c880f7980 2022-02-02T14:50:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c78007ba0 con 0x7f8c880f7980 2022-02-02T14:50:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8806a7d0 con 0x7f8c880f7980 2022-02-02T14:50:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c7801c620 con 0x7f8c880f7980 2022-02-02T14:50:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.105+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8810efe0 con 0x7f8c880f7980 2022-02-02T14:50:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.107+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c88045ad0 con 0x7f8c880f7980 2022-02-02T14:50:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.107+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c7801c890 con 0x7f8c880f7980 2022-02-02T14:50:51.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.108+0000 7f8c7effd700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 0x7f8c74067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.108+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8c78083b50 con 0x7f8c880f7980 2022-02-02T14:50:51.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.108+0000 7f8c8e1c4700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 0x7f8c74067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.109+0000 7f8c8e1c4700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 0x7f8c74067290 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8c8806b730 tx=0x7f8c84008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:51.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.112+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c78051be0 con 0x7f8c880f7980 2022-02-02T14:50:51.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.360+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8c880fef40 con 0x7f8c880f7980 2022-02-02T14:50:51.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.360+0000 7f8c7effd700 1 -- 172.21.15.33:0/3333025192 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8c78055200 con 0x7f8c880f7980 2022-02-02T14:50:51.360 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:50:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:50:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:50:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:50:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:50:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:50:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:50:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:50:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:50:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:50:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:50:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:50:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:50:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:50:51.364 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:50:51.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 msgr2=0x7f8c74067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 0x7f8c74067290 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f8c8806b730 tx=0x7f8c84008040).stop 2022-02-02T14:50:51.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 msgr2=0x7f8c88069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f8c78009990 tx=0x7f8c78009b30).stop 2022-02-02T14:50:51.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 shutdown_connections 2022-02-02T14:50:51.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c74064dd0 0x7f8c74067290 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c880f66e0 0x7f8c8806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 --2- 172.21.15.33:0/3333025192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c880f7980 0x7f8c88069e20 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 >> 172.21.15.33:0/3333025192 conn(0x7f8c880f1e40 msgr2=0x7f8c880fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:51.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 shutdown_connections 2022-02-02T14:50:51.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.363+0000 7f8c90428700 1 -- 172.21.15.33:0/3333025192 wait complete. 2022-02-02T14:50:51.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 -- 172.21.15.33:0/2321513548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 msgr2=0x7f1fa40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 --2- 172.21.15.33:0/2321513548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa40f6b00 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f1f94004660 tx=0x7f1f94009b30).stop 2022-02-02T14:50:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 -- 172.21.15.33:0/2321513548 shutdown_connections 2022-02-02T14:50:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 --2- 172.21.15.33:0/2321513548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 0x7f1fa40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 --2- 172.21.15.33:0/2321513548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa40f6b00 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 -- 172.21.15.33:0/2321513548 >> 172.21.15.33:0/2321513548 conn(0x7f1fa40f1e40 msgr2=0x7f1fa40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 -- 172.21.15.33:0/2321513548 shutdown_connections 2022-02-02T14:50:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 -- 172.21.15.33:0/2321513548 wait complete. 2022-02-02T14:50:51.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.465+0000 7f1faa687700 1 Processor -- start 2022-02-02T14:50:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1faa687700 1 -- start start 2022-02-02T14:50:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1faa687700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1faa687700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 0x7f1fa4069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1faa687700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa406a380 con 0x7f1fa40f66e0 2022-02-02T14:50:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1faa687700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa406a4c0 con 0x7f1fa40f7980 2022-02-02T14:50:51.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34800/0 (socket says 172.21.15.33:34800) 2022-02-02T14:50:51.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 -- 172.21.15.33:0/2469302904 learned_addr learned my addr 172.21.15.33:0/2469302904 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:50:51.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa37fe700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 0x7f1fa4069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 -- 172.21.15.33:0/2469302904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 msgr2=0x7f1fa4069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 0x7f1fa4069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 -- 172.21.15.33:0/2469302904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f94005040 con 0x7f1fa40f66e0 2022-02-02T14:50:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa3fff700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f1f94013a70 tx=0x7f1f94009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:51.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.466+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f94018070 con 0x7f1fa40f66e0 2022-02-02T14:50:51.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.467+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa406a740 con 0x7f1fa40f66e0 2022-02-02T14:50:51.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.467+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f940097d0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.467+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f9401c3c0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.467+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa406aca0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.468+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa4045ad0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.468+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f9401c680 con 0x7f1fa40f66e0 2022-02-02T14:50:51.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.469+0000 7f1fa0ff9700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 0x7f1f8c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:50:51.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.469+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1f940837a0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.469+0000 7f1fa37fe700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 0x7f1f8c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:50:51.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.469+0000 7f1fa37fe700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 0x7f1f8c067290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1f98004b00 tx=0x7f1f9800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:50:51.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.473+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f94051a80 con 0x7f1fa40f66e0 2022-02-02T14:50:51.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.689+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fa40fef40 con 0x7f1fa40f66e0 2022-02-02T14:50:51.689 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3333025192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:50:51.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.689+0000 7f1fa0ff9700 1 -- 172.21.15.33:0/2469302904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1f940550a0 con 0x7f1fa40f66e0 2022-02-02T14:50:51.690 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:50:51.690 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:50:51.690 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:50:51.690 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:50:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:51.691 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:50:51.691 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:50:51.691 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:50:51.692 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:50:51.692 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:50:51.692 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:50:51.692 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:50:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:50:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:50:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:50:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:50:51.693 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:50:51.694 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:50:51.694 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:50:51.694 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:50:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:50:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:50:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:50:51.695 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:50:51.696 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:50:51.696 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:50:51.696 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:50:51.696 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:50:51.696 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:50:51.697 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:50:51.697 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:50:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:51.698 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:50:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:50:51.698 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:51.698 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:51.699 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:51.699 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:50:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.692+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 msgr2=0x7f1f8c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.692+0000 7f1faa687700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 0x7f1f8c067290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f1f98004b00 tx=0x7f1f9800b040).stop 2022-02-02T14:50:51.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.692+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 msgr2=0x7f1fa406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:50:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.692+0000 7f1faa687700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7f1f94013a70 tx=0x7f1f94009b30).stop 2022-02-02T14:50:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 shutdown_connections 2022-02-02T14:50:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f8c064dd0 0x7f1f8c067290 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1fa40f66e0 0x7f1fa406b9a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 --2- 172.21.15.33:0/2469302904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fa40f7980 0x7f1fa4069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:50:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 >> 172.21.15.33:0/2469302904 conn(0x7f1fa40f1e40 msgr2=0x7f1fa40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:50:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 shutdown_connections 2022-02-02T14:50:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:50:51.693+0000 7f1faa687700 1 -- 172.21.15.33:0/2469302904 wait complete. 2022-02-02T14:50:51.703 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:50:52.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3333025192' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:50:52.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:52 smithi033 ceph-mon[101165]: from='client.36292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:52.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:52 smithi033 ceph-mon[101165]: from='client.36296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:52 smithi033 ceph-mon[101165]: pgmap v2164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:52.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2469302904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:50:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:52 smithi037 ceph-mon[69017]: from='client.36292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:52 smithi037 ceph-mon[69017]: from='client.36296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:50:53.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:52 smithi037 ceph-mon[69017]: pgmap v2164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:53.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2469302904' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:50:53.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:53 smithi033 ceph-mon[101165]: pgmap v2165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:54.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:53 smithi037 ceph-mon[69017]: pgmap v2165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:50:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:50:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:50:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:50:55.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:55 smithi033 ceph-mon[101165]: pgmap v2166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:56.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:55 smithi037 ceph-mon[69017]: pgmap v2166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:50:58 smithi033 ceph-mon[101165]: pgmap v2167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:50:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:50:58 smithi037 ceph-mon[69017]: pgmap v2167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:00 smithi033 ceph-mon[101165]: pgmap v2168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:00 smithi037 ceph-mon[69017]: pgmap v2168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:02 smithi033 ceph-mon[101165]: pgmap v2169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:02 smithi037 ceph-mon[69017]: pgmap v2169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:04 smithi033 ceph-mon[101165]: pgmap v2170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:04 smithi037 ceph-mon[69017]: pgmap v2170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:06.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:06 smithi033 ceph-mon[101165]: pgmap v2171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:06 smithi037 ceph-mon[69017]: pgmap v2171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:08 smithi033 ceph-mon[101165]: pgmap v2172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:08 smithi037 ceph-mon[69017]: pgmap v2172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:10 smithi033 ceph-mon[101165]: pgmap v2173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:10 smithi037 ceph-mon[69017]: pgmap v2173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:12 smithi033 ceph-mon[101165]: pgmap v2174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:12 smithi037 ceph-mon[69017]: pgmap v2174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:14 smithi033 ceph-mon[101165]: pgmap v2175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:14 smithi037 ceph-mon[69017]: pgmap v2175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:16 smithi033 ceph-mon[101165]: pgmap v2176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:16 smithi037 ceph-mon[69017]: pgmap v2176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:18 smithi033 ceph-mon[101165]: pgmap v2177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:18 smithi037 ceph-mon[69017]: pgmap v2177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:20 smithi033 ceph-mon[101165]: pgmap v2178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:20 smithi037 ceph-mon[69017]: pgmap v2178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 -- 172.21.15.33:0/877746660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 msgr2=0x7f85000f59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 --2- 172.21.15.33:0/877746660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f85000f59f0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7f84f0004660 tx=0x7f84f0009b30).stop 2022-02-02T14:51:21.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 -- 172.21.15.33:0/877746660 shutdown_connections 2022-02-02T14:51:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 --2- 172.21.15.33:0/877746660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 0x7f85000f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 --2- 172.21.15.33:0/877746660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f85000f59f0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 -- 172.21.15.33:0/877746660 >> 172.21.15.33:0/877746660 conn(0x7f85000f0d70 msgr2=0x7f85000f3190 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:21.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 -- 172.21.15.33:0/877746660 shutdown_connections 2022-02-02T14:51:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 -- 172.21.15.33:0/877746660 wait complete. 2022-02-02T14:51:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.808+0000 7f85057a1700 1 Processor -- start 2022-02-02T14:51:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f85057a1700 1 -- start start 2022-02-02T14:51:21.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f85057a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:21.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f85057a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 0x7f8500107440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:21.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f85057a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85001079f0 con 0x7f85000f55d0 2022-02-02T14:51:21.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f85057a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8500107b30 con 0x7f85000f6870 2022-02-02T14:51:21.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34808/0 (socket says 172.21.15.33:34808) 2022-02-02T14:51:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 -- 172.21.15.33:0/3223017443 learned_addr learned my addr 172.21.15.33:0/3223017443 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84fe7fc700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 0x7f8500107440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 -- 172.21.15.33:0/3223017443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 msgr2=0x7f8500107440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:21.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 0x7f8500107440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 -- 172.21.15.33:0/3223017443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f0005040 con 0x7f85000f55d0 2022-02-02T14:51:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.809+0000 7f84feffd700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f84f0013a70 tx=0x7f84f0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.810+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f0018070 con 0x7f85000f55d0 2022-02-02T14:51:21.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.810+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8500108470 con 0x7f85000f55d0 2022-02-02T14:51:21.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.810+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f84f00097d0 con 0x7f85000f55d0 2022-02-02T14:51:21.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.810+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84f001c3c0 con 0x7f85000f55d0 2022-02-02T14:51:21.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.810+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85001089d0 con 0x7f85000f55d0 2022-02-02T14:51:21.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.811+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8500045ad0 con 0x7f85000f55d0 2022-02-02T14:51:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.812+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f84f0007ba0 con 0x7f85000f55d0 2022-02-02T14:51:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.812+0000 7f84e77fe700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 0x7f84e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.812+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f84f0083ba0 con 0x7f85000f55d0 2022-02-02T14:51:21.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.812+0000 7f84fe7fc700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 0x7f84e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:21.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.813+0000 7f84fe7fc700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 0x7f84e8067290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f84f40096c0 tx=0x7f84f4009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:21.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:21.816+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f84f0055660 con 0x7f85000f55d0 2022-02-02T14:51:22.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.006+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85000facb0 con 0x7f84e8064dd0 2022-02-02T14:51:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.007+0000 7f84e77fe700 1 -- 172.21.15.33:0/3223017443 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f85000facb0 con 0x7f84e8064dd0 2022-02-02T14:51:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 msgr2=0x7f84e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 0x7f84e8067290 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f84f40096c0 tx=0x7f84f4009be0).stop 2022-02-02T14:51:22.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 msgr2=0x7f8500106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f84f0013a70 tx=0x7f84f0009b30).stop 2022-02-02T14:51:22.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 shutdown_connections 2022-02-02T14:51:22.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f84e8064dd0 0x7f84e8067290 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85000f55d0 0x7f8500106f50 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 --2- 172.21.15.33:0/3223017443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85000f6870 0x7f8500107440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 >> 172.21.15.33:0/3223017443 conn(0x7f85000f0d70 msgr2=0x7f850005ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 shutdown_connections 2022-02-02T14:51:22.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.009+0000 7f85057a1700 1 -- 172.21.15.33:0/3223017443 wait complete. 2022-02-02T14:51:22.018 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:51:22.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 -- 172.21.15.33:0/65611099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 msgr2=0x7f7fe40f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 --2- 172.21.15.33:0/65611099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe40f9140 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f7fd4004660 tx=0x7f7fd4009b30).stop 2022-02-02T14:51:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 -- 172.21.15.33:0/65611099 shutdown_connections 2022-02-02T14:51:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 --2- 172.21.15.33:0/65611099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 0x7f7fe40fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 --2- 172.21.15.33:0/65611099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe40f9140 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 -- 172.21.15.33:0/65611099 >> 172.21.15.33:0/65611099 conn(0x7f7fe40f0bc0 msgr2=0x7f7fe40f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 -- 172.21.15.33:0/65611099 shutdown_connections 2022-02-02T14:51:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.110+0000 7f7fe9681700 1 -- 172.21.15.33:0/65611099 wait complete. 2022-02-02T14:51:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 Processor -- start 2022-02-02T14:51:22.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 -- start start 2022-02-02T14:51:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 0x7f7fe4107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4107880 con 0x7f7fe4060310 2022-02-02T14:51:22.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.111+0000 7f7fe9681700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe4108090 con 0x7f7fe40f96c0 2022-02-02T14:51:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34818/0 (socket says 172.21.15.33:34818) 2022-02-02T14:51:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 -- 172.21.15.33:0/3863360287 learned_addr learned my addr 172.21.15.33:0/3863360287 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:22.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe27fc700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 0x7f7fe4107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 -- 172.21.15.33:0/3863360287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 msgr2=0x7f7fe4107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 0x7f7fe4107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 -- 172.21.15.33:0/3863360287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd4005040 con 0x7f7fe4060310 2022-02-02T14:51:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe2ffd700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f7fd4009990 tx=0x7f7fd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd4018070 con 0x7f7fe4060310 2022-02-02T14:51:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7fd4007ba0 con 0x7f7fe4060310 2022-02-02T14:51:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe41082b0 con 0x7f7fe4060310 2022-02-02T14:51:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.112+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fd401c3c0 con 0x7f7fe4060310 2022-02-02T14:51:22.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.113+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe4108810 con 0x7f7fe4060310 2022-02-02T14:51:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.114+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe4059100 con 0x7f7fe4060310 2022-02-02T14:51:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.114+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7fd401d420 con 0x7f7fe4060310 2022-02-02T14:51:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.115+0000 7f7fcb7fe700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 0x7f7fcc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.115+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7fd4083630 con 0x7f7fe4060310 2022-02-02T14:51:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.115+0000 7f7fe27fc700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 0x7f7fcc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.115+0000 7f7fe27fc700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 0x7f7fcc0672e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f7fe40600e0 tx=0x7f7fd800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.119+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7fd4051680 con 0x7f7fe4060310 2022-02-02T14:51:22.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.303+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fe40fedb0 con 0x7f7fcc064e20 2022-02-02T14:51:22.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.317+0000 7f7fcb7fe700 1 -- 172.21.15.33:0/3863360287 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7fe40fedb0 con 0x7f7fcc064e20 2022-02-02T14:51:22.317 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:51:22.317 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (76m) 38m ago 77m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:51:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (69m) 38m ago 77m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:51:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (69m) 38m ago 77m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:51:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (76m) 38m ago 77m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:51:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (70m) 38m ago 73m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:51:22.318 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (70m) 38m ago 73m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:51:22.319 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (71m) 38m ago 73m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:51:22.319 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (73m) 38m ago 73m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:51:22.319 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (71m) 38m ago 78m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:51:22.319 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (70m) 38m ago 77m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:51:22.320 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (70m) 38m ago 79m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:51:22.320 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (70m) 38m ago 77m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:51:22.320 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (77m) 38m ago 77m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:51:22.320 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (76m) 38m ago 76m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:51:22.321 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 38m ago 76m - 4096M 2022-02-02T14:51:22.321 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (76m) 38m ago 76m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:51:22.321 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (75m) 38m ago 75m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:51:22.321 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (75m) 38m ago 75m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:51:22.322 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (75m) 38m ago 75m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:51:22.322 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (74m) 38m ago 74m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:51:22.322 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (76m) 38m ago 77m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:51:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 msgr2=0x7f7fcc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 0x7f7fcc0672e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f7fe40600e0 tx=0x7f7fd800b040).stop 2022-02-02T14:51:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 msgr2=0x7f7fe4106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f7fd4009990 tx=0x7f7fd4009b30).stop 2022-02-02T14:51:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 shutdown_connections 2022-02-02T14:51:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7fcc064e20 0x7f7fcc0672e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7fe4060310 0x7f7fe4106d90 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 --2- 172.21.15.33:0/3863360287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe40f96c0 0x7f7fe4107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 >> 172.21.15.33:0/3863360287 conn(0x7f7fe40f0bc0 msgr2=0x7f7fe40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 shutdown_connections 2022-02-02T14:51:22.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.319+0000 7f7fe9681700 1 -- 172.21.15.33:0/3863360287 wait complete. 2022-02-02T14:51:22.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 -- 172.21.15.33:0/610586079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 msgr2=0x7f10480f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 --2- 172.21.15.33:0/610586079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f10480f7de0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f103c004660 tx=0x7f103c009b30).stop 2022-02-02T14:51:22.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 -- 172.21.15.33:0/610586079 shutdown_connections 2022-02-02T14:51:22.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 --2- 172.21.15.33:0/610586079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f10480f7de0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 --2- 172.21.15.33:0/610586079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 0x7f10480f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 -- 172.21.15.33:0/610586079 >> 172.21.15.33:0/610586079 conn(0x7f10480f1e40 msgr2=0x7f10480f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.419+0000 7f104dae5700 1 -- 172.21.15.33:0/610586079 shutdown_connections 2022-02-02T14:51:22.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 -- 172.21.15.33:0/610586079 wait complete. 2022-02-02T14:51:22.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 Processor -- start 2022-02-02T14:51:22.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 -- start start 2022-02-02T14:51:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 0x7f1048106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10481079b0 con 0x7f10480f7980 2022-02-02T14:51:22.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.420+0000 7f104dae5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1048107af0 con 0x7f10480f66e0 2022-02-02T14:51:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34830/0 (socket says 172.21.15.33:34830) 2022-02-02T14:51:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 -- 172.21.15.33:0/2260048710 learned_addr learned my addr 172.21.15.33:0/2260048710 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f10477fe700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 0x7f1048106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 -- 172.21.15.33:0/2260048710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 msgr2=0x7f1048106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 0x7f1048106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 -- 172.21.15.33:0/2260048710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c005040 con 0x7f10480f7980 2022-02-02T14:51:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f1046ffd700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f103c009990 tx=0x7f103c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c018070 con 0x7f10480f7980 2022-02-02T14:51:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1048108430 con 0x7f10480f7980 2022-02-02T14:51:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f103c007ba0 con 0x7f10480f7980 2022-02-02T14:51:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c01c3c0 con 0x7f10480f7980 2022-02-02T14:51:22.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.421+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1048108990 con 0x7f10480f7980 2022-02-02T14:51:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.422+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1048045ad0 con 0x7f10480f7980 2022-02-02T14:51:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.423+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f103c01c680 con 0x7f10480f7980 2022-02-02T14:51:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.423+0000 7f102ffff700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 0x7f1030067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.423+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f103c083820 con 0x7f10480f7980 2022-02-02T14:51:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.423+0000 7f10477fe700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 0x7f1030067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.424+0000 7f10477fe700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 0x7f1030067290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f10480f77e0 tx=0x7f1038009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.427+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f103c0554a0 con 0x7f10480f7980 2022-02-02T14:51:22.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.670+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1048027a00 con 0x7f10480f7980 2022-02-02T14:51:22.670 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:22 smithi033 ceph-mon[101165]: pgmap v2179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:22.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.670+0000 7f102ffff700 1 -- 172.21.15.33:0/2260048710 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f103c055090 con 0x7f10480f7980 2022-02-02T14:51:22.670 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:51:22.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:51:22.671 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:51:22.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:22.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:51:22.672 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:51:22.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:22.672 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:51:22.672 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:51:22.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:22.673 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:51:22.673 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:51:22.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:22.674 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:51:22.674 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:51:22.674 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:51:22.674 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:51:22.674 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:51:22.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 msgr2=0x7f1030067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 0x7f1030067290 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f10480f77e0 tx=0x7f1038009c80).stop 2022-02-02T14:51:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 msgr2=0x7f1048107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f103c009990 tx=0x7f103c009b30).stop 2022-02-02T14:51:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 shutdown_connections 2022-02-02T14:51:22.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1030064dd0 0x7f1030067290 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10480f66e0 0x7f1048106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 --2- 172.21.15.33:0/2260048710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10480f7980 0x7f1048107400 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 >> 172.21.15.33:0/2260048710 conn(0x7f10480f1e40 msgr2=0x7f10480fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 shutdown_connections 2022-02-02T14:51:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.672+0000 7f104dae5700 1 -- 172.21.15.33:0/2260048710 wait complete. 2022-02-02T14:51:22.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 -- 172.21.15.33:0/2547202969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 msgr2=0x7fcf740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 --2- 172.21.15.33:0/2547202969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf740f59e0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7fcf64004660 tx=0x7fcf64009b30).stop 2022-02-02T14:51:22.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 -- 172.21.15.33:0/2547202969 shutdown_connections 2022-02-02T14:51:22.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 --2- 172.21.15.33:0/2547202969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 0x7fcf740f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 --2- 172.21.15.33:0/2547202969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf740f59e0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 -- 172.21.15.33:0/2547202969 >> 172.21.15.33:0/2547202969 conn(0x7fcf740f0d40 msgr2=0x7fcf740f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:22.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 -- 172.21.15.33:0/2547202969 shutdown_connections 2022-02-02T14:51:22.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.773+0000 7fcf79f39700 1 -- 172.21.15.33:0/2547202969 wait complete. 2022-02-02T14:51:22.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 Processor -- start 2022-02-02T14:51:22.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 -- start start 2022-02-02T14:51:22.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 0x7fcf741073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74107990 con 0x7fcf740f55c0 2022-02-02T14:51:22.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf79f39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74107ad0 con 0x7fcf740f6860 2022-02-02T14:51:22.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34838/0 (socket says 172.21.15.33:34838) 2022-02-02T14:51:22.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf737fe700 1 -- 172.21.15.33:0/1237336252 learned_addr learned my addr 172.21.15.33:0/1237336252 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:22.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.774+0000 7fcf72ffd700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 0x7fcf741073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf737fe700 1 -- 172.21.15.33:0/1237336252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 msgr2=0x7fcf741073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:22.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf737fe700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 0x7fcf741073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:22.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf737fe700 1 -- 172.21.15.33:0/1237336252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64005040 con 0x7fcf740f55c0 2022-02-02T14:51:22.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf737fe700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fcf64014040 tx=0x7fcf6400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf64019070 con 0x7fcf740f55c0 2022-02-02T14:51:22.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcf64007e70 con 0x7fcf740f55c0 2022-02-02T14:51:22.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf74108410 con 0x7fcf740f55c0 2022-02-02T14:51:22.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf64014d10 con 0x7fcf740f55c0 2022-02-02T14:51:22.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.775+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74108970 con 0x7fcf740f55c0 2022-02-02T14:51:22.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.776+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf74045ad0 con 0x7fcf740f55c0 2022-02-02T14:51:22.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.776+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcf64025070 con 0x7fcf740f55c0 2022-02-02T14:51:22.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.777+0000 7fcf6bfff700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 0x7fcf60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:22.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.777+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcf64082a90 con 0x7fcf740f55c0 2022-02-02T14:51:22.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.777+0000 7fcf72ffd700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 0x7fcf60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:22.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.777+0000 7fcf72ffd700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 0x7fcf60067290 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fcf5c009fd0 tx=0x7fcf5c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:22.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.781+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcf64054570 con 0x7fcf740f55c0 2022-02-02T14:51:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.991+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcf74109130 con 0x7fcf740f55c0 2022-02-02T14:51:22.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.992+0000 7fcf6bfff700 1 -- 172.21.15.33:0/1237336252 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcf64023070 con 0x7fcf740f55c0 2022-02-02T14:51:22.992 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:51:22.992 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:51:22.992 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:51:22.992 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:51:22.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:22.993 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:51:22.993 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:51:22.993 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:51:22.993 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:51:22.994 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:51:22.994 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:51:22.994 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:51:22.994 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:51:22.995 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:51:22.995 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:51:22.995 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:51:22.995 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:51:22.996 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:51:22.996 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:51:22.996 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:51:22.996 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:51:22.997 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:51:22.997 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:51:22.997 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:51:22.997 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:51:22.997 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:51:22.998 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:51:22.998 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:51:22.998 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:51:22.998 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:51:22.999 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:51:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:22.999 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:51:22.999 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:23.000 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:23.000 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:23.000 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:23.000 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.993+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 msgr2=0x7fcf60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.993+0000 7fcf79f39700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 0x7fcf60067290 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fcf5c009fd0 tx=0x7fcf5c00b040).stop 2022-02-02T14:51:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.993+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 msgr2=0x7fcf74106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:23.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.993+0000 7fcf79f39700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7fcf64014040 tx=0x7fcf6400b040).stop 2022-02-02T14:51:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.993+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 shutdown_connections 2022-02-02T14:51:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcf60064dd0 0x7fcf60067290 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740f55c0 0x7fcf74106ef0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:23.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 --2- 172.21.15.33:0/1237336252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf740f6860 0x7fcf741073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:23.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 >> 172.21.15.33:0/1237336252 conn(0x7fcf740f0d40 msgr2=0x7fcf7405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:23.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 shutdown_connections 2022-02-02T14:51:23.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:22.994+0000 7fcf79f39700 1 -- 172.21.15.33:0/1237336252 wait complete. 2022-02-02T14:51:23.005 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:51:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:22 smithi037 ceph-mon[69017]: pgmap v2179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:23.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:23 smithi033 ceph-mon[101165]: from='client.36308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:23.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:23 smithi033 ceph-mon[101165]: from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:23.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2260048710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:51:23.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1237336252' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:51:24.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:23 smithi037 ceph-mon[69017]: from='client.36308 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:24.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:23 smithi037 ceph-mon[69017]: from='client.36312 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:24.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2260048710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:51:24.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1237336252' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:51:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:24 smithi033 ceph-mon[101165]: pgmap v2180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:24 smithi037 ceph-mon[69017]: pgmap v2180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:26 smithi033 ceph-mon[101165]: pgmap v2181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:26 smithi037 ceph-mon[69017]: pgmap v2181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:28 smithi033 ceph-mon[101165]: pgmap v2182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:28 smithi037 ceph-mon[69017]: pgmap v2182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:30 smithi033 ceph-mon[101165]: pgmap v2183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:30 smithi037 ceph-mon[69017]: pgmap v2183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:32 smithi033 ceph-mon[101165]: pgmap v2184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:32 smithi037 ceph-mon[69017]: pgmap v2184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:34 smithi033 ceph-mon[101165]: pgmap v2185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:34 smithi037 ceph-mon[69017]: pgmap v2185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:36 smithi033 ceph-mon[101165]: pgmap v2186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:36 smithi037 ceph-mon[69017]: pgmap v2186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:38 smithi033 ceph-mon[101165]: pgmap v2187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:38 smithi037 ceph-mon[69017]: pgmap v2187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:39.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:39 smithi033 ceph-mon[101165]: pgmap v2188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:40.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:39 smithi037 ceph-mon[69017]: pgmap v2188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:42 smithi033 ceph-mon[101165]: pgmap v2189: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:42 smithi037 ceph-mon[69017]: pgmap v2189: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:44 smithi033 ceph-mon[101165]: pgmap v2190: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:44 smithi037 ceph-mon[69017]: pgmap v2190: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:46 smithi033 ceph-mon[101165]: pgmap v2191: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:46 smithi037 ceph-mon[69017]: pgmap v2191: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:48 smithi033 ceph-mon[101165]: pgmap v2192: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:48 smithi037 ceph-mon[69017]: pgmap v2192: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:50 smithi033 ceph-mon[101165]: pgmap v2193: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:50 smithi037 ceph-mon[69017]: pgmap v2193: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:52 smithi033 ceph-mon[101165]: pgmap v2194: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:52 smithi037 ceph-mon[69017]: pgmap v2194: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 -- 172.21.15.33:0/424599844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 msgr2=0x7fcea80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 --2- 172.21.15.33:0/424599844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea80f6cc0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7fce9c004660 tx=0x7fce9c009b30).stop 2022-02-02T14:51:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 -- 172.21.15.33:0/424599844 shutdown_connections 2022-02-02T14:51:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 --2- 172.21.15.33:0/424599844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea80f6cc0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 --2- 172.21.15.33:0/424599844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 0x7fcea80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 -- 172.21.15.33:0/424599844 >> 172.21.15.33:0/424599844 conn(0x7fcea80f0d40 msgr2=0x7fcea80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 -- 172.21.15.33:0/424599844 shutdown_connections 2022-02-02T14:51:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.109+0000 7fceafd0f700 1 -- 172.21.15.33:0/424599844 wait complete. 2022-02-02T14:51:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 Processor -- start 2022-02-02T14:51:53.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 -- start start 2022-02-02T14:51:53.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 0x7fcea8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8107a10 con 0x7fcea80f6860 2022-02-02T14:51:53.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceafd0f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8107b50 con 0x7fcea80f55c0 2022-02-02T14:51:53.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fcead2aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fcead2aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34848/0 (socket says 172.21.15.33:34848) 2022-02-02T14:51:53.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fcead2aa700 1 -- 172.21.15.33:0/2077784779 learned_addr learned my addr 172.21.15.33:0/2077784779 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:53.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.110+0000 7fceadaab700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 0x7fcea8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fcead2aa700 1 -- 172.21.15.33:0/2077784779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 msgr2=0x7fcea8106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fcead2aa700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 0x7fcea8106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fcead2aa700 1 -- 172.21.15.33:0/2077784779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c005040 con 0x7fcea80f6860 2022-02-02T14:51:53.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fcead2aa700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fce9c009990 tx=0x7fce9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c018070 con 0x7fcea80f6860 2022-02-02T14:51:53.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce9c007ba0 con 0x7fcea80f6860 2022-02-02T14:51:53.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea8108490 con 0x7fcea80f6860 2022-02-02T14:51:53.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce9c01c620 con 0x7fcea80f6860 2022-02-02T14:51:53.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.111+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea81089f0 con 0x7fcea80f6860 2022-02-02T14:51:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.112+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea8045ad0 con 0x7fcea80f6860 2022-02-02T14:51:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.113+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce9c01c8e0 con 0x7fcea80f6860 2022-02-02T14:51:53.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.113+0000 7fce9a7fc700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.113+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fce9c083be0 con 0x7fcea80f6860 2022-02-02T14:51:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.114+0000 7fceadaab700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.114+0000 7fceadaab700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcea80f66c0 tx=0x7fcea4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.117+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce9c055600 con 0x7fcea80f6860 2022-02-02T14:51:53.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.304+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcea80faca0 con 0x7fce94064dd0 2022-02-02T14:51:53.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.305+0000 7fce9a7fc700 1 -- 172.21.15.33:0/2077784779 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fcea80faca0 con 0x7fce94064dd0 2022-02-02T14:51:53.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 msgr2=0x7fce94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 0x7fce94067290 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fcea80f66c0 tx=0x7fcea4009040).stop 2022-02-02T14:51:53.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 msgr2=0x7fcea8107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7fce9c009990 tx=0x7fce9c009b30).stop 2022-02-02T14:51:53.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 shutdown_connections 2022-02-02T14:51:53.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce94064dd0 0x7fce94067290 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcea80f55c0 0x7fcea8106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 --2- 172.21.15.33:0/2077784779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcea80f6860 0x7fcea8107460 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 >> 172.21.15.33:0/2077784779 conn(0x7fcea80f0d40 msgr2=0x7fcea805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 shutdown_connections 2022-02-02T14:51:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.307+0000 7fceafd0f700 1 -- 172.21.15.33:0/2077784779 wait complete. 2022-02-02T14:51:53.316 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:51:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 -- 172.21.15.33:0/3780458098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f66e0 msgr2=0x7f3a1c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3780458098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c0f6b00 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f3a0c004660 tx=0x7f3a0c009b30).stop 2022-02-02T14:51:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 -- 172.21.15.33:0/3780458098 shutdown_connections 2022-02-02T14:51:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3780458098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3780458098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c0f6b00 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 -- 172.21.15.33:0/3780458098 >> 172.21.15.33:0/3780458098 conn(0x7f3a1c0f1e40 msgr2=0x7f3a1c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 -- 172.21.15.33:0/3780458098 shutdown_connections 2022-02-02T14:51:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.408+0000 7f3a228bf700 1 -- 172.21.15.33:0/3780458098 wait complete. 2022-02-02T14:51:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 Processor -- start 2022-02-02T14:51:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 -- start start 2022-02-02T14:51:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c068d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c069830 con 0x7f3a1c0f7980 2022-02-02T14:51:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a228bf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c110ac0 con 0x7f3a1c0f66e0 2022-02-02T14:51:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.409+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34858/0 (socket says 172.21.15.33:34858) 2022-02-02T14:51:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 -- 172.21.15.33:0/3972914900 learned_addr learned my addr 172.21.15.33:0/3972914900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:53.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1bfff700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c068d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 -- 172.21.15.33:0/3972914900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f66e0 msgr2=0x7f3a1c068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c068d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 -- 172.21.15.33:0/3972914900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c005040 con 0x7f3a1c0f7980 2022-02-02T14:51:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a1b7fe700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f3a10002700 tx=0x7f3a10009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a10009320 con 0x7f3a1c0f7980 2022-02-02T14:51:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c110d70 con 0x7f3a1c0f7980 2022-02-02T14:51:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a1000f040 con 0x7f3a1c0f7980 2022-02-02T14:51:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a10014870 con 0x7f3a1c0f7980 2022-02-02T14:51:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.410+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c111330 con 0x7f3a1c0f7980 2022-02-02T14:51:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.412+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c0f5ad0 con 0x7f3a1c0f7980 2022-02-02T14:51:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.412+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a10009480 con 0x7f3a1c0f7980 2022-02-02T14:51:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.413+0000 7f3a18ff9700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 0x7f3a04067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.413+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3a10081d50 con 0x7f3a1c0f7980 2022-02-02T14:51:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.413+0000 7f3a1bfff700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 0x7f3a04067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.413+0000 7f3a1bfff700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 0x7f3a04067290 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f3a0c004630 tx=0x7f3a0c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.417+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a10053830 con 0x7f3a1c0f7980 2022-02-02T14:51:53.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.602+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a1c0fefb0 con 0x7f3a04064dd0 2022-02-02T14:51:53.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.617+0000 7f3a18ff9700 1 -- 172.21.15.33:0/3972914900 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3a1c0fefb0 con 0x7f3a04064dd0 2022-02-02T14:51:53.617 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:51:53.617 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (77m) 39m ago 78m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:51:53.617 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (70m) 39m ago 78m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:51:53.618 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (70m) 39m ago 77m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:51:53.618 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (77m) 39m ago 77m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:51:53.618 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (70m) 39m ago 74m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:51:53.618 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (71m) 39m ago 74m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:51:53.619 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (72m) 39m ago 74m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:51:53.619 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (74m) 39m ago 74m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:51:53.619 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (71m) 39m ago 79m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:51:53.619 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (71m) 39m ago 77m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:51:53.620 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (71m) 39m ago 79m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:51:53.620 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (70m) 39m ago 77m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:51:53.620 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (77m) 39m ago 77m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:51:53.620 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (77m) 39m ago 77m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:51:53.621 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 39m ago 76m - 4096M 2022-02-02T14:51:53.621 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (76m) 39m ago 76m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:51:53.621 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (76m) 39m ago 76m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:51:53.621 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (76m) 39m ago 76m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:51:53.622 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (75m) 39m ago 75m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:51:53.622 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (75m) 39m ago 75m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:51:53.622 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (76m) 39m ago 77m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:51:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 msgr2=0x7f3a04067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 0x7f3a04067290 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f3a0c004630 tx=0x7f3a0c009b30).stop 2022-02-02T14:51:53.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 msgr2=0x7f3a1c069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7f3a10002700 tx=0x7f3a10009e00).stop 2022-02-02T14:51:53.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 shutdown_connections 2022-02-02T14:51:53.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a04064dd0 0x7f3a04067290 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0f66e0 0x7f3a1c068d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 --2- 172.21.15.33:0/3972914900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a1c0f7980 0x7f3a1c069230 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 >> 172.21.15.33:0/3972914900 conn(0x7f3a1c0f1e40 msgr2=0x7f3a1c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 shutdown_connections 2022-02-02T14:51:53.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.619+0000 7f3a228bf700 1 -- 172.21.15.33:0/3972914900 wait complete. 2022-02-02T14:51:53.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 -- 172.21.15.33:0/325196530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f66e0 msgr2=0x7f37180f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 --2- 172.21.15.33:0/325196530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f66e0 0x7f37180f6b00 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7f3708004660 tx=0x7f3708009b30).stop 2022-02-02T14:51:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 -- 172.21.15.33:0/325196530 shutdown_connections 2022-02-02T14:51:53.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 --2- 172.21.15.33:0/325196530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f7980 0x7f37180f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 --2- 172.21.15.33:0/325196530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f66e0 0x7f37180f6b00 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 -- 172.21.15.33:0/325196530 >> 172.21.15.33:0/325196530 conn(0x7f37180f1e40 msgr2=0x7f37180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.719+0000 7f371d078700 1 -- 172.21.15.33:0/325196530 shutdown_connections 2022-02-02T14:51:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.720+0000 7f371d078700 1 -- 172.21.15.33:0/325196530 wait complete. 2022-02-02T14:51:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.720+0000 7f371d078700 1 Processor -- start 2022-02-02T14:51:53.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.720+0000 7f371d078700 1 -- start start 2022-02-02T14:51:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371d078700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 0x7f371806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371d078700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371d078700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371806a380 con 0x7f37180f7980 2022-02-02T14:51:53.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371d078700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371806a4c0 con 0x7f37180f66e0 2022-02-02T14:51:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34868/0 (socket says 172.21.15.33:34868) 2022-02-02T14:51:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 -- 172.21.15.33:0/1155602900 learned_addr learned my addr 172.21.15.33:0/1155602900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:53.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f3716d9d700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 0x7f371806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 -- 172.21.15.33:0/1155602900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 msgr2=0x7f371806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 0x7f371806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 -- 172.21.15.33:0/1155602900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708005040 con 0x7f37180f7980 2022-02-02T14:51:53.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f3716d9d700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 0x7f371806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:51:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.721+0000 7f371659c700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f370000c530 tx=0x7f3700007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.722+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f370000f650 con 0x7f37180f7980 2022-02-02T14:51:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.722+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f370000fc60 con 0x7f37180f7980 2022-02-02T14:51:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.722+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371806a7a0 con 0x7f37180f7980 2022-02-02T14:51:53.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.722+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371810efe0 con 0x7f37180f7980 2022-02-02T14:51:53.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.722+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3700012c20 con 0x7f37180f7980 2022-02-02T14:51:53.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.723+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3700010070 con 0x7f37180f7980 2022-02-02T14:51:53.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.723+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc004fa0 con 0x7f37180f7980 2022-02-02T14:51:53.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.724+0000 7f370f7fe700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 0x7f3704067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:53.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.724+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3700081690 con 0x7f37180f7980 2022-02-02T14:51:53.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.724+0000 7f3716d9d700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 0x7f3704067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.724+0000 7f3716d9d700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 0x7f3704067290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f3708013690 tx=0x7f3708009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.728+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f370004f740 con 0x7f37180f7980 2022-02-02T14:51:53.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.975+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f36fc005e80 con 0x7f37180f7980 2022-02-02T14:51:53.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.976+0000 7f370f7fe700 1 -- 172.21.15.33:0/1155602900 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3700052d60 con 0x7f37180f7980 2022-02-02T14:51:53.976 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:51:53.976 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:51:53.976 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:51:53.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:53.977 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:51:53.977 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:51:53.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:53.977 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:51:53.978 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:51:53.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:53.978 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:51:53.978 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:51:53.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:51:53.979 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:51:53.979 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:51:53.979 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:51:53.980 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:51:53.980 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:51:53.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 msgr2=0x7f3704067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 0x7f3704067290 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f3708013690 tx=0x7f3708009b30).stop 2022-02-02T14:51:53.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 msgr2=0x7f3718069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:53.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f370000c530 tx=0x7f3700007e20).stop 2022-02-02T14:51:53.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 shutdown_connections 2022-02-02T14:51:53.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3704064dd0 0x7f3704067290 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37180f66e0 0x7f371806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 --2- 172.21.15.33:0/1155602900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37180f7980 0x7f3718069e20 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:53.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 >> 172.21.15.33:0/1155602900 conn(0x7f37180f1e40 msgr2=0x7f37180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:53.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 shutdown_connections 2022-02-02T14:51:53.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:53.978+0000 7f371d078700 1 -- 172.21.15.33:0/1155602900 wait complete. 2022-02-02T14:51:54.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/2917652622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f55c0 msgr2=0x7f8f880f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:54.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/2917652622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f55c0 0x7f8f880f59e0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f8f7c004660 tx=0x7f8f7c009b30).stop 2022-02-02T14:51:54.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/2917652622 shutdown_connections 2022-02-02T14:51:54.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/2917652622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f6860 0x7f8f880f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/2917652622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f55c0 0x7f8f880f59e0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/2917652622 >> 172.21.15.33:0/2917652622 conn(0x7f8f880f0d40 msgr2=0x7f8f880f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:54.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/2917652622 shutdown_connections 2022-02-02T14:51:54.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/2917652622 wait complete. 2022-02-02T14:51:54.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.079+0000 7f8f8f0d4700 1 Processor -- start 2022-02-02T14:51:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8f0d4700 1 -- start start 2022-02-02T14:51:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8f0d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 0x7f8f88109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8f0d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8f0d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88060420 con 0x7f8f880f6860 2022-02-02T14:51:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8f0d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f88060560 con 0x7f8f880f55c0 2022-02-02T14:51:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34878/0 (socket says 172.21.15.33:34878) 2022-02-02T14:51:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 -- 172.21.15.33:0/403372485 learned_addr learned my addr 172.21.15.33:0/403372485 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:51:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8ce70700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 0x7f8f88109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 -- 172.21.15.33:0/403372485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 msgr2=0x7f8f88109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 0x7f8f88109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f87fff700 1 -- 172.21.15.33:0/403372485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c005040 con 0x7f8f880f6860 2022-02-02T14:51:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.080+0000 7f8f8ce70700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 0x7f8f88109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:51:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f87fff700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f8f7400c530 tx=0x7f8f74007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f7400f650 con 0x7f8f880f6860 2022-02-02T14:51:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8810c740 con 0x7f8f880f6860 2022-02-02T14:51:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8f7400fc60 con 0x7f8f880f6860 2022-02-02T14:51:54.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f74012cd0 con 0x7f8f880f6860 2022-02-02T14:51:54.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.081+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8810ccd0 con 0x7f8f880f6860 2022-02-02T14:51:54.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.082+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f88045ad0 con 0x7f8f880f6860 2022-02-02T14:51:54.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.083+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8f74010070 con 0x7f8f880f6860 2022-02-02T14:51:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.083+0000 7f8f857fa700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 0x7f8f78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:51:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.083+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8f74081fe0 con 0x7f8f880f6860 2022-02-02T14:51:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.083+0000 7f8f8ce70700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 0x7f8f78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:51:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.084+0000 7f8f8ce70700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 0x7f8f78067290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f8f7c004e30 tx=0x7f8f7c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:51:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.086+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8f74050090 con 0x7f8f880f6860 2022-02-02T14:51:54.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.322+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f88027a00 con 0x7f8f880f6860 2022-02-02T14:51:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.323+0000 7f8f857fa700 1 -- 172.21.15.33:0/403372485 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f8f74020070 con 0x7f8f880f6860 2022-02-02T14:51:54.322 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:51:54.323 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:51:54.323 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:51:54.323 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:51:54.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:54.324 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:51:54.324 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:51:54.324 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:51:54.324 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:51:54.325 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:51:54.325 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:51:54.325 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:51:54.325 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:51:54.325 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:51:54.326 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:51:54.326 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:51:54.326 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:51:54.326 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:51:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:51:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:51:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:51:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:51:54.327 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:51:54.328 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:51:54.328 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:51:54.328 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:51:54.328 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:51:54.329 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:51:54.329 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:51:54.329 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:51:54.329 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:51:54.329 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:54.330 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:54.330 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:51:54.330 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:51:54.330 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:54.330 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:54.331 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:54.331 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:51:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.324+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 msgr2=0x7f8f78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.324+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 0x7f8f78067290 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f8f7c004e30 tx=0x7f8f7c009b30).stop 2022-02-02T14:51:54.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.324+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 msgr2=0x7f8f8810c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:51:54.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.324+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f8f7400c530 tx=0x7f8f74007e20).stop 2022-02-02T14:51:54.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 shutdown_connections 2022-02-02T14:51:54.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8f78064dd0 0x7f8f78067290 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f880f55c0 0x7f8f88109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 --2- 172.21.15.33:0/403372485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f880f6860 0x7f8f8810c130 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:51:54.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 >> 172.21.15.33:0/403372485 conn(0x7f8f880f0d40 msgr2=0x7f8f880fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:51:54.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 shutdown_connections 2022-02-02T14:51:54.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:51:54.325+0000 7f8f8f0d4700 1 -- 172.21.15.33:0/403372485 wait complete. 2022-02-02T14:51:54.334 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:51:54.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='client.36324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: pgmap v2195: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1155602900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:51:54.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/403372485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:51:54.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:51:54.741 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:51:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='client.36324 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: pgmap v2195: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='client.36328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:51:55.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1155602900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:51:55.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/403372485' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:51:55.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:51:55.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:51:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:56 smithi033 ceph-mon[101165]: pgmap v2196: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:56 smithi037 ceph-mon[69017]: pgmap v2196: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:58.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:51:58 smithi033 ceph-mon[101165]: pgmap v2197: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:51:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:51:58 smithi037 ceph-mon[69017]: pgmap v2197: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:00 smithi033 ceph-mon[101165]: pgmap v2198: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:00 smithi037 ceph-mon[69017]: pgmap v2198: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:02 smithi033 ceph-mon[101165]: pgmap v2199: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:02 smithi037 ceph-mon[69017]: pgmap v2199: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:04 smithi033 ceph-mon[101165]: pgmap v2200: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:04 smithi037 ceph-mon[69017]: pgmap v2200: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:06 smithi033 ceph-mon[101165]: pgmap v2201: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:06 smithi037 ceph-mon[69017]: pgmap v2201: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:08 smithi033 ceph-mon[101165]: pgmap v2202: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:08 smithi037 ceph-mon[69017]: pgmap v2202: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:10 smithi033 ceph-mon[101165]: pgmap v2203: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:10 smithi037 ceph-mon[69017]: pgmap v2203: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:12 smithi033 ceph-mon[101165]: pgmap v2204: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:12 smithi037 ceph-mon[69017]: pgmap v2204: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:14 smithi033 ceph-mon[101165]: pgmap v2205: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:14 smithi037 ceph-mon[69017]: pgmap v2205: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:16 smithi033 ceph-mon[101165]: pgmap v2206: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:16 smithi037 ceph-mon[69017]: pgmap v2206: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:18 smithi033 ceph-mon[101165]: pgmap v2207: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:18 smithi037 ceph-mon[69017]: pgmap v2207: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:20 smithi033 ceph-mon[101165]: pgmap v2208: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:20 smithi037 ceph-mon[69017]: pgmap v2208: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:22.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:22 smithi033 ceph-mon[101165]: pgmap v2209: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:22 smithi037 ceph-mon[69017]: pgmap v2209: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.437+0000 7f375cec1700 1 -- 172.21.15.33:0/413128087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37580fbb90 msgr2=0x7f37580fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.437+0000 7f375cec1700 1 --2- 172.21.15.33:0/413128087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37580fbb90 0x7f37580fdf80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f374c004660 tx=0x7f374c009b30).stop 2022-02-02T14:52:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- 172.21.15.33:0/413128087 shutdown_connections 2022-02-02T14:52:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 --2- 172.21.15.33:0/413128087 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37580fbb90 0x7f37580fdf80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 --2- 172.21.15.33:0/413128087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3758060310 0x7f37580fb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- 172.21.15.33:0/413128087 >> 172.21.15.33:0/413128087 conn(0x7f37580f0d40 msgr2=0x7f37580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:24.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- 172.21.15.33:0/413128087 shutdown_connections 2022-02-02T14:52:24.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- 172.21.15.33:0/413128087 wait complete. 2022-02-02T14:52:24.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 Processor -- start 2022-02-02T14:52:24.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- start start 2022-02-02T14:52:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37580fbb90 0x7f3758109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758109bf0 con 0x7f3758060310 2022-02-02T14:52:24.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.438+0000 7f375cec1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3758109d30 con 0x7f37580fbb90 2022-02-02T14:52:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34886/0 (socket says 172.21.15.33:34886) 2022-02-02T14:52:24.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 -- 172.21.15.33:0/1137838623 learned_addr learned my addr 172.21.15.33:0/1137838623 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f3755d9b700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37580fbb90 0x7f3758109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 -- 172.21.15.33:0/1137838623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37580fbb90 msgr2=0x7f3758109640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37580fbb90 0x7f3758109640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 -- 172.21.15.33:0/1137838623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c005040 con 0x7f3758060310 2022-02-02T14:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.439+0000 7f375659c700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f37480026d0 tx=0x7f3748009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.440+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37480079c0 con 0x7f3758060310 2022-02-02T14:52:24.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.440+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f374800f040 con 0x7f3758060310 2022-02-02T14:52:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.440+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375810a6d0 con 0x7f3758060310 2022-02-02T14:52:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.440+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37480148b0 con 0x7f3758060310 2022-02-02T14:52:24.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.440+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375810ac90 con 0x7f3758060310 2022-02-02T14:52:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.441+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3758045ad0 con 0x7f3758060310 2022-02-02T14:52:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.441+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3748007b20 con 0x7f3758060310 2022-02-02T14:52:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.441+0000 7f3746ffd700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 0x7f3740067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.442+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f37480819f0 con 0x7f3758060310 2022-02-02T14:52:24.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.442+0000 7f3755d9b700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 0x7f3740067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.442+0000 7f3755d9b700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 0x7f3740067290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f374c005010 tx=0x7f374c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:24.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.446+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3748083e60 con 0x7f3758060310 2022-02-02T14:52:24.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.638+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3758101240 con 0x7f3740064dd0 2022-02-02T14:52:24.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.639+0000 7f3746ffd700 1 -- 172.21.15.33:0/1137838623 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f374c019040 con 0x7f3740064dd0 2022-02-02T14:52:24.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 msgr2=0x7f3740067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 0x7f3740067290 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f374c005010 tx=0x7f374c009b30).stop 2022-02-02T14:52:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 msgr2=0x7f3758109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 rx=0x7f37480026d0 tx=0x7f3748009de0).stop 2022-02-02T14:52:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 shutdown_connections 2022-02-02T14:52:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3740064dd0 0x7f3740067290 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3758060310 0x7f3758109150 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 --2- 172.21.15.33:0/1137838623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37580fbb90 0x7f3758109640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 >> 172.21.15.33:0/1137838623 conn(0x7f37580f0d40 msgr2=0x7f37580f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 shutdown_connections 2022-02-02T14:52:24.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.641+0000 7f375cec1700 1 -- 172.21.15.33:0/1137838623 wait complete. 2022-02-02T14:52:24.650 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:52:24.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:24 smithi033 ceph-mon[101165]: pgmap v2210: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:24.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 -- 172.21.15.33:0/1316583627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 msgr2=0x7f4f580f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 --2- 172.21.15.33:0/1316583627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f580f7de0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f4f48004660 tx=0x7f4f48009b30).stop 2022-02-02T14:52:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 -- 172.21.15.33:0/1316583627 shutdown_connections 2022-02-02T14:52:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 --2- 172.21.15.33:0/1316583627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f580f7de0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 --2- 172.21.15.33:0/1316583627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f580f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 -- 172.21.15.33:0/1316583627 >> 172.21.15.33:0/1316583627 conn(0x7f4f580f1e40 msgr2=0x7f4f580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 -- 172.21.15.33:0/1316583627 shutdown_connections 2022-02-02T14:52:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.742+0000 7f4f60545700 1 -- 172.21.15.33:0/1316583627 wait complete. 2022-02-02T14:52:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 Processor -- start 2022-02-02T14:52:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 -- start start 2022-02-02T14:52:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f5806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806a380 con 0x7f4f580f7980 2022-02-02T14:52:24.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f60545700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806a4c0 con 0x7f4f580f66e0 2022-02-02T14:52:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f5dae0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f5dae0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34898/0 (socket says 172.21.15.33:34898) 2022-02-02T14:52:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f5dae0700 1 -- 172.21.15.33:0/2929987833 learned_addr learned my addr 172.21.15.33:0/2929987833 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.743+0000 7f4f5e2e1700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f5806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f5dae0700 1 -- 172.21.15.33:0/2929987833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 msgr2=0x7f4f5806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f5dae0700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f5806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f5dae0700 1 -- 172.21.15.33:0/2929987833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f48005040 con 0x7f4f580f7980 2022-02-02T14:52:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f5e2e1700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f5806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:52:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f5dae0700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f4f48009990 tx=0x7f4f48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f48018070 con 0x7f4f580f7980 2022-02-02T14:52:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4f48007ba0 con 0x7f4f580f7980 2022-02-02T14:52:24.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5806a740 con 0x7f4f580f7980 2022-02-02T14:52:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4801c3c0 con 0x7f4f580f7980 2022-02-02T14:52:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.744+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5806aca0 con 0x7f4f580f7980 2022-02-02T14:52:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.745+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f58045ad0 con 0x7f4f580f7980 2022-02-02T14:52:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.745+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4f4801d420 con 0x7f4f580f7980 2022-02-02T14:52:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.746+0000 7f4f4effd700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 0x7f4f44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.746+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4f48083790 con 0x7f4f580f7980 2022-02-02T14:52:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.746+0000 7f4f5e2e1700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 0x7f4f44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.746+0000 7f4f5e2e1700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 0x7f4f44067290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f4f5806b730 tx=0x7f4f54009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.750+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4f480518a0 con 0x7f4f580f7980 2022-02-02T14:52:24.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.931+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f58057f10 con 0x7f4f44064dd0 2022-02-02T14:52:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.946+0000 7f4f4effd700 1 -- 172.21.15.33:0/2929987833 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4f58057f10 con 0x7f4f44064dd0 2022-02-02T14:52:24.945 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:52:24.945 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (77m) 39m ago 78m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:52:24.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (70m) 39m ago 78m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:52:24.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (70m) 39m ago 78m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:52:24.946 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (77m) 39m ago 78m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:52:24.946 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (71m) 39m ago 74m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:52:24.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (71m) 39m ago 74m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:52:24.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (72m) 39m ago 74m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:52:24.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (74m) 39m ago 74m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:52:24.947 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (72m) 39m ago 80m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:52:24.948 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (71m) 39m ago 78m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:52:24.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (71m) 39m ago 80m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:52:24.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (71m) 39m ago 78m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:52:24.948 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (78m) 39m ago 78m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:52:24.948 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (77m) 39m ago 77m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:52:24.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 39m ago 77m - 4096M 2022-02-02T14:52:24.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (77m) 39m ago 77m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:52:24.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (76m) 39m ago 76m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:52:24.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (76m) 39m ago 76m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:52:24.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (76m) 39m ago 76m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:52:24.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (76m) 39m ago 76m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:52:24.950 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (77m) 39m ago 78m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:52:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 msgr2=0x7f4f44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 0x7f4f44067290 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f4f5806b730 tx=0x7f4f54009c00).stop 2022-02-02T14:52:24.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 msgr2=0x7f4f58069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7f4f48009990 tx=0x7f4f48009b30).stop 2022-02-02T14:52:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 shutdown_connections 2022-02-02T14:52:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4f44064dd0 0x7f4f44067290 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f580f66e0 0x7f4f5806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 --2- 172.21.15.33:0/2929987833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f580f7980 0x7f4f58069e20 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:24.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 >> 172.21.15.33:0/2929987833 conn(0x7f4f580f1e40 msgr2=0x7f4f580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:24.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 shutdown_connections 2022-02-02T14:52:24.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:24.948+0000 7f4f60545700 1 -- 172.21.15.33:0/2929987833 wait complete. 2022-02-02T14:52:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:24 smithi037 ceph-mon[69017]: pgmap v2210: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:25.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/3996817176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 msgr2=0x7f3a340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/3996817176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a340f59e0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f3a30004660 tx=0x7f3a30009b30).stop 2022-02-02T14:52:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/3996817176 shutdown_connections 2022-02-02T14:52:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/3996817176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a340f6860 0x7f3a340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/3996817176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a340f59e0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.047+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/3996817176 >> 172.21.15.33:0/3996817176 conn(0x7f3a340f0d40 msgr2=0x7f3a340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:25.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/3996817176 shutdown_connections 2022-02-02T14:52:25.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/3996817176 wait complete. 2022-02-02T14:52:25.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 Processor -- start 2022-02-02T14:52:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 -- start start 2022-02-02T14:52:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a340f6860 0x7f3a34109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34109c10 con 0x7f3a340f55c0 2022-02-02T14:52:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.048+0000 7f3a3bf6d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34109d50 con 0x7f3a340f6860 2022-02-02T14:52:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34906/0 (socket says 172.21.15.33:34906) 2022-02-02T14:52:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 -- 172.21.15.33:0/660392393 learned_addr learned my addr 172.21.15.33:0/660392393 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 -- 172.21.15.33:0/660392393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a340f6860 msgr2=0x7f3a34109660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-02-02T14:52:25.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a340f6860 0x7f3a34109660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:52:25.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 -- 172.21.15.33:0/660392393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30005040 con 0x7f3a340f55c0 2022-02-02T14:52:25.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a39d09700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f3a30013a70 tx=0x7f3a30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:25.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a30018070 con 0x7f3a340f55c0 2022-02-02T14:52:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3410a690 con 0x7f3a340f55c0 2022-02-02T14:52:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3a300097d0 con 0x7f3a340f55c0 2022-02-02T14:52:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3001c3c0 con 0x7f3a340f55c0 2022-02-02T14:52:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.049+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3410abf0 con 0x7f3a340f55c0 2022-02-02T14:52:25.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.050+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a34045ad0 con 0x7f3a340f55c0 2022-02-02T14:52:25.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.051+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3a30007ba0 con 0x7f3a340f55c0 2022-02-02T14:52:25.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.051+0000 7f3a267fc700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 0x7f3a20067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.052+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3a30083700 con 0x7f3a340f55c0 2022-02-02T14:52:25.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.052+0000 7f3a39508700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 0x7f3a20067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:25.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.052+0000 7f3a39508700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 0x7f3a20067290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3a28004a10 tx=0x7f3a28009a70).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:25.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.056+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3a300551e0 con 0x7f3a340f55c0 2022-02-02T14:52:25.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.302+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3a3410f790 con 0x7f3a340f55c0 2022-02-02T14:52:25.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.303+0000 7f3a267fc700 1 -- 172.21.15.33:0/660392393 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3a30054dd0 con 0x7f3a340f55c0 2022-02-02T14:52:25.302 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:52:25.303 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:52:25.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:52:25.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:25.303 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:52:25.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:52:25.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:25.304 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:52:25.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:52:25.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:25.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:52:25.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:52:25.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:25.306 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:52:25.306 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:52:25.306 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:52:25.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:52:25.307 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:52:25.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 msgr2=0x7f3a20067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 0x7f3a20067290 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f3a28004a10 tx=0x7f3a28009a70).stop 2022-02-02T14:52:25.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 msgr2=0x7f3a34109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f3a30013a70 tx=0x7f3a30009b30).stop 2022-02-02T14:52:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 shutdown_connections 2022-02-02T14:52:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3a20064dd0 0x7f3a20067290 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a340f55c0 0x7f3a34109170 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 --2- 172.21.15.33:0/660392393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a340f6860 0x7f3a34109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:52:25.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 >> 172.21.15.33:0/660392393 conn(0x7f3a340f0d40 msgr2=0x7f3a3405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:25.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 shutdown_connections 2022-02-02T14:52:25.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.304+0000 7f3a3bf6d700 1 -- 172.21.15.33:0/660392393 wait complete. 2022-02-02T14:52:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- 172.21.15.33:0/4170987130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 msgr2=0x7fc6d80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 --2- 172.21.15.33:0/4170987130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d80f59e0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7fc6cc004660 tx=0x7fc6cc009b30).stop 2022-02-02T14:52:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- 172.21.15.33:0/4170987130 shutdown_connections 2022-02-02T14:52:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 --2- 172.21.15.33:0/4170987130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 --2- 172.21.15.33:0/4170987130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d80f59e0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- 172.21.15.33:0/4170987130 >> 172.21.15.33:0/4170987130 conn(0x7fc6d80f0d40 msgr2=0x7fc6d80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- 172.21.15.33:0/4170987130 shutdown_connections 2022-02-02T14:52:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- 172.21.15.33:0/4170987130 wait complete. 2022-02-02T14:52:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 Processor -- start 2022-02-02T14:52:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.405+0000 7fc6df146700 1 -- start start 2022-02-02T14:52:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6df146700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6df146700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6df146700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d80603e0 con 0x7fc6d80f55c0 2022-02-02T14:52:25.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6df146700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d8060520 con 0x7fc6d80f6860 2022-02-02T14:52:25.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34916/0 (socket says 172.21.15.33:34916) 2022-02-02T14:52:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 -- 172.21.15.33:0/408331915 learned_addr learned my addr 172.21.15.33:0/408331915 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6d7fff700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 -- 172.21.15.33:0/408331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 msgr2=0x7fc6d810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 -- 172.21.15.33:0/408331915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc005040 con 0x7fc6d80f55c0 2022-02-02T14:52:25.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6d7fff700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:52:25.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6dcee2700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fc6cc004f60 tx=0x7fc6cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:25.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6cc018070 con 0x7fc6d80f55c0 2022-02-02T14:52:25.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc6cc007ba0 con 0x7fc6d80f55c0 2022-02-02T14:52:25.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d810c6c0 con 0x7fc6d80f55c0 2022-02-02T14:52:25.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.406+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6cc01c620 con 0x7fc6d80f55c0 2022-02-02T14:52:25.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.407+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d810cc20 con 0x7fc6d80f55c0 2022-02-02T14:52:25.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.407+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d8045ad0 con 0x7fc6d80f55c0 2022-02-02T14:52:25.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.408+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc6cc01d420 con 0x7fc6d80f55c0 2022-02-02T14:52:25.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.408+0000 7fc6d57fa700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 0x7fc6c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:25.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.408+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc6cc0838e0 con 0x7fc6d80f55c0 2022-02-02T14:52:25.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.409+0000 7fc6d7fff700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 0x7fc6c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:25.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.409+0000 7fc6d7fff700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 0x7fc6c8067290 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc6c4004a90 tx=0x7fc6c4009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:25.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.413+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc6cc051a50 con 0x7fc6d80f55c0 2022-02-02T14:52:25.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.633+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6d8027a00 con 0x7fc6d80f55c0 2022-02-02T14:52:25.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.633+0000 7fc6d57fa700 1 -- 172.21.15.33:0/408331915 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc6cc055070 con 0x7fc6d80f55c0 2022-02-02T14:52:25.633 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:52:25.633 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:52:25.634 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:52:25.634 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:52:25.634 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:25.634 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:52:25.635 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:52:25.635 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:52:25.635 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:52:25.635 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:52:25.636 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:52:25.636 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:52:25.636 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:52:25.636 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:52:25.637 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:52:25.637 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:52:25.637 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:52:25.637 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:52:25.638 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:52:25.638 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:52:25.638 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:52:25.638 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:52:25.639 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:52:25.639 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:52:25.639 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:52:25.639 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:52:25.640 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:52:25.640 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:52:25.640 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:52:25.640 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:52:25.641 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:52:25.641 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:25.641 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:25.641 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:52:25.641 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:25.642 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:25.642 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:25.642 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:25.642 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:25.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 msgr2=0x7fc6c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 0x7fc6c8067290 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc6c4004a90 tx=0x7fc6c4009040).stop 2022-02-02T14:52:25.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 msgr2=0x7fc6d8109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:25.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7fc6cc004f60 tx=0x7fc6cc009b30).stop 2022-02-02T14:52:25.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 shutdown_connections 2022-02-02T14:52:25.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc6c8064dd0 0x7fc6c8067290 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6d80f55c0 0x7fc6d8109c70 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 --2- 172.21.15.33:0/408331915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d80f6860 0x7fc6d810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:25.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 >> 172.21.15.33:0/408331915 conn(0x7fc6d80f0d40 msgr2=0x7fc6d80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:25.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 shutdown_connections 2022-02-02T14:52:25.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:25.635+0000 7fc6df146700 1 -- 172.21.15.33:0/408331915 wait complete. 2022-02-02T14:52:25.647 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:52:25.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:25 smithi033 ceph-mon[101165]: from='client.36340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:25.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:25 smithi033 ceph-mon[101165]: from='client.36344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:25.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/660392393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:52:25.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:25 smithi033 ceph-mon[101165]: pgmap v2211: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:26.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:25 smithi037 ceph-mon[69017]: from='client.36340 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:26.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:25 smithi037 ceph-mon[69017]: from='client.36344 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:26.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/660392393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:52:26.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:25 smithi037 ceph-mon[69017]: pgmap v2211: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:26 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/408331915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:52:27.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:26 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/408331915' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:52:27.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:27 smithi037 ceph-mon[69017]: pgmap v2212: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:27.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:27 smithi033 ceph-mon[101165]: pgmap v2212: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:30.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:30 smithi033 ceph-mon[101165]: pgmap v2213: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:30.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:30 smithi037 ceph-mon[69017]: pgmap v2213: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:32 smithi033 ceph-mon[101165]: pgmap v2214: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:32 smithi037 ceph-mon[69017]: pgmap v2214: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:34 smithi033 ceph-mon[101165]: pgmap v2215: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:34 smithi037 ceph-mon[69017]: pgmap v2215: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:36 smithi033 ceph-mon[101165]: pgmap v2216: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:36 smithi037 ceph-mon[69017]: pgmap v2216: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:38 smithi033 ceph-mon[101165]: pgmap v2217: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:38 smithi037 ceph-mon[69017]: pgmap v2217: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:40 smithi033 ceph-mon[101165]: pgmap v2218: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:40 smithi037 ceph-mon[69017]: pgmap v2218: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:42 smithi033 ceph-mon[101165]: pgmap v2219: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:42 smithi037 ceph-mon[69017]: pgmap v2219: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:44 smithi033 ceph-mon[101165]: pgmap v2220: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:44 smithi037 ceph-mon[69017]: pgmap v2220: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:46 smithi033 ceph-mon[101165]: pgmap v2221: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:46 smithi037 ceph-mon[69017]: pgmap v2221: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:48 smithi033 ceph-mon[101165]: pgmap v2222: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:48 smithi037 ceph-mon[69017]: pgmap v2222: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:50 smithi033 ceph-mon[101165]: pgmap v2223: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:50 smithi037 ceph-mon[69017]: pgmap v2223: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:52 smithi033 ceph-mon[101165]: pgmap v2224: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:52 smithi037 ceph-mon[69017]: pgmap v2224: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:54 smithi033 ceph-mon[101165]: pgmap v2225: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:52:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:52:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:54 smithi037 ceph-mon[69017]: pgmap v2225: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:52:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:52:55.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 -- 172.21.15.33:0/3040300353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f6860 msgr2=0x7f73c40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:55.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3040300353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f6860 0x7f73c40f6cc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f73b4004660 tx=0x7f73b4009b30).stop 2022-02-02T14:52:55.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 -- 172.21.15.33:0/3040300353 shutdown_connections 2022-02-02T14:52:55.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3040300353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f6860 0x7f73c40f6cc0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3040300353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f55c0 0x7f73c40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 -- 172.21.15.33:0/3040300353 >> 172.21.15.33:0/3040300353 conn(0x7f73c40f0d40 msgr2=0x7f73c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:55.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 -- 172.21.15.33:0/3040300353 shutdown_connections 2022-02-02T14:52:55.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.749+0000 7f73cbc40700 1 -- 172.21.15.33:0/3040300353 wait complete. 2022-02-02T14:52:55.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 Processor -- start 2022-02-02T14:52:55.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 -- start start 2022-02-02T14:52:55.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:55.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f6860 0x7f73c41073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:55.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4107970 con 0x7f73c40f55c0 2022-02-02T14:52:55.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73cbc40700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c4107ab0 con 0x7f73c40f6860 2022-02-02T14:52:55.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73c99dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:55.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73c99dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34926/0 (socket says 172.21.15.33:34926) 2022-02-02T14:52:55.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73c99dc700 1 -- 172.21.15.33:0/3240554975 learned_addr learned my addr 172.21.15.33:0/3240554975 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.750+0000 7f73c91db700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f6860 0x7f73c41073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73c99dc700 1 -- 172.21.15.33:0/3240554975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f6860 msgr2=0x7f73c41073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:55.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73c99dc700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f6860 0x7f73c41073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73c99dc700 1 -- 172.21.15.33:0/3240554975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4005040 con 0x7f73c40f55c0 2022-02-02T14:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73c99dc700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f73c000e7c0 tx=0x7f73c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c00092e0 con 0x7f73c40f55c0 2022-02-02T14:52:55.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c4108450 con 0x7f73c40f55c0 2022-02-02T14:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f73c000f040 con 0x7f73c40f55c0 2022-02-02T14:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73c00147e0 con 0x7f73c40f55c0 2022-02-02T14:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.751+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c4108a10 con 0x7f73c40f55c0 2022-02-02T14:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.752+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c4045ad0 con 0x7f73c40f55c0 2022-02-02T14:52:55.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.753+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f73c001b030 con 0x7f73c40f55c0 2022-02-02T14:52:55.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.753+0000 7f73ba7fc700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 0x7f73a8067220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:55.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.753+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f73c0081a00 con 0x7f73c40f55c0 2022-02-02T14:52:55.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.753+0000 7f73c91db700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 0x7f73a8067220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:55.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.753+0000 7f73c91db700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 0x7f73a8067220 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f73b4005010 tx=0x7f73b4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:55.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.757+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f73c00534e0 con 0x7f73c40f55c0 2022-02-02T14:52:55.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.947+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73c405fd30 con 0x7f73a8064d60 2022-02-02T14:52:55.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.949+0000 7f73ba7fc700 1 -- 172.21.15.33:0/3240554975 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f73c405fd30 con 0x7f73a8064d60 2022-02-02T14:52:55.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 msgr2=0x7f73a8067220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 0x7f73a8067220 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f73b4005010 tx=0x7f73b4016040).stop 2022-02-02T14:52:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 msgr2=0x7f73c4106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:55.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f73c000e7c0 tx=0x7f73c000b040).stop 2022-02-02T14:52:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 shutdown_connections 2022-02-02T14:52:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f73a8064d60 0x7f73a8067220 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73c40f55c0 0x7f73c4106ed0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 --2- 172.21.15.33:0/3240554975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73c40f6860 0x7f73c41073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 >> 172.21.15.33:0/3240554975 conn(0x7f73c40f0d40 msgr2=0x7f73c405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 shutdown_connections 2022-02-02T14:52:55.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:55.950+0000 7f73cbc40700 1 -- 172.21.15.33:0/3240554975 wait complete. 2022-02-02T14:52:55.959 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:52:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/3590621530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f5430 msgr2=0x7f8d880f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/3590621530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f5430 0x7f8d880f5850 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f8d78004660 tx=0x7f8d78009b30).stop 2022-02-02T14:52:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/3590621530 shutdown_connections 2022-02-02T14:52:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/3590621530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f66d0 0x7f8d880f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/3590621530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f5430 0x7f8d880f5850 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.051+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/3590621530 >> 172.21.15.33:0/3590621530 conn(0x7f8d880f0b90 msgr2=0x7f8d880f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.052+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/3590621530 shutdown_connections 2022-02-02T14:52:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.052+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/3590621530 wait complete. 2022-02-02T14:52:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 Processor -- start 2022-02-02T14:52:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 -- start start 2022-02-02T14:52:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f5430 0x7f8d88105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d881067d0 con 0x7f8d880f66d0 2022-02-02T14:52:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d8ca4c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88106fd0 con 0x7f8d880f5430 2022-02-02T14:52:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d86ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d86ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34938/0 (socket says 172.21.15.33:34938) 2022-02-02T14:52:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d86ffd700 1 -- 172.21.15.33:0/1073784651 learned_addr learned my addr 172.21.15.33:0/1073784651 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.053+0000 7f8d877fe700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f5430 0x7f8d88105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d86ffd700 1 -- 172.21.15.33:0/1073784651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f5430 msgr2=0x7f8d88105d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d86ffd700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f5430 0x7f8d88105d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d86ffd700 1 -- 172.21.15.33:0/1073784651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78005040 con 0x7f8d880f66d0 2022-02-02T14:52:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d86ffd700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f8d7c00c790 tx=0x7f8d7c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c002590 con 0x7f8d880f66d0 2022-02-02T14:52:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d7c002ba0 con 0x7f8d880f66d0 2022-02-02T14:52:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d881072b0 con 0x7f8d880f66d0 2022-02-02T14:52:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d7c013d90 con 0x7f8d880f66d0 2022-02-02T14:52:56.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.054+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d88107870 con 0x7f8d880f66d0 2022-02-02T14:52:56.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.055+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d88045ad0 con 0x7f8d880f66d0 2022-02-02T14:52:56.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.056+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d7c01a060 con 0x7f8d880f66d0 2022-02-02T14:52:56.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.056+0000 7f8d6ffff700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.056+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8d7c081d10 con 0x7f8d880f66d0 2022-02-02T14:52:56.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.056+0000 7f8d877fe700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.057+0000 7f8d877fe700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 0x7f8d700672e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f8d78004630 tx=0x7f8d78009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.061+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d7c053790 con 0x7f8d880f66d0 2022-02-02T14:52:56.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.244+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d8805f620 con 0x7f8d70064e20 2022-02-02T14:52:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.258+0000 7f8d6ffff700 1 -- 172.21.15.33:0/1073784651 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8d8805f620 con 0x7f8d70064e20 2022-02-02T14:52:56.259 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:52:56.259 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (78m) 40m ago 79m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:52:56.260 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (71m) 40m ago 79m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:52:56.260 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (71m) 40m ago 78m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:52:56.260 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (78m) 40m ago 79m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:52:56.261 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (71m) 40m ago 75m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:52:56.261 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (72m) 40m ago 75m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:52:56.261 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (73m) 40m ago 75m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:52:56.261 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (75m) 40m ago 75m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:52:56.261 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (72m) 40m ago 80m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:52:56.262 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (72m) 40m ago 78m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:52:56.262 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (72m) 40m ago 80m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:52:56.263 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (71m) 40m ago 78m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:52:56.263 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (78m) 40m ago 78m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:52:56.263 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (78m) 40m ago 78m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:52:56.263 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 40m ago 77m - 4096M 2022-02-02T14:52:56.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (77m) 40m ago 77m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:52:56.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (77m) 40m ago 77m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:52:56.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (77m) 40m ago 77m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:52:56.264 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (76m) 40m ago 76m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:52:56.265 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (76m) 40m ago 76m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:52:56.265 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (78m) 40m ago 78m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:52:56.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 msgr2=0x7f8d700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 0x7f8d700672e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f8d78004630 tx=0x7f8d78009b30).stop 2022-02-02T14:52:56.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 msgr2=0x7f8d88106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f8d7c00c790 tx=0x7f8d7c007d70).stop 2022-02-02T14:52:56.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 shutdown_connections 2022-02-02T14:52:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d70064e20 0x7f8d700672e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d880f5430 0x7f8d88105d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 --2- 172.21.15.33:0/1073784651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d880f66d0 0x7f8d88106220 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 >> 172.21.15.33:0/1073784651 conn(0x7f8d880f0b90 msgr2=0x7f8d880fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 shutdown_connections 2022-02-02T14:52:56.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.260+0000 7f8d8ca4c700 1 -- 172.21.15.33:0/1073784651 wait complete. 2022-02-02T14:52:56.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 -- 172.21.15.33:0/1552455148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 msgr2=0x7f3e780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/1552455148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e780f59e0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f3e68004660 tx=0x7f3e68009b30).stop 2022-02-02T14:52:56.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 -- 172.21.15.33:0/1552455148 shutdown_connections 2022-02-02T14:52:56.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/1552455148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 0x7f3e780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/1552455148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e780f59e0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 -- 172.21.15.33:0/1552455148 >> 172.21.15.33:0/1552455148 conn(0x7f3e780f0d40 msgr2=0x7f3e780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 -- 172.21.15.33:0/1552455148 shutdown_connections 2022-02-02T14:52:56.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.360+0000 7f3e7cc97700 1 -- 172.21.15.33:0/1552455148 wait complete. 2022-02-02T14:52:56.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 Processor -- start 2022-02-02T14:52:56.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 -- start start 2022-02-02T14:52:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 0x7f3e78105250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78105850 con 0x7f3e780f55c0 2022-02-02T14:52:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7cc97700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78105990 con 0x7f3e780f6860 2022-02-02T14:52:56.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34946/0 (socket says 172.21.15.33:34946) 2022-02-02T14:52:56.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e7659c700 1 -- 172.21.15.33:0/2166039493 learned_addr learned my addr 172.21.15.33:0/2166039493 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:56.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.361+0000 7f3e75d9b700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 0x7f3e78105250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7659c700 1 -- 172.21.15.33:0/2166039493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 msgr2=0x7f3e78105250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7659c700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 0x7f3e78105250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7659c700 1 -- 172.21.15.33:0/2166039493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e68005040 con 0x7f3e780f55c0 2022-02-02T14:52:56.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7659c700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f3e68013a70 tx=0x7f3e68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e68018070 con 0x7f3e780f55c0 2022-02-02T14:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3e680097d0 con 0x7f3e780f55c0 2022-02-02T14:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7810b500 con 0x7f3e780f55c0 2022-02-02T14:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e6801de80 con 0x7f3e780f55c0 2022-02-02T14:52:56.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.362+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7810ba60 con 0x7f3e780f55c0 2022-02-02T14:52:56.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.363+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e78045ad0 con 0x7f3e780f55c0 2022-02-02T14:52:56.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.364+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3e68007ba0 con 0x7f3e780f55c0 2022-02-02T14:52:56.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.364+0000 7f3e6effd700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 0x7f3e64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.364+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3e680836b0 con 0x7f3e780f55c0 2022-02-02T14:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.364+0000 7f3e75d9b700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 0x7f3e64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.365+0000 7f3e75d9b700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 0x7f3e64067290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f3e60004c40 tx=0x7f3e6000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.368+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3e68051760 con 0x7f3e780f55c0 2022-02-02T14:52:56.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.610+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e780fc330 con 0x7f3e780f55c0 2022-02-02T14:52:56.611 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:56 smithi033 ceph-mon[101165]: pgmap v2226: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.611+0000 7f3e6effd700 1 -- 172.21.15.33:0/2166039493 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3e68054d80 con 0x7f3e780f55c0 2022-02-02T14:52:56.612 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:52:56.612 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:52:56.612 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:52:56.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:56.613 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:52:56.613 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:52:56.613 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:56.613 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:52:56.614 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:52:56.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:56.614 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:52:56.614 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:52:56.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:52:56.615 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:52:56.615 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:52:56.615 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:52:56.616 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:52:56.616 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:52:56.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 msgr2=0x7f3e64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 0x7f3e64067290 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f3e60004c40 tx=0x7f3e6000b040).stop 2022-02-02T14:52:56.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 msgr2=0x7f3e78104d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f3e68013a70 tx=0x7f3e68009b30).stop 2022-02-02T14:52:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 shutdown_connections 2022-02-02T14:52:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3e64064dd0 0x7f3e64067290 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e780f55c0 0x7f3e78104d60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 --2- 172.21.15.33:0/2166039493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e780f6860 0x7f3e78105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 >> 172.21.15.33:0/2166039493 conn(0x7f3e780f0d40 msgr2=0x7f3e780f9a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 shutdown_connections 2022-02-02T14:52:56.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.613+0000 7f3e7cc97700 1 -- 172.21.15.33:0/2166039493 wait complete. 2022-02-02T14:52:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 -- 172.21.15.33:0/3917778714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 msgr2=0x7f02540f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 --2- 172.21.15.33:0/3917778714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f02540f5850 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f0248004660 tx=0x7f0248009b30).stop 2022-02-02T14:52:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 -- 172.21.15.33:0/3917778714 shutdown_connections 2022-02-02T14:52:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 --2- 172.21.15.33:0/3917778714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 0x7f02540f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 --2- 172.21.15.33:0/3917778714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f02540f5850 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.713+0000 7f0259f5e700 1 -- 172.21.15.33:0/3917778714 >> 172.21.15.33:0/3917778714 conn(0x7f02540f0b90 msgr2=0x7f02540f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 -- 172.21.15.33:0/3917778714 shutdown_connections 2022-02-02T14:52:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 -- 172.21.15.33:0/3917778714 wait complete. 2022-02-02T14:52:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 Processor -- start 2022-02-02T14:52:56.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 -- start start 2022-02-02T14:52:56.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 0x7f025410e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540602b0 con 0x7f02540f5430 2022-02-02T14:52:56.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.714+0000 7f0259f5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540603f0 con 0x7f02540f66d0 2022-02-02T14:52:56.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34956/0 (socket says 172.21.15.33:34956) 2022-02-02T14:52:56.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 -- 172.21.15.33:0/1937757023 learned_addr learned my addr 172.21.15.33:0/1937757023 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:52:56.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0253fff700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 0x7f025410e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 -- 172.21.15.33:0/1937757023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 msgr2=0x7f025410e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 0x7f025410e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 -- 172.21.15.33:0/1937757023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248005040 con 0x7f02540f5430 2022-02-02T14:52:56.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0258f5c700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f0248013a70 tx=0x7f0248009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0248018070 con 0x7f02540f5430 2022-02-02T14:52:56.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f02480097d0 con 0x7f02540f5430 2022-02-02T14:52:56.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025410e8a0 con 0x7f02540f5430 2022-02-02T14:52:56.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f024801c3c0 con 0x7f02540f5430 2022-02-02T14:52:56.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.715+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025410ec70 con 0x7f02540f5430 2022-02-02T14:52:56.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.717+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f024801c680 con 0x7f02540f5430 2022-02-02T14:52:56.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.717+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0254059100 con 0x7f02540f5430 2022-02-02T14:52:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.717+0000 7f02517fa700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 0x7f02440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:52:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.717+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0248083780 con 0x7f02540f5430 2022-02-02T14:52:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.717+0000 7f0253fff700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 0x7f02440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:52:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.718+0000 7f0253fff700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 0x7f02440672e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0240004a70 tx=0x7f024000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:52:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.722+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0248052720 con 0x7f02540f5430 2022-02-02T14:52:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.935+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f02540fdc80 con 0x7f02540f5430 2022-02-02T14:52:56.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.936+0000 7f02517fa700 1 -- 172.21.15.33:0/1937757023 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0248055d40 con 0x7f02540f5430 2022-02-02T14:52:56.936 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:52:56.936 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:52:56.937 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:52:56.937 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:52:56.937 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:56.937 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:52:56.938 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:52:56.938 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:52:56.938 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:52:56.938 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:52:56.939 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:52:56.939 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:52:56.939 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:52:56.939 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:52:56.940 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:52:56.940 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:52:56.940 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:52:56.940 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:52:56.940 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:52:56.941 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:52:56.941 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:52:56.941 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:52:56.941 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:52:56.942 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:52:56.942 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:52:56.942 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:52:56.942 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:52:56.943 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:52:56.943 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:52:56.943 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:52:56.943 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:52:56.943 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:56.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:56.944 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:52:56.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:52:56.945 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:56.945 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:56.945 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:56.945 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:52:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 msgr2=0x7f02440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 0x7f02440672e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f0240004a70 tx=0x7f024000b040).stop 2022-02-02T14:52:56.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 msgr2=0x7f025410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:52:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f0248013a70 tx=0x7f0248009b30).stop 2022-02-02T14:52:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 shutdown_connections 2022-02-02T14:52:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0244064e20 0x7f02440672e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f02540f5430 0x7f025410beb0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 --2- 172.21.15.33:0/1937757023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540f66d0 0x7f025410e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:52:56.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 >> 172.21.15.33:0/1937757023 conn(0x7f02540f0b90 msgr2=0x7f02540fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:52:56.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 shutdown_connections 2022-02-02T14:52:56.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:52:56.938+0000 7f0259f5e700 1 -- 172.21.15.33:0/1937757023 wait complete. 2022-02-02T14:52:56.949 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:52:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:56 smithi037 ceph-mon[69017]: pgmap v2226: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:57 smithi037 ceph-mon[69017]: from='client.36356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:57.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:57 smithi037 ceph-mon[69017]: from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2166039493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:52:57.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1937757023' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:52:57.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:57 smithi033 ceph-mon[101165]: from='client.36356 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:57.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:57 smithi033 ceph-mon[101165]: from='client.36360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:52:57.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2166039493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:52:57.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1937757023' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:52:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:52:58 smithi033 ceph-mon[101165]: pgmap v2227: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:52:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:52:58 smithi037 ceph-mon[69017]: pgmap v2227: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:00 smithi033 ceph-mon[101165]: pgmap v2228: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:00 smithi037 ceph-mon[69017]: pgmap v2228: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:02 smithi033 ceph-mon[101165]: pgmap v2229: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:02 smithi037 ceph-mon[69017]: pgmap v2229: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:04 smithi033 ceph-mon[101165]: pgmap v2230: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:04 smithi037 ceph-mon[69017]: pgmap v2230: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:06 smithi033 ceph-mon[101165]: pgmap v2231: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:06 smithi037 ceph-mon[69017]: pgmap v2231: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:08 smithi033 ceph-mon[101165]: pgmap v2232: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:08 smithi037 ceph-mon[69017]: pgmap v2232: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:10 smithi033 ceph-mon[101165]: pgmap v2233: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:10 smithi037 ceph-mon[69017]: pgmap v2233: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:12 smithi033 ceph-mon[101165]: pgmap v2234: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:12 smithi037 ceph-mon[69017]: pgmap v2234: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:13.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:13 smithi033 ceph-mon[101165]: pgmap v2235: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:14.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:13 smithi037 ceph-mon[69017]: pgmap v2235: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:16.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:16 smithi033 ceph-mon[101165]: pgmap v2236: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:16 smithi037 ceph-mon[69017]: pgmap v2236: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:18 smithi033 ceph-mon[101165]: pgmap v2237: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:18 smithi037 ceph-mon[69017]: pgmap v2237: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:20 smithi033 ceph-mon[101165]: pgmap v2238: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:21.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:20 smithi037 ceph-mon[69017]: pgmap v2238: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:22 smithi033 ceph-mon[101165]: pgmap v2239: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:22 smithi037 ceph-mon[69017]: pgmap v2239: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:24 smithi033 ceph-mon[101165]: pgmap v2240: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:24 smithi037 ceph-mon[69017]: pgmap v2240: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:26 smithi033 ceph-mon[101165]: pgmap v2241: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:26 smithi037 ceph-mon[69017]: pgmap v2241: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:27.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 -- 172.21.15.33:0/1820632394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 msgr2=0x7f49240f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 --2- 172.21.15.33:0/1820632394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f59e0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f4918004660 tx=0x7f4918009b30).stop 2022-02-02T14:53:27.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 -- 172.21.15.33:0/1820632394 shutdown_connections 2022-02-02T14:53:27.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 --2- 172.21.15.33:0/1820632394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 --2- 172.21.15.33:0/1820632394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f59e0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 -- 172.21.15.33:0/1820632394 >> 172.21.15.33:0/1820632394 conn(0x7f49240f0d40 msgr2=0x7f49240f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 -- 172.21.15.33:0/1820632394 shutdown_connections 2022-02-02T14:53:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.054+0000 7f492ad6a700 1 -- 172.21.15.33:0/1820632394 wait complete. 2022-02-02T14:53:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 Processor -- start 2022-02-02T14:53:27.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 -- start start 2022-02-02T14:53:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240f8100 con 0x7f49240f55c0 2022-02-02T14:53:27.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.055+0000 7f492ad6a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240f8240 con 0x7f49240f6860 2022-02-02T14:53:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34966/0 (socket says 172.21.15.33:34966) 2022-02-02T14:53:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 -- 172.21.15.33:0/2337772550 learned_addr learned my addr 172.21.15.33:0/2337772550 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:27.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 -- 172.21.15.33:0/2337772550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 msgr2=0x7f49240f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4923fff700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 -- 172.21.15.33:0/2337772550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4918005040 con 0x7f49240f55c0 2022-02-02T14:53:27.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4923fff700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f4928b06700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f4918013a70 tx=0x7f4918009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4918018070 con 0x7f49240f55c0 2022-02-02T14:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49180097d0 con 0x7f49240f55c0 2022-02-02T14:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49240f84c0 con 0x7f49240f55c0 2022-02-02T14:53:27.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f491801c3c0 con 0x7f49240f55c0 2022-02-02T14:53:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.056+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240f8a20 con 0x7f49240f55c0 2022-02-02T14:53:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.058+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4924045ad0 con 0x7f49240f55c0 2022-02-02T14:53:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.058+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4918007ba0 con 0x7f49240f55c0 2022-02-02T14:53:27.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.058+0000 7f49217fa700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 0x7f4914067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.059+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4918083790 con 0x7f49240f55c0 2022-02-02T14:53:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.059+0000 7f4923fff700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 0x7f4914067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.059+0000 7f4923fff700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 0x7f4914067290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f4910009880 tx=0x7f491000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.063+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4918051900 con 0x7f49240f55c0 2022-02-02T14:53:27.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.253+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49240faca0 con 0x7f4914064dd0 2022-02-02T14:53:27.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.254+0000 7f49217fa700 1 -- 172.21.15.33:0/2337772550 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f49240faca0 con 0x7f4914064dd0 2022-02-02T14:53:27.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 msgr2=0x7f4914067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 0x7f4914067290 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f4910009880 tx=0x7f491000b040).stop 2022-02-02T14:53:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 msgr2=0x7f49240f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f4918013a70 tx=0x7f4918009b30).stop 2022-02-02T14:53:27.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 shutdown_connections 2022-02-02T14:53:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4914064dd0 0x7f4914067290 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240f55c0 0x7f49240f9720 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 --2- 172.21.15.33:0/2337772550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49240f6860 0x7f49240f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 >> 172.21.15.33:0/2337772550 conn(0x7f49240f0d40 msgr2=0x7f492405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 shutdown_connections 2022-02-02T14:53:27.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.256+0000 7f492ad6a700 1 -- 172.21.15.33:0/2337772550 wait complete. 2022-02-02T14:53:27.265 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:53:27.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 -- 172.21.15.33:0/3374264590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f6860 msgr2=0x7f68f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/3374264590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f6860 0x7f68f40f6cc0 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f68e8004660 tx=0x7f68e8009b30).stop 2022-02-02T14:53:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 -- 172.21.15.33:0/3374264590 shutdown_connections 2022-02-02T14:53:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/3374264590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f6860 0x7f68f40f6cc0 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/3374264590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f55c0 0x7f68f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 -- 172.21.15.33:0/3374264590 >> 172.21.15.33:0/3374264590 conn(0x7f68f40f0d40 msgr2=0x7f68f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 -- 172.21.15.33:0/3374264590 shutdown_connections 2022-02-02T14:53:27.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.357+0000 7f68f9ef3700 1 -- 172.21.15.33:0/3374264590 wait complete. 2022-02-02T14:53:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 Processor -- start 2022-02-02T14:53:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 -- start start 2022-02-02T14:53:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f6860 0x7f68f410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f40603c0 con 0x7f68f40f55c0 2022-02-02T14:53:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f9ef3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f4060500 con 0x7f68f40f6860 2022-02-02T14:53:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.358+0000 7f68f37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34976/0 (socket says 172.21.15.33:34976) 2022-02-02T14:53:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f37fe700 1 -- 172.21.15.33:0/878330351 learned_addr learned my addr 172.21.15.33:0/878330351 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f2ffd700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f6860 0x7f68f410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f37fe700 1 -- 172.21.15.33:0/878330351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f6860 msgr2=0x7f68f410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f37fe700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f6860 0x7f68f410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f37fe700 1 -- 172.21.15.33:0/878330351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e8005040 con 0x7f68f40f55c0 2022-02-02T14:53:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f37fe700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f68e400fb10 tx=0x7f68e4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e4014070 con 0x7f68f40f55c0 2022-02-02T14:53:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68e4009500 con 0x7f68f40f55c0 2022-02-02T14:53:27.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f4105ab0 con 0x7f68f40f55c0 2022-02-02T14:53:27.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f68e4002b20 con 0x7f68f40f55c0 2022-02-02T14:53:27.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.359+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f4106070 con 0x7f68f40f55c0 2022-02-02T14:53:27.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.360+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f4045ad0 con 0x7f68f40f55c0 2022-02-02T14:53:27.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.361+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f68e4020060 con 0x7f68f40f55c0 2022-02-02T14:53:27.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.362+0000 7f68dbfff700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.362+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f68e4085a70 con 0x7f68f40f55c0 2022-02-02T14:53:27.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.362+0000 7f68f2ffd700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.362+0000 7f68f2ffd700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 0x7f68dc067290 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f68e8004630 tx=0x7f68e8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.366+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f68e4053be0 con 0x7f68f40f55c0 2022-02-02T14:53:27.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.549+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f68f40fdec0 con 0x7f68dc064dd0 2022-02-02T14:53:27.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.564+0000 7f68dbfff700 1 -- 172.21.15.33:0/878330351 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f68f40fdec0 con 0x7f68dc064dd0 2022-02-02T14:53:27.563 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:53:27.563 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (78m) 40m ago 79m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:53:27.563 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (71m) 40m ago 79m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:53:27.564 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (71m) 40m ago 79m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:53:27.564 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (78m) 40m ago 79m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:53:27.564 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (72m) 40m ago 75m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:53:27.564 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (72m) 40m ago 75m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:53:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (73m) 40m ago 75m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:53:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (75m) 40m ago 75m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:53:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (73m) 40m ago 81m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:53:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (72m) 40m ago 79m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:53:27.565 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (72m) 40m ago 81m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:53:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (72m) 40m ago 79m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:53:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (79m) 40m ago 79m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:53:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (79m) 40m ago 78m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:53:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 40m ago 78m - 4096M 2022-02-02T14:53:27.566 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (78m) 40m ago 78m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:53:27.567 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (77m) 40m ago 77m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:53:27.567 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (77m) 40m ago 77m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:53:27.567 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (77m) 40m ago 77m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:53:27.567 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (77m) 40m ago 77m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:53:27.568 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (78m) 40m ago 79m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:53:27.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 msgr2=0x7f68dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 0x7f68dc067290 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f68e8004630 tx=0x7f68e8009b30).stop 2022-02-02T14:53:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 msgr2=0x7f68f4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f68e400fb10 tx=0x7f68e4009d80).stop 2022-02-02T14:53:27.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 shutdown_connections 2022-02-02T14:53:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68dc064dd0 0x7f68dc067290 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68f40f55c0 0x7f68f4109c70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 --2- 172.21.15.33:0/878330351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68f40f6860 0x7f68f410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.565+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 >> 172.21.15.33:0/878330351 conn(0x7f68f40f0d40 msgr2=0x7f68f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.566+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 shutdown_connections 2022-02-02T14:53:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.566+0000 7f68f9ef3700 1 -- 172.21.15.33:0/878330351 wait complete. 2022-02-02T14:53:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 -- 172.21.15.33:0/3853622796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 msgr2=0x7fa5540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 --2- 172.21.15.33:0/3853622796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa5540f59e0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa544004660 tx=0x7fa544009b30).stop 2022-02-02T14:53:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 -- 172.21.15.33:0/3853622796 shutdown_connections 2022-02-02T14:53:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 --2- 172.21.15.33:0/3853622796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 0x7fa5540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 --2- 172.21.15.33:0/3853622796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa5540f59e0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 -- 172.21.15.33:0/3853622796 >> 172.21.15.33:0/3853622796 conn(0x7fa5540f0d40 msgr2=0x7fa5540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 -- 172.21.15.33:0/3853622796 shutdown_connections 2022-02-02T14:53:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.667+0000 7fa558f5b700 1 -- 172.21.15.33:0/3853622796 wait complete. 2022-02-02T14:53:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 Processor -- start 2022-02-02T14:53:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 -- start start 2022-02-02T14:53:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 0x7fa5541063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554106950 con 0x7fa5540f55c0 2022-02-02T14:53:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa558f5b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa554106a90 con 0x7fa5540f6860 2022-02-02T14:53:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa55259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa55259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34986/0 (socket says 172.21.15.33:34986) 2022-02-02T14:53:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa55259c700 1 -- 172.21.15.33:0/692436651 learned_addr learned my addr 172.21.15.33:0/692436651 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.668+0000 7fa551d9b700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 0x7fa5541063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa55259c700 1 -- 172.21.15.33:0/692436651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 msgr2=0x7fa5541063a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa55259c700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 0x7fa5541063a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa55259c700 1 -- 172.21.15.33:0/692436651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa544005040 con 0x7fa5540f55c0 2022-02-02T14:53:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa55259c700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa544013a70 tx=0x7fa544009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa544007ba0 con 0x7fa5540f55c0 2022-02-02T14:53:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa558f5b700 1 -- 172.21.15.33:0/692436651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5541073d0 con 0x7fa5540f55c0 2022-02-02T14:53:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa5440097d0 con 0x7fa5540f55c0 2022-02-02T14:53:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa54401a3e0 con 0x7fa5540f55c0 2022-02-02T14:53:27.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.669+0000 7fa558f5b700 1 -- 172.21.15.33:0/692436651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5541078d0 con 0x7fa5540f55c0 2022-02-02T14:53:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.670+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa52c004fa0 con 0x7fa5540f55c0 2022-02-02T14:53:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.671+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa544007d00 con 0x7fa5540f55c0 2022-02-02T14:53:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.671+0000 7fa54affd700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 0x7fa540067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:27.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.671+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa544085420 con 0x7fa5540f55c0 2022-02-02T14:53:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.671+0000 7fa551d9b700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 0x7fa540067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.672+0000 7fa551d9b700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 0x7fa540067290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa53c004c40 tx=0x7fa53c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.676+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa544056f00 con 0x7fa5540f55c0 2022-02-02T14:53:27.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.921+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa52c005e80 con 0x7fa5540f55c0 2022-02-02T14:53:27.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.922+0000 7fa54affd700 1 -- 172.21.15.33:0/692436651 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa544056af0 con 0x7fa5540f55c0 2022-02-02T14:53:27.923 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:53:27.923 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:53:27.923 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:53:27.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:27.924 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:53:27.924 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:53:27.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:27.925 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:53:27.925 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:53:27.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:27.926 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:53:27.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:53:27.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:27.926 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:53:27.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:53:27.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:53:27.927 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:53:27.927 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:53:27.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 msgr2=0x7fa540067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 0x7fa540067290 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7fa53c004c40 tx=0x7fa53c00b040).stop 2022-02-02T14:53:27.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 msgr2=0x7fa554105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:27.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa544013a70 tx=0x7fa544009b30).stop 2022-02-02T14:53:27.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 shutdown_connections 2022-02-02T14:53:27.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa540064dd0 0x7fa540067290 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5540f55c0 0x7fa554105eb0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 --2- 172.21.15.33:0/692436651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5540f6860 0x7fa5541063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 >> 172.21.15.33:0/692436651 conn(0x7fa5540f0d40 msgr2=0x7fa5540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 shutdown_connections 2022-02-02T14:53:27.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:27.924+0000 7fa548ff9700 1 -- 172.21.15.33:0/692436651 wait complete. 2022-02-02T14:53:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 -- 172.21.15.33:0/2039325105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 msgr2=0x7fddec0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 --2- 172.21.15.33:0/2039325105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec0f6cc0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fddd4004660 tx=0x7fddd4009b30).stop 2022-02-02T14:53:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 -- 172.21.15.33:0/2039325105 shutdown_connections 2022-02-02T14:53:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 --2- 172.21.15.33:0/2039325105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec0f6cc0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 --2- 172.21.15.33:0/2039325105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 0x7fddec0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 -- 172.21.15.33:0/2039325105 >> 172.21.15.33:0/2039325105 conn(0x7fddec0f0d40 msgr2=0x7fddec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:28.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 -- 172.21.15.33:0/2039325105 shutdown_connections 2022-02-02T14:53:28.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.025+0000 7fddf233c700 1 -- 172.21.15.33:0/2039325105 wait complete. 2022-02-02T14:53:28.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 Processor -- start 2022-02-02T14:53:28.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 -- start start 2022-02-02T14:53:28.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 0x7fddec109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:28.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:28.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0603e0 con 0x7fddec0f6860 2022-02-02T14:53:28.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddf233c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec060520 con 0x7fddec0f55c0 2022-02-02T14:53:28.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddeb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:28.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddeb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34998/0 (socket says 172.21.15.33:34998) 2022-02-02T14:53:28.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddeb7fe700 1 -- 172.21.15.33:0/1052939224 learned_addr learned my addr 172.21.15.33:0/1052939224 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:28.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.026+0000 7fddebfff700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 0x7fddec109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:28.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddeb7fe700 1 -- 172.21.15.33:0/1052939224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 msgr2=0x7fddec109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:28.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddeb7fe700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 0x7fddec109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddeb7fe700 1 -- 172.21.15.33:0/1052939224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd4005040 con 0x7fddec0f6860 2022-02-02T14:53:28.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddeb7fe700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fddd4009990 tx=0x7fddd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:28.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddd4018070 con 0x7fddec0f6860 2022-02-02T14:53:28.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddec10c6a0 con 0x7fddec0f6860 2022-02-02T14:53:28.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fddd4007ba0 con 0x7fddec0f6860 2022-02-02T14:53:28.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fddd401c3c0 con 0x7fddec0f6860 2022-02-02T14:53:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.027+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec10cc00 con 0x7fddec0f6860 2022-02-02T14:53:28.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.028+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd0004fa0 con 0x7fddec0f6860 2022-02-02T14:53:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.028+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fddd401d420 con 0x7fddec0f6860 2022-02-02T14:53:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.029+0000 7fdde8ff9700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 0x7fddd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:28.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.029+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fddd4083640 con 0x7fddec0f6860 2022-02-02T14:53:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.029+0000 7fddebfff700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 0x7fddd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.029+0000 7fddebfff700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 0x7fddd8067290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fddec060060 tx=0x7fdddc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:28.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.033+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fddd40517b0 con 0x7fddec0f6860 2022-02-02T14:53:28.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.249+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fddd0005e80 con 0x7fddec0f6860 2022-02-02T14:53:28.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.249+0000 7fdde8ff9700 1 -- 172.21.15.33:0/1052939224 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fddd4054dd0 con 0x7fddec0f6860 2022-02-02T14:53:28.249 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:53:28.250 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:53:28.250 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:53:28.250 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:53:28.250 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:28.251 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:53:28.251 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:53:28.251 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:53:28.251 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:53:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:53:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:53:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:53:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:53:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:53:28.253 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:53:28.253 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:53:28.253 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:53:28.253 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:53:28.254 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:53:28.254 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:53:28.254 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:53:28.254 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:53:28.254 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:53:28.255 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:53:28.255 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:53:28.255 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:53:28.255 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:53:28.256 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:53:28.256 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:53:28.256 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:53:28.256 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:53:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:28.257 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:53:28.257 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:28.257 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:28.258 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:28.258 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:28.258 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:28.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 msgr2=0x7fddd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:28.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 0x7fddd8067290 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fddec060060 tx=0x7fdddc00b040).stop 2022-02-02T14:53:28.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 msgr2=0x7fddec10c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:28.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fddd4009990 tx=0x7fddd4009b30).stop 2022-02-02T14:53:28.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 shutdown_connections 2022-02-02T14:53:28.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fddd8064dd0 0x7fddd8067290 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddec0f55c0 0x7fddec109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 --2- 172.21.15.33:0/1052939224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddec0f6860 0x7fddec10c150 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:28.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.251+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 >> 172.21.15.33:0/1052939224 conn(0x7fddec0f0d40 msgr2=0x7fddec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:28.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.252+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 shutdown_connections 2022-02-02T14:53:28.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:28.252+0000 7fddf233c700 1 -- 172.21.15.33:0/1052939224 wait complete. 2022-02-02T14:53:28.262 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:53:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:28 smithi033 ceph-mon[101165]: from='client.36372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:53:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:28 smithi033 ceph-mon[101165]: pgmap v2242: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:28 smithi033 ceph-mon[101165]: from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:53:28.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/692436651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:53:28.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1052939224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:53:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:28 smithi037 ceph-mon[69017]: from='client.36372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:53:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:28 smithi037 ceph-mon[69017]: pgmap v2242: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:29.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:28 smithi037 ceph-mon[69017]: from='client.36376 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:53:29.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/692436651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:53:29.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1052939224' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:53:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:30 smithi033 ceph-mon[101165]: pgmap v2243: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:30 smithi037 ceph-mon[69017]: pgmap v2243: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:32 smithi033 ceph-mon[101165]: pgmap v2244: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:32 smithi037 ceph-mon[69017]: pgmap v2244: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:34 smithi033 ceph-mon[101165]: pgmap v2245: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:35.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:34 smithi037 ceph-mon[69017]: pgmap v2245: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:36 smithi033 ceph-mon[101165]: pgmap v2246: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:36 smithi037 ceph-mon[69017]: pgmap v2246: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:38 smithi033 ceph-mon[101165]: pgmap v2247: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:38 smithi037 ceph-mon[69017]: pgmap v2247: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:40 smithi033 ceph-mon[101165]: pgmap v2248: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:40 smithi037 ceph-mon[69017]: pgmap v2248: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:42 smithi033 ceph-mon[101165]: pgmap v2249: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:42 smithi037 ceph-mon[69017]: pgmap v2249: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:44 smithi033 ceph-mon[101165]: pgmap v2250: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:45.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:44 smithi037 ceph-mon[69017]: pgmap v2250: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:46 smithi033 ceph-mon[101165]: pgmap v2251: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:46 smithi037 ceph-mon[69017]: pgmap v2251: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:48 smithi033 ceph-mon[101165]: pgmap v2252: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:48 smithi037 ceph-mon[69017]: pgmap v2252: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:50 smithi033 ceph-mon[101165]: pgmap v2253: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:50 smithi037 ceph-mon[69017]: pgmap v2253: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:52 smithi033 ceph-mon[101165]: pgmap v2254: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:52 smithi037 ceph-mon[69017]: pgmap v2254: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:54 smithi033 ceph-mon[101165]: pgmap v2255: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:53:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:53:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:54 smithi037 ceph-mon[69017]: pgmap v2255: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:53:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:53:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:56 smithi033 ceph-mon[101165]: pgmap v2256: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:56 smithi037 ceph-mon[69017]: pgmap v2256: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:58.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.367+0000 7fea29631700 1 -- 172.21.15.33:0/899024495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f7d00 msgr2=0x7fea240f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 --2- 172.21.15.33:0/899024495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f7d00 0x7fea240f8120 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fea14004660 tx=0x7fea14009b30).stop 2022-02-02T14:53:58.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 -- 172.21.15.33:0/899024495 shutdown_connections 2022-02-02T14:53:58.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 --2- 172.21.15.33:0/899024495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f8610 0x7fea240f4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 --2- 172.21.15.33:0/899024495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f7d00 0x7fea240f8120 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 -- 172.21.15.33:0/899024495 >> 172.21.15.33:0/899024495 conn(0x7fea240f0540 msgr2=0x7fea240f2960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:58.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 -- 172.21.15.33:0/899024495 shutdown_connections 2022-02-02T14:53:58.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.368+0000 7fea29631700 1 -- 172.21.15.33:0/899024495 wait complete. 2022-02-02T14:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 Processor -- start 2022-02-02T14:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 -- start start 2022-02-02T14:53:58.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 0x7fea240f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240f5fb0 con 0x7fea240f8610 2022-02-02T14:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea29631700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240f60f0 con 0x7fea240f7d00 2022-02-02T14:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35008/0 (socket says 172.21.15.33:35008) 2022-02-02T14:53:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea227fc700 1 -- 172.21.15.33:0/1968093140 learned_addr learned my addr 172.21.15.33:0/1968093140 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.369+0000 7fea22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 0x7fea240f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea227fc700 1 -- 172.21.15.33:0/1968093140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 msgr2=0x7fea240f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea227fc700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 0x7fea240f75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea227fc700 1 -- 172.21.15.33:0/1968093140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14005040 con 0x7fea240f8610 2022-02-02T14:53:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea22ffd700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 0x7fea240f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:53:58.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea227fc700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fea1800e7f0 tx=0x7fea1800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea180092e0 con 0x7fea240f8610 2022-02-02T14:53:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea1800f040 con 0x7fea240f8610 2022-02-02T14:53:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240f63d0 con 0x7fea240f8610 2022-02-02T14:53:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea18014750 con 0x7fea240f8610 2022-02-02T14:53:58.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.370+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2410ef00 con 0x7fea240f8610 2022-02-02T14:53:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.371+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea24045ad0 con 0x7fea240f8610 2022-02-02T14:53:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.372+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fea1801b030 con 0x7fea240f8610 2022-02-02T14:53:58.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.372+0000 7fea0b7fe700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 0x7fea0c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.372+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fea18081880 con 0x7fea240f8610 2022-02-02T14:53:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.372+0000 7fea22ffd700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 0x7fea0c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.373+0000 7fea22ffd700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 0x7fea0c067290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fea14004d80 tx=0x7fea14016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.377+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fea1804f9e0 con 0x7fea240f8610 2022-02-02T14:53:58.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.567+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea240ff020 con 0x7fea0c064dd0 2022-02-02T14:53:58.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.568+0000 7fea0b7fe700 1 -- 172.21.15.33:0/1968093140 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fea240ff020 con 0x7fea0c064dd0 2022-02-02T14:53:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 msgr2=0x7fea0c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 0x7fea0c067290 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fea14004d80 tx=0x7fea14016040).stop 2022-02-02T14:53:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 msgr2=0x7fea240f5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fea1800e7f0 tx=0x7fea1800b040).stop 2022-02-02T14:53:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 shutdown_connections 2022-02-02T14:53:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea0c064dd0 0x7fea0c067290 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea240f7d00 0x7fea240f75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 --2- 172.21.15.33:0/1968093140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea240f8610 0x7fea240f5a50 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 >> 172.21.15.33:0/1968093140 conn(0x7fea240f0540 msgr2=0x7fea240fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 shutdown_connections 2022-02-02T14:53:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.570+0000 7fea29631700 1 -- 172.21.15.33:0/1968093140 wait complete. 2022-02-02T14:53:58.579 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:53:58.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 -- 172.21.15.33:0/2725151840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f66d0 msgr2=0x7f03a00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 --2- 172.21.15.33:0/2725151840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f66d0 0x7f03a00f6b30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f0394004660 tx=0x7f0394009b30).stop 2022-02-02T14:53:58.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 -- 172.21.15.33:0/2725151840 shutdown_connections 2022-02-02T14:53:58.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 --2- 172.21.15.33:0/2725151840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f66d0 0x7f03a00f6b30 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 --2- 172.21.15.33:0/2725151840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f5430 0x7f03a00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 -- 172.21.15.33:0/2725151840 >> 172.21.15.33:0/2725151840 conn(0x7f03a00f0b90 msgr2=0x7f03a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 -- 172.21.15.33:0/2725151840 shutdown_connections 2022-02-02T14:53:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.671+0000 7f03a497a700 1 -- 172.21.15.33:0/2725151840 wait complete. 2022-02-02T14:53:58.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 Processor -- start 2022-02-02T14:53:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 -- start start 2022-02-02T14:53:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f66d0 0x7f03a010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00603e0 con 0x7f03a00f5430 2022-02-02T14:53:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.672+0000 7f03a497a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a0060520 con 0x7f03a00f66d0 2022-02-02T14:53:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35016/0 (socket says 172.21.15.33:35016) 2022-02-02T14:53:58.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 -- 172.21.15.33:0/3709108168 learned_addr learned my addr 172.21.15.33:0/3709108168 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039effd700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f66d0 0x7f03a010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 -- 172.21.15.33:0/3709108168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f66d0 msgr2=0x7f03a010bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f66d0 0x7f03a010bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 -- 172.21.15.33:0/3709108168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394005040 con 0x7f03a00f5430 2022-02-02T14:53:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f039f7fe700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f039000e7c0 tx=0x7f039000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03900092e0 con 0x7f03a00f5430 2022-02-02T14:53:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a010c480 con 0x7f03a00f5430 2022-02-02T14:53:58.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f039000f040 con 0x7f03a00f5430 2022-02-02T14:53:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03900147e0 con 0x7f03a00f5430 2022-02-02T14:53:58.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.673+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a010ca40 con 0x7f03a00f5430 2022-02-02T14:53:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.674+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a0045ad0 con 0x7f03a00f5430 2022-02-02T14:53:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.675+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f039001b030 con 0x7f03a00f5430 2022-02-02T14:53:58.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.675+0000 7f0387fff700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 0x7f03880672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.675+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0390081a00 con 0x7f03a00f5430 2022-02-02T14:53:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.675+0000 7f039effd700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 0x7f03880672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.676+0000 7f039effd700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 0x7f03880672e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0394005010 tx=0x7f0394016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.679+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f039004fab0 con 0x7f03a00f5430 2022-02-02T14:53:58.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.863+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03a00fdd00 con 0x7f0388064e20 2022-02-02T14:53:58.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.877+0000 7f0387fff700 1 -- 172.21.15.33:0/3709108168 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f03a00fdd00 con 0x7f0388064e20 2022-02-02T14:53:58.877 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:53:58.877 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (79m) 41m ago 80m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:53:58.877 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (72m) 41m ago 80m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:53:58.878 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (72m) 41m ago 79m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:53:58.878 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (79m) 41m ago 80m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:53:58.878 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (72m) 41m ago 76m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:53:58.878 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (73m) 41m ago 76m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:53:58.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (74m) 41m ago 76m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:53:58.879 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (76m) 41m ago 76m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:53:58.879 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (73m) 41m ago 81m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:53:58.879 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (73m) 41m ago 79m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:53:58.879 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (73m) 41m ago 81m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:53:58.880 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (72m) 41m ago 79m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:53:58.880 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (79m) 41m ago 79m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:53:58.880 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (79m) 41m ago 79m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:53:58.880 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 41m ago 78m - 4096M 2022-02-02T14:53:58.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (78m) 41m ago 78m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:53:58.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (78m) 41m ago 78m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:53:58.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (78m) 41m ago 78m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:53:58.881 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (77m) 41m ago 77m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:53:58.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (77m) 41m ago 77m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:53:58.882 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (79m) 41m ago 79m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:53:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.879+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 msgr2=0x7f03880672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.879+0000 7f03a497a700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 0x7f03880672e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0394005010 tx=0x7f0394016040).stop 2022-02-02T14:53:58.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.879+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 msgr2=0x7f03a01099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.879+0000 7f03a497a700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f039000e7c0 tx=0x7f039000b040).stop 2022-02-02T14:53:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 shutdown_connections 2022-02-02T14:53:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0388064e20 0x7f03880672e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a00f5430 0x7f03a01099d0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 --2- 172.21.15.33:0/3709108168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03a00f66d0 0x7f03a010bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 >> 172.21.15.33:0/3709108168 conn(0x7f03a00f0b90 msgr2=0x7f03a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 shutdown_connections 2022-02-02T14:53:58.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.880+0000 7f03a497a700 1 -- 172.21.15.33:0/3709108168 wait complete. 2022-02-02T14:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2464429601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f7980 msgr2=0x7fae680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2464429601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f7980 0x7fae680f7de0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7fae5c004660 tx=0x7fae5c009b30).stop 2022-02-02T14:53:58.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:58 smithi033 ceph-mon[101165]: pgmap v2257: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2464429601 shutdown_connections 2022-02-02T14:53:58.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2464429601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f7980 0x7fae680f7de0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2464429601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f66e0 0x7fae680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2464429601 >> 172.21.15.33:0/2464429601 conn(0x7fae680f1e40 msgr2=0x7fae680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:58.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2464429601 shutdown_connections 2022-02-02T14:53:58.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.980+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2464429601 wait complete. 2022-02-02T14:53:58.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 Processor -- start 2022-02-02T14:53:58.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 -- start start 2022-02-02T14:53:58.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f7980 0x7fae68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6806a380 con 0x7fae680f66e0 2022-02-02T14:53:58.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.981+0000 7fae6e7b6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6806a4c0 con 0x7fae680f7980 2022-02-02T14:53:58.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35026/0 (socket says 172.21.15.33:35026) 2022-02-02T14:53:58.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 -- 172.21.15.33:0/2961215962 learned_addr learned my addr 172.21.15.33:0/2961215962 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:58.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae677fe700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f7980 0x7fae68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 -- 172.21.15.33:0/2961215962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f7980 msgr2=0x7fae68069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:58.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f7980 0x7fae68069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:58.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 -- 172.21.15.33:0/2961215962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c005040 con 0x7fae680f66e0 2022-02-02T14:53:58.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae67fff700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fae5800e7c0 tx=0x7fae5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae580092e0 con 0x7fae680f66e0 2022-02-02T14:53:58.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6806a7a0 con 0x7fae680f66e0 2022-02-02T14:53:58.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fae5800f040 con 0x7fae680f66e0 2022-02-02T14:53:58.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae580147e0 con 0x7fae680f66e0 2022-02-02T14:53:58.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.982+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6810ef40 con 0x7fae680f66e0 2022-02-02T14:53:58.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.983+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae68045ad0 con 0x7fae680f66e0 2022-02-02T14:53:58.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.984+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fae5801b030 con 0x7fae680f66e0 2022-02-02T14:53:58.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.984+0000 7fae64ff9700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 0x7fae50067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:58.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.984+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fae58081a50 con 0x7fae680f66e0 2022-02-02T14:53:58.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.984+0000 7fae677fe700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 0x7fae50067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:58.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.985+0000 7fae677fe700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 0x7fae50067290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fae5c005010 tx=0x7fae5c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:58.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:58.988+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fae5804fb00 con 0x7fae680f66e0 2022-02-02T14:53:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:58 smithi037 ceph-mon[69017]: pgmap v2257: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:53:59.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.236+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fae6806a930 con 0x7fae680f66e0 2022-02-02T14:53:59.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.236+0000 7fae64ff9700 1 -- 172.21.15.33:0/2961215962 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fae6806a930 con 0x7fae680f66e0 2022-02-02T14:53:59.236 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:53:59.236 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:53:59.237 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:53:59.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:59.237 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:53:59.237 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:53:59.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:59.238 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:53:59.238 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:53:59.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:59.239 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:53:59.239 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:53:59.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:53:59.239 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:53:59.239 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:53:59.240 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:53:59.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:53:59.240 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:53:59.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 msgr2=0x7fae50067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 0x7fae50067290 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fae5c005010 tx=0x7fae5c016040).stop 2022-02-02T14:53:59.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 msgr2=0x7fae6806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7fae5800e7c0 tx=0x7fae5800b040).stop 2022-02-02T14:53:59.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 shutdown_connections 2022-02-02T14:53:59.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fae50064dd0 0x7fae50067290 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae680f66e0 0x7fae6806b9a0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 --2- 172.21.15.33:0/2961215962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae680f7980 0x7fae68069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.238+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 >> 172.21.15.33:0/2961215962 conn(0x7fae680f1e40 msgr2=0x7fae680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:59.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.239+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 shutdown_connections 2022-02-02T14:53:59.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.239+0000 7fae6e7b6700 1 -- 172.21.15.33:0/2961215962 wait complete. 2022-02-02T14:53:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 -- 172.21.15.33:0/2187428817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f7980 msgr2=0x7fcdc00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 --2- 172.21.15.33:0/2187428817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f7980 0x7fcdc00f7de0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7fcda8004660 tx=0x7fcda8009b30).stop 2022-02-02T14:53:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 -- 172.21.15.33:0/2187428817 shutdown_connections 2022-02-02T14:53:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 --2- 172.21.15.33:0/2187428817 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f7980 0x7fcdc00f7de0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 --2- 172.21.15.33:0/2187428817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f66e0 0x7fcdc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 -- 172.21.15.33:0/2187428817 >> 172.21.15.33:0/2187428817 conn(0x7fcdc00f1e40 msgr2=0x7fcdc00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 -- 172.21.15.33:0/2187428817 shutdown_connections 2022-02-02T14:53:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.339+0000 7fcdc499d700 1 -- 172.21.15.33:0/2187428817 wait complete. 2022-02-02T14:53:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 Processor -- start 2022-02-02T14:53:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 -- start start 2022-02-02T14:53:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f7980 0x7fcdc0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0107a00 con 0x7fcdc00f66e0 2022-02-02T14:53:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdc499d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0107b40 con 0x7fcdc00f7980 2022-02-02T14:53:59.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:59.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35036/0 (socket says 172.21.15.33:35036) 2022-02-02T14:53:59.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 -- 172.21.15.33:0/3680584129 learned_addr learned my addr 172.21.15.33:0/3680584129 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:53:59.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbdd9b700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f7980 0x7fcdc0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 -- 172.21.15.33:0/3680584129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f7980 msgr2=0x7fcdc0107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f7980 0x7fcdc0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 -- 172.21.15.33:0/3680584129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8005040 con 0x7fcdc00f66e0 2022-02-02T14:53:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.340+0000 7fcdbe59c700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fcdb000c530 tx=0x7fcdb0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb000f650 con 0x7fcdc00f66e0 2022-02-02T14:53:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc01084e0 con 0x7fcdc00f66e0 2022-02-02T14:53:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcdb000fc60 con 0x7fcdc00f66e0 2022-02-02T14:53:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb0012d20 con 0x7fcdc00f66e0 2022-02-02T14:53:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc0108aa0 con 0x7fcdc00f66e0 2022-02-02T14:53:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.341+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc0045ad0 con 0x7fcdc00f66e0 2022-02-02T14:53:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.342+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcdb0019030 con 0x7fcdc00f66e0 2022-02-02T14:53:59.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.343+0000 7fcdb6ffd700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 0x7fcdac067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:53:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.343+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcdb0081700 con 0x7fcdc00f66e0 2022-02-02T14:53:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.343+0000 7fcdbdd9b700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 0x7fcdac067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:53:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.343+0000 7fcdbdd9b700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 0x7fcdac067270 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fcda8000c00 tx=0x7fcda8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:53:59.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.347+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcdb0053230 con 0x7fcdc00f66e0 2022-02-02T14:53:59.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.560+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdc0108d20 con 0x7fcdc00f66e0 2022-02-02T14:53:59.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.560+0000 7fcdb6ffd700 1 -- 172.21.15.33:0/3680584129 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcdb0052e20 con 0x7fcdc00f66e0 2022-02-02T14:53:59.560 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:53:59.560 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:53:59.561 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:53:59.561 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:53:59.561 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:59.561 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:53:59.562 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:53:59.562 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:53:59.562 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:53:59.562 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:53:59.563 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:53:59.563 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:53:59.563 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:53:59.563 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:53:59.564 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:53:59.564 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:53:59.564 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:53:59.564 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:53:59.564 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:53:59.565 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:53:59.565 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:53:59.565 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:53:59.565 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:53:59.565 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:53:59.566 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:53:59.566 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:53:59.566 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:53:59.566 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:53:59.567 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:53:59.567 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:53:59.567 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:53:59.567 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:59.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:59.568 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:53:59.568 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:53:59.568 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:59.569 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:59.569 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:59.569 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:53:59.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 msgr2=0x7fcdac067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 0x7fcdac067270 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7fcda8000c00 tx=0x7fcda8009b30).stop 2022-02-02T14:53:59.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 msgr2=0x7fcdc0106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:53:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7fcdb000c530 tx=0x7fcdb0007e10).stop 2022-02-02T14:53:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 shutdown_connections 2022-02-02T14:53:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcdac064db0 0x7fcdac067270 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdc00f66e0 0x7fcdc0106f60 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 --2- 172.21.15.33:0/3680584129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc00f7980 0x7fcdc0107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:53:59.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 >> 172.21.15.33:0/3680584129 conn(0x7fcdc00f1e40 msgr2=0x7fcdc00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:53:59.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 shutdown_connections 2022-02-02T14:53:59.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:53:59.562+0000 7fcdc499d700 1 -- 172.21.15.33:0/3680584129 wait complete. 2022-02-02T14:53:59.573 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:53:59.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:59 smithi033 ceph-mon[101165]: from='client.36388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:53:59.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2961215962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:53:59.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:53:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3680584129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:54:00.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:59 smithi037 ceph-mon[69017]: from='client.36388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:00.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2961215962' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:54:00.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:53:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3680584129' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:54:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:00 smithi033 ceph-mon[101165]: from='client.36392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:00.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:00 smithi033 ceph-mon[101165]: pgmap v2258: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:00 smithi037 ceph-mon[69017]: from='client.36392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:00 smithi037 ceph-mon[69017]: pgmap v2258: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:02 smithi033 ceph-mon[101165]: pgmap v2259: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:02 smithi037 ceph-mon[69017]: pgmap v2259: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:04.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:04 smithi033 ceph-mon[101165]: pgmap v2260: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:04 smithi037 ceph-mon[69017]: pgmap v2260: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:06 smithi033 ceph-mon[101165]: pgmap v2261: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:06 smithi037 ceph-mon[69017]: pgmap v2261: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:08 smithi033 ceph-mon[101165]: pgmap v2262: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:08 smithi037 ceph-mon[69017]: pgmap v2262: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:10 smithi033 ceph-mon[101165]: pgmap v2263: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:10 smithi037 ceph-mon[69017]: pgmap v2263: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:12 smithi033 ceph-mon[101165]: pgmap v2264: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:12 smithi037 ceph-mon[69017]: pgmap v2264: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:14 smithi033 ceph-mon[101165]: pgmap v2265: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:14 smithi037 ceph-mon[69017]: pgmap v2265: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:16 smithi033 ceph-mon[101165]: pgmap v2266: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:16 smithi037 ceph-mon[69017]: pgmap v2266: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:18 smithi033 ceph-mon[101165]: pgmap v2267: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:18 smithi037 ceph-mon[69017]: pgmap v2267: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:20 smithi033 ceph-mon[101165]: pgmap v2268: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:20 smithi037 ceph-mon[69017]: pgmap v2268: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:22 smithi033 ceph-mon[101165]: pgmap v2269: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:22 smithi037 ceph-mon[69017]: pgmap v2269: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:24.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:24 smithi033 ceph-mon[101165]: pgmap v2270: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:24 smithi037 ceph-mon[69017]: pgmap v2270: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:26 smithi033 ceph-mon[101165]: pgmap v2271: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:26 smithi037 ceph-mon[69017]: pgmap v2271: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:28 smithi033 ceph-mon[101165]: pgmap v2272: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:28 smithi037 ceph-mon[69017]: pgmap v2272: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 -- 172.21.15.33:0/3245031202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f6860 msgr2=0x7f14b80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 --2- 172.21.15.33:0/3245031202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f6860 0x7f14b80f6cc0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f14a0004660 tx=0x7f14a0009b30).stop 2022-02-02T14:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 -- 172.21.15.33:0/3245031202 shutdown_connections 2022-02-02T14:54:29.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 --2- 172.21.15.33:0/3245031202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f6860 0x7f14b80f6cc0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 --2- 172.21.15.33:0/3245031202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f55c0 0x7f14b80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.679+0000 7f14bc895700 1 -- 172.21.15.33:0/3245031202 >> 172.21.15.33:0/3245031202 conn(0x7f14b80f0d40 msgr2=0x7f14b80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:29.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 -- 172.21.15.33:0/3245031202 shutdown_connections 2022-02-02T14:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 -- 172.21.15.33:0/3245031202 wait complete. 2022-02-02T14:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 Processor -- start 2022-02-02T14:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 -- start start 2022-02-02T14:54:29.683 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f6860 0x7f14b81063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81069b0 con 0x7f14b80f55c0 2022-02-02T14:54:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.680+0000 7f14bc895700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b81071c0 con 0x7f14b80f6860 2022-02-02T14:54:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35046/0 (socket says 172.21.15.33:35046) 2022-02-02T14:54:29.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 -- 172.21.15.33:0/878181900 learned_addr learned my addr 172.21.15.33:0/878181900 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:54:29.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b5d9b700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f6860 0x7f14b81063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 -- 172.21.15.33:0/878181900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f6860 msgr2=0x7f14b81063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f6860 0x7f14b81063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 -- 172.21.15.33:0/878181900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a0005040 con 0x7f14b80f55c0 2022-02-02T14:54:29.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14b659c700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f14a8002700 tx=0x7f14a8009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:29.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a80079c0 con 0x7f14b80f55c0 2022-02-02T14:54:29.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f14a800f040 con 0x7f14b80f55c0 2022-02-02T14:54:29.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b8107440 con 0x7f14b80f55c0 2022-02-02T14:54:29.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a8014860 con 0x7f14b80f55c0 2022-02-02T14:54:29.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.681+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b8107a00 con 0x7f14b80f55c0 2022-02-02T14:54:29.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.683+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b80f49b0 con 0x7f14b80f55c0 2022-02-02T14:54:29.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.683+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f14a801b060 con 0x7f14b80f55c0 2022-02-02T14:54:29.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.683+0000 7f14aeffd700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.684+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f14a80819b0 con 0x7f14b80f55c0 2022-02-02T14:54:29.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.684+0000 7f14b5d9b700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.684+0000 7f14b5d9b700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 0x7f14a4067290 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f14a0004630 tx=0x7f14a0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:29.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.688+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f14a804fa60 con 0x7f14b80f55c0 2022-02-02T14:54:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.876+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b80fde60 con 0x7f14a4064dd0 2022-02-02T14:54:29.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.877+0000 7f14aeffd700 1 -- 172.21.15.33:0/878181900 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f14b80fde60 con 0x7f14a4064dd0 2022-02-02T14:54:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 msgr2=0x7f14a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 0x7f14a4067290 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f14a0004630 tx=0x7f14a0009b30).stop 2022-02-02T14:54:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 msgr2=0x7f14b8105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f14a8002700 tx=0x7f14a8009d80).stop 2022-02-02T14:54:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 shutdown_connections 2022-02-02T14:54:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f14a4064dd0 0x7f14a4067290 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14b80f55c0 0x7f14b8105ec0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 --2- 172.21.15.33:0/878181900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14b80f6860 0x7f14b81063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 >> 172.21.15.33:0/878181900 conn(0x7f14b80f0d40 msgr2=0x7f14b80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 shutdown_connections 2022-02-02T14:54:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.879+0000 7f14bc895700 1 -- 172.21.15.33:0/878181900 wait complete. 2022-02-02T14:54:29.888 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:54:29.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 -- 172.21.15.33:0/3477459113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f7980 msgr2=0x7fda540f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/3477459113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f7980 0x7fda540f7de0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7fda48004660 tx=0x7fda48009b30).stop 2022-02-02T14:54:29.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 -- 172.21.15.33:0/3477459113 shutdown_connections 2022-02-02T14:54:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/3477459113 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f7980 0x7fda540f7de0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/3477459113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f66e0 0x7fda540f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 -- 172.21.15.33:0/3477459113 >> 172.21.15.33:0/3477459113 conn(0x7fda540f1e40 msgr2=0x7fda540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 -- 172.21.15.33:0/3477459113 shutdown_connections 2022-02-02T14:54:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.981+0000 7fda5c3b1700 1 -- 172.21.15.33:0/3477459113 wait complete. 2022-02-02T14:54:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 Processor -- start 2022-02-02T14:54:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 -- start start 2022-02-02T14:54:29.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f7980 0x7fda54069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5406a380 con 0x7fda540f66e0 2022-02-02T14:54:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5c3b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5406a4c0 con 0x7fda540f7980 2022-02-02T14:54:29.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35056/0 (socket says 172.21.15.33:35056) 2022-02-02T14:54:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 -- 172.21.15.33:0/877750235 learned_addr learned my addr 172.21.15.33:0/877750235 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:54:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5994c700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f7980 0x7fda54069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 -- 172.21.15.33:0/877750235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f7980 msgr2=0x7fda54069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f7980 0x7fda54069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.982+0000 7fda5a14d700 1 -- 172.21.15.33:0/877750235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48005040 con 0x7fda540f66e0 2022-02-02T14:54:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda5a14d700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fda50002700 tx=0x7fda50009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda500079c0 con 0x7fda540f66e0 2022-02-02T14:54:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5406a7a0 con 0x7fda540f66e0 2022-02-02T14:54:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fda5000f040 con 0x7fda540f66e0 2022-02-02T14:54:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda50014860 con 0x7fda540f66e0 2022-02-02T14:54:29.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.983+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5410ef90 con 0x7fda540f66e0 2022-02-02T14:54:29.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.984+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda54045ad0 con 0x7fda540f66e0 2022-02-02T14:54:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.984+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fda5001b060 con 0x7fda540f66e0 2022-02-02T14:54:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.985+0000 7fda46ffd700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 0x7fda40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.985+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fda50081930 con 0x7fda540f66e0 2022-02-02T14:54:29.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.985+0000 7fda5994c700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 0x7fda40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.985+0000 7fda5994c700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 0x7fda40067290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fda48004630 tx=0x7fda48009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:29.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:29.989+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fda5004f9e0 con 0x7fda540f66e0 2022-02-02T14:54:30.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.172+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda540ff050 con 0x7fda40064dd0 2022-02-02T14:54:30.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.186+0000 7fda46ffd700 1 -- 172.21.15.33:0/877750235 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fda48019040 con 0x7fda40064dd0 2022-02-02T14:54:30.186 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:54:30.186 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (79m) 41m ago 80m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:54:30.186 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (72m) 41m ago 80m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:54:30.187 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (72m) 41m ago 80m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:54:30.188 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (79m) 41m ago 80m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:54:30.188 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (73m) 41m ago 76m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:54:30.188 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (73m) 41m ago 76m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:54:30.188 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (74m) 41m ago 77m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:54:30.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (76m) 41m ago 76m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:54:30.189 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (74m) 41m ago 82m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:54:30.189 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (73m) 41m ago 80m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:54:30.189 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (73m) 41m ago 82m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:54:30.190 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (73m) 41m ago 80m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:54:30.190 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (80m) 41m ago 80m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:54:30.190 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (80m) 41m ago 80m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:54:30.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 41m ago 79m - 4096M 2022-02-02T14:54:30.190 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (79m) 41m ago 79m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:54:30.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (78m) 41m ago 78m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:54:30.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (78m) 41m ago 78m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:54:30.192 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (78m) 41m ago 78m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:54:30.192 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (78m) 41m ago 78m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:54:30.192 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (79m) 41m ago 80m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:54:30.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 msgr2=0x7fda40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 0x7fda40067290 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fda48004630 tx=0x7fda48009b30).stop 2022-02-02T14:54:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 msgr2=0x7fda5406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7fda50002700 tx=0x7fda50009d80).stop 2022-02-02T14:54:30.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 shutdown_connections 2022-02-02T14:54:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fda40064dd0 0x7fda40067290 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fda540f66e0 0x7fda5406b9a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 --2- 172.21.15.33:0/877750235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda540f7980 0x7fda54069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 >> 172.21.15.33:0/877750235 conn(0x7fda540f1e40 msgr2=0x7fda540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 shutdown_connections 2022-02-02T14:54:30.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.188+0000 7fda5c3b1700 1 -- 172.21.15.33:0/877750235 wait complete. 2022-02-02T14:54:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.287+0000 7f76cdcae700 1 -- 172.21.15.33:0/1951840571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f66e0 msgr2=0x7f76c80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.287+0000 7f76cdcae700 1 --2- 172.21.15.33:0/1951840571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f66e0 0x7f76c80f6b00 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f76bc004660 tx=0x7f76bc009b30).stop 2022-02-02T14:54:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 -- 172.21.15.33:0/1951840571 shutdown_connections 2022-02-02T14:54:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 --2- 172.21.15.33:0/1951840571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f7980 0x7f76c80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 --2- 172.21.15.33:0/1951840571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f66e0 0x7f76c80f6b00 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 -- 172.21.15.33:0/1951840571 >> 172.21.15.33:0/1951840571 conn(0x7f76c80f1e40 msgr2=0x7f76c80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 -- 172.21.15.33:0/1951840571 shutdown_connections 2022-02-02T14:54:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 -- 172.21.15.33:0/1951840571 wait complete. 2022-02-02T14:54:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 Processor -- start 2022-02-02T14:54:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.288+0000 7f76cdcae700 1 -- start start 2022-02-02T14:54:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76cdcae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f66e0 0x7f76c81091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76cdcae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76cdcae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8109c40 con 0x7f76c80f7980 2022-02-02T14:54:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76cdcae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8109d80 con 0x7f76c80f66e0 2022-02-02T14:54:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35068/0 (socket says 172.21.15.33:35068) 2022-02-02T14:54:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 -- 172.21.15.33:0/2126353901 learned_addr learned my addr 172.21.15.33:0/2126353901 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:54:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c77fe700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f66e0 0x7f76c81091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 -- 172.21.15.33:0/2126353901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f66e0 msgr2=0x7f76c81091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f66e0 0x7f76c81091a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 -- 172.21.15.33:0/2126353901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76bc005040 con 0x7f76c80f7980 2022-02-02T14:54:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76c6ffd700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f76b800c790 tx=0x7f76b8007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:30.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b800e680 con 0x7f76c80f7980 2022-02-02T14:54:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76b800ec90 con 0x7f76c80f7980 2022-02-02T14:54:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c810a720 con 0x7f76c80f7980 2022-02-02T14:54:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.289+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76b8013d60 con 0x7f76c80f7980 2022-02-02T14:54:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.290+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c810ace0 con 0x7f76c80f7980 2022-02-02T14:54:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.290+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c8045ad0 con 0x7f76c80f7980 2022-02-02T14:54:30.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.291+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f76b801a060 con 0x7f76c80f7980 2022-02-02T14:54:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.291+0000 7f76affff700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 0x7f76b0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.291+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f76b8081ce0 con 0x7f76c80f7980 2022-02-02T14:54:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.291+0000 7f76c77fe700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 0x7f76b0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.292+0000 7f76c77fe700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 0x7f76b0067270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f76bc013690 tx=0x7f76bc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:30.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.296+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76b80537c0 con 0x7f76c80f7980 2022-02-02T14:54:30.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.544+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f76c8027a00 con 0x7f76c80f7980 2022-02-02T14:54:30.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.545+0000 7f76affff700 1 -- 172.21.15.33:0/2126353901 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f76b8018070 con 0x7f76c80f7980 2022-02-02T14:54:30.545 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:54:30.546 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:54:30.546 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:54:30.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:54:30.547 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:54:30.547 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:54:30.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:54:30.548 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:54:30.549 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:54:30.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:54:30.550 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:54:30.550 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:54:30.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:54:30.551 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:54:30.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:54:30.552 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:54:30.552 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:54:30.553 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:54:30.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 msgr2=0x7f76b0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 0x7f76b0067270 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f76bc013690 tx=0x7f76bc009b30).stop 2022-02-02T14:54:30.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 msgr2=0x7f76c8109690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f76b800c790 tx=0x7f76b8007d70).stop 2022-02-02T14:54:30.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 shutdown_connections 2022-02-02T14:54:30.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76b0064db0 0x7f76b0067270 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76c80f66e0 0x7f76c81091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 --2- 172.21.15.33:0/2126353901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76c80f7980 0x7f76c8109690 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.547+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 >> 172.21.15.33:0/2126353901 conn(0x7f76c80f1e40 msgr2=0x7f76c806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.548+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 shutdown_connections 2022-02-02T14:54:30.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.548+0000 7f76cdcae700 1 -- 172.21.15.33:0/2126353901 wait complete. 2022-02-02T14:54:30.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.648+0000 7f0f7f59e700 1 -- 172.21.15.33:0/921254742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 msgr2=0x7f0f800f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.648+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/921254742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f5850 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f0f70004660 tx=0x7f0f70009b30).stop 2022-02-02T14:54:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- 172.21.15.33:0/921254742 shutdown_connections 2022-02-02T14:54:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/921254742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 0x7f0f800f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/921254742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f5850 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- 172.21.15.33:0/921254742 >> 172.21.15.33:0/921254742 conn(0x7f0f800f0b90 msgr2=0x7f0f800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- 172.21.15.33:0/921254742 shutdown_connections 2022-02-02T14:54:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- 172.21.15.33:0/921254742 wait complete. 2022-02-02T14:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 Processor -- start 2022-02-02T14:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- start start 2022-02-02T14:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 0x7f0f800f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800f7f70 con 0x7f0f800f5430 2022-02-02T14:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.649+0000 7f0f7f59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800f80b0 con 0x7f0f800f66d0 2022-02-02T14:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35074/0 (socket says 172.21.15.33:35074) 2022-02-02T14:54:30.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 -- 172.21.15.33:0/2951900110 learned_addr learned my addr 172.21.15.33:0/2951900110 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:54:30.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7dd9b700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 0x7f0f800f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 -- 172.21.15.33:0/2951900110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 msgr2=0x7f0f800f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 0x7f0f800f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 -- 172.21.15.33:0/2951900110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f70005040 con 0x7f0f800f5430 2022-02-02T14:54:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7e59c700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0f70013a70 tx=0x7f0f70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f70018070 con 0x7f0f800f5430 2022-02-02T14:54:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800f8330 con 0x7f0f800f5430 2022-02-02T14:54:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0f700097d0 con 0x7f0f800f5430 2022-02-02T14:54:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f7001de80 con 0x7f0f800f5430 2022-02-02T14:54:30.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.650+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f800f8890 con 0x7f0f800f5430 2022-02-02T14:54:30.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.651+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f80045ad0 con 0x7f0f800f5430 2022-02-02T14:54:30.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.652+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0f70007ba0 con 0x7f0f800f5430 2022-02-02T14:54:30.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.652+0000 7f0f6effd700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 0x7f0f680672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:54:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.652+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0f700836a0 con 0x7f0f800f5430 2022-02-02T14:54:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.652+0000 7f0f7dd9b700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 0x7f0f680672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:54:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.653+0000 7f0f7dd9b700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 0x7f0f680672e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f0f74004e20 tx=0x7f0f7400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:54:30.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.657+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0f70051750 con 0x7f0f800f5430 2022-02-02T14:54:30.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.865+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0f8010f490 con 0x7f0f800f5430 2022-02-02T14:54:30.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:30 smithi033 ceph-mon[101165]: pgmap v2273: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:30.865 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2126353901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:54:30.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.866+0000 7f0f6effd700 1 -- 172.21.15.33:0/2951900110 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0f70054d70 con 0x7f0f800f5430 2022-02-02T14:54:30.866 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:54:30.866 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:54:30.867 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:54:30.867 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:54:30.867 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:54:30.867 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:54:30.867 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:54:30.868 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:54:30.868 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:54:30.868 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:54:30.868 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:54:30.869 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:54:30.869 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:54:30.869 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:54:30.869 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:54:30.869 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:54:30.870 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:54:30.870 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:54:30.870 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:54:30.870 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:54:30.871 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:54:30.871 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:54:30.871 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:54:30.871 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:54:30.871 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:54:30.872 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:54:30.872 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:54:30.872 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:54:30.872 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:54:30.873 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:54:30.873 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:54:30.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:54:30.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:54:30.873 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:54:30.874 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:54:30.874 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:54:30.874 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:54:30.874 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:54:30.874 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:54:30.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 msgr2=0x7f0f680672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 0x7f0f680672e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f0f74004e20 tx=0x7f0f7400b040).stop 2022-02-02T14:54:30.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 msgr2=0x7f0f800f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:54:30.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f0f70013a70 tx=0x7f0f70009b30).stop 2022-02-02T14:54:30.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 shutdown_connections 2022-02-02T14:54:30.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0f68064e20 0x7f0f680672e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f800f5430 0x7f0f800f9590 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 --2- 172.21.15.33:0/2951900110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f800f66d0 0x7f0f800f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:54:30.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 >> 172.21.15.33:0/2951900110 conn(0x7f0f800f0b90 msgr2=0x7f0f8005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:54:30.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 shutdown_connections 2022-02-02T14:54:30.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:54:30.868+0000 7f0f7f59e700 1 -- 172.21.15.33:0/2951900110 wait complete. 2022-02-02T14:54:30.878 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:54:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:30 smithi037 ceph-mon[69017]: pgmap v2273: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2126353901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:54:31.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:31 smithi033 ceph-mon[101165]: from='client.36404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:31.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:31 smithi033 ceph-mon[101165]: from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:31.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2951900110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:54:32.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:31 smithi037 ceph-mon[69017]: from='client.36404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:32.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:31 smithi037 ceph-mon[69017]: from='client.36408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:54:32.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2951900110' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:54:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:32 smithi033 ceph-mon[101165]: pgmap v2274: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:32 smithi037 ceph-mon[69017]: pgmap v2274: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:34 smithi033 ceph-mon[101165]: pgmap v2275: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:34 smithi037 ceph-mon[69017]: pgmap v2275: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:36 smithi033 ceph-mon[101165]: pgmap v2276: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:36 smithi037 ceph-mon[69017]: pgmap v2276: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:37.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:37 smithi037 ceph-mon[69017]: pgmap v2277: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:37.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:37 smithi033 ceph-mon[101165]: pgmap v2277: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:40 smithi033 ceph-mon[101165]: pgmap v2278: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:40.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:40 smithi037 ceph-mon[69017]: pgmap v2278: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:42 smithi033 ceph-mon[101165]: pgmap v2279: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:43.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:42 smithi037 ceph-mon[69017]: pgmap v2279: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:44 smithi033 ceph-mon[101165]: pgmap v2280: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:45.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:44 smithi037 ceph-mon[69017]: pgmap v2280: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:46 smithi033 ceph-mon[101165]: pgmap v2281: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:46 smithi037 ceph-mon[69017]: pgmap v2281: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:48 smithi033 ceph-mon[101165]: pgmap v2282: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:48 smithi037 ceph-mon[69017]: pgmap v2282: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:50 smithi033 ceph-mon[101165]: pgmap v2283: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:50 smithi037 ceph-mon[69017]: pgmap v2283: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:52 smithi033 ceph-mon[101165]: pgmap v2284: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:52 smithi037 ceph-mon[69017]: pgmap v2284: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:54 smithi033 ceph-mon[101165]: pgmap v2285: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:54:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:54:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:54 smithi037 ceph-mon[69017]: pgmap v2285: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:54:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:54:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:56 smithi033 ceph-mon[101165]: pgmap v2286: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:56 smithi037 ceph-mon[69017]: pgmap v2286: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:54:58 smithi033 ceph-mon[101165]: pgmap v2287: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:54:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:54:58 smithi037 ceph-mon[69017]: pgmap v2287: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:00.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 -- 172.21.15.33:0/1147330430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 msgr2=0x7f75080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 --2- 172.21.15.33:0/1147330430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f75080f7de0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 rx=0x7f7504004660 tx=0x7f7504009b30).stop 2022-02-02T14:55:00.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 -- 172.21.15.33:0/1147330430 shutdown_connections 2022-02-02T14:55:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 --2- 172.21.15.33:0/1147330430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f75080f7de0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 --2- 172.21.15.33:0/1147330430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 0x7f75080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:00.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 -- 172.21.15.33:0/1147330430 >> 172.21.15.33:0/1147330430 conn(0x7f75080f1e40 msgr2=0x7f75080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:00.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:00 smithi033 ceph-mon[101165]: pgmap v2288: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 -- 172.21.15.33:0/1147330430 shutdown_connections 2022-02-02T14:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.984+0000 7f750f30c700 1 -- 172.21.15.33:0/1147330430 wait complete. 2022-02-02T14:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 Processor -- start 2022-02-02T14:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 -- start start 2022-02-02T14:55:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 0x7f7508106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75081079b0 con 0x7f75080f7980 2022-02-02T14:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.985+0000 7f750f30c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508107af0 con 0x7f75080f66e0 2022-02-02T14:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35090/0 (socket says 172.21.15.33:35090) 2022-02-02T14:55:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 -- 172.21.15.33:0/3153115118 learned_addr learned my addr 172.21.15.33:0/3153115118 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750d0a8700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 0x7f7508106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 -- 172.21.15.33:0/3153115118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 msgr2=0x7f7508106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 0x7f7508106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 -- 172.21.15.33:0/3153115118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504005040 con 0x7f75080f7980 2022-02-02T14:55:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750c8a7700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f7504009990 tx=0x7f7504009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7504018070 con 0x7f75080f7980 2022-02-02T14:55:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7504007ba0 con 0x7f75080f7980 2022-02-02T14:55:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.986+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7508108430 con 0x7f75080f7980 2022-02-02T14:55:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.987+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f750401c3c0 con 0x7f75080f7980 2022-02-02T14:55:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.987+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7508108990 con 0x7f75080f7980 2022-02-02T14:55:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.988+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7508045ad0 con 0x7f75080f7980 2022-02-02T14:55:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.988+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f750401d420 con 0x7f75080f7980 2022-02-02T14:55:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.989+0000 7f74fdffb700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 0x7f74f4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.989+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7504083630 con 0x7f75080f7980 2022-02-02T14:55:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.989+0000 7f750d0a8700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 0x7f74f4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.989+0000 7f750d0a8700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 0x7f74f4067290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f75080f77e0 tx=0x7f74f800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:00.993+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f75040550b0 con 0x7f75080f7980 2022-02-02T14:55:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:00 smithi037 ceph-mon[69017]: pgmap v2288: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:01.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.181+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f75080fefb0 con 0x7f74f4064dd0 2022-02-02T14:55:01.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.182+0000 7f74fdffb700 1 -- 172.21.15.33:0/3153115118 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f75080fefb0 con 0x7f74f4064dd0 2022-02-02T14:55:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 msgr2=0x7f74f4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 0x7f74f4067290 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f75080f77e0 tx=0x7f74f800b040).stop 2022-02-02T14:55:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 msgr2=0x7f7508107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f7504009990 tx=0x7f7504009b30).stop 2022-02-02T14:55:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 shutdown_connections 2022-02-02T14:55:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f74f4064dd0 0x7f74f4067290 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75080f66e0 0x7f7508106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 --2- 172.21.15.33:0/3153115118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75080f7980 0x7f7508107400 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 >> 172.21.15.33:0/3153115118 conn(0x7f75080f1e40 msgr2=0x7f75080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 shutdown_connections 2022-02-02T14:55:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.184+0000 7f750f30c700 1 -- 172.21.15.33:0/3153115118 wait complete. 2022-02-02T14:55:01.193 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:55:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 -- 172.21.15.33:0/3188158170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f55c0 msgr2=0x7fdacc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 --2- 172.21.15.33:0/3188158170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f55c0 0x7fdacc0f59e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fdabc004660 tx=0x7fdabc009b30).stop 2022-02-02T14:55:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 -- 172.21.15.33:0/3188158170 shutdown_connections 2022-02-02T14:55:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 --2- 172.21.15.33:0/3188158170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f6860 0x7fdacc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 --2- 172.21.15.33:0/3188158170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f55c0 0x7fdacc0f59e0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 -- 172.21.15.33:0/3188158170 >> 172.21.15.33:0/3188158170 conn(0x7fdacc0f0d40 msgr2=0x7fdacc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 -- 172.21.15.33:0/3188158170 shutdown_connections 2022-02-02T14:55:01.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.286+0000 7fdad240e700 1 -- 172.21.15.33:0/3188158170 wait complete. 2022-02-02T14:55:01.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 Processor -- start 2022-02-02T14:55:01.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 -- start start 2022-02-02T14:55:01.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f55c0 0x7fdacc109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0603c0 con 0x7fdacc0f6860 2022-02-02T14:55:01.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdad240e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc060500 con 0x7fdacc0f55c0 2022-02-02T14:55:01.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdacb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdacb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35100/0 (socket says 172.21.15.33:35100) 2022-02-02T14:55:01.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdacb7fe700 1 -- 172.21.15.33:0/1970311282 learned_addr learned my addr 172.21.15.33:0/1970311282 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:01.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.287+0000 7fdacbfff700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f55c0 0x7fdacc109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdacb7fe700 1 -- 172.21.15.33:0/1970311282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f55c0 msgr2=0x7fdacc109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdacb7fe700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f55c0 0x7fdacc109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdacb7fe700 1 -- 172.21.15.33:0/1970311282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc005040 con 0x7fdacc0f6860 2022-02-02T14:55:01.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdacb7fe700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fdac0002700 tx=0x7fdac0009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac0009320 con 0x7fdacc0f6860 2022-02-02T14:55:01.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdac000f040 con 0x7fdacc0f6860 2022-02-02T14:55:01.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc10c6c0 con 0x7fdacc0f6860 2022-02-02T14:55:01.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdac0014870 con 0x7fdacc0f6860 2022-02-02T14:55:01.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.288+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc10cc50 con 0x7fdacc0f6860 2022-02-02T14:55:01.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.289+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc045ad0 con 0x7fdacc0f6860 2022-02-02T14:55:01.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.290+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdac0009480 con 0x7fdacc0f6860 2022-02-02T14:55:01.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.290+0000 7fdac8ff9700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 0x7fdab4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.290+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdac0081c60 con 0x7fdacc0f6860 2022-02-02T14:55:01.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.290+0000 7fdacbfff700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 0x7fdab4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.290+0000 7fdacbfff700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 0x7fdab4067290 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fdabc013690 tx=0x7fdabc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.294+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdac004fd10 con 0x7fdacc0f6860 2022-02-02T14:55:01.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.476+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdacc057f10 con 0x7fdab4064dd0 2022-02-02T14:55:01.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.491+0000 7fdac8ff9700 1 -- 172.21.15.33:0/1970311282 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fdacc057f10 con 0x7fdab4064dd0 2022-02-02T14:55:01.490 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:55:01.490 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (80m) 42m ago 81m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:55:01.491 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (73m) 42m ago 81m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:55:01.491 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (73m) 42m ago 80m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:55:01.491 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (80m) 42m ago 81m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:55:01.491 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (73m) 42m ago 77m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:55:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (74m) 42m ago 77m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:55:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (75m) 42m ago 77m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:55:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (77m) 42m ago 77m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:55:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (74m) 42m ago 82m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:55:01.492 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (74m) 42m ago 80m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:55:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (74m) 42m ago 82m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:55:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (73m) 42m ago 80m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:55:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (81m) 42m ago 81m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:55:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (80m) 42m ago 80m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:55:01.493 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 42m ago 80m - 4096M 2022-02-02T14:55:01.494 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (79m) 42m ago 79m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:55:01.494 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (79m) 42m ago 79m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:55:01.494 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (79m) 42m ago 79m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:55:01.494 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (78m) 42m ago 78m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:55:01.495 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (78m) 42m ago 78m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:55:01.495 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (80m) 42m ago 80m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:55:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 msgr2=0x7fdab4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 0x7fdab4067290 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fdabc013690 tx=0x7fdabc009b30).stop 2022-02-02T14:55:01.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 msgr2=0x7fdacc10c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7fdac0002700 tx=0x7fdac0009e00).stop 2022-02-02T14:55:01.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 shutdown_connections 2022-02-02T14:55:01.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdab4064dd0 0x7fdab4067290 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdacc0f55c0 0x7fdacc109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 --2- 172.21.15.33:0/1970311282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc0f6860 0x7fdacc10c110 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 >> 172.21.15.33:0/1970311282 conn(0x7fdacc0f0d40 msgr2=0x7fdacc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 shutdown_connections 2022-02-02T14:55:01.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.493+0000 7fdad240e700 1 -- 172.21.15.33:0/1970311282 wait complete. 2022-02-02T14:55:01.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 -- 172.21.15.33:0/3592472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 msgr2=0x7f22d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 --2- 172.21.15.33:0/3592472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d00f59e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f22c0004660 tx=0x7f22c0009b30).stop 2022-02-02T14:55:01.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 -- 172.21.15.33:0/3592472433 shutdown_connections 2022-02-02T14:55:01.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 --2- 172.21.15.33:0/3592472433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22d00f6860 0x7f22d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 --2- 172.21.15.33:0/3592472433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d00f59e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.592+0000 7f22d651c700 1 -- 172.21.15.33:0/3592472433 >> 172.21.15.33:0/3592472433 conn(0x7f22d00f0d40 msgr2=0x7f22d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.593+0000 7f22d651c700 1 -- 172.21.15.33:0/3592472433 shutdown_connections 2022-02-02T14:55:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.593+0000 7f22d651c700 1 -- 172.21.15.33:0/3592472433 wait complete. 2022-02-02T14:55:01.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.593+0000 7f22d651c700 1 Processor -- start 2022-02-02T14:55:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.593+0000 7f22d651c700 1 -- start start 2022-02-02T14:55:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22d651c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22d651c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22d00f6860 0x7f22d01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22d651c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0109b90 con 0x7f22d00f55c0 2022-02-02T14:55:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22d651c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d0109cd0 con 0x7f22d00f6860 2022-02-02T14:55:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35108/0 (socket says 172.21.15.33:35108) 2022-02-02T14:55:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 -- 172.21.15.33:0/462948811 learned_addr learned my addr 172.21.15.33:0/462948811 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:01.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 -- 172.21.15.33:0/462948811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22d00f6860 msgr2=0x7f22d01095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22d00f6860 0x7f22d01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:55:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 -- 172.21.15.33:0/462948811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0005040 con 0x7f22d00f55c0 2022-02-02T14:55:01.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.594+0000 7f22cffff700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f22c0004f60 tx=0x7f22c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.596+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c0018070 con 0x7f22d00f55c0 2022-02-02T14:55:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.596+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f22c0007ba0 con 0x7f22d00f55c0 2022-02-02T14:55:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.596+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22c001c620 con 0x7f22d00f55c0 2022-02-02T14:55:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.596+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d010a610 con 0x7f22d00f55c0 2022-02-02T14:55:01.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.596+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d010ab70 con 0x7f22d00f55c0 2022-02-02T14:55:01.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.597+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d0045ad0 con 0x7f22d00f55c0 2022-02-02T14:55:01.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.597+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f22c001c890 con 0x7f22d00f55c0 2022-02-02T14:55:01.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.598+0000 7f22ccff9700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.598+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f22c0083860 con 0x7f22d00f55c0 2022-02-02T14:55:01.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.598+0000 7f22cf7fe700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.598+0000 7f22cf7fe700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 0x7f22b8067290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f22c40047d0 tx=0x7f22c4007a40).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.602+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f22c0055340 con 0x7f22d00f55c0 2022-02-02T14:55:01.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.853+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f22d010f710 con 0x7f22d00f55c0 2022-02-02T14:55:01.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.854+0000 7f22ccff9700 1 -- 172.21.15.33:0/462948811 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f22c0054f30 con 0x7f22d00f55c0 2022-02-02T14:55:01.853 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:55:01.854 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:55:01.854 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:55:01.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:01.854 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:55:01.855 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:55:01.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:01.855 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:55:01.855 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:55:01.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:01.856 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:55:01.856 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:55:01.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:01.857 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:55:01.857 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:55:01.857 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:55:01.857 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:55:01.858 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:55:01.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.855+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 msgr2=0x7f22b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.855+0000 7f22d651c700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 0x7f22b8067290 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f22c40047d0 tx=0x7f22c4007a40).stop 2022-02-02T14:55:01.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.855+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 msgr2=0x7f22d01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.855+0000 7f22d651c700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 rx=0x7f22c0004f60 tx=0x7f22c0009b30).stop 2022-02-02T14:55:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 shutdown_connections 2022-02-02T14:55:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22b8064dd0 0x7f22b8067290 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22d00f55c0 0x7f22d01090f0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 --2- 172.21.15.33:0/462948811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22d00f6860 0x7f22d01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:55:01.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 >> 172.21.15.33:0/462948811 conn(0x7f22d00f0d40 msgr2=0x7f22d005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 shutdown_connections 2022-02-02T14:55:01.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.856+0000 7f22d651c700 1 -- 172.21.15.33:0/462948811 wait complete. 2022-02-02T14:55:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 -- 172.21.15.33:0/2998626901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 msgr2=0x7fa6140f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2998626901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa6140f59e0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7fa604004660 tx=0x7fa604009b30).stop 2022-02-02T14:55:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 -- 172.21.15.33:0/2998626901 shutdown_connections 2022-02-02T14:55:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2998626901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa6140f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2998626901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa6140f59e0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 -- 172.21.15.33:0/2998626901 >> 172.21.15.33:0/2998626901 conn(0x7fa6140f0d40 msgr2=0x7fa6140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 -- 172.21.15.33:0/2998626901 shutdown_connections 2022-02-02T14:55:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.957+0000 7fa6195cb700 1 -- 172.21.15.33:0/2998626901 wait complete. 2022-02-02T14:55:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 Processor -- start 2022-02-02T14:55:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 -- start start 2022-02-02T14:55:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa614109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614109c00 con 0x7fa6140f55c0 2022-02-02T14:55:01.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6195cb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa614109d40 con 0x7fa6140f6860 2022-02-02T14:55:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa612ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35118/0 (socket says 172.21.15.33:35118) 2022-02-02T14:55:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa612ffd700 1 -- 172.21.15.33:0/2169065385 learned_addr learned my addr 172.21.15.33:0/2169065385 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:01.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.958+0000 7fa6127fc700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa614109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa612ffd700 1 -- 172.21.15.33:0/2169065385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 msgr2=0x7fa614109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa612ffd700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa614109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa612ffd700 1 -- 172.21.15.33:0/2169065385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604005040 con 0x7fa6140f55c0 2022-02-02T14:55:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa6127fc700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa614109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:55:01.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa612ffd700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fa604004f60 tx=0x7fa604009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa604018070 con 0x7fa6140f55c0 2022-02-02T14:55:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa604007ba0 con 0x7fa6140f55c0 2022-02-02T14:55:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61410a680 con 0x7fa6140f55c0 2022-02-02T14:55:01.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60401c620 con 0x7fa6140f55c0 2022-02-02T14:55:01.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.959+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61410abe0 con 0x7fa6140f55c0 2022-02-02T14:55:01.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.960+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa614045ad0 con 0x7fa6140f55c0 2022-02-02T14:55:01.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.960+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa60401d420 con 0x7fa6140f55c0 2022-02-02T14:55:01.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.961+0000 7fa60b7fe700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 0x7fa600067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:01.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.961+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa6040838e0 con 0x7fa6140f55c0 2022-02-02T14:55:01.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.961+0000 7fa6127fc700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 0x7fa600067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:01.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.961+0000 7fa6127fc700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 0x7fa600067290 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fa5fc0041d0 tx=0x7fa5fc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:01.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:01.965+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa604055480 con 0x7fa6140f55c0 2022-02-02T14:55:02.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.179+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa61410f780 con 0x7fa6140f55c0 2022-02-02T14:55:02.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.180+0000 7fa60b7fe700 1 -- 172.21.15.33:0/2169065385 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa604055070 con 0x7fa6140f55c0 2022-02-02T14:55:02.180 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:55:02.180 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:55:02.181 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:55:02.181 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:55:02.181 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:02.181 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:55:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:55:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:55:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:55:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:55:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:55:02.183 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:55:02.183 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:55:02.183 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:55:02.183 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:55:02.184 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:55:02.184 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:55:02.184 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:55:02.184 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:55:02.184 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:55:02.185 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:55:02.185 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:55:02.185 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:55:02.185 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:55:02.185 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:55:02.186 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:55:02.186 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:55:02.186 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:55:02.186 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:55:02.187 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:55:02.187 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:55:02.187 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:02.187 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:02.187 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:55:02.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:02.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:02.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:02.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:02.188 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:02.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.183+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 msgr2=0x7fa600067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:02.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.183+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 0x7fa600067290 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fa5fc0041d0 tx=0x7fa5fc009040).stop 2022-02-02T14:55:02.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.183+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 msgr2=0x7fa614109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:02.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.183+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7fa604004f60 tx=0x7fa604009b30).stop 2022-02-02T14:55:02.190 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.183+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 shutdown_connections 2022-02-02T14:55:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa600064dd0 0x7fa600067290 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6140f55c0 0x7fa614109160 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 --2- 172.21.15.33:0/2169065385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6140f6860 0x7fa614109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 >> 172.21.15.33:0/2169065385 conn(0x7fa6140f0d40 msgr2=0x7fa61405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:02.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 shutdown_connections 2022-02-02T14:55:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:02.184+0000 7fa6195cb700 1 -- 172.21.15.33:0/2169065385 wait complete. 2022-02-02T14:55:02.192 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:55:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:02 smithi033 ceph-mon[101165]: from='client.36420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:02 smithi033 ceph-mon[101165]: pgmap v2289: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:02.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:02 smithi033 ceph-mon[101165]: from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:02.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/462948811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:55:02.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2169065385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:55:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:02 smithi037 ceph-mon[69017]: from='client.36420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:02 smithi037 ceph-mon[69017]: pgmap v2289: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:02 smithi037 ceph-mon[69017]: from='client.36424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/462948811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:55:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2169065385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:55:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:04 smithi033 ceph-mon[101165]: pgmap v2290: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:04 smithi037 ceph-mon[69017]: pgmap v2290: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:06 smithi033 ceph-mon[101165]: pgmap v2291: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:06 smithi037 ceph-mon[69017]: pgmap v2291: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:08 smithi033 ceph-mon[101165]: pgmap v2292: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:09.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:08 smithi037 ceph-mon[69017]: pgmap v2292: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:10 smithi033 ceph-mon[101165]: pgmap v2293: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:10 smithi037 ceph-mon[69017]: pgmap v2293: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:12.896 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:12 smithi033 ceph-mon[101165]: pgmap v2294: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:12 smithi037 ceph-mon[69017]: pgmap v2294: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:14.897 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:14 smithi033 ceph-mon[101165]: pgmap v2295: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:14 smithi037 ceph-mon[69017]: pgmap v2295: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:16 smithi033 ceph-mon[101165]: pgmap v2296: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:16 smithi037 ceph-mon[69017]: pgmap v2296: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:18.993 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:18 smithi033 ceph-mon[101165]: pgmap v2297: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:18 smithi037 ceph-mon[69017]: pgmap v2297: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:19.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:19 smithi033 ceph-mon[101165]: pgmap v2298: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:20.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:19 smithi037 ceph-mon[69017]: pgmap v2298: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:22 smithi033 ceph-mon[101165]: pgmap v2299: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:22 smithi037 ceph-mon[69017]: pgmap v2299: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:24 smithi033 ceph-mon[101165]: pgmap v2300: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:24 smithi037 ceph-mon[69017]: pgmap v2300: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:26.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:26 smithi033 ceph-mon[101165]: pgmap v2301: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:26 smithi037 ceph-mon[69017]: pgmap v2301: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:28 smithi033 ceph-mon[101165]: pgmap v2302: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:28 smithi037 ceph-mon[69017]: pgmap v2302: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:30 smithi033 ceph-mon[101165]: pgmap v2303: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:30 smithi037 ceph-mon[69017]: pgmap v2303: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 -- 172.21.15.33:0/2386603815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 msgr2=0x7f4ddc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 --2- 172.21.15.33:0/2386603815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc0f5850 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f4dd0004660 tx=0x7f4dd0009b30).stop 2022-02-02T14:55:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 -- 172.21.15.33:0/2386603815 shutdown_connections 2022-02-02T14:55:32.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 --2- 172.21.15.33:0/2386603815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 --2- 172.21.15.33:0/2386603815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc0f5850 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 -- 172.21.15.33:0/2386603815 >> 172.21.15.33:0/2386603815 conn(0x7f4ddc0f0b90 msgr2=0x7f4ddc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:32.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 -- 172.21.15.33:0/2386603815 shutdown_connections 2022-02-02T14:55:32.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.302+0000 7f4de2c12700 1 -- 172.21.15.33:0/2386603815 wait complete. 2022-02-02T14:55:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 Processor -- start 2022-02-02T14:55:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 -- start start 2022-02-02T14:55:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc106220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1067d0 con 0x7f4ddc0f5430 2022-02-02T14:55:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.303+0000 7f4de2c12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc106fd0 con 0x7f4ddc0f66d0 2022-02-02T14:55:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35128/0 (socket says 172.21.15.33:35128) 2022-02-02T14:55:32.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 -- 172.21.15.33:0/110248691 learned_addr learned my addr 172.21.15.33:0/110248691 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:32.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de140f700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc106220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 -- 172.21.15.33:0/110248691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 msgr2=0x7f4ddc106220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc106220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 -- 172.21.15.33:0/110248691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0005040 con 0x7f4ddc0f5430 2022-02-02T14:55:32.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de140f700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:55:32.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de1c10700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f4dd0013a70 tx=0x7f4dd0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd0018070 con 0x7f4ddc0f5430 2022-02-02T14:55:32.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc107250 con 0x7f4ddc0f5430 2022-02-02T14:55:32.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4dd00097d0 con 0x7f4ddc0f5430 2022-02-02T14:55:32.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dd001c3c0 con 0x7f4ddc0f5430 2022-02-02T14:55:32.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.304+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc107680 con 0x7f4ddc0f5430 2022-02-02T14:55:32.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.305+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc045ad0 con 0x7f4ddc0f5430 2022-02-02T14:55:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.306+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4dd0007ba0 con 0x7f4ddc0f5430 2022-02-02T14:55:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.306+0000 7f4dce7fc700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 0x7f4dc80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.306+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4dd0083780 con 0x7f4ddc0f5430 2022-02-02T14:55:32.312 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.306+0000 7f4de140f700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 0x7f4dc80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.307+0000 7f4de140f700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 0x7f4dc80672e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f4dd8009740 tx=0x7f4dd8009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.311+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4dd0055320 con 0x7f4ddc0f5430 2022-02-02T14:55:32.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.502+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ddc0ff670 con 0x7f4dc8064e20 2022-02-02T14:55:32.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.503+0000 7f4dce7fc700 1 -- 172.21.15.33:0/110248691 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4ddc0ff670 con 0x7f4dc8064e20 2022-02-02T14:55:32.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 msgr2=0x7f4dc80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 0x7f4dc80672e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f4dd8009740 tx=0x7f4dd8009be0).stop 2022-02-02T14:55:32.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 msgr2=0x7f4ddc105d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f4dd0013a70 tx=0x7f4dd0009b30).stop 2022-02-02T14:55:32.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 shutdown_connections 2022-02-02T14:55:32.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4dc8064e20 0x7f4dc80672e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ddc0f5430 0x7f4ddc105d30 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 --2- 172.21.15.33:0/110248691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ddc0f66d0 0x7f4ddc106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 >> 172.21.15.33:0/110248691 conn(0x7f4ddc0f0b90 msgr2=0x7f4ddc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:32.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 shutdown_connections 2022-02-02T14:55:32.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.505+0000 7f4de2c12700 1 -- 172.21.15.33:0/110248691 wait complete. 2022-02-02T14:55:32.514 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:55:32.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 -- 172.21.15.33:0/683462317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f6530 msgr2=0x7f05100f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 --2- 172.21.15.33:0/683462317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f6530 0x7f05100f6950 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f0500004660 tx=0x7f0500009b30).stop 2022-02-02T14:55:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 -- 172.21.15.33:0/683462317 shutdown_connections 2022-02-02T14:55:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 --2- 172.21.15.33:0/683462317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f77d0 0x7f05100f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 --2- 172.21.15.33:0/683462317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f6530 0x7f05100f6950 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 -- 172.21.15.33:0/683462317 >> 172.21.15.33:0/683462317 conn(0x7f05100f1c90 msgr2=0x7f05100f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 -- 172.21.15.33:0/683462317 shutdown_connections 2022-02-02T14:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.605+0000 7f0514b61700 1 -- 172.21.15.33:0/683462317 wait complete. 2022-02-02T14:55:32.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 Processor -- start 2022-02-02T14:55:32.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 -- start start 2022-02-02T14:55:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f6530 0x7f0510106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510107880 con 0x7f05100f77d0 2022-02-02T14:55:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.606+0000 7f0514b61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0510108090 con 0x7f05100f6530 2022-02-02T14:55:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35140/0 (socket says 172.21.15.33:35140) 2022-02-02T14:55:32.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 -- 172.21.15.33:0/3578726589 learned_addr learned my addr 172.21.15.33:0/3578726589 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:32.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050f7fe700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f6530 0x7f0510106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 -- 172.21.15.33:0/3578726589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f6530 msgr2=0x7f0510106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f6530 0x7f0510106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 -- 172.21.15.33:0/3578726589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500005040 con 0x7f05100f77d0 2022-02-02T14:55:32.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f050effd700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f050400e7f0 tx=0x7f050400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05040092e0 con 0x7f05100f77d0 2022-02-02T14:55:32.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f050400f040 con 0x7f05100f77d0 2022-02-02T14:55:32.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.607+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0510108310 con 0x7f05100f77d0 2022-02-02T14:55:32.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.608+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0504014750 con 0x7f05100f77d0 2022-02-02T14:55:32.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.608+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05101088d0 con 0x7f05100f77d0 2022-02-02T14:55:32.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.609+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0510059100 con 0x7f05100f77d0 2022-02-02T14:55:32.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.609+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f050401b030 con 0x7f05100f77d0 2022-02-02T14:55:32.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.610+0000 7f04f7fff700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 0x7f04f80673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.610+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0504081710 con 0x7f05100f77d0 2022-02-02T14:55:32.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.610+0000 7f050f7fe700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 0x7f04f80673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.610+0000 7f050f7fe700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 0x7f04f80673b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0500000c00 tx=0x7f0500016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.616 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.614+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f050404a7d0 con 0x7f05100f77d0 2022-02-02T14:55:32.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.796+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f05100fed60 con 0x7f04f8064ef0 2022-02-02T14:55:32.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.811+0000 7f04f7fff700 1 -- 172.21.15.33:0/3578726589 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f05100fed60 con 0x7f04f8064ef0 2022-02-02T14:55:32.811 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:55:32.811 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (80m) 42m ago 81m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:55:32.811 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (73m) 42m ago 81m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:55:32.811 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (73m) 42m ago 81m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:55:32.812 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (80m) 42m ago 81m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:55:32.812 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (74m) 42m ago 78m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:55:32.812 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (74m) 42m ago 77m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:55:32.812 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (75m) 42m ago 78m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:55:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (78m) 42m ago 78m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:55:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (75m) 42m ago 83m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:55:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (75m) 42m ago 81m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:55:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (74m) 42m ago 83m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:55:32.813 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (74m) 42m ago 81m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:55:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (81m) 42m ago 81m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:55:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (81m) 42m ago 81m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:55:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 42m ago 80m - 4096M 2022-02-02T14:55:32.814 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (80m) 42m ago 80m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:55:32.815 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (79m) 42m ago 79m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:55:32.815 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (79m) 42m ago 79m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:55:32.815 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (79m) 42m ago 79m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:55:32.815 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (79m) 42m ago 79m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:55:32.815 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (80m) 42m ago 81m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:55:32.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 msgr2=0x7f04f80673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 0x7f04f80673b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f0500000c00 tx=0x7f0500016040).stop 2022-02-02T14:55:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 msgr2=0x7f0510107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f050400e7f0 tx=0x7f050400b040).stop 2022-02-02T14:55:32.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 shutdown_connections 2022-02-02T14:55:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f04f8064ef0 0x7f04f80673b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05100f6530 0x7f0510106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 --2- 172.21.15.33:0/3578726589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05100f77d0 0x7f0510107280 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.813+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 >> 172.21.15.33:0/3578726589 conn(0x7f05100f1c90 msgr2=0x7f05100fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:32.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.814+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 shutdown_connections 2022-02-02T14:55:32.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.814+0000 7f0514b61700 1 -- 172.21.15.33:0/3578726589 wait complete. 2022-02-02T14:55:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 -- 172.21.15.33:0/3367279853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f6860 msgr2=0x7f6cf40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 --2- 172.21.15.33:0/3367279853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f6cc0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f6ce4004660 tx=0x7f6ce4009b30).stop 2022-02-02T14:55:32.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 -- 172.21.15.33:0/3367279853 shutdown_connections 2022-02-02T14:55:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 --2- 172.21.15.33:0/3367279853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f6cc0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 --2- 172.21.15.33:0/3367279853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.913+0000 7f6cfc766700 1 -- 172.21.15.33:0/3367279853 >> 172.21.15.33:0/3367279853 conn(0x7f6cf40f0d40 msgr2=0x7f6cf40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:32.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:32 smithi033 ceph-mon[101165]: pgmap v2304: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 -- 172.21.15.33:0/3367279853 shutdown_connections 2022-02-02T14:55:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 -- 172.21.15.33:0/3367279853 wait complete. 2022-02-02T14:55:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 Processor -- start 2022-02-02T14:55:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 -- start start 2022-02-02T14:55:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40f8100 con 0x7f6cf40f55c0 2022-02-02T14:55:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.914+0000 7f6cfc766700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40f8240 con 0x7f6cf40f6860 2022-02-02T14:55:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35148/0 (socket says 172.21.15.33:35148) 2022-02-02T14:55:32.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 -- 172.21.15.33:0/2581418260 learned_addr learned my addr 172.21.15.33:0/2581418260 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cf9d01700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 -- 172.21.15.33:0/2581418260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f6860 msgr2=0x7f6cf40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:32.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 -- 172.21.15.33:0/2581418260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4005040 con 0x7f6cf40f55c0 2022-02-02T14:55:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfa502700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6cf000e7c0 tx=0x7f6cf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf00092e0 con 0x7f6cf40f55c0 2022-02-02T14:55:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6cf000f040 con 0x7f6cf40f55c0 2022-02-02T14:55:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf40f8520 con 0x7f6cf40f55c0 2022-02-02T14:55:32.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6cf00147e0 con 0x7f6cf40f55c0 2022-02-02T14:55:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.915+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf410ef20 con 0x7f6cf40f55c0 2022-02-02T14:55:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.916+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf4045ad0 con 0x7f6cf40f55c0 2022-02-02T14:55:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.917+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6cf001b030 con 0x7f6cf40f55c0 2022-02-02T14:55:32.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.917+0000 7f6ceaffd700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 0x7f6ce0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.918+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6cf0081a00 con 0x7f6cf40f55c0 2022-02-02T14:55:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.918+0000 7f6cf9d01700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 0x7f6ce0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:32.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.918+0000 7f6cf9d01700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 0x7f6ce0067290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6ce4005010 tx=0x7f6ce4016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:32.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:32.922+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6cf004fab0 con 0x7f6cf40f55c0 2022-02-02T14:55:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:32 smithi037 ceph-mon[69017]: pgmap v2304: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.163+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6cf410f670 con 0x7f6cf40f55c0 2022-02-02T14:55:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.164+0000 7f6ceaffd700 1 -- 172.21.15.33:0/2581418260 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f6cf00192d0 con 0x7f6cf40f55c0 2022-02-02T14:55:33.163 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:55:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:55:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:55:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:55:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:55:33.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:55:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:55:33.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:55:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:55:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:55:33.167 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:55:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:55:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:55:33.168 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:55:33.168 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:55:33.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.165+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 msgr2=0x7f6ce0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.165+0000 7f6cfc766700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 0x7f6ce0067290 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f6ce4005010 tx=0x7f6ce4016040).stop 2022-02-02T14:55:33.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 msgr2=0x7f6cf40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f6cf000e7c0 tx=0x7f6cf000b040).stop 2022-02-02T14:55:33.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 shutdown_connections 2022-02-02T14:55:33.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ce0064dd0 0x7f6ce0067290 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cf40f55c0 0x7f6cf40f9720 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 --2- 172.21.15.33:0/2581418260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cf40f6860 0x7f6cf40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 >> 172.21.15.33:0/2581418260 conn(0x7f6cf40f0d40 msgr2=0x7f6cf405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:33.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 shutdown_connections 2022-02-02T14:55:33.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.166+0000 7f6cfc766700 1 -- 172.21.15.33:0/2581418260 wait complete. 2022-02-02T14:55:33.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 -- 172.21.15.33:0/286425843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 msgr2=0x7f07300f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 --2- 172.21.15.33:0/286425843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f6cc0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f0724004660 tx=0x7f0724009b30).stop 2022-02-02T14:55:33.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 -- 172.21.15.33:0/286425843 shutdown_connections 2022-02-02T14:55:33.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 --2- 172.21.15.33:0/286425843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f6cc0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 --2- 172.21.15.33:0/286425843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 0x7f07300f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.266+0000 7f0735dad700 1 -- 172.21.15.33:0/286425843 >> 172.21.15.33:0/286425843 conn(0x7f07300f0d40 msgr2=0x7f07300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:33.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 -- 172.21.15.33:0/286425843 shutdown_connections 2022-02-02T14:55:33.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 -- 172.21.15.33:0/286425843 wait complete. 2022-02-02T14:55:33.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 Processor -- start 2022-02-02T14:55:33.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 -- start start 2022-02-02T14:55:33.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 0x7f07300f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:33.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:33.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300f8100 con 0x7f07300f6860 2022-02-02T14:55:33.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.267+0000 7f0735dad700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07300f8240 con 0x7f07300f55c0 2022-02-02T14:55:33.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:33.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35160/0 (socket says 172.21.15.33:35160) 2022-02-02T14:55:33.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 -- 172.21.15.33:0/1780147518 learned_addr learned my addr 172.21.15.33:0/1780147518 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:55:33.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072f7fe700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 0x7f07300f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:33.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 -- 172.21.15.33:0/1780147518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 msgr2=0x7f07300f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 0x7f07300f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 -- 172.21.15.33:0/1780147518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0724005040 con 0x7f07300f6860 2022-02-02T14:55:33.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f072effd700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f0724009990 tx=0x7f0724009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:33.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0724018070 con 0x7f07300f6860 2022-02-02T14:55:33.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07300f84c0 con 0x7f07300f6860 2022-02-02T14:55:33.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0724007ba0 con 0x7f07300f6860 2022-02-02T14:55:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f072401c620 con 0x7f07300f6860 2022-02-02T14:55:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.268+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07300f8a20 con 0x7f07300f6860 2022-02-02T14:55:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.269+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0730045ad0 con 0x7f07300f6860 2022-02-02T14:55:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.270+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f072401c8e0 con 0x7f07300f6860 2022-02-02T14:55:33.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.270+0000 7f0717fff700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 0x7f0718067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:55:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.271+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0724083b20 con 0x7f07300f6860 2022-02-02T14:55:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.271+0000 7f072f7fe700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 0x7f0718067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:55:33.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.271+0000 7f072f7fe700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 0x7f0718067290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f07300f94b0 tx=0x7f0720009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:55:33.277 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.274+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0724051bd0 con 0x7f07300f6860 2022-02-02T14:55:33.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.486+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f07300fdd80 con 0x7f07300f6860 2022-02-02T14:55:33.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.487+0000 7f0717fff700 1 -- 172.21.15.33:0/1780147518 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f07240551f0 con 0x7f07300f6860 2022-02-02T14:55:33.486 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:55:33.487 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:55:33.487 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:55:33.487 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:55:33.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:33.488 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:55:33.488 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:55:33.488 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:55:33.488 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:55:33.489 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:55:33.489 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:55:33.490 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:55:33.490 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:55:33.490 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:55:33.490 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:55:33.491 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:55:33.491 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:55:33.491 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:55:33.491 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:55:33.492 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:55:33.492 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:55:33.492 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:55:33.492 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:55:33.492 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:55:33.493 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:55:33.493 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:55:33.493 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:55:33.493 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:55:33.494 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:55:33.494 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:55:33.494 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:55:33.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:33.495 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:55:33.495 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:55:33.495 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:33.496 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:33.496 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:33.496 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:55:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 msgr2=0x7f0718067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 0x7f0718067290 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f07300f94b0 tx=0x7f0720009040).stop 2022-02-02T14:55:33.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 msgr2=0x7f07300f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:55:33.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7f0724009990 tx=0x7f0724009b30).stop 2022-02-02T14:55:33.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 shutdown_connections 2022-02-02T14:55:33.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0718064dd0 0x7f0718067290 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07300f55c0 0x7f07300f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 --2- 172.21.15.33:0/1780147518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07300f6860 0x7f07300f7ba0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:55:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 >> 172.21.15.33:0/1780147518 conn(0x7f07300f0d40 msgr2=0x7f073005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:55:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 shutdown_connections 2022-02-02T14:55:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:55:33.489+0000 7f0735dad700 1 -- 172.21.15.33:0/1780147518 wait complete. 2022-02-02T14:55:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:55:33.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:33 smithi033 ceph-mon[101165]: from='client.36436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2581418260' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:55:33.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1780147518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:55:34.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:33 smithi037 ceph-mon[69017]: from='client.36436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:34.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2581418260' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:55:34.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1780147518' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:55:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:34 smithi033 ceph-mon[101165]: from='client.36440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:34.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:34 smithi033 ceph-mon[101165]: pgmap v2305: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:34 smithi037 ceph-mon[69017]: from='client.36440 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:55:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:34 smithi037 ceph-mon[69017]: pgmap v2305: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:36 smithi033 ceph-mon[101165]: pgmap v2306: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:36 smithi037 ceph-mon[69017]: pgmap v2306: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:38 smithi033 ceph-mon[101165]: pgmap v2307: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:38 smithi037 ceph-mon[69017]: pgmap v2307: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:40 smithi033 ceph-mon[101165]: pgmap v2308: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:40 smithi037 ceph-mon[69017]: pgmap v2308: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:42 smithi033 ceph-mon[101165]: pgmap v2309: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:42 smithi037 ceph-mon[69017]: pgmap v2309: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:44 smithi033 ceph-mon[101165]: pgmap v2310: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:44 smithi037 ceph-mon[69017]: pgmap v2310: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:46 smithi033 ceph-mon[101165]: pgmap v2311: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:46 smithi037 ceph-mon[69017]: pgmap v2311: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:48 smithi033 ceph-mon[101165]: pgmap v2312: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:48 smithi037 ceph-mon[69017]: pgmap v2312: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:50 smithi033 ceph-mon[101165]: pgmap v2313: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:50 smithi037 ceph-mon[69017]: pgmap v2313: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:52 smithi033 ceph-mon[101165]: pgmap v2314: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:53.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:52 smithi037 ceph-mon[69017]: pgmap v2314: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:53.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:53 smithi033 ceph-mon[101165]: pgmap v2315: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:54.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:53 smithi037 ceph-mon[69017]: pgmap v2315: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:55:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:55:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:55:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:55:55.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:55 smithi033 ceph-mon[101165]: pgmap v2316: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:56.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:55 smithi037 ceph-mon[69017]: pgmap v2316: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:55:58 smithi033 ceph-mon[101165]: pgmap v2317: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:55:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:55:58 smithi037 ceph-mon[69017]: pgmap v2317: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:00 smithi033 ceph-mon[101165]: pgmap v2318: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:00 smithi037 ceph-mon[69017]: pgmap v2318: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:02 smithi033 ceph-mon[101165]: pgmap v2319: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:02 smithi037 ceph-mon[69017]: pgmap v2319: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:03.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 -- 172.21.15.33:0/344037154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 msgr2=0x7fd78c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 --2- 172.21.15.33:0/344037154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c0f59e0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fd780004660 tx=0x7fd780009b30).stop 2022-02-02T14:56:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 -- 172.21.15.33:0/344037154 shutdown_connections 2022-02-02T14:56:03.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 --2- 172.21.15.33:0/344037154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 0x7fd78c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 --2- 172.21.15.33:0/344037154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c0f59e0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 -- 172.21.15.33:0/344037154 >> 172.21.15.33:0/344037154 conn(0x7fd78c0f0d40 msgr2=0x7fd78c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 -- 172.21.15.33:0/344037154 shutdown_connections 2022-02-02T14:56:03.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.605+0000 7fd792bf6700 1 -- 172.21.15.33:0/344037154 wait complete. 2022-02-02T14:56:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 Processor -- start 2022-02-02T14:56:03.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 -- start start 2022-02-02T14:56:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 0x7fd78c1095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c109ba0 con 0x7fd78c0f55c0 2022-02-02T14:56:03.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd792bf6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c109ce0 con 0x7fd78c0f6860 2022-02-02T14:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd790992700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd790992700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35182/0 (socket says 172.21.15.33:35182) 2022-02-02T14:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd790992700 1 -- 172.21.15.33:0/705268643 learned_addr learned my addr 172.21.15.33:0/705268643 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:03.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.606+0000 7fd78bfff700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 0x7fd78c1095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd790992700 1 -- 172.21.15.33:0/705268643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 msgr2=0x7fd78c1095f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd790992700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 0x7fd78c1095f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd790992700 1 -- 172.21.15.33:0/705268643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780005040 con 0x7fd78c0f55c0 2022-02-02T14:56:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd790992700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fd780009830 tx=0x7fd780009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd780018070 con 0x7fd78c0f55c0 2022-02-02T14:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd780007ba0 con 0x7fd78c0f55c0 2022-02-02T14:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c10a620 con 0x7fd78c0f55c0 2022-02-02T14:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd78001de60 con 0x7fd78c0f55c0 2022-02-02T14:56:03.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.607+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c10ab80 con 0x7fd78c0f55c0 2022-02-02T14:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.608+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c045ad0 con 0x7fd78c0f55c0 2022-02-02T14:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.608+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd780007d10 con 0x7fd78c0f55c0 2022-02-02T14:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.609+0000 7fd7897fa700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 0x7fd77c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.609+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd780083590 con 0x7fd78c0f55c0 2022-02-02T14:56:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.609+0000 7fd78bfff700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 0x7fd77c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.609+0000 7fd78bfff700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 0x7fd77c067270 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd778004ce0 tx=0x7fd77800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.613+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd7800550d0 con 0x7fd78c0f55c0 2022-02-02T14:56:03.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.803+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd78c0faaa0 con 0x7fd77c064db0 2022-02-02T14:56:03.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.804+0000 7fd7897fa700 1 -- 172.21.15.33:0/705268643 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd78c0faaa0 con 0x7fd77c064db0 2022-02-02T14:56:03.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 msgr2=0x7fd77c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 0x7fd77c067270 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fd778004ce0 tx=0x7fd77800b040).stop 2022-02-02T14:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 msgr2=0x7fd78c109100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7fd780009830 tx=0x7fd780009b30).stop 2022-02-02T14:56:03.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 shutdown_connections 2022-02-02T14:56:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd77c064db0 0x7fd77c067270 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd78c0f55c0 0x7fd78c109100 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 --2- 172.21.15.33:0/705268643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd78c0f6860 0x7fd78c1095f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.806+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 >> 172.21.15.33:0/705268643 conn(0x7fd78c0f0d40 msgr2=0x7fd78c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.807+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 shutdown_connections 2022-02-02T14:56:03.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.807+0000 7fd792bf6700 1 -- 172.21.15.33:0/705268643 wait complete. 2022-02-02T14:56:03.815 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:56:03.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 -- 172.21.15.33:0/3606129413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f55c0 msgr2=0x7f686c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 --2- 172.21.15.33:0/3606129413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f55c0 0x7f686c0f59e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f6868004660 tx=0x7f6868009b30).stop 2022-02-02T14:56:03.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 -- 172.21.15.33:0/3606129413 shutdown_connections 2022-02-02T14:56:03.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 --2- 172.21.15.33:0/3606129413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f6860 0x7f686c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 --2- 172.21.15.33:0/3606129413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f55c0 0x7f686c0f59e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 -- 172.21.15.33:0/3606129413 >> 172.21.15.33:0/3606129413 conn(0x7f686c0f0d40 msgr2=0x7f686c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 -- 172.21.15.33:0/3606129413 shutdown_connections 2022-02-02T14:56:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.908+0000 7f6873cf0700 1 -- 172.21.15.33:0/3606129413 wait complete. 2022-02-02T14:56:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 Processor -- start 2022-02-02T14:56:03.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 -- start start 2022-02-02T14:56:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c107a10 con 0x7f686c0f6860 2022-02-02T14:56:03.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6873cf0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c107b50 con 0x7f686c0f55c0 2022-02-02T14:56:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f687128b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6871a8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6871a8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:45908/0 (socket says 172.21.15.33:45908) 2022-02-02T14:56:03.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f687128b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35194/0 (socket says 172.21.15.33:35194) 2022-02-02T14:56:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6871a8c700 1 -- 172.21.15.33:0/1449964860 learned_addr learned my addr 172.21.15.33:0/1449964860 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.909+0000 7f6871a8c700 1 -- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 msgr2=0x7f686c107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f6871a8c700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f6871a8c700 1 -- 172.21.15.33:0/1449964860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868005040 con 0x7f686c0f55c0 2022-02-02T14:56:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f687128b700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T14:56:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f6871a8c700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6868013a70 tx=0x7f6868009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6868018070 con 0x7f686c0f55c0 2022-02-02T14:56:03.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c108490 con 0x7f686c0f55c0 2022-02-02T14:56:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f68680097d0 con 0x7f686c0f55c0 2022-02-02T14:56:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f686801de80 con 0x7f686c0f55c0 2022-02-02T14:56:03.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.910+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c1089f0 con 0x7f686c0f55c0 2022-02-02T14:56:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.911+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c045ad0 con 0x7f686c0f55c0 2022-02-02T14:56:03.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.911+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6868007ba0 con 0x7f686c0f55c0 2022-02-02T14:56:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.912+0000 7f68627fc700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 0x7f6858067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.912+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f68680836b0 con 0x7f686c0f55c0 2022-02-02T14:56:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.912+0000 7f687128b700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 0x7f6858067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:03.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.912+0000 7f687128b700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 0x7f6858067290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f685c0102e0 tx=0x7f685c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:03.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:03.917+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6868055190 con 0x7f686c0f55c0 2022-02-02T14:56:04.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.100+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f686c0faca0 con 0x7f6858064dd0 2022-02-02T14:56:04.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.114+0000 7f68627fc700 1 -- 172.21.15.33:0/1449964860 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f686c0faca0 con 0x7f6858064dd0 2022-02-02T14:56:04.113 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:56:04.114 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (81m) 43m ago 82m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:56:04.114 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (74m) 43m ago 82m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:56:04.114 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (74m) 43m ago 81m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:56:04.115 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (81m) 43m ago 82m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:56:04.115 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (74m) 43m ago 78m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:56:04.115 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (75m) 43m ago 78m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:56:04.115 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (76m) 43m ago 78m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:56:04.115 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (78m) 43m ago 78m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:56:04.116 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (76m) 43m ago 83m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:56:04.116 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (75m) 43m ago 81m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:56:04.116 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (75m) 43m ago 83m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:56:04.116 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (74m) 43m ago 81m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:56:04.117 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (82m) 43m ago 82m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:56:04.117 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (81m) 43m ago 81m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:56:04.117 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 43m ago 81m - 4096M 2022-02-02T14:56:04.117 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (80m) 43m ago 80m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:56:04.117 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (80m) 43m ago 80m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:56:04.118 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (80m) 43m ago 80m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:56:04.118 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (79m) 43m ago 79m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:56:04.118 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (79m) 43m ago 79m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:56:04.118 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (81m) 43m ago 81m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:56:04.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 msgr2=0x7f6858067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 0x7f6858067290 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f685c0102e0 tx=0x7f685c00b040).stop 2022-02-02T14:56:04.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 msgr2=0x7f686c106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f6868013a70 tx=0x7f6868009b30).stop 2022-02-02T14:56:04.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 shutdown_connections 2022-02-02T14:56:04.120 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6858064dd0 0x7f6858067290 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f686c0f55c0 0x7f686c106f70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 --2- 172.21.15.33:0/1449964860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f686c0f6860 0x7f686c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.116+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 >> 172.21.15.33:0/1449964860 conn(0x7f686c0f0d40 msgr2=0x7f686c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:04.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.117+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 shutdown_connections 2022-02-02T14:56:04.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.117+0000 7f6873cf0700 1 -- 172.21.15.33:0/1449964860 wait complete. 2022-02-02T14:56:04.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 -- 172.21.15.33:0/1021782131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f5460 msgr2=0x7f4b340f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1021782131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f5460 0x7f4b340f5880 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f4b1c004660 tx=0x7f4b1c009b30).stop 2022-02-02T14:56:04.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 -- 172.21.15.33:0/1021782131 shutdown_connections 2022-02-02T14:56:04.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1021782131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f6700 0x7f4b340f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1021782131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f5460 0x7f4b340f5880 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.216+0000 7f4b392aa700 1 -- 172.21.15.33:0/1021782131 >> 172.21.15.33:0/1021782131 conn(0x7f4b340f0bc0 msgr2=0x7f4b340f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.217+0000 7f4b392aa700 1 -- 172.21.15.33:0/1021782131 shutdown_connections 2022-02-02T14:56:04.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.217+0000 7f4b392aa700 1 -- 172.21.15.33:0/1021782131 wait complete. 2022-02-02T14:56:04.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.217+0000 7f4b392aa700 1 Processor -- start 2022-02-02T14:56:04.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.217+0000 7f4b392aa700 1 -- start start 2022-02-02T14:56:04.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b392aa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b392aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f6700 0x7f4b341072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b392aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b341078b0 con 0x7f4b340f6700 2022-02-02T14:56:04.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b392aa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b341080f0 con 0x7f4b340f5460 2022-02-02T14:56:04.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:04.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:45918/0 (socket says 172.21.15.33:45918) 2022-02-02T14:56:04.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 -- 172.21.15.33:0/1088634085 learned_addr learned my addr 172.21.15.33:0/1088634085 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:04.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 -- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f6700 msgr2=0x7f4b341072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f6700 0x7f4b341072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:56:04.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 -- 172.21.15.33:0/1088634085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c005040 con 0x7f4b340f5460 2022-02-02T14:56:04.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.218+0000 7f4b32ffd700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4b1c013a70 tx=0x7f4b1c009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:04.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.219+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c018070 con 0x7f4b340f5460 2022-02-02T14:56:04.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.219+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b1c0097d0 con 0x7f4b340f5460 2022-02-02T14:56:04.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.219+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34108370 con 0x7f4b340f5460 2022-02-02T14:56:04.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.219+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c01c3c0 con 0x7f4b340f5460 2022-02-02T14:56:04.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.219+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b34108850 con 0x7f4b340f5460 2022-02-02T14:56:04.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.220+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b34059100 con 0x7f4b340f5460 2022-02-02T14:56:04.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.220+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b1c007ba0 con 0x7f4b340f5460 2022-02-02T14:56:04.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.221+0000 7f4b2b7fe700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 0x7f4b200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.221+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4b1c083780 con 0x7f4b340f5460 2022-02-02T14:56:04.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.221+0000 7f4b327fc700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 0x7f4b200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:04.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.221+0000 7f4b327fc700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 0x7f4b200672e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f4b24009880 tx=0x7f4b24009a60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:04.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.225+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b1c0518f0 con 0x7f4b340f5460 2022-02-02T14:56:04.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.467+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4b3410d330 con 0x7f4b340f5460 2022-02-02T14:56:04.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.468+0000 7f4b2b7fe700 1 -- 172.21.15.33:0/1088634085 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4b1c054f10 con 0x7f4b340f5460 2022-02-02T14:56:04.468 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:56:04.468 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:56:04.468 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:56:04.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:04.469 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:56:04.469 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:56:04.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:04.469 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:56:04.469 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:56:04.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:04.470 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:56:04.470 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:56:04.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:04.471 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:56:04.471 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:56:04.471 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:56:04.471 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:56:04.471 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:56:04.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 msgr2=0x7f4b200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 0x7f4b200672e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f4b24009880 tx=0x7f4b24009a60).stop 2022-02-02T14:56:04.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 msgr2=0x7f4b34106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4b1c013a70 tx=0x7f4b1c009b30).stop 2022-02-02T14:56:04.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 shutdown_connections 2022-02-02T14:56:04.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b20064e20 0x7f4b200672e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b340f5460 0x7f4b34106dc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 --2- 172.21.15.33:0/1088634085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b340f6700 0x7f4b341072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2022-02-02T14:56:04.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 >> 172.21.15.33:0/1088634085 conn(0x7f4b340f0bc0 msgr2=0x7f4b3405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:04.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 shutdown_connections 2022-02-02T14:56:04.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.470+0000 7f4b392aa700 1 -- 172.21.15.33:0/1088634085 wait complete. 2022-02-02T14:56:04.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 -- 172.21.15.33:0/2782746514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 msgr2=0x7f28840f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 --2- 172.21.15.33:0/2782746514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840f6af0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f2874004660 tx=0x7f2874009b30).stop 2022-02-02T14:56:04.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 -- 172.21.15.33:0/2782746514 shutdown_connections 2022-02-02T14:56:04.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 --2- 172.21.15.33:0/2782746514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 0x7f28840f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 --2- 172.21.15.33:0/2782746514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840f6af0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 -- 172.21.15.33:0/2782746514 >> 172.21.15.33:0/2782746514 conn(0x7f28840f1e30 msgr2=0x7f28840f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:04.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 -- 172.21.15.33:0/2782746514 shutdown_connections 2022-02-02T14:56:04.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.571+0000 7f288985e700 1 -- 172.21.15.33:0/2782746514 wait complete. 2022-02-02T14:56:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 Processor -- start 2022-02-02T14:56:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 -- start start 2022-02-02T14:56:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 0x7f28840fffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841005c0 con 0x7f28840f66d0 2022-02-02T14:56:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f288985e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2884100700 con 0x7f28840f7970 2022-02-02T14:56:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f2882ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f2882ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35212/0 (socket says 172.21.15.33:35212) 2022-02-02T14:56:04.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f2882ffd700 1 -- 172.21.15.33:0/3692815108 learned_addr learned my addr 172.21.15.33:0/3692815108 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.572+0000 7f28827fc700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 0x7f28840fffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f2882ffd700 1 -- 172.21.15.33:0/3692815108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 msgr2=0x7f28840fffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f2882ffd700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 0x7f28840fffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f2882ffd700 1 -- 172.21.15.33:0/3692815108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2874005040 con 0x7f28840f66d0 2022-02-02T14:56:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f2882ffd700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f2874000c00 tx=0x7f287400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2874019070 con 0x7f28840f66d0 2022-02-02T14:56:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2884101010 con 0x7f28840f66d0 2022-02-02T14:56:04.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2874013380 con 0x7f28840f66d0 2022-02-02T14:56:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2874014cd0 con 0x7f28840f66d0 2022-02-02T14:56:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.573+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2884101570 con 0x7f28840f66d0 2022-02-02T14:56:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.574+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2884045ad0 con 0x7f28840f66d0 2022-02-02T14:56:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.574+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2874025070 con 0x7f28840f66d0 2022-02-02T14:56:04.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.575+0000 7f287b7fe700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 0x7f2870067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.575+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2874082920 con 0x7f28840f66d0 2022-02-02T14:56:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.575+0000 7f28827fc700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 0x7f2870067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.575+0000 7f28827fc700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 0x7f2870067270 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f286c009fd0 tx=0x7f286c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:04.580 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.579+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f28740509d0 con 0x7f28840f66d0 2022-02-02T14:56:04.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:04 smithi033 ceph-mon[101165]: pgmap v2320: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:04.740 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1088634085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:56:04.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.789+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2884027a00 con 0x7f28840f66d0 2022-02-02T14:56:04.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.790+0000 7f287b7fe700 1 -- 172.21.15.33:0/3692815108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2874023020 con 0x7f28840f66d0 2022-02-02T14:56:04.789 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:56:04.790 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:56:04.790 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:56:04.790 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:56:04.790 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:04.791 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:56:04.791 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:56:04.791 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:56:04.791 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:56:04.792 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:56:04.792 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:56:04.792 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:56:04.792 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:56:04.793 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:56:04.793 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:56:04.793 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:56:04.793 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:56:04.794 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:56:04.794 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:56:04.794 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:56:04.794 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:56:04.795 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:56:04.795 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:56:04.795 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:56:04.795 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:56:04.796 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:56:04.796 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:56:04.796 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:56:04.796 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:56:04.797 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:56:04.797 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:56:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:04.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:04.797 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:56:04.798 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:04.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:04.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:04.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:04.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 msgr2=0x7f2870067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 0x7f2870067270 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f286c009fd0 tx=0x7f286c00b040).stop 2022-02-02T14:56:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 msgr2=0x7f28840ffad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7f2874000c00 tx=0x7f287400b040).stop 2022-02-02T14:56:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 shutdown_connections 2022-02-02T14:56:04.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2870064db0 0x7f2870067270 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28840f66d0 0x7f28840ffad0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.791+0000 7f288985e700 1 --2- 172.21.15.33:0/3692815108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28840f7970 0x7f28840fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:04.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.792+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 >> 172.21.15.33:0/3692815108 conn(0x7f28840f1e30 msgr2=0x7f288406a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.792+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 shutdown_connections 2022-02-02T14:56:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:04.792+0000 7f288985e700 1 -- 172.21.15.33:0/3692815108 wait complete. 2022-02-02T14:56:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:56:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:04 smithi037 ceph-mon[69017]: pgmap v2320: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1088634085' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:56:05.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:05 smithi033 ceph-mon[101165]: from='client.36452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:05.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:05 smithi033 ceph-mon[101165]: from='client.45947 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:05.922 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3692815108' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:56:06.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:05 smithi037 ceph-mon[69017]: from='client.36452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:06.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:05 smithi037 ceph-mon[69017]: from='client.45947 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:06.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3692815108' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:56:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:06 smithi033 ceph-mon[101165]: pgmap v2321: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:06 smithi037 ceph-mon[69017]: pgmap v2321: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:08 smithi033 ceph-mon[101165]: pgmap v2322: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:08 smithi037 ceph-mon[69017]: pgmap v2322: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:10 smithi033 ceph-mon[101165]: pgmap v2323: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:10 smithi037 ceph-mon[69017]: pgmap v2323: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:12 smithi033 ceph-mon[101165]: pgmap v2324: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:12 smithi037 ceph-mon[69017]: pgmap v2324: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:14 smithi033 ceph-mon[101165]: pgmap v2325: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:14 smithi037 ceph-mon[69017]: pgmap v2325: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:16 smithi033 ceph-mon[101165]: pgmap v2326: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:16 smithi037 ceph-mon[69017]: pgmap v2326: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:18 smithi033 ceph-mon[101165]: pgmap v2327: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:18 smithi037 ceph-mon[69017]: pgmap v2327: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:20 smithi033 ceph-mon[101165]: pgmap v2328: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:20 smithi037 ceph-mon[69017]: pgmap v2328: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:22 smithi033 ceph-mon[101165]: pgmap v2329: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:22 smithi037 ceph-mon[69017]: pgmap v2329: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:24 smithi033 ceph-mon[101165]: pgmap v2330: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:24 smithi037 ceph-mon[69017]: pgmap v2330: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:26 smithi033 ceph-mon[101165]: pgmap v2331: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:26 smithi037 ceph-mon[69017]: pgmap v2331: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:28 smithi033 ceph-mon[101165]: pgmap v2332: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:28 smithi037 ceph-mon[69017]: pgmap v2332: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:30 smithi033 ceph-mon[101165]: pgmap v2333: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:30 smithi037 ceph-mon[69017]: pgmap v2333: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:32 smithi033 ceph-mon[101165]: pgmap v2334: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:32 smithi037 ceph-mon[69017]: pgmap v2334: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:34.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.907+0000 7feb145bf700 1 -- 172.21.15.33:0/2371804035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 msgr2=0x7feb0c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:34.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.907+0000 7feb145bf700 1 --2- 172.21.15.33:0/2371804035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c0f6cc0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7feb08004660 tx=0x7feb08009b30).stop 2022-02-02T14:56:34.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 -- 172.21.15.33:0/2371804035 shutdown_connections 2022-02-02T14:56:34.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 --2- 172.21.15.33:0/2371804035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c0f6cc0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:34.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 --2- 172.21.15.33:0/2371804035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 0x7feb0c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:34.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 -- 172.21.15.33:0/2371804035 >> 172.21.15.33:0/2371804035 conn(0x7feb0c0f0d40 msgr2=0x7feb0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:34.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 -- 172.21.15.33:0/2371804035 shutdown_connections 2022-02-02T14:56:34.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 -- 172.21.15.33:0/2371804035 wait complete. 2022-02-02T14:56:34.910 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:34 smithi033 ceph-mon[101165]: pgmap v2335: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 Processor -- start 2022-02-02T14:56:34.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.908+0000 7feb145bf700 1 -- start start 2022-02-02T14:56:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb145bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 0x7feb0c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb145bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb145bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0603c0 con 0x7feb0c0f6860 2022-02-02T14:56:34.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb145bf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c060500 con 0x7feb0c0f55c0 2022-02-02T14:56:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35226/0 (socket says 172.21.15.33:35226) 2022-02-02T14:56:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 -- 172.21.15.33:0/2042782219 learned_addr learned my addr 172.21.15.33:0/2042782219 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:34.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb1235b700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 0x7feb0c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 -- 172.21.15.33:0/2042782219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 msgr2=0x7feb0c109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 0x7feb0c109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 -- 172.21.15.33:0/2042782219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08005040 con 0x7feb0c0f6860 2022-02-02T14:56:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.909+0000 7feb11b5a700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7feb08009990 tx=0x7feb08009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:34.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.910+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb08018070 con 0x7feb0c0f6860 2022-02-02T14:56:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.910+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb08007ba0 con 0x7feb0c0f6860 2022-02-02T14:56:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.910+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c10c6c0 con 0x7feb0c0f6860 2022-02-02T14:56:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.910+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb0801c3c0 con 0x7feb0c0f6860 2022-02-02T14:56:34.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.910+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c10cbf0 con 0x7feb0c0f6860 2022-02-02T14:56:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.911+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c0f49b0 con 0x7feb0c0f6860 2022-02-02T14:56:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.912+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb0801d420 con 0x7feb0c0f6860 2022-02-02T14:56:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.912+0000 7feafeffd700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 0x7feaf8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:34.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.912+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feb08083630 con 0x7feb0c0f6860 2022-02-02T14:56:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.912+0000 7feb1235b700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 0x7feaf8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.913+0000 7feb1235b700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 0x7feaf8067290 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7feb0c060040 tx=0x7feb0000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:34.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:34.917+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb08051680 con 0x7feb0c0f6860 2022-02-02T14:56:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:34 smithi037 ceph-mon[69017]: pgmap v2335: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:35.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.104+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb0c0fdf00 con 0x7feaf8064dd0 2022-02-02T14:56:35.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.106+0000 7feafeffd700 1 -- 172.21.15.33:0/2042782219 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7feb0c0fdf00 con 0x7feaf8064dd0 2022-02-02T14:56:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.107+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 msgr2=0x7feaf8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.107+0000 7feb145bf700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 0x7feaf8067290 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7feb0c060040 tx=0x7feb0000b040).stop 2022-02-02T14:56:35.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.107+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 msgr2=0x7feb0c10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.107+0000 7feb145bf700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7feb08009990 tx=0x7feb08009b30).stop 2022-02-02T14:56:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 shutdown_connections 2022-02-02T14:56:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feaf8064dd0 0x7feaf8067290 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb0c0f55c0 0x7feb0c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 --2- 172.21.15.33:0/2042782219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0f6860 0x7feb0c10c170 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 >> 172.21.15.33:0/2042782219 conn(0x7feb0c0f0d40 msgr2=0x7feb0c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 shutdown_connections 2022-02-02T14:56:35.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.108+0000 7feb145bf700 1 -- 172.21.15.33:0/2042782219 wait complete. 2022-02-02T14:56:35.117 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:56:35.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 -- 172.21.15.33:0/2218631242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f4d60 msgr2=0x7f386c0f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 --2- 172.21.15.33:0/2218631242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f4d60 0x7f386c0f5180 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f3868004660 tx=0x7f3868009b30).stop 2022-02-02T14:56:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 -- 172.21.15.33:0/2218631242 shutdown_connections 2022-02-02T14:56:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 --2- 172.21.15.33:0/2218631242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f5f60 0x7f386c0f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 --2- 172.21.15.33:0/2218631242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f4d60 0x7f386c0f5180 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 -- 172.21.15.33:0/2218631242 >> 172.21.15.33:0/2218631242 conn(0x7f386c0f04c0 msgr2=0x7f386c0f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 -- 172.21.15.33:0/2218631242 shutdown_connections 2022-02-02T14:56:35.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.209+0000 7f3873c74700 1 -- 172.21.15.33:0/2218631242 wait complete. 2022-02-02T14:56:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 Processor -- start 2022-02-02T14:56:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 -- start start 2022-02-02T14:56:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f4d60 0x7f386c104d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c105860 con 0x7f386c0f5f60 2022-02-02T14:56:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3873c74700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c106070 con 0x7f386c0f4d60 2022-02-02T14:56:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35236/0 (socket says 172.21.15.33:35236) 2022-02-02T14:56:35.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 -- 172.21.15.33:0/4101145735 learned_addr learned my addr 172.21.15.33:0/4101145735 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f3871a10700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f4d60 0x7f386c104d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 -- 172.21.15.33:0/4101145735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f4d60 msgr2=0x7f386c104d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f4d60 0x7f386c104d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.210+0000 7f387120f700 1 -- 172.21.15.33:0/4101145735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3868005040 con 0x7f386c0f5f60 2022-02-02T14:56:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f387120f700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f385c00f870 tx=0x7f385c00c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385c008ad0 con 0x7f386c0f5f60 2022-02-02T14:56:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f385c010040 con 0x7f386c0f5f60 2022-02-02T14:56:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c1062f0 con 0x7f386c0f5f60 2022-02-02T14:56:35.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f385c0157e0 con 0x7f386c0f5f60 2022-02-02T14:56:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.211+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c1068b0 con 0x7f386c0f5f60 2022-02-02T14:56:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.212+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f385c01c030 con 0x7f386c0f5f60 2022-02-02T14:56:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.212+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c0f4150 con 0x7f386c0f5f60 2022-02-02T14:56:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.213+0000 7f38627fc700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 0x7f3858067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.213+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f385c082960 con 0x7f386c0f5f60 2022-02-02T14:56:35.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.213+0000 7f3871a10700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 0x7f3858067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.213+0000 7f3871a10700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 0x7f3858067290 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3868005010 tx=0x7f386800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.217+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f385c04b7d0 con 0x7f386c0f5f60 2022-02-02T14:56:35.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.401+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f386c0fce30 con 0x7f3858064dd0 2022-02-02T14:56:35.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.415+0000 7f38627fc700 1 -- 172.21.15.33:0/4101145735 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f386c0fce30 con 0x7f3858064dd0 2022-02-02T14:56:35.415 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:56:35.415 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (81m) 43m ago 82m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:56:35.415 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (74m) 43m ago 82m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:56:35.415 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (74m) 44m ago 82m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:56:35.416 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (81m) 43m ago 82m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:56:35.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (75m) 43m ago 79m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:56:35.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (76m) 43m ago 79m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:56:35.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (76m) 44m ago 79m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:56:35.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (79m) 44m ago 79m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:56:35.417 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (76m) 43m ago 84m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:56:35.417 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (76m) 44m ago 82m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:56:35.417 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (75m) 43m ago 84m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:56:35.417 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (75m) 44m ago 82m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:56:35.418 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (82m) 43m ago 82m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:56:35.418 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (82m) 44m ago 82m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:56:35.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 43m ago 81m - 4096M 2022-02-02T14:56:35.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (81m) 43m ago 81m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:56:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (81m) 43m ago 81m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:56:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (80m) 44m ago 80m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:56:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (80m) 44m ago 80m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:56:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (80m) 44m ago 80m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:56:35.419 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (81m) 43m ago 82m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:56:35.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 msgr2=0x7f3858067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 0x7f3858067290 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3868005010 tx=0x7f386800b040).stop 2022-02-02T14:56:35.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 msgr2=0x7f386c105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f385c00f870 tx=0x7f385c00c040).stop 2022-02-02T14:56:35.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 shutdown_connections 2022-02-02T14:56:35.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3858064dd0 0x7f3858067290 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0f4d60 0x7f386c104d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 --2- 172.21.15.33:0/4101145735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f386c0f5f60 0x7f386c105260 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 >> 172.21.15.33:0/4101145735 conn(0x7f386c0f04c0 msgr2=0x7f386c0f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 shutdown_connections 2022-02-02T14:56:35.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.417+0000 7f3873c74700 1 -- 172.21.15.33:0/4101145735 wait complete. 2022-02-02T14:56:35.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 -- 172.21.15.33:0/3315522845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 msgr2=0x7fe26c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 --2- 172.21.15.33:0/3315522845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c0f7de0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7fe260004660 tx=0x7fe260009b30).stop 2022-02-02T14:56:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 -- 172.21.15.33:0/3315522845 shutdown_connections 2022-02-02T14:56:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 --2- 172.21.15.33:0/3315522845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c0f7de0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 --2- 172.21.15.33:0/3315522845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 0x7fe26c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 -- 172.21.15.33:0/3315522845 >> 172.21.15.33:0/3315522845 conn(0x7fe26c0f1e40 msgr2=0x7fe26c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 -- 172.21.15.33:0/3315522845 shutdown_connections 2022-02-02T14:56:35.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.520+0000 7fe27471c700 1 -- 172.21.15.33:0/3315522845 wait complete. 2022-02-02T14:56:35.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 Processor -- start 2022-02-02T14:56:35.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 -- start start 2022-02-02T14:56:35.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 0x7fe26c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c06a380 con 0x7fe26c0f7980 2022-02-02T14:56:35.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe27471c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c06a4c0 con 0x7fe26c0f66e0 2022-02-02T14:56:35.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe271cb7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.521+0000 7fe271cb7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35246/0 (socket says 172.21.15.33:35246) 2022-02-02T14:56:35.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe271cb7700 1 -- 172.21.15.33:0/2382169303 learned_addr learned my addr 172.21.15.33:0/2382169303 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:35.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe2724b8700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 0x7fe26c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe271cb7700 1 -- 172.21.15.33:0/2382169303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 msgr2=0x7fe26c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe271cb7700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 0x7fe26c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe271cb7700 1 -- 172.21.15.33:0/2382169303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe260005040 con 0x7fe26c0f7980 2022-02-02T14:56:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe271cb7700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe260009990 tx=0x7fe260009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe260018070 con 0x7fe26c0f7980 2022-02-02T14:56:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe260007ba0 con 0x7fe26c0f7980 2022-02-02T14:56:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c06a740 con 0x7fe26c0f7980 2022-02-02T14:56:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c06aca0 con 0x7fe26c0f7980 2022-02-02T14:56:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.522+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe26001c3c0 con 0x7fe26c0f7980 2022-02-02T14:56:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.523+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254004fa0 con 0x7fe26c0f7980 2022-02-02T14:56:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.524+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe26001d420 con 0x7fe26c0f7980 2022-02-02T14:56:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.524+0000 7fe25effd700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.524+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe260083630 con 0x7fe26c0f7980 2022-02-02T14:56:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.524+0000 7fe2724b8700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.525+0000 7fe2724b8700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 0x7fe258067290 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fe26c06b730 tx=0x7fe26800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.528+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2600516e0 con 0x7fe26c0f7980 2022-02-02T14:56:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.773+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe254005e80 con 0x7fe26c0f7980 2022-02-02T14:56:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.774+0000 7fe25effd700 1 -- 172.21.15.33:0/2382169303 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe260054d00 con 0x7fe26c0f7980 2022-02-02T14:56:35.773 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:56:35.774 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:56:35.774 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:56:35.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:35.774 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:56:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:56:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:56:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:56:35.775 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:35.776 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:56:35.776 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:56:35.776 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:56:35.776 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:56:35.777 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:56:35.777 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:56:35.777 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:56:35.777 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:56:35.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 msgr2=0x7fe258067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 0x7fe258067290 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fe26c06b730 tx=0x7fe26800b040).stop 2022-02-02T14:56:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 msgr2=0x7fe26c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe260009990 tx=0x7fe260009b30).stop 2022-02-02T14:56:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 shutdown_connections 2022-02-02T14:56:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe258064dd0 0x7fe258067290 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe26c0f66e0 0x7fe26c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 --2- 172.21.15.33:0/2382169303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe26c0f7980 0x7fe26c069e20 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 >> 172.21.15.33:0/2382169303 conn(0x7fe26c0f1e40 msgr2=0x7fe26c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 shutdown_connections 2022-02-02T14:56:35.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.776+0000 7fe27471c700 1 -- 172.21.15.33:0/2382169303 wait complete. 2022-02-02T14:56:35.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 -- 172.21.15.33:0/448458584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f66e0 msgr2=0x7fe2e80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 --2- 172.21.15.33:0/448458584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f66e0 0x7fe2e80f6b00 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fe2d8004660 tx=0x7fe2d8009b30).stop 2022-02-02T14:56:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 -- 172.21.15.33:0/448458584 shutdown_connections 2022-02-02T14:56:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 --2- 172.21.15.33:0/448458584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f7980 0x7fe2e80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 --2- 172.21.15.33:0/448458584 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f66e0 0x7fe2e80f6b00 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 -- 172.21.15.33:0/448458584 >> 172.21.15.33:0/448458584 conn(0x7fe2e80f1e40 msgr2=0x7fe2e80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:35.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 -- 172.21.15.33:0/448458584 shutdown_connections 2022-02-02T14:56:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.877+0000 7fe2ee289700 1 -- 172.21.15.33:0/448458584 wait complete. 2022-02-02T14:56:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 Processor -- start 2022-02-02T14:56:35.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 -- start start 2022-02-02T14:56:35.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 0x7fe2e8106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8107a50 con 0x7fe2e80f7980 2022-02-02T14:56:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2ee289700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e8107b90 con 0x7fe2e80f66e0 2022-02-02T14:56:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35256/0 (socket says 172.21.15.33:35256) 2022-02-02T14:56:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 -- 172.21.15.33:0/592649358 learned_addr learned my addr 172.21.15.33:0/592649358 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:56:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e7fff700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 0x7fe2e8106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 -- 172.21.15.33:0/592649358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 msgr2=0x7fe2e8106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 0x7fe2e8106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.878+0000 7fe2e77fe700 1 -- 172.21.15.33:0/592649358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8005040 con 0x7fe2e80f7980 2022-02-02T14:56:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2e7fff700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 0x7fe2e8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:56:35.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2e77fe700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fe2dc0026d0 tx=0x7fe2dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc009320 con 0x7fe2e80f7980 2022-02-02T14:56:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe2dc00f040 con 0x7fe2e80f7980 2022-02-02T14:56:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e8108530 con 0x7fe2e80f7980 2022-02-02T14:56:35.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2dc0147e0 con 0x7fe2e80f7980 2022-02-02T14:56:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.879+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e8108af0 con 0x7fe2e80f7980 2022-02-02T14:56:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.880+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e8045ad0 con 0x7fe2e80f7980 2022-02-02T14:56:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.880+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe2dc009480 con 0x7fe2e80f7980 2022-02-02T14:56:35.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.881+0000 7fe2e4ff9700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 0x7fe2d0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:56:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.881+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe2dc082170 con 0x7fe2e80f7980 2022-02-02T14:56:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.881+0000 7fe2e7fff700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 0x7fe2d0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:56:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.881+0000 7fe2e7fff700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 0x7fe2d0067290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fe2d8005010 tx=0x7fe2d8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:56:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:35.885+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe2dc053c50 con 0x7fe2e80f7980 2022-02-02T14:56:36.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.099+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe2e8027a00 con 0x7fe2e80f7980 2022-02-02T14:56:36.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.100+0000 7fe2e4ff9700 1 -- 172.21.15.33:0/592649358 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe2dc053840 con 0x7fe2e80f7980 2022-02-02T14:56:36.099 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:56:36.100 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:56:36.100 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:56:36.100 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:56:36.100 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:36.101 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:56:36.101 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:56:36.101 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:56:36.101 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:56:36.102 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:56:36.102 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:56:36.102 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:56:36.102 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:56:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:56:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:56:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:56:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:56:36.103 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:56:36.104 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:56:36.104 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:56:36.104 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:56:36.104 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:56:36.105 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:56:36.105 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:56:36.105 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:56:36.105 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:56:36.105 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:56:36.106 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:56:36.106 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:56:36.106 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:56:36.106 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:56:36.107 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:36.107 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:36.107 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:56:36.107 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:56:36.107 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:36.108 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:36.108 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:36.108 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:56:36.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 msgr2=0x7fe2d0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:36.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 0x7fe2d0067290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fe2d8005010 tx=0x7fe2d8009b30).stop 2022-02-02T14:56:36.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 msgr2=0x7fe2e81074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:56:36.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fe2dc0026d0 tx=0x7fe2dc009de0).stop 2022-02-02T14:56:36.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 shutdown_connections 2022-02-02T14:56:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe2d0064dd0 0x7fe2d0067290 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2e80f66e0 0x7fe2e8106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 --2- 172.21.15.33:0/592649358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2e80f7980 0x7fe2e81074a0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:56:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 >> 172.21.15.33:0/592649358 conn(0x7fe2e80f1e40 msgr2=0x7fe2e80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:56:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 shutdown_connections 2022-02-02T14:56:36.112 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:56:36.102+0000 7fe2ee289700 1 -- 172.21.15.33:0/592649358 wait complete. 2022-02-02T14:56:36.112 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:56:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:36 smithi033 ceph-mon[101165]: from='client.36466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:36 smithi033 ceph-mon[101165]: from='client.36470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:36 smithi033 ceph-mon[101165]: pgmap v2336: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2382169303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:56:36.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/592649358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:56:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:36 smithi037 ceph-mon[69017]: from='client.36466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:36 smithi037 ceph-mon[69017]: from='client.36470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:56:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:36 smithi037 ceph-mon[69017]: pgmap v2336: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2382169303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:56:37.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/592649358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:56:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:38 smithi033 ceph-mon[101165]: pgmap v2337: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:38 smithi037 ceph-mon[69017]: pgmap v2337: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:40 smithi033 ceph-mon[101165]: pgmap v2338: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:40 smithi037 ceph-mon[69017]: pgmap v2338: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:42 smithi033 ceph-mon[101165]: pgmap v2339: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:42 smithi037 ceph-mon[69017]: pgmap v2339: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:44 smithi033 ceph-mon[101165]: pgmap v2340: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:44 smithi037 ceph-mon[69017]: pgmap v2340: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:46 smithi033 ceph-mon[101165]: pgmap v2341: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:46 smithi037 ceph-mon[69017]: pgmap v2341: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:48 smithi033 ceph-mon[101165]: pgmap v2342: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:48 smithi037 ceph-mon[69017]: pgmap v2342: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:50 smithi033 ceph-mon[101165]: pgmap v2343: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:50 smithi037 ceph-mon[69017]: pgmap v2343: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:52 smithi033 ceph-mon[101165]: pgmap v2344: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:52 smithi037 ceph-mon[69017]: pgmap v2344: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:54 smithi033 ceph-mon[101165]: pgmap v2345: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:56:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:56:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:54 smithi037 ceph-mon[69017]: pgmap v2345: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:56:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:56:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:56 smithi033 ceph-mon[101165]: pgmap v2346: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:56 smithi037 ceph-mon[69017]: pgmap v2346: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:56:58 smithi033 ceph-mon[101165]: pgmap v2347: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:56:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:56:58 smithi037 ceph-mon[69017]: pgmap v2347: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:00 smithi033 ceph-mon[101165]: pgmap v2348: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:00 smithi037 ceph-mon[69017]: pgmap v2348: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:02.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:02 smithi033 ceph-mon[101165]: pgmap v2349: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:02 smithi037 ceph-mon[69017]: pgmap v2349: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:04 smithi033 ceph-mon[101165]: pgmap v2350: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:04 smithi037 ceph-mon[69017]: pgmap v2350: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:06.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 -- 172.21.15.33:0/2018800968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f55c0 msgr2=0x7f54340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 --2- 172.21.15.33:0/2018800968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f55c0 0x7f54340f59e0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7f5424004660 tx=0x7f5424009b30).stop 2022-02-02T14:57:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 -- 172.21.15.33:0/2018800968 shutdown_connections 2022-02-02T14:57:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 --2- 172.21.15.33:0/2018800968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f6860 0x7f54340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 --2- 172.21.15.33:0/2018800968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f55c0 0x7f54340f59e0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 -- 172.21.15.33:0/2018800968 >> 172.21.15.33:0/2018800968 conn(0x7f54340f0d40 msgr2=0x7f54340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 -- 172.21.15.33:0/2018800968 shutdown_connections 2022-02-02T14:57:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.217+0000 7f543c0a1700 1 -- 172.21.15.33:0/2018800968 wait complete. 2022-02-02T14:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 Processor -- start 2022-02-02T14:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 -- start start 2022-02-02T14:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f55c0 0x7f543405feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5434060460 con 0x7f54340f6860 2022-02-02T14:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543c0a1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54340605a0 con 0x7f54340f55c0 2022-02-02T14:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543963c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543963c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35264/0 (socket says 172.21.15.33:35264) 2022-02-02T14:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f543963c700 1 -- 172.21.15.33:0/1206083558 learned_addr learned my addr 172.21.15.33:0/1206083558 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.218+0000 7f5439e3d700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f55c0 0x7f543405feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543963c700 1 -- 172.21.15.33:0/1206083558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f55c0 msgr2=0x7f543405feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543963c700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f55c0 0x7f543405feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543963c700 1 -- 172.21.15.33:0/1206083558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5424005040 con 0x7f54340f6860 2022-02-02T14:57:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543963c700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f543000e7f0 tx=0x7f543000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54300092e0 con 0x7f54340f6860 2022-02-02T14:57:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f543000f040 con 0x7f54340f6860 2022-02-02T14:57:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5434068eb0 con 0x7f54340f6860 2022-02-02T14:57:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5430014750 con 0x7f54340f6860 2022-02-02T14:57:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.219+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5434069470 con 0x7f54340f6860 2022-02-02T14:57:06.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.220+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54340f49b0 con 0x7f54340f6860 2022-02-02T14:57:06.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.221+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f543001b030 con 0x7f54340f6860 2022-02-02T14:57:06.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.221+0000 7f542a7fc700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.221+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5430081910 con 0x7f54340f6860 2022-02-02T14:57:06.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.221+0000 7f5439e3d700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.222+0000 7f5439e3d700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 0x7f5420067290 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f5424004d80 tx=0x7f5424016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.225+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f543004a7d0 con 0x7f54340f6860 2022-02-02T14:57:06.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.415+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54340008d0 con 0x7f5420064dd0 2022-02-02T14:57:06.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.417+0000 7f542a7fc700 1 -- 172.21.15.33:0/1206083558 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f54340008d0 con 0x7f5420064dd0 2022-02-02T14:57:06.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 msgr2=0x7f5420067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 0x7f5420067290 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f5424004d80 tx=0x7f5424016040).stop 2022-02-02T14:57:06.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 msgr2=0x7f5434068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f543000e7f0 tx=0x7f543000b040).stop 2022-02-02T14:57:06.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 shutdown_connections 2022-02-02T14:57:06.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5420064dd0 0x7f5420067290 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54340f55c0 0x7f543405feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.418+0000 7f543c0a1700 1 --2- 172.21.15.33:0/1206083558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54340f6860 0x7f5434068870 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.419+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 >> 172.21.15.33:0/1206083558 conn(0x7f54340f0d40 msgr2=0x7f54340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.419+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 shutdown_connections 2022-02-02T14:57:06.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.419+0000 7f543c0a1700 1 -- 172.21.15.33:0/1206083558 wait complete. 2022-02-02T14:57:06.427 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:57:06.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 -- 172.21.15.33:0/2094674750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f6860 msgr2=0x7fe1a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 --2- 172.21.15.33:0/2094674750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f6860 0x7fe1a40f6cc0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7fe18c004660 tx=0x7fe18c009b30).stop 2022-02-02T14:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 -- 172.21.15.33:0/2094674750 shutdown_connections 2022-02-02T14:57:06.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 --2- 172.21.15.33:0/2094674750 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f6860 0x7fe1a40f6cc0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 --2- 172.21.15.33:0/2094674750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f55c0 0x7fe1a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T14:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 -- 172.21.15.33:0/2094674750 >> 172.21.15.33:0/2094674750 conn(0x7fe1a40f0d40 msgr2=0x7fe1a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 -- 172.21.15.33:0/2094674750 shutdown_connections 2022-02-02T14:57:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.520+0000 7fe1a8894700 1 -- 172.21.15.33:0/2094674750 wait complete. 2022-02-02T14:57:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 Processor -- start 2022-02-02T14:57:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 -- start start 2022-02-02T14:57:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f6860 0x7fe1a4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4107ab0 con 0x7fe1a40f55c0 2022-02-02T14:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a8894700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a4108360 con 0x7fe1a40f6860 2022-02-02T14:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35272/0 (socket says 172.21.15.33:35272) 2022-02-02T14:57:06.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a259c700 1 -- 172.21.15.33:0/1742677515 learned_addr learned my addr 172.21.15.33:0/1742677515 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:06.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a1d9b700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f6860 0x7fe1a4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a259c700 1 -- 172.21.15.33:0/1742677515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f6860 msgr2=0x7fe1a4107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.521+0000 7fe1a259c700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f6860 0x7fe1a4107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe1a259c700 1 -- 172.21.15.33:0/1742677515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c005040 con 0x7fe1a40f55c0 2022-02-02T14:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe1a259c700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fe1940093f0 tx=0x7fe194006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194013640 con 0x7fe1a40f55c0 2022-02-02T14:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a4108640 con 0x7fe1a40f55c0 2022-02-02T14:57:06.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe194013c50 con 0x7fe1a40f55c0 2022-02-02T14:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe194012c70 con 0x7fe1a40f55c0 2022-02-02T14:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.522+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a4108c00 con 0x7fe1a40f55c0 2022-02-02T14:57:06.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.523+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40f49b0 con 0x7fe1a40f55c0 2022-02-02T14:57:06.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.523+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe19401a060 con 0x7fe1a40f55c0 2022-02-02T14:57:06.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.524+0000 7fe19affd700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 0x7fe190067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.524+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe194081aa0 con 0x7fe1a40f55c0 2022-02-02T14:57:06.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.524+0000 7fe1a1d9b700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 0x7fe190067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.524+0000 7fe1a1d9b700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 0x7fe190067270 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe18c004e30 tx=0x7fe18c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.528+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe194053520 con 0x7fe1a40f55c0 2022-02-02T14:57:06.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.711+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1a40faca0 con 0x7fe190064db0 2022-02-02T14:57:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.726+0000 7fe19affd700 1 -- 172.21.15.33:0/1742677515 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fe1a40faca0 con 0x7fe190064db0 2022-02-02T14:57:06.726 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:57:06.726 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (82m) 44m ago 83m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:57:06.727 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (75m) 44m ago 83m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:57:06.727 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (75m) 44m ago 82m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:57:06.727 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (82m) 44m ago 83m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:57:06.727 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (75m) 44m ago 79m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:57:06.728 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (76m) 44m ago 79m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:57:06.728 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (77m) 44m ago 79m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:57:06.728 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (79m) 44m ago 79m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:57:06.728 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (77m) 44m ago 84m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:57:06.728 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (76m) 44m ago 82m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:57:06.729 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (76m) 44m ago 84m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:57:06.729 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (75m) 44m ago 82m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:57:06.729 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (83m) 44m ago 83m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:57:06.729 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (82m) 44m ago 82m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:57:06.730 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 44m ago 82m - 4096M 2022-02-02T14:57:06.730 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (81m) 44m ago 81m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:57:06.730 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (81m) 44m ago 81m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:57:06.730 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (81m) 44m ago 81m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:57:06.731 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (80m) 44m ago 80m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:57:06.731 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (80m) 44m ago 80m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:57:06.731 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (82m) 44m ago 82m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:57:06.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 msgr2=0x7fe190067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 0x7fe190067270 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fe18c004e30 tx=0x7fe18c009b30).stop 2022-02-02T14:57:06.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 msgr2=0x7fe1a4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fe1940093f0 tx=0x7fe194006ec0).stop 2022-02-02T14:57:06.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 shutdown_connections 2022-02-02T14:57:06.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe190064db0 0x7fe190067270 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a40f55c0 0x7fe1a4106f80 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 --2- 172.21.15.33:0/1742677515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a40f6860 0x7fe1a4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 >> 172.21.15.33:0/1742677515 conn(0x7fe1a40f0d40 msgr2=0x7fe1a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 shutdown_connections 2022-02-02T14:57:06.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.728+0000 7fe1a8894700 1 -- 172.21.15.33:0/1742677515 wait complete. 2022-02-02T14:57:06.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 -- 172.21.15.33:0/3956878267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f5430 msgr2=0x7f93480f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 --2- 172.21.15.33:0/3956878267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f5430 0x7f93480f5850 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7f9338004660 tx=0x7f9338009b30).stop 2022-02-02T14:57:06.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 -- 172.21.15.33:0/3956878267 shutdown_connections 2022-02-02T14:57:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 --2- 172.21.15.33:0/3956878267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f66d0 0x7f93480f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 --2- 172.21.15.33:0/3956878267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f5430 0x7f93480f5850 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.828+0000 7f934d747700 1 -- 172.21.15.33:0/3956878267 >> 172.21.15.33:0/3956878267 conn(0x7f93480f0b90 msgr2=0x7f93480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:06.830 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:06 smithi033 ceph-mon[101165]: pgmap v2351: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:06.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.829+0000 7f934d747700 1 -- 172.21.15.33:0/3956878267 shutdown_connections 2022-02-02T14:57:06.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.829+0000 7f934d747700 1 -- 172.21.15.33:0/3956878267 wait complete. 2022-02-02T14:57:06.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.829+0000 7f934d747700 1 Processor -- start 2022-02-02T14:57:06.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f934d747700 1 -- start start 2022-02-02T14:57:06.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f934d747700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f5430 0x7f9348109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f934d747700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f934d747700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93480603e0 con 0x7f93480f66d0 2022-02-02T14:57:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f934d747700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9348060520 con 0x7f93480f5430 2022-02-02T14:57:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35284/0 (socket says 172.21.15.33:35284) 2022-02-02T14:57:06.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f9347fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f5430 0x7f9348109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 -- 172.21.15.33:0/1671208580 learned_addr learned my addr 172.21.15.33:0/1671208580 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:06.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 -- 172.21.15.33:0/1671208580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f5430 msgr2=0x7f9348109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:06.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f5430 0x7f9348109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:06.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.830+0000 7f93477fe700 1 -- 172.21.15.33:0/1671208580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338005040 con 0x7f93480f66d0 2022-02-02T14:57:06.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f93477fe700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f933c0026d0 tx=0x7f933c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933c0079c0 con 0x7f93480f66d0 2022-02-02T14:57:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934810c540 con 0x7f93480f66d0 2022-02-02T14:57:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f933c00f040 con 0x7f93480f66d0 2022-02-02T14:57:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f933c0148b0 con 0x7f93480f66d0 2022-02-02T14:57:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.831+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934810cb00 con 0x7f93480f66d0 2022-02-02T14:57:06.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.832+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348045ad0 con 0x7f93480f66d0 2022-02-02T14:57:06.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.832+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f933c007b20 con 0x7f93480f66d0 2022-02-02T14:57:06.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.833+0000 7f9344ff9700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 0x7f93300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:06.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.833+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f933c081a30 con 0x7f93480f66d0 2022-02-02T14:57:06.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.833+0000 7f9347fff700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 0x7f93300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:06.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.833+0000 7f9347fff700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 0x7f93300672e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f9348060060 tx=0x7f9338009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:06.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:06.837+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f933c04fae0 con 0x7f93480f66d0 2022-02-02T14:57:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:06 smithi037 ceph-mon[69017]: pgmap v2351: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:07.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.083+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9348027a00 con 0x7f93480f66d0 2022-02-02T14:57:07.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.084+0000 7f9344ff9700 1 -- 172.21.15.33:0/1671208580 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f933c053100 con 0x7f93480f66d0 2022-02-02T14:57:07.084 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:57:07.084 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:57:07.084 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:57:07.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:07.085 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:57:07.085 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:57:07.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:07.086 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:57:07.086 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:57:07.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:07.087 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:57:07.087 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:57:07.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:07.087 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:57:07.087 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:57:07.088 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:57:07.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:57:07.088 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:57:07.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 msgr2=0x7f93300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 0x7f93300672e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f9348060060 tx=0x7f9338009b30).stop 2022-02-02T14:57:07.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 msgr2=0x7f934810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7f933c0026d0 tx=0x7f933c009de0).stop 2022-02-02T14:57:07.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 shutdown_connections 2022-02-02T14:57:07.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9330064e20 0x7f93300672e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93480f5430 0x7f9348109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 --2- 172.21.15.33:0/1671208580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93480f66d0 0x7f934810bf90 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 >> 172.21.15.33:0/1671208580 conn(0x7f93480f0b90 msgr2=0x7f93480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:07.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 shutdown_connections 2022-02-02T14:57:07.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.086+0000 7f934d747700 1 -- 172.21.15.33:0/1671208580 wait complete. 2022-02-02T14:57:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 -- 172.21.15.33:0/4013043725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 msgr2=0x7f79e40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 --2- 172.21.15.33:0/4013043725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f59e0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7f79d8004660 tx=0x7f79d8009b30).stop 2022-02-02T14:57:07.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 -- 172.21.15.33:0/4013043725 shutdown_connections 2022-02-02T14:57:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 --2- 172.21.15.33:0/4013043725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 --2- 172.21.15.33:0/4013043725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f59e0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 -- 172.21.15.33:0/4013043725 >> 172.21.15.33:0/4013043725 conn(0x7f79e40f0d40 msgr2=0x7f79e40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:07.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 -- 172.21.15.33:0/4013043725 shutdown_connections 2022-02-02T14:57:07.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.187+0000 7f79e93c5700 1 -- 172.21.15.33:0/4013043725 wait complete. 2022-02-02T14:57:07.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 Processor -- start 2022-02-02T14:57:07.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 -- start start 2022-02-02T14:57:07.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:07.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:07.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40f8100 con 0x7f79e40f55c0 2022-02-02T14:57:07.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e93c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40f8240 con 0x7f79e40f6860 2022-02-02T14:57:07.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:07.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35292/0 (socket says 172.21.15.33:35292) 2022-02-02T14:57:07.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.188+0000 7f79e2ffd700 1 -- 172.21.15.33:0/3694430014 learned_addr learned my addr 172.21.15.33:0/3694430014 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:07.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e27fc700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:07.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e2ffd700 1 -- 172.21.15.33:0/3694430014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 msgr2=0x7f79e40f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e2ffd700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e2ffd700 1 -- 172.21.15.33:0/3694430014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8005040 con 0x7f79e40f55c0 2022-02-02T14:57:07.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e27fc700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:57:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e2ffd700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f79d8013a70 tx=0x7f79d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d8018070 con 0x7f79e40f55c0 2022-02-02T14:57:07.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40f84c0 con 0x7f79e40f55c0 2022-02-02T14:57:07.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f79d80097d0 con 0x7f79e40f55c0 2022-02-02T14:57:07.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d801c3c0 con 0x7f79e40f55c0 2022-02-02T14:57:07.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.189+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40f8a20 con 0x7f79e40f55c0 2022-02-02T14:57:07.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.190+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e4045ad0 con 0x7f79e40f55c0 2022-02-02T14:57:07.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.191+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f79d8007ba0 con 0x7f79e40f55c0 2022-02-02T14:57:07.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.191+0000 7f79cb7fe700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 0x7f79cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:07.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.191+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f79d8083790 con 0x7f79e40f55c0 2022-02-02T14:57:07.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.191+0000 7f79e27fc700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 0x7f79cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:07.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.192+0000 7f79e27fc700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 0x7f79cc067290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f79d4009780 tx=0x7f79d4009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:07.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.195+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79d8051900 con 0x7f79e40f55c0 2022-02-02T14:57:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.406+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f79e410f660 con 0x7f79e40f55c0 2022-02-02T14:57:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.407+0000 7f79cb7fe700 1 -- 172.21.15.33:0/3694430014 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f79d8054f20 con 0x7f79e40f55c0 2022-02-02T14:57:07.407 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:57:07.407 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:57:07.407 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:57:07.408 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:57:07.408 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:07.408 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:57:07.409 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:57:07.409 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:57:07.409 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:57:07.409 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:57:07.410 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:57:07.410 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:57:07.410 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:57:07.410 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:57:07.411 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:57:07.411 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:57:07.411 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:57:07.411 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:57:07.412 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:57:07.412 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:57:07.412 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:57:07.412 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:57:07.412 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:57:07.413 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:57:07.413 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:57:07.413 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:57:07.413 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:57:07.414 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:57:07.414 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:57:07.414 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:57:07.414 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:57:07.415 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:07.415 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:07.415 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:57:07.415 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:07.415 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:07.416 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:07.416 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:07.416 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:07.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.410+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 msgr2=0x7f79cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.410+0000 7f79e93c5700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 0x7f79cc067290 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f79d4009780 tx=0x7f79d4009c80).stop 2022-02-02T14:57:07.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.410+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 msgr2=0x7f79e40f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:07.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.410+0000 7f79e93c5700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7f79d8013a70 tx=0x7f79d8009b30).stop 2022-02-02T14:57:07.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 shutdown_connections 2022-02-02T14:57:07.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f79cc064dd0 0x7f79cc067290 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e40f55c0 0x7f79e40f9720 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 --2- 172.21.15.33:0/3694430014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40f6860 0x7f79e40f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:07.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 >> 172.21.15.33:0/3694430014 conn(0x7f79e40f0d40 msgr2=0x7f79e405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:07.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 shutdown_connections 2022-02-02T14:57:07.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:07.411+0000 7f79e93c5700 1 -- 172.21.15.33:0/3694430014 wait complete. 2022-02-02T14:57:07.420 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:57:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:07 smithi037 ceph-mon[69017]: from='client.36482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:07.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:07 smithi037 ceph-mon[69017]: from='client.36486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1671208580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:57:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3694430014' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:57:07.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:07 smithi037 ceph-mon[69017]: pgmap v2352: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:07.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:07 smithi033 ceph-mon[101165]: from='client.36482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:07.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:07 smithi033 ceph-mon[101165]: from='client.36486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1671208580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:57:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3694430014' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:57:07.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:07 smithi033 ceph-mon[101165]: pgmap v2352: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:10.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:10 smithi037 ceph-mon[69017]: pgmap v2353: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:10 smithi033 ceph-mon[101165]: pgmap v2353: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:12 smithi033 ceph-mon[101165]: pgmap v2354: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:12 smithi037 ceph-mon[69017]: pgmap v2354: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:14.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:14 smithi033 ceph-mon[101165]: pgmap v2355: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:15.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:14 smithi037 ceph-mon[69017]: pgmap v2355: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:16 smithi033 ceph-mon[101165]: pgmap v2356: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:17.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:16 smithi037 ceph-mon[69017]: pgmap v2356: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:18 smithi033 ceph-mon[101165]: pgmap v2357: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:19.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:18 smithi037 ceph-mon[69017]: pgmap v2357: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:20 smithi033 ceph-mon[101165]: pgmap v2358: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:21.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:20 smithi037 ceph-mon[69017]: pgmap v2358: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:22 smithi033 ceph-mon[101165]: pgmap v2359: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:22 smithi037 ceph-mon[69017]: pgmap v2359: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:24.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:24 smithi033 ceph-mon[101165]: pgmap v2360: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:24 smithi037 ceph-mon[69017]: pgmap v2360: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:26 smithi033 ceph-mon[101165]: pgmap v2361: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:26 smithi037 ceph-mon[69017]: pgmap v2361: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:28 smithi033 ceph-mon[101165]: pgmap v2362: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:28 smithi037 ceph-mon[69017]: pgmap v2362: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:30 smithi033 ceph-mon[101165]: pgmap v2363: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:30 smithi037 ceph-mon[69017]: pgmap v2363: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:32 smithi033 ceph-mon[101165]: pgmap v2364: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:32 smithi037 ceph-mon[69017]: pgmap v2364: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:34 smithi033 ceph-mon[101165]: pgmap v2365: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:34 smithi037 ceph-mon[69017]: pgmap v2365: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:36 smithi033 ceph-mon[101165]: pgmap v2366: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:37.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:36 smithi037 ceph-mon[69017]: pgmap v2366: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 -- 172.21.15.33:0/1855445102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f55c0 msgr2=0x7f5b100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/1855445102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f55c0 0x7f5b100f59e0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f5b04004660 tx=0x7f5b04009b30).stop 2022-02-02T14:57:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 -- 172.21.15.33:0/1855445102 shutdown_connections 2022-02-02T14:57:37.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/1855445102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f6860 0x7f5b100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/1855445102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f55c0 0x7f5b100f59e0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 -- 172.21.15.33:0/1855445102 >> 172.21.15.33:0/1855445102 conn(0x7f5b100f0d40 msgr2=0x7f5b100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:37.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 -- 172.21.15.33:0/1855445102 shutdown_connections 2022-02-02T14:57:37.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.526+0000 7f5b17b9a700 1 -- 172.21.15.33:0/1855445102 wait complete. 2022-02-02T14:57:37.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 Processor -- start 2022-02-02T14:57:37.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 -- start start 2022-02-02T14:57:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f55c0 0x7f5b10105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10106950 con 0x7f5b100f6860 2022-02-02T14:57:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b17b9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10107160 con 0x7f5b100f55c0 2022-02-02T14:57:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b15135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b15135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35304/0 (socket says 172.21.15.33:35304) 2022-02-02T14:57:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b15135700 1 -- 172.21.15.33:0/3866002606 learned_addr learned my addr 172.21.15.33:0/3866002606 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.527+0000 7f5b15936700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f55c0 0x7f5b10105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b15135700 1 -- 172.21.15.33:0/3866002606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f55c0 msgr2=0x7f5b10105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b15135700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f55c0 0x7f5b10105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b15135700 1 -- 172.21.15.33:0/3866002606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b04005040 con 0x7f5b100f6860 2022-02-02T14:57:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b15135700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f5b0c00e7f0 tx=0x7f5b0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c0092e0 con 0x7f5b100f6860 2022-02-02T14:57:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5b0c00f040 con 0x7f5b100f6860 2022-02-02T14:57:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b101073e0 con 0x7f5b100f6860 2022-02-02T14:57:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b0c014750 con 0x7f5b100f6860 2022-02-02T14:57:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.528+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b101079a0 con 0x7f5b100f6860 2022-02-02T14:57:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.529+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b100f49b0 con 0x7f5b100f6860 2022-02-02T14:57:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.530+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5b0c01b030 con 0x7f5b100f6860 2022-02-02T14:57:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.530+0000 7f5b027fc700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 0x7f5afc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.530+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5b0c081820 con 0x7f5b100f6860 2022-02-02T14:57:37.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.530+0000 7f5b15936700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 0x7f5afc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.531+0000 7f5b15936700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 0x7f5afc067270 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5b04000c00 tx=0x7f5b0400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:37.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.535+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5b0c04f980 con 0x7f5b100f6860 2022-02-02T14:57:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.722+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b100fdf10 con 0x7f5afc064db0 2022-02-02T14:57:37.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.724+0000 7f5b027fc700 1 -- 172.21.15.33:0/3866002606 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f5b100fdf10 con 0x7f5afc064db0 2022-02-02T14:57:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 msgr2=0x7f5afc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 0x7f5afc067270 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f5b04000c00 tx=0x7f5b0400b040).stop 2022-02-02T14:57:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 msgr2=0x7f5b10106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f5b0c00e7f0 tx=0x7f5b0c00b040).stop 2022-02-02T14:57:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 shutdown_connections 2022-02-02T14:57:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5afc064db0 0x7f5afc067270 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b100f55c0 0x7f5b10105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 --2- 172.21.15.33:0/3866002606 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b100f6860 0x7f5b10106350 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.725+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 >> 172.21.15.33:0/3866002606 conn(0x7f5b100f0d40 msgr2=0x7f5b100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.726+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 shutdown_connections 2022-02-02T14:57:37.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.726+0000 7f5b17b9a700 1 -- 172.21.15.33:0/3866002606 wait complete. 2022-02-02T14:57:37.734 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:57:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 -- 172.21.15.33:0/870773728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f55c0 msgr2=0x7faa0c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 --2- 172.21.15.33:0/870773728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f59e0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fa9fc004660 tx=0x7fa9fc009b30).stop 2022-02-02T14:57:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 -- 172.21.15.33:0/870773728 shutdown_connections 2022-02-02T14:57:37.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 --2- 172.21.15.33:0/870773728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 --2- 172.21.15.33:0/870773728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f59e0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 -- 172.21.15.33:0/870773728 >> 172.21.15.33:0/870773728 conn(0x7faa0c0f0d40 msgr2=0x7faa0c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:37.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.826+0000 7faa12848700 1 -- 172.21.15.33:0/870773728 shutdown_connections 2022-02-02T14:57:37.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.827+0000 7faa12848700 1 -- 172.21.15.33:0/870773728 wait complete. 2022-02-02T14:57:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.827+0000 7faa12848700 1 Processor -- start 2022-02-02T14:57:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.827+0000 7faa12848700 1 -- start start 2022-02-02T14:57:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa12848700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa12848700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa12848700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0f8100 con 0x7faa0c0f6860 2022-02-02T14:57:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa12848700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0c0f8240 con 0x7faa0c0f55c0 2022-02-02T14:57:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35314/0 (socket says 172.21.15.33:35314) 2022-02-02T14:57:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 -- 172.21.15.33:0/3706418736 learned_addr learned my addr 172.21.15.33:0/3706418736 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa0bfff700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 -- 172.21.15.33:0/3706418736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f55c0 msgr2=0x7faa0c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:37.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 -- 172.21.15.33:0/3706418736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc005040 con 0x7faa0c0f6860 2022-02-02T14:57:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.828+0000 7faa03fff700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fa9f400c530 tx=0x7fa9f4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.829+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f400f650 con 0x7faa0c0f6860 2022-02-02T14:57:37.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.829+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa9f400fc60 con 0x7faa0c0f6860 2022-02-02T14:57:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.829+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9f4012c20 con 0x7faa0c0f6860 2022-02-02T14:57:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.829+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa0c0f8520 con 0x7faa0c0f6860 2022-02-02T14:57:37.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.829+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa0c10efa0 con 0x7faa0c0f6860 2022-02-02T14:57:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.830+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa9f4010070 con 0x7faa0c0f6860 2022-02-02T14:57:37.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.830+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa0c045ad0 con 0x7faa0c0f6860 2022-02-02T14:57:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.831+0000 7faa097fa700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 0x7fa9f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.831+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa9f4081730 con 0x7faa0c0f6860 2022-02-02T14:57:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.831+0000 7faa0bfff700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 0x7fa9f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:37.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.831+0000 7faa0bfff700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 0x7fa9f8067290 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa9fc013690 tx=0x7fa9fc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:37.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:37.835+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa9f404f7e0 con 0x7faa0c0f6860 2022-02-02T14:57:38.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.018+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa0c0faca0 con 0x7fa9f8064dd0 2022-02-02T14:57:38.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.033+0000 7faa097fa700 1 -- 172.21.15.33:0/3706418736 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faa0c0faca0 con 0x7fa9f8064dd0 2022-02-02T14:57:38.033 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:57:38.033 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (82m) 45m ago 83m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:57:38.033 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (75m) 45m ago 83m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:57:38.033 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (75m) 45m ago 83m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:57:38.034 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (82m) 45m ago 83m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:57:38.034 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (76m) 45m ago 80m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:57:38.034 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (77m) 45m ago 80m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:57:38.034 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (77m) 45m ago 80m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:57:38.034 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (80m) 45m ago 80m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:57:38.035 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (77m) 45m ago 85m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:57:38.035 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (77m) 45m ago 83m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:57:38.035 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (76m) 45m ago 85m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:57:38.035 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (76m) 45m ago 83m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (83m) 45m ago 83m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (83m) 45m ago 83m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 45m ago 82m - 4096M 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (82m) 45m ago 82m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (82m) 45m ago 82m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:57:38.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (81m) 45m ago 81m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:57:38.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (81m) 45m ago 81m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:57:38.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (81m) 45m ago 81m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:57:38.037 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (82m) 45m ago 83m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:57:38.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 msgr2=0x7fa9f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 0x7fa9f8067290 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fa9fc013690 tx=0x7fa9fc009b30).stop 2022-02-02T14:57:38.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 msgr2=0x7faa0c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 rx=0x7fa9f400c530 tx=0x7fa9f4007e20).stop 2022-02-02T14:57:38.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 shutdown_connections 2022-02-02T14:57:38.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa9f8064dd0 0x7fa9f8067290 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa0c0f55c0 0x7faa0c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 --2- 172.21.15.33:0/3706418736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa0c0f6860 0x7faa0c0f7ba0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 >> 172.21.15.33:0/3706418736 conn(0x7faa0c0f0d40 msgr2=0x7faa0c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 shutdown_connections 2022-02-02T14:57:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.035+0000 7faa12848700 1 -- 172.21.15.33:0/3706418736 wait complete. 2022-02-02T14:57:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.135+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2443280226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f5430 msgr2=0x7ff5cc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.135+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2443280226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc0f5850 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7ff5c8004660 tx=0x7ff5c8009b30).stop 2022-02-02T14:57:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2443280226 shutdown_connections 2022-02-02T14:57:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2443280226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2443280226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc0f5850 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2443280226 >> 172.21.15.33:0/2443280226 conn(0x7ff5cc0f0b90 msgr2=0x7ff5cc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2443280226 shutdown_connections 2022-02-02T14:57:38.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2443280226 wait complete. 2022-02-02T14:57:38.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 Processor -- start 2022-02-02T14:57:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.136+0000 7ff5d2c7e700 1 -- start start 2022-02-02T14:57:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d2c7e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d2c7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d2c7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc0603e0 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d2c7e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5cc060520 con 0x7ff5cc0f5430 2022-02-02T14:57:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35324/0 (socket says 172.21.15.33:35324) 2022-02-02T14:57:38.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 -- 172.21.15.33:0/2341286209 learned_addr learned my addr 172.21.15.33:0/2341286209 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d1c7c700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 -- 172.21.15.33:0/2341286209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 msgr2=0x7ff5cc109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 -- 172.21.15.33:0/2341286209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8005040 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d1c7c700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:57:38.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.137+0000 7ff5d147b700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7ff5bc0026d0 tx=0x7ff5bc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:38.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.138+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5bc009320 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.138+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5cc10c540 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.138+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5bc00f040 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.138+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5bc0147e0 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.138+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5cc10cb00 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.139+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5cc045ad0 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.139+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff5bc009480 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.139+0000 7ff5c27fc700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 0x7ff5b80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.140+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff5bc082170 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.140+0000 7ff5d1c7c700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 0x7ff5b80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.140+0000 7ff5d1c7c700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 0x7ff5b80672e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ff5c8004e30 tx=0x7ff5c8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:38.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.144+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5bc050220 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.388+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff5cc027a00 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.389+0000 7ff5c27fc700 1 -- 172.21.15.33:0/2341286209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff5bc053840 con 0x7ff5cc0f66d0 2022-02-02T14:57:38.389 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:57:38.389 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:57:38.389 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:57:38.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:38.390 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:57:38.390 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:57:38.390 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:38.390 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:57:38.391 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:57:38.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:38.391 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:57:38.391 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:57:38.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:57:38.392 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:57:38.392 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:57:38.392 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:57:38.393 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:57:38.393 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:57:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 msgr2=0x7ff5b80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 0x7ff5b80672e0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7ff5c8004e30 tx=0x7ff5c8009b30).stop 2022-02-02T14:57:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 msgr2=0x7ff5cc10bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7ff5bc0026d0 tx=0x7ff5bc009de0).stop 2022-02-02T14:57:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 shutdown_connections 2022-02-02T14:57:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5b8064e20 0x7ff5b80672e0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5cc0f5430 0x7ff5cc109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 --2- 172.21.15.33:0/2341286209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5cc0f66d0 0x7ff5cc10bf90 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 >> 172.21.15.33:0/2341286209 conn(0x7ff5cc0f0b90 msgr2=0x7ff5cc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 shutdown_connections 2022-02-02T14:57:38.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.391+0000 7ff5d2c7e700 1 -- 172.21.15.33:0/2341286209 wait complete. 2022-02-02T14:57:38.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 -- 172.21.15.33:0/3085473801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 msgr2=0x7fecfc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 --2- 172.21.15.33:0/3085473801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc0f6cc0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 rx=0x7fecf0004660 tx=0x7fecf0009b30).stop 2022-02-02T14:57:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 -- 172.21.15.33:0/3085473801 shutdown_connections 2022-02-02T14:57:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 --2- 172.21.15.33:0/3085473801 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc0f6cc0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 --2- 172.21.15.33:0/3085473801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 0x7fecfc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 -- 172.21.15.33:0/3085473801 >> 172.21.15.33:0/3085473801 conn(0x7fecfc0f0d40 msgr2=0x7fecfc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:38.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 -- 172.21.15.33:0/3085473801 shutdown_connections 2022-02-02T14:57:38.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.492+0000 7fed035be700 1 -- 172.21.15.33:0/3085473801 wait complete. 2022-02-02T14:57:38.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 Processor -- start 2022-02-02T14:57:38.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 -- start start 2022-02-02T14:57:38.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 0x7fecfc10c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0602b0 con 0x7fecfc0f6860 2022-02-02T14:57:38.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed035be700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecfc0603f0 con 0x7fecfc0f55c0 2022-02-02T14:57:38.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35334/0 (socket says 172.21.15.33:35334) 2022-02-02T14:57:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 -- 172.21.15.33:0/3138923103 learned_addr learned my addr 172.21.15.33:0/3138923103 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:57:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed0135a700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 0x7fecfc10c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 -- 172.21.15.33:0/3138923103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 msgr2=0x7fecfc10c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 0x7fecfc10c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 -- 172.21.15.33:0/3138923103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf0005040 con 0x7fecfc0f6860 2022-02-02T14:57:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fed00b59700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fecf0009990 tx=0x7fecf0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.493+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf0018070 con 0x7fecfc0f6860 2022-02-02T14:57:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.494+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc10ea60 con 0x7fecfc0f6860 2022-02-02T14:57:38.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.494+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fecf0007ba0 con 0x7fecfc0f6860 2022-02-02T14:57:38.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.494+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fecf001c3c0 con 0x7fecfc0f6860 2022-02-02T14:57:38.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.494+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecfc10ee30 con 0x7fecfc0f6860 2022-02-02T14:57:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.495+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecfc0f49b0 con 0x7fecfc0f6860 2022-02-02T14:57:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.495+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fecf001d420 con 0x7fecfc0f6860 2022-02-02T14:57:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.496+0000 7fecedffb700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 0x7fece8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:57:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.496+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fecf0083710 con 0x7fecfc0f6860 2022-02-02T14:57:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.496+0000 7fed0135a700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 0x7fece8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:57:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.496+0000 7fed0135a700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 0x7fece8067290 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fecfc060040 tx=0x7fecf800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:57:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.500+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fecf0051820 con 0x7fecfc0f6860 2022-02-02T14:57:38.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.712+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fecfc0fdea0 con 0x7fecfc0f6860 2022-02-02T14:57:38.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.713+0000 7fecedffb700 1 -- 172.21.15.33:0/3138923103 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fecf0051070 con 0x7fecfc0f6860 2022-02-02T14:57:38.713 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:57:38.713 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:57:38.713 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:57:38.713 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:57:38.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:38.714 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:57:38.714 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:57:38.715 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:57:38.715 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:57:38.715 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:57:38.715 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:57:38.715 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:57:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:57:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:57:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:57:38.716 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:57:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:57:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:57:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:57:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:57:38.717 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:57:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:57:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:57:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:57:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:57:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:57:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:57:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:57:38.719 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:57:38.720 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:57:38.720 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:57:38.720 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:38.720 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:38.720 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:57:38.721 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:57:38.721 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:38.721 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:38.721 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:38.722 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:57:38.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 msgr2=0x7fece8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 0x7fece8067290 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fecfc060040 tx=0x7fecf800b040).stop 2022-02-02T14:57:38.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 msgr2=0x7fecfc10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:57:38.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fecf0009990 tx=0x7fecf0009b30).stop 2022-02-02T14:57:38.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 shutdown_connections 2022-02-02T14:57:38.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fece8064dd0 0x7fece8067290 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecfc0f55c0 0x7fecfc10c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 --2- 172.21.15.33:0/3138923103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecfc0f6860 0x7fecfc10e570 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:57:38.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 >> 172.21.15.33:0/3138923103 conn(0x7fecfc0f0d40 msgr2=0x7fecfc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:57:38.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 shutdown_connections 2022-02-02T14:57:38.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:57:38.715+0000 7fed035be700 1 -- 172.21.15.33:0/3138923103 wait complete. 2022-02-02T14:57:38.725 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:57:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:38 smithi033 ceph-mon[101165]: pgmap v2367: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:38.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2341286209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:57:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:38 smithi037 ceph-mon[69017]: pgmap v2367: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:39.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2341286209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:57:39.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:39 smithi033 ceph-mon[101165]: from='client.36498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:39.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:39 smithi033 ceph-mon[101165]: from='client.36502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:39.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:39 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3138923103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:57:40.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:39 smithi037 ceph-mon[69017]: from='client.36498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:40.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:39 smithi037 ceph-mon[69017]: from='client.36502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:57:40.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:39 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3138923103' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:57:40.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:40 smithi033 ceph-mon[101165]: pgmap v2368: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:40 smithi037 ceph-mon[69017]: pgmap v2368: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:42.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:42 smithi033 ceph-mon[101165]: pgmap v2369: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:42 smithi037 ceph-mon[69017]: pgmap v2369: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:44 smithi033 ceph-mon[101165]: pgmap v2370: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:44 smithi037 ceph-mon[69017]: pgmap v2370: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:46.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:46 smithi033 ceph-mon[101165]: pgmap v2371: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:46 smithi037 ceph-mon[69017]: pgmap v2371: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:48.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:48 smithi033 ceph-mon[101165]: pgmap v2372: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:49.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:48 smithi037 ceph-mon[69017]: pgmap v2372: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:50 smithi033 ceph-mon[101165]: pgmap v2373: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:51.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:50 smithi037 ceph-mon[69017]: pgmap v2373: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:52 smithi033 ceph-mon[101165]: pgmap v2374: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:52 smithi037 ceph-mon[69017]: pgmap v2374: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:54 smithi033 ceph-mon[101165]: pgmap v2375: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:57:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:57:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:54 smithi037 ceph-mon[69017]: pgmap v2375: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:57:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:57:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:56 smithi033 ceph-mon[101165]: pgmap v2376: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:56 smithi037 ceph-mon[69017]: pgmap v2376: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:57:58 smithi033 ceph-mon[101165]: pgmap v2377: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:57:59.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:57:58 smithi037 ceph-mon[69017]: pgmap v2377: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:00 smithi033 ceph-mon[101165]: pgmap v2378: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:00 smithi037 ceph-mon[69017]: pgmap v2378: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:02 smithi033 ceph-mon[101165]: pgmap v2379: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:03.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:02 smithi037 ceph-mon[69017]: pgmap v2379: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:04.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:04 smithi033 ceph-mon[101165]: pgmap v2380: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:05.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:04 smithi037 ceph-mon[69017]: pgmap v2380: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:06 smithi033 ceph-mon[101165]: pgmap v2381: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:07.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:06 smithi037 ceph-mon[69017]: pgmap v2381: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:08.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 -- 172.21.15.33:0/2761913544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0602b0 msgr2=0x7f6c4c0fb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:08.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 --2- 172.21.15.33:0/2761913544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c0fb700 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f6c3c004660 tx=0x7f6c3c009b30).stop 2022-02-02T14:58:08.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 -- 172.21.15.33:0/2761913544 shutdown_connections 2022-02-02T14:58:08.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 --2- 172.21.15.33:0/2761913544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c0fdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:08.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 --2- 172.21.15.33:0/2761913544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c0fb700 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:08.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 -- 172.21.15.33:0/2761913544 >> 172.21.15.33:0/2761913544 conn(0x7f6c4c0f0d40 msgr2=0x7f6c4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:08.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 -- 172.21.15.33:0/2761913544 shutdown_connections 2022-02-02T14:58:08.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.830+0000 7f6c51afc700 1 -- 172.21.15.33:0/2761913544 wait complete. 2022-02-02T14:58:08.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 Processor -- start 2022-02-02T14:58:08.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 -- start start 2022-02-02T14:58:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c109bf0 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c51afc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c109d30 con 0x7f6c4c0602b0 2022-02-02T14:58:08.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:08.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c4affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35344/0 (socket says 172.21.15.33:35344) 2022-02-02T14:58:08.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c4affd700 1 -- 172.21.15.33:0/4198043312 learned_addr learned my addr 172.21.15.33:0/4198043312 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:08.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.831+0000 7f6c4b7fe700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:08.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c4affd700 1 -- 172.21.15.33:0/4198043312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0602b0 msgr2=0x7f6c4c109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:08.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c4affd700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:08.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c4affd700 1 -- 172.21.15.33:0/4198043312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c005040 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c4affd700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f6c40002700 tx=0x7f6c40009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:08.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c400079c0 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c4000f040 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c10a6d0 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c40014740 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.832+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c10ac90 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.833+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c045ad0 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.834+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c4001b060 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.834+0000 7f6c33fff700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 0x7f6c34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.834+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c40081890 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.834+0000 7f6c4b7fe700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 0x7f6c34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.835+0000 7f6c4b7fe700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 0x7f6c34067290 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6c3c004630 tx=0x7f6c3c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:08.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:08.838+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c40053420 con 0x7f6c4c0fbbf0 2022-02-02T14:58:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:08 smithi033 ceph-mon[101165]: pgmap v2382: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.026+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c4c101210 con 0x7f6c34064dd0 2022-02-02T14:58:09.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.027+0000 7f6c33fff700 1 -- 172.21.15.33:0/4198043312 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6c4c101210 con 0x7f6c34064dd0 2022-02-02T14:58:09.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 msgr2=0x7f6c34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 0x7f6c34067290 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f6c3c004630 tx=0x7f6c3c009b30).stop 2022-02-02T14:58:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 msgr2=0x7f6c4c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f6c40002700 tx=0x7f6c40009d60).stop 2022-02-02T14:58:09.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 shutdown_connections 2022-02-02T14:58:09.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.029+0000 7f6c51afc700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c34064dd0 0x7f6c34067290 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.030+0000 7f6c51afc700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c4c0602b0 0x7f6c4c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.030+0000 7f6c51afc700 1 --2- 172.21.15.33:0/4198043312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c4c0fbbf0 0x7f6c4c109640 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.030+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 >> 172.21.15.33:0/4198043312 conn(0x7f6c4c0f0d40 msgr2=0x7f6c4c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.030+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 shutdown_connections 2022-02-02T14:58:09.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.030+0000 7f6c51afc700 1 -- 172.21.15.33:0/4198043312 wait complete. 2022-02-02T14:58:09.039 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:58:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:08 smithi037 ceph-mon[69017]: pgmap v2382: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:09.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 -- 172.21.15.33:0/1008096247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f6860 msgr2=0x7fc5140f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 --2- 172.21.15.33:0/1008096247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f6860 0x7fc5140f6cc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7fc508004660 tx=0x7fc508009b30).stop 2022-02-02T14:58:09.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 -- 172.21.15.33:0/1008096247 shutdown_connections 2022-02-02T14:58:09.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 --2- 172.21.15.33:0/1008096247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f6860 0x7fc5140f6cc0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 --2- 172.21.15.33:0/1008096247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f55c0 0x7fc5140f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 -- 172.21.15.33:0/1008096247 >> 172.21.15.33:0/1008096247 conn(0x7fc5140f0d40 msgr2=0x7fc5140f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 -- 172.21.15.33:0/1008096247 shutdown_connections 2022-02-02T14:58:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.131+0000 7fc51a470700 1 -- 172.21.15.33:0/1008096247 wait complete. 2022-02-02T14:58:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 Processor -- start 2022-02-02T14:58:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 -- start start 2022-02-02T14:58:09.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 0x7fc51410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5140603e0 con 0x7fc5140f55c0 2022-02-02T14:58:09.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc51a470700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc514060520 con 0x7fc5140f6860 2022-02-02T14:58:09.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.132+0000 7fc513fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35352/0 (socket says 172.21.15.33:35352) 2022-02-02T14:58:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 -- 172.21.15.33:0/3386437090 learned_addr learned my addr 172.21.15.33:0/3386437090 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc5137fe700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 0x7fc51410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 -- 172.21.15.33:0/3386437090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 msgr2=0x7fc51410c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 0x7fc51410c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 -- 172.21.15.33:0/3386437090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508005040 con 0x7fc5140f55c0 2022-02-02T14:58:09.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc5137fe700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 0x7fc51410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T14:58:09.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc513fff700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fc50400c530 tx=0x7fc504007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc50400f650 con 0x7fc5140f55c0 2022-02-02T14:58:09.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51410c700 con 0x7fc5140f55c0 2022-02-02T14:58:09.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc50400fc60 con 0x7fc5140f55c0 2022-02-02T14:58:09.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc504012d20 con 0x7fc5140f55c0 2022-02-02T14:58:09.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.133+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51410ccc0 con 0x7fc5140f55c0 2022-02-02T14:58:09.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.134+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc514045ad0 con 0x7fc5140f55c0 2022-02-02T14:58:09.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.135+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc504019030 con 0x7fc5140f55c0 2022-02-02T14:58:09.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.135+0000 7fc510ff9700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 0x7fc4fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.136+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc5040817c0 con 0x7fc5140f55c0 2022-02-02T14:58:09.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.136+0000 7fc5137fe700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 0x7fc4fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.136+0000 7fc5137fe700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 0x7fc4fc067290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc508009da0 tx=0x7fc508009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.140+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc50404f800 con 0x7fc5140f55c0 2022-02-02T14:58:09.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.322+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc514057f10 con 0x7fc4fc064dd0 2022-02-02T14:58:09.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.337+0000 7fc510ff9700 1 -- 172.21.15.33:0/3386437090 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc514057f10 con 0x7fc4fc064dd0 2022-02-02T14:58:09.337 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:58:09.337 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (83m) 45m ago 84m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:58:09.337 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (76m) 45m ago 84m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:58:09.338 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (76m) 45m ago 83m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:58:09.338 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (83m) 45m ago 84m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:58:09.338 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (76m) 45m ago 80m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:58:09.338 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (77m) 45m ago 80m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:58:09.339 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (78m) 45m ago 80m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:58:09.339 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (80m) 45m ago 80m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:58:09.339 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (78m) 45m ago 85m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:58:09.339 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (77m) 45m ago 83m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:58:09.340 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (77m) 45m ago 85m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:58:09.340 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (77m) 45m ago 83m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:58:09.340 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (84m) 45m ago 84m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:58:09.340 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (83m) 45m ago 83m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:58:09.340 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 45m ago 83m - 4096M 2022-02-02T14:58:09.341 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (82m) 45m ago 82m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:58:09.341 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (82m) 45m ago 82m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:58:09.341 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (82m) 45m ago 82m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:58:09.342 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (82m) 45m ago 82m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:58:09.342 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (81m) 45m ago 81m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:58:09.342 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (83m) 45m ago 84m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:58:09.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 msgr2=0x7fc4fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 0x7fc4fc067290 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fc508009da0 tx=0x7fc508009b30).stop 2022-02-02T14:58:09.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 msgr2=0x7fc514109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7fc50400c530 tx=0x7fc504007e10).stop 2022-02-02T14:58:09.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 shutdown_connections 2022-02-02T14:58:09.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc4fc064dd0 0x7fc4fc067290 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5140f55c0 0x7fc514109c50 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 --2- 172.21.15.33:0/3386437090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5140f6860 0x7fc51410c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.339+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 >> 172.21.15.33:0/3386437090 conn(0x7fc5140f0d40 msgr2=0x7fc5140fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.340+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 shutdown_connections 2022-02-02T14:58:09.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.340+0000 7fc51a470700 1 -- 172.21.15.33:0/3386437090 wait complete. 2022-02-02T14:58:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 -- 172.21.15.33:0/1467205828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 msgr2=0x7fce780f9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 --2- 172.21.15.33:0/1467205828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f9340 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7fce68004660 tx=0x7fce68009b30).stop 2022-02-02T14:58:09.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 -- 172.21.15.33:0/1467205828 shutdown_connections 2022-02-02T14:58:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 --2- 172.21.15.33:0/1467205828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 --2- 172.21.15.33:0/1467205828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f9340 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 -- 172.21.15.33:0/1467205828 >> 172.21.15.33:0/1467205828 conn(0x7fce780f0d40 msgr2=0x7fce780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 -- 172.21.15.33:0/1467205828 shutdown_connections 2022-02-02T14:58:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.442+0000 7fce7d384700 1 -- 172.21.15.33:0/1467205828 wait complete. 2022-02-02T14:58:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 Processor -- start 2022-02-02T14:58:09.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 -- start start 2022-02-02T14:58:09.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780f57a0 con 0x7fce78060270 2022-02-02T14:58:09.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce7d384700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780f58e0 con 0x7fce780f9830 2022-02-02T14:58:09.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35362/0 (socket says 172.21.15.33:35362) 2022-02-02T14:58:09.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.443+0000 7fce76ffd700 1 -- 172.21.15.33:0/2272661911 learned_addr learned my addr 172.21.15.33:0/2272661911 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce767fc700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce76ffd700 1 -- 172.21.15.33:0/2272661911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 msgr2=0x7fce780f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce76ffd700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce76ffd700 1 -- 172.21.15.33:0/2272661911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68005040 con 0x7fce78060270 2022-02-02T14:58:09.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce767fc700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T14:58:09.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce76ffd700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fce68009990 tx=0x7fce68009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce68018070 con 0x7fce78060270 2022-02-02T14:58:09.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce68007ca0 con 0x7fce78060270 2022-02-02T14:58:09.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce780f5b60 con 0x7fce78060270 2022-02-02T14:58:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce6801c600 con 0x7fce78060270 2022-02-02T14:58:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.444+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce780f60c0 con 0x7fce78060270 2022-02-02T14:58:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.445+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce78045ad0 con 0x7fce78060270 2022-02-02T14:58:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.446+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce6801d9d0 con 0x7fce78060270 2022-02-02T14:58:09.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.446+0000 7fce5f7fe700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 0x7fce60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.446+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fce68083910 con 0x7fce78060270 2022-02-02T14:58:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.446+0000 7fce767fc700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 0x7fce60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.447+0000 7fce767fc700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 0x7fce60067290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fce78060040 tx=0x7fce6c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.450+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce680519c0 con 0x7fce78060270 2022-02-02T14:58:09.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.694+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce78027a00 con 0x7fce78060270 2022-02-02T14:58:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.694+0000 7fce5f7fe700 1 -- 172.21.15.33:0/2272661911 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fce68054fe0 con 0x7fce78060270 2022-02-02T14:58:09.694 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:58:09.694 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:58:09.695 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:58:09.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:09.695 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:58:09.695 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:58:09.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:09.696 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:58:09.696 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:58:09.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:09.697 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:58:09.697 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:58:09.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:09.697 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:58:09.698 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:58:09.698 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:58:09.698 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:58:09.698 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:58:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 msgr2=0x7fce60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 0x7fce60067290 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fce78060040 tx=0x7fce6c009040).stop 2022-02-02T14:58:09.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 msgr2=0x7fce780f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7fce68009990 tx=0x7fce68009b30).stop 2022-02-02T14:58:09.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 shutdown_connections 2022-02-02T14:58:09.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce60064dd0 0x7fce60067290 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce78060270 0x7fce780f6dc0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 --2- 172.21.15.33:0/2272661911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce780f9830 0x7fce780f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 >> 172.21.15.33:0/2272661911 conn(0x7fce780f0d40 msgr2=0x7fce780f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 shutdown_connections 2022-02-02T14:58:09.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.697+0000 7fce7d384700 1 -- 172.21.15.33:0/2272661911 wait complete. 2022-02-02T14:58:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 -- 172.21.15.33:0/3605370194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f5430 msgr2=0x7fc2840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 --2- 172.21.15.33:0/3605370194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f5430 0x7fc2840f5850 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7fc280004660 tx=0x7fc280009b30).stop 2022-02-02T14:58:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 -- 172.21.15.33:0/3605370194 shutdown_connections 2022-02-02T14:58:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 --2- 172.21.15.33:0/3605370194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f66d0 0x7fc2840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 --2- 172.21.15.33:0/3605370194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f5430 0x7fc2840f5850 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 -- 172.21.15.33:0/3605370194 >> 172.21.15.33:0/3605370194 conn(0x7fc2840f0b90 msgr2=0x7fc2840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 -- 172.21.15.33:0/3605370194 shutdown_connections 2022-02-02T14:58:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.797+0000 7fc28a57c700 1 -- 172.21.15.33:0/3605370194 wait complete. 2022-02-02T14:58:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 Processor -- start 2022-02-02T14:58:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 -- start start 2022-02-02T14:58:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f5430 0x7fc284108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284109a40 con 0x7fc2840f66d0 2022-02-02T14:58:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28a57c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc284109b80 con 0x7fc2840f5430 2022-02-02T14:58:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc288d79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc288d79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35374/0 (socket says 172.21.15.33:35374) 2022-02-02T14:58:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc288d79700 1 -- 172.21.15.33:0/1676115715 learned_addr learned my addr 172.21.15.33:0/1676115715 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.798+0000 7fc28957a700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f5430 0x7fc284108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc288d79700 1 -- 172.21.15.33:0/1676115715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f5430 msgr2=0x7fc284108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc288d79700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f5430 0x7fc284108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc288d79700 1 -- 172.21.15.33:0/1676115715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280005040 con 0x7fc2840f66d0 2022-02-02T14:58:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc288d79700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fc2740026d0 tx=0x7fc274009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2740079c0 con 0x7fc2840f66d0 2022-02-02T14:58:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc27400f040 con 0x7fc2840f66d0 2022-02-02T14:58:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28410a520 con 0x7fc2840f66d0 2022-02-02T14:58:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2740148b0 con 0x7fc2840f66d0 2022-02-02T14:58:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.799+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28410aae0 con 0x7fc2840f66d0 2022-02-02T14:58:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.800+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc284045ad0 con 0x7fc2840f66d0 2022-02-02T14:58:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.801+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc274007b20 con 0x7fc2840f66d0 2022-02-02T14:58:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.801+0000 7fc279ffb700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 0x7fc2700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:09.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.801+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc274081950 con 0x7fc2840f66d0 2022-02-02T14:58:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.801+0000 7fc28957a700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 0x7fc2700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.802+0000 7fc28957a700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 0x7fc2700672e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc280004630 tx=0x7fc280009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:09.805+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc274053430 con 0x7fc2840f66d0 2022-02-02T14:58:10.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.017+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc28410b1d0 con 0x7fc2840f66d0 2022-02-02T14:58:10.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.018+0000 7fc279ffb700 1 -- 172.21.15.33:0/1676115715 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc274053020 con 0x7fc2840f66d0 2022-02-02T14:58:10.018 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:58:10.018 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:58:10.018 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:58:10.018 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:58:10.019 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:10.019 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:58:10.019 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:58:10.019 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:58:10.020 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:58:10.020 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:58:10.020 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:58:10.020 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:58:10.021 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:58:10.021 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:58:10.021 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:58:10.021 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:58:10.021 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:58:10.022 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:58:10.022 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:58:10.022 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:58:10.022 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:58:10.023 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:58:10.023 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:58:10.023 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:58:10.023 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:58:10.023 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:58:10.024 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:58:10.024 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:58:10.024 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:58:10.024 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:58:10.025 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:58:10.025 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:10.025 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:10.025 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:58:10.025 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:10.026 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:10.026 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:10.026 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:10.026 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 msgr2=0x7fc2700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 0x7fc2700672e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fc280004630 tx=0x7fc280009b30).stop 2022-02-02T14:58:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 msgr2=0x7fc284109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7fc2740026d0 tx=0x7fc274009de0).stop 2022-02-02T14:58:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 shutdown_connections 2022-02-02T14:58:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc270064e20 0x7fc2700672e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2840f5430 0x7fc284108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 --2- 172.21.15.33:0/1676115715 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2840f66d0 0x7fc284109490 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 >> 172.21.15.33:0/1676115715 conn(0x7fc2840f0b90 msgr2=0x7fc28405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.021+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 shutdown_connections 2022-02-02T14:58:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:10.022+0000 7fc28a57c700 1 -- 172.21.15.33:0/1676115715 wait complete. 2022-02-02T14:58:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:58:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:10 smithi033 ceph-mon[101165]: from='client.36514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:10 smithi033 ceph-mon[101165]: from='client.36518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:10.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:10 smithi033 ceph-mon[101165]: pgmap v2383: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:10.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2272661911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:58:10.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1676115715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:58:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:10 smithi037 ceph-mon[69017]: from='client.36514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:11.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:10 smithi037 ceph-mon[69017]: from='client.36518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:11.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:10 smithi037 ceph-mon[69017]: pgmap v2383: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:11.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2272661911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:58:11.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1676115715' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:58:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:12 smithi033 ceph-mon[101165]: pgmap v2384: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:13.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:12 smithi037 ceph-mon[69017]: pgmap v2384: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:13.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:13 smithi033 ceph-mon[101165]: pgmap v2385: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:14.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:13 smithi037 ceph-mon[69017]: pgmap v2385: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:16.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:16 smithi037 ceph-mon[69017]: pgmap v2386: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:16 smithi033 ceph-mon[101165]: pgmap v2386: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:18.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:18 smithi033 ceph-mon[101165]: pgmap v2387: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:19.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:18 smithi037 ceph-mon[69017]: pgmap v2387: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:20 smithi033 ceph-mon[101165]: pgmap v2388: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:21.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:20 smithi037 ceph-mon[69017]: pgmap v2388: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:22 smithi033 ceph-mon[101165]: pgmap v2389: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:23.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:22 smithi037 ceph-mon[69017]: pgmap v2389: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:24 smithi033 ceph-mon[101165]: pgmap v2390: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:25.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:24 smithi037 ceph-mon[69017]: pgmap v2390: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:26 smithi033 ceph-mon[101165]: pgmap v2391: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:27.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:26 smithi037 ceph-mon[69017]: pgmap v2391: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:28 smithi033 ceph-mon[101165]: pgmap v2392: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:29.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:28 smithi037 ceph-mon[69017]: pgmap v2392: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:30 smithi033 ceph-mon[101165]: pgmap v2393: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:31.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:30 smithi037 ceph-mon[69017]: pgmap v2393: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:32.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:32 smithi033 ceph-mon[101165]: pgmap v2394: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:32 smithi037 ceph-mon[69017]: pgmap v2394: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:34.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:34 smithi033 ceph-mon[101165]: pgmap v2395: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:35.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:34 smithi037 ceph-mon[69017]: pgmap v2395: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:36 smithi033 ceph-mon[101165]: pgmap v2396: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:37.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:36 smithi037 ceph-mon[69017]: pgmap v2396: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:38 smithi033 ceph-mon[101165]: pgmap v2397: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:39.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:38 smithi037 ceph-mon[69017]: pgmap v2397: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:40.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 -- 172.21.15.33:0/2694013746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f5430 msgr2=0x7f30380f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 --2- 172.21.15.33:0/2694013746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f5430 0x7f30380f5850 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f30300099e0 tx=0x7f3030004d10).stop 2022-02-02T14:58:40.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 -- 172.21.15.33:0/2694013746 shutdown_connections 2022-02-02T14:58:40.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 --2- 172.21.15.33:0/2694013746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f66d0 0x7f30380f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 --2- 172.21.15.33:0/2694013746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f5430 0x7f30380f5850 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 -- 172.21.15.33:0/2694013746 >> 172.21.15.33:0/2694013746 conn(0x7f30380f0b90 msgr2=0x7f30380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 -- 172.21.15.33:0/2694013746 shutdown_connections 2022-02-02T14:58:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.136+0000 7f303d344700 1 -- 172.21.15.33:0/2694013746 wait complete. 2022-02-02T14:58:40.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 Processor -- start 2022-02-02T14:58:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 -- start start 2022-02-02T14:58:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f5430 0x7f3038106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038107950 con 0x7f30380f66d0 2022-02-02T14:58:40.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f303d344700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038107a90 con 0x7f30380f5430 2022-02-02T14:58:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f30377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f30377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35382/0 (socket says 172.21.15.33:35382) 2022-02-02T14:58:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f30377fe700 1 -- 172.21.15.33:0/451183261 learned_addr learned my addr 172.21.15.33:0/451183261 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:40.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.137+0000 7f3037fff700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f5430 0x7f3038106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f30377fe700 1 -- 172.21.15.33:0/451183261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f5430 msgr2=0x7f3038106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f30377fe700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f5430 0x7f3038106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f30377fe700 1 -- 172.21.15.33:0/451183261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3030009640 con 0x7f30380f66d0 2022-02-02T14:58:40.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f30377fe700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f302800e7f0 tx=0x7f302800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30280092e0 con 0x7f30380f66d0 2022-02-02T14:58:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3038108430 con 0x7f30380f66d0 2022-02-02T14:58:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f302800f040 con 0x7f30380f66d0 2022-02-02T14:58:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3028014750 con 0x7f30380f66d0 2022-02-02T14:58:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.138+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30381089f0 con 0x7f30380f66d0 2022-02-02T14:58:40.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.140+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f302801b030 con 0x7f30380f66d0 2022-02-02T14:58:40.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.140+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3038045ad0 con 0x7f30380f66d0 2022-02-02T14:58:40.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.140+0000 7f3034ff9700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 0x7f30240672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.140+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f30280818a0 con 0x7f30380f66d0 2022-02-02T14:58:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.140+0000 7f3037fff700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 0x7f30240672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.141+0000 7f3037fff700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 0x7f30240672e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f303000b620 tx=0x7f3030015040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.145+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3028053430 con 0x7f30380f66d0 2022-02-02T14:58:40.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.332+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f303805fd30 con 0x7f3024064e20 2022-02-02T14:58:40.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.333+0000 7f3034ff9700 1 -- 172.21.15.33:0/451183261 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f303805fd30 con 0x7f3024064e20 2022-02-02T14:58:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 msgr2=0x7f30240672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 0x7f30240672e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f303000b620 tx=0x7f3030015040).stop 2022-02-02T14:58:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 msgr2=0x7f30381073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f302800e7f0 tx=0x7f302800b040).stop 2022-02-02T14:58:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 shutdown_connections 2022-02-02T14:58:40.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3024064e20 0x7f30240672e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30380f5430 0x7f3038106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 --2- 172.21.15.33:0/451183261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30380f66d0 0x7f30381073a0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 >> 172.21.15.33:0/451183261 conn(0x7f30380f0b90 msgr2=0x7f303805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 shutdown_connections 2022-02-02T14:58:40.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.335+0000 7f303d344700 1 -- 172.21.15.33:0/451183261 wait complete. 2022-02-02T14:58:40.344 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:58:40.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 -- 172.21.15.33:0/3468955091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 msgr2=0x7f8adc0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 --2- 172.21.15.33:0/3468955091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc0f7de0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f8ad0004660 tx=0x7f8ad0009b30).stop 2022-02-02T14:58:40.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 -- 172.21.15.33:0/3468955091 shutdown_connections 2022-02-02T14:58:40.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 --2- 172.21.15.33:0/3468955091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc0f7de0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 --2- 172.21.15.33:0/3468955091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 0x7f8adc0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 -- 172.21.15.33:0/3468955091 >> 172.21.15.33:0/3468955091 conn(0x7f8adc0f1e40 msgr2=0x7f8adc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 -- 172.21.15.33:0/3468955091 shutdown_connections 2022-02-02T14:58:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.436+0000 7f8ae2881700 1 -- 172.21.15.33:0/3468955091 wait complete. 2022-02-02T14:58:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 Processor -- start 2022-02-02T14:58:40.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 -- start start 2022-02-02T14:58:40.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 0x7f8adc109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc109c20 con 0x7f8adc0f7980 2022-02-02T14:58:40.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8ae2881700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8adc109d60 con 0x7f8adc0f66e0 2022-02-02T14:58:40.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35392/0 (socket says 172.21.15.33:35392) 2022-02-02T14:58:40.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.437+0000 7f8adb7fe700 1 -- 172.21.15.33:0/1940245602 learned_addr learned my addr 172.21.15.33:0/1940245602 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:40.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8adbfff700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 0x7f8adc109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8adb7fe700 1 -- 172.21.15.33:0/1940245602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 msgr2=0x7f8adc109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8adb7fe700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 0x7f8adc109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8adb7fe700 1 -- 172.21.15.33:0/1940245602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0005040 con 0x7f8adc0f7980 2022-02-02T14:58:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8adb7fe700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f8ad0009990 tx=0x7f8ad0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad0018070 con 0x7f8adc0f7980 2022-02-02T14:58:40.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8adc10a6a0 con 0x7f8adc0f7980 2022-02-02T14:58:40.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ad0007ba0 con 0x7f8adc0f7980 2022-02-02T14:58:40.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ad001c3c0 con 0x7f8adc0f7980 2022-02-02T14:58:40.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.438+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8adc10ac00 con 0x7f8adc0f7980 2022-02-02T14:58:40.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.439+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8adc045ad0 con 0x7f8adc0f7980 2022-02-02T14:58:40.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.440+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ad001d420 con 0x7f8adc0f7980 2022-02-02T14:58:40.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.440+0000 7f8ad8ff9700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 0x7f8ac4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.440+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ad0083700 con 0x7f8adc0f7980 2022-02-02T14:58:40.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.441+0000 7f8adbfff700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 0x7f8ac4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.441+0000 7f8adbfff700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 0x7f8ac4067290 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f8adc0f77e0 tx=0x7f8acc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.445+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ad0055240 con 0x7f8adc0f7980 2022-02-02T14:58:40.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.627+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8adc0fefb0 con 0x7f8ac4064dd0 2022-02-02T14:58:40.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.642+0000 7f8ad8ff9700 1 -- 172.21.15.33:0/1940245602 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8adc0fefb0 con 0x7f8ac4064dd0 2022-02-02T14:58:40.641 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:58:40.641 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (83m) 46m ago 84m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:58:40.642 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (77m) 46m ago 84m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:58:40.642 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (76m) 46m ago 84m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:58:40.642 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (83m) 46m ago 84m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:58:40.642 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (77m) 46m ago 81m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:58:40.643 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (78m) 46m ago 81m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:58:40.643 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (78m) 46m ago 81m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:58:40.643 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (81m) 46m ago 81m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:58:40.643 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (78m) 46m ago 86m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:58:40.644 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (78m) 46m ago 84m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:58:40.644 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (77m) 46m ago 86m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:58:40.644 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (77m) 46m ago 84m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:58:40.644 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (84m) 46m ago 84m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:58:40.645 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (84m) 46m ago 84m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:58:40.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 46m ago 83m - 4096M 2022-02-02T14:58:40.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (83m) 46m ago 83m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:58:40.645 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (83m) 46m ago 83m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:58:40.646 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (82m) 46m ago 82m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:58:40.646 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (82m) 46m ago 82m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:58:40.646 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (82m) 46m ago 82m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:58:40.646 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (83m) 46m ago 84m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:58:40.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.644+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 msgr2=0x7f8ac4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.644+0000 7f8ae2881700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 0x7f8ac4067290 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f8adc0f77e0 tx=0x7f8acc00b040).stop 2022-02-02T14:58:40.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.644+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 msgr2=0x7f8adc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.644+0000 7f8ae2881700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f8ad0009990 tx=0x7f8ad0009b30).stop 2022-02-02T14:58:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 shutdown_connections 2022-02-02T14:58:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8ac4064dd0 0x7f8ac4067290 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8adc0f66e0 0x7f8adc109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 --2- 172.21.15.33:0/1940245602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8adc0f7980 0x7f8adc109670 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 >> 172.21.15.33:0/1940245602 conn(0x7f8adc0f1e40 msgr2=0x7f8adc06a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 shutdown_connections 2022-02-02T14:58:40.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.645+0000 7f8ae2881700 1 -- 172.21.15.33:0/1940245602 wait complete. 2022-02-02T14:58:40.739 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:40 smithi033 ceph-mon[101165]: pgmap v2398: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:40.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 -- 172.21.15.33:0/4288904104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f5430 msgr2=0x7fe01c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 --2- 172.21.15.33:0/4288904104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f5430 0x7fe01c0f5850 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7fe00c004660 tx=0x7fe00c009b30).stop 2022-02-02T14:58:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 -- 172.21.15.33:0/4288904104 shutdown_connections 2022-02-02T14:58:40.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 --2- 172.21.15.33:0/4288904104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f66d0 0x7fe01c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 --2- 172.21.15.33:0/4288904104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f5430 0x7fe01c0f5850 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 -- 172.21.15.33:0/4288904104 >> 172.21.15.33:0/4288904104 conn(0x7fe01c0f0b90 msgr2=0x7fe01c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 -- 172.21.15.33:0/4288904104 shutdown_connections 2022-02-02T14:58:40.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.746+0000 7fe020c31700 1 -- 172.21.15.33:0/4288904104 wait complete. 2022-02-02T14:58:40.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 Processor -- start 2022-02-02T14:58:40.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 -- start start 2022-02-02T14:58:40.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f5430 0x7fe01c105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c106760 con 0x7fe01c0f66d0 2022-02-02T14:58:40.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe020c31700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c106f60 con 0x7fe01c0f5430 2022-02-02T14:58:40.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe01affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe01affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35402/0 (socket says 172.21.15.33:35402) 2022-02-02T14:58:40.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe01affd700 1 -- 172.21.15.33:0/214113427 learned_addr learned my addr 172.21.15.33:0/214113427 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:40.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.747+0000 7fe01b7fe700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f5430 0x7fe01c105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe01affd700 1 -- 172.21.15.33:0/214113427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f5430 msgr2=0x7fe01c105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe01affd700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f5430 0x7fe01c105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe01affd700 1 -- 172.21.15.33:0/214113427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c005040 con 0x7fe01c0f66d0 2022-02-02T14:58:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe01affd700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fe010002700 tx=0x7fe010009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe010009320 con 0x7fe01c0f66d0 2022-02-02T14:58:40.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c107240 con 0x7fe01c0f66d0 2022-02-02T14:58:40.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe01000f040 con 0x7fe01c0f66d0 2022-02-02T14:58:40.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe010014870 con 0x7fe01c0f66d0 2022-02-02T14:58:40.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.748+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c107800 con 0x7fe01c0f66d0 2022-02-02T14:58:40.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.749+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c059100 con 0x7fe01c0f66d0 2022-02-02T14:58:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.750+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe010009480 con 0x7fe01c0f66d0 2022-02-02T14:58:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.750+0000 7fe003fff700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 0x7fe0040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.750+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe010081d50 con 0x7fe01c0f66d0 2022-02-02T14:58:40.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.750+0000 7fe01b7fe700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 0x7fe0040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:40.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.751+0000 7fe01b7fe700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 0x7fe0040672e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe00c004630 tx=0x7fe00c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:40.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.754+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe010053830 con 0x7fe01c0f66d0 2022-02-02T14:58:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.996+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe01c045ad0 con 0x7fe01c0f66d0 2022-02-02T14:58:40.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.997+0000 7fe003fff700 1 -- 172.21.15.33:0/214113427 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe010053420 con 0x7fe01c0f66d0 2022-02-02T14:58:40.997 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:58:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:58:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:58:40.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:58:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:58:40.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:58:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:58:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:58:40.999 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:58:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:58:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:58:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:58:41.000 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:58:41.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:58:41.001 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:58:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 msgr2=0x7fe0040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 0x7fe0040672e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fe00c004630 tx=0x7fe00c009b30).stop 2022-02-02T14:58:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 msgr2=0x7fe01c1061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 rx=0x7fe010002700 tx=0x7fe010009e00).stop 2022-02-02T14:58:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 shutdown_connections 2022-02-02T14:58:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe004064e20 0x7fe0040672e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe01c0f5430 0x7fe01c105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 --2- 172.21.15.33:0/214113427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01c0f66d0 0x7fe01c1061b0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 >> 172.21.15.33:0/214113427 conn(0x7fe01c0f0b90 msgr2=0x7fe01c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:41.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 shutdown_connections 2022-02-02T14:58:41.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:40.999+0000 7fe020c31700 1 -- 172.21.15.33:0/214113427 wait complete. 2022-02-02T14:58:41.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:40 smithi037 ceph-mon[69017]: pgmap v2398: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:41.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.100+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/1328391084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 msgr2=0x7fbf180f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.100+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/1328391084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf180f5850 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7fbf14004660 tx=0x7fbf14009b30).stop 2022-02-02T14:58:41.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/1328391084 shutdown_connections 2022-02-02T14:58:41.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/1328391084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 0x7fbf180f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/1328391084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf180f5850 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/1328391084 >> 172.21.15.33:0/1328391084 conn(0x7fbf180f0b90 msgr2=0x7fbf180f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/1328391084 shutdown_connections 2022-02-02T14:58:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/1328391084 wait complete. 2022-02-02T14:58:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 Processor -- start 2022-02-02T14:58:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- start start 2022-02-02T14:58:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:41.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 0x7fbf18107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf18107880 con 0x7fbf180f5430 2022-02-02T14:58:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.101+0000 7fbf1f0a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf181080c0 con 0x7fbf180f66d0 2022-02-02T14:58:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35410/0 (socket says 172.21.15.33:35410) 2022-02-02T14:58:41.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 -- 172.21.15.33:0/3110318546 learned_addr learned my addr 172.21.15.33:0/3110318546 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:58:41.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1d89d700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 0x7fbf18107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:41.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 -- 172.21.15.33:0/3110318546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 msgr2=0x7fbf18107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 0x7fbf18107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 -- 172.21.15.33:0/3110318546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf14005040 con 0x7fbf180f5430 2022-02-02T14:58:41.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1e09e700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fbf14014040 tx=0x7fbf1400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:41.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf14019070 con 0x7fbf180f5430 2022-02-02T14:58:41.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbf14007e70 con 0x7fbf180f5430 2022-02-02T14:58:41.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf18108340 con 0x7fbf180f5430 2022-02-02T14:58:41.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf14014d10 con 0x7fbf180f5430 2022-02-02T14:58:41.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.102+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf18108820 con 0x7fbf180f5430 2022-02-02T14:58:41.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.103+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf18059100 con 0x7fbf180f5430 2022-02-02T14:58:41.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.104+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbf14025070 con 0x7fbf180f5430 2022-02-02T14:58:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.104+0000 7fbf0effd700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 0x7fbf040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:58:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.104+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbf14082a90 con 0x7fbf180f5430 2022-02-02T14:58:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.104+0000 7fbf1d89d700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 0x7fbf040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:58:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.105+0000 7fbf1d89d700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 0x7fbf040672e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fbf18106b20 tx=0x7fbf0800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:58:41.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.108+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbf14050b40 con 0x7fbf180f5430 2022-02-02T14:58:41.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.320+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbf1810d300 con 0x7fbf180f5430 2022-02-02T14:58:41.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.321+0000 7fbf0effd700 1 -- 172.21.15.33:0/3110318546 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fbf14023070 con 0x7fbf180f5430 2022-02-02T14:58:41.321 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:58:41.321 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:58:41.321 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:58:41.322 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:58:41.322 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:41.322 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:58:41.322 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:58:41.323 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:58:41.323 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:58:41.323 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:58:41.323 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:58:41.324 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:58:41.324 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:58:41.324 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:58:41.324 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:58:41.324 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:58:41.325 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:58:41.325 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:58:41.325 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:58:41.325 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:58:41.326 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:58:41.326 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:58:41.326 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:58:41.326 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:58:41.327 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:58:41.327 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:58:41.327 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:58:41.327 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:58:41.327 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:58:41.328 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:58:41.328 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:58:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:41.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:58:41.329 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:58:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:41.329 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:41.330 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:58:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 msgr2=0x7fbf040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 0x7fbf040672e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fbf18106b20 tx=0x7fbf0800b040).stop 2022-02-02T14:58:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 msgr2=0x7fbf18106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:58:41.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fbf14014040 tx=0x7fbf1400b040).stop 2022-02-02T14:58:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 shutdown_connections 2022-02-02T14:58:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbf04064e20 0x7fbf040672e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf180f5430 0x7fbf18106d90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 --2- 172.21.15.33:0/3110318546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180f66d0 0x7fbf18107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:58:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 >> 172.21.15.33:0/3110318546 conn(0x7fbf180f0b90 msgr2=0x7fbf1805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:58:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 shutdown_connections 2022-02-02T14:58:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:58:41.323+0000 7fbf1f0a0700 1 -- 172.21.15.33:0/3110318546 wait complete. 2022-02-02T14:58:41.333 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:58:41.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:41 smithi033 ceph-mon[101165]: from='client.36530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:41 smithi033 ceph-mon[101165]: from='client.36534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/214113427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:58:41.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3110318546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:58:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:41 smithi037 ceph-mon[69017]: from='client.36530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:41 smithi037 ceph-mon[69017]: from='client.36534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:58:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/214113427' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:58:42.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3110318546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:58:42.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:42 smithi033 ceph-mon[101165]: pgmap v2399: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:43.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:42 smithi037 ceph-mon[69017]: pgmap v2399: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:44 smithi033 ceph-mon[101165]: pgmap v2400: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:44 smithi037 ceph-mon[69017]: pgmap v2400: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:46.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:46 smithi033 ceph-mon[101165]: pgmap v2401: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:47.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:46 smithi037 ceph-mon[69017]: pgmap v2401: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:47.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:47 smithi037 ceph-mon[69017]: pgmap v2402: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:47.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:47 smithi033 ceph-mon[101165]: pgmap v2402: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:50.790 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:50 smithi037 ceph-mon[69017]: pgmap v2403: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:50.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:50 smithi033 ceph-mon[101165]: pgmap v2403: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:52.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:52 smithi033 ceph-mon[101165]: pgmap v2404: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:53.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:52 smithi037 ceph-mon[69017]: pgmap v2404: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:54 smithi033 ceph-mon[101165]: pgmap v2405: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:54.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:58:54.991 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:58:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:54 smithi037 ceph-mon[69017]: pgmap v2405: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:55.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:58:55.041 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:58:56.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:56 smithi033 ceph-mon[101165]: pgmap v2406: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:57.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:56 smithi037 ceph-mon[69017]: pgmap v2406: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:58.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:58:58 smithi033 ceph-mon[101165]: pgmap v2407: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:58:59.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:58:58 smithi037 ceph-mon[69017]: pgmap v2407: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:00 smithi033 ceph-mon[101165]: pgmap v2408: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:01.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:00 smithi037 ceph-mon[69017]: pgmap v2408: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:02.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:02 smithi033 ceph-mon[101165]: pgmap v2409: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:03.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:02 smithi037 ceph-mon[69017]: pgmap v2409: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:04.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:04 smithi033 ceph-mon[101165]: pgmap v2410: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:05.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:04 smithi037 ceph-mon[69017]: pgmap v2410: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:06.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:06 smithi033 ceph-mon[101165]: pgmap v2411: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:07.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:06 smithi037 ceph-mon[69017]: pgmap v2411: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:08.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:08 smithi033 ceph-mon[101165]: pgmap v2412: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:09.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:08 smithi037 ceph-mon[69017]: pgmap v2412: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:10.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:10 smithi033 ceph-mon[101165]: pgmap v2413: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:11.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:10 smithi037 ceph-mon[69017]: pgmap v2413: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:11.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 -- 172.21.15.33:0/3390150654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f55c0 msgr2=0x7fa8500f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 --2- 172.21.15.33:0/3390150654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f55c0 0x7fa8500f59e0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7fa844004660 tx=0x7fa844009b30).stop 2022-02-02T14:59:11.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 -- 172.21.15.33:0/3390150654 shutdown_connections 2022-02-02T14:59:11.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 --2- 172.21.15.33:0/3390150654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f6860 0x7fa8500f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 --2- 172.21.15.33:0/3390150654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f55c0 0x7fa8500f59e0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 -- 172.21.15.33:0/3390150654 >> 172.21.15.33:0/3390150654 conn(0x7fa8500f0d40 msgr2=0x7fa8500f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 -- 172.21.15.33:0/3390150654 shutdown_connections 2022-02-02T14:59:11.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.438+0000 7fa856e11700 1 -- 172.21.15.33:0/3390150654 wait complete. 2022-02-02T14:59:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 Processor -- start 2022-02-02T14:59:11.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 -- start start 2022-02-02T14:59:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f55c0 0x7fa850105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa850106950 con 0x7fa8500f6860 2022-02-02T14:59:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.439+0000 7fa856e11700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa850107160 con 0x7fa8500f55c0 2022-02-02T14:59:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35422/0 (socket says 172.21.15.33:35422) 2022-02-02T14:59:11.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 -- 172.21.15.33:0/1442552123 learned_addr learned my addr 172.21.15.33:0/1442552123 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa854bad700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f55c0 0x7fa850105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 -- 172.21.15.33:0/1442552123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f55c0 msgr2=0x7fa850105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f55c0 0x7fa850105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 -- 172.21.15.33:0/1442552123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa844005040 con 0x7fa8500f6860 2022-02-02T14:59:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84ffff700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fa83c010a00 tx=0x7fa83c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83c0094c0 con 0x7fa8500f6860 2022-02-02T14:59:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa83c010e90 con 0x7fa8500f6860 2022-02-02T14:59:11.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa850107380 con 0x7fa8500f6860 2022-02-02T14:59:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa83c007db0 con 0x7fa8500f6860 2022-02-02T14:59:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.440+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa850107910 con 0x7fa8500f6860 2022-02-02T14:59:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.441+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa850045ad0 con 0x7fa8500f6860 2022-02-02T14:59:11.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.442+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa83c022070 con 0x7fa8500f6860 2022-02-02T14:59:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.443+0000 7fa84d7fa700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 0x7fa840067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.443+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa83c0843a0 con 0x7fa8500f6860 2022-02-02T14:59:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.443+0000 7fa854bad700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 0x7fa840067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.443+0000 7fa854bad700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 0x7fa840067290 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa844000c00 tx=0x7fa844016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:11.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.446+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa83c052450 con 0x7fa8500f6860 2022-02-02T14:59:11.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.635+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8500ff910 con 0x7fa840064dd0 2022-02-02T14:59:11.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.636+0000 7fa84d7fa700 1 -- 172.21.15.33:0/1442552123 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa8500ff910 con 0x7fa840064dd0 2022-02-02T14:59:11.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 msgr2=0x7fa840067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 0x7fa840067290 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa844000c00 tx=0x7fa844016040).stop 2022-02-02T14:59:11.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 msgr2=0x7fa850106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7fa83c010a00 tx=0x7fa83c00b040).stop 2022-02-02T14:59:11.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 shutdown_connections 2022-02-02T14:59:11.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa840064dd0 0x7fa840067290 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8500f55c0 0x7fa850105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 --2- 172.21.15.33:0/1442552123 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8500f6860 0x7fa850106350 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 >> 172.21.15.33:0/1442552123 conn(0x7fa8500f0d40 msgr2=0x7fa8500fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:11.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 shutdown_connections 2022-02-02T14:59:11.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.638+0000 7fa856e11700 1 -- 172.21.15.33:0/1442552123 wait complete. 2022-02-02T14:59:11.647 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:59:11.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 -- 172.21.15.33:0/2430406384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c0f9830 msgr2=0x7f1f7c0fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 --2- 172.21.15.33:0/2430406384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c0fbc80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 rx=0x7f1f70004660 tx=0x7f1f70009b30).stop 2022-02-02T14:59:11.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 -- 172.21.15.33:0/2430406384 shutdown_connections 2022-02-02T14:59:11.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 --2- 172.21.15.33:0/2430406384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c0fbc80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 --2- 172.21.15.33:0/2430406384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c060270 0x7f1f7c0f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 -- 172.21.15.33:0/2430406384 >> 172.21.15.33:0/2430406384 conn(0x7f1f7c0f0d40 msgr2=0x7f1f7c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:11.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.741+0000 7f1f82417700 1 -- 172.21.15.33:0/2430406384 shutdown_connections 2022-02-02T14:59:11.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.742+0000 7f1f82417700 1 -- 172.21.15.33:0/2430406384 wait complete. 2022-02-02T14:59:11.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.742+0000 7f1f82417700 1 Processor -- start 2022-02-02T14:59:11.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f82417700 1 -- start start 2022-02-02T14:59:11.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f82417700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f82417700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f82417700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c109bd0 con 0x7f1f7c060270 2022-02-02T14:59:11.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f82417700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7c109d10 con 0x7f1f7c0f9830 2022-02-02T14:59:11.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35430/0 (socket says 172.21.15.33:35430) 2022-02-02T14:59:11.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 -- 172.21.15.33:0/2724536436 learned_addr learned my addr 172.21.15.33:0/2724536436 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:11.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7b7fe700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 -- 172.21.15.33:0/2724536436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c0f9830 msgr2=0x7f1f7c109620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c109620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.743+0000 7f1f7bfff700 1 -- 172.21.15.33:0/2724536436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70005040 con 0x7f1f7c060270 2022-02-02T14:59:11.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f7bfff700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1f6c0026d0 tx=0x7f1f6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:11.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6c009320 con 0x7f1f7c060270 2022-02-02T14:59:11.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f6c00f040 con 0x7f1f7c060270 2022-02-02T14:59:11.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f7c10a6b0 con 0x7f1f7c060270 2022-02-02T14:59:11.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f6c0147e0 con 0x7f1f7c060270 2022-02-02T14:59:11.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.744+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f7c10ac70 con 0x7f1f7c060270 2022-02-02T14:59:11.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.745+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7c045ad0 con 0x7f1f7c060270 2022-02-02T14:59:11.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.745+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f6c009480 con 0x7f1f7c060270 2022-02-02T14:59:11.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.746+0000 7f1f78ff9700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 0x7f1f64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:11.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.746+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1f6c0820e0 con 0x7f1f7c060270 2022-02-02T14:59:11.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.746+0000 7f1f7b7fe700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 0x7f1f64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:11.752 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.746+0000 7f1f7b7fe700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 0x7f1f64067290 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f1f70004630 tx=0x7f1f70009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.750+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f6c053bc0 con 0x7f1f7c060270 2022-02-02T14:59:11.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.932+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f7c0f6c10 con 0x7f1f64064dd0 2022-02-02T14:59:11.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.946+0000 7f1f78ff9700 1 -- 172.21.15.33:0/2724536436 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f1f70019040 con 0x7f1f64064dd0 2022-02-02T14:59:11.945 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:59:11.946 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (84m) 46m ago 85m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:59:11.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (77m) 46m ago 85m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:59:11.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (77m) 46m ago 84m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:59:11.946 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (84m) 46m ago 85m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:59:11.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (78m) 46m ago 81m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:59:11.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (78m) 46m ago 81m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:59:11.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (79m) 46m ago 81m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:59:11.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (81m) 46m ago 81m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:59:11.948 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (79m) 46m ago 86m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:59:11.948 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (78m) 46m ago 84m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:59:11.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (78m) 46m ago 86m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:59:11.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (78m) 46m ago 84m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:59:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (85m) 46m ago 85m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:59:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (84m) 46m ago 84m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:59:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 46m ago 84m - 4096M 2022-02-02T14:59:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (83m) 46m ago 83m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:59:11.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (83m) 46m ago 83m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:59:11.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (83m) 46m ago 83m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:59:11.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (83m) 46m ago 83m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:59:11.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (82m) 46m ago 82m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:59:11.950 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (84m) 46m ago 85m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:59:11.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 msgr2=0x7f1f64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 0x7f1f64067290 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f1f70004630 tx=0x7f1f70009b30).stop 2022-02-02T14:59:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 msgr2=0x7f1f7c109130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1f6c0026d0 tx=0x7f1f6c009de0).stop 2022-02-02T14:59:11.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 shutdown_connections 2022-02-02T14:59:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f64064dd0 0x7f1f64067290 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f7c060270 0x7f1f7c109130 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 --2- 172.21.15.33:0/2724536436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f7c0f9830 0x7f1f7c109620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:11.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 >> 172.21.15.33:0/2724536436 conn(0x7f1f7c0f0d40 msgr2=0x7f1f7c0f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 shutdown_connections 2022-02-02T14:59:11.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:11.948+0000 7f1f82417700 1 -- 172.21.15.33:0/2724536436 wait complete. 2022-02-02T14:59:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 -- 172.21.15.33:0/736070741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6530 msgr2=0x7fedf00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 --2- 172.21.15.33:0/736070741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6530 0x7fedf00f6950 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7fede0004660 tx=0x7fede0009b30).stop 2022-02-02T14:59:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 -- 172.21.15.33:0/736070741 shutdown_connections 2022-02-02T14:59:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 --2- 172.21.15.33:0/736070741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f77d0 0x7fedf00f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 --2- 172.21.15.33:0/736070741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f6530 0x7fedf00f6950 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 -- 172.21.15.33:0/736070741 >> 172.21.15.33:0/736070741 conn(0x7fedf00f1c90 msgr2=0x7fedf00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 -- 172.21.15.33:0/736070741 shutdown_connections 2022-02-02T14:59:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.048+0000 7fedf4837700 1 -- 172.21.15.33:0/736070741 wait complete. 2022-02-02T14:59:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 Processor -- start 2022-02-02T14:59:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 -- start start 2022-02-02T14:59:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6530 0x7fedf0106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0107870 con 0x7fedf00f77d0 2022-02-02T14:59:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.049+0000 7fedf4837700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0108080 con 0x7fedf00f6530 2022-02-02T14:59:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35442/0 (socket says 172.21.15.33:35442) 2022-02-02T14:59:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 -- 172.21.15.33:0/3936696896 learned_addr learned my addr 172.21.15.33:0/3936696896 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedef7fe700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6530 0x7fedf0106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 -- 172.21.15.33:0/3936696896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6530 msgr2=0x7fedf0106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6530 0x7fedf0106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 -- 172.21.15.33:0/3936696896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede0005040 con 0x7fedf00f77d0 2022-02-02T14:59:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedeeffd700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fede400e7f0 tx=0x7fede400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede40092e0 con 0x7fedf00f77d0 2022-02-02T14:59:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf0108300 con 0x7fedf00f77d0 2022-02-02T14:59:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fede400f040 con 0x7fedf00f77d0 2022-02-02T14:59:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.050+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fede4014750 con 0x7fedf00f77d0 2022-02-02T14:59:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.051+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf01088c0 con 0x7fedf00f77d0 2022-02-02T14:59:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.052+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf0059100 con 0x7fedf00f77d0 2022-02-02T14:59:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.052+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fede401b030 con 0x7fedf00f77d0 2022-02-02T14:59:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.052+0000 7fedd7fff700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 0x7fedd80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.053+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fede4081840 con 0x7fedf00f77d0 2022-02-02T14:59:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.053+0000 7fedef7fe700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 0x7fedd80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.053+0000 7fedef7fe700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 0x7fedd80672e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fede0000c00 tx=0x7fede0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.057+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fede404f8e0 con 0x7fedf00f77d0 2022-02-02T14:59:12.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.300+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fedf00fee80 con 0x7fedf00f77d0 2022-02-02T14:59:12.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.301+0000 7fedd7fff700 1 -- 172.21.15.33:0/3936696896 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fedf00fee80 con 0x7fedf00f77d0 2022-02-02T14:59:12.300 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:59:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:59:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:59:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:12.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:59:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:59:12.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:59:12.303 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:59:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:59:12.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:59:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:59:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:59:12.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:59:12.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:59:12.306 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:59:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 msgr2=0x7fedd80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 0x7fedd80672e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fede0000c00 tx=0x7fede0016040).stop 2022-02-02T14:59:12.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 msgr2=0x7fedf0107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7fede400e7f0 tx=0x7fede400b040).stop 2022-02-02T14:59:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 shutdown_connections 2022-02-02T14:59:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd8064e20 0x7fedd80672e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf00f6530 0x7fedf0106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 --2- 172.21.15.33:0/3936696896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fedf00f77d0 0x7fedf0107270 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 >> 172.21.15.33:0/3936696896 conn(0x7fedf00f1c90 msgr2=0x7fedf00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 shutdown_connections 2022-02-02T14:59:12.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.303+0000 7fedf4837700 1 -- 172.21.15.33:0/3936696896 wait complete. 2022-02-02T14:59:12.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 -- 172.21.15.33:0/554121881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f5430 msgr2=0x7f1f8c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 --2- 172.21.15.33:0/554121881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c0f5850 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f1f88004660 tx=0x7f1f88009b30).stop 2022-02-02T14:59:12.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 -- 172.21.15.33:0/554121881 shutdown_connections 2022-02-02T14:59:12.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 --2- 172.21.15.33:0/554121881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 --2- 172.21.15.33:0/554121881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c0f5850 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.403+0000 7f1f920ba700 1 -- 172.21.15.33:0/554121881 >> 172.21.15.33:0/554121881 conn(0x7f1f8c0f0b90 msgr2=0x7f1f8c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 -- 172.21.15.33:0/554121881 shutdown_connections 2022-02-02T14:59:12.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 -- 172.21.15.33:0/554121881 wait complete. 2022-02-02T14:59:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 Processor -- start 2022-02-02T14:59:12.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 -- start start 2022-02-02T14:59:12.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0603c0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f920ba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c060500 con 0x7f1f8c0f5430 2022-02-02T14:59:12.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.404+0000 7f1f908b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35452/0 (socket says 172.21.15.33:35452) 2022-02-02T14:59:12.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 -- 172.21.15.33:0/4020668447 learned_addr learned my addr 172.21.15.33:0/4020668447 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:12.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f910b8700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 -- 172.21.15.33:0/4020668447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f5430 msgr2=0x7f1f8c109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 -- 172.21.15.33:0/4020668447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88005040 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f908b7700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f1f7c00e7f0 tx=0x7f1f7c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:12.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f7c0092e0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f7c00f040 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f7c014750 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c10c4f0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.405+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c10ca80 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.406+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c059100 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.407+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f7c01b030 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.407+0000 7f1f81ffb700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 0x7f1f780672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.407+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1f7c081850 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.407+0000 7f1f910b8700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 0x7f1f780672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.408+0000 7f1f910b8700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 0x7f1f780672e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f1f88000c00 tx=0x7f1f8800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.411+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f7c04f9b0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.623+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1f8c045ad0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.624+0000 7f1f81ffb700 1 -- 172.21.15.33:0/4020668447 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1f7c052fd0 con 0x7f1f8c0f66d0 2022-02-02T14:59:12.623 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:59:12.623 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:59:12.624 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:59:12.624 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:59:12.624 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:12.624 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:59:12.624 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:59:12.625 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:59:12.625 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:59:12.625 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:59:12.625 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:59:12.626 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:59:12.626 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:59:12.626 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:59:12.626 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:59:12.627 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:59:12.627 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:59:12.627 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:59:12.627 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:59:12.627 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:59:12.628 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:59:12.628 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:59:12.628 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:59:12.628 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:59:12.628 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:59:12.629 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:59:12.629 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:59:12.629 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:59:12.629 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:59:12.629 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:59:12.630 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:59:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:12.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:12.631 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:59:12.631 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:12.631 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:12.631 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:12.632 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:12.632 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:12.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.625+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 msgr2=0x7f1f780672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.625+0000 7f1f920ba700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 0x7f1f780672e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f1f88000c00 tx=0x7f1f8800b040).stop 2022-02-02T14:59:12.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.625+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 msgr2=0x7f1f8c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:12.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.625+0000 7f1f920ba700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 rx=0x7f1f7c00e7f0 tx=0x7f1f7c00b040).stop 2022-02-02T14:59:12.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 shutdown_connections 2022-02-02T14:59:12.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f78064e20 0x7f1f780672e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f8c0f5430 0x7f1f8c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 --2- 172.21.15.33:0/4020668447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f8c0f66d0 0x7f1f8c10bf40 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:12.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 >> 172.21.15.33:0/4020668447 conn(0x7f1f8c0f0b90 msgr2=0x7f1f8c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:12.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 shutdown_connections 2022-02-02T14:59:12.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:12.626+0000 7f1f920ba700 1 -- 172.21.15.33:0/4020668447 wait complete. 2022-02-02T14:59:12.635 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:59:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:12 smithi033 ceph-mon[101165]: pgmap v2414: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:12.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:12 smithi033 ceph-mon[101165]: from='client.36546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:12.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3936696896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:59:12.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4020668447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:59:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:12 smithi037 ceph-mon[69017]: pgmap v2414: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:12 smithi037 ceph-mon[69017]: from='client.36546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3936696896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:59:13.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4020668447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:59:13.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:13 smithi033 ceph-mon[101165]: from='client.36550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:14.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:13 smithi037 ceph-mon[69017]: from='client.36550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:14.992 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:14 smithi033 ceph-mon[101165]: pgmap v2415: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:15.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:14 smithi037 ceph-mon[69017]: pgmap v2415: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:16.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:16 smithi033 ceph-mon[101165]: pgmap v2416: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:17.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:16 smithi037 ceph-mon[69017]: pgmap v2416: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:17.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:17 smithi037 ceph-mon[69017]: pgmap v2417: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:17.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:17 smithi033 ceph-mon[101165]: pgmap v2417: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:20.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:20 smithi037 ceph-mon[69017]: pgmap v2418: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:20.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:20 smithi033 ceph-mon[101165]: pgmap v2418: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:22.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:22 smithi033 ceph-mon[101165]: pgmap v2419: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:23.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:22 smithi037 ceph-mon[69017]: pgmap v2419: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:24.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:24 smithi033 ceph-mon[101165]: pgmap v2420: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:25.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:24 smithi037 ceph-mon[69017]: pgmap v2420: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:26.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:26 smithi033 ceph-mon[101165]: pgmap v2421: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:27.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:26 smithi037 ceph-mon[69017]: pgmap v2421: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:28.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:28 smithi033 ceph-mon[101165]: pgmap v2422: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:29.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:28 smithi037 ceph-mon[69017]: pgmap v2422: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:30.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:30 smithi033 ceph-mon[101165]: pgmap v2423: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:31.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:30 smithi037 ceph-mon[69017]: pgmap v2423: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:32.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:32 smithi033 ceph-mon[101165]: pgmap v2424: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:33.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:32 smithi037 ceph-mon[69017]: pgmap v2424: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:34.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:34 smithi033 ceph-mon[101165]: pgmap v2425: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:35.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:34 smithi037 ceph-mon[69017]: pgmap v2425: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:36.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:36 smithi033 ceph-mon[101165]: pgmap v2426: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:37.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:36 smithi037 ceph-mon[69017]: pgmap v2426: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:38.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:38 smithi033 ceph-mon[101165]: pgmap v2427: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:39.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:38 smithi037 ceph-mon[69017]: pgmap v2427: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:40.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:40 smithi033 ceph-mon[101165]: pgmap v2428: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:41.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:40 smithi037 ceph-mon[69017]: pgmap v2428: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:42.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- 172.21.15.33:0/2452485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 msgr2=0x7f71840f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2452485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f71840f6b30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f7174004660 tx=0x7f7174009b30).stop 2022-02-02T14:59:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- 172.21.15.33:0/2452485263 shutdown_connections 2022-02-02T14:59:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2452485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f71840f6b30 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2452485263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 0x7f71840f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- 172.21.15.33:0/2452485263 >> 172.21.15.33:0/2452485263 conn(0x7f71840f0b90 msgr2=0x7f71840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- 172.21.15.33:0/2452485263 shutdown_connections 2022-02-02T14:59:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- 172.21.15.33:0/2452485263 wait complete. 2022-02-02T14:59:42.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 Processor -- start 2022-02-02T14:59:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.742+0000 7f718a1a2700 1 -- start start 2022-02-02T14:59:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718a1a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 0x7f7184106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718a1a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718a1a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7184107870 con 0x7f71840f66d0 2022-02-02T14:59:42.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718a1a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71841080b0 con 0x7f71840f5430 2022-02-02T14:59:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35462/0 (socket says 172.21.15.33:35462) 2022-02-02T14:59:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 -- 172.21.15.33:0/2133752576 learned_addr learned my addr 172.21.15.33:0/2133752576 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:42.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f71891a0700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 0x7f7184106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 -- 172.21.15.33:0/2133752576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 msgr2=0x7f7184106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 0x7f7184106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 -- 172.21.15.33:0/2133752576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174005040 con 0x7f71840f66d0 2022-02-02T14:59:42.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.743+0000 7f718899f700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f7174009990 tx=0x7f7174009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.744+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7174018070 con 0x7f71840f66d0 2022-02-02T14:59:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.744+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7174007ba0 con 0x7f71840f66d0 2022-02-02T14:59:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.744+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717401c3c0 con 0x7f71840f66d0 2022-02-02T14:59:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.744+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7184108330 con 0x7f71840f66d0 2022-02-02T14:59:42.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.744+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7184108810 con 0x7f71840f66d0 2022-02-02T14:59:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.745+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7184059100 con 0x7f71840f66d0 2022-02-02T14:59:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.745+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f717401d420 con 0x7f71840f66d0 2022-02-02T14:59:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.746+0000 7f7179ffb700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 0x7f71700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:42.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.746+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7174083790 con 0x7f71840f66d0 2022-02-02T14:59:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.746+0000 7f71891a0700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 0x7f71700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.747+0000 7f71891a0700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 0x7f71700672e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7184107b40 tx=0x7f7180009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:42.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.750+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f71740518a0 con 0x7f71840f66d0 2022-02-02T14:59:42.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.941+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71840fab10 con 0x7f7170064e20 2022-02-02T14:59:42.941 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:42 smithi033 ceph-mon[101165]: pgmap v2429: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:42.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.943+0000 7f7179ffb700 1 -- 172.21.15.33:0/2133752576 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f71840fab10 con 0x7f7170064e20 2022-02-02T14:59:42.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 msgr2=0x7f71700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 0x7f71700672e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f7184107b40 tx=0x7f7180009c00).stop 2022-02-02T14:59:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 msgr2=0x7f7184107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f7174009990 tx=0x7f7174009b30).stop 2022-02-02T14:59:42.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 shutdown_connections 2022-02-02T14:59:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7170064e20 0x7f71700672e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71840f5430 0x7f7184106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 --2- 172.21.15.33:0/2133752576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71840f66d0 0x7f7184107270 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 >> 172.21.15.33:0/2133752576 conn(0x7f71840f0b90 msgr2=0x7f718405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 shutdown_connections 2022-02-02T14:59:42.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:42.945+0000 7f718a1a2700 1 -- 172.21.15.33:0/2133752576 wait complete. 2022-02-02T14:59:42.953 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T14:59:43.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:42 smithi037 ceph-mon[69017]: pgmap v2429: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:43.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 -- 172.21.15.33:0/3454011305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f77d0 msgr2=0x7fd0480f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 --2- 172.21.15.33:0/3454011305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f77d0 0x7fd0480f7c30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 rx=0x7fd038004660 tx=0x7fd038009b30).stop 2022-02-02T14:59:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 -- 172.21.15.33:0/3454011305 shutdown_connections 2022-02-02T14:59:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 --2- 172.21.15.33:0/3454011305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f77d0 0x7fd0480f7c30 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 --2- 172.21.15.33:0/3454011305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f6530 0x7fd0480f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 -- 172.21.15.33:0/3454011305 >> 172.21.15.33:0/3454011305 conn(0x7fd0480f1c90 msgr2=0x7fd0480f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 -- 172.21.15.33:0/3454011305 shutdown_connections 2022-02-02T14:59:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.046+0000 7fd047fff700 1 -- 172.21.15.33:0/3454011305 wait complete. 2022-02-02T14:59:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 Processor -- start 2022-02-02T14:59:43.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 -- start start 2022-02-02T14:59:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f77d0 0x7fd048069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04806a380 con 0x7fd0480f6530 2022-02-02T14:59:43.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd047fff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04806a4c0 con 0x7fd0480f77d0 2022-02-02T14:59:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd046ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd046ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35470/0 (socket says 172.21.15.33:35470) 2022-02-02T14:59:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd046ffd700 1 -- 172.21.15.33:0/4107166235 learned_addr learned my addr 172.21.15.33:0/4107166235 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:43.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.047+0000 7fd0467fc700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f77d0 0x7fd048069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd046ffd700 1 -- 172.21.15.33:0/4107166235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f77d0 msgr2=0x7fd048069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd046ffd700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f77d0 0x7fd048069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd046ffd700 1 -- 172.21.15.33:0/4107166235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038005040 con 0x7fd0480f6530 2022-02-02T14:59:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd046ffd700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fd030002700 tx=0x7fd030009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0300079c0 con 0x7fd0480f6530 2022-02-02T14:59:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04806a7a0 con 0x7fd0480f6530 2022-02-02T14:59:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd03000f040 con 0x7fd0480f6530 2022-02-02T14:59:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd030014860 con 0x7fd0480f6530 2022-02-02T14:59:43.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.048+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04810ece0 con 0x7fd0480f6530 2022-02-02T14:59:43.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.049+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd048045ad0 con 0x7fd0480f6530 2022-02-02T14:59:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.050+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd03001b060 con 0x7fd0480f6530 2022-02-02T14:59:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.050+0000 7fd03f7fe700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 0x7fd0340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.051+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd030081930 con 0x7fd0480f6530 2022-02-02T14:59:43.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.051+0000 7fd0467fc700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 0x7fd0340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.051+0000 7fd0467fc700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 0x7fd0340672e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd038004630 tx=0x7fd038009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.055+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd03004f9e0 con 0x7fd0480f6530 2022-02-02T14:59:43.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.235+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd048057f10 con 0x7fd034064e20 2022-02-02T14:59:43.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.250+0000 7fd03f7fe700 1 -- 172.21.15.33:0/4107166235 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd048057f10 con 0x7fd034064e20 2022-02-02T14:59:43.249 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T14:59:43.249 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (85m) 47m ago 86m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T14:59:43.249 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (78m) 47m ago 85m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T14:59:43.250 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (77m) 47m ago 85m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T14:59:43.250 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (84m) 47m ago 85m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T14:59:43.250 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (78m) 47m ago 82m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T14:59:43.250 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (79m) 47m ago 82m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T14:59:43.250 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (79m) 47m ago 82m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T14:59:43.251 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (82m) 47m ago 82m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T14:59:43.251 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (79m) 47m ago 87m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T14:59:43.251 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (79m) 47m ago 85m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T14:59:43.251 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (78m) 47m ago 87m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T14:59:43.252 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (78m) 47m ago 85m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T14:59:43.252 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (85m) 47m ago 85m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T14:59:43.252 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (85m) 47m ago 85m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T14:59:43.252 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 47m ago 84m - 4096M 2022-02-02T14:59:43.252 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (84m) 47m ago 84m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T14:59:43.253 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (84m) 47m ago 84m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T14:59:43.253 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (83m) 47m ago 83m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T14:59:43.253 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (83m) 47m ago 83m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T14:59:43.253 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (83m) 47m ago 83m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T14:59:43.254 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (84m) 47m ago 85m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T14:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 msgr2=0x7fd0340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 0x7fd0340672e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fd038004630 tx=0x7fd038009b30).stop 2022-02-02T14:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 msgr2=0x7fd04806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7fd030002700 tx=0x7fd030009d80).stop 2022-02-02T14:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 shutdown_connections 2022-02-02T14:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd034064e20 0x7fd0340672e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0480f6530 0x7fd04806b9a0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 --2- 172.21.15.33:0/4107166235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0480f77d0 0x7fd048069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.252+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 >> 172.21.15.33:0/4107166235 conn(0x7fd0480f1c90 msgr2=0x7fd0480fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.253+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 shutdown_connections 2022-02-02T14:59:43.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.253+0000 7fd047fff700 1 -- 172.21.15.33:0/4107166235 wait complete. 2022-02-02T14:59:43.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 -- 172.21.15.33:0/933493802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 msgr2=0x7ff18c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 --2- 172.21.15.33:0/933493802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c0f59e0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 rx=0x7ff17c004660 tx=0x7ff17c009b30).stop 2022-02-02T14:59:43.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 -- 172.21.15.33:0/933493802 shutdown_connections 2022-02-02T14:59:43.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 --2- 172.21.15.33:0/933493802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 0x7ff18c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 --2- 172.21.15.33:0/933493802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c0f59e0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 -- 172.21.15.33:0/933493802 >> 172.21.15.33:0/933493802 conn(0x7ff18c0f0d40 msgr2=0x7ff18c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 -- 172.21.15.33:0/933493802 shutdown_connections 2022-02-02T14:59:43.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.352+0000 7ff191784700 1 -- 172.21.15.33:0/933493802 wait complete. 2022-02-02T14:59:43.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 Processor -- start 2022-02-02T14:59:43.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 -- start start 2022-02-02T14:59:43.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 0x7ff18c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c106950 con 0x7ff18c0f55c0 2022-02-02T14:59:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff191784700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c107160 con 0x7ff18c0f6860 2022-02-02T14:59:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35480/0 (socket says 172.21.15.33:35480) 2022-02-02T14:59:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 -- 172.21.15.33:0/2682743836 learned_addr learned my addr 172.21.15.33:0/2682743836 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:43.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18a7fc700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 0x7ff18c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 -- 172.21.15.33:0/2682743836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 msgr2=0x7ff18c106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 0x7ff18c106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.353+0000 7ff18affd700 1 -- 172.21.15.33:0/2682743836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c005040 con 0x7ff18c0f55c0 2022-02-02T14:59:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff18affd700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7ff17c013a70 tx=0x7ff17c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff17c018070 con 0x7ff18c0f55c0 2022-02-02T14:59:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff17c0097d0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c107380 con 0x7ff18c0f55c0 2022-02-02T14:59:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff17c01de80 con 0x7ff18c0f55c0 2022-02-02T14:59:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.354+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c1078e0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.355+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c0f49b0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.355+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff17c007ba0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.356+0000 7ff1837fe700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 0x7ff178067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.356+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff17c0836b0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.356+0000 7ff18a7fc700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 0x7ff178067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.356+0000 7ff18a7fc700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 0x7ff178067290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff174004ce0 tx=0x7ff17400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.360+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff17c051760 con 0x7ff18c0f55c0 2022-02-02T14:59:43.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.602+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff18c0008d0 con 0x7ff18c0f55c0 2022-02-02T14:59:43.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.602+0000 7ff1837fe700 1 -- 172.21.15.33:0/2682743836 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff17c054d80 con 0x7ff18c0f55c0 2022-02-02T14:59:43.601 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T14:59:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T14:59:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:59:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:43.602 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T14:59:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T14:59:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T14:59:43.603 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T14:59:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T14:59:43.604 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T14:59:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T14:59:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T14:59:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T14:59:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T14:59:43.605 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T14:59:43.606 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T14:59:43.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 msgr2=0x7ff178067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 0x7ff178067290 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7ff174004ce0 tx=0x7ff17400b040).stop 2022-02-02T14:59:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 msgr2=0x7ff18c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7ff17c013a70 tx=0x7ff17c009b30).stop 2022-02-02T14:59:43.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 shutdown_connections 2022-02-02T14:59:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff178064dd0 0x7ff178067290 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff18c0f55c0 0x7ff18c105e60 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 --2- 172.21.15.33:0/2682743836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff18c0f6860 0x7ff18c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 >> 172.21.15.33:0/2682743836 conn(0x7ff18c0f0d40 msgr2=0x7ff18c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 shutdown_connections 2022-02-02T14:59:43.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.605+0000 7ff191784700 1 -- 172.21.15.33:0/2682743836 wait complete. 2022-02-02T14:59:43.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 -- 172.21.15.33:0/2176520733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 msgr2=0x7f28340fbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 --2- 172.21.15.33:0/2176520733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28340fbaf0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7f2828004660 tx=0x7f2828009b30).stop 2022-02-02T14:59:43.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 -- 172.21.15.33:0/2176520733 shutdown_connections 2022-02-02T14:59:43.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 --2- 172.21.15.33:0/2176520733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28340fbaf0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 --2- 172.21.15.33:0/2176520733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 0x7f28340f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 -- 172.21.15.33:0/2176520733 >> 172.21.15.33:0/2176520733 conn(0x7f28340f0b90 msgr2=0x7f28340f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 -- 172.21.15.33:0/2176520733 shutdown_connections 2022-02-02T14:59:43.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.706+0000 7f283a138700 1 -- 172.21.15.33:0/2176520733 wait complete. 2022-02-02T14:59:43.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 Processor -- start 2022-02-02T14:59:43.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 -- start start 2022-02-02T14:59:43.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 0x7f2834106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28341078b0 con 0x7f28340f96c0 2022-02-02T14:59:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f283a138700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28341080f0 con 0x7f2834060250 2022-02-02T14:59:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f2838935700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f2838935700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35492/0 (socket says 172.21.15.33:35492) 2022-02-02T14:59:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f2838935700 1 -- 172.21.15.33:0/930714332 learned_addr learned my addr 172.21.15.33:0/930714332 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T14:59:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.707+0000 7f2839136700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 0x7f2834106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2838935700 1 -- 172.21.15.33:0/930714332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 msgr2=0x7f2834106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2838935700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 0x7f2834106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2838935700 1 -- 172.21.15.33:0/930714332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2828005040 con 0x7f28340f96c0 2022-02-02T14:59:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2838935700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f2828000c00 tx=0x7f2828009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2828018070 con 0x7f28340f96c0 2022-02-02T14:59:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f28280097d0 con 0x7f28340f96c0 2022-02-02T14:59:43.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2834108370 con 0x7f28340f96c0 2022-02-02T14:59:43.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f282801c3c0 con 0x7f28340f96c0 2022-02-02T14:59:43.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.708+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2834108850 con 0x7f28340f96c0 2022-02-02T14:59:43.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.709+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2834059100 con 0x7f28340f96c0 2022-02-02T14:59:43.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.710+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f282801d420 con 0x7f28340f96c0 2022-02-02T14:59:43.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.710+0000 7f2825ffb700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 0x7f28200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T14:59:43.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.710+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f28280837c0 con 0x7f28340f96c0 2022-02-02T14:59:43.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.710+0000 7f2839136700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 0x7f28200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T14:59:43.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.711+0000 7f2839136700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 0x7f28200672e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f28300041d0 tx=0x7f2830009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T14:59:43.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.714+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2828051930 con 0x7f28340f96c0 2022-02-02T14:59:43.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.924+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f28340008d0 con 0x7f28340f96c0 2022-02-02T14:59:43.923 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:43 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2682743836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:59:43.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.924+0000 7f2825ffb700 1 -- 172.21.15.33:0/930714332 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2828054f50 con 0x7f28340f96c0 2022-02-02T14:59:43.924 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T14:59:43.924 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T14:59:43.924 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:59:43.925 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T14:59:43.925 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:43.925 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T14:59:43.925 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T14:59:43.926 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T14:59:43.926 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T14:59:43.926 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T14:59:43.926 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T14:59:43.927 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T14:59:43.927 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T14:59:43.927 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T14:59:43.927 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T14:59:43.928 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T14:59:43.928 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T14:59:43.928 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T14:59:43.928 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T14:59:43.929 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T14:59:43.929 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T14:59:43.929 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T14:59:43.929 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T14:59:43.930 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T14:59:43.930 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T14:59:43.930 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T14:59:43.931 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T14:59:43.931 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T14:59:43.931 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T14:59:43.931 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T14:59:43.931 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T14:59:43.932 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:43.932 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:43.932 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T14:59:43.932 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T14:59:43.933 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:43.933 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:43.933 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:43.933 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T14:59:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 msgr2=0x7f28200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 0x7f28200672e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f28300041d0 tx=0x7f2830009040).stop 2022-02-02T14:59:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 msgr2=0x7f28341072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T14:59:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 rx=0x7f2828000c00 tx=0x7f2828009b30).stop 2022-02-02T14:59:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 shutdown_connections 2022-02-02T14:59:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2820064e20 0x7f28200672e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2834060250 0x7f2834106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.926+0000 7f283a138700 1 --2- 172.21.15.33:0/930714332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28340f96c0 0x7f28341072b0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T14:59:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.927+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 >> 172.21.15.33:0/930714332 conn(0x7f28340f0b90 msgr2=0x7f28340f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T14:59:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.927+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 shutdown_connections 2022-02-02T14:59:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T14:59:43.927+0000 7f283a138700 1 -- 172.21.15.33:0/930714332 wait complete. 2022-02-02T14:59:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T14:59:44.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:43 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2682743836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T14:59:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:44 smithi033 ceph-mon[101165]: from='client.36562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:44.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:44 smithi033 ceph-mon[101165]: from='client.36566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:44 smithi033 ceph-mon[101165]: pgmap v2430: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:44.990 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/930714332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:59:45.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:44 smithi037 ceph-mon[69017]: from='client.36562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:44 smithi037 ceph-mon[69017]: from='client.36566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T14:59:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:44 smithi037 ceph-mon[69017]: pgmap v2430: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:45.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/930714332' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T14:59:46.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:46 smithi033 ceph-mon[101165]: pgmap v2431: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:47.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:46 smithi037 ceph-mon[69017]: pgmap v2431: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:48.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:48 smithi033 ceph-mon[101165]: pgmap v2432: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:49.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:48 smithi037 ceph-mon[69017]: pgmap v2432: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:50.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:49 smithi037 ceph-mon[69017]: pgmap v2433: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:50.238 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:49 smithi033 ceph-mon[101165]: pgmap v2433: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:52.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:52 smithi033 ceph-mon[101165]: pgmap v2434: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:53.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:52 smithi037 ceph-mon[69017]: pgmap v2434: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:54.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:54 smithi033 ceph-mon[101165]: pgmap v2435: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:59:54.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:59:55.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:54 smithi037 ceph-mon[69017]: pgmap v2435: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:55.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T14:59:55.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T14:59:56.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:56 smithi033 ceph-mon[101165]: pgmap v2436: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:57.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:56 smithi037 ceph-mon[69017]: pgmap v2436: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:58.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 14:59:58 smithi033 ceph-mon[101165]: pgmap v2437: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T14:59:59.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 14:59:58 smithi037 ceph-mon[69017]: pgmap v2437: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:00.488 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:00 smithi033 conmon[101141]: 2022-02-02T14:59:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:00:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:00 smithi033 ceph-mon[101165]: pgmap v2438: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:00.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:00:01.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:00 smithi037 ceph-mon[69017]: pgmap v2438: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:01.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:00:02.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:02 smithi033 ceph-mon[101165]: pgmap v2439: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:03.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:02 smithi037 ceph-mon[69017]: pgmap v2439: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:04.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:04 smithi033 ceph-mon[101165]: pgmap v2440: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:05.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:04 smithi037 ceph-mon[69017]: pgmap v2440: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:06.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:06 smithi033 ceph-mon[101165]: pgmap v2441: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:07.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:06 smithi037 ceph-mon[69017]: pgmap v2441: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:08.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:08 smithi033 ceph-mon[101165]: pgmap v2442: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:09.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:08 smithi037 ceph-mon[69017]: pgmap v2442: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:10.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:10 smithi033 ceph-mon[101165]: pgmap v2443: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:11.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:10 smithi037 ceph-mon[69017]: pgmap v2443: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:12.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:12 smithi033 ceph-mon[101165]: pgmap v2444: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:13.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:12 smithi037 ceph-mon[69017]: pgmap v2444: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 -- 172.21.15.33:0/844214450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06a350 msgr2=0x7ff84c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 --2- 172.21.15.33:0/844214450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06a350 0x7ff84c06a7d0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7ff840004660 tx=0x7ff840009b30).stop 2022-02-02T15:00:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 -- 172.21.15.33:0/844214450 shutdown_connections 2022-02-02T15:00:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 --2- 172.21.15.33:0/844214450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06a350 0x7ff84c06a7d0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 --2- 172.21.15.33:0/844214450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06b960 0x7ff84c069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.040+0000 7ff8534f2700 1 -- 172.21.15.33:0/844214450 >> 172.21.15.33:0/844214450 conn(0x7ff84c0f1e40 msgr2=0x7ff84c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.041+0000 7ff8534f2700 1 -- 172.21.15.33:0/844214450 shutdown_connections 2022-02-02T15:00:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.041+0000 7ff8534f2700 1 -- 172.21.15.33:0/844214450 wait complete. 2022-02-02T15:00:14.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.041+0000 7ff8534f2700 1 Processor -- start 2022-02-02T15:00:14.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.041+0000 7ff8534f2700 1 -- start start 2022-02-02T15:00:14.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff8534f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06a350 0x7ff84c109140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff8534f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff8534f2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c109be0 con 0x7ff84c06b960 2022-02-02T15:00:14.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff8534f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84c109d20 con 0x7ff84c06a350 2022-02-02T15:00:14.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35502/0 (socket says 172.21.15.33:35502) 2022-02-02T15:00:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 -- 172.21.15.33:0/3733072725 learned_addr learned my addr 172.21.15.33:0/3733072725 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff85128e700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06a350 0x7ff84c109140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 -- 172.21.15.33:0/3733072725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06a350 msgr2=0x7ff84c109140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06a350 0x7ff84c109140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 -- 172.21.15.33:0/3733072725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840005040 con 0x7ff84c06b960 2022-02-02T15:00:14.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.042+0000 7ff850a8d700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7ff840009990 tx=0x7ff840009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.043+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff840018070 con 0x7ff84c06b960 2022-02-02T15:00:14.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.043+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff840007ba0 con 0x7ff84c06b960 2022-02-02T15:00:14.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.043+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84c10a660 con 0x7ff84c06b960 2022-02-02T15:00:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.043+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff84001c3c0 con 0x7ff84c06b960 2022-02-02T15:00:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.043+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84c10abc0 con 0x7ff84c06b960 2022-02-02T15:00:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.044+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff84c045ad0 con 0x7ff84c06b960 2022-02-02T15:00:14.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.045+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff84001d420 con 0x7ff84c06b960 2022-02-02T15:00:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.045+0000 7ff83dffb700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 0x7ff838067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.045+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff840083930 con 0x7ff84c06b960 2022-02-02T15:00:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.046+0000 7ff85128e700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 0x7ff838067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.046+0000 7ff85128e700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 0x7ff838067290 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff8480096c0 tx=0x7ff848009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.049+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff840055430 con 0x7ff84c06b960 2022-02-02T15:00:14.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.237+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff84c1011d0 con 0x7ff838064dd0 2022-02-02T15:00:14.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.238+0000 7ff83dffb700 1 -- 172.21.15.33:0/3733072725 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff84c1011d0 con 0x7ff838064dd0 2022-02-02T15:00:14.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 msgr2=0x7ff838067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 0x7ff838067290 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7ff8480096c0 tx=0x7ff848009be0).stop 2022-02-02T15:00:14.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 msgr2=0x7ff84c109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7ff840009990 tx=0x7ff840009b30).stop 2022-02-02T15:00:14.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 shutdown_connections 2022-02-02T15:00:14.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff838064dd0 0x7ff838067290 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff84c06a350 0x7ff84c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 --2- 172.21.15.33:0/3733072725 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff84c06b960 0x7ff84c109630 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 >> 172.21.15.33:0/3733072725 conn(0x7ff84c0f1e40 msgr2=0x7ff84c0fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 shutdown_connections 2022-02-02T15:00:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.240+0000 7ff8534f2700 1 -- 172.21.15.33:0/3733072725 wait complete. 2022-02-02T15:00:14.249 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:00:14.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 -- 172.21.15.33:0/2378836183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f55c0 msgr2=0x7f7d5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 --2- 172.21.15.33:0/2378836183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f59e0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f7d4c004660 tx=0x7f7d4c009b30).stop 2022-02-02T15:00:14.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 -- 172.21.15.33:0/2378836183 shutdown_connections 2022-02-02T15:00:14.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 --2- 172.21.15.33:0/2378836183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 --2- 172.21.15.33:0/2378836183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f59e0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 -- 172.21.15.33:0/2378836183 >> 172.21.15.33:0/2378836183 conn(0x7f7d5c0f0d40 msgr2=0x7f7d5c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 -- 172.21.15.33:0/2378836183 shutdown_connections 2022-02-02T15:00:14.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.341+0000 7f7d61151700 1 -- 172.21.15.33:0/2378836183 wait complete. 2022-02-02T15:00:14.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 Processor -- start 2022-02-02T15:00:14.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 -- start start 2022-02-02T15:00:14.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0f8100 con 0x7f7d5c0f6860 2022-02-02T15:00:14.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d61151700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0f8240 con 0x7f7d5c0f55c0 2022-02-02T15:00:14.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d5a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d5a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35512/0 (socket says 172.21.15.33:35512) 2022-02-02T15:00:14.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.342+0000 7f7d5a59c700 1 -- 172.21.15.33:0/415021574 learned_addr learned my addr 172.21.15.33:0/415021574 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:14.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d5ad9d700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d5a59c700 1 -- 172.21.15.33:0/415021574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f55c0 msgr2=0x7f7d5c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d5a59c700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d5a59c700 1 -- 172.21.15.33:0/415021574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c005040 con 0x7f7d5c0f6860 2022-02-02T15:00:14.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d5a59c700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f7d4400e7f0 tx=0x7f7d4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d440092e0 con 0x7f7d5c0f6860 2022-02-02T15:00:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0f8520 con 0x7f7d5c0f6860 2022-02-02T15:00:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7d4400f040 con 0x7f7d5c0f6860 2022-02-02T15:00:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.343+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d44014750 con 0x7f7d5c0f6860 2022-02-02T15:00:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.344+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c10ef20 con 0x7f7d5c0f6860 2022-02-02T15:00:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.344+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c045ad0 con 0x7f7d5c0f6860 2022-02-02T15:00:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.345+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7d4401b030 con 0x7f7d5c0f6860 2022-02-02T15:00:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.345+0000 7f7d537fe700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 0x7f7d48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.346+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7d44081880 con 0x7f7d5c0f6860 2022-02-02T15:00:14.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.346+0000 7f7d5ad9d700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 0x7f7d48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.346+0000 7f7d5ad9d700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 0x7f7d48067290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7d4c000c00 tx=0x7f7d4c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.350+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7d4404f9e0 con 0x7f7d5c0f6860 2022-02-02T15:00:14.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.534+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d5c0faca0 con 0x7f7d48064dd0 2022-02-02T15:00:14.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.548+0000 7f7d537fe700 1 -- 172.21.15.33:0/415021574 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f7d5c0faca0 con 0x7f7d48064dd0 2022-02-02T15:00:14.548 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:00:14.549 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (85m) 47m ago 86m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:00:14.549 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (78m) 47m ago 86m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:00:14.549 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (78m) 47m ago 86m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:00:14.549 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (85m) 47m ago 86m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:00:14.550 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (79m) 47m ago 82m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:00:14.550 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (79m) 47m ago 82m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:00:14.550 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (80m) 47m ago 82m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:00:14.550 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (82m) 47m ago 82m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:00:14.551 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (80m) 47m ago 87m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:00:14.551 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (79m) 47m ago 85m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:00:14.551 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (79m) 47m ago 87m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:00:14.551 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (79m) 47m ago 85m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:00:14.551 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (86m) 47m ago 86m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:00:14.552 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (85m) 47m ago 85m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:00:14.552 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 47m ago 85m - 4096M 2022-02-02T15:00:14.552 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (84m) 47m ago 84m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:00:14.552 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (84m) 47m ago 84m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:00:14.553 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (84m) 47m ago 84m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:00:14.553 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (84m) 47m ago 84m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:00:14.553 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (83m) 47m ago 83m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:00:14.553 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (85m) 47m ago 86m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:00:14.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 msgr2=0x7f7d48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 0x7f7d48067290 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7f7d4c000c00 tx=0x7f7d4c016040).stop 2022-02-02T15:00:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 msgr2=0x7f7d5c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 rx=0x7f7d4400e7f0 tx=0x7f7d4400b040).stop 2022-02-02T15:00:14.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 shutdown_connections 2022-02-02T15:00:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7d48064dd0 0x7f7d48067290 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d5c0f55c0 0x7f7d5c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 --2- 172.21.15.33:0/415021574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7d5c0f6860 0x7f7d5c0f7ba0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 >> 172.21.15.33:0/415021574 conn(0x7f7d5c0f0d40 msgr2=0x7f7d5c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 shutdown_connections 2022-02-02T15:00:14.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.550+0000 7f7d61151700 1 -- 172.21.15.33:0/415021574 wait complete. 2022-02-02T15:00:14.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 -- 172.21.15.33:0/462965329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f66e0 msgr2=0x7ff8d40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 --2- 172.21.15.33:0/462965329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f66e0 0x7ff8d40f6b00 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7ff8d0004660 tx=0x7ff8d0009b30).stop 2022-02-02T15:00:14.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 -- 172.21.15.33:0/462965329 shutdown_connections 2022-02-02T15:00:14.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 --2- 172.21.15.33:0/462965329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f7980 0x7ff8d40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 --2- 172.21.15.33:0/462965329 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f66e0 0x7ff8d40f6b00 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 -- 172.21.15.33:0/462965329 >> 172.21.15.33:0/462965329 conn(0x7ff8d40f1e40 msgr2=0x7ff8d40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 -- 172.21.15.33:0/462965329 shutdown_connections 2022-02-02T15:00:14.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.650+0000 7ff8db736700 1 -- 172.21.15.33:0/462965329 wait complete. 2022-02-02T15:00:14.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 Processor -- start 2022-02-02T15:00:14.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 -- start start 2022-02-02T15:00:14.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f66e0 0x7ff8d4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4107a50 con 0x7ff8d40f7980 2022-02-02T15:00:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8db736700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d4107b90 con 0x7ff8d40f66e0 2022-02-02T15:00:14.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.651+0000 7ff8d8cd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35520/0 (socket says 172.21.15.33:35520) 2022-02-02T15:00:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 -- 172.21.15.33:0/3830523849 learned_addr learned my addr 172.21.15.33:0/3830523849 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d94d2700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f66e0 0x7ff8d4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 -- 172.21.15.33:0/3830523849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f66e0 msgr2=0x7ff8d4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f66e0 0x7ff8d4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 -- 172.21.15.33:0/3830523849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0005040 con 0x7ff8d40f7980 2022-02-02T15:00:14.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8d8cd1700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7ff8c80026d0 tx=0x7ff8c8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c80079c0 con 0x7ff8d40f7980 2022-02-02T15:00:14.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff8c800f040 con 0x7ff8d40f7980 2022-02-02T15:00:14.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d4108530 con 0x7ff8d40f7980 2022-02-02T15:00:14.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.652+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8c80148b0 con 0x7ff8d40f7980 2022-02-02T15:00:14.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.653+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4108af0 con 0x7ff8d40f7980 2022-02-02T15:00:14.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.653+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d4045ad0 con 0x7ff8d40f7980 2022-02-02T15:00:14.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.654+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff8c8007b20 con 0x7ff8d40f7980 2022-02-02T15:00:14.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.654+0000 7ff8c5ffb700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 0x7ff8c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:14.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.654+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff8c8081a30 con 0x7ff8d40f7980 2022-02-02T15:00:14.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.654+0000 7ff8d94d2700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 0x7ff8c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:14.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.655+0000 7ff8d94d2700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 0x7ff8c0067290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ff8d0004630 tx=0x7ff8d0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:14.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.658+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff8c8053510 con 0x7ff8d40f7980 2022-02-02T15:00:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.905+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8d4027a00 con 0x7ff8d40f7980 2022-02-02T15:00:14.905 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:14 smithi033 ceph-mon[101165]: pgmap v2445: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.906+0000 7ff8c5ffb700 1 -- 172.21.15.33:0/3830523849 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff8c8053100 con 0x7ff8d40f7980 2022-02-02T15:00:14.906 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:00:14.906 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:00:14.906 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:00:14.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:14.907 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:00:14.907 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:00:14.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:14.908 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:00:14.908 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:00:14.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:14.908 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:00:14.908 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:00:14.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:14.909 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:00:14.909 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:00:14.909 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:00:14.909 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:00:14.910 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:00:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 msgr2=0x7ff8c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 0x7ff8c0067290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ff8d0004630 tx=0x7ff8d0009b30).stop 2022-02-02T15:00:14.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 msgr2=0x7ff8d41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7ff8c80026d0 tx=0x7ff8c8009de0).stop 2022-02-02T15:00:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 shutdown_connections 2022-02-02T15:00:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff8c0064dd0 0x7ff8c0067290 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8d40f66e0 0x7ff8d4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 --2- 172.21.15.33:0/3830523849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d40f7980 0x7ff8d41074a0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:14.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 >> 172.21.15.33:0/3830523849 conn(0x7ff8d40f1e40 msgr2=0x7ff8d40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:14.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 shutdown_connections 2022-02-02T15:00:14.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:14.908+0000 7ff8db736700 1 -- 172.21.15.33:0/3830523849 wait complete. 2022-02-02T15:00:15.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 -- 172.21.15.33:0/3509327143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 msgr2=0x7fb9780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3509327143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb9780f59e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 rx=0x7fb968004660 tx=0x7fb968009b30).stop 2022-02-02T15:00:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 -- 172.21.15.33:0/3509327143 shutdown_connections 2022-02-02T15:00:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3509327143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 0x7fb9780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3509327143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb9780f59e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 -- 172.21.15.33:0/3509327143 >> 172.21.15.33:0/3509327143 conn(0x7fb9780f0d40 msgr2=0x7fb9780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 -- 172.21.15.33:0/3509327143 shutdown_connections 2022-02-02T15:00:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.009+0000 7fb97cc84700 1 -- 172.21.15.33:0/3509327143 wait complete. 2022-02-02T15:00:15.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 Processor -- start 2022-02-02T15:00:15.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 -- start start 2022-02-02T15:00:15.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:15.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 0x7fb97810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:15.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9780603e0 con 0x7fb9780f55c0 2022-02-02T15:00:15.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97cc84700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb978060520 con 0x7fb9780f6860 2022-02-02T15:00:15.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35528/0 (socket says 172.21.15.33:35528) 2022-02-02T15:00:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.010+0000 7fb97659c700 1 -- 172.21.15.33:0/3284464297 learned_addr learned my addr 172.21.15.33:0/3284464297 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb975d9b700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 0x7fb97810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97659c700 1 -- 172.21.15.33:0/3284464297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 msgr2=0x7fb97810c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97659c700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 0x7fb97810c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97659c700 1 -- 172.21.15.33:0/3284464297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb968005040 con 0x7fb9780f55c0 2022-02-02T15:00:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97659c700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fb968013a70 tx=0x7fb968009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb968018070 con 0x7fb9780f55c0 2022-02-02T15:00:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb9680097d0 con 0x7fb9780f55c0 2022-02-02T15:00:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97810c700 con 0x7fb9780f55c0 2022-02-02T15:00:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb96801c3c0 con 0x7fb9780f55c0 2022-02-02T15:00:15.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.011+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97810cc60 con 0x7fb9780f55c0 2022-02-02T15:00:15.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.012+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978045ad0 con 0x7fb9780f55c0 2022-02-02T15:00:15.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.012+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb968007ba0 con 0x7fb9780f55c0 2022-02-02T15:00:15.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.013+0000 7fb96effd700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:15.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.013+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb968083790 con 0x7fb9780f55c0 2022-02-02T15:00:15.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.013+0000 7fb975d9b700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:15.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.013+0000 7fb975d9b700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 0x7fb964067290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fb9600096c0 tx=0x7fb960009c20).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:15.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.017+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb968051900 con 0x7fb9780f55c0 2022-02-02T15:00:15.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:14 smithi037 ceph-mon[69017]: pgmap v2445: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:15.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.229+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9780008d0 con 0x7fb9780f55c0 2022-02-02T15:00:15.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.229+0000 7fb96effd700 1 -- 172.21.15.33:0/3284464297 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb968054f20 con 0x7fb9780f55c0 2022-02-02T15:00:15.229 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:00:15.229 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:00:15.229 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:00:15.230 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:00:15.230 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:15.230 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:00:15.230 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:00:15.231 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:00:15.231 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:00:15.231 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:00:15.231 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:00:15.232 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:00:15.232 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:00:15.232 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:00:15.232 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:00:15.233 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:00:15.233 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:00:15.233 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:00:15.233 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:00:15.233 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:00:15.234 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:00:15.234 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:00:15.234 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:00:15.235 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:00:15.235 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:00:15.236 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:00:15.236 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:00:15.236 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:00:15.236 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:00:15.237 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:00:15.237 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:00:15.237 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:15.237 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:15.237 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:00:15.238 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:15.238 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:15.238 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:15.238 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:15.239 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 msgr2=0x7fb964067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 0x7fb964067290 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fb9600096c0 tx=0x7fb960009c20).stop 2022-02-02T15:00:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 msgr2=0x7fb978109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7fb968013a70 tx=0x7fb968009b30).stop 2022-02-02T15:00:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 shutdown_connections 2022-02-02T15:00:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.231+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb964064dd0 0x7fb964067290 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.232+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9780f55c0 0x7fb978109cb0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.232+0000 7fb97cc84700 1 --2- 172.21.15.33:0/3284464297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9780f6860 0x7fb97810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.232+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 >> 172.21.15.33:0/3284464297 conn(0x7fb9780f0d40 msgr2=0x7fb9780fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.232+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 shutdown_connections 2022-02-02T15:00:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:15.232+0000 7fb97cc84700 1 -- 172.21.15.33:0/3284464297 wait complete. 2022-02-02T15:00:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:00:15.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:15 smithi033 ceph-mon[101165]: from='client.36578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:15.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:15 smithi033 ceph-mon[101165]: from='client.36582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:15.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3830523849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:00:15.989 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3284464297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:00:16.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:15 smithi037 ceph-mon[69017]: from='client.36578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:16.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:15 smithi037 ceph-mon[69017]: from='client.36582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:16.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3830523849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:00:16.039 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3284464297' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:00:16.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:16 smithi033 ceph-mon[101165]: pgmap v2446: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:17.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:16 smithi037 ceph-mon[69017]: pgmap v2446: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:18.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:18 smithi033 ceph-mon[101165]: pgmap v2447: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:19.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:18 smithi037 ceph-mon[69017]: pgmap v2447: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:19.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:19 smithi033 ceph-mon[101165]: pgmap v2448: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:20.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:19 smithi037 ceph-mon[69017]: pgmap v2448: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:22.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:22 smithi033 ceph-mon[101165]: pgmap v2449: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:23.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:22 smithi037 ceph-mon[69017]: pgmap v2449: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:24.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:24 smithi033 ceph-mon[101165]: pgmap v2450: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:25.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:24 smithi037 ceph-mon[69017]: pgmap v2450: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:26.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:26 smithi033 ceph-mon[101165]: pgmap v2451: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:27.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:26 smithi037 ceph-mon[69017]: pgmap v2451: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:28.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:28 smithi033 ceph-mon[101165]: pgmap v2452: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:29.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:28 smithi037 ceph-mon[69017]: pgmap v2452: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:30.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:30 smithi033 ceph-mon[101165]: pgmap v2453: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:31.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:30 smithi037 ceph-mon[69017]: pgmap v2453: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:32.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:32 smithi033 ceph-mon[101165]: pgmap v2454: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:33.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:32 smithi037 ceph-mon[69017]: pgmap v2454: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:34.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:34 smithi033 ceph-mon[101165]: pgmap v2455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:35.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:34 smithi037 ceph-mon[69017]: pgmap v2455: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:36.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:36 smithi033 ceph-mon[101165]: pgmap v2456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:37.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:36 smithi037 ceph-mon[69017]: pgmap v2456: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:38.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:38 smithi033 ceph-mon[101165]: pgmap v2457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:39.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:38 smithi037 ceph-mon[69017]: pgmap v2457: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:40.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:40 smithi033 ceph-mon[101165]: pgmap v2458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:41.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:40 smithi037 ceph-mon[69017]: pgmap v2458: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:42.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:42 smithi033 ceph-mon[101165]: pgmap v2459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:43.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:42 smithi037 ceph-mon[69017]: pgmap v2459: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:44.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:44 smithi033 ceph-mon[101165]: pgmap v2460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:45.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:44 smithi037 ceph-mon[69017]: pgmap v2460: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:45.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3167203955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 msgr2=0x7fe1a80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.348 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3167203955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a80f6b00 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fe19c004660 tx=0x7fe19c009b30).stop 2022-02-02T15:00:45.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3167203955 shutdown_connections 2022-02-02T15:00:45.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3167203955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3167203955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a80f6b00 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3167203955 >> 172.21.15.33:0/3167203955 conn(0x7fe1a80f1e40 msgr2=0x7fe1a80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:45.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3167203955 shutdown_connections 2022-02-02T15:00:45.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3167203955 wait complete. 2022-02-02T15:00:45.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 Processor -- start 2022-02-02T15:00:45.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.349+0000 7fe1aef6f700 1 -- start start 2022-02-02T15:00:45.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1aef6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1aef6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1aef6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a806a380 con 0x7fe1a80f66e0 2022-02-02T15:00:45.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1aef6f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a806a4c0 con 0x7fe1a80f7980 2022-02-02T15:00:45.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35536/0 (socket says 172.21.15.33:35536) 2022-02-02T15:00:45.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 -- 172.21.15.33:0/3405739990 learned_addr learned my addr 172.21.15.33:0/3405739990 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:45.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1a7fff700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 -- 172.21.15.33:0/3405739990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 msgr2=0x7fe1a8069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a8069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 -- 172.21.15.33:0/3405739990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19c005040 con 0x7fe1a80f66e0 2022-02-02T15:00:45.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1a7fff700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:00:45.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.350+0000 7fe1acd0b700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fe19c009830 tx=0x7fe19c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.351+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c018070 con 0x7fe1a80f66e0 2022-02-02T15:00:45.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.351+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe19c007ba0 con 0x7fe1a80f66e0 2022-02-02T15:00:45.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.351+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe19c01c620 con 0x7fe1a80f66e0 2022-02-02T15:00:45.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.351+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a806a740 con 0x7fe1a80f66e0 2022-02-02T15:00:45.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.351+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a806aca0 con 0x7fe1a80f66e0 2022-02-02T15:00:45.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.352+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe19c007d10 con 0x7fe1a80f66e0 2022-02-02T15:00:45.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.352+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a8045ad0 con 0x7fe1a80f66e0 2022-02-02T15:00:45.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.353+0000 7fe1a57fa700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 0x7fe198067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.353+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe19c083860 con 0x7fe1a80f66e0 2022-02-02T15:00:45.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.353+0000 7fe1a7fff700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 0x7fe198067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.353+0000 7fe1a7fff700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 0x7fe198067270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fe194007800 tx=0x7fe194009d00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.357+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe19c051910 con 0x7fe1a80f66e0 2022-02-02T15:00:45.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.549+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1a8057f10 con 0x7fe198064db0 2022-02-02T15:00:45.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.550+0000 7fe1a57fa700 1 -- 172.21.15.33:0/3405739990 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe1a8057f10 con 0x7fe198064db0 2022-02-02T15:00:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 msgr2=0x7fe198067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 0x7fe198067270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fe194007800 tx=0x7fe194009d00).stop 2022-02-02T15:00:45.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 msgr2=0x7fe1a806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fe19c009830 tx=0x7fe19c009b30).stop 2022-02-02T15:00:45.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 shutdown_connections 2022-02-02T15:00:45.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe198064db0 0x7fe198067270 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1a80f66e0 0x7fe1a806b9a0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 --2- 172.21.15.33:0/3405739990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1a80f7980 0x7fe1a8069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 >> 172.21.15.33:0/3405739990 conn(0x7fe1a80f1e40 msgr2=0x7fe1a80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:45.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 shutdown_connections 2022-02-02T15:00:45.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.552+0000 7fe1aef6f700 1 -- 172.21.15.33:0/3405739990 wait complete. 2022-02-02T15:00:45.559 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:00:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.653+0000 7f216b46b700 1 -- 172.21.15.33:0/3741668503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f5430 msgr2=0x7f21640f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.653+0000 7f216b46b700 1 --2- 172.21.15.33:0/3741668503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f5430 0x7f21640f5850 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7f2160004660 tx=0x7f2160009b30).stop 2022-02-02T15:00:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.653+0000 7f216b46b700 1 -- 172.21.15.33:0/3741668503 shutdown_connections 2022-02-02T15:00:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 --2- 172.21.15.33:0/3741668503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f66d0 0x7f21640f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 --2- 172.21.15.33:0/3741668503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f5430 0x7f21640f5850 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 -- 172.21.15.33:0/3741668503 >> 172.21.15.33:0/3741668503 conn(0x7f21640f0b90 msgr2=0x7f21640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:45.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 -- 172.21.15.33:0/3741668503 shutdown_connections 2022-02-02T15:00:45.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 -- 172.21.15.33:0/3741668503 wait complete. 2022-02-02T15:00:45.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 Processor -- start 2022-02-02T15:00:45.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.654+0000 7f216b46b700 1 -- start start 2022-02-02T15:00:45.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216b46b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f5430 0x7f2164106e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216b46b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216b46b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164107900 con 0x7f21640f66d0 2022-02-02T15:00:45.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216b46b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2164108110 con 0x7f21640f5430 2022-02-02T15:00:45.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35548/0 (socket says 172.21.15.33:35548) 2022-02-02T15:00:45.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 -- 172.21.15.33:0/345595487 learned_addr learned my addr 172.21.15.33:0/345595487 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:45.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216a469700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f5430 0x7f2164106e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 -- 172.21.15.33:0/345595487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f5430 msgr2=0x7f2164106e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f5430 0x7f2164106e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 -- 172.21.15.33:0/345595487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160005040 con 0x7f21640f66d0 2022-02-02T15:00:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f2169c68700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f215400c530 tx=0x7f2154007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f215400f650 con 0x7f21640f66d0 2022-02-02T15:00:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.655+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2164108390 con 0x7f21640f66d0 2022-02-02T15:00:45.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.656+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f215400fc60 con 0x7f21640f66d0 2022-02-02T15:00:45.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.656+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2154012c20 con 0x7f21640f66d0 2022-02-02T15:00:45.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.656+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2164108950 con 0x7f21640f66d0 2022-02-02T15:00:45.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.657+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2164059100 con 0x7f21640f66d0 2022-02-02T15:00:45.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.657+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2154010070 con 0x7f21640f66d0 2022-02-02T15:00:45.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.658+0000 7f215affd700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 0x7f21500672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.658+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2154081700 con 0x7f21640f66d0 2022-02-02T15:00:45.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.658+0000 7f216a469700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 0x7f21500672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.658+0000 7f216a469700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 0x7f21500672e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2160013690 tx=0x7f2160009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.662+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f215404f7b0 con 0x7f21640f66d0 2022-02-02T15:00:45.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.846+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21640fab10 con 0x7f2150064e20 2022-02-02T15:00:45.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.860+0000 7f215affd700 1 -- 172.21.15.33:0/345595487 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f21640fab10 con 0x7f2150064e20 2022-02-02T15:00:45.858 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:00:45.858 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (86m) 48m ago 87m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:00:45.859 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (79m) 48m ago 87m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:00:45.859 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (79m) 48m ago 86m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:00:45.859 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (85m) 48m ago 86m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:00:45.859 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (79m) 48m ago 83m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:00:45.859 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (80m) 48m ago 83m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:00:45.860 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (80m) 48m ago 83m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:00:45.860 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (83m) 48m ago 83m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:00:45.860 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (80m) 48m ago 88m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:00:45.860 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (80m) 48m ago 86m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:00:45.861 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (80m) 48m ago 88m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:00:45.861 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (79m) 48m ago 86m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:00:45.861 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (86m) 48m ago 86m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:00:45.861 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (86m) 48m ago 86m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:00:45.861 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 48m ago 85m - 4096M 2022-02-02T15:00:45.862 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (85m) 48m ago 85m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:00:45.862 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (85m) 48m ago 85m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:00:45.862 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (84m) 48m ago 84m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:00:45.862 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (84m) 48m ago 84m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:00:45.863 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (84m) 48m ago 84m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:00:45.863 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (85m) 48m ago 86m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 msgr2=0x7f21500672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 0x7f21500672e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f2160013690 tx=0x7f2160009b30).stop 2022-02-02T15:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 msgr2=0x7f2164107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f215400c530 tx=0x7f2154007e20).stop 2022-02-02T15:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 shutdown_connections 2022-02-02T15:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2150064e20 0x7f21500672e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21640f5430 0x7f2164106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.862+0000 7f216b46b700 1 --2- 172.21.15.33:0/345595487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21640f66d0 0x7f2164107300 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.863+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 >> 172.21.15.33:0/345595487 conn(0x7f21640f0b90 msgr2=0x7f216405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.863+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 shutdown_connections 2022-02-02T15:00:45.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.863+0000 7f216b46b700 1 -- 172.21.15.33:0/345595487 wait complete. 2022-02-02T15:00:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:45 smithi033 ceph-mon[101165]: pgmap v2461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:45.919 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:45 smithi033 ceph-mon[101165]: from='client.36594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 -- 172.21.15.33:0/3985555052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f7980 msgr2=0x7f03740f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 --2- 172.21.15.33:0/3985555052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f7980 0x7f03740f7de0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f0368004660 tx=0x7f0368009b30).stop 2022-02-02T15:00:45.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 -- 172.21.15.33:0/3985555052 shutdown_connections 2022-02-02T15:00:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 --2- 172.21.15.33:0/3985555052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f7980 0x7f03740f7de0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 --2- 172.21.15.33:0/3985555052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f66e0 0x7f03740f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 -- 172.21.15.33:0/3985555052 >> 172.21.15.33:0/3985555052 conn(0x7f03740f1e40 msgr2=0x7f03740f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.963+0000 7f0379be1700 1 -- 172.21.15.33:0/3985555052 shutdown_connections 2022-02-02T15:00:45.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 -- 172.21.15.33:0/3985555052 wait complete. 2022-02-02T15:00:45.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 Processor -- start 2022-02-02T15:00:45.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 -- start start 2022-02-02T15:00:45.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f7980 0x7f0374069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037406a380 con 0x7f03740f66e0 2022-02-02T15:00:45.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.964+0000 7f0379be1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037406a4c0 con 0x7f03740f7980 2022-02-02T15:00:45.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35556/0 (socket says 172.21.15.33:35556) 2022-02-02T15:00:45.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 -- 172.21.15.33:0/461596445 learned_addr learned my addr 172.21.15.33:0/461596445 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:45.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f0372ffd700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f7980 0x7f0374069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 -- 172.21.15.33:0/461596445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f7980 msgr2=0x7f0374069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:45.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f7980 0x7f0374069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:45.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 -- 172.21.15.33:0/461596445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0368005040 con 0x7f03740f66e0 2022-02-02T15:00:45.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f03737fe700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f036400c510 tx=0x7f0364007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036400f650 con 0x7f03740f66e0 2022-02-02T15:00:45.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f036400fc60 con 0x7f03740f66e0 2022-02-02T15:00:45.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0364012cd0 con 0x7f03740f66e0 2022-02-02T15:00:45.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037406a7a0 con 0x7f03740f66e0 2022-02-02T15:00:45.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.965+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037410efb0 con 0x7f03740f66e0 2022-02-02T15:00:45.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.967+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0374045ad0 con 0x7f03740f66e0 2022-02-02T15:00:45.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.967+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0364010070 con 0x7f03740f66e0 2022-02-02T15:00:45.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.967+0000 7f035bfff700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 0x7f035c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:45.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.967+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0364081770 con 0x7f03740f66e0 2022-02-02T15:00:45.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.967+0000 7f0372ffd700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 0x7f035c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:45.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.968+0000 7f0372ffd700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 0x7f035c067290 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f0368004630 tx=0x7f0368009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:45.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:45.972+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f036404f820 con 0x7f03740f66e0 2022-02-02T15:00:46.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:45 smithi037 ceph-mon[69017]: pgmap v2461: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:46.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:45 smithi037 ceph-mon[69017]: from='client.36594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.215+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0374027a00 con 0x7f03740f66e0 2022-02-02T15:00:46.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.216+0000 7f035bfff700 1 -- 172.21.15.33:0/461596445 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f036404f070 con 0x7f03740f66e0 2022-02-02T15:00:46.214 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:00:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:00:46.214 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:00:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:00:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:00:46.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:00:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:00:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:46.216 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:00:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:00:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:00:46.217 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:00:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:00:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:00:46.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:00:46.218 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:00:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 msgr2=0x7f035c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 0x7f035c067290 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f0368004630 tx=0x7f0368009b30).stop 2022-02-02T15:00:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 msgr2=0x7f037406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7f036400c510 tx=0x7f0364007df0).stop 2022-02-02T15:00:46.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 shutdown_connections 2022-02-02T15:00:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f035c064dd0 0x7f035c067290 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03740f66e0 0x7f037406b9a0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 --2- 172.21.15.33:0/461596445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03740f7980 0x7f0374069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 >> 172.21.15.33:0/461596445 conn(0x7f03740f1e40 msgr2=0x7f03740fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 shutdown_connections 2022-02-02T15:00:46.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.218+0000 7f0379be1700 1 -- 172.21.15.33:0/461596445 wait complete. 2022-02-02T15:00:46.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 -- 172.21.15.33:0/995555910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f66e0 msgr2=0x7fc8fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 --2- 172.21.15.33:0/995555910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc0f6b00 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fc8e4004660 tx=0x7fc8e4009b30).stop 2022-02-02T15:00:46.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 -- 172.21.15.33:0/995555910 shutdown_connections 2022-02-02T15:00:46.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 --2- 172.21.15.33:0/995555910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 --2- 172.21.15.33:0/995555910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc0f6b00 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 -- 172.21.15.33:0/995555910 >> 172.21.15.33:0/995555910 conn(0x7fc8fc0f1e40 msgr2=0x7fc8fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:46.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 -- 172.21.15.33:0/995555910 shutdown_connections 2022-02-02T15:00:46.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 -- 172.21.15.33:0/995555910 wait complete. 2022-02-02T15:00:46.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.319+0000 7fc9029eb700 1 Processor -- start 2022-02-02T15:00:46.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc9029eb700 1 -- start start 2022-02-02T15:00:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc9029eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc9029eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc9029eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06a380 con 0x7fc8fc0f7980 2022-02-02T15:00:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc9029eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06a4c0 con 0x7fc8fc0f66e0 2022-02-02T15:00:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35568/0 (socket says 172.21.15.33:35568) 2022-02-02T15:00:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 -- 172.21.15.33:0/3350600611 learned_addr learned my addr 172.21.15.33:0/3350600611 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:00:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fbfff700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 -- 172.21.15.33:0/3350600611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 msgr2=0x7fc8fc06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 -- 172.21.15.33:0/3350600611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4005040 con 0x7fc8fc0f7980 2022-02-02T15:00:46.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fbfff700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:00:46.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.320+0000 7fc8fb7fe700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fc8ec00e7f0 tx=0x7fc8ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:46.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.321+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec0092e0 con 0x7fc8fc0f7980 2022-02-02T15:00:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.321+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc8ec00f040 con 0x7fc8fc0f7980 2022-02-02T15:00:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.321+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc06a7a0 con 0x7fc8fc0f7980 2022-02-02T15:00:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.321+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec014750 con 0x7fc8fc0f7980 2022-02-02T15:00:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.321+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc10ef90 con 0x7fc8fc0f7980 2022-02-02T15:00:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.322+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc045ad0 con 0x7fc8fc0f7980 2022-02-02T15:00:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.322+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc8ec01b030 con 0x7fc8fc0f7980 2022-02-02T15:00:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.322+0000 7fc8f8ff9700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 0x7fc8e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:00:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.323+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc8ec081840 con 0x7fc8fc0f7980 2022-02-02T15:00:46.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.323+0000 7fc8fbfff700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 0x7fc8e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:00:46.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.323+0000 7fc8fbfff700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 0x7fc8e8067290 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc8e4000c00 tx=0x7fc8e400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:00:46.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.327+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc8ec04f9a0 con 0x7fc8fc0f7980 2022-02-02T15:00:46.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.540+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc8fc027a00 con 0x7fc8fc0f7980 2022-02-02T15:00:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.540+0000 7fc8f8ff9700 1 -- 172.21.15.33:0/3350600611 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc8ec019070 con 0x7fc8fc0f7980 2022-02-02T15:00:46.538 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:00:46.538 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:00:46.539 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:00:46.539 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:00:46.539 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:46.539 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:00:46.540 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:00:46.540 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:00:46.540 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:00:46.540 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:00:46.541 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:00:46.541 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:00:46.541 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:00:46.541 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:00:46.541 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:00:46.542 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:00:46.542 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:00:46.542 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:00:46.542 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:00:46.543 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:00:46.543 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:00:46.543 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:00:46.543 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:00:46.544 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:00:46.544 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:00:46.544 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:00:46.544 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:00:46.545 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:00:46.545 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:00:46.545 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:00:46.545 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:00:46.546 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:46.546 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:46.546 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:00:46.546 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:00:46.546 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:46.547 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:46.547 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:46.547 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:00:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 msgr2=0x7fc8e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 0x7fc8e8067290 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fc8e4000c00 tx=0x7fc8e400b040).stop 2022-02-02T15:00:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 msgr2=0x7fc8fc069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:00:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 rx=0x7fc8ec00e7f0 tx=0x7fc8ec00b040).stop 2022-02-02T15:00:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 shutdown_connections 2022-02-02T15:00:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc8e8064dd0 0x7fc8e8067290 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8fc0f66e0 0x7fc8fc06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 --2- 172.21.15.33:0/3350600611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8fc0f7980 0x7fc8fc069e20 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:00:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 >> 172.21.15.33:0/3350600611 conn(0x7fc8fc0f1e40 msgr2=0x7fc8fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:00:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 shutdown_connections 2022-02-02T15:00:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:00:46.542+0000 7fc9029eb700 1 -- 172.21.15.33:0/3350600611 wait complete. 2022-02-02T15:00:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:00:46.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:46 smithi033 ceph-mon[101165]: from='client.36598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:46.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/461596445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:00:46.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3350600611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:00:47.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:46 smithi037 ceph-mon[69017]: from='client.36598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:00:47.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/461596445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:00:47.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3350600611' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:00:47.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:47 smithi037 ceph-mon[69017]: pgmap v2462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:47.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:47 smithi033 ceph-mon[101165]: pgmap v2462: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:50.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:50 smithi033 ceph-mon[101165]: pgmap v2463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:51.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:50 smithi037 ceph-mon[69017]: pgmap v2463: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:52.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:52 smithi033 ceph-mon[101165]: pgmap v2464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:53.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:52 smithi037 ceph-mon[69017]: pgmap v2464: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:54 smithi033 ceph-mon[101165]: pgmap v2465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:54.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:00:54.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:00:55.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:54 smithi037 ceph-mon[69017]: pgmap v2465: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:55.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:00:55.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:00:56.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:56 smithi033 ceph-mon[101165]: pgmap v2466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:57.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:56 smithi037 ceph-mon[69017]: pgmap v2466: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:58.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:00:58 smithi033 ceph-mon[101165]: pgmap v2467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:00:59.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:00:58 smithi037 ceph-mon[69017]: pgmap v2467: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:00.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:00 smithi033 ceph-mon[101165]: pgmap v2468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:01.021 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:00 smithi037 ceph-mon[69017]: pgmap v2468: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:02.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:02 smithi033 ceph-mon[101165]: pgmap v2469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:03.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:02 smithi037 ceph-mon[69017]: pgmap v2469: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:04.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:04 smithi033 ceph-mon[101165]: pgmap v2470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:05.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:04 smithi037 ceph-mon[69017]: pgmap v2470: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:06.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:06 smithi033 ceph-mon[101165]: pgmap v2471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:07.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:06 smithi037 ceph-mon[69017]: pgmap v2471: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:08.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:08 smithi033 ceph-mon[101165]: pgmap v2472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:09.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:08 smithi037 ceph-mon[69017]: pgmap v2472: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:10.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:10 smithi033 ceph-mon[101165]: pgmap v2473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:11.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:10 smithi037 ceph-mon[69017]: pgmap v2473: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:12.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:12 smithi033 ceph-mon[101165]: pgmap v2474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:13.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:12 smithi037 ceph-mon[69017]: pgmap v2474: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:14.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:14 smithi033 ceph-mon[101165]: pgmap v2475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:15.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:14 smithi037 ceph-mon[69017]: pgmap v2475: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:16.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 -- 172.21.15.33:0/1039404264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f5430 msgr2=0x7f17a00f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 --2- 172.21.15.33:0/1039404264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f5430 0x7f17a00f5850 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f179c004660 tx=0x7f179c009b30).stop 2022-02-02T15:01:16.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 -- 172.21.15.33:0/1039404264 shutdown_connections 2022-02-02T15:01:16.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 --2- 172.21.15.33:0/1039404264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f66d0 0x7f17a00f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 --2- 172.21.15.33:0/1039404264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f5430 0x7f17a00f5850 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 -- 172.21.15.33:0/1039404264 >> 172.21.15.33:0/1039404264 conn(0x7f17a00f0b90 msgr2=0x7f17a00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:16.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 -- 172.21.15.33:0/1039404264 shutdown_connections 2022-02-02T15:01:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 -- 172.21.15.33:0/1039404264 wait complete. 2022-02-02T15:01:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.657+0000 7f17a6fab700 1 Processor -- start 2022-02-02T15:01:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a6fab700 1 -- start start 2022-02-02T15:01:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a6fab700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f5430 0x7f17a0109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a6fab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a6fab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00603e0 con 0x7f17a00f66d0 2022-02-02T15:01:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a6fab700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0060520 con 0x7f17a00f5430 2022-02-02T15:01:16.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35576/0 (socket says 172.21.15.33:35576) 2022-02-02T15:01:16.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 -- 172.21.15.33:0/3127877677 learned_addr learned my addr 172.21.15.33:0/3127877677 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:16.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a5fa9700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f5430 0x7f17a0109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 -- 172.21.15.33:0/3127877677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f5430 msgr2=0x7f17a0109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f5430 0x7f17a0109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.658+0000 7f17a57a8700 1 -- 172.21.15.33:0/3127877677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c005040 con 0x7f17a00f66d0 2022-02-02T15:01:16.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17a57a8700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f179000e7f0 tx=0x7f179000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:16.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17900092e0 con 0x7f17a00f66d0 2022-02-02T15:01:16.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f179000f040 con 0x7f17a00f66d0 2022-02-02T15:01:16.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a010c4d0 con 0x7f17a00f66d0 2022-02-02T15:01:16.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1790014750 con 0x7f17a00f66d0 2022-02-02T15:01:16.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.659+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a010ca90 con 0x7f17a00f66d0 2022-02-02T15:01:16.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.660+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a0045ad0 con 0x7f17a00f66d0 2022-02-02T15:01:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.660+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f179001b030 con 0x7f17a00f66d0 2022-02-02T15:01:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.661+0000 7f17967fc700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 0x7f178c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.661+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1790081780 con 0x7f17a00f66d0 2022-02-02T15:01:16.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.661+0000 7f17a5fa9700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 0x7f178c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.661+0000 7f17a5fa9700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 0x7f178c0672e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f179c000c00 tx=0x7f179c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:16.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.665+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f179004f8e0 con 0x7f17a00f66d0 2022-02-02T15:01:16.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.854+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17a0057f10 con 0x7f178c064e20 2022-02-02T15:01:16.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.855+0000 7f17967fc700 1 -- 172.21.15.33:0/3127877677 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f17a0057f10 con 0x7f178c064e20 2022-02-02T15:01:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 msgr2=0x7f178c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 0x7f178c0672e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f179c000c00 tx=0x7f179c016040).stop 2022-02-02T15:01:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 msgr2=0x7f17a010bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f179000e7f0 tx=0x7f179000b040).stop 2022-02-02T15:01:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 shutdown_connections 2022-02-02T15:01:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f178c064e20 0x7f178c0672e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17a00f5430 0x7f17a0109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 --2- 172.21.15.33:0/3127877677 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17a00f66d0 0x7f17a010bf20 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 >> 172.21.15.33:0/3127877677 conn(0x7f17a00f0b90 msgr2=0x7f17a00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:16.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 shutdown_connections 2022-02-02T15:01:16.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.857+0000 7f17a6fab700 1 -- 172.21.15.33:0/3127877677 wait complete. 2022-02-02T15:01:16.865 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:01:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 -- 172.21.15.33:0/2195134355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 msgr2=0x7fd6bc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 --2- 172.21.15.33:0/2195134355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc0f6b00 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 rx=0x7fd6ac004660 tx=0x7fd6ac009b30).stop 2022-02-02T15:01:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 -- 172.21.15.33:0/2195134355 shutdown_connections 2022-02-02T15:01:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 --2- 172.21.15.33:0/2195134355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 0x7fd6bc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 --2- 172.21.15.33:0/2195134355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc0f6b00 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 -- 172.21.15.33:0/2195134355 >> 172.21.15.33:0/2195134355 conn(0x7fd6bc0f1e40 msgr2=0x7fd6bc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:16.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:16 smithi033 ceph-mon[101165]: pgmap v2476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:16.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 -- 172.21.15.33:0/2195134355 shutdown_connections 2022-02-02T15:01:16.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 -- 172.21.15.33:0/2195134355 wait complete. 2022-02-02T15:01:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.959+0000 7fd6c2677700 1 Processor -- start 2022-02-02T15:01:16.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6c2677700 1 -- start start 2022-02-02T15:01:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6c2677700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6c2677700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 0x7fd6bc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6c2677700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc107a50 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6c2677700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc107b90 con 0x7fd6bc0f7980 2022-02-02T15:01:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35582/0 (socket says 172.21.15.33:35582) 2022-02-02T15:01:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 -- 172.21.15.33:0/80594024 learned_addr learned my addr 172.21.15.33:0/80594024 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bb7fe700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 0x7fd6bc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 -- 172.21.15.33:0/80594024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 msgr2=0x7fd6bc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:16.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 0x7fd6bc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:16.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.960+0000 7fd6bbfff700 1 -- 172.21.15.33:0/80594024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac005040 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6bbfff700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fd6ac013a70 tx=0x7fd6ac009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:16.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac018070 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd6ac0097d0 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc1084d0 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ac01c3c0 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.961+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc108a30 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.962+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc045ad0 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.963+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd6ac007ba0 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.963+0000 7fd6b8ff9700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:16.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.963+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd6ac083790 con 0x7fd6bc0f66e0 2022-02-02T15:01:16.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.963+0000 7fd6bb7fe700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:16.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.964+0000 7fd6bb7fe700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fd6b00096c0 tx=0x7fd6b0009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:16.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:16.967+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd6ac055330 con 0x7fd6bc0f66e0 2022-02-02T15:01:17.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:16 smithi037 ceph-mon[69017]: pgmap v2476: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.147+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6bc0fef10 con 0x7fd6a4064dd0 2022-02-02T15:01:17.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.162+0000 7fd6b8ff9700 1 -- 172.21.15.33:0/80594024 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fd6bc0fef10 con 0x7fd6a4064dd0 2022-02-02T15:01:17.160 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:01:17.160 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (86m) 48m ago 87m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:01:17.160 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (79m) 48m ago 87m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:01:17.161 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (79m) 48m ago 87m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:01:17.161 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (86m) 48m ago 87m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:01:17.161 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (80m) 48m ago 83m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:01:17.161 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (80m) 48m ago 83m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:01:17.162 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (81m) 48m ago 83m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:01:17.162 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (83m) 48m ago 83m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:01:17.162 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (81m) 48m ago 88m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:01:17.162 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (80m) 48m ago 87m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:01:17.163 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (80m) 48m ago 88m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:01:17.163 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (80m) 48m ago 86m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:01:17.163 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (87m) 48m ago 87m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:01:17.163 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (86m) 48m ago 86m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:01:17.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 48m ago 86m - 4096M 2022-02-02T15:01:17.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (85m) 48m ago 85m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:01:17.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (85m) 48m ago 85m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:01:17.164 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (85m) 48m ago 85m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:01:17.165 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (85m) 48m ago 85m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:01:17.165 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (84m) 48m ago 84m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:01:17.165 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (86m) 48m ago 87m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:01:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 msgr2=0x7fd6a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fd6b00096c0 tx=0x7fd6b0009be0).stop 2022-02-02T15:01:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 msgr2=0x7fd6bc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7fd6ac013a70 tx=0x7fd6ac009b30).stop 2022-02-02T15:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 shutdown_connections 2022-02-02T15:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd6a4064dd0 0x7fd6a4067290 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.163+0000 7fd6c2677700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd6bc0f66e0 0x7fd6bc106fb0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.164+0000 7fd6c2677700 1 --2- 172.21.15.33:0/80594024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6bc0f7980 0x7fd6bc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.164+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 >> 172.21.15.33:0/80594024 conn(0x7fd6bc0f1e40 msgr2=0x7fd6bc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.164+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 shutdown_connections 2022-02-02T15:01:17.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.164+0000 7fd6c2677700 1 -- 172.21.15.33:0/80594024 wait complete. 2022-02-02T15:01:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 -- 172.21.15.33:0/604837345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f66e0 msgr2=0x7f0ef40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 --2- 172.21.15.33:0/604837345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f66e0 0x7f0ef40f6b00 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f0ee4004660 tx=0x7f0ee4009b30).stop 2022-02-02T15:01:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 -- 172.21.15.33:0/604837345 shutdown_connections 2022-02-02T15:01:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 --2- 172.21.15.33:0/604837345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f7980 0x7f0ef40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 --2- 172.21.15.33:0/604837345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f66e0 0x7f0ef40f6b00 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 -- 172.21.15.33:0/604837345 >> 172.21.15.33:0/604837345 conn(0x7f0ef40f1e40 msgr2=0x7f0ef40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:17.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 -- 172.21.15.33:0/604837345 shutdown_connections 2022-02-02T15:01:17.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.264+0000 7f0efc5db700 1 -- 172.21.15.33:0/604837345 wait complete. 2022-02-02T15:01:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 Processor -- start 2022-02-02T15:01:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 -- start start 2022-02-02T15:01:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f66e0 0x7f0ef4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4107a50 con 0x7f0ef40f7980 2022-02-02T15:01:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efc5db700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4107b90 con 0x7f0ef40f66e0 2022-02-02T15:01:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0ef9b76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0efa377700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f66e0 0x7f0ef4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0ef9b76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35594/0 (socket says 172.21.15.33:35594) 2022-02-02T15:01:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.265+0000 7f0ef9b76700 1 -- 172.21.15.33:0/2552731322 learned_addr learned my addr 172.21.15.33:0/2552731322 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0ef9b76700 1 -- 172.21.15.33:0/2552731322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f66e0 msgr2=0x7f0ef4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0ef9b76700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f66e0 0x7f0ef4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0ef9b76700 1 -- 172.21.15.33:0/2552731322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee4005040 con 0x7f0ef40f7980 2022-02-02T15:01:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0ef9b76700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f0ef00026d0 tx=0x7f0ef0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef00079c0 con 0x7f0ef40f7980 2022-02-02T15:01:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0ef000f040 con 0x7f0ef40f7980 2022-02-02T15:01:17.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef4108530 con 0x7f0ef40f7980 2022-02-02T15:01:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef00148b0 con 0x7f0ef40f7980 2022-02-02T15:01:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.266+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef4108af0 con 0x7f0ef40f7980 2022-02-02T15:01:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.267+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef4045ad0 con 0x7f0ef40f7980 2022-02-02T15:01:17.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.267+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0ef0007b20 con 0x7f0ef40f7980 2022-02-02T15:01:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.268+0000 7f0eeaffd700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 0x7f0ee0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.268+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0ef0081a30 con 0x7f0ef40f7980 2022-02-02T15:01:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.268+0000 7f0efa377700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 0x7f0ee0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.268+0000 7f0efa377700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 0x7f0ee0067270 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0ee4013690 tx=0x7f0ee4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:17.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.272+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0ef0053510 con 0x7f0ef40f7980 2022-02-02T15:01:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.515+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ef4027a00 con 0x7f0ef40f7980 2022-02-02T15:01:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.516+0000 7f0eeaffd700 1 -- 172.21.15.33:0/2552731322 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f0ef0053100 con 0x7f0ef40f7980 2022-02-02T15:01:17.515 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:01:17.515 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:01:17.515 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:01:17.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:17.516 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:01:17.516 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:01:17.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:17.516 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:01:17.516 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:01:17.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:17.517 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:01:17.517 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:01:17.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:17.518 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:01:17.518 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:01:17.518 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:01:17.518 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:01:17.519 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:01:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 msgr2=0x7f0ee0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 0x7f0ee0067270 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0ee4013690 tx=0x7f0ee4009b30).stop 2022-02-02T15:01:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 msgr2=0x7f0ef41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7f0ef00026d0 tx=0x7f0ef0009de0).stop 2022-02-02T15:01:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 shutdown_connections 2022-02-02T15:01:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0ee0064db0 0x7f0ee0067270 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ef40f66e0 0x7f0ef4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 --2- 172.21.15.33:0/2552731322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ef40f7980 0x7f0ef41074a0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 >> 172.21.15.33:0/2552731322 conn(0x7f0ef40f1e40 msgr2=0x7f0ef40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 shutdown_connections 2022-02-02T15:01:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.518+0000 7f0efc5db700 1 -- 172.21.15.33:0/2552731322 wait complete. 2022-02-02T15:01:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- 172.21.15.33:0/2377107544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f66d0 msgr2=0x7efcd80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 --2- 172.21.15.33:0/2377107544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f66d0 0x7efcd80f6b30 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7efcd4004660 tx=0x7efcd4009b30).stop 2022-02-02T15:01:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- 172.21.15.33:0/2377107544 shutdown_connections 2022-02-02T15:01:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 --2- 172.21.15.33:0/2377107544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f66d0 0x7efcd80f6b30 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 --2- 172.21.15.33:0/2377107544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f5430 0x7efcd80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- 172.21.15.33:0/2377107544 >> 172.21.15.33:0/2377107544 conn(0x7efcd80f0b90 msgr2=0x7efcd80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- 172.21.15.33:0/2377107544 shutdown_connections 2022-02-02T15:01:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- 172.21.15.33:0/2377107544 wait complete. 2022-02-02T15:01:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 Processor -- start 2022-02-02T15:01:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.619+0000 7efcde7a2700 1 -- start start 2022-02-02T15:01:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcde7a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcde7a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f66d0 0x7efcd810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcde7a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80603e0 con 0x7efcd80f5430 2022-02-02T15:01:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcde7a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8060520 con 0x7efcd80f66d0 2022-02-02T15:01:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35602/0 (socket says 172.21.15.33:35602) 2022-02-02T15:01:17.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 -- 172.21.15.33:0/3026981627 learned_addr learned my addr 172.21.15.33:0/3026981627 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:17.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdcf9f700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f66d0 0x7efcd810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 -- 172.21.15.33:0/3026981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f66d0 msgr2=0x7efcd810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f66d0 0x7efcd810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 -- 172.21.15.33:0/3026981627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4005040 con 0x7efcd80f5430 2022-02-02T15:01:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcdd7a0700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7efcc8002700 tx=0x7efcc8009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc80079c0 con 0x7efcd80f5430 2022-02-02T15:01:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efcc800f040 con 0x7efcd80f5430 2022-02-02T15:01:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcc8014850 con 0x7efcd80f5430 2022-02-02T15:01:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.620+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd810c480 con 0x7efcd80f5430 2022-02-02T15:01:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.621+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd810ca40 con 0x7efcd80f5430 2022-02-02T15:01:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.622+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8045ad0 con 0x7efcd80f5430 2022-02-02T15:01:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.622+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efcc801b060 con 0x7efcd80f5430 2022-02-02T15:01:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.622+0000 7efccdffb700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 0x7efcc40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.622+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efcc8081830 con 0x7efcd80f5430 2022-02-02T15:01:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.622+0000 7efcdcf9f700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 0x7efcc40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.623+0000 7efcdcf9f700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 0x7efcc40672e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7efcd4004630 tx=0x7efcd4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.626+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efcc804f8e0 con 0x7efcd80f5430 2022-02-02T15:01:17.787 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2552731322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:01:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.842+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efcd8027a00 con 0x7efcd80f5430 2022-02-02T15:01:17.841 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2552731322' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:01:17.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.843+0000 7efccdffb700 1 -- 172.21.15.33:0/3026981627 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7efcc8052f00 con 0x7efcd80f5430 2022-02-02T15:01:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:01:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:01:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:01:17.842 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:01:17.843 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:17.843 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:01:17.843 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:01:17.843 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:01:17.844 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:01:17.844 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:01:17.844 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:01:17.844 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:01:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:01:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:01:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:01:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:01:17.845 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:01:17.846 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:01:17.846 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:01:17.846 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:01:17.846 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:01:17.847 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:01:17.847 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:01:17.847 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:01:17.847 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:01:17.848 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:01:17.848 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:01:17.848 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:01:17.848 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:01:17.848 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:01:17.849 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:01:17.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:17.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:17.849 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:01:17.850 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:17.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:17.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:17.850 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:17.851 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.845+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 msgr2=0x7efcc40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.845+0000 7efcde7a2700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 0x7efcc40672e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7efcd4004630 tx=0x7efcd4009b30).stop 2022-02-02T15:01:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.845+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 msgr2=0x7efcd81099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:17.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.845+0000 7efcde7a2700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7efcc8002700 tx=0x7efcc8009e00).stop 2022-02-02T15:01:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 shutdown_connections 2022-02-02T15:01:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcc4064e20 0x7efcc40672e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efcd80f5430 0x7efcd81099d0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 --2- 172.21.15.33:0/3026981627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80f66d0 0x7efcd810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 >> 172.21.15.33:0/3026981627 conn(0x7efcd80f0b90 msgr2=0x7efcd80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 shutdown_connections 2022-02-02T15:01:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:17.846+0000 7efcde7a2700 1 -- 172.21.15.33:0/3026981627 wait complete. 2022-02-02T15:01:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:01:18.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:18 smithi033 ceph-mon[101165]: from='client.36610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:18.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:18 smithi033 ceph-mon[101165]: from='client.36614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:18.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:18 smithi033 ceph-mon[101165]: pgmap v2477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:18.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3026981627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:01:19.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:18 smithi037 ceph-mon[69017]: from='client.36610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:19.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:18 smithi037 ceph-mon[69017]: from='client.36614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:19.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:18 smithi037 ceph-mon[69017]: pgmap v2477: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:19.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3026981627' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:01:19.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:19 smithi033 ceph-mon[101165]: pgmap v2478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:20.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:19 smithi037 ceph-mon[69017]: pgmap v2478: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:22.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:22 smithi033 ceph-mon[101165]: pgmap v2479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:23.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:22 smithi037 ceph-mon[69017]: pgmap v2479: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:24.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:24 smithi033 ceph-mon[101165]: pgmap v2480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:25.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:24 smithi037 ceph-mon[69017]: pgmap v2480: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:26.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:26 smithi033 ceph-mon[101165]: pgmap v2481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:27.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:26 smithi037 ceph-mon[69017]: pgmap v2481: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:28.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:28 smithi033 ceph-mon[101165]: pgmap v2482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:29.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:28 smithi037 ceph-mon[69017]: pgmap v2482: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:30.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:30 smithi033 ceph-mon[101165]: pgmap v2483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:31.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:30 smithi037 ceph-mon[69017]: pgmap v2483: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:32.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:32 smithi033 ceph-mon[101165]: pgmap v2484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:33.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:32 smithi037 ceph-mon[69017]: pgmap v2484: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:34.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:34 smithi033 ceph-mon[101165]: pgmap v2485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:35.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:34 smithi037 ceph-mon[69017]: pgmap v2485: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:36.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:36 smithi033 ceph-mon[101165]: pgmap v2486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:37.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:36 smithi037 ceph-mon[69017]: pgmap v2486: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:38.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:38 smithi033 ceph-mon[101165]: pgmap v2487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:39.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:38 smithi037 ceph-mon[69017]: pgmap v2487: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:40.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:40 smithi033 ceph-mon[101165]: pgmap v2488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:41.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:40 smithi037 ceph-mon[69017]: pgmap v2488: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:42.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:42 smithi033 ceph-mon[101165]: pgmap v2489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:43.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:42 smithi037 ceph-mon[69017]: pgmap v2489: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:44.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:44 smithi033 ceph-mon[101165]: pgmap v2490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:45.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:44 smithi037 ceph-mon[69017]: pgmap v2490: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:46.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:46 smithi033 ceph-mon[101165]: pgmap v2491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:47.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:46 smithi037 ceph-mon[69017]: pgmap v2491: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:47.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 -- 172.21.15.33:0/1214667888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 msgr2=0x7f03480f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:47.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 --2- 172.21.15.33:0/1214667888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f03480f6cc0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f0344004660 tx=0x7f0344009b30).stop 2022-02-02T15:01:47.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 -- 172.21.15.33:0/1214667888 shutdown_connections 2022-02-02T15:01:47.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 --2- 172.21.15.33:0/1214667888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f03480f6cc0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:47.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 --2- 172.21.15.33:0/1214667888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 0x7f03480f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:47.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 -- 172.21.15.33:0/1214667888 >> 172.21.15.33:0/1214667888 conn(0x7f03480f0d40 msgr2=0x7f03480f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:47.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 -- 172.21.15.33:0/1214667888 shutdown_connections 2022-02-02T15:01:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.962+0000 7f034f329700 1 -- 172.21.15.33:0/1214667888 wait complete. 2022-02-02T15:01:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 Processor -- start 2022-02-02T15:01:47.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 -- start start 2022-02-02T15:01:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 0x7f0348109c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348060420 con 0x7f03480f6860 2022-02-02T15:01:47.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034f329700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348060560 con 0x7f03480f55c0 2022-02-02T15:01:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034c8c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034c8c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35612/0 (socket says 172.21.15.33:35612) 2022-02-02T15:01:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034c8c4700 1 -- 172.21.15.33:0/2397869960 learned_addr learned my addr 172.21.15.33:0/2397869960 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:47.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.963+0000 7f034d0c5700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 0x7f0348109c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034c8c4700 1 -- 172.21.15.33:0/2397869960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 msgr2=0x7f0348109c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034c8c4700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 0x7f0348109c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034c8c4700 1 -- 172.21.15.33:0/2397869960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344005040 con 0x7f03480f6860 2022-02-02T15:01:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034c8c4700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f0344009990 tx=0x7f0344009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:47.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0344018070 con 0x7f03480f6860 2022-02-02T15:01:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0344007ba0 con 0x7f03480f6860 2022-02-02T15:01:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f034810c6c0 con 0x7f03480f6860 2022-02-02T15:01:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f034401c620 con 0x7f03480f6860 2022-02-02T15:01:47.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.964+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f034810cbf0 con 0x7f03480f6860 2022-02-02T15:01:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.966+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03480f49b0 con 0x7f03480f6860 2022-02-02T15:01:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.966+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f034401c8e0 con 0x7f03480f6860 2022-02-02T15:01:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.966+0000 7f033dffb700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 0x7f0334067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:47.969 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.967+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f03440839a0 con 0x7f03480f6860 2022-02-02T15:01:47.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.967+0000 7f034d0c5700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 0x7f0334067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:47.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.967+0000 7f034d0c5700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 0x7f0334067290 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f03480600a0 tx=0x7f0338009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:47.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:47.971+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0344051990 con 0x7f03480f6860 2022-02-02T15:01:48.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.161+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03480fdf10 con 0x7f0334064dd0 2022-02-02T15:01:48.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.163+0000 7f033dffb700 1 -- 172.21.15.33:0/2397869960 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f03480fdf10 con 0x7f0334064dd0 2022-02-02T15:01:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.164+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 msgr2=0x7f0334067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.164+0000 7f034f329700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 0x7f0334067290 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f03480600a0 tx=0x7f0338009040).stop 2022-02-02T15:01:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.164+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 msgr2=0x7f034810c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.164+0000 7f034f329700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f0344009990 tx=0x7f0344009b30).stop 2022-02-02T15:01:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 shutdown_connections 2022-02-02T15:01:48.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0334064dd0 0x7f0334067290 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03480f55c0 0x7f0348109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 --2- 172.21.15.33:0/2397869960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03480f6860 0x7f034810c110 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 >> 172.21.15.33:0/2397869960 conn(0x7f03480f0d40 msgr2=0x7f03480fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 shutdown_connections 2022-02-02T15:01:48.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.165+0000 7f034f329700 1 -- 172.21.15.33:0/2397869960 wait complete. 2022-02-02T15:01:48.171 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:01:48.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.265+0000 7f8a69024700 1 -- 172.21.15.33:0/4258176161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f5430 msgr2=0x7f8a640f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.265+0000 7f8a69024700 1 --2- 172.21.15.33:0/4258176161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f5430 0x7f8a640f5850 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f8a54004660 tx=0x7f8a54009b30).stop 2022-02-02T15:01:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 -- 172.21.15.33:0/4258176161 shutdown_connections 2022-02-02T15:01:48.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 --2- 172.21.15.33:0/4258176161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f66d0 0x7f8a640f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 --2- 172.21.15.33:0/4258176161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f5430 0x7f8a640f5850 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 -- 172.21.15.33:0/4258176161 >> 172.21.15.33:0/4258176161 conn(0x7f8a640f0b90 msgr2=0x7f8a640f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 -- 172.21.15.33:0/4258176161 shutdown_connections 2022-02-02T15:01:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 -- 172.21.15.33:0/4258176161 wait complete. 2022-02-02T15:01:48.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.266+0000 7f8a69024700 1 Processor -- start 2022-02-02T15:01:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a69024700 1 -- start start 2022-02-02T15:01:48.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a69024700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f5430 0x7f8a6410be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a69024700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a69024700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640602b0 con 0x7f8a640f66d0 2022-02-02T15:01:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a69024700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a640603f0 con 0x7f8a640f5430 2022-02-02T15:01:48.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35622/0 (socket says 172.21.15.33:35622) 2022-02-02T15:01:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 -- 172.21.15.33:0/2304665274 learned_addr learned my addr 172.21.15.33:0/2304665274 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a63fff700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f5430 0x7f8a6410be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 -- 172.21.15.33:0/2304665274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f5430 msgr2=0x7f8a6410be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f5430 0x7f8a6410be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 -- 172.21.15.33:0/2304665274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a54005040 con 0x7f8a640f66d0 2022-02-02T15:01:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.267+0000 7f8a637fe700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f8a5800e7f0 tx=0x7f8a5800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.268+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a580092e0 con 0x7f8a640f66d0 2022-02-02T15:01:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.268+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8a5800f040 con 0x7f8a640f66d0 2022-02-02T15:01:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.268+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a58014750 con 0x7f8a640f66d0 2022-02-02T15:01:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.268+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6410e830 con 0x7f8a640f66d0 2022-02-02T15:01:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.268+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a6410ecb0 con 0x7f8a640f66d0 2022-02-02T15:01:48.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.269+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a64045ad0 con 0x7f8a640f66d0 2022-02-02T15:01:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.269+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8a5801b030 con 0x7f8a640f66d0 2022-02-02T15:01:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.270+0000 7f8a60ff9700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 0x7f8a4c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.270+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8a58081750 con 0x7f8a640f66d0 2022-02-02T15:01:48.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.270+0000 7f8a63fff700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 0x7f8a4c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.270+0000 7f8a63fff700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 0x7f8a4c0672e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f8a54000c00 tx=0x7f8a5400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.274+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8a5804f8b0 con 0x7f8a640f66d0 2022-02-02T15:01:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.454+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a64057f10 con 0x7f8a4c064e20 2022-02-02T15:01:48.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.469+0000 7f8a60ff9700 1 -- 172.21.15.33:0/2304665274 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8a64057f10 con 0x7f8a4c064e20 2022-02-02T15:01:48.466 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:01:48.466 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (87m) 49m ago 88m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:01:48.467 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (80m) 49m ago 88m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:01:48.467 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (80m) 49m ago 87m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:01:48.467 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (86m) 49m ago 87m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:01:48.467 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (80m) 49m ago 84m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:01:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (81m) 49m ago 84m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:01:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (81m) 49m ago 84m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:01:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (84m) 49m ago 84m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:01:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (81m) 49m ago 89m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:01:48.468 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (81m) 49m ago 87m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:01:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (81m) 49m ago 89m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:01:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (80m) 49m ago 87m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:01:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (87m) 49m ago 87m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:01:48.469 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (87m) 49m ago 87m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:01:48.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 49m ago 86m - 4096M 2022-02-02T15:01:48.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (86m) 49m ago 86m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:01:48.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (86m) 49m ago 86m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:01:48.470 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (85m) 49m ago 85m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:01:48.471 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (85m) 49m ago 85m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:01:48.471 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (85m) 49m ago 85m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:01:48.471 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (86m) 49m ago 87m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:01:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 msgr2=0x7f8a4c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 0x7f8a4c0672e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7f8a54000c00 tx=0x7f8a5400b040).stop 2022-02-02T15:01:48.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 msgr2=0x7f8a6410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f8a5800e7f0 tx=0x7f8a5800b040).stop 2022-02-02T15:01:48.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 shutdown_connections 2022-02-02T15:01:48.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8a4c064e20 0x7f8a4c0672e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a640f5430 0x7f8a6410be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 --2- 172.21.15.33:0/2304665274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8a640f66d0 0x7f8a6410e340 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 >> 172.21.15.33:0/2304665274 conn(0x7f8a640f0b90 msgr2=0x7f8a640fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 shutdown_connections 2022-02-02T15:01:48.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.471+0000 7f8a69024700 1 -- 172.21.15.33:0/2304665274 wait complete. 2022-02-02T15:01:48.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 -- 172.21.15.33:0/3339822133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 msgr2=0x7fb2b40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 --2- 172.21.15.33:0/3339822133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b40f6cc0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7fb2a0004660 tx=0x7fb2a0009b30).stop 2022-02-02T15:01:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 -- 172.21.15.33:0/3339822133 shutdown_connections 2022-02-02T15:01:48.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 --2- 172.21.15.33:0/3339822133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b40f6cc0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 --2- 172.21.15.33:0/3339822133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 0x7fb2b40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.571+0000 7fb2baea5700 1 -- 172.21.15.33:0/3339822133 >> 172.21.15.33:0/3339822133 conn(0x7fb2b40f0d40 msgr2=0x7fb2b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.572+0000 7fb2baea5700 1 -- 172.21.15.33:0/3339822133 shutdown_connections 2022-02-02T15:01:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.572+0000 7fb2baea5700 1 -- 172.21.15.33:0/3339822133 wait complete. 2022-02-02T15:01:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.572+0000 7fb2baea5700 1 Processor -- start 2022-02-02T15:01:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.572+0000 7fb2baea5700 1 -- start start 2022-02-02T15:01:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2baea5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2baea5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2baea5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40603e0 con 0x7fb2b40f6860 2022-02-02T15:01:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2baea5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4060520 con 0x7fb2b40f55c0 2022-02-02T15:01:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35632/0 (socket says 172.21.15.33:35632) 2022-02-02T15:01:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2395216196 learned_addr learned my addr 172.21.15.33:0/2395216196 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b8c41700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2395216196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 msgr2=0x7fb2b4109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2395216196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a0005040 con 0x7fb2b40f6860 2022-02-02T15:01:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.573+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fb2a0009990 tx=0x7fb2a0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.574+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a0018070 con 0x7fb2b40f6860 2022-02-02T15:01:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.574+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb2a0007ba0 con 0x7fb2b40f6860 2022-02-02T15:01:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.574+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b410c6a0 con 0x7fb2b40f6860 2022-02-02T15:01:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.574+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b410cc00 con 0x7fb2b40f6860 2022-02-02T15:01:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.574+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2a001c3c0 con 0x7fb2b40f6860 2022-02-02T15:01:48.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.575+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294004fa0 con 0x7fb2b40f6860 2022-02-02T15:01:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.575+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb2a001d420 con 0x7fb2b40f6860 2022-02-02T15:01:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.576+0000 7fb2b17fa700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 0x7fb2a406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.576+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb2a00836e0 con 0x7fb2b40f6860 2022-02-02T15:01:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.576+0000 7fb2b8c41700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 0x7fb2a406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.576+0000 7fb2b8c41700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 0x7fb2a406b6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fb2b4060060 tx=0x7fb2a8009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.580+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb2a0051730 con 0x7fb2b40f6860 2022-02-02T15:01:48.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.822+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb294005e80 con 0x7fb2b40f6860 2022-02-02T15:01:48.819 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:48 smithi033 ceph-mon[101165]: pgmap v2492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:48.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.823+0000 7fb2b17fa700 1 -- 172.21.15.33:0/2395216196 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb2a0054d50 con 0x7fb2b40f6860 2022-02-02T15:01:48.820 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:01:48.821 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:01:48.821 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:01:48.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:48.821 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:01:48.822 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:01:48.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:48.822 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:01:48.822 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:01:48.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:48.823 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:01:48.823 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:01:48.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:01:48.824 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:01:48.824 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:01:48.824 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:01:48.824 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:01:48.825 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:01:48.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 msgr2=0x7fb2a406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 0x7fb2a406b6a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7fb2b4060060 tx=0x7fb2a8009c00).stop 2022-02-02T15:01:48.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 msgr2=0x7fb2b410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7fb2a0009990 tx=0x7fb2a0009b30).stop 2022-02-02T15:01:48.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 shutdown_connections 2022-02-02T15:01:48.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb2a40691e0 0x7fb2a406b6a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2b40f55c0 0x7fb2b4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 --2- 172.21.15.33:0/2395216196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40f6860 0x7fb2b410c150 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 >> 172.21.15.33:0/2395216196 conn(0x7fb2b40f0d40 msgr2=0x7fb2b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 shutdown_connections 2022-02-02T15:01:48.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.825+0000 7fb2baea5700 1 -- 172.21.15.33:0/2395216196 wait complete. 2022-02-02T15:01:48.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 -- 172.21.15.33:0/3564184617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f77d0 msgr2=0x7f36180f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 --2- 172.21.15.33:0/3564184617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f77d0 0x7f36180f7c30 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 rx=0x7f3604004660 tx=0x7f3604009b30).stop 2022-02-02T15:01:48.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 -- 172.21.15.33:0/3564184617 shutdown_connections 2022-02-02T15:01:48.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 --2- 172.21.15.33:0/3564184617 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f77d0 0x7f36180f7c30 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 --2- 172.21.15.33:0/3564184617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f6530 0x7f36180f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 -- 172.21.15.33:0/3564184617 >> 172.21.15.33:0/3564184617 conn(0x7f36180f1c90 msgr2=0x7f36180f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:48.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 -- 172.21.15.33:0/3564184617 shutdown_connections 2022-02-02T15:01:48.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.926+0000 7f361dff3700 1 -- 172.21.15.33:0/3564184617 wait complete. 2022-02-02T15:01:48.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 Processor -- start 2022-02-02T15:01:48.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 -- start start 2022-02-02T15:01:48.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f77d0 0x7f361810d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361810de10 con 0x7f36180f6530 2022-02-02T15:01:48.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361dff3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361810df50 con 0x7f36180f77d0 2022-02-02T15:01:48.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361cff1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361cff1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35640/0 (socket says 172.21.15.33:35640) 2022-02-02T15:01:48.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f361cff1700 1 -- 172.21.15.33:0/1340137466 learned_addr learned my addr 172.21.15.33:0/1340137466 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:01:48.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.927+0000 7f3617fff700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f77d0 0x7f361810d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361cff1700 1 -- 172.21.15.33:0/1340137466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f77d0 msgr2=0x7f361810d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:48.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361cff1700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f77d0 0x7f361810d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:48.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361cff1700 1 -- 172.21.15.33:0/1340137466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3604005040 con 0x7f36180f6530 2022-02-02T15:01:48.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361cff1700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f360c002700 tx=0x7f360c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c0079c0 con 0x7f36180f6530 2022-02-02T15:01:48.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f360c00f040 con 0x7f36180f6530 2022-02-02T15:01:48.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361810e8f0 con 0x7f36180f6530 2022-02-02T15:01:48.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360c014860 con 0x7f36180f6530 2022-02-02T15:01:48.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.928+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f361810eeb0 con 0x7f36180f6530 2022-02-02T15:01:48.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.929+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3618045ad0 con 0x7f36180f6530 2022-02-02T15:01:48.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.930+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f360c01b060 con 0x7f36180f6530 2022-02-02T15:01:48.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.930+0000 7f36157fa700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 0x7f36080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:01:48.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.930+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f360c081930 con 0x7f36180f6530 2022-02-02T15:01:48.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.930+0000 7f3617fff700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 0x7f36080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:01:48.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.931+0000 7f3617fff700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 0x7f36080672e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f3604004e30 tx=0x7f3604009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:01:48.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:48.934+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f360c053410 con 0x7f36180f6530 2022-02-02T15:01:49.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:48 smithi037 ceph-mon[69017]: pgmap v2492: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:49.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.145+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f36180fee00 con 0x7f36180f6530 2022-02-02T15:01:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.146+0000 7f36157fa700 1 -- 172.21.15.33:0/1340137466 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f360c019070 con 0x7f36180f6530 2022-02-02T15:01:49.143 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:01:49.143 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:01:49.144 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:01:49.144 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:01:49.144 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:49.144 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:01:49.145 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:01:49.145 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:01:49.145 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:01:49.145 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:01:49.145 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:01:49.146 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:01:49.146 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:01:49.146 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:01:49.146 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:01:49.147 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:01:49.147 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:01:49.147 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:01:49.147 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:01:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:01:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:01:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:01:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:01:49.148 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:01:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:01:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:01:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:01:49.149 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:01:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:01:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:01:49.150 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:01:49.150 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:49.151 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:49.151 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:01:49.151 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:01:49.151 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:49.152 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:49.152 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:49.152 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:01:49.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.149+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 msgr2=0x7f36080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:49.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.149+0000 7f361dff3700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 0x7f36080672e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f3604004e30 tx=0x7f3604009b30).stop 2022-02-02T15:01:49.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.149+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 msgr2=0x7f361810d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:01:49.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.149+0000 7f361dff3700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f360c002700 tx=0x7f360c009d80).stop 2022-02-02T15:01:49.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 shutdown_connections 2022-02-02T15:01:49.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3608064e20 0x7f36080672e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:49.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36180f6530 0x7f361810d370 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:49.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 --2- 172.21.15.33:0/1340137466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36180f77d0 0x7f361810d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:01:49.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 >> 172.21.15.33:0/1340137466 conn(0x7f36180f1c90 msgr2=0x7f361806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:01:49.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 shutdown_connections 2022-02-02T15:01:49.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:01:49.150+0000 7f361dff3700 1 -- 172.21.15.33:0/1340137466 wait complete. 2022-02-02T15:01:49.156 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:01:49.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:49 smithi033 ceph-mon[101165]: from='client.36626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:49.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:49 smithi033 ceph-mon[101165]: from='client.36630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:49.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2395216196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:01:49.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1340137466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:01:49.988 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:49 smithi033 ceph-mon[101165]: pgmap v2493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:50.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:49 smithi037 ceph-mon[69017]: from='client.36626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:50.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:49 smithi037 ceph-mon[69017]: from='client.36630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:01:50.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2395216196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:01:50.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1340137466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:01:50.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:49 smithi037 ceph-mon[69017]: pgmap v2493: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:52.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:52 smithi033 ceph-mon[101165]: pgmap v2494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:53.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:52 smithi037 ceph-mon[69017]: pgmap v2494: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:54 smithi033 ceph-mon[101165]: pgmap v2495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:01:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:01:55.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:54 smithi037 ceph-mon[69017]: pgmap v2495: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:55.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:01:55.038 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:01:56.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:56 smithi033 ceph-mon[101165]: pgmap v2496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:57.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:56 smithi037 ceph-mon[69017]: pgmap v2496: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:58.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:01:58 smithi033 ceph-mon[101165]: pgmap v2497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:01:59.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:01:58 smithi037 ceph-mon[69017]: pgmap v2497: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:00.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:00 smithi033 ceph-mon[101165]: pgmap v2498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:01.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:00 smithi037 ceph-mon[69017]: pgmap v2498: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:02.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:02 smithi033 ceph-mon[101165]: pgmap v2499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:03.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:02 smithi037 ceph-mon[69017]: pgmap v2499: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:04.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:04 smithi033 ceph-mon[101165]: pgmap v2500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:05.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:04 smithi037 ceph-mon[69017]: pgmap v2500: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:06.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:06 smithi033 ceph-mon[101165]: pgmap v2501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:07.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:06 smithi037 ceph-mon[69017]: pgmap v2501: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:08.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:08 smithi033 ceph-mon[101165]: pgmap v2502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:09.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:08 smithi037 ceph-mon[69017]: pgmap v2502: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:10.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:10 smithi033 ceph-mon[101165]: pgmap v2503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:11.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:10 smithi037 ceph-mon[69017]: pgmap v2503: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:12.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:12 smithi033 ceph-mon[101165]: pgmap v2504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:13.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:12 smithi037 ceph-mon[69017]: pgmap v2504: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:14.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:14 smithi033 ceph-mon[101165]: pgmap v2505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:15.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:14 smithi037 ceph-mon[69017]: pgmap v2505: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:16.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:16 smithi033 ceph-mon[101165]: pgmap v2506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:17.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:16 smithi037 ceph-mon[69017]: pgmap v2506: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:17.787 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:17 smithi037 ceph-mon[69017]: pgmap v2507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:17.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:17 smithi033 ceph-mon[101165]: pgmap v2507: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:19.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 -- 172.21.15.33:0/486542446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 msgr2=0x7f928c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 --2- 172.21.15.33:0/486542446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c0f7de0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f9280004660 tx=0x7f9280009b30).stop 2022-02-02T15:02:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 -- 172.21.15.33:0/486542446 shutdown_connections 2022-02-02T15:02:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 --2- 172.21.15.33:0/486542446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c0f7de0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 --2- 172.21.15.33:0/486542446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 0x7f928c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 -- 172.21.15.33:0/486542446 >> 172.21.15.33:0/486542446 conn(0x7f928c0f1e40 msgr2=0x7f928c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 -- 172.21.15.33:0/486542446 shutdown_connections 2022-02-02T15:02:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.264+0000 7f9292647700 1 -- 172.21.15.33:0/486542446 wait complete. 2022-02-02T15:02:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 Processor -- start 2022-02-02T15:02:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 -- start start 2022-02-02T15:02:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 0x7f928c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06a380 con 0x7f928c0f7980 2022-02-02T15:02:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f9292647700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c06a4c0 con 0x7f928c0f66e0 2022-02-02T15:02:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f928b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35652/0 (socket says 172.21.15.33:35652) 2022-02-02T15:02:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f928b7fe700 1 -- 172.21.15.33:0/772516466 learned_addr learned my addr 172.21.15.33:0/772516466 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.265+0000 7f928bfff700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 0x7f928c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f928b7fe700 1 -- 172.21.15.33:0/772516466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 msgr2=0x7f928c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f928b7fe700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 0x7f928c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f928b7fe700 1 -- 172.21.15.33:0/772516466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9280005040 con 0x7f928c0f7980 2022-02-02T15:02:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f928b7fe700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f9280009990 tx=0x7f9280009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9280018070 con 0x7f928c0f7980 2022-02-02T15:02:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c06a740 con 0x7f928c0f7980 2022-02-02T15:02:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9280007ba0 con 0x7f928c0f7980 2022-02-02T15:02:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f928001c3c0 con 0x7f928c0f7980 2022-02-02T15:02:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.266+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c06aca0 con 0x7f928c0f7980 2022-02-02T15:02:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.267+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c045ad0 con 0x7f928c0f7980 2022-02-02T15:02:19.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.268+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f928001d420 con 0x7f928c0f7980 2022-02-02T15:02:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.268+0000 7f9288ff9700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 0x7f9274067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.268+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f92800836f0 con 0x7f928c0f7980 2022-02-02T15:02:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.268+0000 7f928bfff700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 0x7f9274067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.268+0000 7f928bfff700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 0x7f9274067290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f928c06b730 tx=0x7f927c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.272+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9280051860 con 0x7f928c0f7980 2022-02-02T15:02:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.459+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f928c057f10 con 0x7f9274064dd0 2022-02-02T15:02:19.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.460+0000 7f9288ff9700 1 -- 172.21.15.33:0/772516466 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f928c057f10 con 0x7f9274064dd0 2022-02-02T15:02:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 msgr2=0x7f9274067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 0x7f9274067290 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f928c06b730 tx=0x7f927c00b040).stop 2022-02-02T15:02:19.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 msgr2=0x7f928c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7f9280009990 tx=0x7f9280009b30).stop 2022-02-02T15:02:19.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 shutdown_connections 2022-02-02T15:02:19.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9274064dd0 0x7f9274067290 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f928c0f66e0 0x7f928c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 --2- 172.21.15.33:0/772516466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f928c0f7980 0x7f928c069e20 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 >> 172.21.15.33:0/772516466 conn(0x7f928c0f1e40 msgr2=0x7f928c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:19.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 shutdown_connections 2022-02-02T15:02:19.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.462+0000 7f9292647700 1 -- 172.21.15.33:0/772516466 wait complete. 2022-02-02T15:02:19.469 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:02:19.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 -- 172.21.15.33:0/3197576991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 msgr2=0x7faa440fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 --2- 172.21.15.33:0/3197576991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa440fbc70 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7faa30004660 tx=0x7faa30009b30).stop 2022-02-02T15:02:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 -- 172.21.15.33:0/3197576991 shutdown_connections 2022-02-02T15:02:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 --2- 172.21.15.33:0/3197576991 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa440fbc70 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 --2- 172.21.15.33:0/3197576991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 0x7faa440f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 -- 172.21.15.33:0/3197576991 >> 172.21.15.33:0/3197576991 conn(0x7faa440f0d40 msgr2=0x7faa440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 -- 172.21.15.33:0/3197576991 shutdown_connections 2022-02-02T15:02:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 -- 172.21.15.33:0/3197576991 wait complete. 2022-02-02T15:02:19.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.564+0000 7faa4ab89700 1 Processor -- start 2022-02-02T15:02:19.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa4ab89700 1 -- start start 2022-02-02T15:02:19.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa4ab89700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 0x7faa44106eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa4ab89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa4ab89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44107950 con 0x7faa440f9820 2022-02-02T15:02:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa4ab89700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa44107a90 con 0x7faa44060310 2022-02-02T15:02:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35662/0 (socket says 172.21.15.33:35662) 2022-02-02T15:02:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa43fff700 1 -- 172.21.15.33:0/2135345927 learned_addr learned my addr 172.21.15.33:0/2135345927 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa48925700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 0x7faa44106eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa43fff700 1 -- 172.21.15.33:0/2135345927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 msgr2=0x7faa44106eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.565+0000 7faa43fff700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 0x7faa44106eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa43fff700 1 -- 172.21.15.33:0/2135345927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa30005040 con 0x7faa440f9820 2022-02-02T15:02:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa43fff700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7faa30014040 tx=0x7faa3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa30019070 con 0x7faa440f9820 2022-02-02T15:02:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faa30007e70 con 0x7faa440f9820 2022-02-02T15:02:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa441083d0 con 0x7faa440f9820 2022-02-02T15:02:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa30014d10 con 0x7faa440f9820 2022-02-02T15:02:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.566+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa44108930 con 0x7faa440f9820 2022-02-02T15:02:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.567+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa44045ad0 con 0x7faa440f9820 2022-02-02T15:02:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.567+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faa30025070 con 0x7faa440f9820 2022-02-02T15:02:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.568+0000 7faa417fa700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 0x7faa34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.568+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faa30082990 con 0x7faa440f9820 2022-02-02T15:02:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.568+0000 7faa48925700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 0x7faa34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.568+0000 7faa48925700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 0x7faa34067290 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7faa38009fd0 tx=0x7faa3800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.572+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faa30054470 con 0x7faa440f9820 2022-02-02T15:02:19.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.756+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faa44108ba0 con 0x7faa34064dd0 2022-02-02T15:02:19.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.771+0000 7faa417fa700 1 -- 172.21.15.33:0/2135345927 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7faa44108ba0 con 0x7faa34064dd0 2022-02-02T15:02:19.768 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:02:19.769 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (87m) 49m ago 88m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:02:19.769 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (80m) 49m ago 88m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:02:19.769 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (80m) 49m ago 88m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:02:19.769 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (87m) 49m ago 88m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:02:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (81m) 49m ago 84m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:02:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (81m) 49m ago 84m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:02:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (82m) 49m ago 84m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:02:19.771 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (84m) 49m ago 84m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:02:19.771 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (82m) 49m ago 89m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:02:19.771 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (81m) 49m ago 88m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:02:19.771 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (81m) 49m ago 90m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:02:19.772 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (81m) 49m ago 87m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:02:19.772 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (88m) 49m ago 88m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:02:19.772 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (87m) 49m ago 87m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:02:19.772 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 49m ago 87m - 4096M 2022-02-02T15:02:19.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (87m) 49m ago 87m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:02:19.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (86m) 49m ago 86m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:02:19.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (86m) 49m ago 86m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:02:19.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (86m) 49m ago 86m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:02:19.773 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (85m) 49m ago 85m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:02:19.774 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (87m) 49m ago 88m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:02:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 msgr2=0x7faa34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 0x7faa34067290 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7faa38009fd0 tx=0x7faa3800b040).stop 2022-02-02T15:02:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 msgr2=0x7faa441073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 rx=0x7faa30014040 tx=0x7faa3000b040).stop 2022-02-02T15:02:19.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 shutdown_connections 2022-02-02T15:02:19.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7faa34064dd0 0x7faa34067290 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa44060310 0x7faa44106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 --2- 172.21.15.33:0/2135345927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa440f9820 0x7faa441073a0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 >> 172.21.15.33:0/2135345927 conn(0x7faa440f0d40 msgr2=0x7faa440f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 shutdown_connections 2022-02-02T15:02:19.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.773+0000 7faa4ab89700 1 -- 172.21.15.33:0/2135345927 wait complete. 2022-02-02T15:02:19.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 -- 172.21.15.33:0/1783652932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 msgr2=0x7f5a2c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1783652932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c0f59e0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7f5a1c004660 tx=0x7f5a1c009b30).stop 2022-02-02T15:02:19.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 -- 172.21.15.33:0/1783652932 shutdown_connections 2022-02-02T15:02:19.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1783652932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1783652932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c0f59e0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 -- 172.21.15.33:0/1783652932 >> 172.21.15.33:0/1783652932 conn(0x7f5a2c0f0d40 msgr2=0x7f5a2c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:19.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 -- 172.21.15.33:0/1783652932 shutdown_connections 2022-02-02T15:02:19.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.873+0000 7f5a31de3700 1 -- 172.21.15.33:0/1783652932 wait complete. 2022-02-02T15:02:19.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 Processor -- start 2022-02-02T15:02:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 -- start start 2022-02-02T15:02:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c106950 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a31de3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2c107160 con 0x7f5a2c0f6860 2022-02-02T15:02:19.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a2b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35670/0 (socket says 172.21.15.33:35670) 2022-02-02T15:02:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.874+0000 7f5a2b7fe700 1 -- 172.21.15.33:0/1839888938 learned_addr learned my addr 172.21.15.33:0/1839888938 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:19.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2affd700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2b7fe700 1 -- 172.21.15.33:0/1839888938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 msgr2=0x7f5a2c106350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:19.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2b7fe700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c106350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2b7fe700 1 -- 172.21.15.33:0/1839888938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c005040 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2affd700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:02:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a2b7fe700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f5a1c000c00 tx=0x7f5a1c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1c019070 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c107380 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5a1c013380 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1c014d30 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.875+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a2c1078e0 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.876+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a2c045ad0 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.877+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5a1c025070 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.877+0000 7f5a23fff700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 0x7f5a18067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:19.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.877+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5a1c082a40 con 0x7f5a2c0f55c0 2022-02-02T15:02:19.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.877+0000 7f5a2affd700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 0x7f5a18067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:19.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.878+0000 7f5a2affd700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 0x7f5a18067270 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5a14004fd0 tx=0x7f5a1400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:19.887 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:19.881+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5a1c050af0 con 0x7f5a2c0f55c0 2022-02-02T15:02:20.121 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.124+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5a2c0ff790 con 0x7f5a2c0f55c0 2022-02-02T15:02:20.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.124+0000 7f5a23fff700 1 -- 172.21.15.33:0/1839888938 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5a1c023070 con 0x7f5a2c0f55c0 2022-02-02T15:02:20.122 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:02:20.122 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:02:20.122 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:02:20.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:20.123 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:02:20.123 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:02:20.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:20.124 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:02:20.124 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:02:20.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:20.124 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:02:20.125 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:02:20.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:20.125 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:02:20.126 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:02:20.126 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:02:20.126 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:02:20.126 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:02:20.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 msgr2=0x7f5a18067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 0x7f5a18067270 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5a14004fd0 tx=0x7f5a1400b040).stop 2022-02-02T15:02:20.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 msgr2=0x7f5a2c105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f5a1c000c00 tx=0x7f5a1c00b040).stop 2022-02-02T15:02:20.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 shutdown_connections 2022-02-02T15:02:20.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5a18064db0 0x7f5a18067270 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a2c0f55c0 0x7f5a2c105e60 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 --2- 172.21.15.33:0/1839888938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a2c0f6860 0x7f5a2c106350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 >> 172.21.15.33:0/1839888938 conn(0x7f5a2c0f0d40 msgr2=0x7f5a2c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 shutdown_connections 2022-02-02T15:02:20.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.126+0000 7f5a31de3700 1 -- 172.21.15.33:0/1839888938 wait complete. 2022-02-02T15:02:20.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- 172.21.15.33:0/716650068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f66d0 msgr2=0x7f9d6c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/716650068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c0f6b30 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f9d60004660 tx=0x7f9d60009b30).stop 2022-02-02T15:02:20.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- 172.21.15.33:0/716650068 shutdown_connections 2022-02-02T15:02:20.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/716650068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c0f6b30 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/716650068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- 172.21.15.33:0/716650068 >> 172.21.15.33:0/716650068 conn(0x7f9d6c0f0b90 msgr2=0x7f9d6c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:20.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- 172.21.15.33:0/716650068 shutdown_connections 2022-02-02T15:02:20.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- 172.21.15.33:0/716650068 wait complete. 2022-02-02T15:02:20.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 Processor -- start 2022-02-02T15:02:20.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 -- start start 2022-02-02T15:02:20.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.228+0000 7f9d6b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:20.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c1093c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:20.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c109970 con 0x7f9d6c0f5430 2022-02-02T15:02:20.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6c109ab0 con 0x7f9d6c0f66d0 2022-02-02T15:02:20.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:20.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35680/0 (socket says 172.21.15.33:35680) 2022-02-02T15:02:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 -- 172.21.15.33:0/3767128415 learned_addr learned my addr 172.21.15.33:0/3767128415 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d69d9b700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c1093c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 -- 172.21.15.33:0/3767128415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f66d0 msgr2=0x7f9d6c1093c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c1093c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 -- 172.21.15.33:0/3767128415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d60005040 con 0x7f9d6c0f5430 2022-02-02T15:02:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6a59c700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f9d5c00e7c0 tx=0x7f9d5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5c0092e0 con 0x7f9d6c0f5430 2022-02-02T15:02:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9d5c00f040 con 0x7f9d6c0f5430 2022-02-02T15:02:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c10a450 con 0x7f9d6c0f5430 2022-02-02T15:02:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d5c0147e0 con 0x7f9d6c0f5430 2022-02-02T15:02:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.229+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d6c10aa10 con 0x7f9d6c0f5430 2022-02-02T15:02:20.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.231+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6c045ad0 con 0x7f9d6c0f5430 2022-02-02T15:02:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.231+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9d5c01b030 con 0x7f9d6c0f5430 2022-02-02T15:02:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.232+0000 7f9d5affd700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 0x7f9d540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.232+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9d5c0817b0 con 0x7f9d6c0f5430 2022-02-02T15:02:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.232+0000 7f9d69d9b700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 0x7f9d540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.232+0000 7f9d69d9b700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 0x7f9d540672e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9d60005010 tx=0x7f9d60016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:20.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.236+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9d5c053340 con 0x7f9d6c0f5430 2022-02-02T15:02:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.446+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9d6c10f4f0 con 0x7f9d6c0f5430 2022-02-02T15:02:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.446+0000 7f9d5affd700 1 -- 172.21.15.33:0/3767128415 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f9d5c019750 con 0x7f9d6c0f5430 2022-02-02T15:02:20.444 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:02:20.444 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:02:20.444 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:02:20.445 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:02:20.445 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:20.445 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:02:20.445 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:02:20.446 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:02:20.446 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:02:20.446 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:02:20.446 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:02:20.446 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:02:20.447 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:02:20.447 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:02:20.447 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:02:20.447 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:02:20.448 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:02:20.448 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:02:20.448 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:02:20.448 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:02:20.449 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:02:20.449 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:02:20.449 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:02:20.449 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:02:20.449 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:02:20.450 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:02:20.450 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:02:20.450 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:02:20.450 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:02:20.451 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:02:20.451 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:02:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:20.451 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:20.451 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:02:20.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:20.452 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:20.452 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:20.452 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:20.453 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:20.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 msgr2=0x7f9d540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 0x7f9d540672e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f9d60005010 tx=0x7f9d60016040).stop 2022-02-02T15:02:20.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 msgr2=0x7f9d6c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:20.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f9d5c00e7c0 tx=0x7f9d5c00b040).stop 2022-02-02T15:02:20.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 shutdown_connections 2022-02-02T15:02:20.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9d54064e20 0x7f9d540672e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d6c0f5430 0x7f9d6c108ed0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 --2- 172.21.15.33:0/3767128415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d6c0f66d0 0x7f9d6c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:20.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 >> 172.21.15.33:0/3767128415 conn(0x7f9d6c0f0b90 msgr2=0x7f9d6c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:20.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 shutdown_connections 2022-02-02T15:02:20.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:20.448+0000 7f9d6b59e700 1 -- 172.21.15.33:0/3767128415 wait complete. 2022-02-02T15:02:20.457 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:02:20.736 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:20 smithi033 ceph-mon[101165]: from='client.36642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:20.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:20 smithi033 ceph-mon[101165]: pgmap v2508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:20.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1839888938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:02:20.737 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3767128415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:02:21.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:20 smithi037 ceph-mon[69017]: from='client.36642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:21.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:20 smithi037 ceph-mon[69017]: pgmap v2508: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:21.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1839888938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:02:21.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3767128415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:02:21.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:21 smithi033 ceph-mon[101165]: from='client.36646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:22.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:21 smithi037 ceph-mon[69017]: from='client.36646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:22.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:22 smithi033 ceph-mon[101165]: pgmap v2509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:23.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:22 smithi037 ceph-mon[69017]: pgmap v2509: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:24.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:24 smithi033 ceph-mon[101165]: pgmap v2510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:25.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:24 smithi037 ceph-mon[69017]: pgmap v2510: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:26.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:26 smithi033 ceph-mon[101165]: pgmap v2511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:27.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:26 smithi037 ceph-mon[69017]: pgmap v2511: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:28.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:28 smithi033 ceph-mon[101165]: pgmap v2512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:29.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:28 smithi037 ceph-mon[69017]: pgmap v2512: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:30.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:30 smithi033 ceph-mon[101165]: pgmap v2513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:31.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:30 smithi037 ceph-mon[69017]: pgmap v2513: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:32.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:32 smithi033 ceph-mon[101165]: pgmap v2514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:33.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:32 smithi037 ceph-mon[69017]: pgmap v2514: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:34.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:34 smithi033 ceph-mon[101165]: pgmap v2515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:35.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:34 smithi037 ceph-mon[69017]: pgmap v2515: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:36.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:36 smithi033 ceph-mon[101165]: pgmap v2516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:37.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:36 smithi037 ceph-mon[69017]: pgmap v2516: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:38.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:38 smithi033 ceph-mon[101165]: pgmap v2517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:39.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:38 smithi037 ceph-mon[69017]: pgmap v2517: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:40.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:40 smithi033 ceph-mon[101165]: pgmap v2518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:41.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:40 smithi037 ceph-mon[69017]: pgmap v2518: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:42.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:42 smithi033 ceph-mon[101165]: pgmap v2519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:43.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:42 smithi037 ceph-mon[69017]: pgmap v2519: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:43.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:43 smithi033 ceph-mon[101165]: pgmap v2520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:44.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:43 smithi037 ceph-mon[69017]: pgmap v2520: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:46.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:46 smithi033 ceph-mon[101165]: pgmap v2521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:47.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:46 smithi037 ceph-mon[69017]: pgmap v2521: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:48.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:48 smithi033 ceph-mon[101165]: pgmap v2522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:49.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:48 smithi037 ceph-mon[69017]: pgmap v2522: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:50.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.564+0000 7f6ed7532700 1 -- 172.21.15.33:0/225873690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 msgr2=0x7f6ed00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.564+0000 7f6ed7532700 1 --2- 172.21.15.33:0/225873690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed00f7de0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f6ec4004660 tx=0x7f6ec4009b30).stop 2022-02-02T15:02:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 -- 172.21.15.33:0/225873690 shutdown_connections 2022-02-02T15:02:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 --2- 172.21.15.33:0/225873690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed00f7de0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 --2- 172.21.15.33:0/225873690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 -- 172.21.15.33:0/225873690 >> 172.21.15.33:0/225873690 conn(0x7f6ed00f1e40 msgr2=0x7f6ed00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 -- 172.21.15.33:0/225873690 shutdown_connections 2022-02-02T15:02:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 -- 172.21.15.33:0/225873690 wait complete. 2022-02-02T15:02:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 Processor -- start 2022-02-02T15:02:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.565+0000 7f6ed7532700 1 -- start start 2022-02-02T15:02:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed7532700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed0106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed7532700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed7532700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed01079b0 con 0x7f6ed00f7980 2022-02-02T15:02:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed7532700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed0107af0 con 0x7f6ed00f66e0 2022-02-02T15:02:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35692/0 (socket says 172.21.15.33:35692) 2022-02-02T15:02:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 -- 172.21.15.33:0/1566281254 learned_addr learned my addr 172.21.15.33:0/1566281254 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed52ce700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed0106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 -- 172.21.15.33:0/1566281254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 msgr2=0x7f6ed0106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed0106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 -- 172.21.15.33:0/1566281254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4005040 con 0x7f6ed00f7980 2022-02-02T15:02:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed52ce700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed0106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:02:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.566+0000 7f6ed4acd700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f6ec4009990 tx=0x7f6ec4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.567+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec4018070 con 0x7f6ed00f7980 2022-02-02T15:02:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.567+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6ec4007ba0 con 0x7f6ed00f7980 2022-02-02T15:02:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.567+0000 7f6ed7532700 1 -- 172.21.15.33:0/1566281254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed0108430 con 0x7f6ed00f7980 2022-02-02T15:02:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.567+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ec401c3c0 con 0x7f6ed00f7980 2022-02-02T15:02:50.569 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.567+0000 7f6ed7532700 1 -- 172.21.15.33:0/1566281254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed0108990 con 0x7f6ed00f7980 2022-02-02T15:02:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.568+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea8004fa0 con 0x7f6ed00f7980 2022-02-02T15:02:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.568+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6ec401d420 con 0x7f6ed00f7980 2022-02-02T15:02:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.569+0000 7f6ec1ffb700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 0x7f6ebc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.569+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6ec40836f0 con 0x7f6ed00f7980 2022-02-02T15:02:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.569+0000 7f6ed52ce700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 0x7f6ebc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.569+0000 7f6ed52ce700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 0x7f6ebc067290 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f6ed00f77e0 tx=0x7f6ecc009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:50.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.573+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6ec4055170 con 0x7f6ed00f7980 2022-02-02T15:02:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.761+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ea8000bc0 con 0x7f6ebc064dd0 2022-02-02T15:02:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.763+0000 7f6ec1ffb700 1 -- 172.21.15.33:0/1566281254 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6ea8000bc0 con 0x7f6ebc064dd0 2022-02-02T15:02:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 msgr2=0x7f6ebc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 0x7f6ebc067290 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f6ed00f77e0 tx=0x7f6ecc009c80).stop 2022-02-02T15:02:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 msgr2=0x7f6ed0107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f6ec4009990 tx=0x7f6ec4009b30).stop 2022-02-02T15:02:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 shutdown_connections 2022-02-02T15:02:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6ebc064dd0 0x7f6ebc067290 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed00f66e0 0x7f6ed0106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 --2- 172.21.15.33:0/1566281254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ed00f7980 0x7f6ed0107400 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 >> 172.21.15.33:0/1566281254 conn(0x7f6ed00f1e40 msgr2=0x7f6ed00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 shutdown_connections 2022-02-02T15:02:50.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.765+0000 7f6ebb7fe700 1 -- 172.21.15.33:0/1566281254 wait complete. 2022-02-02T15:02:50.770 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:02:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 -- 172.21.15.33:0/923704882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f55c0 msgr2=0x7f40580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 --2- 172.21.15.33:0/923704882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f55c0 0x7f40580f59e0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f4054004660 tx=0x7f4054009b30).stop 2022-02-02T15:02:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 -- 172.21.15.33:0/923704882 shutdown_connections 2022-02-02T15:02:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 --2- 172.21.15.33:0/923704882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f6860 0x7f40580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 --2- 172.21.15.33:0/923704882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f55c0 0x7f40580f59e0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 -- 172.21.15.33:0/923704882 >> 172.21.15.33:0/923704882 conn(0x7f40580f0d40 msgr2=0x7f40580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:50.863 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:50 smithi033 ceph-mon[101165]: pgmap v2523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 -- 172.21.15.33:0/923704882 shutdown_connections 2022-02-02T15:02:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.866+0000 7f405f7f9700 1 -- 172.21.15.33:0/923704882 wait complete. 2022-02-02T15:02:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 Processor -- start 2022-02-02T15:02:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 -- start start 2022-02-02T15:02:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f55c0 0x7f4058105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058106950 con 0x7f40580f6860 2022-02-02T15:02:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405f7f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4058107160 con 0x7f40580f55c0 2022-02-02T15:02:50.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35702/0 (socket says 172.21.15.33:35702) 2022-02-02T15:02:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 -- 172.21.15.33:0/3527575442 learned_addr learned my addr 172.21.15.33:0/3527575442 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:50.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405d595700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f55c0 0x7f4058105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 -- 172.21.15.33:0/3527575442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f55c0 msgr2=0x7f4058105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f55c0 0x7f4058105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 -- 172.21.15.33:0/3527575442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4054005040 con 0x7f40580f6860 2022-02-02T15:02:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.867+0000 7f405cd94700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f404c00e7f0 tx=0x7f404c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.868+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c0092e0 con 0x7f40580f6860 2022-02-02T15:02:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.868+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f404c00f040 con 0x7f40580f6860 2022-02-02T15:02:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.868+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40581073e0 con 0x7f40580f6860 2022-02-02T15:02:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.868+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f404c014750 con 0x7f40580f6860 2022-02-02T15:02:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.868+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40581079a0 con 0x7f40580f6860 2022-02-02T15:02:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.869+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40580f49b0 con 0x7f40580f6860 2022-02-02T15:02:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.869+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f404c01b030 con 0x7f40580f6860 2022-02-02T15:02:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.870+0000 7f4049ffb700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 0x7f4044067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:50.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.870+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f404c081810 con 0x7f40580f6860 2022-02-02T15:02:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.870+0000 7f405d595700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 0x7f4044067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.870+0000 7f405d595700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 0x7f4044067290 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f4054000c00 tx=0x7f405400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:50.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:50.874+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f404c04f8b0 con 0x7f40580f6860 2022-02-02T15:02:51.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:50 smithi037 ceph-mon[69017]: pgmap v2523: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:51.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.057+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40580fddf0 con 0x7f4044064dd0 2022-02-02T15:02:51.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.071+0000 7f4049ffb700 1 -- 172.21.15.33:0/3527575442 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f40580fddf0 con 0x7f4044064dd0 2022-02-02T15:02:51.067 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:02:51.068 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (88m) 50m ago 89m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:02:51.068 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (81m) 50m ago 89m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:02:51.068 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (81m) 50m ago 88m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:02:51.068 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (88m) 50m ago 88m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:02:51.069 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (81m) 50m ago 85m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:02:51.069 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (82m) 50m ago 85m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:02:51.069 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (83m) 50m ago 85m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:02:51.070 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (85m) 50m ago 85m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:02:51.070 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (82m) 50m ago 90m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:02:51.070 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (82m) 50m ago 88m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:02:51.070 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (82m) 50m ago 90m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:02:51.071 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (81m) 50m ago 88m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:02:51.071 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (88m) 50m ago 88m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:02:51.071 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (88m) 50m ago 88m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:02:51.071 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 50m ago 87m - 4096M 2022-02-02T15:02:51.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (87m) 50m ago 87m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:02:51.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (87m) 50m ago 87m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:02:51.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (87m) 50m ago 87m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:02:51.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (86m) 50m ago 86m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:02:51.072 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (86m) 50m ago 86m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:02:51.073 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (87m) 50m ago 88m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:02:51.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 msgr2=0x7f4044067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 0x7f4044067290 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7f4054000c00 tx=0x7f405400b040).stop 2022-02-02T15:02:51.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 msgr2=0x7f4058106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f404c00e7f0 tx=0x7f404c00b040).stop 2022-02-02T15:02:51.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 shutdown_connections 2022-02-02T15:02:51.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4044064dd0 0x7f4044067290 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40580f55c0 0x7f4058105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 --2- 172.21.15.33:0/3527575442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40580f6860 0x7f4058106350 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 >> 172.21.15.33:0/3527575442 conn(0x7f40580f0d40 msgr2=0x7f40580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:51.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.073+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 shutdown_connections 2022-02-02T15:02:51.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.074+0000 7f405f7f9700 1 -- 172.21.15.33:0/3527575442 wait complete. 2022-02-02T15:02:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 -- 172.21.15.33:0/1981792582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 msgr2=0x7f10e80f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/1981792582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e80f6b30 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f10dc004660 tx=0x7f10dc009b30).stop 2022-02-02T15:02:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 -- 172.21.15.33:0/1981792582 shutdown_connections 2022-02-02T15:02:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/1981792582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e80f6b30 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/1981792582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 0x7f10e80f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.173+0000 7f10ecc4a700 1 -- 172.21.15.33:0/1981792582 >> 172.21.15.33:0/1981792582 conn(0x7f10e80f0b90 msgr2=0x7f10e80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:51.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 -- 172.21.15.33:0/1981792582 shutdown_connections 2022-02-02T15:02:51.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 -- 172.21.15.33:0/1981792582 wait complete. 2022-02-02T15:02:51.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 Processor -- start 2022-02-02T15:02:51.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 -- start start 2022-02-02T15:02:51.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 0x7f10e8106d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.174+0000 7f10ecc4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10ecc4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e8107870 con 0x7f10e80f66d0 2022-02-02T15:02:51.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10ecc4a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e81080b0 con 0x7f10e80f5430 2022-02-02T15:02:51.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35712/0 (socket says 172.21.15.33:35712) 2022-02-02T15:02:51.177 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 -- 172.21.15.33:0/658631467 learned_addr learned my addr 172.21.15.33:0/658631467 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e77fe700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 0x7f10e8106d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 -- 172.21.15.33:0/658631467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 msgr2=0x7f10e8106d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 0x7f10e8106d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.178 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 -- 172.21.15.33:0/658631467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc005040 con 0x7f10e80f66d0 2022-02-02T15:02:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10e6ffd700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f10dc009990 tx=0x7f10dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc018070 con 0x7f10e80f66d0 2022-02-02T15:02:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e8108330 con 0x7f10e80f66d0 2022-02-02T15:02:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f10dc007ba0 con 0x7f10e80f66d0 2022-02-02T15:02:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc01c3c0 con 0x7f10e80f66d0 2022-02-02T15:02:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.175+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e8108810 con 0x7f10e80f66d0 2022-02-02T15:02:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.177+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e8059100 con 0x7f10e80f66d0 2022-02-02T15:02:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.177+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f10dc01d420 con 0x7f10e80f66d0 2022-02-02T15:02:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.177+0000 7f10cffff700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 0x7f10d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.177+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f10dc0837c0 con 0x7f10e80f66d0 2022-02-02T15:02:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.178+0000 7f10e77fe700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 0x7f10d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.178+0000 7f10e77fe700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 0x7f10d00672e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f10e8107b40 tx=0x7f10d8009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.182+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f10dc051930 con 0x7f10e80f66d0 2022-02-02T15:02:51.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.426+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f10e810d2f0 con 0x7f10e80f66d0 2022-02-02T15:02:51.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.427+0000 7f10cffff700 1 -- 172.21.15.33:0/658631467 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f10dc054f50 con 0x7f10e80f66d0 2022-02-02T15:02:51.423 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:02:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:02:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:02:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:02:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:02:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:02:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:02:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:02:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:02:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:02:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:02:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:02:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:02:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:02:51.427 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:02:51.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 msgr2=0x7f10d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 0x7f10d00672e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f10e8107b40 tx=0x7f10d8009c00).stop 2022-02-02T15:02:51.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 msgr2=0x7f10e8107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f10dc009990 tx=0x7f10dc009b30).stop 2022-02-02T15:02:51.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 shutdown_connections 2022-02-02T15:02:51.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f10d0064e20 0x7f10d00672e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10e80f5430 0x7f10e8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 --2- 172.21.15.33:0/658631467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10e80f66d0 0x7f10e8107270 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.428+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 >> 172.21.15.33:0/658631467 conn(0x7f10e80f0b90 msgr2=0x7f10e805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.429+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 shutdown_connections 2022-02-02T15:02:51.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.429+0000 7f10ecc4a700 1 -- 172.21.15.33:0/658631467 wait complete. 2022-02-02T15:02:51.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 -- 172.21.15.33:0/1478723393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 msgr2=0x7f8cc00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1478723393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc00f7de0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f8ca8004660 tx=0x7f8ca8009b30).stop 2022-02-02T15:02:51.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 -- 172.21.15.33:0/1478723393 shutdown_connections 2022-02-02T15:02:51.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1478723393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc00f7de0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1478723393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 -- 172.21.15.33:0/1478723393 >> 172.21.15.33:0/1478723393 conn(0x7f8cc00f1e40 msgr2=0x7f8cc00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:51.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 -- 172.21.15.33:0/1478723393 shutdown_connections 2022-02-02T15:02:51.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.530+0000 7f8cc5598700 1 -- 172.21.15.33:0/1478723393 wait complete. 2022-02-02T15:02:51.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 Processor -- start 2022-02-02T15:02:51.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 -- start start 2022-02-02T15:02:51.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc0106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0107a20 con 0x7f8cc00f7980 2022-02-02T15:02:51.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cc5598700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc0107b60 con 0x7f8cc00f66e0 2022-02-02T15:02:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35722/0 (socket says 172.21.15.33:35722) 2022-02-02T15:02:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 -- 172.21.15.33:0/1107801964 learned_addr learned my addr 172.21.15.33:0/1107801964 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:02:51.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbeffd700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc0106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 -- 172.21.15.33:0/1107801964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 msgr2=0x7f8cc0106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc0106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.531+0000 7f8cbe7fc700 1 -- 172.21.15.33:0/1107801964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8005040 con 0x7f8cc00f7980 2022-02-02T15:02:51.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cbeffd700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:02:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cbe7fc700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f8ca8009990 tx=0x7f8ca8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca8018070 con 0x7f8cc00f7980 2022-02-02T15:02:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8ca8007ba0 con 0x7f8cc00f7980 2022-02-02T15:02:51.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ca801c3c0 con 0x7f8cc00f7980 2022-02-02T15:02:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc01084a0 con 0x7f8cc00f7980 2022-02-02T15:02:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.532+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc0108a00 con 0x7f8cc00f7980 2022-02-02T15:02:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.533+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc0045ad0 con 0x7f8cc00f7980 2022-02-02T15:02:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.533+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8ca801d420 con 0x7f8cc00f7980 2022-02-02T15:02:51.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.534+0000 7f8cb77fe700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 0x7f8cac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:02:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.534+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8ca8083760 con 0x7f8cc00f7980 2022-02-02T15:02:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.534+0000 7f8cbeffd700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 0x7f8cac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:02:51.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.534+0000 7f8cbeffd700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 0x7f8cac067290 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8cc00f77e0 tx=0x7f8cb0009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:02:51.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.538+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8ca80552a0 con 0x7f8cc00f7980 2022-02-02T15:02:51.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.749+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8cc0027a00 con 0x7f8cc00f7980 2022-02-02T15:02:51.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.750+0000 7f8cb77fe700 1 -- 172.21.15.33:0/1107801964 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f8ca8054e90 con 0x7f8cc00f7980 2022-02-02T15:02:51.746 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:02:51.746 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:02:51.746 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:02:51.747 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:02:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:51.747 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:02:51.747 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:02:51.748 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:02:51.748 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:02:51.748 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:02:51.748 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:02:51.748 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:02:51.749 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:02:51.749 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:02:51.749 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:02:51.749 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:02:51.750 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:02:51.750 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:02:51.750 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:02:51.750 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:02:51.750 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:02:51.751 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:02:51.751 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:02:51.751 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:02:51.751 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:02:51.752 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:02:51.752 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:02:51.752 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:02:51.752 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:02:51.752 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:02:51.753 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:02:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:51.753 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:02:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:02:51.754 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:51.754 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:51.754 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:51.754 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:02:51.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 msgr2=0x7f8cac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 0x7f8cac067290 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7f8cc00f77e0 tx=0x7f8cb0009be0).stop 2022-02-02T15:02:51.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 msgr2=0x7f8cc0107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:02:51.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f8ca8009990 tx=0x7f8ca8009b30).stop 2022-02-02T15:02:51.756 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 shutdown_connections 2022-02-02T15:02:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8cac064dd0 0x7f8cac067290 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc00f66e0 0x7f8cc0106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 --2- 172.21.15.33:0/1107801964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8cc00f7980 0x7f8cc0107470 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:02:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 >> 172.21.15.33:0/1107801964 conn(0x7f8cc00f1e40 msgr2=0x7f8cc00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:02:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 shutdown_connections 2022-02-02T15:02:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:02:51.752+0000 7f8cc5598700 1 -- 172.21.15.33:0/1107801964 wait complete. 2022-02-02T15:02:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:02:51.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/658631467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:02:52.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/658631467' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:02:52.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:52 smithi033 ceph-mon[101165]: from='client.36658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:52.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:52 smithi033 ceph-mon[101165]: from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:52.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:52 smithi033 ceph-mon[101165]: pgmap v2524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:52.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:52 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1107801964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:02:53.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:52 smithi037 ceph-mon[69017]: from='client.36658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:53.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:52 smithi037 ceph-mon[69017]: from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:02:53.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:52 smithi037 ceph-mon[69017]: pgmap v2524: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:53.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:52 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1107801964' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:02:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:54 smithi033 ceph-mon[101165]: pgmap v2525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:02:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:02:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:54 smithi037 ceph-mon[69017]: pgmap v2525: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:02:55.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:02:56.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:56 smithi033 ceph-mon[101165]: pgmap v2526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:57.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:56 smithi037 ceph-mon[69017]: pgmap v2526: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:58.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:02:58 smithi033 ceph-mon[101165]: pgmap v2527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:02:59.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:02:58 smithi037 ceph-mon[69017]: pgmap v2527: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:00.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:00 smithi033 ceph-mon[101165]: pgmap v2528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:01.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:00 smithi037 ceph-mon[69017]: pgmap v2528: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:02.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:02 smithi033 ceph-mon[101165]: pgmap v2529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:03.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:02 smithi037 ceph-mon[69017]: pgmap v2529: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:04.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:04 smithi033 ceph-mon[101165]: pgmap v2530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:05.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:04 smithi037 ceph-mon[69017]: pgmap v2530: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:06.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:06 smithi033 ceph-mon[101165]: pgmap v2531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:07.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:06 smithi037 ceph-mon[69017]: pgmap v2531: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:07.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:07 smithi033 ceph-mon[101165]: pgmap v2532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:08.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:07 smithi037 ceph-mon[69017]: pgmap v2532: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:10.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:10 smithi033 ceph-mon[101165]: pgmap v2533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:11.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:10 smithi037 ceph-mon[69017]: pgmap v2533: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:12.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:12 smithi033 ceph-mon[101165]: pgmap v2534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:13.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:12 smithi037 ceph-mon[69017]: pgmap v2534: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:14.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:14 smithi033 ceph-mon[101165]: pgmap v2535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:15.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:14 smithi037 ceph-mon[69017]: pgmap v2535: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:16.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:16 smithi033 ceph-mon[101165]: pgmap v2536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:17.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:16 smithi037 ceph-mon[69017]: pgmap v2536: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:18.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:18 smithi033 ceph-mon[101165]: pgmap v2537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:19.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:18 smithi037 ceph-mon[69017]: pgmap v2537: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:20.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:20 smithi033 ceph-mon[101165]: pgmap v2538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:21.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:20 smithi037 ceph-mon[69017]: pgmap v2538: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:21.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 -- 172.21.15.33:0/2868797047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 msgr2=0x7fcad40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:21.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 --2- 172.21.15.33:0/2868797047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad40f6cc0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fcac8004660 tx=0x7fcac8009b30).stop 2022-02-02T15:03:21.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 -- 172.21.15.33:0/2868797047 shutdown_connections 2022-02-02T15:03:21.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 --2- 172.21.15.33:0/2868797047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad40f6cc0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 --2- 172.21.15.33:0/2868797047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 0x7fcad40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 -- 172.21.15.33:0/2868797047 >> 172.21.15.33:0/2868797047 conn(0x7fcad40f0d40 msgr2=0x7fcad40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 -- 172.21.15.33:0/2868797047 shutdown_connections 2022-02-02T15:03:21.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 -- 172.21.15.33:0/2868797047 wait complete. 2022-02-02T15:03:21.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.866+0000 7fcad9d93700 1 Processor -- start 2022-02-02T15:03:21.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad9d93700 1 -- start start 2022-02-02T15:03:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad9d93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 0x7fcad4106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad9d93700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad9d93700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4107990 con 0x7fcad40f6860 2022-02-02T15:03:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad9d93700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4107ad0 con 0x7fcad40f55c0 2022-02-02T15:03:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35732/0 (socket says 172.21.15.33:35732) 2022-02-02T15:03:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 -- 172.21.15.33:0/1072419491 learned_addr learned my addr 172.21.15.33:0/1072419491 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:21.869 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad37fe700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 0x7fcad4106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 -- 172.21.15.33:0/1072419491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 msgr2=0x7fcad4106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 0x7fcad4106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 -- 172.21.15.33:0/1072419491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac8005040 con 0x7fcad40f6860 2022-02-02T15:03:21.870 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.867+0000 7fcad2ffd700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcac8000c00 tx=0x7fcac800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:21.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.868+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac8019070 con 0x7fcad40f6860 2022-02-02T15:03:21.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.868+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcac8007e70 con 0x7fcad40f6860 2022-02-02T15:03:21.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.868+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac8014ce0 con 0x7fcad40f6860 2022-02-02T15:03:21.871 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.868+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad4108410 con 0x7fcad40f6860 2022-02-02T15:03:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.868+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad4108970 con 0x7fcad40f6860 2022-02-02T15:03:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.869+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad4045ad0 con 0x7fcad40f6860 2022-02-02T15:03:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.869+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcac8025070 con 0x7fcad40f6860 2022-02-02T15:03:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.870+0000 7fcabbfff700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 0x7fcabc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.870+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcac80829f0 con 0x7fcad40f6860 2022-02-02T15:03:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.870+0000 7fcad37fe700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 0x7fcabc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.870+0000 7fcad37fe700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 0x7fcabc067290 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fcac4009fd0 tx=0x7fcac400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:21.874+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcac8084e60 con 0x7fcad40f6860 2022-02-02T15:03:22.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.064+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcad40faca0 con 0x7fcabc064dd0 2022-02-02T15:03:22.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.065+0000 7fcabbfff700 1 -- 172.21.15.33:0/1072419491 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fcad40faca0 con 0x7fcabc064dd0 2022-02-02T15:03:22.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 msgr2=0x7fcabc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 0x7fcabc067290 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fcac4009fd0 tx=0x7fcac400b040).stop 2022-02-02T15:03:22.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 msgr2=0x7fcad41073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 rx=0x7fcac8000c00 tx=0x7fcac800b040).stop 2022-02-02T15:03:22.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 shutdown_connections 2022-02-02T15:03:22.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcabc064dd0 0x7fcabc067290 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcad40f55c0 0x7fcad4106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 --2- 172.21.15.33:0/1072419491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcad40f6860 0x7fcad41073e0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 >> 172.21.15.33:0/1072419491 conn(0x7fcad40f0d40 msgr2=0x7fcad405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 shutdown_connections 2022-02-02T15:03:22.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.067+0000 7fcad9d93700 1 -- 172.21.15.33:0/1072419491 wait complete. 2022-02-02T15:03:22.073 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:03:22.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 -- 172.21.15.33:0/66657423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f55c0 msgr2=0x7f6a740f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 --2- 172.21.15.33:0/66657423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f55c0 0x7f6a740f59e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f6a64004660 tx=0x7f6a64009b30).stop 2022-02-02T15:03:22.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 -- 172.21.15.33:0/66657423 shutdown_connections 2022-02-02T15:03:22.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 --2- 172.21.15.33:0/66657423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f5ed0 0x7f6a740f6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 --2- 172.21.15.33:0/66657423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f55c0 0x7f6a740f59e0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.168+0000 7f6a795e2700 1 -- 172.21.15.33:0/66657423 >> 172.21.15.33:0/66657423 conn(0x7f6a740f0de0 msgr2=0x7f6a740f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.169+0000 7f6a795e2700 1 -- 172.21.15.33:0/66657423 shutdown_connections 2022-02-02T15:03:22.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.169+0000 7f6a795e2700 1 -- 172.21.15.33:0/66657423 wait complete. 2022-02-02T15:03:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.169+0000 7f6a795e2700 1 Processor -- start 2022-02-02T15:03:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a795e2700 1 -- start start 2022-02-02T15:03:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a795e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f55c0 0x7f6a7410bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a795e2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a795e2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74060430 con 0x7f6a740f5ed0 2022-02-02T15:03:22.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a795e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a74060570 con 0x7f6a740f55c0 2022-02-02T15:03:22.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35742/0 (socket says 172.21.15.33:35742) 2022-02-02T15:03:22.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 -- 172.21.15.33:0/57020847 learned_addr learned my addr 172.21.15.33:0/57020847 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:22.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a72ffd700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f55c0 0x7f6a7410bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 -- 172.21.15.33:0/57020847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f55c0 msgr2=0x7f6a7410bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f55c0 0x7f6a7410bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 -- 172.21.15.33:0/57020847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64005040 con 0x7f6a740f5ed0 2022-02-02T15:03:22.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.170+0000 7f6a727fc700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f6a6800e7f0 tx=0x7f6a6800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.171+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a680092e0 con 0x7f6a740f5ed0 2022-02-02T15:03:22.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.171+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7410e9c0 con 0x7f6a740f5ed0 2022-02-02T15:03:22.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.171+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a6800f040 con 0x7f6a740f5ed0 2022-02-02T15:03:22.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.171+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a68014750 con 0x7f6a740f5ed0 2022-02-02T15:03:22.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.171+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7410ee40 con 0x7f6a740f5ed0 2022-02-02T15:03:22.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.172+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a74045ad0 con 0x7f6a740f5ed0 2022-02-02T15:03:22.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.172+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a6801b030 con 0x7f6a740f5ed0 2022-02-02T15:03:22.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.173+0000 7f6a5b7fe700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 0x7f6a5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.173+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6a68081820 con 0x7f6a740f5ed0 2022-02-02T15:03:22.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.173+0000 7f6a72ffd700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 0x7f6a5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.173+0000 7f6a72ffd700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 0x7f6a5c067290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f6a64004d80 tx=0x7f6a64016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.177+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a6804f980 con 0x7f6a740f5ed0 2022-02-02T15:03:22.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.359+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a740fde80 con 0x7f6a5c064dd0 2022-02-02T15:03:22.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.374+0000 7f6a5b7fe700 1 -- 172.21.15.33:0/57020847 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6a740fde80 con 0x7f6a5c064dd0 2022-02-02T15:03:22.371 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:03:22.371 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (88m) 50m ago 89m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:03:22.371 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (81m) 50m ago 89m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:03:22.371 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (81m) 50m ago 89m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:03:22.372 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (88m) 50m ago 89m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:03:22.372 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (82m) 50m ago 85m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:03:22.372 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (82m) 50m ago 85m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:03:22.372 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (83m) 50m ago 85m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:03:22.373 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (85m) 50m ago 85m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:03:22.373 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (83m) 50m ago 90m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:03:22.373 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (82m) 50m ago 89m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:03:22.373 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (82m) 50m ago 91m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:03:22.373 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (82m) 50m ago 89m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:03:22.374 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (89m) 50m ago 89m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:03:22.374 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (88m) 50m ago 88m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:03:22.374 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 50m ago 88m - 4096M 2022-02-02T15:03:22.374 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (88m) 50m ago 88m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:03:22.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (87m) 50m ago 87m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:03:22.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (87m) 50m ago 87m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:03:22.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (87m) 50m ago 87m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:03:22.375 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (86m) 50m ago 86m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:03:22.375 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (88m) 50m ago 89m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:03:22.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 msgr2=0x7f6a5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 0x7f6a5c067290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7f6a64004d80 tx=0x7f6a64016040).stop 2022-02-02T15:03:22.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 msgr2=0x7f6a7410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7f6a6800e7f0 tx=0x7f6a6800b040).stop 2022-02-02T15:03:22.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 shutdown_connections 2022-02-02T15:03:22.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a5c064dd0 0x7f6a5c067290 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a740f55c0 0x7f6a7410bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 --2- 172.21.15.33:0/57020847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a740f5ed0 0x7f6a7410e4d0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 >> 172.21.15.33:0/57020847 conn(0x7f6a740f0de0 msgr2=0x7f6a740fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 shutdown_connections 2022-02-02T15:03:22.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.376+0000 7f6a795e2700 1 -- 172.21.15.33:0/57020847 wait complete. 2022-02-02T15:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 -- 172.21.15.33:0/583952732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f6860 msgr2=0x7f6c400f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 --2- 172.21.15.33:0/583952732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f6860 0x7f6c400f6cc0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f6c30004660 tx=0x7f6c30009b30).stop 2022-02-02T15:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 -- 172.21.15.33:0/583952732 shutdown_connections 2022-02-02T15:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 --2- 172.21.15.33:0/583952732 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f6860 0x7f6c400f6cc0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 --2- 172.21.15.33:0/583952732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f55c0 0x7f6c400f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 -- 172.21.15.33:0/583952732 >> 172.21.15.33:0/583952732 conn(0x7f6c400f0d40 msgr2=0x7f6c400f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 -- 172.21.15.33:0/583952732 shutdown_connections 2022-02-02T15:03:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 -- 172.21.15.33:0/583952732 wait complete. 2022-02-02T15:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.476+0000 7f6c475f4700 1 Processor -- start 2022-02-02T15:03:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c475f4700 1 -- start start 2022-02-02T15:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c475f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c475f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 0x7f6c4010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c475f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c400603e0 con 0x7f6c400f55c0 2022-02-02T15:03:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c475f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c40060520 con 0x7f6c400f6860 2022-02-02T15:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35750/0 (socket says 172.21.15.33:35750) 2022-02-02T15:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 -- 172.21.15.33:0/974795589 learned_addr learned my addr 172.21.15.33:0/974795589 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 -- 172.21.15.33:0/974795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 msgr2=0x7f6c4010c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c44b8f700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 0x7f6c4010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 0x7f6c4010c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 -- 172.21.15.33:0/974795589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30005040 con 0x7f6c400f55c0 2022-02-02T15:03:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c44b8f700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 0x7f6c4010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:03:22.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.477+0000 7f6c45390700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f6c3c002700 tx=0x7f6c3c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.478+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3c009320 con 0x7f6c400f55c0 2022-02-02T15:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.478+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c3c00f040 con 0x7f6c400f55c0 2022-02-02T15:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.478+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c3c014900 con 0x7f6c400f55c0 2022-02-02T15:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.478+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4010c700 con 0x7f6c400f55c0 2022-02-02T15:03:22.479 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.478+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4010ccc0 con 0x7f6c400f55c0 2022-02-02T15:03:22.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.479+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c40045ad0 con 0x7f6c400f55c0 2022-02-02T15:03:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.479+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c3c009480 con 0x7f6c400f55c0 2022-02-02T15:03:22.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.480+0000 7f6c35ffb700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 0x7f6c2c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.480+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c3c081d10 con 0x7f6c400f55c0 2022-02-02T15:03:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.481+0000 7f6c44b8f700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 0x7f6c2c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.481+0000 7f6c44b8f700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 0x7f6c2c067290 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6c30009da0 tx=0x7f6c30009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.482 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.484+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c3c04fe80 con 0x7f6c400f55c0 2022-02-02T15:03:22.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.726+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6c400fdf00 con 0x7f6c400f55c0 2022-02-02T15:03:22.724 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:22 smithi033 ceph-mon[101165]: pgmap v2539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:22.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.727+0000 7f6c35ffb700 1 -- 172.21.15.33:0/974795589 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f6c3c0534a0 con 0x7f6c400f55c0 2022-02-02T15:03:22.724 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:03:22.725 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:03:22.725 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:03:22.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:22.725 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:03:22.726 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:03:22.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:22.726 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:03:22.726 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:03:22.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:22.727 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:03:22.727 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:03:22.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:22.728 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:03:22.728 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:03:22.728 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:03:22.728 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:03:22.728 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:03:22.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 msgr2=0x7f6c2c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 0x7f6c2c067290 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6c30009da0 tx=0x7f6c30009b30).stop 2022-02-02T15:03:22.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 msgr2=0x7f6c40109c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f6c3c002700 tx=0x7f6c3c009d80).stop 2022-02-02T15:03:22.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 shutdown_connections 2022-02-02T15:03:22.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c2c064dd0 0x7f6c2c067290 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c400f55c0 0x7f6c40109c50 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 --2- 172.21.15.33:0/974795589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c400f6860 0x7f6c4010c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 >> 172.21.15.33:0/974795589 conn(0x7f6c400f0d40 msgr2=0x7f6c400fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 shutdown_connections 2022-02-02T15:03:22.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.729+0000 7f6c475f4700 1 -- 172.21.15.33:0/974795589 wait complete. 2022-02-02T15:03:22.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- 172.21.15.33:0/2080273758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 msgr2=0x7feb940f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/2080273758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb940f7de0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7feb84004660 tx=0x7feb84009b30).stop 2022-02-02T15:03:22.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- 172.21.15.33:0/2080273758 shutdown_connections 2022-02-02T15:03:22.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/2080273758 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb940f7de0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/2080273758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 0x7feb940f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- 172.21.15.33:0/2080273758 >> 172.21.15.33:0/2080273758 conn(0x7feb940f1e40 msgr2=0x7feb940f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:22.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- 172.21.15.33:0/2080273758 shutdown_connections 2022-02-02T15:03:22.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- 172.21.15.33:0/2080273758 wait complete. 2022-02-02T15:03:22.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 Processor -- start 2022-02-02T15:03:22.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.830+0000 7feb9b6f0700 1 -- start start 2022-02-02T15:03:22.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9b6f0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 0x7feb9406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9b6f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9b6f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9406a380 con 0x7feb940f7980 2022-02-02T15:03:22.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9b6f0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9406a4c0 con 0x7feb940f66e0 2022-02-02T15:03:22.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35762/0 (socket says 172.21.15.33:35762) 2022-02-02T15:03:22.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 -- 172.21.15.33:0/1312991602 learned_addr learned my addr 172.21.15.33:0/1312991602 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:22.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9948c700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 0x7feb9406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 -- 172.21.15.33:0/1312991602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 msgr2=0x7feb9406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:22.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 0x7feb9406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:22.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 -- 172.21.15.33:0/1312991602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb84005040 con 0x7feb940f7980 2022-02-02T15:03:22.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb98c8b700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7feb84009990 tx=0x7feb84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb84018070 con 0x7feb940f7980 2022-02-02T15:03:22.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.831+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9406a740 con 0x7feb940f7980 2022-02-02T15:03:22.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.832+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feb84007ba0 con 0x7feb940f7980 2022-02-02T15:03:22.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.832+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb8401c620 con 0x7feb940f7980 2022-02-02T15:03:22.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.832+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9406aca0 con 0x7feb940f7980 2022-02-02T15:03:22.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.833+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb94045ad0 con 0x7feb940f7980 2022-02-02T15:03:22.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.833+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feb8401c8e0 con 0x7feb940f7980 2022-02-02T15:03:22.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.833+0000 7feb89ffb700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 0x7feb80067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:22.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.834+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feb840838a0 con 0x7feb940f7980 2022-02-02T15:03:22.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.834+0000 7feb9948c700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 0x7feb80067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:22.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.834+0000 7feb9948c700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 0x7feb80067290 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7feb9406b730 tx=0x7feb90009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:22.837 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:22.838+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feb84051950 con 0x7feb940f7980 2022-02-02T15:03:23.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:22 smithi037 ceph-mon[69017]: pgmap v2539: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.051+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7feb940feea0 con 0x7feb940f7980 2022-02-02T15:03:23.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.052+0000 7feb89ffb700 1 -- 172.21.15.33:0/1312991602 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7feb84054f70 con 0x7feb940f7980 2022-02-02T15:03:23.049 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:03:23.049 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:03:23.049 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:03:23.049 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:03:23.050 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:23.050 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:03:23.050 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:03:23.050 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:03:23.051 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:03:23.051 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:03:23.051 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:03:23.051 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:03:23.051 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:03:23.052 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:03:23.052 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:03:23.052 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:03:23.052 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:03:23.053 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:03:23.053 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:03:23.053 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:03:23.053 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:03:23.054 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:03:23.054 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:03:23.054 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:03:23.054 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:03:23.054 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:03:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:03:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:03:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:03:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:03:23.055 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:03:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:23.056 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:03:23.056 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:23.056 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:23.057 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:23.057 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:23.057 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 msgr2=0x7feb80067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:23.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 0x7feb80067290 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7feb9406b730 tx=0x7feb90009040).stop 2022-02-02T15:03:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 msgr2=0x7feb94069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7feb84009990 tx=0x7feb84009b30).stop 2022-02-02T15:03:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 shutdown_connections 2022-02-02T15:03:23.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feb80064dd0 0x7feb80067290 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb940f66e0 0x7feb9406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 --2- 172.21.15.33:0/1312991602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb940f7980 0x7feb94069e20 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 >> 172.21.15.33:0/1312991602 conn(0x7feb940f1e40 msgr2=0x7feb940fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 shutdown_connections 2022-02-02T15:03:23.060 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:23.054+0000 7feb9b6f0700 1 -- 172.21.15.33:0/1312991602 wait complete. 2022-02-02T15:03:23.061 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:03:23.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:23 smithi033 ceph-mon[101165]: from='client.36674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:23.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:23 smithi033 ceph-mon[101165]: from='client.36678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:23.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/974795589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:03:23.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1312991602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:03:24.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:23 smithi037 ceph-mon[69017]: from='client.36674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:24.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:23 smithi037 ceph-mon[69017]: from='client.36678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:24.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/974795589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:03:24.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1312991602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:03:24.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:24 smithi033 ceph-mon[101165]: pgmap v2540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:25.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:24 smithi037 ceph-mon[69017]: pgmap v2540: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:26.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:26 smithi033 ceph-mon[101165]: pgmap v2541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:27.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:26 smithi037 ceph-mon[69017]: pgmap v2541: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:28.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:28 smithi033 ceph-mon[101165]: pgmap v2542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:29.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:28 smithi037 ceph-mon[69017]: pgmap v2542: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:30.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:30 smithi033 ceph-mon[101165]: pgmap v2543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:31.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:30 smithi037 ceph-mon[69017]: pgmap v2543: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:32.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:32 smithi033 ceph-mon[101165]: pgmap v2544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:33.040 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:32 smithi037 ceph-mon[69017]: pgmap v2544: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:34.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:34 smithi033 ceph-mon[101165]: pgmap v2545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:35.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:34 smithi037 ceph-mon[69017]: pgmap v2545: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:36.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:36 smithi033 ceph-mon[101165]: pgmap v2546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:37.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:36 smithi037 ceph-mon[69017]: pgmap v2546: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:38.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:38 smithi033 ceph-mon[101165]: pgmap v2547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:39.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:38 smithi037 ceph-mon[69017]: pgmap v2547: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:40.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:40 smithi033 ceph-mon[101165]: pgmap v2548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:41.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:40 smithi037 ceph-mon[69017]: pgmap v2548: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:42.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:42 smithi033 ceph-mon[101165]: pgmap v2549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:43.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:42 smithi037 ceph-mon[69017]: pgmap v2549: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:44.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:44 smithi033 ceph-mon[101165]: pgmap v2550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:45.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:44 smithi037 ceph-mon[69017]: pgmap v2550: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:46.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:46 smithi033 ceph-mon[101165]: pgmap v2551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:47.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:46 smithi037 ceph-mon[69017]: pgmap v2551: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:48.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:48 smithi033 ceph-mon[101165]: pgmap v2552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:49.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:48 smithi037 ceph-mon[69017]: pgmap v2552: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:50.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:50 smithi033 ceph-mon[101165]: pgmap v2553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:51.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:50 smithi037 ceph-mon[69017]: pgmap v2553: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:52.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:52 smithi033 ceph-mon[101165]: pgmap v2554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:53.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:52 smithi037 ceph-mon[69017]: pgmap v2554: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:53.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 -- 172.21.15.33:0/249577802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f66d0 msgr2=0x7f61c00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 --2- 172.21.15.33:0/249577802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f66d0 0x7f61c00f6b30 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f61a8004660 tx=0x7f61a8009b30).stop 2022-02-02T15:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 -- 172.21.15.33:0/249577802 shutdown_connections 2022-02-02T15:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 --2- 172.21.15.33:0/249577802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f66d0 0x7f61c00f6b30 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 --2- 172.21.15.33:0/249577802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f5430 0x7f61c00f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 -- 172.21.15.33:0/249577802 >> 172.21.15.33:0/249577802 conn(0x7f61c00f0b90 msgr2=0x7f61c00f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 -- 172.21.15.33:0/249577802 shutdown_connections 2022-02-02T15:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.170+0000 7f61c5244700 1 -- 172.21.15.33:0/249577802 wait complete. 2022-02-02T15:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 Processor -- start 2022-02-02T15:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 -- start start 2022-02-02T15:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f66d0 0x7f61c010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c00603e0 con 0x7f61c00f5430 2022-02-02T15:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61c5244700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61c0060520 con 0x7f61c00f66d0 2022-02-02T15:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35768/0 (socket says 172.21.15.33:35768) 2022-02-02T15:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61bffff700 1 -- 172.21.15.33:0/2060094545 learned_addr learned my addr 172.21.15.33:0/2060094545 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.171+0000 7f61bf7fe700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f66d0 0x7f61c010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bffff700 1 -- 172.21.15.33:0/2060094545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f66d0 msgr2=0x7f61c010bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bffff700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f66d0 0x7f61c010bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bffff700 1 -- 172.21.15.33:0/2060094545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8005040 con 0x7f61c00f5430 2022-02-02T15:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bffff700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f61b0002700 tx=0x7f61b0009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b00079c0 con 0x7f61c00f5430 2022-02-02T15:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f61b000f040 con 0x7f61c00f5430 2022-02-02T15:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61c010c4d0 con 0x7f61c00f5430 2022-02-02T15:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f61b0014860 con 0x7f61c00f5430 2022-02-02T15:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.172+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61c010ca90 con 0x7f61c00f5430 2022-02-02T15:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.173+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61c0045ad0 con 0x7f61c00f5430 2022-02-02T15:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.173+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f61b001b060 con 0x7f61c00f5430 2022-02-02T15:03:53.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.174+0000 7f61bcff9700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 0x7f61ac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.174+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f61b0081930 con 0x7f61c00f5430 2022-02-02T15:03:53.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.174+0000 7f61bf7fe700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 0x7f61ac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.174+0000 7f61bf7fe700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 0x7f61ac0672e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f61a8004e30 tx=0x7f61a8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.176 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.178+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f61b004f9e0 con 0x7f61c00f5430 2022-02-02T15:03:53.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.365+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f61c00fdda0 con 0x7f61ac064e20 2022-02-02T15:03:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.367+0000 7f61bcff9700 1 -- 172.21.15.33:0/2060094545 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f61a8019040 con 0x7f61ac064e20 2022-02-02T15:03:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.368+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 msgr2=0x7f61ac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.368+0000 7f61c5244700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 0x7f61ac0672e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f61a8004e30 tx=0x7f61a8009b30).stop 2022-02-02T15:03:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.368+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 msgr2=0x7f61c0109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f61b0002700 tx=0x7f61b0009d80).stop 2022-02-02T15:03:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 shutdown_connections 2022-02-02T15:03:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f61ac064e20 0x7f61ac0672e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61c00f5430 0x7f61c0109a20 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 --2- 172.21.15.33:0/2060094545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61c00f66d0 0x7f61c010bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 >> 172.21.15.33:0/2060094545 conn(0x7f61c00f0b90 msgr2=0x7f61c00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 shutdown_connections 2022-02-02T15:03:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.369+0000 7f61c5244700 1 -- 172.21.15.33:0/2060094545 wait complete. 2022-02-02T15:03:53.373 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:03:53.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 -- 172.21.15.33:0/2225937911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 msgr2=0x7f06d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 --2- 172.21.15.33:0/2225937911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d40f6cc0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f06c8004660 tx=0x7f06c8009b30).stop 2022-02-02T15:03:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 -- 172.21.15.33:0/2225937911 shutdown_connections 2022-02-02T15:03:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 --2- 172.21.15.33:0/2225937911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d40f6cc0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 --2- 172.21.15.33:0/2225937911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 0x7f06d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 -- 172.21.15.33:0/2225937911 >> 172.21.15.33:0/2225937911 conn(0x7f06d40f0d40 msgr2=0x7f06d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 -- 172.21.15.33:0/2225937911 shutdown_connections 2022-02-02T15:03:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.470+0000 7f06db3c8700 1 -- 172.21.15.33:0/2225937911 wait complete. 2022-02-02T15:03:53.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 Processor -- start 2022-02-02T15:03:53.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 -- start start 2022-02-02T15:03:53.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 0x7f06d4106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4107990 con 0x7f06d40f6860 2022-02-02T15:03:53.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06db3c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4107ad0 con 0x7f06d40f55c0 2022-02-02T15:03:53.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06d8963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06d8963700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35780/0 (socket says 172.21.15.33:35780) 2022-02-02T15:03:53.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06d8963700 1 -- 172.21.15.33:0/1919125102 learned_addr learned my addr 172.21.15.33:0/1919125102 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:53.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.471+0000 7f06d9164700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 0x7f06d4106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06d8963700 1 -- 172.21.15.33:0/1919125102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 msgr2=0x7f06d4106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06d8963700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 0x7f06d4106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06d8963700 1 -- 172.21.15.33:0/1919125102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c8005040 con 0x7f06d40f6860 2022-02-02T15:03:53.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06d8963700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f06c8000c00 tx=0x7f06c800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c8019070 con 0x7f06d40f6860 2022-02-02T15:03:53.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06c8007e70 con 0x7f06d40f6860 2022-02-02T15:03:53.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4108410 con 0x7f06d40f6860 2022-02-02T15:03:53.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06c8014ce0 con 0x7f06d40f6860 2022-02-02T15:03:53.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.472+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d4108970 con 0x7f06d40f6860 2022-02-02T15:03:53.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.474+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4045ad0 con 0x7f06d40f6860 2022-02-02T15:03:53.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.474+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06c8025070 con 0x7f06d40f6860 2022-02-02T15:03:53.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.474+0000 7f06c5ffb700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 0x7f06c0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.474+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f06c80829c0 con 0x7f06d40f6860 2022-02-02T15:03:53.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.474+0000 7f06d9164700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 0x7f06c0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.475+0000 7f06d9164700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 0x7f06c0067290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f06d0009fd0 tx=0x7f06d000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.478+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06c8054420 con 0x7f06d40f6860 2022-02-02T15:03:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.659+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f06d40faca0 con 0x7f06c0064dd0 2022-02-02T15:03:53.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.674+0000 7f06c5ffb700 1 -- 172.21.15.33:0/1919125102 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f06d40faca0 con 0x7f06c0064dd0 2022-02-02T15:03:53.669 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (89m) 51m ago 90m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (82m) 51m ago 90m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (82m) 51m ago 89m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:03:53.670 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (89m) 51m ago 89m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (82m) 51m ago 86m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (83m) 51m ago 86m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (84m) 51m ago 86m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:03:53.671 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (86m) 51m ago 86m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (83m) 51m ago 91m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (83m) 51m ago 89m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (83m) 51m ago 91m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (82m) 51m ago 89m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:03:53.672 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (89m) 51m ago 89m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (89m) 51m ago 89m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 51m ago 88m - 4096M 2022-02-02T15:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (88m) 51m ago 88m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:03:53.673 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (88m) 51m ago 88m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:03:53.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (88m) 51m ago 88m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:03:53.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (87m) 51m ago 87m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:03:53.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (87m) 51m ago 87m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:03:53.674 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (88m) 51m ago 89m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:03:53.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 msgr2=0x7f06c0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 0x7f06c0067290 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f06d0009fd0 tx=0x7f06d000b040).stop 2022-02-02T15:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 msgr2=0x7f06d41073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 rx=0x7f06c8000c00 tx=0x7f06c800b040).stop 2022-02-02T15:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 shutdown_connections 2022-02-02T15:03:53.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06c0064dd0 0x7f06c0067290 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06d40f55c0 0x7f06d4106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 --2- 172.21.15.33:0/1919125102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06d40f6860 0x7f06d41073e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 >> 172.21.15.33:0/1919125102 conn(0x7f06d40f0d40 msgr2=0x7f06d405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:53.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 shutdown_connections 2022-02-02T15:03:53.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.676+0000 7f06db3c8700 1 -- 172.21.15.33:0/1919125102 wait complete. 2022-02-02T15:03:53.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.776+0000 7f7c1225a700 1 -- 172.21.15.33:0/3168724786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0f96f0 msgr2=0x7f7c0c0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.776+0000 7f7c1225a700 1 --2- 172.21.15.33:0/3168724786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0fbae0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7f7bfc004660 tx=0x7f7bfc009b30).stop 2022-02-02T15:03:53.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.776+0000 7f7c1225a700 1 -- 172.21.15.33:0/3168724786 shutdown_connections 2022-02-02T15:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.776+0000 7f7c1225a700 1 --2- 172.21.15.33:0/3168724786 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0fbae0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.776+0000 7f7c1225a700 1 --2- 172.21.15.33:0/3168724786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 -- 172.21.15.33:0/3168724786 >> 172.21.15.33:0/3168724786 conn(0x7f7c0c0f0b90 msgr2=0x7f7c0c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:53.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 -- 172.21.15.33:0/3168724786 shutdown_connections 2022-02-02T15:03:53.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 -- 172.21.15.33:0/3168724786 wait complete. 2022-02-02T15:03:53.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 Processor -- start 2022-02-02T15:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 -- start start 2022-02-02T15:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.777+0000 7f7c1225a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c1225a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0f55d0 con 0x7f7c0c0602b0 2022-02-02T15:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c1225a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0c0f5710 con 0x7f7c0c0f96f0 2022-02-02T15:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35788/0 (socket says 172.21.15.33:35788) 2022-02-02T15:03:53.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 -- 172.21.15.33:0/484511318 learned_addr learned my addr 172.21.15.33:0/484511318 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c10a57700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 -- 172.21.15.33:0/484511318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 msgr2=0x7f7c0c0f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:53.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 -- 172.21.15.33:0/484511318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc005040 con 0x7f7c0c0602b0 2022-02-02T15:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c10a57700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c11258700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f7c080026d0 tx=0x7f7c08009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c08009320 con 0x7f7c0c0602b0 2022-02-02T15:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7c0800f040 con 0x7f7c0c0602b0 2022-02-02T15:03:53.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c0c0f59f0 con 0x7f7c0c0602b0 2022-02-02T15:03:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.778+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c080147e0 con 0x7f7c0c0602b0 2022-02-02T15:03:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.779+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c0c10ed60 con 0x7f7c0c0602b0 2022-02-02T15:03:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.779+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0c045ad0 con 0x7f7c0c0602b0 2022-02-02T15:03:53.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.780+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7c08009480 con 0x7f7c0c0602b0 2022-02-02T15:03:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.781+0000 7f7c01ffb700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 0x7f7bf80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.781+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7c080820e0 con 0x7f7c0c0602b0 2022-02-02T15:03:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.781+0000 7f7c10a57700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 0x7f7bf80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:53.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.781+0000 7f7c10a57700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 0x7f7bf80672e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7bfc009da0 tx=0x7f7bfc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:53.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:53.785+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7c08050190 con 0x7f7c0c0602b0 2022-02-02T15:03:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.030+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7c0c0fee30 con 0x7f7c0c0602b0 2022-02-02T15:03:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.030+0000 7f7c01ffb700 1 -- 172.21.15.33:0/484511318 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7c080537b0 con 0x7f7c0c0602b0 2022-02-02T15:03:54.026 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:03:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:03:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:03:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:03:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:03:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:03:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:03:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:03:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:03:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:03:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:03:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:03:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:03:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:03:54.029 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:03:54.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 msgr2=0x7f7bf80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 0x7f7bf80672e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f7bfc009da0 tx=0x7f7bfc009b30).stop 2022-02-02T15:03:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 msgr2=0x7f7c0c0f6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7f7c080026d0 tx=0x7f7c08009de0).stop 2022-02-02T15:03:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 shutdown_connections 2022-02-02T15:03:54.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7bf8064e20 0x7f7bf80672e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7c0c0602b0 0x7f7c0c0f6bf0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 --2- 172.21.15.33:0/484511318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c0f96f0 0x7f7c0c0f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 >> 172.21.15.33:0/484511318 conn(0x7f7c0c0f0b90 msgr2=0x7f7c0c0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:54.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 shutdown_connections 2022-02-02T15:03:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.032+0000 7f7c1225a700 1 -- 172.21.15.33:0/484511318 wait complete. 2022-02-02T15:03:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.132+0000 7f6e8359e700 1 -- 172.21.15.33:0/2906245851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 msgr2=0x7f6e840f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.132+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2906245851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e840f6950 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7f6e74004660 tx=0x7f6e74009b30).stop 2022-02-02T15:03:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 -- 172.21.15.33:0/2906245851 shutdown_connections 2022-02-02T15:03:54.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2906245851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e840f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2906245851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e840f6950 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 -- 172.21.15.33:0/2906245851 >> 172.21.15.33:0/2906245851 conn(0x7f6e840f1c90 msgr2=0x7f6e840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 -- 172.21.15.33:0/2906245851 shutdown_connections 2022-02-02T15:03:54.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 -- 172.21.15.33:0/2906245851 wait complete. 2022-02-02T15:03:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 Processor -- start 2022-02-02T15:03:54.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.133+0000 7f6e8359e700 1 -- start start 2022-02-02T15:03:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e84107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84107880 con 0x7f6e840f6530 2022-02-02T15:03:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84108090 con 0x7f6e840f77d0 2022-02-02T15:03:54.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35798/0 (socket says 172.21.15.33:35798) 2022-02-02T15:03:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 -- 172.21.15.33:0/2242743916 learned_addr learned my addr 172.21.15.33:0/2242743916 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:03:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e81d9b700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e84107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:54.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 -- 172.21.15.33:0/2242743916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 msgr2=0x7f6e84107280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e84107280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 -- 172.21.15.33:0/2242743916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74005040 con 0x7f6e840f6530 2022-02-02T15:03:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e81d9b700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e84107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:03:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e8259c700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f6e74000c00 tx=0x7f6e7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:54.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.134+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e74019070 con 0x7f6e840f6530 2022-02-02T15:03:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.135+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e74013380 con 0x7f6e840f6530 2022-02-02T15:03:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.135+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e841082b0 con 0x7f6e840f6530 2022-02-02T15:03:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.135+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e74014d30 con 0x7f6e840f6530 2022-02-02T15:03:54.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.135+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e84108810 con 0x7f6e840f6530 2022-02-02T15:03:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.136+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84059100 con 0x7f6e840f6530 2022-02-02T15:03:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.136+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e74025070 con 0x7f6e840f6530 2022-02-02T15:03:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.136+0000 7f6e72ffd700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 0x7f6e6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:03:54.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.136+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e740829e0 con 0x7f6e840f6530 2022-02-02T15:03:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.136+0000 7f6e81d9b700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 0x7f6e6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:03:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.137+0000 7f6e81d9b700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 0x7f6e6c0672e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f6e78007fc0 tx=0x7f6e7800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:03:54.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.141+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e74050a90 con 0x7f6e840f6530 2022-02-02T15:03:54.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.351+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e840008d0 con 0x7f6e840f6530 2022-02-02T15:03:54.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.351+0000 7f6e72ffd700 1 -- 172.21.15.33:0/2242743916 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6e74023020 con 0x7f6e840f6530 2022-02-02T15:03:54.347 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:03:54.347 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:03:54.347 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:03:54.348 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:03:54.348 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:54.348 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:03:54.348 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:03:54.349 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:03:54.349 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:03:54.349 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:03:54.350 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:03:54.350 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:03:54.350 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:03:54.350 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:03:54.350 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:03:54.351 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:03:54.351 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:03:54.351 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:03:54.352 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:03:54.352 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:03:54.352 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:03:54.352 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:03:54.352 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:03:54.353 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:03:54.353 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:03:54.353 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:03:54.353 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:03:54.354 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:03:54.354 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:03:54.354 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:03:54.354 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:03:54.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:54.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:03:54.355 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:03:54.355 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:54.356 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:03:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 msgr2=0x7f6e6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 0x7f6e6c0672e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f6e78007fc0 tx=0x7f6e7800b040).stop 2022-02-02T15:03:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 msgr2=0x7f6e84106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:03:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x7f6e74000c00 tx=0x7f6e7400b040).stop 2022-02-02T15:03:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 shutdown_connections 2022-02-02T15:03:54.358 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e6c064e20 0x7f6e6c0672e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e840f6530 0x7f6e84106d90 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 --2- 172.21.15.33:0/2242743916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e840f77d0 0x7f6e84107280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:03:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.354+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 >> 172.21.15.33:0/2242743916 conn(0x7f6e840f1c90 msgr2=0x7f6e840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:03:54.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.355+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 shutdown_connections 2022-02-02T15:03:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:03:54.355+0000 7f6e8359e700 1 -- 172.21.15.33:0/2242743916 wait complete. 2022-02-02T15:03:54.360 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:03:54.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='client.36690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: pgmap v2555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/484511318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:03:54.986 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2242743916' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:03:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:03:54.987 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:03:55.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='client.36690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: pgmap v2555: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:03:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/484511318' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:03:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2242743916' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:03:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:03:55.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:03:56.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:56 smithi033 ceph-mon[101165]: pgmap v2556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:57.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:56 smithi037 ceph-mon[69017]: pgmap v2556: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:58.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:03:58 smithi033 ceph-mon[101165]: pgmap v2557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:03:59.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:03:58 smithi037 ceph-mon[69017]: pgmap v2557: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:00.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:00 smithi033 ceph-mon[101165]: pgmap v2558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:01.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:00 smithi037 ceph-mon[69017]: pgmap v2558: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:02.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:02 smithi033 ceph-mon[101165]: pgmap v2559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:03.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:02 smithi037 ceph-mon[69017]: pgmap v2559: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:04.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:04 smithi033 ceph-mon[101165]: pgmap v2560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:05.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:04 smithi037 ceph-mon[69017]: pgmap v2560: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:06.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:06 smithi033 ceph-mon[101165]: pgmap v2561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:07.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:06 smithi037 ceph-mon[69017]: pgmap v2561: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:08.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:08 smithi033 ceph-mon[101165]: pgmap v2562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:09.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:08 smithi037 ceph-mon[69017]: pgmap v2562: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:11.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:10 smithi037 ceph-mon[69017]: pgmap v2563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:11.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:10 smithi033 ceph-mon[101165]: pgmap v2563: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:13.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:12 smithi037 ceph-mon[69017]: pgmap v2564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:13.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:12 smithi033 ceph-mon[101165]: pgmap v2564: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:14.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:13 smithi033 ceph-mon[101165]: pgmap v2565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:14.285 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:13 smithi037 ceph-mon[69017]: pgmap v2565: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:16.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:16 smithi033 ceph-mon[101165]: pgmap v2566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:17.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:16 smithi037 ceph-mon[69017]: pgmap v2566: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:18.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:18 smithi033 ceph-mon[101165]: pgmap v2567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:19.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:18 smithi037 ceph-mon[69017]: pgmap v2567: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:20.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:20 smithi033 ceph-mon[101165]: pgmap v2568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:21.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:20 smithi037 ceph-mon[69017]: pgmap v2568: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:22.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:22 smithi033 ceph-mon[101165]: pgmap v2569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:23.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:22 smithi037 ceph-mon[69017]: pgmap v2569: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 -- 172.21.15.33:0/2989316546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 msgr2=0x7f1f5c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 --2- 172.21.15.33:0/2989316546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c0f59e0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1f58004660 tx=0x7f1f58009b30).stop 2022-02-02T15:04:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 -- 172.21.15.33:0/2989316546 shutdown_connections 2022-02-02T15:04:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 --2- 172.21.15.33:0/2989316546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 0x7f1f5c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 --2- 172.21.15.33:0/2989316546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c0f59e0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 -- 172.21.15.33:0/2989316546 >> 172.21.15.33:0/2989316546 conn(0x7f1f5c0f0d40 msgr2=0x7f1f5c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:24.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 -- 172.21.15.33:0/2989316546 shutdown_connections 2022-02-02T15:04:24.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.470+0000 7f1f647fa700 1 -- 172.21.15.33:0/2989316546 wait complete. 2022-02-02T15:04:24.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 Processor -- start 2022-02-02T15:04:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 -- start start 2022-02-02T15:04:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 0x7f1f5c1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c107990 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f647fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c107ad0 con 0x7f1f5c0f6860 2022-02-02T15:04:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35808/0 (socket says 172.21.15.33:35808) 2022-02-02T15:04:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 -- 172.21.15.33:0/501516926 learned_addr learned my addr 172.21.15.33:0/501516926 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f61d95700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 0x7f1f5c1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 -- 172.21.15.33:0/501516926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 msgr2=0x7f1f5c1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 0x7f1f5c1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 -- 172.21.15.33:0/501516926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f58005040 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.471+0000 7f1f62596700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f1f58013a70 tx=0x7f1f58009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.472+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f58018070 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.472+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1f580097d0 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.472+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5c108410 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.472+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f5801c3c0 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.472+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5c108970 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.473+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f5c045ad0 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.473+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1f58007ba0 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.473+0000 7f1f52ffd700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 0x7f1f48067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.474+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1f58083790 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.477 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.474+0000 7f1f61d95700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 0x7f1f48067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.474+0000 7f1f61d95700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 0x7f1f48067290 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f1f4c009740 tx=0x7f1f4c009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.478+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1f58055330 con 0x7f1f5c0f55c0 2022-02-02T15:04:24.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.668+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f5c0faca0 con 0x7f1f48064dd0 2022-02-02T15:04:24.665 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.669+0000 7f1f52ffd700 1 -- 172.21.15.33:0/501516926 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1f5c0faca0 con 0x7f1f48064dd0 2022-02-02T15:04:24.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 msgr2=0x7f1f48067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 0x7f1f48067290 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f1f4c009740 tx=0x7f1f4c009c60).stop 2022-02-02T15:04:24.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 msgr2=0x7f1f5c106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f1f58013a70 tx=0x7f1f58009b30).stop 2022-02-02T15:04:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 shutdown_connections 2022-02-02T15:04:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1f48064dd0 0x7f1f48067290 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f5c0f55c0 0x7f1f5c106ef0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 --2- 172.21.15.33:0/501516926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f5c0f6860 0x7f1f5c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 >> 172.21.15.33:0/501516926 conn(0x7f1f5c0f0d40 msgr2=0x7f1f5c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 shutdown_connections 2022-02-02T15:04:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.671+0000 7f1f647fa700 1 -- 172.21.15.33:0/501516926 wait complete. 2022-02-02T15:04:24.676 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:04:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 -- 172.21.15.33:0/2030503937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 msgr2=0x7fb3840f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 --2- 172.21.15.33:0/2030503937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb3840f5850 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fb380004660 tx=0x7fb380009b30).stop 2022-02-02T15:04:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 -- 172.21.15.33:0/2030503937 shutdown_connections 2022-02-02T15:04:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 --2- 172.21.15.33:0/2030503937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f66d0 0x7fb3840f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 --2- 172.21.15.33:0/2030503937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f5430 0x7fb3840f5850 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 -- 172.21.15.33:0/2030503937 >> 172.21.15.33:0/2030503937 conn(0x7fb3840f0b90 msgr2=0x7fb3840f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 -- 172.21.15.33:0/2030503937 shutdown_connections 2022-02-02T15:04:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.773+0000 7fb38ab68700 1 -- 172.21.15.33:0/2030503937 wait complete. 2022-02-02T15:04:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 Processor -- start 2022-02-02T15:04:24.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 -- start start 2022-02-02T15:04:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f5430 0x7fb384106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb384107880 con 0x7fb3840f66d0 2022-02-02T15:04:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb38ab68700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3841080c0 con 0x7fb3840f5430 2022-02-02T15:04:24.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35820/0 (socket says 172.21.15.33:35820) 2022-02-02T15:04:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 -- 172.21.15.33:0/4250117594 learned_addr learned my addr 172.21.15.33:0/4250117594 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389b66700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f5430 0x7fb384106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 -- 172.21.15.33:0/4250117594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f5430 msgr2=0x7fb384106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f5430 0x7fb384106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 -- 172.21.15.33:0/4250117594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380005040 con 0x7fb3840f66d0 2022-02-02T15:04:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.774+0000 7fb389365700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fb37800e7f0 tx=0x7fb37800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.775+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3780092e0 con 0x7fb3840f66d0 2022-02-02T15:04:24.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.775+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3841083a0 con 0x7fb3840f66d0 2022-02-02T15:04:24.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.775+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb37800f040 con 0x7fb3840f66d0 2022-02-02T15:04:24.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.775+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb378014750 con 0x7fb3840f66d0 2022-02-02T15:04:24.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.775+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3841088e0 con 0x7fb3840f66d0 2022-02-02T15:04:24.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.776+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb384059100 con 0x7fb3840f66d0 2022-02-02T15:04:24.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.776+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb37801b030 con 0x7fb3840f66d0 2022-02-02T15:04:24.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.776+0000 7fb3767fc700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:24.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.777+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb378081780 con 0x7fb3840f66d0 2022-02-02T15:04:24.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.777+0000 7fb389b66700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:24.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.777+0000 7fb389b66700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fb380000c00 tx=0x7fb380016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:24.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.781+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb37804f8e0 con 0x7fb3840f66d0 2022-02-02T15:04:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.962+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3840fab10 con 0x7fb370064e20 2022-02-02T15:04:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.977+0000 7fb3767fc700 1 -- 172.21.15.33:0/4250117594 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb3840fab10 con 0x7fb370064e20 2022-02-02T15:04:24.973 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:04:24.973 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (89m) 51m ago 90m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:04:24.973 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (82m) 51m ago 90m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:04:24.973 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (82m) 51m ago 90m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:04:24.974 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (89m) 51m ago 90m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:04:24.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (83m) 51m ago 86m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:04:24.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (83m) 51m ago 86m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:04:24.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (84m) 51m ago 86m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:04:24.975 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (86m) 51m ago 86m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:04:24.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (84m) 51m ago 92m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:04:24.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (83m) 51m ago 90m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:04:24.975 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (83m) 51m ago 92m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:04:24.975 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (83m) 51m ago 90m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:04:24.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (90m) 51m ago 90m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:04:24.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (89m) 51m ago 89m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:04:24.976 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 51m ago 89m - 4096M 2022-02-02T15:04:24.976 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (89m) 51m ago 89m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:04:24.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (88m) 51m ago 88m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:04:24.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (88m) 51m ago 88m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:04:24.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (88m) 51m ago 88m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:04:24.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (88m) 51m ago 88m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:04:24.978 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (89m) 51m ago 90m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:04:24.978 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:24 smithi033 ceph-mon[101165]: pgmap v2570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 msgr2=0x7fb3700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fb380000c00 tx=0x7fb380016040).stop 2022-02-02T15:04:24.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 msgr2=0x7fb384107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fb37800e7f0 tx=0x7fb37800b040).stop 2022-02-02T15:04:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 shutdown_connections 2022-02-02T15:04:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb370064e20 0x7fb3700672e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3840f5430 0x7fb384106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 --2- 172.21.15.33:0/4250117594 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb3840f66d0 0x7fb384107280 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 >> 172.21.15.33:0/4250117594 conn(0x7fb3840f0b90 msgr2=0x7fb38405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 shutdown_connections 2022-02-02T15:04:24.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:24.979+0000 7fb38ab68700 1 -- 172.21.15.33:0/4250117594 wait complete. 2022-02-02T15:04:25.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:24 smithi037 ceph-mon[69017]: pgmap v2570: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:25.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 -- 172.21.15.33:0/3206971754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780f9880 msgr2=0x7fbc780fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 --2- 172.21.15.33:0/3206971754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780f9880 0x7fbc780fbc70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fbc68004660 tx=0x7fbc68009b30).stop 2022-02-02T15:04:25.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 -- 172.21.15.33:0/3206971754 shutdown_connections 2022-02-02T15:04:25.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 --2- 172.21.15.33:0/3206971754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780f9880 0x7fbc780fbc70 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 --2- 172.21.15.33:0/3206971754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780602b0 0x7fbc780f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 -- 172.21.15.33:0/3206971754 >> 172.21.15.33:0/3206971754 conn(0x7fbc780f0d40 msgr2=0x7fbc780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:25.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 -- 172.21.15.33:0/3206971754 shutdown_connections 2022-02-02T15:04:25.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.079+0000 7fbc7db38700 1 -- 172.21.15.33:0/3206971754 wait complete. 2022-02-02T15:04:25.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.080+0000 7fbc7db38700 1 Processor -- start 2022-02-02T15:04:25.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.080+0000 7fbc7db38700 1 -- start start 2022-02-02T15:04:25.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.080+0000 7fbc7db38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc7db38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780f9880 0x7fbc78107420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc7db38700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781079d0 con 0x7fbc780602b0 2022-02-02T15:04:25.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc7db38700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78107b10 con 0x7fbc780f9880 2022-02-02T15:04:25.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35828/0 (socket says 172.21.15.33:35828) 2022-02-02T15:04:25.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 -- 172.21.15.33:0/348544292 learned_addr learned my addr 172.21.15.33:0/348544292 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:25.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc76ffd700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780f9880 0x7fbc78107420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 -- 172.21.15.33:0/348544292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780f9880 msgr2=0x7fbc78107420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780f9880 0x7fbc78107420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 -- 172.21.15.33:0/348544292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68005040 con 0x7fbc780602b0 2022-02-02T15:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc777fe700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fbc6c0026d0 tx=0x7fbc6c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c0079c0 con 0x7fbc780602b0 2022-02-02T15:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbc6c00f040 con 0x7fbc780602b0 2022-02-02T15:04:25.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc781084b0 con 0x7fbc780602b0 2022-02-02T15:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c0148b0 con 0x7fbc780602b0 2022-02-02T15:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.081+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc78108a70 con 0x7fbc780602b0 2022-02-02T15:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.082+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc78045ad0 con 0x7fbc780602b0 2022-02-02T15:04:25.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.083+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbc6c007b20 con 0x7fbc780602b0 2022-02-02T15:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.083+0000 7fbc5ffff700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 0x7fbc60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.083+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbc6c081a30 con 0x7fbc780602b0 2022-02-02T15:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.084+0000 7fbc76ffd700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 0x7fbc60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.084+0000 7fbc76ffd700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 0x7fbc60067290 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fbc68004630 tx=0x7fbc68009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:25.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.088+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbc6c053510 con 0x7fbc780602b0 2022-02-02T15:04:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.333+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc780ff000 con 0x7fbc780602b0 2022-02-02T15:04:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.333+0000 7fbc5ffff700 1 -- 172.21.15.33:0/348544292 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fbc6c053100 con 0x7fbc780602b0 2022-02-02T15:04:25.330 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:04:25.330 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:04:25.330 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:04:25.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:25.331 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:04:25.331 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:04:25.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:25.332 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:04:25.332 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:04:25.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:25.332 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:04:25.333 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:04:25.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:25.333 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:04:25.333 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:04:25.333 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:04:25.334 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:04:25.334 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:04:25.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 msgr2=0x7fbc60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 0x7fbc60067290 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fbc68004630 tx=0x7fbc68009b30).stop 2022-02-02T15:04:25.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 msgr2=0x7fbc78106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fbc6c0026d0 tx=0x7fbc6c009de0).stop 2022-02-02T15:04:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 shutdown_connections 2022-02-02T15:04:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbc60064dd0 0x7fbc60067290 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc780602b0 0x7fbc78106f30 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 --2- 172.21.15.33:0/348544292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc780f9880 0x7fbc78107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 >> 172.21.15.33:0/348544292 conn(0x7fbc780f0d40 msgr2=0x7fbc780f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 shutdown_connections 2022-02-02T15:04:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.336+0000 7fbc7db38700 1 -- 172.21.15.33:0/348544292 wait complete. 2022-02-02T15:04:25.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 -- 172.21.15.33:0/768378957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f55c0 msgr2=0x7fcd100f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 --2- 172.21.15.33:0/768378957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f55c0 0x7fcd100f59e0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7fcd00004660 tx=0x7fcd00009b30).stop 2022-02-02T15:04:25.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 -- 172.21.15.33:0/768378957 shutdown_connections 2022-02-02T15:04:25.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 --2- 172.21.15.33:0/768378957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f6860 0x7fcd100f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 --2- 172.21.15.33:0/768378957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f55c0 0x7fcd100f59e0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 -- 172.21.15.33:0/768378957 >> 172.21.15.33:0/768378957 conn(0x7fcd100f0d40 msgr2=0x7fcd100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:25.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 -- 172.21.15.33:0/768378957 shutdown_connections 2022-02-02T15:04:25.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 -- 172.21.15.33:0/768378957 wait complete. 2022-02-02T15:04:25.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.437+0000 7fcd151cd700 1 Processor -- start 2022-02-02T15:04:25.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd151cd700 1 -- start start 2022-02-02T15:04:25.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd151cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 0x7fcd10105e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd151cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd151cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10106950 con 0x7fcd100f6860 2022-02-02T15:04:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd151cd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd10107160 con 0x7fcd100f55c0 2022-02-02T15:04:25.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35840/0 (socket says 172.21.15.33:35840) 2022-02-02T15:04:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 -- 172.21.15.33:0/3374600227 learned_addr learned my addr 172.21.15.33:0/3374600227 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0ed9d700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 0x7fcd10105e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 -- 172.21.15.33:0/3374600227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 msgr2=0x7fcd10105e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 0x7fcd10105e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 -- 172.21.15.33:0/3374600227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd00005040 con 0x7fcd100f6860 2022-02-02T15:04:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0ed9d700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 0x7fcd10105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:04:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fcd0e59c700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fcd04010a00 tx=0x7fcd0400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.438+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd040094c0 con 0x7fcd100f6860 2022-02-02T15:04:25.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.439+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd10107380 con 0x7fcd100f6860 2022-02-02T15:04:25.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.439+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcd04009620 con 0x7fcd100f6860 2022-02-02T15:04:25.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.439+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd10107910 con 0x7fcd100f6860 2022-02-02T15:04:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.439+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd04007e50 con 0x7fcd100f6860 2022-02-02T15:04:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.440+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf0004fa0 con 0x7fcd100f6860 2022-02-02T15:04:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.440+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcd04022070 con 0x7fcd100f6860 2022-02-02T15:04:25.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.440+0000 7fccf77fe700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 0x7fccf8067230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:25.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.441+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcd04084350 con 0x7fcd100f6860 2022-02-02T15:04:25.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.441+0000 7fcd0ed9d700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 0x7fccf8067230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:25.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.441+0000 7fcd0ed9d700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 0x7fccf8067230 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fcd00004d80 tx=0x7fcd0000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:25.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.445+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcd04052400 con 0x7fcd100f6860 2022-02-02T15:04:25.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.664+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fccf0005e80 con 0x7fcd100f6860 2022-02-02T15:04:25.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.664+0000 7fccf77fe700 1 -- 172.21.15.33:0/3374600227 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcd04055a20 con 0x7fcd100f6860 2022-02-02T15:04:25.661 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:04:25.661 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:04:25.661 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:04:25.661 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:04:25.662 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:25.662 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:04:25.662 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:04:25.663 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:04:25.663 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:04:25.663 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:04:25.663 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:04:25.664 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:04:25.664 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:04:25.664 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:04:25.664 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:04:25.664 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:04:25.665 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:04:25.665 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:04:25.665 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:04:25.665 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:04:25.666 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:04:25.666 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:04:25.666 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:04:25.666 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:04:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:04:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:04:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:04:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:04:25.667 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:04:25.668 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:04:25.668 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:04:25.668 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:25.668 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:25.669 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:04:25.669 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:25.669 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:25.669 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:25.669 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:25.670 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:25.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 msgr2=0x7fccf8067230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 0x7fccf8067230 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7fcd00004d80 tx=0x7fcd0000b040).stop 2022-02-02T15:04:25.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 msgr2=0x7fcd10106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:25.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7fcd04010a00 tx=0x7fcd0400b040).stop 2022-02-02T15:04:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 shutdown_connections 2022-02-02T15:04:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fccf8064d70 0x7fccf8067230 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd100f55c0 0x7fcd10105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 --2- 172.21.15.33:0/3374600227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd100f6860 0x7fcd10106350 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:25.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 >> 172.21.15.33:0/3374600227 conn(0x7fcd100f0d40 msgr2=0x7fcd100fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:25.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 shutdown_connections 2022-02-02T15:04:25.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:25.667+0000 7fcd151cd700 1 -- 172.21.15.33:0/3374600227 wait complete. 2022-02-02T15:04:25.673 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:04:25.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:25 smithi033 ceph-mon[101165]: from='client.36706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:25.916 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/348544292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:04:25.917 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3374600227' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:04:26.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:25 smithi037 ceph-mon[69017]: from='client.36706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:26.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/348544292' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:04:26.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3374600227' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:04:26.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:26 smithi033 ceph-mon[101165]: from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:26.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:26 smithi033 ceph-mon[101165]: pgmap v2571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:27.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:26 smithi037 ceph-mon[69017]: from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:27.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:26 smithi037 ceph-mon[69017]: pgmap v2571: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:28.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:28 smithi033 ceph-mon[101165]: pgmap v2572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:29.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:28 smithi037 ceph-mon[69017]: pgmap v2572: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:31.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:30 smithi037 ceph-mon[69017]: pgmap v2573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:31.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:30 smithi033 ceph-mon[101165]: pgmap v2573: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:33.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:32 smithi037 ceph-mon[69017]: pgmap v2574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:33.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:32 smithi033 ceph-mon[101165]: pgmap v2574: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:35.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:34 smithi037 ceph-mon[69017]: pgmap v2575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:35.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:34 smithi033 ceph-mon[101165]: pgmap v2575: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:36.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:35 smithi033 ceph-mon[101165]: pgmap v2576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:36.285 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:35 smithi037 ceph-mon[69017]: pgmap v2576: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:38.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:38 smithi033 ceph-mon[101165]: pgmap v2577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:39.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:38 smithi037 ceph-mon[69017]: pgmap v2577: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:40.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:40 smithi033 ceph-mon[101165]: pgmap v2578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:41.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:40 smithi037 ceph-mon[69017]: pgmap v2578: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:42.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:42 smithi033 ceph-mon[101165]: pgmap v2579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:43.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:42 smithi037 ceph-mon[69017]: pgmap v2579: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:44.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:44 smithi033 ceph-mon[101165]: pgmap v2580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:45.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:44 smithi037 ceph-mon[69017]: pgmap v2580: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:46.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:46 smithi033 ceph-mon[101165]: pgmap v2581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:47.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:46 smithi037 ceph-mon[69017]: pgmap v2581: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:49.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:48 smithi037 ceph-mon[69017]: pgmap v2582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:49.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:48 smithi033 ceph-mon[101165]: pgmap v2582: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:51.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:50 smithi037 ceph-mon[69017]: pgmap v2583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:51.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:50 smithi033 ceph-mon[101165]: pgmap v2583: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:53.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:52 smithi037 ceph-mon[69017]: pgmap v2584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:53.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:52 smithi033 ceph-mon[101165]: pgmap v2584: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:55.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:54 smithi037 ceph-mon[69017]: pgmap v2585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:04:55.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:04:55.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:54 smithi033 ceph-mon[101165]: pgmap v2585: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:55.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:04:55.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:04:55.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 -- 172.21.15.33:0/911792427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 msgr2=0x7f76e00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:55.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 --2- 172.21.15.33:0/911792427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e00f59e0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f76dc004660 tx=0x7f76dc009b30).stop 2022-02-02T15:04:55.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 -- 172.21.15.33:0/911792427 shutdown_connections 2022-02-02T15:04:55.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 --2- 172.21.15.33:0/911792427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 0x7f76e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 --2- 172.21.15.33:0/911792427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e00f59e0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 -- 172.21.15.33:0/911792427 >> 172.21.15.33:0/911792427 conn(0x7f76e00f0d40 msgr2=0x7f76e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:55.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 -- 172.21.15.33:0/911792427 shutdown_connections 2022-02-02T15:04:55.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 -- 172.21.15.33:0/911792427 wait complete. 2022-02-02T15:04:55.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.785+0000 7f76e82c5700 1 Processor -- start 2022-02-02T15:04:55.784 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e82c5700 1 -- start start 2022-02-02T15:04:55.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e82c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:55.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e82c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 0x7f76e010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:55.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e82c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00603c0 con 0x7f76e00f55c0 2022-02-02T15:04:55.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e82c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e0060500 con 0x7f76e00f6860 2022-02-02T15:04:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e6061700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e6061700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35850/0 (socket says 172.21.15.33:35850) 2022-02-02T15:04:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e6061700 1 -- 172.21.15.33:0/2243464101 learned_addr learned my addr 172.21.15.33:0/2243464101 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:55.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e5860700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 0x7f76e010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e6061700 1 -- 172.21.15.33:0/2243464101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 msgr2=0x7f76e010c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.786+0000 7f76e6061700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 0x7f76e010c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76e6061700 1 -- 172.21.15.33:0/2243464101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc005040 con 0x7f76e00f55c0 2022-02-02T15:04:55.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76e6061700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f76dc013a70 tx=0x7f76dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:55.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76dc018070 con 0x7f76e00f55c0 2022-02-02T15:04:55.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e010c6e0 con 0x7f76e00f55c0 2022-02-02T15:04:55.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e010cc10 con 0x7f76e00f55c0 2022-02-02T15:04:55.788 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f76dc0097d0 con 0x7f76e00f55c0 2022-02-02T15:04:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.787+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76dc01dbe0 con 0x7f76e00f55c0 2022-02-02T15:04:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.788+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c8004fa0 con 0x7f76e00f55c0 2022-02-02T15:04:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.788+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f76dc027440 con 0x7f76e00f55c0 2022-02-02T15:04:55.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.789+0000 7f76d6ffd700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 0x7f76cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.789+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f76dc083290 con 0x7f76e00f55c0 2022-02-02T15:04:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.789+0000 7f76e5860700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 0x7f76cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:55.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.789+0000 7f76e5860700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 0x7f76cc067290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f76d0004c40 tx=0x7f76d000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:55.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.793+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f76dc051500 con 0x7f76e00f55c0 2022-02-02T15:04:55.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.982+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f76c8000bc0 con 0x7f76cc064dd0 2022-02-02T15:04:55.977 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.983+0000 7f76d6ffd700 1 -- 172.21.15.33:0/2243464101 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f76c8000bc0 con 0x7f76cc064dd0 2022-02-02T15:04:55.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 msgr2=0x7f76cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:55.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 0x7f76cc067290 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f76d0004c40 tx=0x7f76d000b040).stop 2022-02-02T15:04:55.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 msgr2=0x7f76e0109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:55.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f76dc013a70 tx=0x7f76dc009b30).stop 2022-02-02T15:04:55.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 shutdown_connections 2022-02-02T15:04:55.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f76cc064dd0 0x7f76cc067290 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e00f55c0 0x7f76e0109c90 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 --2- 172.21.15.33:0/2243464101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e00f6860 0x7f76e010c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:55.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 >> 172.21.15.33:0/2243464101 conn(0x7f76e00f0d40 msgr2=0x7f76e00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:55.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 shutdown_connections 2022-02-02T15:04:55.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:55.985+0000 7f76e82c5700 1 -- 172.21.15.33:0/2243464101 wait complete. 2022-02-02T15:04:55.989 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:04:56.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 -- 172.21.15.33:0/3547032291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f66e0 msgr2=0x7f49ec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 --2- 172.21.15.33:0/3547032291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f66e0 0x7f49ec0f6b00 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f49e8004660 tx=0x7f49e8009b30).stop 2022-02-02T15:04:56.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 -- 172.21.15.33:0/3547032291 shutdown_connections 2022-02-02T15:04:56.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 --2- 172.21.15.33:0/3547032291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f7980 0x7f49ec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 --2- 172.21.15.33:0/3547032291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f66e0 0x7f49ec0f6b00 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 -- 172.21.15.33:0/3547032291 >> 172.21.15.33:0/3547032291 conn(0x7f49ec0f1e40 msgr2=0x7f49ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 -- 172.21.15.33:0/3547032291 shutdown_connections 2022-02-02T15:04:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.086+0000 7f49f41b3700 1 -- 172.21.15.33:0/3547032291 wait complete. 2022-02-02T15:04:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 Processor -- start 2022-02-02T15:04:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 -- start start 2022-02-02T15:04:56.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f66e0 0x7f49ec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec06a380 con 0x7f49ec0f7980 2022-02-02T15:04:56.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f41b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec06a4c0 con 0x7f49ec0f66e0 2022-02-02T15:04:56.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35862/0 (socket says 172.21.15.33:35862) 2022-02-02T15:04:56.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 -- 172.21.15.33:0/1071094733 learned_addr learned my addr 172.21.15.33:0/1071094733 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:56.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f1f4f700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f66e0 0x7f49ec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 -- 172.21.15.33:0/1071094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f66e0 msgr2=0x7f49ec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f66e0 0x7f49ec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.087+0000 7f49f174e700 1 -- 172.21.15.33:0/1071094733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8005040 con 0x7f49ec0f7980 2022-02-02T15:04:56.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49f174e700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f49dc0026d0 tx=0x7f49dc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49dc009320 con 0x7f49ec0f7980 2022-02-02T15:04:56.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f49dc00f040 con 0x7f49ec0f7980 2022-02-02T15:04:56.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec06a7a0 con 0x7f49ec0f7980 2022-02-02T15:04:56.089 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49dc0147e0 con 0x7f49ec0f7980 2022-02-02T15:04:56.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.088+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec10efe0 con 0x7f49ec0f7980 2022-02-02T15:04:56.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.089+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec045ad0 con 0x7f49ec0f7980 2022-02-02T15:04:56.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.089+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f49dc009480 con 0x7f49ec0f7980 2022-02-02T15:04:56.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.090+0000 7f49e27fc700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 0x7f49d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.090 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.090+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f49dc082170 con 0x7f49ec0f7980 2022-02-02T15:04:56.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.090+0000 7f49f1f4f700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 0x7f49d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.090+0000 7f49f1f4f700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 0x7f49d8067290 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f49e8004e30 tx=0x7f49e8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.091 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.094+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f49dc050220 con 0x7f49ec0f7980 2022-02-02T15:04:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.277+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f49ec0ff050 con 0x7f49d8064dd0 2022-02-02T15:04:56.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.292+0000 7f49e27fc700 1 -- 172.21.15.33:0/1071094733 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f49e8019040 con 0x7f49d8064dd0 2022-02-02T15:04:56.286 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:04:56.287 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (90m) 52m ago 91m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:04:56.287 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (83m) 52m ago 91m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:04:56.287 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (83m) 52m ago 90m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:04:56.287 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (90m) 52m ago 91m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:04:56.288 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (83m) 52m ago 87m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:04:56.288 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (84m) 52m ago 87m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:04:56.288 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (85m) 52m ago 87m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:04:56.288 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (87m) 52m ago 87m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:04:56.289 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (84m) 52m ago 92m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:04:56.289 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (84m) 52m ago 90m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:04:56.289 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (84m) 52m ago 92m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:04:56.289 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (83m) 52m ago 90m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:04:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (90m) 52m ago 90m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:04:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (90m) 52m ago 90m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:04:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 52m ago 89m - 4096M 2022-02-02T15:04:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (89m) 52m ago 89m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:04:56.290 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (89m) 52m ago 89m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:04:56.291 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (89m) 52m ago 89m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:04:56.291 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (88m) 52m ago 88m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:04:56.291 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (88m) 52m ago 88m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:04:56.291 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (90m) 52m ago 90m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:04:56.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 msgr2=0x7f49d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 0x7f49d8067290 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f49e8004e30 tx=0x7f49e8009b30).stop 2022-02-02T15:04:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 msgr2=0x7f49ec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7f49dc0026d0 tx=0x7f49dc009de0).stop 2022-02-02T15:04:56.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 shutdown_connections 2022-02-02T15:04:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f49d8064dd0 0x7f49d8067290 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49ec0f66e0 0x7f49ec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 --2- 172.21.15.33:0/1071094733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49ec0f7980 0x7f49ec069e20 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 >> 172.21.15.33:0/1071094733 conn(0x7f49ec0f1e40 msgr2=0x7f49ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 shutdown_connections 2022-02-02T15:04:56.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.294+0000 7f49f41b3700 1 -- 172.21.15.33:0/1071094733 wait complete. 2022-02-02T15:04:56.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.393+0000 7f997d0f9700 1 -- 172.21.15.33:0/3778618117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f77d0 msgr2=0x7f99780f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.393+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3778618117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f77d0 0x7f99780f7c30 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f9960004660 tx=0x7f9960009b30).stop 2022-02-02T15:04:56.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 -- 172.21.15.33:0/3778618117 shutdown_connections 2022-02-02T15:04:56.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3778618117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f77d0 0x7f99780f7c30 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3778618117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f6530 0x7f99780f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 -- 172.21.15.33:0/3778618117 >> 172.21.15.33:0/3778618117 conn(0x7f99780f1c90 msgr2=0x7f99780f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 -- 172.21.15.33:0/3778618117 shutdown_connections 2022-02-02T15:04:56.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 -- 172.21.15.33:0/3778618117 wait complete. 2022-02-02T15:04:56.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 Processor -- start 2022-02-02T15:04:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.394+0000 7f997d0f9700 1 -- start start 2022-02-02T15:04:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f997d0f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f997d0f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f77d0 0x7f9978069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f997d0f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997806a380 con 0x7f99780f6530 2022-02-02T15:04:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f997d0f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997806a4c0 con 0x7f99780f77d0 2022-02-02T15:04:56.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35870/0 (socket says 172.21.15.33:35870) 2022-02-02T15:04:56.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 -- 172.21.15.33:0/3180334793 learned_addr learned my addr 172.21.15.33:0/3180334793 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:56.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f99777fe700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f77d0 0x7f9978069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 -- 172.21.15.33:0/3180334793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f77d0 msgr2=0x7f9978069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f77d0 0x7f9978069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 -- 172.21.15.33:0/3180334793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9960005040 con 0x7f99780f6530 2022-02-02T15:04:56.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9977fff700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f996800c530 tx=0x7f9968007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.395+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f996800f650 con 0x7f99780f6530 2022-02-02T15:04:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.396+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997806a7a0 con 0x7f99780f6530 2022-02-02T15:04:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.396+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f996800fc60 con 0x7f99780f6530 2022-02-02T15:04:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.396+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9968012cb0 con 0x7f99780f6530 2022-02-02T15:04:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.396+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997810ed50 con 0x7f99780f6530 2022-02-02T15:04:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.397+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9978045ad0 con 0x7f99780f6530 2022-02-02T15:04:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.397+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9968019030 con 0x7f99780f6530 2022-02-02T15:04:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.397+0000 7f9974ff9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 0x7f99640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.398+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9968081680 con 0x7f99780f6530 2022-02-02T15:04:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.398+0000 7f99777fe700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 0x7f99640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.398+0000 7f99777fe700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 0x7f99640672e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f9960004630 tx=0x7f9960009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.402+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f996804f7e0 con 0x7f99780f6530 2022-02-02T15:04:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.650+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f99780fee30 con 0x7f99780f6530 2022-02-02T15:04:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.651+0000 7f9974ff9700 1 -- 172.21.15.33:0/3180334793 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f99680172d0 con 0x7f99780f6530 2022-02-02T15:04:56.646 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:04:56.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:04:56.646 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:04:56.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:56.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:04:56.647 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:04:56.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:56.647 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:04:56.647 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:04:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:04:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:04:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:04:56.648 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:04:56.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:04:56.649 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:04:56.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:04:56.649 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:04:56.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 msgr2=0x7f99640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 0x7f99640672e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f9960004630 tx=0x7f9960009b30).stop 2022-02-02T15:04:56.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 msgr2=0x7f997806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f996800c530 tx=0x7f9968007e10).stop 2022-02-02T15:04:56.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 shutdown_connections 2022-02-02T15:04:56.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9964064e20 0x7f99640672e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780f6530 0x7f997806b9a0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 --2- 172.21.15.33:0/3180334793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99780f77d0 0x7f9978069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 >> 172.21.15.33:0/3180334793 conn(0x7f99780f1c90 msgr2=0x7f99780fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 shutdown_connections 2022-02-02T15:04:56.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.653+0000 7f997d0f9700 1 -- 172.21.15.33:0/3180334793 wait complete. 2022-02-02T15:04:56.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 -- 172.21.15.33:0/3962888674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 msgr2=0x7f24d00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/3962888674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d00f6cc0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f24c4004660 tx=0x7f24c4009b30).stop 2022-02-02T15:04:56.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 -- 172.21.15.33:0/3962888674 shutdown_connections 2022-02-02T15:04:56.754 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/3962888674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d00f6cc0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/3962888674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 0x7f24d00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 -- 172.21.15.33:0/3962888674 >> 172.21.15.33:0/3962888674 conn(0x7f24d00f0d40 msgr2=0x7f24d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 -- 172.21.15.33:0/3962888674 shutdown_connections 2022-02-02T15:04:56.755 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.759+0000 7f24d5bf6700 1 -- 172.21.15.33:0/3962888674 wait complete. 2022-02-02T15:04:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 Processor -- start 2022-02-02T15:04:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 -- start start 2022-02-02T15:04:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 0x7f24d0109b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0060420 con 0x7f24d00f6860 2022-02-02T15:04:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.760+0000 7f24d5bf6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0060560 con 0x7f24d00f55c0 2022-02-02T15:04:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35882/0 (socket says 172.21.15.33:35882) 2022-02-02T15:04:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 -- 172.21.15.33:0/2734936675 learned_addr learned my addr 172.21.15.33:0/2734936675 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:04:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24cf7fe700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 0x7f24d0109b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 -- 172.21.15.33:0/2734936675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 msgr2=0x7f24d0109b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 0x7f24d0109b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 -- 172.21.15.33:0/2734936675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c4005040 con 0x7f24d00f6860 2022-02-02T15:04:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24ceffd700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f24c4000c00 tx=0x7f24c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c4019070 con 0x7f24d00f6860 2022-02-02T15:04:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24c4007e70 con 0x7f24d00f6860 2022-02-02T15:04:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d010c630 con 0x7f24d00f6860 2022-02-02T15:04:56.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24c4014ce0 con 0x7f24d00f6860 2022-02-02T15:04:56.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.761+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d010cb60 con 0x7f24d00f6860 2022-02-02T15:04:56.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.762+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d0045ad0 con 0x7f24d00f6860 2022-02-02T15:04:56.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.763+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24c4025070 con 0x7f24d00f6860 2022-02-02T15:04:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.763+0000 7f24b7fff700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 0x7f24b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:04:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.764+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f24c4082d20 con 0x7f24d00f6860 2022-02-02T15:04:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.764+0000 7f24cf7fe700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 0x7f24b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:04:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.764+0000 7f24cf7fe700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 0x7f24b8067290 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f24d00600a0 tx=0x7f24c000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:04:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.767+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24c4050e50 con 0x7f24d00f6860 2022-02-02T15:04:56.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.980+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f24d0027a00 con 0x7f24d00f6860 2022-02-02T15:04:56.975 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:56 smithi033 ceph-mon[101165]: pgmap v2586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:56.975 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:56 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3180334793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:04:56.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.981+0000 7f24b7fff700 1 -- 172.21.15.33:0/2734936675 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f24c4023070 con 0x7f24d00f6860 2022-02-02T15:04:56.977 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:04:56.977 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:04:56.977 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:04:56.977 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:04:56.978 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:56.978 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:04:56.978 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:04:56.978 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:04:56.979 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:04:56.979 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:04:56.979 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:04:56.979 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:04:56.979 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:04:56.980 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:04:56.980 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:04:56.980 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:04:56.980 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:04:56.981 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:04:56.981 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:04:56.981 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:04:56.981 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:04:56.981 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:04:56.982 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:04:56.982 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:04:56.982 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:04:56.982 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:04:56.983 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:04:56.983 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:04:56.983 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:04:56.983 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:04:56.984 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:04:56.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:56.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:56.984 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:04:56.984 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:04:56.985 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:56.985 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:56.985 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:56.985 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:04:56.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 msgr2=0x7f24b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 0x7f24b8067290 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f24d00600a0 tx=0x7f24c000b040).stop 2022-02-02T15:04:56.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 msgr2=0x7f24d010c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:04:56.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f24c4000c00 tx=0x7f24c400b040).stop 2022-02-02T15:04:56.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 shutdown_connections 2022-02-02T15:04:56.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24b8064dd0 0x7f24b8067290 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24d00f55c0 0x7f24d0109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 --2- 172.21.15.33:0/2734936675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24d00f6860 0x7f24d010c080 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:04:56.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 >> 172.21.15.33:0/2734936675 conn(0x7f24d00f0d40 msgr2=0x7f24d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:04:56.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 shutdown_connections 2022-02-02T15:04:56.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:04:56.984+0000 7f24d5bf6700 1 -- 172.21.15.33:0/2734936675 wait complete. 2022-02-02T15:04:56.989 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:04:57.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:56 smithi037 ceph-mon[69017]: pgmap v2586: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:57.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:56 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3180334793' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:04:58.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:57 smithi037 ceph-mon[69017]: from='client.36722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:58.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:57 smithi037 ceph-mon[69017]: from='client.36726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:58.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2734936675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:04:58.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:04:57 smithi037 ceph-mon[69017]: pgmap v2587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:04:58.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:57 smithi033 ceph-mon[101165]: from='client.36722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:58.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:57 smithi033 ceph-mon[101165]: from='client.36726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:04:58.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2734936675' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:04:58.236 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:04:57 smithi033 ceph-mon[101165]: pgmap v2587: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:00.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:00 smithi033 ceph-mon[101165]: pgmap v2588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:01.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:00 smithi037 ceph-mon[69017]: pgmap v2588: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:02.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:02 smithi033 ceph-mon[101165]: pgmap v2589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:03.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:02 smithi037 ceph-mon[69017]: pgmap v2589: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:04.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:04 smithi033 ceph-mon[101165]: pgmap v2590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:05.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:04 smithi037 ceph-mon[69017]: pgmap v2590: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:06.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:06 smithi033 ceph-mon[101165]: pgmap v2591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:07.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:06 smithi037 ceph-mon[69017]: pgmap v2591: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:09.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:08 smithi037 ceph-mon[69017]: pgmap v2592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:09.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:08 smithi033 ceph-mon[101165]: pgmap v2592: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:11.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:10 smithi037 ceph-mon[69017]: pgmap v2593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:11.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:10 smithi033 ceph-mon[101165]: pgmap v2593: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:13.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:12 smithi037 ceph-mon[69017]: pgmap v2594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:13.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:12 smithi033 ceph-mon[101165]: pgmap v2594: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:15.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:14 smithi037 ceph-mon[69017]: pgmap v2595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:15.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:14 smithi033 ceph-mon[101165]: pgmap v2595: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:17.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:16 smithi037 ceph-mon[69017]: pgmap v2596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:17.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:16 smithi033 ceph-mon[101165]: pgmap v2596: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:19.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:18 smithi037 ceph-mon[69017]: pgmap v2597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:19.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:18 smithi033 ceph-mon[101165]: pgmap v2597: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:20.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:19 smithi033 ceph-mon[101165]: pgmap v2598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:20.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:19 smithi037 ceph-mon[69017]: pgmap v2598: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:22.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:22 smithi033 ceph-mon[101165]: pgmap v2599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:23.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:22 smithi037 ceph-mon[69017]: pgmap v2599: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:24.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:24 smithi033 ceph-mon[101165]: pgmap v2600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:25.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:24 smithi037 ceph-mon[69017]: pgmap v2600: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:26.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:26 smithi033 ceph-mon[101165]: pgmap v2601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:27.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:26 smithi037 ceph-mon[69017]: pgmap v2601: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 -- 172.21.15.33:0/258036484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f6860 msgr2=0x7f7a4c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 --2- 172.21.15.33:0/258036484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c0f6cc0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f7a40004660 tx=0x7f7a40009b30).stop 2022-02-02T15:05:27.093 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 -- 172.21.15.33:0/258036484 shutdown_connections 2022-02-02T15:05:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 --2- 172.21.15.33:0/258036484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c0f6cc0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 --2- 172.21.15.33:0/258036484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 -- 172.21.15.33:0/258036484 >> 172.21.15.33:0/258036484 conn(0x7f7a4c0f0d40 msgr2=0x7f7a4c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.097+0000 7f7a528d4700 1 -- 172.21.15.33:0/258036484 shutdown_connections 2022-02-02T15:05:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.098+0000 7f7a528d4700 1 -- 172.21.15.33:0/258036484 wait complete. 2022-02-02T15:05:27.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.098+0000 7f7a528d4700 1 Processor -- start 2022-02-02T15:05:27.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.098+0000 7f7a528d4700 1 -- start start 2022-02-02T15:05:27.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a528d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a528d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a528d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c0603c0 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a528d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a4c060500 con 0x7f7a4c0f6860 2022-02-02T15:05:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35890/0 (socket says 172.21.15.33:35890) 2022-02-02T15:05:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 -- 172.21.15.33:0/3979001426 learned_addr learned my addr 172.21.15.33:0/3979001426 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4b7fe700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 -- 172.21.15.33:0/3979001426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f6860 msgr2=0x7f7a4c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 -- 172.21.15.33:0/3979001426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40005040 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a4bfff700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f7a3c002700 tx=0x7f7a3c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.099+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3c0079c0 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.100+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7a3c00f040 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.100+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a4c10c720 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.100+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a3c014860 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.100+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a4c10ccb0 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.101+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a4c045ad0 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.101+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7a3c01b060 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.102+0000 7f7a48ff9700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 0x7f7a34067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.102+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7a3c081940 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.102+0000 7f7a4b7fe700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 0x7f7a34067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.103+0000 7f7a4b7fe700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 0x7f7a34067290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f7a40004630 tx=0x7f7a40009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.106+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7a3c04f9f0 con 0x7f7a4c0f55c0 2022-02-02T15:05:27.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.296+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a4c057f10 con 0x7f7a34064dd0 2022-02-02T15:05:27.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.297+0000 7f7a48ff9700 1 -- 172.21.15.33:0/3979001426 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f7a4c057f10 con 0x7f7a34064dd0 2022-02-02T15:05:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 msgr2=0x7f7a34067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 0x7f7a34067290 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7f7a40004630 tx=0x7f7a40009b30).stop 2022-02-02T15:05:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 msgr2=0x7f7a4c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f7a3c002700 tx=0x7f7a3c009d80).stop 2022-02-02T15:05:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 shutdown_connections 2022-02-02T15:05:27.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7a34064dd0 0x7f7a34067290 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a4c0f55c0 0x7f7a4c109c70 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 --2- 172.21.15.33:0/3979001426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a4c0f6860 0x7f7a4c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 >> 172.21.15.33:0/3979001426 conn(0x7f7a4c0f0d40 msgr2=0x7f7a4c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 shutdown_connections 2022-02-02T15:05:27.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.299+0000 7f7a528d4700 1 -- 172.21.15.33:0/3979001426 wait complete. 2022-02-02T15:05:27.304 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:05:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 -- 172.21.15.33:0/155066216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 msgr2=0x7fa7140f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 --2- 172.21.15.33:0/155066216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa7140f7de0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fa710004660 tx=0x7fa710009b30).stop 2022-02-02T15:05:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 -- 172.21.15.33:0/155066216 shutdown_connections 2022-02-02T15:05:27.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 --2- 172.21.15.33:0/155066216 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa7140f7de0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 --2- 172.21.15.33:0/155066216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa7140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 -- 172.21.15.33:0/155066216 >> 172.21.15.33:0/155066216 conn(0x7fa7140f1e40 msgr2=0x7fa7140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 -- 172.21.15.33:0/155066216 shutdown_connections 2022-02-02T15:05:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.400+0000 7fa71c30d700 1 -- 172.21.15.33:0/155066216 wait complete. 2022-02-02T15:05:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 Processor -- start 2022-02-02T15:05:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 -- start start 2022-02-02T15:05:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa71406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71406a380 con 0x7fa7140f7980 2022-02-02T15:05:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa71c30d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71406a4c0 con 0x7fa7140f66e0 2022-02-02T15:05:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.401+0000 7fa7198a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35902/0 (socket says 172.21.15.33:35902) 2022-02-02T15:05:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 -- 172.21.15.33:0/3272271400 learned_addr learned my addr 172.21.15.33:0/3272271400 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa71a0a9700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa71406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 -- 172.21.15.33:0/3272271400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 msgr2=0x7fa71406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa71406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 -- 172.21.15.33:0/3272271400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa710005040 con 0x7fa7140f7980 2022-02-02T15:05:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa71a0a9700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa71406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:05:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa7198a8700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fa710009990 tx=0x7fa710009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa710018070 con 0x7fa7140f7980 2022-02-02T15:05:27.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71406a740 con 0x7fa7140f7980 2022-02-02T15:05:27.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa710007ba0 con 0x7fa7140f7980 2022-02-02T15:05:27.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71406aca0 con 0x7fa7140f7980 2022-02-02T15:05:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.402+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa71001ddb0 con 0x7fa7140f7980 2022-02-02T15:05:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.403+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa714045ad0 con 0x7fa7140f7980 2022-02-02T15:05:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.404+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa71001d420 con 0x7fa7140f7980 2022-02-02T15:05:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.405+0000 7fa70affd700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 0x7fa700067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.405+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa7100835d0 con 0x7fa7140f7980 2022-02-02T15:05:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.405+0000 7fa71a0a9700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 0x7fa700067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.405+0000 7fa71a0a9700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 0x7fa700067290 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fa704009fd0 tx=0x7fa70400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.409+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa710051620 con 0x7fa7140f7980 2022-02-02T15:05:27.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.591+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7140ff050 con 0x7fa700064dd0 2022-02-02T15:05:27.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.606+0000 7fa70affd700 1 -- 172.21.15.33:0/3272271400 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fa70400f040 con 0x7fa700064dd0 2022-02-02T15:05:27.601 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:05:27.602 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (90m) 52m ago 91m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:05:27.602 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (83m) 52m ago 91m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:05:27.602 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (83m) 52m ago 91m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:05:27.602 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (90m) 52m ago 91m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:05:27.602 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (84m) 52m ago 87m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:05:27.603 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (84m) 52m ago 87m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:05:27.603 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (85m) 52m ago 87m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:05:27.603 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (87m) 52m ago 87m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:05:27.603 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (85m) 52m ago 93m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:05:27.604 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (84m) 52m ago 91m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:05:27.604 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (84m) 52m ago 93m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:05:27.604 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (84m) 52m ago 91m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:05:27.604 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (91m) 52m ago 91m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:05:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (91m) 52m ago 90m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:05:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 52m ago 90m - 4096M 2022-02-02T15:05:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (90m) 52m ago 90m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:05:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (89m) 52m ago 89m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:05:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (89m) 52m ago 89m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:05:27.606 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (89m) 52m ago 89m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:05:27.606 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (89m) 52m ago 89m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:05:27.606 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (90m) 52m ago 91m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:05:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 msgr2=0x7fa700067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 0x7fa700067290 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fa704009fd0 tx=0x7fa70400b040).stop 2022-02-02T15:05:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 msgr2=0x7fa714069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7fa710009990 tx=0x7fa710009b30).stop 2022-02-02T15:05:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 shutdown_connections 2022-02-02T15:05:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa700064dd0 0x7fa700067290 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7140f66e0 0x7fa71406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 --2- 172.21.15.33:0/3272271400 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7140f7980 0x7fa714069e20 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 >> 172.21.15.33:0/3272271400 conn(0x7fa7140f1e40 msgr2=0x7fa7140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 shutdown_connections 2022-02-02T15:05:27.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.609+0000 7fa71c30d700 1 -- 172.21.15.33:0/3272271400 wait complete. 2022-02-02T15:05:27.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 -- 172.21.15.33:0/1247641184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 msgr2=0x7f3bac0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/1247641184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac0f6b00 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f3b9c004660 tx=0x7f3b9c009b30).stop 2022-02-02T15:05:27.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 -- 172.21.15.33:0/1247641184 shutdown_connections 2022-02-02T15:05:27.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/1247641184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/1247641184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac0f6b00 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 -- 172.21.15.33:0/1247641184 >> 172.21.15.33:0/1247641184 conn(0x7f3bac0f1e40 msgr2=0x7f3bac0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 -- 172.21.15.33:0/1247641184 shutdown_connections 2022-02-02T15:05:27.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.709+0000 7f3bb0d01700 1 -- 172.21.15.33:0/1247641184 wait complete. 2022-02-02T15:05:27.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 Processor -- start 2022-02-02T15:05:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 -- start start 2022-02-02T15:05:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac107a50 con 0x7f3bac0f66e0 2022-02-02T15:05:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3bb0d01700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac107b90 con 0x7f3bac0f7980 2022-02-02T15:05:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3baa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35910/0 (socket says 172.21.15.33:35910) 2022-02-02T15:05:27.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.710+0000 7f3baa59c700 1 -- 172.21.15.33:0/3335679419 learned_addr learned my addr 172.21.15.33:0/3335679419 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:27.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3ba9d9b700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3baa59c700 1 -- 172.21.15.33:0/3335679419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 msgr2=0x7f3bac1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3baa59c700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3baa59c700 1 -- 172.21.15.33:0/3335679419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c005040 con 0x7f3bac0f66e0 2022-02-02T15:05:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3ba9d9b700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:05:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3baa59c700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f3b9c013a70 tx=0x7f3b9c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9c018070 con 0x7f3bac0f66e0 2022-02-02T15:05:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3b9c0097d0 con 0x7f3bac0f66e0 2022-02-02T15:05:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac1084d0 con 0x7f3bac0f66e0 2022-02-02T15:05:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b9c01c3c0 con 0x7f3bac0f66e0 2022-02-02T15:05:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.711+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac108a30 con 0x7f3bac0f66e0 2022-02-02T15:05:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.712+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac045ad0 con 0x7f3bac0f66e0 2022-02-02T15:05:27.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.713+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3b9c007ba0 con 0x7f3bac0f66e0 2022-02-02T15:05:27.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.714+0000 7f3b9affd700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:27.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.714+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3b9c083690 con 0x7f3bac0f66e0 2022-02-02T15:05:27.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.714+0000 7f3ba9d9b700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:27.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.714+0000 7f3ba9d9b700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 0x7f3b94067290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f3ba0009fd0 tx=0x7f3ba000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:27.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.718+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3b9c055230 con 0x7f3bac0f66e0 2022-02-02T15:05:27.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.961+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3bac0ff020 con 0x7f3bac0f66e0 2022-02-02T15:05:27.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.962+0000 7f3b9affd700 1 -- 172.21.15.33:0/3335679419 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3b9c054e20 con 0x7f3bac0f66e0 2022-02-02T15:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:05:27.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:27.959 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:05:27.960 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:05:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:05:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:05:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:05:27.961 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:05:27.962 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 msgr2=0x7f3b94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 0x7f3b94067290 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f3ba0009fd0 tx=0x7f3ba000b040).stop 2022-02-02T15:05:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 msgr2=0x7f3bac106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f3b9c013a70 tx=0x7f3b9c009b30).stop 2022-02-02T15:05:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 shutdown_connections 2022-02-02T15:05:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3b94064dd0 0x7f3b94067290 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bac0f66e0 0x7f3bac106fb0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 --2- 172.21.15.33:0/3335679419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bac0f7980 0x7f3bac1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 >> 172.21.15.33:0/3335679419 conn(0x7f3bac0f1e40 msgr2=0x7f3bac0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 shutdown_connections 2022-02-02T15:05:27.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:27.964+0000 7f3bb0d01700 1 -- 172.21.15.33:0/3335679419 wait complete. 2022-02-02T15:05:28.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 -- 172.21.15.33:0/2095818285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f5430 msgr2=0x7fb46c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:28.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 --2- 172.21.15.33:0/2095818285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f5430 0x7fb46c0f5850 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7fb45c004660 tx=0x7fb45c009b30).stop 2022-02-02T15:05:28.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 -- 172.21.15.33:0/2095818285 shutdown_connections 2022-02-02T15:05:28.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 --2- 172.21.15.33:0/2095818285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f66d0 0x7fb46c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 --2- 172.21.15.33:0/2095818285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f5430 0x7fb46c0f5850 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.064+0000 7fb47085b700 1 -- 172.21.15.33:0/2095818285 >> 172.21.15.33:0/2095818285 conn(0x7fb46c0f0b90 msgr2=0x7fb46c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:28.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 -- 172.21.15.33:0/2095818285 shutdown_connections 2022-02-02T15:05:28.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 -- 172.21.15.33:0/2095818285 wait complete. 2022-02-02T15:05:28.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 Processor -- start 2022-02-02T15:05:28.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 -- start start 2022-02-02T15:05:28.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f5430 0x7fb46c108fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:28.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:28.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c109a40 con 0x7fb46c0f66d0 2022-02-02T15:05:28.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.065+0000 7fb47085b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46c109b80 con 0x7fb46c0f5430 2022-02-02T15:05:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35922/0 (socket says 172.21.15.33:35922) 2022-02-02T15:05:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 -- 172.21.15.33:0/2551228690 learned_addr learned my addr 172.21.15.33:0/2551228690 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46b7fe700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f5430 0x7fb46c108fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:28.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 -- 172.21.15.33:0/2551228690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f5430 msgr2=0x7fb46c108fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:28.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f5430 0x7fb46c108fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 -- 172.21.15.33:0/2551228690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c005040 con 0x7fb46c0f66d0 2022-02-02T15:05:28.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb46affd700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fb46000c790 tx=0x7fb460007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:28.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb460002590 con 0x7fb46c0f66d0 2022-02-02T15:05:28.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb460002ba0 con 0x7fb46c0f66d0 2022-02-02T15:05:28.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46c10a520 con 0x7fb46c0f66d0 2022-02-02T15:05:28.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb460013d90 con 0x7fb46c0f66d0 2022-02-02T15:05:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.066+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46c10aae0 con 0x7fb46c0f66d0 2022-02-02T15:05:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.067+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46c045ad0 con 0x7fb46c0f66d0 2022-02-02T15:05:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.068+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb46001a060 con 0x7fb46c0f66d0 2022-02-02T15:05:28.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.068+0000 7fb453fff700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 0x7fb4540672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:28.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.068+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb460081d10 con 0x7fb46c0f66d0 2022-02-02T15:05:28.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.068+0000 7fb46b7fe700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 0x7fb4540672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:28.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.069+0000 7fb46b7fe700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 0x7fb4540672e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fb45c004630 tx=0x7fb45c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:28.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.072+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb460053790 con 0x7fb46c0f66d0 2022-02-02T15:05:28.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.288+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb46c10b120 con 0x7fb46c0f66d0 2022-02-02T15:05:28.284 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.288+0000 7fb453fff700 1 -- 172.21.15.33:0/2551228690 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb460053380 con 0x7fb46c0f66d0 2022-02-02T15:05:28.284 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:05:28.284 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:05:28.285 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:05:28.285 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:05:28.285 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:28.285 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:05:28.285 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:05:28.286 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:05:28.286 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:05:28.286 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:05:28.286 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:05:28.287 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:05:28.287 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:05:28.287 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:05:28.287 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:05:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:05:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:05:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:05:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:05:28.289 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:05:28.289 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:05:28.289 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:05:28.289 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:05:28.289 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:05:28.290 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:05:28.290 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:05:28.290 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:05:28.290 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:05:28.291 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:05:28.291 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:05:28.291 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:05:28.291 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:28.292 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:05:28.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:28.292 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:28.292 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:28.293 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:28.293 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:28.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 msgr2=0x7fb4540672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:28.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 0x7fb4540672e0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7fb45c004630 tx=0x7fb45c009b30).stop 2022-02-02T15:05:28.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 msgr2=0x7fb46c109490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:28.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7fb46000c790 tx=0x7fb460007d70).stop 2022-02-02T15:05:28.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 shutdown_connections 2022-02-02T15:05:28.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb454064e20 0x7fb4540672e0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb46c0f5430 0x7fb46c108fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 --2- 172.21.15.33:0/2551228690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb46c0f66d0 0x7fb46c109490 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:28.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 >> 172.21.15.33:0/2551228690 conn(0x7fb46c0f0b90 msgr2=0x7fb46c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:28.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 shutdown_connections 2022-02-02T15:05:28.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:28.291+0000 7fb47085b700 1 -- 172.21.15.33:0/2551228690 wait complete. 2022-02-02T15:05:28.297 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:05:29.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:28 smithi037 ceph-mon[69017]: from='client.36738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:05:29.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:28 smithi037 ceph-mon[69017]: from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:05:29.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:28 smithi037 ceph-mon[69017]: pgmap v2602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:29.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3335679419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:05:29.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2551228690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:05:29.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:28 smithi033 ceph-mon[101165]: from='client.36738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:05:29.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:28 smithi033 ceph-mon[101165]: from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:05:29.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:28 smithi033 ceph-mon[101165]: pgmap v2602: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:29.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3335679419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:05:29.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2551228690' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:05:31.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:30 smithi037 ceph-mon[69017]: pgmap v2603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:31.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:30 smithi033 ceph-mon[101165]: pgmap v2603: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:33.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:32 smithi037 ceph-mon[69017]: pgmap v2604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:33.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:32 smithi033 ceph-mon[101165]: pgmap v2604: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:35.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:34 smithi037 ceph-mon[69017]: pgmap v2605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:35.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:34 smithi033 ceph-mon[101165]: pgmap v2605: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:37.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:36 smithi037 ceph-mon[69017]: pgmap v2606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:37.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:36 smithi033 ceph-mon[101165]: pgmap v2606: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:38.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:37 smithi037 ceph-mon[69017]: pgmap v2607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:38.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:37 smithi033 ceph-mon[101165]: pgmap v2607: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:40.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:40 smithi033 ceph-mon[101165]: pgmap v2608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:41.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:40 smithi037 ceph-mon[69017]: pgmap v2608: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:43.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:42 smithi037 ceph-mon[69017]: pgmap v2609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:43.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:42 smithi033 ceph-mon[101165]: pgmap v2609: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:45.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:44 smithi037 ceph-mon[69017]: pgmap v2610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:45.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:44 smithi033 ceph-mon[101165]: pgmap v2610: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:47.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:46 smithi037 ceph-mon[69017]: pgmap v2611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:47.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:46 smithi033 ceph-mon[101165]: pgmap v2611: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:49.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:48 smithi037 ceph-mon[69017]: pgmap v2612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:49.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:48 smithi033 ceph-mon[101165]: pgmap v2612: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:51.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:50 smithi037 ceph-mon[69017]: pgmap v2613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:51.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:50 smithi033 ceph-mon[101165]: pgmap v2613: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:53.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:52 smithi037 ceph-mon[69017]: pgmap v2614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:53.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:52 smithi033 ceph-mon[101165]: pgmap v2614: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:54 smithi037 ceph-mon[69017]: pgmap v2615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:55.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:05:55.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:05:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:54 smithi033 ceph-mon[101165]: pgmap v2615: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:55.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:05:55.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:05:56.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:55 smithi033 ceph-mon[101165]: pgmap v2616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:56.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:55 smithi037 ceph-mon[69017]: pgmap v2616: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 -- 172.21.15.33:0/1739002813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f6860 msgr2=0x7f23a40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.403 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 --2- 172.21.15.33:0/1739002813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f6860 0x7f23a40f6cc0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f2394004660 tx=0x7f2394009b30).stop 2022-02-02T15:05:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 -- 172.21.15.33:0/1739002813 shutdown_connections 2022-02-02T15:05:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 --2- 172.21.15.33:0/1739002813 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f6860 0x7f23a40f6cc0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 --2- 172.21.15.33:0/1739002813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f55c0 0x7f23a40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.404 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 -- 172.21.15.33:0/1739002813 >> 172.21.15.33:0/1739002813 conn(0x7f23a40f0d40 msgr2=0x7f23a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 -- 172.21.15.33:0/1739002813 shutdown_connections 2022-02-02T15:05:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.407+0000 7f23a8d60700 1 -- 172.21.15.33:0/1739002813 wait complete. 2022-02-02T15:05:58.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 Processor -- start 2022-02-02T15:05:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 -- start start 2022-02-02T15:05:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f6860 0x7f23a4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4107a10 con 0x7f23a40f55c0 2022-02-02T15:05:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a8d60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4107b50 con 0x7f23a40f6860 2022-02-02T15:05:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35930/0 (socket says 172.21.15.33:35930) 2022-02-02T15:05:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a259c700 1 -- 172.21.15.33:0/3228259724 learned_addr learned my addr 172.21.15.33:0/3228259724 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.408+0000 7f23a1d9b700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f6860 0x7f23a4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a259c700 1 -- 172.21.15.33:0/3228259724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f6860 msgr2=0x7f23a4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a259c700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f6860 0x7f23a4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a259c700 1 -- 172.21.15.33:0/3228259724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394005040 con 0x7f23a40f55c0 2022-02-02T15:05:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a259c700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f238c002700 tx=0x7f238c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238c0079c0 con 0x7f23a40f55c0 2022-02-02T15:05:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f238c00f040 con 0x7f23a40f55c0 2022-02-02T15:05:58.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f238c014860 con 0x7f23a40f55c0 2022-02-02T15:05:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a41084f0 con 0x7f23a40f55c0 2022-02-02T15:05:58.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.409+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a4108ab0 con 0x7f23a40f55c0 2022-02-02T15:05:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.410+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a4045ad0 con 0x7f23a40f55c0 2022-02-02T15:05:58.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.411+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f238c01b060 con 0x7f23a40f55c0 2022-02-02T15:05:58.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.411+0000 7f239affd700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 0x7f2390067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.411+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f238c081860 con 0x7f23a40f55c0 2022-02-02T15:05:58.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.411+0000 7f23a1d9b700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 0x7f2390067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.412+0000 7f23a1d9b700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 0x7f2390067270 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f2394004e30 tx=0x7f2394009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:58.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.415+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f238c053340 con 0x7f23a40f55c0 2022-02-02T15:05:58.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.602+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23a40faca0 con 0x7f2390064db0 2022-02-02T15:05:58.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.603+0000 7f239affd700 1 -- 172.21.15.33:0/3228259724 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f23a40faca0 con 0x7f2390064db0 2022-02-02T15:05:58.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 msgr2=0x7f2390067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 0x7f2390067270 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f2394004e30 tx=0x7f2394009b30).stop 2022-02-02T15:05:58.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 msgr2=0x7f23a4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f238c002700 tx=0x7f238c009d80).stop 2022-02-02T15:05:58.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 shutdown_connections 2022-02-02T15:05:58.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2390064db0 0x7f2390067270 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23a40f55c0 0x7f23a4106f70 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 --2- 172.21.15.33:0/3228259724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23a40f6860 0x7f23a4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 >> 172.21.15.33:0/3228259724 conn(0x7f23a40f0d40 msgr2=0x7f23a405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:58.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 shutdown_connections 2022-02-02T15:05:58.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.605+0000 7f23a8d60700 1 -- 172.21.15.33:0/3228259724 wait complete. 2022-02-02T15:05:58.608 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:05:58.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 -- 172.21.15.33:0/2460417403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f66e0 msgr2=0x7f8c400f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/2460417403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f66e0 0x7f8c400f6b00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f8c380099e0 tx=0x7f8c38004d10).stop 2022-02-02T15:05:58.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 -- 172.21.15.33:0/2460417403 shutdown_connections 2022-02-02T15:05:58.707 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/2460417403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f7980 0x7f8c400f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/2460417403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f66e0 0x7f8c400f6b00 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 -- 172.21.15.33:0/2460417403 >> 172.21.15.33:0/2460417403 conn(0x7f8c400f1e40 msgr2=0x7f8c400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 -- 172.21.15.33:0/2460417403 shutdown_connections 2022-02-02T15:05:58.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.705+0000 7f8c47dd5700 1 -- 172.21.15.33:0/2460417403 wait complete. 2022-02-02T15:05:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 Processor -- start 2022-02-02T15:05:58.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 -- start start 2022-02-02T15:05:58.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f66e0 0x7f8c4006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4006a380 con 0x7f8c400f7980 2022-02-02T15:05:58.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c47dd5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4006a4c0 con 0x7f8c400f66e0 2022-02-02T15:05:58.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.706+0000 7f8c45370700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35942/0 (socket says 172.21.15.33:35942) 2022-02-02T15:05:58.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 -- 172.21.15.33:0/36230782 learned_addr learned my addr 172.21.15.33:0/36230782 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:58.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45b71700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f66e0 0x7f8c4006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 -- 172.21.15.33:0/36230782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f66e0 msgr2=0x7f8c4006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f66e0 0x7f8c4006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 -- 172.21.15.33:0/36230782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009640 con 0x7f8c400f7980 2022-02-02T15:05:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c45370700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f8c3400c530 tx=0x7f8c34007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c3400f650 con 0x7f8c400f7980 2022-02-02T15:05:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4006a7a0 con 0x7f8c400f7980 2022-02-02T15:05:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8c3400fc60 con 0x7f8c400f7980 2022-02-02T15:05:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c34012c20 con 0x7f8c400f7980 2022-02-02T15:05:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.707+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4010f100 con 0x7f8c400f7980 2022-02-02T15:05:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.708+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400f5ad0 con 0x7f8c400f7980 2022-02-02T15:05:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.709+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8c34010070 con 0x7f8c400f7980 2022-02-02T15:05:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.709+0000 7f8c3e7fc700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 0x7f8c28067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:58.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.709+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8c34081700 con 0x7f8c400f7980 2022-02-02T15:05:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.709+0000 7f8c45b71700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 0x7f8c28067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.710+0000 7f8c45b71700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 0x7f8c28067290 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f8c380099b0 tx=0x7f8c38004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:58.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.714+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8c3404f7b0 con 0x7f8c400f7980 2022-02-02T15:05:58.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.897+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c400fef60 con 0x7f8c28064dd0 2022-02-02T15:05:58.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.912+0000 7f8c3e7fc700 1 -- 172.21.15.33:0/36230782 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8c400fef60 con 0x7f8c28064dd0 2022-02-02T15:05:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:05:58.906 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (91m) 53m ago 92m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:05:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (84m) 53m ago 92m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:05:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (84m) 53m ago 91m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:05:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (91m) 53m ago 92m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:05:58.907 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (84m) 53m ago 88m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:05:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (85m) 53m ago 88m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:05:58.908 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (86m) 53m ago 88m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:05:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (88m) 53m ago 88m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:05:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (85m) 53m ago 93m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:05:58.909 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (85m) 53m ago 91m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:05:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (85m) 53m ago 93m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:05:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (84m) 53m ago 91m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:05:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (92m) 53m ago 91m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:05:58.910 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (91m) 53m ago 91m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:05:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 53m ago 90m - 4096M 2022-02-02T15:05:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (90m) 53m ago 90m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:05:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (90m) 53m ago 90m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:05:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (90m) 53m ago 90m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:05:58.911 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (89m) 53m ago 89m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:05:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (89m) 53m ago 89m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:05:58.912 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (91m) 53m ago 91m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:05:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 msgr2=0x7f8c28067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 0x7f8c28067290 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f8c380099b0 tx=0x7f8c38004d10).stop 2022-02-02T15:05:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 msgr2=0x7f8c40069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f8c3400c530 tx=0x7f8c34007e20).stop 2022-02-02T15:05:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 shutdown_connections 2022-02-02T15:05:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8c28064dd0 0x7f8c28067290 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c400f66e0 0x7f8c4006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 --2- 172.21.15.33:0/36230782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8c400f7980 0x7f8c40069e20 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:58.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 >> 172.21.15.33:0/36230782 conn(0x7f8c400f1e40 msgr2=0x7f8c400fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:58.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 shutdown_connections 2022-02-02T15:05:58.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:58.914+0000 7f8c47dd5700 1 -- 172.21.15.33:0/36230782 wait complete. 2022-02-02T15:05:58.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:58 smithi033 ceph-mon[101165]: pgmap v2617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 -- 172.21.15.33:0/1042939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f6860 msgr2=0x7f69f40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 --2- 172.21.15.33:0/1042939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f6860 0x7f69f40f6cc0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f69e4004660 tx=0x7f69e4009b30).stop 2022-02-02T15:05:59.009 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 -- 172.21.15.33:0/1042939103 shutdown_connections 2022-02-02T15:05:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 --2- 172.21.15.33:0/1042939103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f6860 0x7f69f40f6cc0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 --2- 172.21.15.33:0/1042939103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f55c0 0x7f69f40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 -- 172.21.15.33:0/1042939103 >> 172.21.15.33:0/1042939103 conn(0x7f69f40f0d40 msgr2=0x7f69f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:59.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 -- 172.21.15.33:0/1042939103 shutdown_connections 2022-02-02T15:05:59.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.015+0000 7f69f8b41700 1 -- 172.21.15.33:0/1042939103 wait complete. 2022-02-02T15:05:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 Processor -- start 2022-02-02T15:05:59.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 -- start start 2022-02-02T15:05:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f6860 0x7f69f410c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40603c0 con 0x7f69f40f55c0 2022-02-02T15:05:59.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f8b41700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4060500 con 0x7f69f40f6860 2022-02-02T15:05:59.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35950/0 (socket says 172.21.15.33:35950) 2022-02-02T15:05:59.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 -- 172.21.15.33:0/211702872 learned_addr learned my addr 172.21.15.33:0/211702872 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:59.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f1d9b700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f6860 0x7f69f410c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 -- 172.21.15.33:0/211702872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f6860 msgr2=0x7f69f410c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f6860 0x7f69f410c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.016+0000 7f69f259c700 1 -- 172.21.15.33:0/211702872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4005040 con 0x7f69f40f55c0 2022-02-02T15:05:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69f259c700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f69e800c790 tx=0x7f69e8007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:59.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e8013630 con 0x7f69f40f55c0 2022-02-02T15:05:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69e8012860 con 0x7f69f40f55c0 2022-02-02T15:05:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f410c720 con 0x7f69f40f55c0 2022-02-02T15:05:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f410ccb0 con 0x7f69f40f55c0 2022-02-02T15:05:59.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.017+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69e8002780 con 0x7f69f40f55c0 2022-02-02T15:05:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.018+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f40f49b0 con 0x7f69f40f55c0 2022-02-02T15:05:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.018+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f69e8010070 con 0x7f69f40f55c0 2022-02-02T15:05:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.019+0000 7f69e2ffd700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 0x7f69dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.019+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f69e8081a90 con 0x7f69f40f55c0 2022-02-02T15:05:59.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.019+0000 7f69f1d9b700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 0x7f69dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.019+0000 7f69f1d9b700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 0x7f69dc067290 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f69e4004630 tx=0x7f69e4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:59.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.023+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69e804fae0 con 0x7f69f40f55c0 2022-02-02T15:05:59.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:58 smithi037 ceph-mon[69017]: pgmap v2617: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:05:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.270+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69f40fde50 con 0x7f69f40f55c0 2022-02-02T15:05:59.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.270+0000 7f69e2ffd700 1 -- 172.21.15.33:0/211702872 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f69e8053100 con 0x7f69f40f55c0 2022-02-02T15:05:59.265 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:05:59.265 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:05:59.265 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:05:59.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:59.266 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:05:59.266 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:05:59.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:59.267 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:05:59.267 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:05:59.267 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:59.267 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:05:59.268 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:05:59.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:05:59.268 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:05:59.268 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:05:59.269 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:05:59.269 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:05:59.269 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:05:59.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 msgr2=0x7f69dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 0x7f69dc067290 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f69e4004630 tx=0x7f69e4009b30).stop 2022-02-02T15:05:59.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 msgr2=0x7f69f4109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f69e800c790 tx=0x7f69e8007d90).stop 2022-02-02T15:05:59.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 shutdown_connections 2022-02-02T15:05:59.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69dc064dd0 0x7f69dc067290 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69f40f55c0 0x7f69f4109c70 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 --2- 172.21.15.33:0/211702872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69f40f6860 0x7f69f410c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 >> 172.21.15.33:0/211702872 conn(0x7f69f40f0d40 msgr2=0x7f69f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:59.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 shutdown_connections 2022-02-02T15:05:59.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.273+0000 7f69f8b41700 1 -- 172.21.15.33:0/211702872 wait complete. 2022-02-02T15:05:59.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 -- 172.21.15.33:0/2234756224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f66d0 msgr2=0x7f5e480f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/2234756224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f66d0 0x7f5e480f6b30 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f5e38004660 tx=0x7f5e38009b30).stop 2022-02-02T15:05:59.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 -- 172.21.15.33:0/2234756224 shutdown_connections 2022-02-02T15:05:59.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/2234756224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f66d0 0x7f5e480f6b30 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/2234756224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f5430 0x7f5e480f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.373+0000 7f5e4edc9700 1 -- 172.21.15.33:0/2234756224 >> 172.21.15.33:0/2234756224 conn(0x7f5e480f0b90 msgr2=0x7f5e480f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:59.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.374+0000 7f5e4edc9700 1 -- 172.21.15.33:0/2234756224 shutdown_connections 2022-02-02T15:05:59.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.374+0000 7f5e4edc9700 1 -- 172.21.15.33:0/2234756224 wait complete. 2022-02-02T15:05:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.374+0000 7f5e4edc9700 1 Processor -- start 2022-02-02T15:05:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.374+0000 7f5e4edc9700 1 -- start start 2022-02-02T15:05:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4edc9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4edc9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f66d0 0x7f5e4810bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4edc9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e480603e0 con 0x7f5e480f5430 2022-02-02T15:05:59.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4edc9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e48060520 con 0x7f5e480f66d0 2022-02-02T15:05:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35960/0 (socket says 172.21.15.33:35960) 2022-02-02T15:05:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 -- 172.21.15.33:0/802382775 learned_addr learned my addr 172.21.15.33:0/802382775 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:05:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4d5c6700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f66d0 0x7f5e4810bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 -- 172.21.15.33:0/802382775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f66d0 msgr2=0x7f5e4810bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f66d0 0x7f5e4810bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 -- 172.21.15.33:0/802382775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e38005040 con 0x7f5e480f5430 2022-02-02T15:05:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4ddc7700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f5e4400c790 tx=0x7f5e44007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:59.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e4400e680 con 0x7f5e480f5430 2022-02-02T15:05:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4810c4d0 con 0x7f5e480f5430 2022-02-02T15:05:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5e4400ec90 con 0x7f5e480f5430 2022-02-02T15:05:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.375+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e44012d00 con 0x7f5e480f5430 2022-02-02T15:05:59.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.376+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4810ca90 con 0x7f5e480f5430 2022-02-02T15:05:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.376+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e48045ad0 con 0x7f5e480f5430 2022-02-02T15:05:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.377+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5e44010070 con 0x7f5e480f5430 2022-02-02T15:05:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.377+0000 7f5e3e7fc700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 0x7f5e340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:05:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.377+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5e44081b80 con 0x7f5e480f5430 2022-02-02T15:05:59.378 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.378+0000 7f5e4d5c6700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 0x7f5e340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:05:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.378+0000 7f5e4d5c6700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 0x7f5e340672e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f5e38009da0 tx=0x7f5e38009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:05:59.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.382+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5e4404fc30 con 0x7f5e480f5430 2022-02-02T15:05:59.589 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.595+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e480fdcc0 con 0x7f5e480f5430 2022-02-02T15:05:59.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.596+0000 7f5e3e7fc700 1 -- 172.21.15.33:0/802382775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f5e44053250 con 0x7f5e480f5430 2022-02-02T15:05:59.590 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:05:59.590 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:05:59.591 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:05:59.591 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:05:59.591 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:59.591 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:05:59.592 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:05:59.592 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:05:59.592 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:05:59.592 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:05:59.592 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:05:59.593 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:05:59.593 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:05:59.593 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:05:59.594 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:05:59.594 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:05:59.594 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:05:59.594 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:05:59.595 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:05:59.595 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:05:59.595 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:05:59.595 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:05:59.596 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:05:59.596 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:05:59.596 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:05:59.596 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:05:59.597 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:05:59.597 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:05:59.597 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:05:59.597 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:05:59.597 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:05:59.598 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:59.598 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:59.598 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:05:59.598 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:05:59.599 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:59.599 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:59.599 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:59.599 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:05:59.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 msgr2=0x7f5e340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 0x7f5e340672e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7f5e38009da0 tx=0x7f5e38009b30).stop 2022-02-02T15:05:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 msgr2=0x7f5e48109a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:05:59.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f5e4400c790 tx=0x7f5e44007d90).stop 2022-02-02T15:05:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 shutdown_connections 2022-02-02T15:05:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5e34064e20 0x7f5e340672e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e480f5430 0x7f5e48109a20 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 --2- 172.21.15.33:0/802382775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e480f66d0 0x7f5e4810bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:05:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.598+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 >> 172.21.15.33:0/802382775 conn(0x7f5e480f0b90 msgr2=0x7f5e480fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:05:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.599+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 shutdown_connections 2022-02-02T15:05:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:05:59.599+0000 7f5e4edc9700 1 -- 172.21.15.33:0/802382775 wait complete. 2022-02-02T15:05:59.603 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:05:59.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:59 smithi033 ceph-mon[101165]: from='client.36754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:05:59.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/211702872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:05:59.985 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:05:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/802382775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:06:00.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:59 smithi037 ceph-mon[69017]: from='client.36754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:00.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/211702872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:06:00.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:05:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/802382775' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:06:01.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:00 smithi037 ceph-mon[69017]: from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:01.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:00 smithi037 ceph-mon[69017]: pgmap v2618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:01.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:00 smithi033 ceph-mon[101165]: from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:01.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:00 smithi033 ceph-mon[101165]: pgmap v2618: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:03.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:02 smithi037 ceph-mon[69017]: pgmap v2619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:03.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:02 smithi033 ceph-mon[101165]: pgmap v2619: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:05.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:04 smithi037 ceph-mon[69017]: pgmap v2620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:05.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:04 smithi033 ceph-mon[101165]: pgmap v2620: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:07.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:06 smithi037 ceph-mon[69017]: pgmap v2621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:07.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:06 smithi033 ceph-mon[101165]: pgmap v2621: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:09.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:08 smithi037 ceph-mon[69017]: pgmap v2622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:09.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:08 smithi033 ceph-mon[101165]: pgmap v2622: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:11.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:10 smithi037 ceph-mon[69017]: pgmap v2623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:11.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:10 smithi033 ceph-mon[101165]: pgmap v2623: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:13.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:12 smithi037 ceph-mon[69017]: pgmap v2624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:13.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:12 smithi033 ceph-mon[101165]: pgmap v2624: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:15.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:14 smithi037 ceph-mon[69017]: pgmap v2625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:15.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:14 smithi033 ceph-mon[101165]: pgmap v2625: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:17.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:16 smithi037 ceph-mon[69017]: pgmap v2626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:17.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:16 smithi033 ceph-mon[101165]: pgmap v2626: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:19.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:18 smithi037 ceph-mon[69017]: pgmap v2627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:19.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:18 smithi033 ceph-mon[101165]: pgmap v2627: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:21.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:20 smithi037 ceph-mon[69017]: pgmap v2628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:21.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:20 smithi033 ceph-mon[101165]: pgmap v2628: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:23.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:22 smithi037 ceph-mon[69017]: pgmap v2629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:23.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:22 smithi033 ceph-mon[101165]: pgmap v2629: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:24.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:23 smithi033 ceph-mon[101165]: pgmap v2630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:24.285 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:23 smithi037 ceph-mon[69017]: pgmap v2630: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:26.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:26 smithi033 ceph-mon[101165]: pgmap v2631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:27.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:26 smithi037 ceph-mon[69017]: pgmap v2631: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:29.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:28 smithi037 ceph-mon[69017]: pgmap v2632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:29.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:28 smithi033 ceph-mon[101165]: pgmap v2632: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 -- 172.21.15.33:0/3825203542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300602b0 msgr2=0x7f79300f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 --2- 172.21.15.33:0/3825203542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300602b0 0x7f79300f9300 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f792c004660 tx=0x7f792c009b30).stop 2022-02-02T15:06:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 -- 172.21.15.33:0/3825203542 shutdown_connections 2022-02-02T15:06:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 --2- 172.21.15.33:0/3825203542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300f9880 0x7f79300fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 --2- 172.21.15.33:0/3825203542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300602b0 0x7f79300f9300 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.713+0000 7f7937dba700 1 -- 172.21.15.33:0/3825203542 >> 172.21.15.33:0/3825203542 conn(0x7f79300f0d40 msgr2=0x7f79300f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 -- 172.21.15.33:0/3825203542 shutdown_connections 2022-02-02T15:06:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 -- 172.21.15.33:0/3825203542 wait complete. 2022-02-02T15:06:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 Processor -- start 2022-02-02T15:06:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 -- start start 2022-02-02T15:06:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300602b0 0x7f7930109120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930109bc0 con 0x7f79300f9880 2022-02-02T15:06:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.714+0000 7f7937dba700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7930109d00 con 0x7f79300602b0 2022-02-02T15:06:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:29.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35972/0 (socket says 172.21.15.33:35972) 2022-02-02T15:06:29.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 -- 172.21.15.33:0/2798776083 learned_addr learned my addr 172.21.15.33:0/2798776083 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:06:29.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935b56700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300602b0 0x7f7930109120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:29.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 -- 172.21.15.33:0/2798776083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300602b0 msgr2=0x7f7930109120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300602b0 0x7f7930109120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 -- 172.21.15.33:0/2798776083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f792c005040 con 0x7f79300f9880 2022-02-02T15:06:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7935355700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7924002700 tx=0x7f7924009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79240079c0 con 0x7f79300f9880 2022-02-02T15:06:29.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f792400f040 con 0x7f79300f9880 2022-02-02T15:06:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793010a6a0 con 0x7f79300f9880 2022-02-02T15:06:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7924014740 con 0x7f79300f9880 2022-02-02T15:06:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.715+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f793010ac60 con 0x7f79300f9880 2022-02-02T15:06:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.716+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7930045ad0 con 0x7f79300f9880 2022-02-02T15:06:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.717+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f792401b060 con 0x7f79300f9880 2022-02-02T15:06:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.717+0000 7f79227fc700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 0x7f791c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.718+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7924081970 con 0x7f79300f9880 2022-02-02T15:06:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.718+0000 7f7935b56700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 0x7f791c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.718+0000 7f7935b56700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 0x7f791c067290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f792c004630 tx=0x7f792c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.723+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f79240533f0 con 0x7f79300f9880 2022-02-02T15:06:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.911+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f79300f5840 con 0x7f791c064dd0 2022-02-02T15:06:29.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.912+0000 7f79227fc700 1 -- 172.21.15.33:0/2798776083 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f79300f5840 con 0x7f791c064dd0 2022-02-02T15:06:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 msgr2=0x7f791c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 0x7f791c067290 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f792c004630 tx=0x7f792c009b30).stop 2022-02-02T15:06:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 msgr2=0x7f7930109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7f7924002700 tx=0x7f7924009d60).stop 2022-02-02T15:06:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 shutdown_connections 2022-02-02T15:06:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f791c064dd0 0x7f791c067290 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79300602b0 0x7f7930109120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 --2- 172.21.15.33:0/2798776083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79300f9880 0x7f7930109610 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 >> 172.21.15.33:0/2798776083 conn(0x7f79300f0d40 msgr2=0x7f79300f5130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 shutdown_connections 2022-02-02T15:06:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:29.915+0000 7f7937dba700 1 -- 172.21.15.33:0/2798776083 wait complete. 2022-02-02T15:06:29.918 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:06:30.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.016+0000 7f24e5b94700 1 -- 172.21.15.33:0/2652236968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e0060290 msgr2=0x7f24e00f91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 --2- 172.21.15.33:0/2652236968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e0060290 0x7f24e00f91a0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f24d4004660 tx=0x7f24d4009b30).stop 2022-02-02T15:06:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 -- 172.21.15.33:0/2652236968 shutdown_connections 2022-02-02T15:06:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 --2- 172.21.15.33:0/2652236968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e00f9720 0x7f24e00fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 --2- 172.21.15.33:0/2652236968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e0060290 0x7f24e00f91a0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 -- 172.21.15.33:0/2652236968 >> 172.21.15.33:0/2652236968 conn(0x7f24e00f0ba0 msgr2=0x7f24e00f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 -- 172.21.15.33:0/2652236968 shutdown_connections 2022-02-02T15:06:30.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 -- 172.21.15.33:0/2652236968 wait complete. 2022-02-02T15:06:30.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 Processor -- start 2022-02-02T15:06:30.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.017+0000 7f24e5b94700 1 -- start start 2022-02-02T15:06:30.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e5b94700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e0060290 0x7f24e0106d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e5b94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e5b94700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0107850 con 0x7f24e00f9720 2022-02-02T15:06:30.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e5b94700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e0108060 con 0x7f24e0060290 2022-02-02T15:06:30.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35982/0 (socket says 172.21.15.33:35982) 2022-02-02T15:06:30.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 -- 172.21.15.33:0/726393628 learned_addr learned my addr 172.21.15.33:0/726393628 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:06:30.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e4b92700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e0060290 0x7f24e0106d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 -- 172.21.15.33:0/726393628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e0060290 msgr2=0x7f24e0106d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e0060290 0x7f24e0106d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 -- 172.21.15.33:0/726393628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4005040 con 0x7f24e00f9720 2022-02-02T15:06:30.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dffff700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f24cc00e7c0 tx=0x7f24cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24cc0092e0 con 0x7f24e00f9720 2022-02-02T15:06:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.018+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e0108280 con 0x7f24e00f9720 2022-02-02T15:06:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.019+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f24cc00f040 con 0x7f24e00f9720 2022-02-02T15:06:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.019+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24cc0147a0 con 0x7f24e00f9720 2022-02-02T15:06:30.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.019+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e0108840 con 0x7f24e00f9720 2022-02-02T15:06:30.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.020+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e0059100 con 0x7f24e00f9720 2022-02-02T15:06:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.020+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f24cc014a60 con 0x7f24e00f9720 2022-02-02T15:06:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.020+0000 7f24dd7fa700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 0x7f24d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.020+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f24cc081e70 con 0x7f24e00f9720 2022-02-02T15:06:30.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.020+0000 7f24e4b92700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 0x7f24d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.021+0000 7f24e4b92700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 0x7f24d00672e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f24d4005010 tx=0x7f24d400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.026+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f24cc04ff20 con 0x7f24e00f9720 2022-02-02T15:06:30.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.209+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24e00fee90 con 0x7f24d0064e20 2022-02-02T15:06:30.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.223+0000 7f24dd7fa700 1 -- 172.21.15.33:0/726393628 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f24e00fee90 con 0x7f24d0064e20 2022-02-02T15:06:30.219 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:06:30.219 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (91m) 53m ago 92m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:06:30.220 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (84m) 53m ago 92m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:06:30.220 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (84m) 53m ago 92m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:06:30.220 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (91m) 53m ago 92m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:06:30.221 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (85m) 53m ago 88m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:06:30.221 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (85m) 53m ago 88m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:06:30.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (86m) 53m ago 89m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:06:30.222 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (88m) 53m ago 88m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:06:30.222 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (86m) 53m ago 94m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:06:30.223 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (85m) 53m ago 92m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:06:30.223 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (85m) 53m ago 94m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:06:30.224 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (85m) 53m ago 92m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:06:30.224 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (92m) 53m ago 92m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:06:30.224 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (92m) 53m ago 92m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:06:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 53m ago 91m - 4096M 2022-02-02T15:06:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (91m) 53m ago 91m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:06:30.225 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (90m) 53m ago 90m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:06:30.226 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (90m) 53m ago 90m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:06:30.226 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (90m) 53m ago 90m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:06:30.227 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (90m) 53m ago 90m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:06:30.227 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (91m) 53m ago 92m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:06:30.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.225+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 msgr2=0x7f24d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.225+0000 7f24e5b94700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 0x7f24d00672e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f24d4005010 tx=0x7f24d400b040).stop 2022-02-02T15:06:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.225+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 msgr2=0x7f24e0107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.225+0000 7f24e5b94700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f24cc00e7c0 tx=0x7f24cc00b040).stop 2022-02-02T15:06:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 shutdown_connections 2022-02-02T15:06:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f24d0064e20 0x7f24d00672e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24e0060290 0x7f24e0106d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 --2- 172.21.15.33:0/726393628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24e00f9720 0x7f24e0107250 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 >> 172.21.15.33:0/726393628 conn(0x7f24e00f0ba0 msgr2=0x7f24e00f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 shutdown_connections 2022-02-02T15:06:30.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.226+0000 7f24e5b94700 1 -- 172.21.15.33:0/726393628 wait complete. 2022-02-02T15:06:30.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 -- 172.21.15.33:0/645936567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 msgr2=0x7f526c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 --2- 172.21.15.33:0/645936567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c0f6b30 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f5254004660 tx=0x7f5254009b30).stop 2022-02-02T15:06:30.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 -- 172.21.15.33:0/645936567 shutdown_connections 2022-02-02T15:06:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 --2- 172.21.15.33:0/645936567 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c0f6b30 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 --2- 172.21.15.33:0/645936567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 0x7f526c0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 -- 172.21.15.33:0/645936567 >> 172.21.15.33:0/645936567 conn(0x7f526c0f0b90 msgr2=0x7f526c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 -- 172.21.15.33:0/645936567 shutdown_connections 2022-02-02T15:06:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.326+0000 7f5271488700 1 -- 172.21.15.33:0/645936567 wait complete. 2022-02-02T15:06:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 Processor -- start 2022-02-02T15:06:30.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 -- start start 2022-02-02T15:06:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 0x7f526c109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c0603c0 con 0x7f526c0f66d0 2022-02-02T15:06:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5271488700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526c060500 con 0x7f526c0f5430 2022-02-02T15:06:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5263fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5263fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35992/0 (socket says 172.21.15.33:35992) 2022-02-02T15:06:30.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f5263fff700 1 -- 172.21.15.33:0/150288090 learned_addr learned my addr 172.21.15.33:0/150288090 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:06:30.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.327+0000 7f526bfff700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 0x7f526c109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.328+0000 7f5263fff700 1 -- 172.21.15.33:0/150288090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 msgr2=0x7f526c109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.328+0000 7f5263fff700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 0x7f526c109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.328+0000 7f5263fff700 1 -- 172.21.15.33:0/150288090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5254005040 con 0x7f526c0f66d0 2022-02-02T15:06:30.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.328+0000 7f5263fff700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f5254009990 tx=0x7f5254009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5254018070 con 0x7f526c0f66d0 2022-02-02T15:06:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5254007ba0 con 0x7f526c0f66d0 2022-02-02T15:06:30.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f525401c3c0 con 0x7f526c0f66d0 2022-02-02T15:06:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c10c490 con 0x7f526c0f66d0 2022-02-02T15:06:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f526c10c9c0 con 0x7f526c0f66d0 2022-02-02T15:06:30.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f526c059100 con 0x7f526c0f66d0 2022-02-02T15:06:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.332+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f525401d420 con 0x7f526c0f66d0 2022-02-02T15:06:30.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.333+0000 7f52697fa700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 0x7f52580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.333+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5254083630 con 0x7f526c0f66d0 2022-02-02T15:06:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.333+0000 7f526bfff700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 0x7f52580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.333+0000 7f526bfff700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 0x7f52580672e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f526c060040 tx=0x7f525c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.338+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f52540516e0 con 0x7f526c0f66d0 2022-02-02T15:06:30.583 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.589+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f526c045ad0 con 0x7f526c0f66d0 2022-02-02T15:06:30.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.590+0000 7f52697fa700 1 -- 172.21.15.33:0/150288090 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5254054d00 con 0x7f526c0f66d0 2022-02-02T15:06:30.585 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:06:30.585 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:06:30.585 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:06:30.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:06:30.586 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:06:30.587 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:06:30.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:06:30.588 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:06:30.588 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:06:30.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:06:30.589 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:06:30.589 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:06:30.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:06:30.590 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:06:30.591 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:06:30.591 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:06:30.592 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:06:30.592 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:06:30.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 msgr2=0x7f52580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 0x7f52580672e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f526c060040 tx=0x7f525c00b040).stop 2022-02-02T15:06:30.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 msgr2=0x7f526c10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f5254009990 tx=0x7f5254009b30).stop 2022-02-02T15:06:30.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 shutdown_connections 2022-02-02T15:06:30.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5258064e20 0x7f52580672e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f526c0f5430 0x7f526c109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 --2- 172.21.15.33:0/150288090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f526c0f66d0 0x7f526c10bf40 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.591+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 >> 172.21.15.33:0/150288090 conn(0x7f526c0f0b90 msgr2=0x7f526c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.592+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 shutdown_connections 2022-02-02T15:06:30.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.592+0000 7f5271488700 1 -- 172.21.15.33:0/150288090 wait complete. 2022-02-02T15:06:30.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3659011871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 msgr2=0x7f1c600f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3659011871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f59e0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f1c54004660 tx=0x7f1c54009b30).stop 2022-02-02T15:06:30.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3659011871 shutdown_connections 2022-02-02T15:06:30.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3659011871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 0x7f1c600f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3659011871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f59e0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3659011871 >> 172.21.15.33:0/3659011871 conn(0x7f1c600f0d40 msgr2=0x7f1c600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3659011871 shutdown_connections 2022-02-02T15:06:30.694 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3659011871 wait complete. 2022-02-02T15:06:30.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 Processor -- start 2022-02-02T15:06:30.695 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.693+0000 7f1c66ed3700 1 -- start start 2022-02-02T15:06:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c66ed3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c66ed3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 0x7f1c600f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c66ed3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600f8100 con 0x7f1c600f55c0 2022-02-02T15:06:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c66ed3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600f8240 con 0x7f1c600f6860 2022-02-02T15:06:30.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36000/0 (socket says 172.21.15.33:36000) 2022-02-02T15:06:30.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 -- 172.21.15.33:0/3377349234 learned_addr learned my addr 172.21.15.33:0/3377349234 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:06:30.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 0x7f1c600f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 -- 172.21.15.33:0/3377349234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 msgr2=0x7f1c600f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 0x7f1c600f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 -- 172.21.15.33:0/3377349234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54005040 con 0x7f1c600f55c0 2022-02-02T15:06:30.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c64c6f700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f1c54009830 tx=0x7f1c54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.694+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c54018070 con 0x7f1c600f55c0 2022-02-02T15:06:30.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.695+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1c54007ba0 con 0x7f1c600f55c0 2022-02-02T15:06:30.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.695+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600f84c0 con 0x7f1c600f55c0 2022-02-02T15:06:30.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.695+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600f8a20 con 0x7f1c600f55c0 2022-02-02T15:06:30.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.695+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5401de60 con 0x7f1c600f55c0 2022-02-02T15:06:30.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.696+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c40004fa0 con 0x7f1c600f55c0 2022-02-02T15:06:30.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.696+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1c54007d10 con 0x7f1c600f55c0 2022-02-02T15:06:30.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.697+0000 7f1c5d7fa700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 0x7f1c50067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:06:30.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.697+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1c540835b0 con 0x7f1c600f55c0 2022-02-02T15:06:30.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.697+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 0x7f1c50067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:06:30.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.697+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 0x7f1c50067270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1c4c004e20 tx=0x7f1c4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:06:30.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.701+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1c540516c0 con 0x7f1c600f55c0 2022-02-02T15:06:30.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.913+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1c40005e80 con 0x7f1c600f55c0 2022-02-02T15:06:30.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:30 smithi033 ceph-mon[101165]: pgmap v2633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:30.908 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/150288090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:06:30.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.914+0000 7f1c5d7fa700 1 -- 172.21.15.33:0/3377349234 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1c54054ce0 con 0x7f1c600f55c0 2022-02-02T15:06:30.909 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:06:30.909 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:06:30.909 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:06:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:06:30.910 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:06:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:06:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:06:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:06:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:06:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:06:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:06:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:06:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:06:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:06:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:06:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:06:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:06:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:06:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:06:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:06:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:06:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:06:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:06:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:06:30.915 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:06:30.915 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:06:30.915 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:06:30.915 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:06:30.916 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:06:30.916 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:06:30.916 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:06:30.916 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:06:30.917 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:06:30.917 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:06:30.917 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:06:30.917 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:06:30.917 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:06:30.918 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:06:30.918 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:06:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 msgr2=0x7f1c50067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 0x7f1c50067270 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f1c4c004e20 tx=0x7f1c4c00b040).stop 2022-02-02T15:06:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 msgr2=0x7f1c600f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:06:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f1c54009830 tx=0x7f1c54009b30).stop 2022-02-02T15:06:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 shutdown_connections 2022-02-02T15:06:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1c50064db0 0x7f1c50067270 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c600f55c0 0x7f1c600f9720 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 --2- 172.21.15.33:0/3377349234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c600f6860 0x7f1c600f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:06:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 >> 172.21.15.33:0/3377349234 conn(0x7f1c600f0d40 msgr2=0x7f1c6005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:06:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 shutdown_connections 2022-02-02T15:06:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:06:30.916+0000 7f1c66ed3700 1 -- 172.21.15.33:0/3377349234 wait complete. 2022-02-02T15:06:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:06:31.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:30 smithi037 ceph-mon[69017]: pgmap v2633: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:31.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/150288090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:06:32.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:31 smithi037 ceph-mon[69017]: from='client.36770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:32.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:31 smithi037 ceph-mon[69017]: from='client.36774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:32.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3377349234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:06:32.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:31 smithi033 ceph-mon[101165]: from='client.36770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:32.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:31 smithi033 ceph-mon[101165]: from='client.36774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:06:32.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3377349234' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:06:33.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:32 smithi037 ceph-mon[69017]: pgmap v2634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:33.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:32 smithi033 ceph-mon[101165]: pgmap v2634: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:35.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:34 smithi037 ceph-mon[69017]: pgmap v2635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:35.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:34 smithi033 ceph-mon[101165]: pgmap v2635: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:36 smithi037 ceph-mon[69017]: pgmap v2636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:37.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:36 smithi033 ceph-mon[101165]: pgmap v2636: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:38.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:37 smithi037 ceph-mon[69017]: pgmap v2637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:38.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:37 smithi033 ceph-mon[101165]: pgmap v2637: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:40.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:40 smithi033 ceph-mon[101165]: pgmap v2638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:41.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:40 smithi037 ceph-mon[69017]: pgmap v2638: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:43.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:42 smithi037 ceph-mon[69017]: pgmap v2639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:43.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:42 smithi033 ceph-mon[101165]: pgmap v2639: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:45.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:44 smithi037 ceph-mon[69017]: pgmap v2640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:45.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:44 smithi033 ceph-mon[101165]: pgmap v2640: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:47.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:46 smithi037 ceph-mon[69017]: pgmap v2641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:47.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:46 smithi033 ceph-mon[101165]: pgmap v2641: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:49.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:48 smithi037 ceph-mon[69017]: pgmap v2642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:49.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:48 smithi033 ceph-mon[101165]: pgmap v2642: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:51.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:50 smithi037 ceph-mon[69017]: pgmap v2643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:51.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:50 smithi033 ceph-mon[101165]: pgmap v2643: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:53.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:52 smithi037 ceph-mon[69017]: pgmap v2644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:53.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:52 smithi033 ceph-mon[101165]: pgmap v2644: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:54 smithi037 ceph-mon[69017]: pgmap v2645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:06:55.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:06:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:54 smithi033 ceph-mon[101165]: pgmap v2645: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:06:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:06:56.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:55 smithi033 ceph-mon[101165]: pgmap v2646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:56.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:55 smithi037 ceph-mon[69017]: pgmap v2646: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:59.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:06:58 smithi037 ceph-mon[69017]: pgmap v2647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:06:59.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:06:58 smithi033 ceph-mon[101165]: pgmap v2647: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:01.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 -- 172.21.15.33:0/4107472169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 msgr2=0x7f2a440f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 --2- 172.21.15.33:0/4107472169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a440f7c20 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f2a30004660 tx=0x7f2a30009b30).stop 2022-02-02T15:07:01.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 -- 172.21.15.33:0/4107472169 shutdown_connections 2022-02-02T15:07:01.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 --2- 172.21.15.33:0/4107472169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a440f7c20 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 --2- 172.21.15.33:0/4107472169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 0x7f2a440f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 -- 172.21.15.33:0/4107472169 >> 172.21.15.33:0/4107472169 conn(0x7f2a440f1ca0 msgr2=0x7f2a440f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.027 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:00 smithi033 ceph-mon[101165]: pgmap v2648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:01.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 -- 172.21.15.33:0/4107472169 shutdown_connections 2022-02-02T15:07:01.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.032+0000 7f2a499f9700 1 -- 172.21.15.33:0/4107472169 wait complete. 2022-02-02T15:07:01.030 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 Processor -- start 2022-02-02T15:07:01.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 -- start start 2022-02-02T15:07:01.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 0x7f2a44106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441078b0 con 0x7f2a440f77c0 2022-02-02T15:07:01.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.033+0000 7f2a499f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441080f0 con 0x7f2a440f6520 2022-02-02T15:07:01.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36012/0 (socket says 172.21.15.33:36012) 2022-02-02T15:07:01.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 -- 172.21.15.33:0/3526072980 learned_addr learned my addr 172.21.15.33:0/3526072980 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:01.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a489f7700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 0x7f2a44106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 -- 172.21.15.33:0/3526072980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 msgr2=0x7f2a44106dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 0x7f2a44106dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 -- 172.21.15.33:0/3526072980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a30005040 con 0x7f2a440f77c0 2022-02-02T15:07:01.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a43fff700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f2a30009990 tx=0x7f2a30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a30018070 con 0x7f2a440f77c0 2022-02-02T15:07:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44108370 con 0x7f2a440f77c0 2022-02-02T15:07:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2a30007ba0 con 0x7f2a440f77c0 2022-02-02T15:07:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a3001c3c0 con 0x7f2a440f77c0 2022-02-02T15:07:01.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.034+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a44108850 con 0x7f2a440f77c0 2022-02-02T15:07:01.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.035+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a44059100 con 0x7f2a440f77c0 2022-02-02T15:07:01.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.036+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2a3001d420 con 0x7f2a440f77c0 2022-02-02T15:07:01.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.036+0000 7f2a417fa700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 0x7f2a340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.036+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2a300837c0 con 0x7f2a440f77c0 2022-02-02T15:07:01.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.037+0000 7f2a489f7700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 0x7f2a340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.037+0000 7f2a489f7700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 0x7f2a340672e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f2a44107b80 tx=0x7f2a3800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.037 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:00 smithi037 ceph-mon[69017]: pgmap v2648: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:01.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.041+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2a30051810 con 0x7f2a440f77c0 2022-02-02T15:07:01.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.229+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a440fed50 con 0x7f2a34064e20 2022-02-02T15:07:01.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.230+0000 7f2a417fa700 1 -- 172.21.15.33:0/3526072980 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2a440fed50 con 0x7f2a34064e20 2022-02-02T15:07:01.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 msgr2=0x7f2a340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 0x7f2a340672e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f2a44107b80 tx=0x7f2a3800b040).stop 2022-02-02T15:07:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 msgr2=0x7f2a441072b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7f2a30009990 tx=0x7f2a30009b30).stop 2022-02-02T15:07:01.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 shutdown_connections 2022-02-02T15:07:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2a34064e20 0x7f2a340672e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a440f6520 0x7f2a44106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 --2- 172.21.15.33:0/3526072980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a440f77c0 0x7f2a441072b0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 >> 172.21.15.33:0/3526072980 conn(0x7f2a440f1ca0 msgr2=0x7f2a440fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 shutdown_connections 2022-02-02T15:07:01.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.232+0000 7f2a499f9700 1 -- 172.21.15.33:0/3526072980 wait complete. 2022-02-02T15:07:01.235 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:07:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/912315697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 msgr2=0x7f6b780f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/912315697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b780f7de0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7f6b60004660 tx=0x7f6b60009b30).stop 2022-02-02T15:07:01.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/912315697 shutdown_connections 2022-02-02T15:07:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/912315697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b780f7de0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/912315697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b780f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/912315697 >> 172.21.15.33:0/912315697 conn(0x7f6b780f1e40 msgr2=0x7f6b780f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/912315697 shutdown_connections 2022-02-02T15:07:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.333+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/912315697 wait complete. 2022-02-02T15:07:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 Processor -- start 2022-02-02T15:07:01.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 -- start start 2022-02-02T15:07:01.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b7806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7806a380 con 0x7f6b780f7980 2022-02-02T15:07:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.334+0000 7f6b7e1cf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7806a4c0 con 0x7f6b780f66e0 2022-02-02T15:07:01.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b7806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36022/0 (socket says 172.21.15.33:36022) 2022-02-02T15:07:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b76ffd700 1 -- 172.21.15.33:0/3832768248 learned_addr learned my addr 172.21.15.33:0/3832768248 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:01.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b777fe700 1 -- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 msgr2=0x7f6b78069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b777fe700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b777fe700 1 -- 172.21.15.33:0/3832768248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60005040 con 0x7f6b780f66e0 2022-02-02T15:07:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b76ffd700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:07:01.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b777fe700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b7806b9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6b780f77e0 tx=0x7f6b6800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b680092e0 con 0x7f6b780f66e0 2022-02-02T15:07:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7806a7a0 con 0x7f6b780f66e0 2022-02-02T15:07:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6b6800f040 con 0x7f6b780f66e0 2022-02-02T15:07:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b680147a0 con 0x7f6b780f66e0 2022-02-02T15:07:01.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.335+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7810ef40 con 0x7f6b780f66e0 2022-02-02T15:07:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.337+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6b6801b030 con 0x7f6b780f66e0 2022-02-02T15:07:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.337+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b78045ad0 con 0x7f6b780f66e0 2022-02-02T15:07:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.337+0000 7f6b6ffff700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 0x7f6b64067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.337+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6b68081900 con 0x7f6b780f66e0 2022-02-02T15:07:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.337+0000 7f6b76ffd700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 0x7f6b64067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.338+0000 7f6b76ffd700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 0x7f6b64067290 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f6b60005010 tx=0x7f6b60016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.342+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6b6804f9b0 con 0x7f6b780f66e0 2022-02-02T15:07:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.523+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b780ff050 con 0x7f6b64064dd0 2022-02-02T15:07:01.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.537+0000 7f6b6ffff700 1 -- 172.21.15.33:0/3832768248 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f6b6000f070 con 0x7f6b64064dd0 2022-02-02T15:07:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:07:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (92m) 54m ago 93m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:07:01.531 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (85m) 54m ago 93m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:07:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (85m) 54m ago 92m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:07:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (92m) 54m ago 93m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:07:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (85m) 54m ago 89m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:07:01.532 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (86m) 54m ago 89m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:07:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (87m) 54m ago 89m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:07:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (89m) 54m ago 89m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:07:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (86m) 54m ago 94m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:07:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (86m) 54m ago 92m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:07:01.533 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (86m) 54m ago 94m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:07:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (85m) 54m ago 92m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:07:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (93m) 54m ago 93m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:07:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (92m) 54m ago 92m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:07:01.534 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 54m ago 92m - 4096M 2022-02-02T15:07:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (91m) 54m ago 91m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:07:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (91m) 54m ago 91m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:07:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (91m) 54m ago 91m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:07:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (90m) 54m ago 90m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:07:01.535 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (90m) 54m ago 90m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:07:01.536 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (92m) 54m ago 92m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:07:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 msgr2=0x7f6b64067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 0x7f6b64067290 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f6b60005010 tx=0x7f6b60016040).stop 2022-02-02T15:07:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 msgr2=0x7f6b7806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b7806b9a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f6b780f77e0 tx=0x7f6b6800b040).stop 2022-02-02T15:07:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 shutdown_connections 2022-02-02T15:07:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6b64064dd0 0x7f6b64067290 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6b780f66e0 0x7f6b7806b9a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 --2- 172.21.15.33:0/3832768248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b780f7980 0x7f6b78069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 >> 172.21.15.33:0/3832768248 conn(0x7f6b780f1e40 msgr2=0x7f6b780fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 shutdown_connections 2022-02-02T15:07:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.539+0000 7f6b7e1cf700 1 -- 172.21.15.33:0/3832768248 wait complete. 2022-02-02T15:07:01.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 -- 172.21.15.33:0/1987615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 msgr2=0x7f775c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 --2- 172.21.15.33:0/1987615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c0f59e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f7750004660 tx=0x7f7750009b30).stop 2022-02-02T15:07:01.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 -- 172.21.15.33:0/1987615317 shutdown_connections 2022-02-02T15:07:01.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 --2- 172.21.15.33:0/1987615317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 0x7f775c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 --2- 172.21.15.33:0/1987615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c0f59e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 -- 172.21.15.33:0/1987615317 >> 172.21.15.33:0/1987615317 conn(0x7f775c0f0d40 msgr2=0x7f775c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 -- 172.21.15.33:0/1987615317 shutdown_connections 2022-02-02T15:07:01.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.639+0000 7f7762cde700 1 -- 172.21.15.33:0/1987615317 wait complete. 2022-02-02T15:07:01.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 Processor -- start 2022-02-02T15:07:01.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 -- start start 2022-02-02T15:07:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 0x7f775c109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c109c00 con 0x7f775c0f55c0 2022-02-02T15:07:01.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7762cde700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c109d40 con 0x7f775c0f6860 2022-02-02T15:07:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7760a7a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7760a7a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36030/0 (socket says 172.21.15.33:36030) 2022-02-02T15:07:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f7760a7a700 1 -- 172.21.15.33:0/2531236659 learned_addr learned my addr 172.21.15.33:0/2531236659 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:01.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.640+0000 7f775bfff700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 0x7f775c109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7760a7a700 1 -- 172.21.15.33:0/2531236659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 msgr2=0x7f775c109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7760a7a700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 0x7f775c109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7760a7a700 1 -- 172.21.15.33:0/2531236659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750005040 con 0x7f775c0f55c0 2022-02-02T15:07:01.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7760a7a700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f7750000c00 tx=0x7f7750009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7750018070 con 0x7f775c0f55c0 2022-02-02T15:07:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7750007cf0 con 0x7f775c0f55c0 2022-02-02T15:07:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775001c3c0 con 0x7f775c0f55c0 2022-02-02T15:07:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c10a680 con 0x7f775c0f55c0 2022-02-02T15:07:01.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.641+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c10abe0 con 0x7f775c0f55c0 2022-02-02T15:07:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.642+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c045ad0 con 0x7f775c0f55c0 2022-02-02T15:07:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.643+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f775001d420 con 0x7f775c0f55c0 2022-02-02T15:07:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.643+0000 7f77597fa700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 0x7f774c067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.643+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7750083910 con 0x7f775c0f55c0 2022-02-02T15:07:01.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.643+0000 7f775bfff700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 0x7f774c067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.644+0000 7f775bfff700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 0x7f774c067270 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f77480041d0 tx=0x7f7748009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:01.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.648+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7750055330 con 0x7f775c0f55c0 2022-02-02T15:07:01.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.895+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f775c0fdf00 con 0x7f775c0f55c0 2022-02-02T15:07:01.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.896+0000 7f77597fa700 1 -- 172.21.15.33:0/2531236659 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7750054f20 con 0x7f775c0f55c0 2022-02-02T15:07:01.890 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:07:01.890 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:07:01.890 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:07:01.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:01.891 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:07:01.891 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:07:01.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:01.891 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:07:01.891 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:07:01.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:01.892 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:07:01.892 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:07:01.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:01.892 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:07:01.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:07:01.893 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:07:01.893 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:07:01.893 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:07:01.894 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.897+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 msgr2=0x7f774c067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.897+0000 7f7762cde700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 0x7f774c067270 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f77480041d0 tx=0x7f7748009040).stop 2022-02-02T15:07:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 msgr2=0x7f775c109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7f7750000c00 tx=0x7f7750009b30).stop 2022-02-02T15:07:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 shutdown_connections 2022-02-02T15:07:01.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f774c064db0 0x7f774c067270 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f775c0f55c0 0x7f775c109160 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 --2- 172.21.15.33:0/2531236659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f775c0f6860 0x7f775c109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 >> 172.21.15.33:0/2531236659 conn(0x7f775c0f0d40 msgr2=0x7f775c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 shutdown_connections 2022-02-02T15:07:01.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.898+0000 7f7762cde700 1 -- 172.21.15.33:0/2531236659 wait complete. 2022-02-02T15:07:01.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 -- 172.21.15.33:0/4051365927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 msgr2=0x7f77ec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:01.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 --2- 172.21.15.33:0/4051365927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec0f6b00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7f77dc004660 tx=0x7f77dc009b30).stop 2022-02-02T15:07:01.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 -- 172.21.15.33:0/4051365927 shutdown_connections 2022-02-02T15:07:01.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 --2- 172.21.15.33:0/4051365927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 --2- 172.21.15.33:0/4051365927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec0f6b00 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:01.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 -- 172.21.15.33:0/4051365927 >> 172.21.15.33:0/4051365927 conn(0x7f77ec0f1e40 msgr2=0x7f77ec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 -- 172.21.15.33:0/4051365927 shutdown_connections 2022-02-02T15:07:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:01.999+0000 7f77f21a5700 1 -- 172.21.15.33:0/4051365927 wait complete. 2022-02-02T15:07:01.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 Processor -- start 2022-02-02T15:07:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 -- start start 2022-02-02T15:07:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec107a50 con 0x7f77ec0f66e0 2022-02-02T15:07:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77f21a5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ec107b90 con 0x7f77ec0f7980 2022-02-02T15:07:01.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36040/0 (socket says 172.21.15.33:36040) 2022-02-02T15:07:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.000+0000 7f77eb7fe700 1 -- 172.21.15.33:0/2816590625 learned_addr learned my addr 172.21.15.33:0/2816590625 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:01.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eaffd700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eb7fe700 1 -- 172.21.15.33:0/2816590625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 msgr2=0x7f77ec1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eb7fe700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eb7fe700 1 -- 172.21.15.33:0/2816590625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc005040 con 0x7f77ec0f66e0 2022-02-02T15:07:02.002 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eaffd700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:07:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77eb7fe700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f77dc013a70 tx=0x7f77dc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc018070 con 0x7f77ec0f66e0 2022-02-02T15:07:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f77dc0097d0 con 0x7f77ec0f66e0 2022-02-02T15:07:02.003 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ec1084d0 con 0x7f77ec0f66e0 2022-02-02T15:07:02.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f77dc01c3c0 con 0x7f77ec0f66e0 2022-02-02T15:07:02.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.001+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ec108a30 con 0x7f77ec0f66e0 2022-02-02T15:07:02.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.002+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ec045ad0 con 0x7f77ec0f66e0 2022-02-02T15:07:02.004 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.003+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f77dc007ba0 con 0x7f77ec0f66e0 2022-02-02T15:07:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.003+0000 7f77d3fff700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 0x7f77d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.003+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f77dc083850 con 0x7f77ec0f66e0 2022-02-02T15:07:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.003+0000 7f77eaffd700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 0x7f77d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.004+0000 7f77eaffd700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 0x7f77d4067290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f77e0009740 tx=0x7f77e0009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:02.005 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.007+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f77dc055330 con 0x7f77ec0f66e0 2022-02-02T15:07:02.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.220+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f77ec0fef40 con 0x7f77ec0f66e0 2022-02-02T15:07:02.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.221+0000 7f77d3fff700 1 -- 172.21.15.33:0/2816590625 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f77dc054f20 con 0x7f77ec0f66e0 2022-02-02T15:07:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:07:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:07:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:07:02.215 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:07:02.216 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:07:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:07:02.216 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:07:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:07:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:07:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:07:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:07:02.217 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:07:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:07:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:07:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:07:02.218 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:07:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:07:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:07:02.219 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:07:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:07:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:07:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:07:02.220 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:07:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:07:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:07:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:07:02.221 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:07:02.222 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:07:02.222 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:07:02.222 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:07:02.222 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:02.222 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:02.223 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:07:02.223 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:02.223 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:02.223 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:02.224 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:02.224 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:02.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 msgr2=0x7f77d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:02.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 0x7f77d4067290 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f77e0009740 tx=0x7f77e0009be0).stop 2022-02-02T15:07:02.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 msgr2=0x7f77ec106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:02.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7f77dc013a70 tx=0x7f77dc009b30).stop 2022-02-02T15:07:02.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 shutdown_connections 2022-02-02T15:07:02.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f77d4064dd0 0x7f77d4067290 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:02.226 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f77ec0f66e0 0x7f77ec106fb0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:02.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 --2- 172.21.15.33:0/2816590625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77ec0f7980 0x7f77ec1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:02.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 >> 172.21.15.33:0/2816590625 conn(0x7f77ec0f1e40 msgr2=0x7f77ec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:02.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 shutdown_connections 2022-02-02T15:07:02.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:02.223+0000 7f77f21a5700 1 -- 172.21.15.33:0/2816590625 wait complete. 2022-02-02T15:07:02.228 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:07:03.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:02 smithi037 ceph-mon[69017]: from='client.36786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:03.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:02 smithi037 ceph-mon[69017]: from='client.46241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:03.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:02 smithi037 ceph-mon[69017]: pgmap v2649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:03.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2531236659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:07:03.035 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2816590625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:07:03.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:02 smithi033 ceph-mon[101165]: from='client.36786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:03.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:02 smithi033 ceph-mon[101165]: from='client.46241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:03.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:02 smithi033 ceph-mon[101165]: pgmap v2649: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:03.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2531236659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:07:03.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2816590625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:07:05.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:04 smithi037 ceph-mon[69017]: pgmap v2650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:05.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:04 smithi033 ceph-mon[101165]: pgmap v2650: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:07.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:06 smithi037 ceph-mon[69017]: pgmap v2651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:07.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:06 smithi033 ceph-mon[101165]: pgmap v2651: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:09.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:08 smithi037 ceph-mon[69017]: pgmap v2652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:09.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:08 smithi033 ceph-mon[101165]: pgmap v2652: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:10.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:09 smithi033 ceph-mon[101165]: pgmap v2653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:10.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:09 smithi037 ceph-mon[69017]: pgmap v2653: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:13.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:12 smithi037 ceph-mon[69017]: pgmap v2654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:13.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:12 smithi033 ceph-mon[101165]: pgmap v2654: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:15.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:14 smithi037 ceph-mon[69017]: pgmap v2655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:15.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:14 smithi033 ceph-mon[101165]: pgmap v2655: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:17.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:16 smithi037 ceph-mon[69017]: pgmap v2656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:17.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:16 smithi033 ceph-mon[101165]: pgmap v2656: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:19.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:18 smithi037 ceph-mon[69017]: pgmap v2657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:19.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:18 smithi033 ceph-mon[101165]: pgmap v2657: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:21.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:20 smithi037 ceph-mon[69017]: pgmap v2658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:21.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:20 smithi033 ceph-mon[101165]: pgmap v2658: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:23.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:22 smithi037 ceph-mon[69017]: pgmap v2659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:23.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:22 smithi033 ceph-mon[101165]: pgmap v2659: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:24.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:23 smithi033 ceph-mon[101165]: pgmap v2660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:24.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:23 smithi037 ceph-mon[69017]: pgmap v2660: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:26.983 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:26 smithi033 ceph-mon[101165]: pgmap v2661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:27.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:26 smithi037 ceph-mon[69017]: pgmap v2661: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:29.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:28 smithi037 ceph-mon[69017]: pgmap v2662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:29.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:28 smithi033 ceph-mon[101165]: pgmap v2662: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:31.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:30 smithi037 ceph-mon[69017]: pgmap v2663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:31.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:30 smithi033 ceph-mon[101165]: pgmap v2663: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:32.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 -- 172.21.15.33:0/3764751432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 msgr2=0x7f8e580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3764751432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e580f59e0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7f8e48004660 tx=0x7f8e48009b30).stop 2022-02-02T15:07:32.332 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 -- 172.21.15.33:0/3764751432 shutdown_connections 2022-02-02T15:07:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3764751432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 0x7f8e580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3764751432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e580f59e0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 -- 172.21.15.33:0/3764751432 >> 172.21.15.33:0/3764751432 conn(0x7f8e580f0d40 msgr2=0x7f8e580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 -- 172.21.15.33:0/3764751432 shutdown_connections 2022-02-02T15:07:32.333 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.338+0000 7f8e5e358700 1 -- 172.21.15.33:0/3764751432 wait complete. 2022-02-02T15:07:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 Processor -- start 2022-02-02T15:07:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 -- start start 2022-02-02T15:07:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 0x7f8e5810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e580603e0 con 0x7f8e580f55c0 2022-02-02T15:07:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e5e358700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58060520 con 0x7f8e580f6860 2022-02-02T15:07:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36050/0 (socket says 172.21.15.33:36050) 2022-02-02T15:07:32.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.339+0000 7f8e57fff700 1 -- 172.21.15.33:0/3063370169 learned_addr learned my addr 172.21.15.33:0/3063370169 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:32.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e577fe700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 0x7f8e5810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e57fff700 1 -- 172.21.15.33:0/3063370169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 msgr2=0x7f8e5810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e57fff700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 0x7f8e5810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e57fff700 1 -- 172.21.15.33:0/3063370169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48005040 con 0x7f8e580f55c0 2022-02-02T15:07:32.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e57fff700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f8e48013a70 tx=0x7f8e48009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e48018070 con 0x7f8e580f55c0 2022-02-02T15:07:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5810c6c0 con 0x7f8e580f55c0 2022-02-02T15:07:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8e480097d0 con 0x7f8e580f55c0 2022-02-02T15:07:32.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4801de80 con 0x7f8e580f55c0 2022-02-02T15:07:32.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.340+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5810cc20 con 0x7f8e580f55c0 2022-02-02T15:07:32.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.341+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e58045ad0 con 0x7f8e580f55c0 2022-02-02T15:07:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.342+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8e48007ba0 con 0x7f8e580f55c0 2022-02-02T15:07:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.342+0000 7f8e54ff9700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.342+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8e480836b0 con 0x7f8e580f55c0 2022-02-02T15:07:32.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.342+0000 7f8e577fe700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.343+0000 7f8e577fe700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 0x7f8e40067290 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f8e4c004c40 tx=0x7f8e4c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.346+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8e48051760 con 0x7f8e580f55c0 2022-02-02T15:07:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.537+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e580fdf30 con 0x7f8e40064dd0 2022-02-02T15:07:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.539+0000 7f8e54ff9700 1 -- 172.21.15.33:0/3063370169 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8e4c00f040 con 0x7f8e40064dd0 2022-02-02T15:07:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 msgr2=0x7f8e40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 0x7f8e40067290 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f8e4c004c40 tx=0x7f8e4c00b040).stop 2022-02-02T15:07:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 msgr2=0x7f8e58109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7f8e48013a70 tx=0x7f8e48009b30).stop 2022-02-02T15:07:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 shutdown_connections 2022-02-02T15:07:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8e40064dd0 0x7f8e40067290 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e580f55c0 0x7f8e58109c70 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 --2- 172.21.15.33:0/3063370169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e580f6860 0x7f8e5810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.540+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 >> 172.21.15.33:0/3063370169 conn(0x7f8e580f0d40 msgr2=0x7f8e580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:32.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.541+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 shutdown_connections 2022-02-02T15:07:32.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.541+0000 7f8e5e358700 1 -- 172.21.15.33:0/3063370169 wait complete. 2022-02-02T15:07:32.544 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:07:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 -- 172.21.15.33:0/1396817029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f4800 msgr2=0x7fea440f4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 --2- 172.21.15.33:0/1396817029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f4800 0x7fea440f4c20 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fea38004660 tx=0x7fea38009b30).stop 2022-02-02T15:07:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 -- 172.21.15.33:0/1396817029 shutdown_connections 2022-02-02T15:07:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 --2- 172.21.15.33:0/1396817029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f51a0 0x7fea440f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 --2- 172.21.15.33:0/1396817029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f4800 0x7fea440f4c20 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.641+0000 7fea49857700 1 -- 172.21.15.33:0/1396817029 >> 172.21.15.33:0/1396817029 conn(0x7fea440f0320 msgr2=0x7fea440f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:32.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.642+0000 7fea49857700 1 -- 172.21.15.33:0/1396817029 shutdown_connections 2022-02-02T15:07:32.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.642+0000 7fea49857700 1 -- 172.21.15.33:0/1396817029 wait complete. 2022-02-02T15:07:32.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.642+0000 7fea49857700 1 Processor -- start 2022-02-02T15:07:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.642+0000 7fea49857700 1 -- start start 2022-02-02T15:07:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea49857700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f4800 0x7fea440f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea49857700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea49857700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440f5d90 con 0x7fea440f51a0 2022-02-02T15:07:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea49857700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea440f5ed0 con 0x7fea440f4800 2022-02-02T15:07:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36062/0 (socket says 172.21.15.33:36062) 2022-02-02T15:07:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 -- 172.21.15.33:0/4103785937 learned_addr learned my addr 172.21.15.33:0/4103785937 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:32.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea48855700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f4800 0x7fea440f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 -- 172.21.15.33:0/4103785937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f4800 msgr2=0x7fea440f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f4800 0x7fea440f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 -- 172.21.15.33:0/4103785937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38005040 con 0x7fea440f51a0 2022-02-02T15:07:32.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.643+0000 7fea43fff700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fea30002700 tx=0x7fea30009d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.644+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea300079c0 con 0x7fea440f51a0 2022-02-02T15:07:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.644+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fea3000f040 con 0x7fea440f51a0 2022-02-02T15:07:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.644+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea440f61b0 con 0x7fea440f51a0 2022-02-02T15:07:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.644+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea30014740 con 0x7fea440f51a0 2022-02-02T15:07:32.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.644+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4410edd0 con 0x7fea440f51a0 2022-02-02T15:07:32.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.645+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea44045ad0 con 0x7fea440f51a0 2022-02-02T15:07:32.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.645+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fea3001b060 con 0x7fea440f51a0 2022-02-02T15:07:32.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.646+0000 7fea417fa700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 0x7fea340672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.646+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fea30081970 con 0x7fea440f51a0 2022-02-02T15:07:32.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.646+0000 7fea48855700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 0x7fea340672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.647+0000 7fea48855700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 0x7fea340672e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fea38013690 tx=0x7fea38009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.645 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.650+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fea3004f9c0 con 0x7fea440f51a0 2022-02-02T15:07:32.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.833+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fea440fee50 con 0x7fea34064e20 2022-02-02T15:07:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.847+0000 7fea417fa700 1 -- 172.21.15.33:0/4103785937 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fea440fee50 con 0x7fea34064e20 2022-02-02T15:07:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:07:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (92m) 54m ago 93m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:07:32.841 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (85m) 54m ago 93m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:07:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (85m) 54m ago 93m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:07:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (92m) 54m ago 93m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:07:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (86m) 54m ago 90m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:07:32.842 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (86m) 54m ago 89m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:07:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (87m) 54m ago 90m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:07:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (90m) 54m ago 90m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:07:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (87m) 54m ago 95m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:07:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (87m) 54m ago 93m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:07:32.843 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (86m) 54m ago 95m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:07:32.844 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (86m) 54m ago 93m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:07:32.844 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (93m) 54m ago 93m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:07:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (93m) 54m ago 93m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:07:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 54m ago 92m - 4096M 2022-02-02T15:07:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (92m) 54m ago 92m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:07:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (91m) 54m ago 91m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:07:32.845 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (91m) 54m ago 91m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:07:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (91m) 54m ago 91m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:07:32.846 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (91m) 54m ago 91m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:07:32.847 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (92m) 54m ago 93m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:07:32.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 msgr2=0x7fea340672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 0x7fea340672e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7fea38013690 tx=0x7fea38009b30).stop 2022-02-02T15:07:32.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 msgr2=0x7fea440f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7fea30002700 tx=0x7fea30009d60).stop 2022-02-02T15:07:32.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 shutdown_connections 2022-02-02T15:07:32.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fea34064e20 0x7fea340672e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea440f4800 0x7fea440f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 --2- 172.21.15.33:0/4103785937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea440f51a0 0x7fea440f5830 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 >> 172.21.15.33:0/4103785937 conn(0x7fea440f0320 msgr2=0x7fea440fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:32.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 shutdown_connections 2022-02-02T15:07:32.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.849+0000 7fea49857700 1 -- 172.21.15.33:0/4103785937 wait complete. 2022-02-02T15:07:32.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 -- 172.21.15.33:0/359625492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f55c0 msgr2=0x7f2da80f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 --2- 172.21.15.33:0/359625492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f55c0 0x7f2da80f59e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f2d980099e0 tx=0x7f2d98004d10).stop 2022-02-02T15:07:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 -- 172.21.15.33:0/359625492 shutdown_connections 2022-02-02T15:07:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 --2- 172.21.15.33:0/359625492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f6860 0x7f2da80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 --2- 172.21.15.33:0/359625492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f55c0 0x7f2da80f59e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 -- 172.21.15.33:0/359625492 >> 172.21.15.33:0/359625492 conn(0x7f2da80f0d40 msgr2=0x7f2da80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:32.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.949+0000 7f2dade2f700 1 -- 172.21.15.33:0/359625492 shutdown_connections 2022-02-02T15:07:32.948 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:32 smithi033 ceph-mon[101165]: pgmap v2664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:32.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.950+0000 7f2dade2f700 1 -- 172.21.15.33:0/359625492 wait complete. 2022-02-02T15:07:32.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.950+0000 7f2dade2f700 1 Processor -- start 2022-02-02T15:07:32.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2dade2f700 1 -- start start 2022-02-02T15:07:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2dade2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f55c0 0x7f2da810c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2dade2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2dade2f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80602b0 con 0x7f2da80f6860 2022-02-02T15:07:32.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2dade2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da80603f0 con 0x7f2da80f55c0 2022-02-02T15:07:32.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2da6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2da6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36072/0 (socket says 172.21.15.33:36072) 2022-02-02T15:07:32.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2da6ffd700 1 -- 172.21.15.33:0/36212313 learned_addr learned my addr 172.21.15.33:0/36212313 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:32.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.951+0000 7f2da77fe700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f55c0 0x7f2da810c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2da6ffd700 1 -- 172.21.15.33:0/36212313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f55c0 msgr2=0x7f2da810c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:32.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2da6ffd700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f55c0 0x7f2da810c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:32.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2da6ffd700 1 -- 172.21.15.33:0/36212313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d98009640 con 0x7f2da80f6860 2022-02-02T15:07:32.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2da6ffd700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f2d9000e7f0 tx=0x7f2d9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d900092e0 con 0x7f2da80f6860 2022-02-02T15:07:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da810ebe0 con 0x7f2da80f6860 2022-02-02T15:07:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da810f060 con 0x7f2da80f6860 2022-02-02T15:07:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2d9000f040 con 0x7f2da80f6860 2022-02-02T15:07:32.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.952+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d90014830 con 0x7f2da80f6860 2022-02-02T15:07:32.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.953+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8c004fa0 con 0x7f2da80f6860 2022-02-02T15:07:32.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.954+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2d90014aa0 con 0x7f2da80f6860 2022-02-02T15:07:32.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.954+0000 7f2d9ffff700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 0x7f2d94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:32.956 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.954+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2d90081a30 con 0x7f2da80f6860 2022-02-02T15:07:32.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.954+0000 7f2da77fe700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 0x7f2d94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:32.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.955+0000 7f2da77fe700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 0x7f2d94067290 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f2d9800b6c0 tx=0x7f2d98015040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:32.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:32.958+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2d900497d0 con 0x7f2da80f6860 2022-02-02T15:07:33.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:32 smithi037 ceph-mon[69017]: pgmap v2664: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.200+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d8c005e80 con 0x7f2da80f6860 2022-02-02T15:07:33.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.200+0000 7f2d9ffff700 1 -- 172.21.15.33:0/36212313 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2d9004fc30 con 0x7f2da80f6860 2022-02-02T15:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:07:33.195 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:33.196 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:33.197 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:07:33.198 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:33.199 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:07:33.200 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:07:33.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:07:33.202 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:07:33.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 msgr2=0x7f2d94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 0x7f2d94067290 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f2d9800b6c0 tx=0x7f2d98015040).stop 2022-02-02T15:07:33.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 msgr2=0x7f2da810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f2d9000e7f0 tx=0x7f2d9000b040).stop 2022-02-02T15:07:33.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 shutdown_connections 2022-02-02T15:07:33.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2d94064dd0 0x7f2d94067290 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.206 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da80f55c0 0x7f2da810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 --2- 172.21.15.33:0/36212313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2da80f6860 0x7f2da810e6f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 >> 172.21.15.33:0/36212313 conn(0x7f2da80f0d40 msgr2=0x7f2da80fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 shutdown_connections 2022-02-02T15:07:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.202+0000 7f2dade2f700 1 -- 172.21.15.33:0/36212313 wait complete. 2022-02-02T15:07:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2779146603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 msgr2=0x7f0a180f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2779146603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a180f7de0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f0a04004660 tx=0x7f0a04009b30).stop 2022-02-02T15:07:33.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2779146603 shutdown_connections 2022-02-02T15:07:33.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2779146603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a180f7de0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2779146603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a180f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2779146603 >> 172.21.15.33:0/2779146603 conn(0x7f0a180f1e40 msgr2=0x7f0a180f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:33.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2779146603 shutdown_connections 2022-02-02T15:07:33.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.303+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2779146603 wait complete. 2022-02-02T15:07:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 Processor -- start 2022-02-02T15:07:33.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 -- start start 2022-02-02T15:07:33.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:33.304 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a18107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18107a00 con 0x7f0a180f7980 2022-02-02T15:07:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.304+0000 7f0a1edb5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a18107b40 con 0x7f0a180f66e0 2022-02-02T15:07:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a18107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:33.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:46796/0 (socket says 172.21.15.33:46796) 2022-02-02T15:07:33.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 -- 172.21.15.33:0/2309379337 learned_addr learned my addr 172.21.15.33:0/2309379337 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:07:33.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 -- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 msgr2=0x7f0a18107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.306 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a18107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 -- 172.21.15.33:0/2309379337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04005040 con 0x7f0a180f66e0 2022-02-02T15:07:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a17fff700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a18107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:07:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1cb51700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0a0c002700 tx=0x7f0a0c009d80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:33.307 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c0079c0 con 0x7f0a180f66e0 2022-02-02T15:07:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a181084e0 con 0x7f0a180f66e0 2022-02-02T15:07:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f0a0c00f040 con 0x7f0a180f66e0 2022-02-02T15:07:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c014860 con 0x7f0a180f66e0 2022-02-02T15:07:33.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.305+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a18108aa0 con 0x7f0a180f66e0 2022-02-02T15:07:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.306+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a18045ad0 con 0x7f0a180f66e0 2022-02-02T15:07:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.307+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0a0c01b060 con 0x7f0a180f66e0 2022-02-02T15:07:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.307+0000 7f0a157fa700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 0x7f0a08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:07:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.307+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f0a0c081930 con 0x7f0a180f66e0 2022-02-02T15:07:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.307+0000 7f0a17fff700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 0x7f0a08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:07:33.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.308+0000 7f0a17fff700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 0x7f0a08067290 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0a04005010 tx=0x7f0a04009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:07:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.312+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0a0c053410 con 0x7f0a180f66e0 2022-02-02T15:07:33.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.530+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a180ff020 con 0x7f0a180f66e0 2022-02-02T15:07:33.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.531+0000 7f0a157fa700 1 -- 172.21.15.33:0/2309379337 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0a0c019070 con 0x7f0a180f66e0 2022-02-02T15:07:33.524 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:07:33.525 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:07:33.525 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:07:33.525 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:07:33.525 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:33.526 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:07:33.526 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:07:33.526 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:07:33.526 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:07:33.527 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:07:33.527 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:07:33.527 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:07:33.527 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:07:33.528 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:07:33.528 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:07:33.528 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:07:33.528 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:07:33.529 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:07:33.529 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:07:33.529 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:07:33.529 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:07:33.530 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:07:33.530 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:07:33.530 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:07:33.530 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:07:33.531 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:07:33.531 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:07:33.531 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:07:33.531 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:07:33.531 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:07:33.532 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:07:33.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:33.532 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:33.532 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:07:33.533 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:07:33.533 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:33.533 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:33.533 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:33.534 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:07:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 msgr2=0x7f0a08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 0x7f0a08067290 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0a04005010 tx=0x7f0a04009b30).stop 2022-02-02T15:07:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 msgr2=0x7f0a18106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:07:33.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f0a0c002700 tx=0x7f0a0c009d80).stop 2022-02-02T15:07:33.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 shutdown_connections 2022-02-02T15:07:33.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0a08064dd0 0x7f0a08067290 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a180f66e0 0x7f0a18106f60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 --2- 172.21.15.33:0/2309379337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a180f7980 0x7f0a18107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:07:33.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 >> 172.21.15.33:0/2309379337 conn(0x7f0a180f1e40 msgr2=0x7f0a180fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:07:33.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 shutdown_connections 2022-02-02T15:07:33.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:07:33.534+0000 7f0a1edb5700 1 -- 172.21.15.33:0/2309379337 wait complete. 2022-02-02T15:07:33.537 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:07:33.983 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:33 smithi033 ceph-mon[101165]: from='client.36802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:33.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/36212313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:07:33.984 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2309379337' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:07:34.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:33 smithi037 ceph-mon[69017]: from='client.36802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:34.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/36212313' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:07:34.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2309379337' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:07:35.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:34 smithi037 ceph-mon[69017]: from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:35.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:34 smithi037 ceph-mon[69017]: pgmap v2665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:35.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:34 smithi033 ceph-mon[101165]: from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:07:35.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:34 smithi033 ceph-mon[101165]: pgmap v2665: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:36 smithi037 ceph-mon[69017]: pgmap v2666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:37.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:36 smithi033 ceph-mon[101165]: pgmap v2666: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:38.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:37 smithi033 ceph-mon[101165]: pgmap v2667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:38.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:37 smithi037 ceph-mon[69017]: pgmap v2667: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:40.983 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:40 smithi033 ceph-mon[101165]: pgmap v2668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:41.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:40 smithi037 ceph-mon[69017]: pgmap v2668: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:43.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:42 smithi037 ceph-mon[69017]: pgmap v2669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:43.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:42 smithi033 ceph-mon[101165]: pgmap v2669: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:45.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:44 smithi037 ceph-mon[69017]: pgmap v2670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:45.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:44 smithi033 ceph-mon[101165]: pgmap v2670: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:47.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:46 smithi037 ceph-mon[69017]: pgmap v2671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:47.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:46 smithi033 ceph-mon[101165]: pgmap v2671: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:49.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:48 smithi037 ceph-mon[69017]: pgmap v2672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:49.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:48 smithi033 ceph-mon[101165]: pgmap v2672: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:51.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:50 smithi037 ceph-mon[69017]: pgmap v2673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:51.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:50 smithi033 ceph-mon[101165]: pgmap v2673: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:53.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:52 smithi037 ceph-mon[69017]: pgmap v2674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:53.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:52 smithi033 ceph-mon[101165]: pgmap v2674: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:55.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:54 smithi037 ceph-mon[69017]: pgmap v2675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:07:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:07:55.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:54 smithi033 ceph-mon[101165]: pgmap v2675: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:55.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:07:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:07:57.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:56 smithi037 ceph-mon[69017]: pgmap v2676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:57.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:56 smithi033 ceph-mon[101165]: pgmap v2676: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:59.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:07:58 smithi037 ceph-mon[69017]: pgmap v2677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:07:59.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:07:58 smithi033 ceph-mon[101165]: pgmap v2677: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:01.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:00 smithi037 ceph-mon[69017]: pgmap v2678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:01.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:00 smithi033 ceph-mon[101165]: pgmap v2678: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:03.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:02 smithi037 ceph-mon[69017]: pgmap v2679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:03.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:02 smithi033 ceph-mon[101165]: pgmap v2679: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:03.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2196596093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f66e0 msgr2=0x7efd040f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2196596093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f66e0 0x7efd040f6b00 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7efd00004660 tx=0x7efd00009b30).stop 2022-02-02T15:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2196596093 shutdown_connections 2022-02-02T15:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2196596093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f7980 0x7efd040f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2196596093 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f66e0 0x7efd040f6b00 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.643 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2196596093 >> 172.21.15.33:0/2196596093 conn(0x7efd040f1e40 msgr2=0x7efd040f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2196596093 shutdown_connections 2022-02-02T15:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.649+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2196596093 wait complete. 2022-02-02T15:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 Processor -- start 2022-02-02T15:08:03.644 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 -- start start 2022-02-02T15:08:03.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f66e0 0x7efd04109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04109c30 con 0x7efd040f7980 2022-02-02T15:08:03.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd0bc4a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd04109d70 con 0x7efd040f66e0 2022-02-02T15:08:03.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd091e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.647 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd091e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36092/0 (socket says 172.21.15.33:36092) 2022-02-02T15:08:03.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd091e5700 1 -- 172.21.15.33:0/2731508205 learned_addr learned my addr 172.21.15.33:0/2731508205 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:03.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.650+0000 7efd099e6700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f66e0 0x7efd04109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd091e5700 1 -- 172.21.15.33:0/2731508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f66e0 msgr2=0x7efd04109190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.648 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd091e5700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f66e0 0x7efd04109190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd091e5700 1 -- 172.21.15.33:0/2731508205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd00005040 con 0x7efd040f7980 2022-02-02T15:08:03.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd091e5700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7efcf40026d0 tx=0x7efcf4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:03.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf40079c0 con 0x7efd040f7980 2022-02-02T15:08:03.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efcf400f040 con 0x7efd040f7980 2022-02-02T15:08:03.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0410a710 con 0x7efd040f7980 2022-02-02T15:08:03.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efcf40148b0 con 0x7efd040f7980 2022-02-02T15:08:03.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.651+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0410acd0 con 0x7efd040f7980 2022-02-02T15:08:03.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.652+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd04045ad0 con 0x7efd040f7980 2022-02-02T15:08:03.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.653+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efcf4007b20 con 0x7efd040f7980 2022-02-02T15:08:03.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.653+0000 7efcfa7fc700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 0x7efcf0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.653+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efcf4081910 con 0x7efd040f7980 2022-02-02T15:08:03.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.653+0000 7efd099e6700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 0x7efcf0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.654+0000 7efd099e6700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 0x7efcf0067270 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7efd00013690 tx=0x7efd00009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:03.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.658+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efcf40533f0 con 0x7efd040f7980 2022-02-02T15:08:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.844+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efd0410b000 con 0x7efcf0064db0 2022-02-02T15:08:03.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.845+0000 7efcfa7fc700 1 -- 172.21.15.33:0/2731508205 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7efd0410b000 con 0x7efcf0064db0 2022-02-02T15:08:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 msgr2=0x7efcf0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 0x7efcf0067270 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7efd00013690 tx=0x7efd00009b30).stop 2022-02-02T15:08:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 msgr2=0x7efd04109680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 rx=0x7efcf40026d0 tx=0x7efcf4009de0).stop 2022-02-02T15:08:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 shutdown_connections 2022-02-02T15:08:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf0064db0 0x7efcf0067270 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd040f66e0 0x7efd04109190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 --2- 172.21.15.33:0/2731508205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd040f7980 0x7efd04109680 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 >> 172.21.15.33:0/2731508205 conn(0x7efd040f1e40 msgr2=0x7efd040fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 shutdown_connections 2022-02-02T15:08:03.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.847+0000 7efd0bc4a700 1 -- 172.21.15.33:0/2731508205 wait complete. 2022-02-02T15:08:03.850 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:08:03.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 -- 172.21.15.33:0/1169099078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 msgr2=0x7f62a40fdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.941 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/1169099078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a40fdfe0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f6290004660 tx=0x7f6290009b30).stop 2022-02-02T15:08:03.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 -- 172.21.15.33:0/1169099078 shutdown_connections 2022-02-02T15:08:03.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/1169099078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a40fdfe0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/1169099078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 0x7f62a40fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 -- 172.21.15.33:0/1169099078 >> 172.21.15.33:0/1169099078 conn(0x7f62a40f0d40 msgr2=0x7f62a40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:03.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 -- 172.21.15.33:0/1169099078 shutdown_connections 2022-02-02T15:08:03.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.948+0000 7f62ab1bf700 1 -- 172.21.15.33:0/1169099078 wait complete. 2022-02-02T15:08:03.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 Processor -- start 2022-02-02T15:08:03.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 -- start start 2022-02-02T15:08:03.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 0x7f62a41090e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4109b80 con 0x7f62a40fbbf0 2022-02-02T15:08:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62ab1bf700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a4109cc0 con 0x7f62a40602b0 2022-02-02T15:08:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36102/0 (socket says 172.21.15.33:36102) 2022-02-02T15:08:03.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.949+0000 7f62a3fff700 1 -- 172.21.15.33:0/4244446358 learned_addr learned my addr 172.21.15.33:0/4244446358 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:03.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a8f5b700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 0x7f62a41090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a3fff700 1 -- 172.21.15.33:0/4244446358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 msgr2=0x7f62a41090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a3fff700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 0x7f62a41090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a3fff700 1 -- 172.21.15.33:0/4244446358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005040 con 0x7f62a40fbbf0 2022-02-02T15:08:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a3fff700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6290014040 tx=0x7f629000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:03.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6290019070 con 0x7f62a40fbbf0 2022-02-02T15:08:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6290007e70 con 0x7f62a40fbbf0 2022-02-02T15:08:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a410a600 con 0x7f62a40fbbf0 2022-02-02T15:08:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6290014d10 con 0x7f62a40fbbf0 2022-02-02T15:08:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.950+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a410ab60 con 0x7f62a40fbbf0 2022-02-02T15:08:03.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.952+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a4045ad0 con 0x7f62a40fbbf0 2022-02-02T15:08:03.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.952+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6290025070 con 0x7f62a40fbbf0 2022-02-02T15:08:03.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.952+0000 7f62a17fa700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 0x7f6294067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:03.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.952+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6290082b50 con 0x7f62a40fbbf0 2022-02-02T15:08:03.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.953+0000 7f62a8f5b700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 0x7f6294067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:03.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.953+0000 7f62a8f5b700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 0x7f6294067290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6298009fd0 tx=0x7f629800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:03.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:03.957+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6290054570 con 0x7f62a40fbbf0 2022-02-02T15:08:04.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.137+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f62a410ad80 con 0x7f6294064dd0 2022-02-02T15:08:04.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.152+0000 7f62a17fa700 1 -- 172.21.15.33:0/4244446358 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f62a410ad80 con 0x7f6294064dd0 2022-02-02T15:08:04.144 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:08:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (93m) 55m ago 94m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:08:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (86m) 55m ago 94m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:08:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (86m) 55m ago 93m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:08:04.145 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (93m) 55m ago 94m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:08:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (86m) 55m ago 90m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:08:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (87m) 55m ago 90m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:08:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (88m) 55m ago 90m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:08:04.146 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (90m) 55m ago 90m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:08:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (88m) 55m ago 95m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:08:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (87m) 55m ago 93m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:08:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (87m) 55m ago 95m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:08:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (86m) 55m ago 93m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:08:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (94m) 55m ago 94m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:08:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (93m) 55m ago 93m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:08:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 55m ago 93m - 4096M 2022-02-02T15:08:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (92m) 55m ago 92m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:08:04.148 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (92m) 55m ago 92m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:08:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (92m) 55m ago 92m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:08:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (91m) 55m ago 91m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:08:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (91m) 55m ago 91m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:08:04.149 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (93m) 55m ago 93m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:08:04.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.153+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 msgr2=0x7f6294067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.153+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 0x7f6294067290 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7f6298009fd0 tx=0x7f629800b040).stop 2022-02-02T15:08:04.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.153+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 msgr2=0x7f62a41095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.153+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6290014040 tx=0x7f629000b040).stop 2022-02-02T15:08:04.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 shutdown_connections 2022-02-02T15:08:04.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6294064dd0 0x7f6294067290 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62a40602b0 0x7f62a41090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 --2- 172.21.15.33:0/4244446358 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62a40fbbf0 0x7f62a41095d0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 >> 172.21.15.33:0/4244446358 conn(0x7f62a40f0d40 msgr2=0x7f62a40f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:04.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 shutdown_connections 2022-02-02T15:08:04.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.154+0000 7f62ab1bf700 1 -- 172.21.15.33:0/4244446358 wait complete. 2022-02-02T15:08:04.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 -- 172.21.15.33:0/214237823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 msgr2=0x7fa83c0f4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 --2- 172.21.15.33:0/214237823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c0f4fe0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7fa82c004770 tx=0x7fa82c00ac40).stop 2022-02-02T15:08:04.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 -- 172.21.15.33:0/214237823 shutdown_connections 2022-02-02T15:08:04.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 --2- 172.21.15.33:0/214237823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 0x7fa83c0f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 --2- 172.21.15.33:0/214237823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c0f4fe0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 -- 172.21.15.33:0/214237823 >> 172.21.15.33:0/214237823 conn(0x7fa83c0f0320 msgr2=0x7fa83c0f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 -- 172.21.15.33:0/214237823 shutdown_connections 2022-02-02T15:08:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.253+0000 7fa83b59e700 1 -- 172.21.15.33:0/214237823 wait complete. 2022-02-02T15:08:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 Processor -- start 2022-02-02T15:08:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 -- start start 2022-02-02T15:08:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 0x7fa83c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c109a70 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83c109bb0 con 0x7fa83c0f5e60 2022-02-02T15:08:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36110/0 (socket says 172.21.15.33:36110) 2022-02-02T15:08:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 -- 172.21.15.33:0/1065690674 learned_addr learned my addr 172.21.15.33:0/1065690674 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa839d9b700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 0x7fa83c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 -- 172.21.15.33:0/1065690674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 msgr2=0x7fa83c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 0x7fa83c1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.254+0000 7fa83a59c700 1 -- 172.21.15.33:0/1065690674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c005040 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa83a59c700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fa82c00acf0 tx=0x7fa82c00ac40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82c00f030 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa82c007c60 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83c10a4f0 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82c019070 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.255+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83c10aa50 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.256+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83c045ad0 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.256+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa82c008440 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.256+0000 7fa832ffd700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 0x7fa8280672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.257+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa82c0835d0 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.257+0000 7fa839d9b700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 0x7fa8280672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.257+0000 7fa839d9b700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 0x7fa8280672e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fa8240041d0 tx=0x7fa824009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:04.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.261+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa82c055170 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.503+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa83c0fcc20 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.503+0000 7fa832ffd700 1 -- 172.21.15.33:0/1065690674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa82c054d60 con 0x7fa83c0f4bc0 2022-02-02T15:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:08:04.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:04.498 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:08:04.499 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:08:04.500 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:08:04.501 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:08:04.501 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:08:04.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.505+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 msgr2=0x7fa8280672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.505+0000 7fa83b59e700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 0x7fa8280672e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fa8240041d0 tx=0x7fa824009040).stop 2022-02-02T15:08:04.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.505+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 msgr2=0x7fa83c108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.505+0000 7fa83b59e700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7fa82c00acf0 tx=0x7fa82c00ac40).stop 2022-02-02T15:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 shutdown_connections 2022-02-02T15:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa828064e20 0x7fa8280672e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa83c0f4bc0 0x7fa83c108fd0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 --2- 172.21.15.33:0/1065690674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa83c0f5e60 0x7fa83c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 >> 172.21.15.33:0/1065690674 conn(0x7fa83c0f0320 msgr2=0x7fa83c0f98b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 shutdown_connections 2022-02-02T15:08:04.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.506+0000 7fa83b59e700 1 -- 172.21.15.33:0/1065690674 wait complete. 2022-02-02T15:08:04.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 -- 172.21.15.33:0/1766983654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f55c0 msgr2=0x7f07900f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 --2- 172.21.15.33:0/1766983654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f55c0 0x7f07900f59e0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f0780004660 tx=0x7f0780009b30).stop 2022-02-02T15:08:04.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 -- 172.21.15.33:0/1766983654 shutdown_connections 2022-02-02T15:08:04.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 --2- 172.21.15.33:0/1766983654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f6860 0x7f07900f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 --2- 172.21.15.33:0/1766983654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f55c0 0x7f07900f59e0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 -- 172.21.15.33:0/1766983654 >> 172.21.15.33:0/1766983654 conn(0x7f07900f0d40 msgr2=0x7f07900f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:04.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 -- 172.21.15.33:0/1766983654 shutdown_connections 2022-02-02T15:08:04.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.606+0000 7f07966f3700 1 -- 172.21.15.33:0/1766983654 wait complete. 2022-02-02T15:08:04.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 Processor -- start 2022-02-02T15:08:04.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 -- start start 2022-02-02T15:08:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f55c0 0x7f0790109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900603c0 con 0x7f07900f6860 2022-02-02T15:08:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f07966f3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0790060500 con 0x7f07900f55c0 2022-02-02T15:08:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f078f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f078f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36122/0 (socket says 172.21.15.33:36122) 2022-02-02T15:08:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f078f7fe700 1 -- 172.21.15.33:0/3082281029 learned_addr learned my addr 172.21.15.33:0/3082281029 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.607+0000 7f078ffff700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f55c0 0x7f0790109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078f7fe700 1 -- 172.21.15.33:0/3082281029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f55c0 msgr2=0x7f0790109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078f7fe700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f55c0 0x7f0790109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078f7fe700 1 -- 172.21.15.33:0/3082281029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0780005040 con 0x7f07900f6860 2022-02-02T15:08:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078f7fe700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f07840026d0 tx=0x7f0784009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07840079c0 con 0x7f07900f6860 2022-02-02T15:08:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f078400f040 con 0x7f07900f6860 2022-02-02T15:08:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079010c740 con 0x7f07900f6860 2022-02-02T15:08:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07840148b0 con 0x7f07900f6860 2022-02-02T15:08:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.608+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079010ccd0 con 0x7f07900f6860 2022-02-02T15:08:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.609+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0790045ad0 con 0x7f07900f6860 2022-02-02T15:08:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.610+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0784007b20 con 0x7f07900f6860 2022-02-02T15:08:04.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.610+0000 7f078cff9700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 0x7f0778067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:04.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.610+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f07840819b0 con 0x7f07900f6860 2022-02-02T15:08:04.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.610+0000 7f078ffff700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 0x7f0778067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:04.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.611+0000 7f078ffff700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 0x7f0778067270 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f0790060040 tx=0x7f0780009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:04.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.614+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f078404f9a0 con 0x7f07900f6860 2022-02-02T15:08:04.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.827+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0790027a00 con 0x7f07900f6860 2022-02-02T15:08:04.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.828+0000 7f078cff9700 1 -- 172.21.15.33:0/3082281029 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f0784052fc0 con 0x7f07900f6860 2022-02-02T15:08:04.821 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:08:04.821 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:08:04.821 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:08:04.821 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:08:04.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:04.822 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:08:04.822 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:08:04.822 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:08:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:08:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:08:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:08:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:08:04.823 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:08:04.824 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:08:04.824 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:08:04.824 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:08:04.824 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:08:04.824 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:08:04.825 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:08:04.825 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:08:04.825 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:08:04.825 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:08:04.825 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:08:04.826 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:08:04.826 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:08:04.826 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:08:04.826 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:08:04.827 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:08:04.827 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:08:04.827 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:08:04.827 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:08:04.827 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:04.828 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:08:04.828 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:04.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:04.828 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:04.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:04.829 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:04.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 msgr2=0x7f0778067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 0x7f0778067270 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f0790060040 tx=0x7f0780009b30).stop 2022-02-02T15:08:04.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 msgr2=0x7f079010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f07840026d0 tx=0x7f0784009de0).stop 2022-02-02T15:08:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 shutdown_connections 2022-02-02T15:08:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0778064db0 0x7f0778067270 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07900f55c0 0x7f0790109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 --2- 172.21.15.33:0/3082281029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07900f6860 0x7f079010c190 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:04.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.829+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 >> 172.21.15.33:0/3082281029 conn(0x7f07900f0d40 msgr2=0x7f07900fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:04.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.830+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 shutdown_connections 2022-02-02T15:08:04.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:04.830+0000 7f07966f3700 1 -- 172.21.15.33:0/3082281029 wait complete. 2022-02-02T15:08:04.832 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:08:05.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:04 smithi037 ceph-mon[69017]: pgmap v2680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:05.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1065690674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:08:05.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:04 smithi033 ceph-mon[101165]: pgmap v2680: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:05.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1065690674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:08:06.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:05 smithi037 ceph-mon[69017]: from='client.36818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:06.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:05 smithi037 ceph-mon[69017]: from='client.36822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:06.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:05 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3082281029' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:08:06.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:05 smithi033 ceph-mon[101165]: from='client.36818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:06.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:05 smithi033 ceph-mon[101165]: from='client.36822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:06.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:05 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3082281029' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:08:07.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:06 smithi037 ceph-mon[69017]: pgmap v2681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:07.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:06 smithi033 ceph-mon[101165]: pgmap v2681: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:09.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:08 smithi037 ceph-mon[69017]: pgmap v2682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:09.236 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:08 smithi033 ceph-mon[101165]: pgmap v2682: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:10.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:09 smithi033 ceph-mon[101165]: pgmap v2683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:10.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:09 smithi037 ceph-mon[69017]: pgmap v2683: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:13.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:12 smithi037 ceph-mon[69017]: pgmap v2684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:13.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:12 smithi033 ceph-mon[101165]: pgmap v2684: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:15.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:14 smithi037 ceph-mon[69017]: pgmap v2685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:15.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:14 smithi033 ceph-mon[101165]: pgmap v2685: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:17.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:16 smithi037 ceph-mon[69017]: pgmap v2686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:17.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:16 smithi033 ceph-mon[101165]: pgmap v2686: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:19.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:18 smithi037 ceph-mon[69017]: pgmap v2687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:19.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:18 smithi033 ceph-mon[101165]: pgmap v2687: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:21.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:20 smithi037 ceph-mon[69017]: pgmap v2688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:21.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:20 smithi033 ceph-mon[101165]: pgmap v2688: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:23.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:22 smithi037 ceph-mon[69017]: pgmap v2689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:23.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:22 smithi033 ceph-mon[101165]: pgmap v2689: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:25.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:24 smithi037 ceph-mon[69017]: pgmap v2690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:25.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:24 smithi033 ceph-mon[101165]: pgmap v2690: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:27.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:26 smithi037 ceph-mon[69017]: pgmap v2691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:27.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:26 smithi033 ceph-mon[101165]: pgmap v2691: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:29.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:28 smithi037 ceph-mon[69017]: pgmap v2692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:29.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:28 smithi033 ceph-mon[101165]: pgmap v2692: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:31.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:30 smithi037 ceph-mon[69017]: pgmap v2693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:31.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:30 smithi033 ceph-mon[101165]: pgmap v2693: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:33.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:32 smithi037 ceph-mon[69017]: pgmap v2694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:33.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:32 smithi033 ceph-mon[101165]: pgmap v2694: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:34.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 -- 172.21.15.33:0/1359069822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 msgr2=0x7fa2580f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:34.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 --2- 172.21.15.33:0/1359069822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa2580f5180 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fa254004660 tx=0x7fa254009b30).stop 2022-02-02T15:08:34.938 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 -- 172.21.15.33:0/1359069822 shutdown_connections 2022-02-02T15:08:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 --2- 172.21.15.33:0/1359069822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 0x7fa2580f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 --2- 172.21.15.33:0/1359069822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa2580f5180 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.944+0000 7fa25f878700 1 -- 172.21.15.33:0/1359069822 >> 172.21.15.33:0/1359069822 conn(0x7fa2580f04c0 msgr2=0x7fa2580f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.945+0000 7fa25f878700 1 -- 172.21.15.33:0/1359069822 shutdown_connections 2022-02-02T15:08:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.945+0000 7fa25f878700 1 -- 172.21.15.33:0/1359069822 wait complete. 2022-02-02T15:08:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.945+0000 7fa25f878700 1 Processor -- start 2022-02-02T15:08:34.940 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.945+0000 7fa25f878700 1 -- start start 2022-02-02T15:08:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25f878700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25f878700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 0x7fa25810c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25f878700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580fc030 con 0x7fa2580f4d60 2022-02-02T15:08:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25f878700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2580fc170 con 0x7fa2580f5f60 2022-02-02T15:08:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36130/0 (socket says 172.21.15.33:36130) 2022-02-02T15:08:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 -- 172.21.15.33:0/915253055 learned_addr learned my addr 172.21.15.33:0/915253055 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25ce13700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 0x7fa25810c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 -- 172.21.15.33:0/915253055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 msgr2=0x7fa25810c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 0x7fa25810c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 -- 172.21.15.33:0/915253055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa254005040 con 0x7fa2580f4d60 2022-02-02T15:08:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.946+0000 7fa25d614700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa254000c00 tx=0x7fa25400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.947+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254019070 con 0x7fa2580f4d60 2022-02-02T15:08:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.947+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa254007e40 con 0x7fa2580f4d60 2022-02-02T15:08:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.947+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25810c6f0 con 0x7fa2580f4d60 2022-02-02T15:08:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.947+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa254014c60 con 0x7fa2580f4d60 2022-02-02T15:08:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.947+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25810cc20 con 0x7fa2580f4d60 2022-02-02T15:08:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.948+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2580f4150 con 0x7fa2580f4d60 2022-02-02T15:08:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.948+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa254025070 con 0x7fa2580f4d60 2022-02-02T15:08:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.949+0000 7fa24dffb700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 0x7fa244067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.949+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa254082960 con 0x7fa2580f4d60 2022-02-02T15:08:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.949+0000 7fa25ce13700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 0x7fa244067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.949+0000 7fa25ce13700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 0x7fa244067290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fa248009fd0 tx=0x7fa24800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:34.953+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa254050a10 con 0x7fa2580f4d60 2022-02-02T15:08:35.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:34 smithi037 ceph-mon[69017]: pgmap v2695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:35.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.143+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2580fdeb0 con 0x7fa244064dd0 2022-02-02T15:08:35.136 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:34 smithi033 ceph-mon[101165]: pgmap v2695: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:35.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.144+0000 7fa24dffb700 1 -- 172.21.15.33:0/915253055 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa2580fdeb0 con 0x7fa244064dd0 2022-02-02T15:08:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 msgr2=0x7fa244067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 0x7fa244067290 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7fa248009fd0 tx=0x7fa24800b040).stop 2022-02-02T15:08:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 msgr2=0x7fa258109c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7fa254000c00 tx=0x7fa25400b040).stop 2022-02-02T15:08:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 shutdown_connections 2022-02-02T15:08:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa244064dd0 0x7fa244067290 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2580f4d60 0x7fa258109c40 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 --2- 172.21.15.33:0/915253055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2580f5f60 0x7fa25810c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 >> 172.21.15.33:0/915253055 conn(0x7fa2580f04c0 msgr2=0x7fa2580f9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 shutdown_connections 2022-02-02T15:08:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.146+0000 7fa25f878700 1 -- 172.21.15.33:0/915253055 wait complete. 2022-02-02T15:08:35.148 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:08:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 -- 172.21.15.33:0/4150761372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f66e0 msgr2=0x7fc5c40f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 --2- 172.21.15.33:0/4150761372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f66e0 0x7fc5c40f6b00 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fc5b8004660 tx=0x7fc5b8009b30).stop 2022-02-02T15:08:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 -- 172.21.15.33:0/4150761372 shutdown_connections 2022-02-02T15:08:35.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 --2- 172.21.15.33:0/4150761372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f7980 0x7fc5c40f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 --2- 172.21.15.33:0/4150761372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f66e0 0x7fc5c40f6b00 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 -- 172.21.15.33:0/4150761372 >> 172.21.15.33:0/4150761372 conn(0x7fc5c40f1e40 msgr2=0x7fc5c40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 -- 172.21.15.33:0/4150761372 shutdown_connections 2022-02-02T15:08:35.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.247+0000 7fc5cb585700 1 -- 172.21.15.33:0/4150761372 wait complete. 2022-02-02T15:08:35.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 Processor -- start 2022-02-02T15:08:35.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 -- start start 2022-02-02T15:08:35.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f66e0 0x7fc5c4106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.244 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4107a50 con 0x7fc5c40f7980 2022-02-02T15:08:35.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5cb585700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c4107b90 con 0x7fc5c40f66e0 2022-02-02T15:08:35.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5c8b20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.245 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5c9321700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f66e0 0x7fc5c4106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5c8b20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36142/0 (socket says 172.21.15.33:36142) 2022-02-02T15:08:35.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.248+0000 7fc5c8b20700 1 -- 172.21.15.33:0/1263181201 learned_addr learned my addr 172.21.15.33:0/1263181201 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:35.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5c8b20700 1 -- 172.21.15.33:0/1263181201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f66e0 msgr2=0x7fc5c4106fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5c8b20700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f66e0 0x7fc5c4106fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.246 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5c8b20700 1 -- 172.21.15.33:0/1263181201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8005040 con 0x7fc5c40f7980 2022-02-02T15:08:35.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5c8b20700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc5c00026d0 tx=0x7fc5c0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c00079c0 con 0x7fc5c40f7980 2022-02-02T15:08:35.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc5c000f040 con 0x7fc5c40f7980 2022-02-02T15:08:35.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c4108530 con 0x7fc5c40f7980 2022-02-02T15:08:35.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c00148b0 con 0x7fc5c40f7980 2022-02-02T15:08:35.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.249+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c4108af0 con 0x7fc5c40f7980 2022-02-02T15:08:35.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.250+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c4045ad0 con 0x7fc5c40f7980 2022-02-02T15:08:35.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.250+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc5c0014a10 con 0x7fc5c40f7980 2022-02-02T15:08:35.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.251+0000 7fc5b5ffb700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 0x7fc5b0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.251+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc5c0081930 con 0x7fc5c40f7980 2022-02-02T15:08:35.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.251+0000 7fc5c9321700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 0x7fc5b0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.251+0000 7fc5c9321700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 0x7fc5b0067290 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc5b8004630 tx=0x7fc5b8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.255+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc5c0053410 con 0x7fc5c40f7980 2022-02-02T15:08:35.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.437+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5c4108dc0 con 0x7fc5b0064dd0 2022-02-02T15:08:35.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.452+0000 7fc5b5ffb700 1 -- 172.21.15.33:0/1263181201 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fc5c4108dc0 con 0x7fc5b0064dd0 2022-02-02T15:08:35.445 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:08:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (93m) 55m ago 94m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:08:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (86m) 55m ago 94m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:08:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (86m) 56m ago 94m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:08:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (93m) 55m ago 94m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:08:35.446 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (87m) 55m ago 91m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:08:35.447 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (88m) 55m ago 91m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:08:35.447 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (88m) 56m ago 91m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:08:35.447 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (91m) 56m ago 91m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:08:35.447 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (88m) 55m ago 96m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:08:35.448 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (88m) 56m ago 94m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:08:35.448 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (87m) 55m ago 96m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:08:35.448 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (87m) 56m ago 94m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:08:35.448 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (94m) 55m ago 94m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:08:35.448 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (94m) 56m ago 94m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:08:35.449 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 55m ago 93m - 4096M 2022-02-02T15:08:35.449 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (93m) 55m ago 93m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:08:35.449 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (93m) 55m ago 93m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:08:35.449 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (92m) 56m ago 92m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:08:35.450 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (92m) 56m ago 92m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:08:35.450 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (92m) 56m ago 92m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:08:35.450 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (93m) 55m ago 94m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:08:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 msgr2=0x7fc5b0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 0x7fc5b0067290 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fc5b8004630 tx=0x7fc5b8009b30).stop 2022-02-02T15:08:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 msgr2=0x7fc5c41074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7fc5c00026d0 tx=0x7fc5c0009de0).stop 2022-02-02T15:08:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 shutdown_connections 2022-02-02T15:08:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc5b0064dd0 0x7fc5b0067290 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.452 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c40f66e0 0x7fc5c4106fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 --2- 172.21.15.33:0/1263181201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5c40f7980 0x7fc5c41074a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 >> 172.21.15.33:0/1263181201 conn(0x7fc5c40f1e40 msgr2=0x7fc5c40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 shutdown_connections 2022-02-02T15:08:35.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.455+0000 7fc5cb585700 1 -- 172.21.15.33:0/1263181201 wait complete. 2022-02-02T15:08:35.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 -- 172.21.15.33:0/1683221423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 msgr2=0x7fce140f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 --2- 172.21.15.33:0/1683221423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce140f6b30 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7fce00004660 tx=0x7fce00009b30).stop 2022-02-02T15:08:35.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 -- 172.21.15.33:0/1683221423 shutdown_connections 2022-02-02T15:08:35.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 --2- 172.21.15.33:0/1683221423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce140f6b30 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 --2- 172.21.15.33:0/1683221423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 0x7fce140f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.559+0000 7fce19f2e700 1 -- 172.21.15.33:0/1683221423 >> 172.21.15.33:0/1683221423 conn(0x7fce140f0b90 msgr2=0x7fce140f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.560+0000 7fce19f2e700 1 -- 172.21.15.33:0/1683221423 shutdown_connections 2022-02-02T15:08:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.560+0000 7fce19f2e700 1 -- 172.21.15.33:0/1683221423 wait complete. 2022-02-02T15:08:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.560+0000 7fce19f2e700 1 Processor -- start 2022-02-02T15:08:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.560+0000 7fce19f2e700 1 -- start start 2022-02-02T15:08:35.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce19f2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 0x7fce14105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce19f2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce19f2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce14106760 con 0x7fce140f66d0 2022-02-02T15:08:35.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce19f2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce14106f60 con 0x7fce140f5430 2022-02-02T15:08:35.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36152/0 (socket says 172.21.15.33:36152) 2022-02-02T15:08:35.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 -- 172.21.15.33:0/681648860 learned_addr learned my addr 172.21.15.33:0/681648860 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:35.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce18f2c700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 0x7fce14105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 -- 172.21.15.33:0/681648860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 msgr2=0x7fce14105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 0x7fce14105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 -- 172.21.15.33:0/681648860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce00005040 con 0x7fce140f66d0 2022-02-02T15:08:35.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.561+0000 7fce13fff700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fce00009990 tx=0x7fce00009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.562+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce00018070 con 0x7fce140f66d0 2022-02-02T15:08:35.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.562+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce141071e0 con 0x7fce140f66d0 2022-02-02T15:08:35.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.562+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fce00007ba0 con 0x7fce140f66d0 2022-02-02T15:08:35.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.562+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce0001c3c0 con 0x7fce140f66d0 2022-02-02T15:08:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.562+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce14107740 con 0x7fce140f66d0 2022-02-02T15:08:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.563+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce14045ad0 con 0x7fce140f66d0 2022-02-02T15:08:35.563 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.563+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fce0001d420 con 0x7fce140f66d0 2022-02-02T15:08:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.564+0000 7fce117fa700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 0x7fce040672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.564+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fce000836f0 con 0x7fce140f66d0 2022-02-02T15:08:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.564+0000 7fce18f2c700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 0x7fce040672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.564+0000 7fce18f2c700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 0x7fce040672e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fce140f6530 tx=0x7fce0800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.568+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fce00055290 con 0x7fce140f66d0 2022-02-02T15:08:35.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.812+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fce140ff600 con 0x7fce140f66d0 2022-02-02T15:08:35.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.813+0000 7fce117fa700 1 -- 172.21.15.33:0/681648860 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fce00054e80 con 0x7fce140f66d0 2022-02-02T15:08:35.806 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:08:35.806 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:35.807 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:08:35.808 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:08:35.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:35.808 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:08:35.808 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:08:35.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:35.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:08:35.809 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:08:35.810 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:08:35.811 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:08:35.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.814+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 msgr2=0x7fce040672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.814+0000 7fce19f2e700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 0x7fce040672e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fce140f6530 tx=0x7fce0800b040).stop 2022-02-02T15:08:35.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 msgr2=0x7fce141061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7fce00009990 tx=0x7fce00009b30).stop 2022-02-02T15:08:35.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 shutdown_connections 2022-02-02T15:08:35.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fce04064e20 0x7fce040672e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce140f5430 0x7fce14105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 --2- 172.21.15.33:0/681648860 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce140f66d0 0x7fce141061b0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 >> 172.21.15.33:0/681648860 conn(0x7fce140f0b90 msgr2=0x7fce140fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 shutdown_connections 2022-02-02T15:08:35.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.815+0000 7fce19f2e700 1 -- 172.21.15.33:0/681648860 wait complete. 2022-02-02T15:08:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 -- 172.21.15.33:0/1488121012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f6530 msgr2=0x7f6e880f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 --2- 172.21.15.33:0/1488121012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f6530 0x7f6e880f6950 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f6e78004660 tx=0x7f6e78009b30).stop 2022-02-02T15:08:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 -- 172.21.15.33:0/1488121012 shutdown_connections 2022-02-02T15:08:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 --2- 172.21.15.33:0/1488121012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f77d0 0x7f6e880f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 --2- 172.21.15.33:0/1488121012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f6530 0x7f6e880f6950 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 -- 172.21.15.33:0/1488121012 >> 172.21.15.33:0/1488121012 conn(0x7f6e880f1c90 msgr2=0x7f6e880f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:35.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 -- 172.21.15.33:0/1488121012 shutdown_connections 2022-02-02T15:08:35.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.915+0000 7f6e8d437700 1 -- 172.21.15.33:0/1488121012 wait complete. 2022-02-02T15:08:35.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 Processor -- start 2022-02-02T15:08:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 -- start start 2022-02-02T15:08:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f6530 0x7f6e88106e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e881078f0 con 0x7f6e880f77d0 2022-02-02T15:08:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e8d437700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88108100 con 0x7f6e880f6530 2022-02-02T15:08:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36162/0 (socket says 172.21.15.33:36162) 2022-02-02T15:08:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.916+0000 7f6e877fe700 1 -- 172.21.15.33:0/2108514521 learned_addr learned my addr 172.21.15.33:0/2108514521 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:08:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e87fff700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f6530 0x7f6e88106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e877fe700 1 -- 172.21.15.33:0/2108514521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f6530 msgr2=0x7f6e88106e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e877fe700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f6530 0x7f6e88106e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e877fe700 1 -- 172.21.15.33:0/2108514521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78005040 con 0x7f6e880f77d0 2022-02-02T15:08:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e877fe700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f6e7c0026d0 tx=0x7f6e7c009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c009320 con 0x7f6e880f77d0 2022-02-02T15:08:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e88108380 con 0x7f6e880f77d0 2022-02-02T15:08:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6e7c00f040 con 0x7f6e880f77d0 2022-02-02T15:08:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c0147e0 con 0x7f6e880f77d0 2022-02-02T15:08:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.917+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88108940 con 0x7f6e880f77d0 2022-02-02T15:08:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.918+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e88059100 con 0x7f6e880f77d0 2022-02-02T15:08:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.919+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6e7c009480 con 0x7f6e880f77d0 2022-02-02T15:08:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.919+0000 7f6e84ff9700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 0x7f6e700672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:08:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.919+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6e7c0820e0 con 0x7f6e880f77d0 2022-02-02T15:08:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.919+0000 7f6e87fff700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 0x7f6e700672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:08:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.919+0000 7f6e87fff700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 0x7f6e700672e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6e78004e30 tx=0x7f6e78009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:08:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:35.923+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6e7c050190 con 0x7f6e880f77d0 2022-02-02T15:08:36.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.135+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e880fee80 con 0x7f6e880f77d0 2022-02-02T15:08:36.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.136+0000 7f6e84ff9700 1 -- 172.21.15.33:0/2108514521 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6e880fee80 con 0x7f6e880f77d0 2022-02-02T15:08:36.129 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:08:36.129 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:08:36.129 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:08:36.130 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:08:36.130 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:36.130 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:08:36.130 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:08:36.131 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:08:36.131 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:08:36.131 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:08:36.132 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:08:36.132 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:08:36.132 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:08:36.133 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:08:36.133 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:08:36.133 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:08:36.133 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:08:36.133 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:08:36.134 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:08:36.134 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:08:36.134 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:08:36.134 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:08:36.135 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:08:36.135 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:08:36.135 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:08:36.135 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:08:36.135 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:08:36.136 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:08:36.136 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:08:36.136 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:08:36.136 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:08:36.137 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:36.137 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:36.137 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:08:36.137 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:08:36.137 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:08:36.139 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.137+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 msgr2=0x7f6e700672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:36.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.137+0000 7f6e8d437700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 0x7f6e700672e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f6e78004e30 tx=0x7f6e78009b30).stop 2022-02-02T15:08:36.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 msgr2=0x7f6e881072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:08:36.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f6e7c0026d0 tx=0x7f6e7c009de0).stop 2022-02-02T15:08:36.140 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 shutdown_connections 2022-02-02T15:08:36.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6e70064e20 0x7f6e700672e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:36.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e880f6530 0x7f6e88106e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:36.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 --2- 172.21.15.33:0/2108514521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880f77d0 0x7f6e881072f0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:08:36.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 >> 172.21.15.33:0/2108514521 conn(0x7f6e880f1c90 msgr2=0x7f6e880fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:08:36.141 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 shutdown_connections 2022-02-02T15:08:36.142 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:08:36.138+0000 7f6e8d437700 1 -- 172.21.15.33:0/2108514521 wait complete. 2022-02-02T15:08:36.142 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:08:37.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:36 smithi037 ceph-mon[69017]: from='client.36834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:36 smithi037 ceph-mon[69017]: from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:36 smithi037 ceph-mon[69017]: pgmap v2696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/681648860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:08:37.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2108514521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:08:37.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:36 smithi033 ceph-mon[101165]: from='client.36834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:37.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:36 smithi033 ceph-mon[101165]: from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:08:37.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:36 smithi033 ceph-mon[101165]: pgmap v2696: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:37.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/681648860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:08:37.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2108514521' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:08:39.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:38 smithi037 ceph-mon[69017]: pgmap v2697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:39.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:38 smithi033 ceph-mon[101165]: pgmap v2697: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:40.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:39 smithi033 ceph-mon[101165]: pgmap v2698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:40.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:39 smithi037 ceph-mon[69017]: pgmap v2698: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:43.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:42 smithi037 ceph-mon[69017]: pgmap v2699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:43.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:42 smithi033 ceph-mon[101165]: pgmap v2699: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:45.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:44 smithi037 ceph-mon[69017]: pgmap v2700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:45.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:44 smithi033 ceph-mon[101165]: pgmap v2700: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:47.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:46 smithi037 ceph-mon[69017]: pgmap v2701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:47.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:46 smithi033 ceph-mon[101165]: pgmap v2701: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:49.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:48 smithi037 ceph-mon[69017]: pgmap v2702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:49.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:48 smithi033 ceph-mon[101165]: pgmap v2702: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:50.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:49 smithi033 ceph-mon[101165]: pgmap v2703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:50.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:49 smithi037 ceph-mon[69017]: pgmap v2703: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:53.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:52 smithi037 ceph-mon[69017]: pgmap v2704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:53.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:52 smithi033 ceph-mon[101165]: pgmap v2704: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:55.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:54 smithi037 ceph-mon[69017]: pgmap v2705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:55.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:08:55.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:08:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:54 smithi033 ceph-mon[101165]: pgmap v2705: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:55.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:08:55.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:08:57.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:56 smithi037 ceph-mon[69017]: pgmap v2706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:57.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:56 smithi033 ceph-mon[101165]: pgmap v2706: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:59.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:58 smithi033 ceph-mon[101165]: pgmap v2707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:08:59.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:58 smithi037 ceph-mon[69017]: pgmap v2707: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:00.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:08:59 smithi033 ceph-mon[101165]: pgmap v2708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:00.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:08:59 smithi037 ceph-mon[69017]: pgmap v2708: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:03.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:02 smithi037 ceph-mon[69017]: pgmap v2709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:03.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:02 smithi033 ceph-mon[101165]: pgmap v2709: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:05.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:04 smithi037 ceph-mon[69017]: pgmap v2710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:05.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:04 smithi033 ceph-mon[101165]: pgmap v2710: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 -- 172.21.15.33:0/1324843548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 msgr2=0x7fc35c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 --2- 172.21.15.33:0/1324843548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c0f6cc0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7fc348004660 tx=0x7fc348009b30).stop 2022-02-02T15:09:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 -- 172.21.15.33:0/1324843548 shutdown_connections 2022-02-02T15:09:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 --2- 172.21.15.33:0/1324843548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c0f6cc0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 --2- 172.21.15.33:0/1324843548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 -- 172.21.15.33:0/1324843548 >> 172.21.15.33:0/1324843548 conn(0x7fc35c0f0d40 msgr2=0x7fc35c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:06.249 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.253+0000 7fc362dc7700 1 -- 172.21.15.33:0/1324843548 shutdown_connections 2022-02-02T15:09:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.254+0000 7fc362dc7700 1 -- 172.21.15.33:0/1324843548 wait complete. 2022-02-02T15:09:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.254+0000 7fc362dc7700 1 Processor -- start 2022-02-02T15:09:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.254+0000 7fc362dc7700 1 -- start start 2022-02-02T15:09:06.250 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.254+0000 7fc362dc7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc362dc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc362dc7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c109bf0 con 0x7fc35c0f6860 2022-02-02T15:09:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc362dc7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc35c109d30 con 0x7fc35c0f55c0 2022-02-02T15:09:06.251 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36172/0 (socket says 172.21.15.33:36172) 2022-02-02T15:09:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 -- 172.21.15.33:0/261309647 learned_addr learned my addr 172.21.15.33:0/261309647 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc360b63700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.252 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 -- 172.21.15.33:0/261309647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 msgr2=0x7fc35c109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 -- 172.21.15.33:0/261309647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348005040 con 0x7fc35c0f6860 2022-02-02T15:09:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc360b63700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:09:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc35bfff700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fc348009990 tx=0x7fc348009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.253 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc348018070 con 0x7fc35c0f6860 2022-02-02T15:09:06.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35c10a670 con 0x7fc35c0f6860 2022-02-02T15:09:06.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc348007ba0 con 0x7fc35c0f6860 2022-02-02T15:09:06.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.255+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc34801c3c0 con 0x7fc35c0f6860 2022-02-02T15:09:06.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.256+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35c10abd0 con 0x7fc35c0f6860 2022-02-02T15:09:06.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.256+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35c045ad0 con 0x7fc35c0f6860 2022-02-02T15:09:06.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.257+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc34801d420 con 0x7fc35c0f6860 2022-02-02T15:09:06.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.257+0000 7fc3597fa700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.256 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.258+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc348083790 con 0x7fc35c0f6860 2022-02-02T15:09:06.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.258+0000 7fc360b63700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.258+0000 7fc360b63700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fc35c0f66c0 tx=0x7fc35000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.257 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.262+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3480552d0 con 0x7fc35c0f6860 2022-02-02T15:09:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.451+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc35c0faaa0 con 0x7fc34c064dd0 2022-02-02T15:09:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.452+0000 7fc3597fa700 1 -- 172.21.15.33:0/261309647 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc35c0faaa0 con 0x7fc34c064dd0 2022-02-02T15:09:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 msgr2=0x7fc34c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7fc35c0f66c0 tx=0x7fc35000b040).stop 2022-02-02T15:09:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 msgr2=0x7fc35c109640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.447 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7fc348009990 tx=0x7fc348009b30).stop 2022-02-02T15:09:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 shutdown_connections 2022-02-02T15:09:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064dd0 0x7fc34c067290 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc35c0f55c0 0x7fc35c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.448 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 --2- 172.21.15.33:0/261309647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc35c0f6860 0x7fc35c109640 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 >> 172.21.15.33:0/261309647 conn(0x7fc35c0f0d40 msgr2=0x7fc35c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 shutdown_connections 2022-02-02T15:09:06.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.454+0000 7fc362dc7700 1 -- 172.21.15.33:0/261309647 wait complete. 2022-02-02T15:09:06.456 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:09:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- 172.21.15.33:0/4172228004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f66e0 msgr2=0x7f27f80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 --2- 172.21.15.33:0/4172228004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f66e0 0x7f27f80f6b00 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f27ec004660 tx=0x7f27ec009b30).stop 2022-02-02T15:09:06.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- 172.21.15.33:0/4172228004 shutdown_connections 2022-02-02T15:09:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 --2- 172.21.15.33:0/4172228004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f7980 0x7f27f80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 --2- 172.21.15.33:0/4172228004 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f66e0 0x7f27f80f6b00 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- 172.21.15.33:0/4172228004 >> 172.21.15.33:0/4172228004 conn(0x7f27f80f1e40 msgr2=0x7f27f80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:06.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- 172.21.15.33:0/4172228004 shutdown_connections 2022-02-02T15:09:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- 172.21.15.33:0/4172228004 wait complete. 2022-02-02T15:09:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 Processor -- start 2022-02-02T15:09:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.555+0000 7f27feaa5700 1 -- start start 2022-02-02T15:09:06.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27feaa5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f66e0 0x7f27f8104d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27feaa5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27feaa5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8105830 con 0x7f27f80f7980 2022-02-02T15:09:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27feaa5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8105970 con 0x7f27f80f66e0 2022-02-02T15:09:06.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36182/0 (socket says 172.21.15.33:36182) 2022-02-02T15:09:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 -- 172.21.15.33:0/453417757 learned_addr learned my addr 172.21.15.33:0/453417757 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27fc841700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f66e0 0x7f27f8104d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 -- 172.21.15.33:0/453417757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f66e0 msgr2=0x7f27f8104d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f66e0 0x7f27f8104d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.556+0000 7f27f7fff700 1 -- 172.21.15.33:0/453417757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec005040 con 0x7f27f80f7980 2022-02-02T15:09:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27f7fff700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f27e400c530 tx=0x7f27e4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e400f650 con 0x7f27f80f7980 2022-02-02T15:09:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f27e400fc60 con 0x7f27f80f7980 2022-02-02T15:09:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f810b540 con 0x7f27f80f7980 2022-02-02T15:09:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27e4012c20 con 0x7f27f80f7980 2022-02-02T15:09:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.557+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f810bb00 con 0x7f27f80f7980 2022-02-02T15:09:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.558+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f8045ad0 con 0x7f27f80f7980 2022-02-02T15:09:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.559+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f27e4010070 con 0x7f27f80f7980 2022-02-02T15:09:06.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.559+0000 7f27f57fa700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 0x7f27e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.559+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f27e4081660 con 0x7f27f80f7980 2022-02-02T15:09:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.559+0000 7f27fc841700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 0x7f27e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.560+0000 7f27fc841700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 0x7f27e8067290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f27ec013690 tx=0x7f27ec009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.563+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f27e40477d0 con 0x7f27f80f7980 2022-02-02T15:09:06.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.747+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f27f80fbe40 con 0x7f27e8064dd0 2022-02-02T15:09:06.753 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.761+0000 7f27f57fa700 1 -- 172.21.15.33:0/453417757 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f27f80fbe40 con 0x7f27e8064dd0 2022-02-02T15:09:06.754 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:09:06.754 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (94m) 56m ago 95m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:09:06.754 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (87m) 56m ago 95m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:09:06.755 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (87m) 56m ago 94m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:09:06.755 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (94m) 56m ago 95m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:09:06.755 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (87m) 56m ago 91m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:09:06.755 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (88m) 56m ago 91m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:09:06.756 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (89m) 56m ago 91m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:09:06.756 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (91m) 56m ago 91m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:09:06.756 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (89m) 56m ago 96m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:09:06.756 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (88m) 56m ago 94m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:09:06.757 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (88m) 56m ago 96m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:09:06.757 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (87m) 56m ago 94m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:09:06.757 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (95m) 56m ago 95m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:09:06.757 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (94m) 56m ago 94m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:09:06.757 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 56m ago 94m - 4096M 2022-02-02T15:09:06.758 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (93m) 56m ago 93m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:09:06.758 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (93m) 56m ago 93m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:09:06.758 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (93m) 56m ago 93m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:09:06.758 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (92m) 56m ago 92m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:09:06.759 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (92m) 56m ago 92m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:09:06.759 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (94m) 56m ago 94m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:09:06.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 msgr2=0x7f27e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 0x7f27e8067290 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f27ec013690 tx=0x7f27ec009b30).stop 2022-02-02T15:09:06.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 msgr2=0x7f27f8105230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7f27e400c530 tx=0x7f27e4007e20).stop 2022-02-02T15:09:06.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 shutdown_connections 2022-02-02T15:09:06.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f27e8064dd0 0x7f27e8067290 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27f80f66e0 0x7f27f8104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 --2- 172.21.15.33:0/453417757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27f80f7980 0x7f27f8105230 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 >> 172.21.15.33:0/453417757 conn(0x7f27f80f1e40 msgr2=0x7f27f806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:06.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 shutdown_connections 2022-02-02T15:09:06.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.763+0000 7f27feaa5700 1 -- 172.21.15.33:0/453417757 wait complete. 2022-02-02T15:09:06.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 -- 172.21.15.33:0/1463959851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540f9830 msgr2=0x7fa9540fbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/1463959851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540f9830 0x7fa9540fbc20 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 rx=0x7fa944004660 tx=0x7fa944009b30).stop 2022-02-02T15:09:06.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 -- 172.21.15.33:0/1463959851 shutdown_connections 2022-02-02T15:09:06.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/1463959851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540f9830 0x7fa9540fbc20 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/1463959851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540602b0 0x7fa9540f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 -- 172.21.15.33:0/1463959851 >> 172.21.15.33:0/1463959851 conn(0x7fa9540f0cd0 msgr2=0x7fa9540f30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:06.858 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:06 smithi033 ceph-mon[101165]: pgmap v2711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:06.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 -- 172.21.15.33:0/1463959851 shutdown_connections 2022-02-02T15:09:06.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.864+0000 7fa95b4d0700 1 -- 172.21.15.33:0/1463959851 wait complete. 2022-02-02T15:09:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 Processor -- start 2022-02-02T15:09:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 -- start start 2022-02-02T15:09:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 0x7fa9541073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954107990 con 0x7fa9540602b0 2022-02-02T15:09:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95b4d0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa954107ad0 con 0x7fa9540f9830 2022-02-02T15:09:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95926c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95926c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36190/0 (socket says 172.21.15.33:36190) 2022-02-02T15:09:06.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa95926c700 1 -- 172.21.15.33:0/3353012268 learned_addr learned my addr 172.21.15.33:0/3353012268 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.865+0000 7fa958a6b700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 0x7fa9541073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95926c700 1 -- 172.21.15.33:0/3353012268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 msgr2=0x7fa9541073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95926c700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 0x7fa9541073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:06.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95926c700 1 -- 172.21.15.33:0/3353012268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944005040 con 0x7fa9540602b0 2022-02-02T15:09:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa958a6b700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 0x7fa9541073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:09:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95926c700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fa9500026d0 tx=0x7fa950009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9500079c0 con 0x7fa9540602b0 2022-02-02T15:09:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa95000f040 con 0x7fa9540602b0 2022-02-02T15:09:06.865 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa954108470 con 0x7fa9540602b0 2022-02-02T15:09:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9500148b0 con 0x7fa9540602b0 2022-02-02T15:09:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.866+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954108a30 con 0x7fa9540602b0 2022-02-02T15:09:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.867+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954045ad0 con 0x7fa9540602b0 2022-02-02T15:09:06.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.868+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa950007b20 con 0x7fa9540602b0 2022-02-02T15:09:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.868+0000 7fa949ffb700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 0x7fa9400672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.869+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa950081950 con 0x7fa9540602b0 2022-02-02T15:09:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.869+0000 7fa958a6b700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 0x7fa9400672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:06.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.869+0000 7fa958a6b700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 0x7fa9400672e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fa944005010 tx=0x7fa944009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:06.868 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:06.873+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa950053430 con 0x7fa9540602b0 2022-02-02T15:09:07.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.116+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa954027a00 con 0x7fa9540602b0 2022-02-02T15:09:07.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.117+0000 7fa949ffb700 1 -- 172.21.15.33:0/3353012268 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa950053020 con 0x7fa9540602b0 2022-02-02T15:09:07.109 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:09:07.110 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:09:07.110 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:09:07.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:07.110 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:09:07.111 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:09:07.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:07.111 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:09:07.111 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:09:07.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:07.112 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:09:07.112 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:09:07.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:07.113 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:09:07.113 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:09:07.113 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:09:07.113 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:09:07.113 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:09:07.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.118+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 msgr2=0x7fa9400672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.118+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 0x7fa9400672e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7fa944005010 tx=0x7fa944009b30).stop 2022-02-02T15:09:07.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.118+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 msgr2=0x7fa954106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.118+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7fa9500026d0 tx=0x7fa950009de0).stop 2022-02-02T15:09:07.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 shutdown_connections 2022-02-02T15:09:07.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa940064e20 0x7fa9400672e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9540602b0 0x7fa954106ef0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 --2- 172.21.15.33:0/3353012268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540f9830 0x7fa9541073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 >> 172.21.15.33:0/3353012268 conn(0x7fa9540f0cd0 msgr2=0x7fa9540f30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:07.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 shutdown_connections 2022-02-02T15:09:07.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.119+0000 7fa95b4d0700 1 -- 172.21.15.33:0/3353012268 wait complete. 2022-02-02T15:09:07.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/971492191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f7980 msgr2=0x7fcc680f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/971492191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f7980 0x7fcc680f7de0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 rx=0x7fcc50004660 tx=0x7fcc50009b30).stop 2022-02-02T15:09:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/971492191 shutdown_connections 2022-02-02T15:09:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/971492191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f7980 0x7fcc680f7de0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/971492191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f66e0 0x7fcc680f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/971492191 >> 172.21.15.33:0/971492191 conn(0x7fcc680f1e40 msgr2=0x7fcc680f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:07.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/971492191 shutdown_connections 2022-02-02T15:09:07.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.220+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/971492191 wait complete. 2022-02-02T15:09:07.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 Processor -- start 2022-02-02T15:09:07.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 -- start start 2022-02-02T15:09:07.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:07.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f7980 0x7fcc68069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:07.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6806a380 con 0x7fcc680f66e0 2022-02-02T15:09:07.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6c9ce700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6806a4c0 con 0x7fcc680f7980 2022-02-02T15:09:07.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:07.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36200/0 (socket says 172.21.15.33:36200) 2022-02-02T15:09:07.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 -- 172.21.15.33:0/2555646976 learned_addr learned my addr 172.21.15.33:0/2555646976 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:07.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc65d9b700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f7980 0x7fcc68069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:07.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 -- 172.21.15.33:0/2555646976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f7980 msgr2=0x7fcc68069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f7980 0x7fcc68069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.221+0000 7fcc6659c700 1 -- 172.21.15.33:0/2555646976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc50005040 con 0x7fcc680f66e0 2022-02-02T15:09:07.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc6659c700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fcc5800c530 tx=0x7fcc58007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:07.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc5800f650 con 0x7fcc680f66e0 2022-02-02T15:09:07.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcc5800fc60 con 0x7fcc680f66e0 2022-02-02T15:09:07.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6806a7a0 con 0x7fcc680f66e0 2022-02-02T15:09:07.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc58012cb0 con 0x7fcc680f66e0 2022-02-02T15:09:07.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.222+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6810ef90 con 0x7fcc680f66e0 2022-02-02T15:09:07.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.223+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c004fa0 con 0x7fcc680f66e0 2022-02-02T15:09:07.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.223+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcc58019030 con 0x7fcc680f66e0 2022-02-02T15:09:07.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.224+0000 7fcc5effd700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 0x7fcc54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:07.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.224+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcc58081540 con 0x7fcc680f66e0 2022-02-02T15:09:07.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.224+0000 7fcc65d9b700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 0x7fcc54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:07.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.224+0000 7fcc65d9b700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 0x7fcc54067290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fcc50004630 tx=0x7fcc50009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:07.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.228+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcc580487d0 con 0x7fcc680f66e0 2022-02-02T15:09:07.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:06 smithi037 ceph-mon[69017]: pgmap v2711: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:07.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.440+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc4c005e80 con 0x7fcc680f66e0 2022-02-02T15:09:07.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.441+0000 7fcc5effd700 1 -- 172.21.15.33:0/2555646976 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fcc58017070 con 0x7fcc680f66e0 2022-02-02T15:09:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:09:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:09:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:09:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:09:07.435 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:07.435 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:09:07.435 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:09:07.435 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:09:07.435 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:09:07.436 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:09:07.436 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:09:07.436 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:09:07.436 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:09:07.437 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:09:07.437 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:09:07.437 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:09:07.437 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:09:07.437 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:09:07.438 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:09:07.438 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:09:07.438 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:09:07.438 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:09:07.438 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:09:07.439 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:09:07.439 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:09:07.439 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:09:07.439 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:09:07.439 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:09:07.440 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:09:07.440 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:09:07.440 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:09:07.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:07.441 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:07.441 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:09:07.441 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:07.441 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:07.441 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:07.442 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:07.442 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:07.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 msgr2=0x7fcc54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 0x7fcc54067290 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7fcc50004630 tx=0x7fcc50009b30).stop 2022-02-02T15:09:07.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 msgr2=0x7fcc6806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:07.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7fcc5800c530 tx=0x7fcc58007e10).stop 2022-02-02T15:09:07.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 shutdown_connections 2022-02-02T15:09:07.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcc54064dd0 0x7fcc54067290 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc680f66e0 0x7fcc6806b9a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 --2- 172.21.15.33:0/2555646976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc680f7980 0x7fcc68069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 >> 172.21.15.33:0/2555646976 conn(0x7fcc680f1e40 msgr2=0x7fcc680fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 shutdown_connections 2022-02-02T15:09:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:07.443+0000 7fcc6c9ce700 1 -- 172.21.15.33:0/2555646976 wait complete. 2022-02-02T15:09:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:09:08.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:07 smithi033 ceph-mon[101165]: from='client.36850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:08.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:07 smithi033 ceph-mon[101165]: from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:08.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3353012268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:09:08.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2555646976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:09:08.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:07 smithi037 ceph-mon[69017]: from='client.36850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:08.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:07 smithi037 ceph-mon[69017]: from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:08.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3353012268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:09:08.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2555646976' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:09:09.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:08 smithi033 ceph-mon[101165]: pgmap v2712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:09.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:08 smithi037 ceph-mon[69017]: pgmap v2712: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:10.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:09 smithi033 ceph-mon[101165]: pgmap v2713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:10.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:09 smithi037 ceph-mon[69017]: pgmap v2713: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:13.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:12 smithi037 ceph-mon[69017]: pgmap v2714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:13.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:12 smithi033 ceph-mon[101165]: pgmap v2714: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:15.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:14 smithi037 ceph-mon[69017]: pgmap v2715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:15.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:14 smithi033 ceph-mon[101165]: pgmap v2715: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:16.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:15 smithi033 ceph-mon[101165]: pgmap v2716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:16.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:15 smithi037 ceph-mon[69017]: pgmap v2716: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:19.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:18 smithi037 ceph-mon[69017]: pgmap v2717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:19.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:18 smithi033 ceph-mon[101165]: pgmap v2717: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:21.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:20 smithi033 ceph-mon[101165]: pgmap v2718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:21.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:20 smithi037 ceph-mon[69017]: pgmap v2718: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:23.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:22 smithi033 ceph-mon[101165]: pgmap v2719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:23.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:22 smithi037 ceph-mon[69017]: pgmap v2719: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:24.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:23 smithi033 ceph-mon[101165]: pgmap v2720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:24.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:23 smithi037 ceph-mon[69017]: pgmap v2720: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:26.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:26 smithi033 ceph-mon[101165]: pgmap v2721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:27.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:26 smithi037 ceph-mon[69017]: pgmap v2721: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:29.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:28 smithi033 ceph-mon[101165]: pgmap v2722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:29.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:28 smithi037 ceph-mon[69017]: pgmap v2722: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:31.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:30 smithi033 ceph-mon[101165]: pgmap v2723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:31.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:30 smithi037 ceph-mon[69017]: pgmap v2723: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:33.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:32 smithi033 ceph-mon[101165]: pgmap v2724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:33.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:32 smithi037 ceph-mon[69017]: pgmap v2724: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:34.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:33 smithi033 ceph-mon[101165]: pgmap v2725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:34.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:33 smithi037 ceph-mon[69017]: pgmap v2725: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:36.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:36 smithi033 ceph-mon[101165]: pgmap v2726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:37.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:36 smithi037 ceph-mon[69017]: pgmap v2726: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:37.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 -- 172.21.15.33:0/1675829433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 msgr2=0x7f35fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 --2- 172.21.15.33:0/1675829433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc0f6cc0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f35ec004660 tx=0x7f35ec009b30).stop 2022-02-02T15:09:37.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 -- 172.21.15.33:0/1675829433 shutdown_connections 2022-02-02T15:09:37.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 --2- 172.21.15.33:0/1675829433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc0f6cc0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.553 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 --2- 172.21.15.33:0/1675829433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 0x7f35fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 -- 172.21.15.33:0/1675829433 >> 172.21.15.33:0/1675829433 conn(0x7f35fc0f0d40 msgr2=0x7f35fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 -- 172.21.15.33:0/1675829433 shutdown_connections 2022-02-02T15:09:37.554 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.558+0000 7f3603e19700 1 -- 172.21.15.33:0/1675829433 wait complete. 2022-02-02T15:09:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 Processor -- start 2022-02-02T15:09:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 -- start start 2022-02-02T15:09:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 0x7f35fc109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.555 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc109c20 con 0x7f35fc0f6860 2022-02-02T15:09:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3603e19700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc109d60 con 0x7f35fc0f55c0 2022-02-02T15:09:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f36013b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f36013b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36212/0 (socket says 172.21.15.33:36212) 2022-02-02T15:09:37.556 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f36013b4700 1 -- 172.21.15.33:0/760695209 learned_addr learned my addr 172.21.15.33:0/760695209 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:37.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.559+0000 7f3601bb5700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 0x7f35fc109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f36013b4700 1 -- 172.21.15.33:0/760695209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 msgr2=0x7f35fc109180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f36013b4700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 0x7f35fc109180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f36013b4700 1 -- 172.21.15.33:0/760695209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec005040 con 0x7f35fc0f6860 2022-02-02T15:09:37.557 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f36013b4700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f35ec009990 tx=0x7f35ec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35ec018070 con 0x7f35fc0f6860 2022-02-02T15:09:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f35ec007ba0 con 0x7f35fc0f6860 2022-02-02T15:09:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc10a6a0 con 0x7f35fc0f6860 2022-02-02T15:09:37.558 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35ec01c3c0 con 0x7f35fc0f6860 2022-02-02T15:09:37.559 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.560+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc10ac00 con 0x7f35fc0f6860 2022-02-02T15:09:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.561+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc045ad0 con 0x7f35fc0f6860 2022-02-02T15:09:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.562+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f35ec01d420 con 0x7f35fc0f6860 2022-02-02T15:09:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.562+0000 7f35f27fc700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 0x7f35e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.562+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f35ec0836f0 con 0x7f35fc0f6860 2022-02-02T15:09:37.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.562+0000 7f3601bb5700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 0x7f35e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.563+0000 7f3601bb5700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 0x7f35e8067290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f35fc0f66c0 tx=0x7f35f800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:37.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.567+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f35ec055290 con 0x7f35fc0f6860 2022-02-02T15:09:37.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.751+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f35fc0faaa0 con 0x7f35e8064dd0 2022-02-02T15:09:37.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.753+0000 7f35f27fc700 1 -- 172.21.15.33:0/760695209 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f35fc0faaa0 con 0x7f35e8064dd0 2022-02-02T15:09:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 msgr2=0x7f35e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 0x7f35e8067290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f35fc0f66c0 tx=0x7f35f800b040).stop 2022-02-02T15:09:37.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 msgr2=0x7f35fc109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f35ec009990 tx=0x7f35ec009b30).stop 2022-02-02T15:09:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 shutdown_connections 2022-02-02T15:09:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f35e8064dd0 0x7f35e8067290 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35fc0f55c0 0x7f35fc109180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 --2- 172.21.15.33:0/760695209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35fc0f6860 0x7f35fc109670 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 >> 172.21.15.33:0/760695209 conn(0x7f35fc0f0d40 msgr2=0x7f35fc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 shutdown_connections 2022-02-02T15:09:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.755+0000 7f3603e19700 1 -- 172.21.15.33:0/760695209 wait complete. 2022-02-02T15:09:37.756 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:09:37.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 -- 172.21.15.33:0/983927494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 msgr2=0x7f371c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 --2- 172.21.15.33:0/983927494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f5850 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f3710004660 tx=0x7f3710009b30).stop 2022-02-02T15:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 -- 172.21.15.33:0/983927494 shutdown_connections 2022-02-02T15:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 --2- 172.21.15.33:0/983927494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 0x7f371c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 --2- 172.21.15.33:0/983927494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f5850 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.855+0000 7f3721c7a700 1 -- 172.21.15.33:0/983927494 >> 172.21.15.33:0/983927494 conn(0x7f371c0f0b90 msgr2=0x7f371c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.856+0000 7f3721c7a700 1 -- 172.21.15.33:0/983927494 shutdown_connections 2022-02-02T15:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.856+0000 7f3721c7a700 1 -- 172.21.15.33:0/983927494 wait complete. 2022-02-02T15:09:37.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.856+0000 7f3721c7a700 1 Processor -- start 2022-02-02T15:09:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.856+0000 7f3721c7a700 1 -- start start 2022-02-02T15:09:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3721c7a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3721c7a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 0x7f371c0f7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3721c7a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0f7f70 con 0x7f371c0f5430 2022-02-02T15:09:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3721c7a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371c0f80b0 con 0x7f371c0f66d0 2022-02-02T15:09:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36220/0 (socket says 172.21.15.33:36220) 2022-02-02T15:09:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 -- 172.21.15.33:0/3980587838 learned_addr learned my addr 172.21.15.33:0/3980587838 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f371bfff700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 0x7f371c0f7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 -- 172.21.15.33:0/3980587838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 msgr2=0x7f371c0f7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 0x7f371c0f7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:37.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 -- 172.21.15.33:0/3980587838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3710005040 con 0x7f371c0f5430 2022-02-02T15:09:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.857+0000 7f3720c78700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f3710013a70 tx=0x7f3710009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.858+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3710018070 con 0x7f371c0f5430 2022-02-02T15:09:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.858+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f371c0f8330 con 0x7f371c0f5430 2022-02-02T15:09:37.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.858+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f37100097d0 con 0x7f371c0f5430 2022-02-02T15:09:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.858+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f371001c3c0 con 0x7f371c0f5430 2022-02-02T15:09:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.858+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371c0f8890 con 0x7f371c0f5430 2022-02-02T15:09:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.859+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3710007ba0 con 0x7f371c0f5430 2022-02-02T15:09:37.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.859+0000 7f37197fa700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 0x7f370c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.859+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371c045ad0 con 0x7f371c0f5430 2022-02-02T15:09:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.860+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3710083790 con 0x7f371c0f5430 2022-02-02T15:09:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.860+0000 7f371bfff700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 0x7f370c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:37.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.860+0000 7f371bfff700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 0x7f370c0672e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f3708009760 tx=0x7f3708009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:37.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:37.864+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3710051900 con 0x7f371c0f5430 2022-02-02T15:09:38.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.049+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f371c0fab10 con 0x7f370c064e20 2022-02-02T15:09:38.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.064+0000 7f37197fa700 1 -- 172.21.15.33:0/3980587838 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f371c0fab10 con 0x7f370c064e20 2022-02-02T15:09:38.056 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:09:38.057 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (94m) 57m ago 95m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:09:38.057 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (87m) 57m ago 95m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:09:38.057 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (87m) 57m ago 95m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:09:38.057 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (94m) 57m ago 95m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:09:38.058 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (88m) 57m ago 92m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:09:38.058 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (89m) 57m ago 92m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:09:38.058 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (89m) 57m ago 92m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:09:38.058 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (92m) 57m ago 92m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:09:38.059 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (89m) 57m ago 97m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:09:38.059 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (89m) 57m ago 95m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:09:38.059 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (88m) 57m ago 97m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:09:38.059 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (88m) 57m ago 95m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:09:38.060 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (95m) 57m ago 95m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:09:38.060 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (95m) 57m ago 95m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:09:38.060 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 57m ago 94m - 4096M 2022-02-02T15:09:38.060 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (94m) 57m ago 94m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:09:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (94m) 57m ago 94m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:09:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (93m) 57m ago 93m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:09:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (93m) 57m ago 93m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:09:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (93m) 57m ago 93m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:09:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (94m) 57m ago 95m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:09:38.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 msgr2=0x7f370c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 0x7f370c0672e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f3708009760 tx=0x7f3708009c60).stop 2022-02-02T15:09:38.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 msgr2=0x7f371c0f9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7f3710013a70 tx=0x7f3710009b30).stop 2022-02-02T15:09:38.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 shutdown_connections 2022-02-02T15:09:38.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f370c064e20 0x7f370c0672e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f371c0f5430 0x7f371c0f9590 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 --2- 172.21.15.33:0/3980587838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f371c0f66d0 0x7f371c0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 >> 172.21.15.33:0/3980587838 conn(0x7f371c0f0b90 msgr2=0x7f371c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:38.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 shutdown_connections 2022-02-02T15:09:38.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.066+0000 7f3721c7a700 1 -- 172.21.15.33:0/3980587838 wait complete. 2022-02-02T15:09:38.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 -- 172.21.15.33:0/4050000486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 msgr2=0x7f44e00f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 --2- 172.21.15.33:0/4050000486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f7920 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f44d4004660 tx=0x7f44d4009b30).stop 2022-02-02T15:09:38.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 -- 172.21.15.33:0/4050000486 shutdown_connections 2022-02-02T15:09:38.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 --2- 172.21.15.33:0/4050000486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f7920 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 --2- 172.21.15.33:0/4050000486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 0x7f44e00f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.165+0000 7f44e48a9700 1 -- 172.21.15.33:0/4050000486 >> 172.21.15.33:0/4050000486 conn(0x7f44e00f0320 msgr2=0x7f44e00f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:38.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.166+0000 7f44e48a9700 1 -- 172.21.15.33:0/4050000486 shutdown_connections 2022-02-02T15:09:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.166+0000 7f44e48a9700 1 -- 172.21.15.33:0/4050000486 wait complete. 2022-02-02T15:09:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 Processor -- start 2022-02-02T15:09:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 -- start start 2022-02-02T15:09:38.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 0x7f44e00f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e010a9f0 con 0x7f44e00f51a0 2022-02-02T15:09:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44e48a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e010ab30 con 0x7f44e00f4800 2022-02-02T15:09:38.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44de59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44de59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36230/0 (socket says 172.21.15.33:36230) 2022-02-02T15:09:38.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44de59c700 1 -- 172.21.15.33:0/3822502263 learned_addr learned my addr 172.21.15.33:0/3822502263 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:38.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.167+0000 7f44ded9d700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 0x7f44e00f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44de59c700 1 -- 172.21.15.33:0/3822502263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 msgr2=0x7f44e00f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44de59c700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 0x7f44e00f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44de59c700 1 -- 172.21.15.33:0/3822502263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4005040 con 0x7f44e00f51a0 2022-02-02T15:09:38.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44de59c700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f44d4004f60 tx=0x7f44d4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d4018070 con 0x7f44e00f51a0 2022-02-02T15:09:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f44d4009770 con 0x7f44e00f51a0 2022-02-02T15:09:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e00f5d80 con 0x7f44e00f51a0 2022-02-02T15:09:38.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44d401c3c0 con 0x7f44e00f51a0 2022-02-02T15:09:38.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.168+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e00f62e0 con 0x7f44e00f51a0 2022-02-02T15:09:38.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.169+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e0045ad0 con 0x7f44e00f51a0 2022-02-02T15:09:38.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.170+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f44d401d420 con 0x7f44e00f51a0 2022-02-02T15:09:38.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.170+0000 7f44c77fe700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 0x7f44c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.170+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f44d40838d0 con 0x7f44e00f51a0 2022-02-02T15:09:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.170+0000 7f44ded9d700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 0x7f44c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.171+0000 7f44ded9d700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 0x7f44c80672e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f44e00f7140 tx=0x7f44d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:38.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.175+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f44d4051a40 con 0x7f44e00f51a0 2022-02-02T15:09:38.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.419+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f44e0027a00 con 0x7f44e00f51a0 2022-02-02T15:09:38.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.420+0000 7f44c77fe700 1 -- 172.21.15.33:0/3822502263 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f44d4055060 con 0x7f44e00f51a0 2022-02-02T15:09:38.412 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:09:38.413 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:09:38.413 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:09:38.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:38.413 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:09:38.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:09:38.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:38.414 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:09:38.414 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:09:38.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:38.415 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:09:38.415 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:09:38.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:09:38.415 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:09:38.416 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:09:38.416 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:09:38.416 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:09:38.416 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:09:38.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.421+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 msgr2=0x7f44c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.421+0000 7f44e48a9700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 0x7f44c80672e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f44e00f7140 tx=0x7f44d0009040).stop 2022-02-02T15:09:38.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.421+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 msgr2=0x7f44e00f5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.421+0000 7f44e48a9700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f44d4004f60 tx=0x7f44d4009b30).stop 2022-02-02T15:09:38.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 shutdown_connections 2022-02-02T15:09:38.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f44c8064e20 0x7f44c80672e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44e00f4800 0x7f44e00f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 --2- 172.21.15.33:0/3822502263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e00f51a0 0x7f44e00f5830 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 >> 172.21.15.33:0/3822502263 conn(0x7f44e00f0320 msgr2=0x7f44e00fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 shutdown_connections 2022-02-02T15:09:38.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.422+0000 7f44e48a9700 1 -- 172.21.15.33:0/3822502263 wait complete. 2022-02-02T15:09:38.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 -- 172.21.15.33:0/3046503236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f66d0 msgr2=0x7f07080f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 --2- 172.21.15.33:0/3046503236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f66d0 0x7f07080f6b30 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f06fc004660 tx=0x7f06fc009b30).stop 2022-02-02T15:09:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 -- 172.21.15.33:0/3046503236 shutdown_connections 2022-02-02T15:09:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 --2- 172.21.15.33:0/3046503236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f66d0 0x7f07080f6b30 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 --2- 172.21.15.33:0/3046503236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f5430 0x7f07080f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 -- 172.21.15.33:0/3046503236 >> 172.21.15.33:0/3046503236 conn(0x7f07080f0b90 msgr2=0x7f07080f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.522+0000 7f070f089700 1 -- 172.21.15.33:0/3046503236 shutdown_connections 2022-02-02T15:09:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.523+0000 7f070f089700 1 -- 172.21.15.33:0/3046503236 wait complete. 2022-02-02T15:09:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.523+0000 7f070f089700 1 Processor -- start 2022-02-02T15:09:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.523+0000 7f070f089700 1 -- start start 2022-02-02T15:09:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070f089700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f5430 0x7f0708109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070f089700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070f089700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07080603c0 con 0x7f07080f5430 2022-02-02T15:09:38.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070f089700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708060500 con 0x7f07080f66d0 2022-02-02T15:09:38.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.33:46958/0 (socket says 172.21.15.33:46958) 2022-02-02T15:09:38.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 -- 172.21.15.33:0/297915012 learned_addr learned my addr 172.21.15.33:0/297915012 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:09:38.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070e087700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f5430 0x7f0708109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 -- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f5430 msgr2=0x7f0708109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f5430 0x7f0708109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 -- 172.21.15.33:0/297915012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc005040 con 0x7f07080f66d0 2022-02-02T15:09:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.524+0000 7f070d886700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f06fc009990 tx=0x7f06fc009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.525+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06fc018070 con 0x7f07080f66d0 2022-02-02T15:09:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.525+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f06fc007ba0 con 0x7f07080f66d0 2022-02-02T15:09:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.525+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070810c490 con 0x7f07080f66d0 2022-02-02T15:09:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.525+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06fc01c3c0 con 0x7f07080f66d0 2022-02-02T15:09:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.525+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070810c9c0 con 0x7f07080f66d0 2022-02-02T15:09:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.526+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0708045ad0 con 0x7f07080f66d0 2022-02-02T15:09:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.526+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f06fc01d420 con 0x7f07080f66d0 2022-02-02T15:09:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.526+0000 7f06faffd700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 0x7f06f40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:09:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.527+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f06fc0837b0 con 0x7f07080f66d0 2022-02-02T15:09:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.527+0000 7f070e087700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 0x7f06f40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:09:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.527+0000 7f070e087700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 0x7f06f40672e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f0708060040 tx=0x7f070400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:09:38.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.531+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f06fc051860 con 0x7f07080f66d0 2022-02-02T15:09:38.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.743+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f07080fdcf0 con 0x7f07080f66d0 2022-02-02T15:09:38.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.744+0000 7f06faffd700 1 -- 172.21.15.33:0/297915012 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f06fc054e80 con 0x7f07080f66d0 2022-02-02T15:09:38.736 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:09:38.737 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:09:38.737 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:09:38.737 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:09:38.737 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:38.738 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:09:38.738 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:09:38.738 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:09:38.738 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:09:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:09:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:09:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:09:38.739 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:09:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:09:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:09:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:09:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:09:38.740 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:09:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:09:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:09:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:09:38.741 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:09:38.742 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:09:38.742 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:09:38.742 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:09:38.742 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:09:38.742 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:09:38.743 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:09:38.743 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:09:38.743 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:09:38.743 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:09:38.744 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:38.744 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:38.744 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:09:38.744 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:09:38.745 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:38.745 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:38.745 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:38.746 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:09:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 msgr2=0x7f06f40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 0x7f06f40672e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f0708060040 tx=0x7f070400b040).stop 2022-02-02T15:09:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 msgr2=0x7f070810bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:09:38.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f06fc009990 tx=0x7f06fc009b30).stop 2022-02-02T15:09:38.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 shutdown_connections 2022-02-02T15:09:38.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f06f4064e20 0x7f06f40672e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07080f5430 0x7f0708109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 --2- 172.21.15.33:0/297915012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07080f66d0 0x7f070810bf40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:09:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 >> 172.21.15.33:0/297915012 conn(0x7f07080f0b90 msgr2=0x7f07080fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:09:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 shutdown_connections 2022-02-02T15:09:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:09:38.746+0000 7f070f089700 1 -- 172.21.15.33:0/297915012 wait complete. 2022-02-02T15:09:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:09:39.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:38 smithi033 ceph-mon[101165]: pgmap v2727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:39.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:38 smithi033 ceph-mon[101165]: from='client.36866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:39.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3822502263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:09:39.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/297915012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:09:39.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:38 smithi037 ceph-mon[69017]: pgmap v2727: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:39.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:38 smithi037 ceph-mon[69017]: from='client.36866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:39.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3822502263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:09:39.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/297915012' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:09:40.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:39 smithi033 ceph-mon[101165]: from='client.36870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:40.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:39 smithi037 ceph-mon[69017]: from='client.36870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:09:41.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:40 smithi033 ceph-mon[101165]: pgmap v2728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:41.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:40 smithi037 ceph-mon[69017]: pgmap v2728: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:43.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:42 smithi033 ceph-mon[101165]: pgmap v2729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:43.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:42 smithi037 ceph-mon[69017]: pgmap v2729: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:44.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:43 smithi033 ceph-mon[101165]: pgmap v2730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:44.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:43 smithi037 ceph-mon[69017]: pgmap v2730: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:47.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:46 smithi037 ceph-mon[69017]: pgmap v2731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:47.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:46 smithi033 ceph-mon[101165]: pgmap v2731: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:49.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:48 smithi033 ceph-mon[101165]: pgmap v2732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:49.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:48 smithi037 ceph-mon[69017]: pgmap v2732: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:51.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:50 smithi033 ceph-mon[101165]: pgmap v2733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:51.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:50 smithi037 ceph-mon[69017]: pgmap v2733: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:53.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:52 smithi033 ceph-mon[101165]: pgmap v2734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:53.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:52 smithi037 ceph-mon[69017]: pgmap v2734: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:54 smithi033 ceph-mon[101165]: pgmap v2735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:55.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:09:55.234 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:09:55.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:54 smithi037 ceph-mon[69017]: pgmap v2735: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:55.285 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:09:55.285 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:09:56.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:55 smithi033 ceph-mon[101165]: pgmap v2736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:56.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:55 smithi037 ceph-mon[69017]: pgmap v2736: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:59.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:09:58 smithi033 ceph-mon[101165]: pgmap v2737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:09:59.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:09:58 smithi037 ceph-mon[69017]: pgmap v2737: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:00.482 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:00 smithi033 conmon[101141]: 2022-02-02T15:09:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:10:01.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:00 smithi033 ceph-mon[101165]: pgmap v2738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:01.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:10:01.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:00 smithi037 ceph-mon[69017]: pgmap v2738: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:01.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:10:03.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:02 smithi033 ceph-mon[101165]: pgmap v2739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:03.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:02 smithi037 ceph-mon[69017]: pgmap v2739: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:05.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:04 smithi033 ceph-mon[101165]: pgmap v2740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:05.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:04 smithi037 ceph-mon[69017]: pgmap v2740: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:06.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:05 smithi033 ceph-mon[101165]: pgmap v2741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:06.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:05 smithi037 ceph-mon[69017]: pgmap v2741: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.861+0000 7f1a5ff72700 1 -- 172.21.15.33:0/582469756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f6860 msgr2=0x7f1a580f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.861+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/582469756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f6860 0x7f1a580f6cc0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7f1a4c004660 tx=0x7f1a4c009b30).stop 2022-02-02T15:10:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 -- 172.21.15.33:0/582469756 shutdown_connections 2022-02-02T15:10:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/582469756 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f6860 0x7f1a580f6cc0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/582469756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f55c0 0x7f1a580f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 -- 172.21.15.33:0/582469756 >> 172.21.15.33:0/582469756 conn(0x7f1a580f0d40 msgr2=0x7f1a580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 -- 172.21.15.33:0/582469756 shutdown_connections 2022-02-02T15:10:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 -- 172.21.15.33:0/582469756 wait complete. 2022-02-02T15:10:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 Processor -- start 2022-02-02T15:10:08.856 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.862+0000 7f1a5ff72700 1 -- start start 2022-02-02T15:10:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f6860 0x7f1a58106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58106920 con 0x7f1a580f55c0 2022-02-02T15:10:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a58107130 con 0x7f1a580f6860 2022-02-02T15:10:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36250/0 (socket says 172.21.15.33:36250) 2022-02-02T15:10:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 -- 172.21.15.33:0/300715894 learned_addr learned my addr 172.21.15.33:0/300715894 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5d50d700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f6860 0x7f1a58106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 -- 172.21.15.33:0/300715894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f6860 msgr2=0x7f1a58106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f6860 0x7f1a58106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 -- 172.21.15.33:0/300715894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c005040 con 0x7f1a580f55c0 2022-02-02T15:10:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5dd0e700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f1a5400e7c0 tx=0x7f1a5400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:08.861 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a540092e0 con 0x7f1a580f55c0 2022-02-02T15:10:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1a5400f040 con 0x7f1a580f55c0 2022-02-02T15:10:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a58107350 con 0x7f1a580f55c0 2022-02-02T15:10:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a540147e0 con 0x7f1a580f55c0 2022-02-02T15:10:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.863+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a581078e0 con 0x7f1a580f55c0 2022-02-02T15:10:08.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.864+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a58045ad0 con 0x7f1a580f55c0 2022-02-02T15:10:08.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.865+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1a5401b030 con 0x7f1a580f55c0 2022-02-02T15:10:08.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.865+0000 7f1a4a7fc700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 0x7f1a44067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:08.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.865+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1a54081960 con 0x7f1a580f55c0 2022-02-02T15:10:08.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.866+0000 7f1a5d50d700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 0x7f1a44067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:08.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.866+0000 7f1a5d50d700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 0x7f1a44067290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f1a4c005010 tx=0x7f1a4c018040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:08.864 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:08.870+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1a5404fa10 con 0x7f1a580f55c0 2022-02-02T15:10:09.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.059+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a580ff800 con 0x7f1a44064dd0 2022-02-02T15:10:09.052 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:08 smithi033 ceph-mon[101165]: pgmap v2742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:09.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.061+0000 7f1a4a7fc700 1 -- 172.21.15.33:0/300715894 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1a580ff800 con 0x7f1a44064dd0 2022-02-02T15:10:09.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 msgr2=0x7f1a44067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 0x7f1a44067290 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f1a4c005010 tx=0x7f1a4c018040).stop 2022-02-02T15:10:09.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 msgr2=0x7f1a58105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7f1a5400e7c0 tx=0x7f1a5400b040).stop 2022-02-02T15:10:09.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 shutdown_connections 2022-02-02T15:10:09.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1a44064dd0 0x7f1a44067290 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a580f55c0 0x7f1a58105e30 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 --2- 172.21.15.33:0/300715894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a580f6860 0x7f1a58106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.062+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 >> 172.21.15.33:0/300715894 conn(0x7f1a580f0d40 msgr2=0x7f1a580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.063+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 shutdown_connections 2022-02-02T15:10:09.057 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.063+0000 7f1a5ff72700 1 -- 172.21.15.33:0/300715894 wait complete. 2022-02-02T15:10:09.064 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:10:09.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 -- 172.21.15.33:0/542576057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00602b0 msgr2=0x7f3ae00f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 --2- 172.21.15.33:0/542576057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00602b0 0x7f3ae00f9300 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7f3ad0004660 tx=0x7f3ad0009b30).stop 2022-02-02T15:10:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 -- 172.21.15.33:0/542576057 shutdown_connections 2022-02-02T15:10:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 --2- 172.21.15.33:0/542576057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00f9880 0x7f3ae00fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 --2- 172.21.15.33:0/542576057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00602b0 0x7f3ae00f9300 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 -- 172.21.15.33:0/542576057 >> 172.21.15.33:0/542576057 conn(0x7f3ae00f0d40 msgr2=0x7f3ae00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 -- 172.21.15.33:0/542576057 shutdown_connections 2022-02-02T15:10:09.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.163+0000 7f3ae6552700 1 -- 172.21.15.33:0/542576057 wait complete. 2022-02-02T15:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.164+0000 7f3ae6552700 1 Processor -- start 2022-02-02T15:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.164+0000 7f3ae6552700 1 -- start start 2022-02-02T15:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3ae6552700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00602b0 0x7f3ae01090b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3ae6552700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3ae6552700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0109b50 con 0x7f3ae00f9880 2022-02-02T15:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3ae6552700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae0109c90 con 0x7f3ae00602b0 2022-02-02T15:10:09.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36262/0 (socket says 172.21.15.33:36262) 2022-02-02T15:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 -- 172.21.15.33:0/1106246867 learned_addr learned my addr 172.21.15.33:0/1106246867 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adffff700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00602b0 0x7f3ae01090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 -- 172.21.15.33:0/1106246867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00602b0 msgr2=0x7f3ae01090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.162 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00602b0 0x7f3ae01090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 -- 172.21.15.33:0/1106246867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad0005040 con 0x7f3ae00f9880 2022-02-02T15:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adf7fe700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f3ad40026d0 tx=0x7f3ad4009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad40079c0 con 0x7f3ae00f9880 2022-02-02T15:10:09.163 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3ad400f040 con 0x7f3ae00f9880 2022-02-02T15:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.165+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae010a630 con 0x7f3ae00f9880 2022-02-02T15:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.166+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad4014850 con 0x7f3ae00f9880 2022-02-02T15:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.166+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae010abf0 con 0x7f3ae00f9880 2022-02-02T15:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.167+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0045ad0 con 0x7f3ae00f9880 2022-02-02T15:10:09.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.167+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3ad4007b20 con 0x7f3ae00f9880 2022-02-02T15:10:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.168+0000 7f3adcff9700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 0x7f3ac8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.168+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3ad4081990 con 0x7f3ae00f9880 2022-02-02T15:10:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.168+0000 7f3adffff700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 0x7f3ac8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.168+0000 7f3adffff700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 0x7f3ac8067290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f3ad0004630 tx=0x7f3ad0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.172+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3ad4053470 con 0x7f3ae00f9880 2022-02-02T15:10:09.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:08 smithi037 ceph-mon[69017]: pgmap v2742: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:09.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.353+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ae00f5820 con 0x7f3ac8064dd0 2022-02-02T15:10:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.368+0000 7f3adcff9700 1 -- 172.21.15.33:0/1106246867 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f3ae00f5820 con 0x7f3ac8064dd0 2022-02-02T15:10:09.360 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:10:09.361 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (95m) 57m ago 96m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:10:09.361 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (88m) 57m ago 96m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:10:09.361 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (88m) 57m ago 95m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:10:09.361 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (95m) 57m ago 96m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:10:09.362 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (88m) 57m ago 92m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:10:09.362 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (89m) 57m ago 92m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:10:09.362 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (90m) 57m ago 92m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:10:09.362 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (92m) 57m ago 92m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:10:09.363 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (90m) 57m ago 97m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:10:09.363 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (89m) 57m ago 95m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:10:09.363 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (89m) 57m ago 97m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:10:09.363 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (89m) 57m ago 95m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:10:09.363 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (96m) 57m ago 96m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:10:09.364 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (95m) 57m ago 95m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:10:09.364 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 57m ago 95m - 4096M 2022-02-02T15:10:09.364 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (94m) 57m ago 94m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:10:09.364 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (94m) 57m ago 94m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:10:09.365 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (94m) 57m ago 94m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:10:09.365 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (94m) 57m ago 94m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:10:09.365 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (93m) 57m ago 93m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:10:09.365 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (95m) 57m ago 96m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:10:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 msgr2=0x7f3ac8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 0x7f3ac8067290 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f3ad0004630 tx=0x7f3ad0009b30).stop 2022-02-02T15:10:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 msgr2=0x7f3ae01095a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f3ad40026d0 tx=0x7f3ad4009e00).stop 2022-02-02T15:10:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 shutdown_connections 2022-02-02T15:10:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3ac8064dd0 0x7f3ac8067290 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ae00602b0 0x7f3ae01090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 --2- 172.21.15.33:0/1106246867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ae00f9880 0x7f3ae01095a0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 >> 172.21.15.33:0/1106246867 conn(0x7f3ae00f0d40 msgr2=0x7f3ae00f5110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 shutdown_connections 2022-02-02T15:10:09.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.370+0000 7f3ae6552700 1 -- 172.21.15.33:0/1106246867 wait complete. 2022-02-02T15:10:09.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- 172.21.15.33:0/3180062331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 msgr2=0x7fb5400f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 --2- 172.21.15.33:0/3180062331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5400f7de0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7fb53c004660 tx=0x7fb53c009b30).stop 2022-02-02T15:10:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- 172.21.15.33:0/3180062331 shutdown_connections 2022-02-02T15:10:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 --2- 172.21.15.33:0/3180062331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5400f7de0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 --2- 172.21.15.33:0/3180062331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb5400f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- 172.21.15.33:0/3180062331 >> 172.21.15.33:0/3180062331 conn(0x7fb5400f1e40 msgr2=0x7fb5400f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- 172.21.15.33:0/3180062331 shutdown_connections 2022-02-02T15:10:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- 172.21.15.33:0/3180062331 wait complete. 2022-02-02T15:10:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 Processor -- start 2022-02-02T15:10:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.471+0000 7fb547b48700 1 -- start start 2022-02-02T15:10:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb547b48700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb540109100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb547b48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb547b48700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540109ba0 con 0x7fb5400f7980 2022-02-02T15:10:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb547b48700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb540109ce0 con 0x7fb5400f66e0 2022-02-02T15:10:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36272/0 (socket says 172.21.15.33:36272) 2022-02-02T15:10:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 -- 172.21.15.33:0/4136710955 learned_addr learned my addr 172.21.15.33:0/4136710955 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5458e4700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb540109100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 -- 172.21.15.33:0/4136710955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 msgr2=0x7fb540109100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb540109100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 -- 172.21.15.33:0/4136710955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c005040 con 0x7fb5400f7980 2022-02-02T15:10:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5458e4700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb540109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:10:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5450e3700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fb53c009990 tx=0x7fb53c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c018070 con 0x7fb5400f7980 2022-02-02T15:10:09.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54010a620 con 0x7fb5400f7980 2022-02-02T15:10:09.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.472+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb53c007ba0 con 0x7fb5400f7980 2022-02-02T15:10:09.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.473+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb53c01c3c0 con 0x7fb5400f7980 2022-02-02T15:10:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.473+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54010ab80 con 0x7fb5400f7980 2022-02-02T15:10:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.473+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb540045ad0 con 0x7fb5400f7980 2022-02-02T15:10:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.474+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb53c01d420 con 0x7fb5400f7980 2022-02-02T15:10:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.475+0000 7fb5367fc700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 0x7fb52c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.475+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb53c083930 con 0x7fb5400f7980 2022-02-02T15:10:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.475+0000 7fb5458e4700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 0x7fb52c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.475+0000 7fb5458e4700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 0x7fb52c067290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fb5400f77e0 tx=0x7fb530009c80).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.478+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb53c055430 con 0x7fb5400f7980 2022-02-02T15:10:09.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.724+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb540027a00 con 0x7fb5400f7980 2022-02-02T15:10:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.725+0000 7fb5367fc700 1 -- 172.21.15.33:0/4136710955 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb53c055020 con 0x7fb5400f7980 2022-02-02T15:10:09.717 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:10:09.717 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:10:09.717 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:10:09.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:09.718 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:10:09.718 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:10:09.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:09.719 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:10:09.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:10:09.719 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:09.719 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:10:09.719 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:10:09.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:09.720 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:10:09.720 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:10:09.720 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:10:09.721 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:10:09.721 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:10:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.727+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 msgr2=0x7fb52c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.727+0000 7fb547b48700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 0x7fb52c067290 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7fb5400f77e0 tx=0x7fb530009c80).stop 2022-02-02T15:10:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.727+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 msgr2=0x7fb5401095f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.727+0000 7fb547b48700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7fb53c009990 tx=0x7fb53c009b30).stop 2022-02-02T15:10:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 shutdown_connections 2022-02-02T15:10:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb52c064dd0 0x7fb52c067290 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5400f66e0 0x7fb540109100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 --2- 172.21.15.33:0/4136710955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb5400f7980 0x7fb5401095f0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 >> 172.21.15.33:0/4136710955 conn(0x7fb5400f1e40 msgr2=0x7fb54006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 shutdown_connections 2022-02-02T15:10:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.728+0000 7fb547b48700 1 -- 172.21.15.33:0/4136710955 wait complete. 2022-02-02T15:10:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 -- 172.21.15.33:0/758612569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f55c0 msgr2=0x7f2ac00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 --2- 172.21.15.33:0/758612569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f55c0 0x7f2ac00f59e0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f2ab0004660 tx=0x7f2ab0009b30).stop 2022-02-02T15:10:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 -- 172.21.15.33:0/758612569 shutdown_connections 2022-02-02T15:10:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 --2- 172.21.15.33:0/758612569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f6860 0x7f2ac00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 --2- 172.21.15.33:0/758612569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f55c0 0x7f2ac00f59e0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 -- 172.21.15.33:0/758612569 >> 172.21.15.33:0/758612569 conn(0x7f2ac00f0d40 msgr2=0x7f2ac00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 -- 172.21.15.33:0/758612569 shutdown_connections 2022-02-02T15:10:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.829+0000 7f2ac6365700 1 -- 172.21.15.33:0/758612569 wait complete. 2022-02-02T15:10:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 Processor -- start 2022-02-02T15:10:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 -- start start 2022-02-02T15:10:09.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 0x7f2ac0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0107a10 con 0x7f2ac00f6860 2022-02-02T15:10:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2ac6365700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0107b50 con 0x7f2ac00f55c0 2022-02-02T15:10:09.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2abf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2abf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36280/0 (socket says 172.21.15.33:36280) 2022-02-02T15:10:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.830+0000 7f2abf7fe700 1 -- 172.21.15.33:0/1760934406 learned_addr learned my addr 172.21.15.33:0/1760934406 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abffff700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 0x7f2ac0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abf7fe700 1 -- 172.21.15.33:0/1760934406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 msgr2=0x7f2ac0106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:09.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 0x7f2ac0106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:09.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abf7fe700 1 -- 172.21.15.33:0/1760934406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab0005040 con 0x7f2ac00f6860 2022-02-02T15:10:09.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abffff700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 0x7f2ac0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:10:09.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abf7fe700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f2ab400c530 tx=0x7f2ab4007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab400f650 con 0x7f2ac00f6860 2022-02-02T15:10:09.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ab400fc60 con 0x7f2ac00f6860 2022-02-02T15:10:09.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac01084f0 con 0x7f2ac00f6860 2022-02-02T15:10:09.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ab4012cd0 con 0x7f2ac00f6860 2022-02-02T15:10:09.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.831+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac0108ab0 con 0x7f2ac00f6860 2022-02-02T15:10:09.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.832+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac0045ad0 con 0x7f2ac00f6860 2022-02-02T15:10:09.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.833+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2ab4010070 con 0x7f2ac00f6860 2022-02-02T15:10:09.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.833+0000 7f2abcff9700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 0x7f2aa8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:09.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.833+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2ab40817d0 con 0x7f2ac00f6860 2022-02-02T15:10:09.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.833+0000 7f2abffff700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 0x7f2aa8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:09.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.833+0000 7f2abffff700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 0x7f2aa8067290 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f2ab0004e30 tx=0x7f2ab0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:09.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:09.837+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2ab40532b0 con 0x7f2ac00f6860 2022-02-02T15:10:09.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4136710955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:10:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.049+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2ac01090f0 con 0x7f2ac00f6860 2022-02-02T15:10:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.049+0000 7f2abcff9700 1 -- 172.21.15.33:0/1760934406 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2ab4052ea0 con 0x7f2ac00f6860 2022-02-02T15:10:10.042 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:10:10.042 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:10:10.043 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:10:10.043 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:10:10.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:10.043 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:10:10.044 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:10:10.044 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:10:10.044 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:10:10.044 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:10:10.044 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:10:10.045 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:10:10.045 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:10:10.045 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:10:10.045 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:10:10.046 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:10:10.046 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:10:10.046 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:10:10.046 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:10:10.046 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:10:10.047 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:10:10.047 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:10:10.047 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:10:10.047 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:10:10.048 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:10:10.048 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:10:10.048 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:10:10.048 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:10:10.048 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:10:10.049 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:10:10.049 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:10:10.049 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:10.049 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:10.049 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:10:10.050 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:10.050 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:10.050 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:10.050 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:10.051 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 msgr2=0x7f2aa8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 0x7f2aa8067290 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f2ab0004e30 tx=0x7f2ab0009b30).stop 2022-02-02T15:10:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 msgr2=0x7f2ac0107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f2ab400c530 tx=0x7f2ab4007e20).stop 2022-02-02T15:10:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 shutdown_connections 2022-02-02T15:10:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2aa8064dd0 0x7f2aa8067290 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac00f55c0 0x7f2ac0106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 --2- 172.21.15.33:0/1760934406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ac00f6860 0x7f2ac0107460 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 >> 172.21.15.33:0/1760934406 conn(0x7f2ac00f0d40 msgr2=0x7f2ac005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 shutdown_connections 2022-02-02T15:10:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:10.051+0000 7f2ac6365700 1 -- 172.21.15.33:0/1760934406 wait complete. 2022-02-02T15:10:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:10:10.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4136710955' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:10:11.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:10 smithi033 ceph-mon[101165]: from='client.36882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:11.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:10 smithi033 ceph-mon[101165]: from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:11.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:10 smithi033 ceph-mon[101165]: pgmap v2743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:11.233 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1760934406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:10:11.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:10 smithi037 ceph-mon[69017]: from='client.36882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:11.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:10 smithi037 ceph-mon[69017]: from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:11.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:10 smithi037 ceph-mon[69017]: pgmap v2743: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:11.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1760934406' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:10:13.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:12 smithi037 ceph-mon[69017]: pgmap v2744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:13.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:12 smithi033 ceph-mon[101165]: pgmap v2744: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:14.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:13 smithi033 ceph-mon[101165]: pgmap v2745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:14.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:13 smithi037 ceph-mon[69017]: pgmap v2745: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:17.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:16 smithi037 ceph-mon[69017]: pgmap v2746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:17.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:16 smithi033 ceph-mon[101165]: pgmap v2746: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:19.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:18 smithi033 ceph-mon[101165]: pgmap v2747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:19.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:18 smithi037 ceph-mon[69017]: pgmap v2747: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:20.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:19 smithi033 ceph-mon[101165]: pgmap v2748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:20.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:19 smithi037 ceph-mon[69017]: pgmap v2748: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:23.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:22 smithi033 ceph-mon[101165]: pgmap v2749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:23.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:22 smithi037 ceph-mon[69017]: pgmap v2749: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:24.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:23 smithi033 ceph-mon[101165]: pgmap v2750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:24.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:23 smithi037 ceph-mon[69017]: pgmap v2750: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:27.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:26 smithi037 ceph-mon[69017]: pgmap v2751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:27.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:26 smithi033 ceph-mon[101165]: pgmap v2751: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:28.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:27 smithi033 ceph-mon[101165]: pgmap v2752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:28.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:27 smithi037 ceph-mon[69017]: pgmap v2752: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:31.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:30 smithi037 ceph-mon[69017]: pgmap v2753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:31.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:30 smithi033 ceph-mon[101165]: pgmap v2753: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:32.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:32 smithi033 ceph-mon[101165]: pgmap v2754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:33.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:32 smithi037 ceph-mon[69017]: pgmap v2754: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:34.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:33 smithi033 ceph-mon[101165]: pgmap v2755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:34.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:33 smithi037 ceph-mon[69017]: pgmap v2755: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:37.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:36 smithi037 ceph-mon[69017]: pgmap v2756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:37.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:36 smithi033 ceph-mon[101165]: pgmap v2756: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:39.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:38 smithi033 ceph-mon[101165]: pgmap v2757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:39.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:38 smithi037 ceph-mon[69017]: pgmap v2757: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:40.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 -- 172.21.15.33:0/2858970766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f6860 msgr2=0x7f4a540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2858970766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f6860 0x7f4a540f6cc0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f4a48004660 tx=0x7f4a48009b30).stop 2022-02-02T15:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 -- 172.21.15.33:0/2858970766 shutdown_connections 2022-02-02T15:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2858970766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f6860 0x7f4a540f6cc0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2858970766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f55c0 0x7f4a540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 -- 172.21.15.33:0/2858970766 >> 172.21.15.33:0/2858970766 conn(0x7f4a540f0d40 msgr2=0x7f4a540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 -- 172.21.15.33:0/2858970766 shutdown_connections 2022-02-02T15:10:40.161 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.167+0000 7f4a5a074700 1 -- 172.21.15.33:0/2858970766 wait complete. 2022-02-02T15:10:40.161 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:39 smithi033 ceph-mon[101165]: pgmap v2758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.168+0000 7f4a5a074700 1 Processor -- start 2022-02-02T15:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.168+0000 7f4a5a074700 1 -- start start 2022-02-02T15:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.168+0000 7f4a5a074700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.164 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a5a074700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f6860 0x7f4a541063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a5a074700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a541069b0 con 0x7f4a540f55c0 2022-02-02T15:10:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a5a074700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a541071c0 con 0x7f4a540f6860 2022-02-02T15:10:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36288/0 (socket says 172.21.15.33:36288) 2022-02-02T15:10:40.165 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 -- 172.21.15.33:0/2697194395 learned_addr learned my addr 172.21.15.33:0/2697194395 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:40.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a52ffd700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f6860 0x7f4a541063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 -- 172.21.15.33:0/2697194395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f6860 msgr2=0x7f4a541063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f6860 0x7f4a541063b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 -- 172.21.15.33:0/2697194395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48005040 con 0x7f4a540f55c0 2022-02-02T15:10:40.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a537fe700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f4a4400d7f0 tx=0x7f4a44004e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.169+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a4400b4f0 con 0x7f4a540f55c0 2022-02-02T15:10:40.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.170+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a54107440 con 0x7f4a540f55c0 2022-02-02T15:10:40.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.170+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4a4400f040 con 0x7f4a540f55c0 2022-02-02T15:10:40.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.170+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a44013980 con 0x7f4a540f55c0 2022-02-02T15:10:40.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.170+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a54107a00 con 0x7f4a540f55c0 2022-02-02T15:10:40.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.171+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a540f49b0 con 0x7f4a540f55c0 2022-02-02T15:10:40.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.171+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4a4401a030 con 0x7f4a540f55c0 2022-02-02T15:10:40.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.171+0000 7f4a3bfff700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 0x7f4a3c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.172+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4a44081890 con 0x7f4a540f55c0 2022-02-02T15:10:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.172+0000 7f4a52ffd700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 0x7f4a3c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.172+0000 7f4a52ffd700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 0x7f4a3c067290 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f4a48004630 tx=0x7f4a48009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.170 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.176+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4a4404f940 con 0x7f4a540f55c0 2022-02-02T15:10:40.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:39 smithi037 ceph-mon[69017]: pgmap v2758: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.364+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a540008d0 con 0x7f4a3c064dd0 2022-02-02T15:10:40.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.366+0000 7f4a3bfff700 1 -- 172.21.15.33:0/2697194395 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4a540008d0 con 0x7f4a3c064dd0 2022-02-02T15:10:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 msgr2=0x7f4a3c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 0x7f4a3c067290 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f4a48004630 tx=0x7f4a48009b30).stop 2022-02-02T15:10:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 msgr2=0x7f4a54105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f4a4400d7f0 tx=0x7f4a44004e80).stop 2022-02-02T15:10:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 shutdown_connections 2022-02-02T15:10:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4a3c064dd0 0x7f4a3c067290 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4a540f55c0 0x7f4a54105ec0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 --2- 172.21.15.33:0/2697194395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a540f6860 0x7f4a541063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.367+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 >> 172.21.15.33:0/2697194395 conn(0x7f4a540f0d40 msgr2=0x7f4a540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.368+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 shutdown_connections 2022-02-02T15:10:40.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.368+0000 7f4a5a074700 1 -- 172.21.15.33:0/2697194395 wait complete. 2022-02-02T15:10:40.369 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 -- 172.21.15.33:0/636034189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 msgr2=0x7f23dc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 --2- 172.21.15.33:0/636034189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc0f6cc0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f23d8004660 tx=0x7f23d8009b30).stop 2022-02-02T15:10:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 -- 172.21.15.33:0/636034189 shutdown_connections 2022-02-02T15:10:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 --2- 172.21.15.33:0/636034189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc0f6cc0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 --2- 172.21.15.33:0/636034189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 0x7f23dc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 -- 172.21.15.33:0/636034189 >> 172.21.15.33:0/636034189 conn(0x7f23dc0f0d40 msgr2=0x7f23dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:40.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 -- 172.21.15.33:0/636034189 shutdown_connections 2022-02-02T15:10:40.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.468+0000 7f23e4193700 1 -- 172.21.15.33:0/636034189 wait complete. 2022-02-02T15:10:40.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 Processor -- start 2022-02-02T15:10:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 -- start start 2022-02-02T15:10:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 0x7f23dc105ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1069b0 con 0x7f23dc0f6860 2022-02-02T15:10:40.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e4193700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23dc1071c0 con 0x7f23dc0f55c0 2022-02-02T15:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36300/0 (socket says 172.21.15.33:36300) 2022-02-02T15:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 -- 172.21.15.33:0/4107663562 learned_addr learned my addr 172.21.15.33:0/4107663562 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e1f2f700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 0x7f23dc105ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 -- 172.21.15.33:0/4107663562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 msgr2=0x7f23dc105ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 0x7f23dc105ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.469+0000 7f23e172e700 1 -- 172.21.15.33:0/4107663562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8005040 con 0x7f23dc0f6860 2022-02-02T15:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23e172e700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f23d8009990 tx=0x7f23d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d801a070 con 0x7f23dc0f6860 2022-02-02T15:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23dc1073e0 con 0x7f23dc0f6860 2022-02-02T15:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23d8012a80 con 0x7f23dc0f6860 2022-02-02T15:10:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d801f870 con 0x7f23dc0f6860 2022-02-02T15:10:40.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.470+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23dc107940 con 0x7f23dc0f6860 2022-02-02T15:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.471+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23dc0f49b0 con 0x7f23dc0f6860 2022-02-02T15:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.471+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f23d8012bf0 con 0x7f23dc0f6860 2022-02-02T15:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.472+0000 7f23ce7fc700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 0x7f23c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.472+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f23d8085ca0 con 0x7f23dc0f6860 2022-02-02T15:10:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.472+0000 7f23e1f2f700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 0x7f23c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.472+0000 7f23e1f2f700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 0x7f23c8067290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f23dc105c30 tx=0x7f23d0009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.476+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f23d808a070 con 0x7f23dc0f6860 2022-02-02T15:10:40.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.660+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f23dc05f620 con 0x7f23c8064dd0 2022-02-02T15:10:40.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.674+0000 7f23ce7fc700 1 -- 172.21.15.33:0/4107663562 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f23dc05f620 con 0x7f23c8064dd0 2022-02-02T15:10:40.666 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:10:40.667 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (95m) 58m ago 96m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:10:40.667 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (89m) 58m ago 96m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:10:40.667 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (88m) 58m ago 96m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:10:40.667 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (95m) 58m ago 96m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:10:40.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (89m) 58m ago 93m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:10:40.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (90m) 58m ago 93m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:10:40.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (90m) 58m ago 93m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:10:40.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (93m) 58m ago 93m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:10:40.669 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (90m) 58m ago 98m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:10:40.669 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (90m) 58m ago 96m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:10:40.669 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (89m) 58m ago 98m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:10:40.669 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (89m) 58m ago 96m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:10:40.669 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (96m) 58m ago 96m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:10:40.670 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (96m) 58m ago 96m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:10:40.670 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 58m ago 95m - 4096M 2022-02-02T15:10:40.670 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (95m) 58m ago 95m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:10:40.670 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (95m) 58m ago 95m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:10:40.671 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (94m) 58m ago 94m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:10:40.671 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (94m) 58m ago 94m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:10:40.671 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (94m) 58m ago 94m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:10:40.671 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (95m) 58m ago 96m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:10:40.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 msgr2=0x7f23c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 0x7f23c8067290 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f23dc105c30 tx=0x7f23d0009040).stop 2022-02-02T15:10:40.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 msgr2=0x7f23dc1063b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f23d8009990 tx=0x7f23d8009b30).stop 2022-02-02T15:10:40.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 shutdown_connections 2022-02-02T15:10:40.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f23c8064dd0 0x7f23c8067290 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23dc0f55c0 0x7f23dc105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 --2- 172.21.15.33:0/4107663562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23dc0f6860 0x7f23dc1063b0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 >> 172.21.15.33:0/4107663562 conn(0x7f23dc0f0d40 msgr2=0x7f23dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:40.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 shutdown_connections 2022-02-02T15:10:40.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.676+0000 7f23e4193700 1 -- 172.21.15.33:0/4107663562 wait complete. 2022-02-02T15:10:40.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 -- 172.21.15.33:0/1391501040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 msgr2=0x7f5c800f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 --2- 172.21.15.33:0/1391501040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c800f6b30 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 rx=0x7f5c70004660 tx=0x7f5c70009b30).stop 2022-02-02T15:10:40.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 -- 172.21.15.33:0/1391501040 shutdown_connections 2022-02-02T15:10:40.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 --2- 172.21.15.33:0/1391501040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c800f6b30 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 --2- 172.21.15.33:0/1391501040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 0x7f5c800f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 -- 172.21.15.33:0/1391501040 >> 172.21.15.33:0/1391501040 conn(0x7f5c800f0b90 msgr2=0x7f5c800f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 -- 172.21.15.33:0/1391501040 shutdown_connections 2022-02-02T15:10:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.776+0000 7f5c86d78700 1 -- 172.21.15.33:0/1391501040 wait complete. 2022-02-02T15:10:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 Processor -- start 2022-02-02T15:10:40.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 -- start start 2022-02-02T15:10:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 0x7f5c80109a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800603e0 con 0x7f5c800f66d0 2022-02-02T15:10:40.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c86d78700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80060520 con 0x7f5c800f5430 2022-02-02T15:10:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c85575700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c85575700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36310/0 (socket says 172.21.15.33:36310) 2022-02-02T15:10:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c85575700 1 -- 172.21.15.33:0/279799699 learned_addr learned my addr 172.21.15.33:0/279799699 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.777+0000 7f5c85d76700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 0x7f5c80109a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c85575700 1 -- 172.21.15.33:0/279799699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 msgr2=0x7f5c80109a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c85575700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 0x7f5c80109a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c85575700 1 -- 172.21.15.33:0/279799699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c70005040 con 0x7f5c800f66d0 2022-02-02T15:10:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c85575700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f5c70009990 tx=0x7f5c70009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c70018070 con 0x7f5c800f66d0 2022-02-02T15:10:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f5c70007ba0 con 0x7f5c800f66d0 2022-02-02T15:10:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8010c470 con 0x7f5c800f66d0 2022-02-02T15:10:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c7001c620 con 0x7f5c800f66d0 2022-02-02T15:10:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.778+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8010c9d0 con 0x7f5c800f66d0 2022-02-02T15:10:40.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.779+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80045ad0 con 0x7f5c800f66d0 2022-02-02T15:10:40.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.779+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f5c7001c890 con 0x7f5c800f66d0 2022-02-02T15:10:40.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.780+0000 7f5c767fc700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 0x7f5c6c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:40.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.780+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f5c70083810 con 0x7f5c800f66d0 2022-02-02T15:10:40.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.780+0000 7f5c85d76700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 0x7f5c6c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:40.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.780+0000 7f5c85d76700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 0x7f5c6c0672e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c80060060 tx=0x7f5c7c009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:40.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:40.784+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f5c700518c0 con 0x7f5c800f66d0 2022-02-02T15:10:41.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.027+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c80027a00 con 0x7f5c800f66d0 2022-02-02T15:10:41.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:40 smithi033 ceph-mon[101165]: from='client.36898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:41.019 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:40 smithi033 ceph-mon[101165]: from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:41.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.028+0000 7f5c767fc700 1 -- 172.21.15.33:0/279799699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f5c70054ee0 con 0x7f5c800f66d0 2022-02-02T15:10:41.020 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:10:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:10:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:10:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:10:41.021 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:10:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:10:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:10:41.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:10:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:10:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:10:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:10:41.023 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:10:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:10:41.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:10:41.024 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:10:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 msgr2=0x7f5c6c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 0x7f5c6c0672e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f5c80060060 tx=0x7f5c7c009040).stop 2022-02-02T15:10:41.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 msgr2=0x7f5c8010bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 rx=0x7f5c70009990 tx=0x7f5c70009b30).stop 2022-02-02T15:10:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 shutdown_connections 2022-02-02T15:10:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f5c6c064e20 0x7f5c6c0672e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.026 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c800f5430 0x7f5c80109a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 --2- 172.21.15.33:0/279799699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c800f66d0 0x7f5c8010bf20 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 >> 172.21.15.33:0/279799699 conn(0x7f5c800f0b90 msgr2=0x7f5c800fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 shutdown_connections 2022-02-02T15:10:41.027 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.030+0000 7f5c86d78700 1 -- 172.21.15.33:0/279799699 wait complete. 2022-02-02T15:10:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- 172.21.15.33:0/1809052973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f6860 msgr2=0x7f44a00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 --2- 172.21.15.33:0/1809052973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f6860 0x7f44a00f6cc0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 rx=0x7f4490004660 tx=0x7f4490009b30).stop 2022-02-02T15:10:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- 172.21.15.33:0/1809052973 shutdown_connections 2022-02-02T15:10:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 --2- 172.21.15.33:0/1809052973 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f6860 0x7f44a00f6cc0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 --2- 172.21.15.33:0/1809052973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f55c0 0x7f44a00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- 172.21.15.33:0/1809052973 >> 172.21.15.33:0/1809052973 conn(0x7f44a00f0d40 msgr2=0x7f44a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:41.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- 172.21.15.33:0/1809052973 shutdown_connections 2022-02-02T15:10:41.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- 172.21.15.33:0/1809052973 wait complete. 2022-02-02T15:10:41.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 Processor -- start 2022-02-02T15:10:41.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.131+0000 7f44a4c58700 1 -- start start 2022-02-02T15:10:41.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f44a4c58700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:41.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f44a4c58700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f6860 0x7f44a00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:41.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f44a4c58700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00f8100 con 0x7f44a00f55c0 2022-02-02T15:10:41.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f44a4c58700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00f8240 con 0x7f44a00f6860 2022-02-02T15:10:41.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:41.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36318/0 (socket says 172.21.15.33:36318) 2022-02-02T15:10:41.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 -- 172.21.15.33:0/2094858552 learned_addr learned my addr 172.21.15.33:0/2094858552 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:10:41.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f6860 0x7f44a00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:41.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 -- 172.21.15.33:0/2094858552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f6860 msgr2=0x7f44a00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f6860 0x7f44a00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 -- 172.21.15.33:0/2094858552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490005040 con 0x7f44a00f55c0 2022-02-02T15:10:41.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f449e59c700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f4494002700 tx=0x7f4494009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:41.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44940079c0 con 0x7f44a00f55c0 2022-02-02T15:10:41.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.132+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f449400f040 con 0x7f44a00f55c0 2022-02-02T15:10:41.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.133+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a00f8520 con 0x7f44a00f55c0 2022-02-02T15:10:41.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.133+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4494014850 con 0x7f44a00f55c0 2022-02-02T15:10:41.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.133+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a010ef20 con 0x7f44a00f55c0 2022-02-02T15:10:41.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.133+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a0045ad0 con 0x7f44a00f55c0 2022-02-02T15:10:41.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.134+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f449401b060 con 0x7f44a00f55c0 2022-02-02T15:10:41.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.134+0000 7f448effd700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 0x7f4488067360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:10:41.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.134+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f44940817e0 con 0x7f44a00f55c0 2022-02-02T15:10:41.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.134+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 0x7f4488067360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:10:41.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.135+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 0x7f4488067360 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f4490004630 tx=0x7f4490009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:10:41.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.139+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f449404f9d0 con 0x7f44a00f55c0 2022-02-02T15:10:41.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:40 smithi037 ceph-mon[69017]: from='client.36898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:41.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:40 smithi037 ceph-mon[69017]: from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:10:41.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.352+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f44a010f6a0 con 0x7f44a00f55c0 2022-02-02T15:10:41.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.352+0000 7f448effd700 1 -- 172.21.15.33:0/2094858552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f4494019750 con 0x7f44a00f55c0 2022-02-02T15:10:41.345 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:10:41.345 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:10:41.345 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:10:41.345 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:10:41.346 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:41.346 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:10:41.346 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:10:41.346 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:10:41.346 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:10:41.347 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:10:41.347 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:10:41.347 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:10:41.347 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:10:41.348 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:10:41.348 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:10:41.348 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:10:41.349 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:10:41.349 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:10:41.349 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:10:41.349 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:10:41.350 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:10:41.350 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:10:41.350 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:10:41.350 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:10:41.350 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:10:41.351 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:10:41.351 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:10:41.351 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:10:41.351 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:10:41.352 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:10:41.352 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:10:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:41.352 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:41.352 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:10:41.353 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:10:41.353 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:41.353 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:41.353 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:41.354 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:10:41.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 msgr2=0x7f4488067360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 0x7f4488067360 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7f4490004630 tx=0x7f4490009b30).stop 2022-02-02T15:10:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 msgr2=0x7f44a00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:10:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f4494002700 tx=0x7f4494009e00).stop 2022-02-02T15:10:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 shutdown_connections 2022-02-02T15:10:41.356 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4488064ea0 0x7f4488067360 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00f55c0 0x7f44a00f9720 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 --2- 172.21.15.33:0/2094858552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44a00f6860 0x7f44a00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:10:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 >> 172.21.15.33:0/2094858552 conn(0x7f44a00f0d40 msgr2=0x7f44a005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:10:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 shutdown_connections 2022-02-02T15:10:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:10:41.356+0000 7f44a4c58700 1 -- 172.21.15.33:0/2094858552 wait complete. 2022-02-02T15:10:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:10:42.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/279799699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:10:42.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:41 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2094858552' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:10:42.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:41 smithi033 ceph-mon[101165]: pgmap v2759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:42.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/279799699' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:10:42.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:41 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2094858552' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:10:42.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:41 smithi037 ceph-mon[69017]: pgmap v2759: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:45.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:44 smithi037 ceph-mon[69017]: pgmap v2760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:45.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:44 smithi033 ceph-mon[101165]: pgmap v2760: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:47.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:46 smithi037 ceph-mon[69017]: pgmap v2761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:47.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:46 smithi033 ceph-mon[101165]: pgmap v2761: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:49.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:48 smithi033 ceph-mon[101165]: pgmap v2762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:49.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:48 smithi037 ceph-mon[69017]: pgmap v2762: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:50.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:49 smithi033 ceph-mon[101165]: pgmap v2763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:50.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:49 smithi037 ceph-mon[69017]: pgmap v2763: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:53.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:52 smithi033 ceph-mon[101165]: pgmap v2764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:53.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:52 smithi037 ceph-mon[69017]: pgmap v2764: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:54.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:53 smithi033 ceph-mon[101165]: pgmap v2765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:54.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:53 smithi037 ceph-mon[69017]: pgmap v2765: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:10:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:10:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:10:55.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:10:56.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:55 smithi033 ceph-mon[101165]: pgmap v2766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:56.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:55 smithi037 ceph-mon[69017]: pgmap v2766: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:58.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:10:57 smithi033 ceph-mon[101165]: pgmap v2767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:10:58.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:10:57 smithi037 ceph-mon[69017]: pgmap v2767: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:01.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:00 smithi037 ceph-mon[69017]: pgmap v2768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:01.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:00 smithi033 ceph-mon[101165]: pgmap v2768: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:03.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:02 smithi033 ceph-mon[101165]: pgmap v2769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:03.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:02 smithi037 ceph-mon[69017]: pgmap v2769: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:04.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:03 smithi033 ceph-mon[101165]: pgmap v2770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:04.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:03 smithi037 ceph-mon[69017]: pgmap v2770: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:07.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:06 smithi037 ceph-mon[69017]: pgmap v2771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:07.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:06 smithi033 ceph-mon[101165]: pgmap v2771: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:08.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:07 smithi033 ceph-mon[101165]: pgmap v2772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:08.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:07 smithi037 ceph-mon[69017]: pgmap v2772: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:11.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:10 smithi037 ceph-mon[69017]: pgmap v2773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:11.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:10 smithi033 ceph-mon[101165]: pgmap v2773: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 -- 172.21.15.33:0/2870482763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f66d0 msgr2=0x7f83b40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 --2- 172.21.15.33:0/2870482763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f66d0 0x7f83b40f6b30 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f83a8004660 tx=0x7f83a8009b30).stop 2022-02-02T15:11:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 -- 172.21.15.33:0/2870482763 shutdown_connections 2022-02-02T15:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 --2- 172.21.15.33:0/2870482763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f66d0 0x7f83b40f6b30 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 --2- 172.21.15.33:0/2870482763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f5430 0x7f83b40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 -- 172.21.15.33:0/2870482763 >> 172.21.15.33:0/2870482763 conn(0x7f83b40f0b90 msgr2=0x7f83b40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 -- 172.21.15.33:0/2870482763 shutdown_connections 2022-02-02T15:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 -- 172.21.15.33:0/2870482763 wait complete. 2022-02-02T15:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.471+0000 7f83b359e700 1 Processor -- start 2022-02-02T15:11:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b359e700 1 -- start start 2022-02-02T15:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f66d0 0x7f83b40f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40f8790 con 0x7f83b40f5430 2022-02-02T15:11:11.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40f88d0 con 0x7f83b40f66d0 2022-02-02T15:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36350/0 (socket says 172.21.15.33:36350) 2022-02-02T15:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 -- 172.21.15.33:0/1557115137 learned_addr learned my addr 172.21.15.33:0/1557115137 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b1d9b700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f66d0 0x7f83b40f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 -- 172.21.15.33:0/1557115137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f66d0 msgr2=0x7f83b40f8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f66d0 0x7f83b40f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 -- 172.21.15.33:0/1557115137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a8005040 con 0x7f83b40f5430 2022-02-02T15:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.472+0000 7f83b259c700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f83a400e7c0 tx=0x7f83a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:11.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.473+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a40092e0 con 0x7f83b40f5430 2022-02-02T15:11:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.473+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83a400f040 con 0x7f83b40f5430 2022-02-02T15:11:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.473+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40f8bb0 con 0x7f83b40f5430 2022-02-02T15:11:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.473+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83a4014750 con 0x7f83b40f5430 2022-02-02T15:11:11.471 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.473+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b410ed00 con 0x7f83b40f5430 2022-02-02T15:11:11.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.474+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4045ad0 con 0x7f83b40f5430 2022-02-02T15:11:11.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.474+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83a401b030 con 0x7f83b40f5430 2022-02-02T15:11:11.474 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.474+0000 7f83a2ffd700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 0x7f839c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.475+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f83a4081ab0 con 0x7f83b40f5430 2022-02-02T15:11:11.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.475+0000 7f83b1d9b700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 0x7f839c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.475 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.475+0000 7f83b1d9b700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 0x7f839c0672e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f83a80043d0 tx=0x7f83a800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:11.476 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.479+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83a404fb00 con 0x7f83b40f5430 2022-02-02T15:11:11.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.671+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83b405fd30 con 0x7f839c064e20 2022-02-02T15:11:11.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.672+0000 7f83a2ffd700 1 -- 172.21.15.33:0/1557115137 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f83b405fd30 con 0x7f839c064e20 2022-02-02T15:11:11.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 msgr2=0x7f839c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 0x7f839c0672e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f83a80043d0 tx=0x7f83a800b040).stop 2022-02-02T15:11:11.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 msgr2=0x7f83b40f9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f83a400e7c0 tx=0x7f83a400b040).stop 2022-02-02T15:11:11.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 shutdown_connections 2022-02-02T15:11:11.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f839c064e20 0x7f839c0672e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83b40f5430 0x7f83b40f9db0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 --2- 172.21.15.33:0/1557115137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b40f66d0 0x7f83b40f8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 >> 172.21.15.33:0/1557115137 conn(0x7f83b40f0b90 msgr2=0x7f83b405f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 shutdown_connections 2022-02-02T15:11:11.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.674+0000 7f83b359e700 1 -- 172.21.15.33:0/1557115137 wait complete. 2022-02-02T15:11:11.675 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:11:11.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/1825760224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f66d0 msgr2=0x7f8ec40f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/1825760224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f66d0 0x7f8ec40f6b30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f8eb8004660 tx=0x7f8eb8009b30).stop 2022-02-02T15:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/1825760224 shutdown_connections 2022-02-02T15:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/1825760224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f66d0 0x7f8ec40f6b30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/1825760224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f5430 0x7f8ec40f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/1825760224 >> 172.21.15.33:0/1825760224 conn(0x7f8ec40f0b90 msgr2=0x7f8ec40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/1825760224 shutdown_connections 2022-02-02T15:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.775+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/1825760224 wait complete. 2022-02-02T15:11:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 Processor -- start 2022-02-02T15:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 -- start start 2022-02-02T15:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f66d0 0x7f8ec4109430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec41099e0 con 0x7f8ec40f5430 2022-02-02T15:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec8b0e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4109b20 con 0x7f8ec40f66d0 2022-02-02T15:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.776+0000 7f8ec37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36360/0 (socket says 172.21.15.33:36360) 2022-02-02T15:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 -- 172.21.15.33:0/2703170676 learned_addr learned my addr 172.21.15.33:0/2703170676 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec2ffd700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f66d0 0x7f8ec4109430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 -- 172.21.15.33:0/2703170676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f66d0 msgr2=0x7f8ec4109430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f66d0 0x7f8ec4109430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 -- 172.21.15.33:0/2703170676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8005040 con 0x7f8ec40f5430 2022-02-02T15:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec37fe700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f8eb4002700 tx=0x7f8eb4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb40079c0 con 0x7f8ec40f5430 2022-02-02T15:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8eb400f040 con 0x7f8ec40f5430 2022-02-02T15:11:11.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec410a4c0 con 0x7f8ec40f5430 2022-02-02T15:11:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb4014860 con 0x7f8ec40f5430 2022-02-02T15:11:11.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.777+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec410aa80 con 0x7f8ec40f5430 2022-02-02T15:11:11.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.778+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4045ad0 con 0x7f8ec40f5430 2022-02-02T15:11:11.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.779+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8eb401b060 con 0x7f8ec40f5430 2022-02-02T15:11:11.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.779+0000 7f8eabfff700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 0x7f8eac0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:11.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.779+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8eb4081930 con 0x7f8ec40f5430 2022-02-02T15:11:11.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.779+0000 7f8ec2ffd700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 0x7f8eac0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:11.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.780+0000 7f8ec2ffd700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 0x7f8eac0672e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f8eb8004630 tx=0x7f8eb8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:11.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.783+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8eb4053410 con 0x7f8ec40f5430 2022-02-02T15:11:11.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.967+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ec40fa910 con 0x7f8eac064e20 2022-02-02T15:11:11.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.981+0000 7f8eabfff700 1 -- 172.21.15.33:0/2703170676 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f8ec40fa910 con 0x7f8eac064e20 2022-02-02T15:11:11.973 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:11:11.973 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (96m) 58m ago 97m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:11:11.974 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (89m) 58m ago 97m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:11:11.974 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (89m) 58m ago 96m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:11:11.974 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (96m) 58m ago 97m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:11:11.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (90m) 58m ago 93m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:11:11.974 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (90m) 58m ago 93m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:11:11.975 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (91m) 58m ago 93m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:11:11.975 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (93m) 58m ago 93m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:11:11.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (91m) 58m ago 98m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:11:11.975 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (90m) 58m ago 96m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:11:11.976 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (90m) 58m ago 98m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:11:11.976 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (90m) 58m ago 96m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:11:11.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (97m) 58m ago 97m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:11:11.976 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (96m) 58m ago 96m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:11:11.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 58m ago 96m - 4096M 2022-02-02T15:11:11.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (95m) 58m ago 95m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:11:11.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (95m) 58m ago 95m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:11:11.977 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (95m) 58m ago 95m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:11:11.978 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (95m) 58m ago 95m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:11:11.978 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (94m) 58m ago 94m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:11:11.978 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (96m) 58m ago 97m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:11:11.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 msgr2=0x7f8eac0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 0x7f8eac0672e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f8eb8004630 tx=0x7f8eb8009b30).stop 2022-02-02T15:11:11.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 msgr2=0x7f8ec4108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:11.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f8eb4002700 tx=0x7f8eb4009d80).stop 2022-02-02T15:11:11.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 shutdown_connections 2022-02-02T15:11:11.980 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eac064e20 0x7f8eac0672e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f5430 0x7f8ec4108f40 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 --2- 172.21.15.33:0/2703170676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f66d0 0x7f8ec4109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:11.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 >> 172.21.15.33:0/2703170676 conn(0x7f8ec40f0b90 msgr2=0x7f8ec405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:11.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 shutdown_connections 2022-02-02T15:11:11.981 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:11.984+0000 7f8ec8b0e700 1 -- 172.21.15.33:0/2703170676 wait complete. 2022-02-02T15:11:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 -- 172.21.15.33:0/605865094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 msgr2=0x7f230c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 --2- 172.21.15.33:0/605865094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c0f59e0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f2300004660 tx=0x7f2300009b30).stop 2022-02-02T15:11:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 -- 172.21.15.33:0/605865094 shutdown_connections 2022-02-02T15:11:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 --2- 172.21.15.33:0/605865094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 0x7f230c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 --2- 172.21.15.33:0/605865094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c0f59e0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 -- 172.21.15.33:0/605865094 >> 172.21.15.33:0/605865094 conn(0x7f230c0f0d40 msgr2=0x7f230c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 -- 172.21.15.33:0/605865094 shutdown_connections 2022-02-02T15:11:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.084+0000 7f2312d47700 1 -- 172.21.15.33:0/605865094 wait complete. 2022-02-02T15:11:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 Processor -- start 2022-02-02T15:11:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 -- start start 2022-02-02T15:11:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 0x7f230c107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1079c0 con 0x7f230c0f55c0 2022-02-02T15:11:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2312d47700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c107b00 con 0x7f230c0f6860 2022-02-02T15:11:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2310ae3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2310ae3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36370/0 (socket says 172.21.15.33:36370) 2022-02-02T15:11:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.085+0000 7f2310ae3700 1 -- 172.21.15.33:0/2201089482 learned_addr learned my addr 172.21.15.33:0/2201089482 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f230bfff700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 0x7f230c107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2310ae3700 1 -- 172.21.15.33:0/2201089482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 msgr2=0x7f230c107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2310ae3700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 0x7f230c107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2310ae3700 1 -- 172.21.15.33:0/2201089482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300005040 con 0x7f230c0f55c0 2022-02-02T15:11:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2310ae3700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f2300013a70 tx=0x7f2300009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2300018070 con 0x7f230c0f55c0 2022-02-02T15:11:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f23000097d0 con 0x7f230c0f55c0 2022-02-02T15:11:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230001de80 con 0x7f230c0f55c0 2022-02-02T15:11:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c108440 con 0x7f230c0f55c0 2022-02-02T15:11:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.086+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c108950 con 0x7f230c0f55c0 2022-02-02T15:11:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.087+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230c045ad0 con 0x7f230c0f55c0 2022-02-02T15:11:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.088+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2300007ba0 con 0x7f230c0f55c0 2022-02-02T15:11:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.089+0000 7f23097fa700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 0x7f22fc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.089+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f23000836b0 con 0x7f230c0f55c0 2022-02-02T15:11:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.089+0000 7f230bfff700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 0x7f22fc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.090+0000 7f230bfff700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 0x7f22fc067290 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f22f8004ce0 tx=0x7f22f800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.093+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2300055190 con 0x7f230c0f55c0 2022-02-02T15:11:12.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.337+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f230c0fdf10 con 0x7f230c0f55c0 2022-02-02T15:11:12.330 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.338+0000 7f23097fa700 1 -- 172.21.15.33:0/2201089482 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f230c0fdf10 con 0x7f230c0f55c0 2022-02-02T15:11:12.330 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:11:12.330 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:11:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:11:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:11:12.331 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:11:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:11:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:11:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:12.332 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:11:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:11:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:11:12.333 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:11:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:11:12.334 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:11:12.334 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:11:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.340+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 msgr2=0x7f22fc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.340+0000 7f2312d47700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 0x7f22fc067290 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f22f8004ce0 tx=0x7f22f800b040).stop 2022-02-02T15:11:12.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.340+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 msgr2=0x7f230c106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.340+0000 7f2312d47700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7f2300013a70 tx=0x7f2300009b30).stop 2022-02-02T15:11:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 shutdown_connections 2022-02-02T15:11:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f22fc064dd0 0x7f22fc067290 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230c0f55c0 0x7f230c106f20 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 --2- 172.21.15.33:0/2201089482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f230c0f6860 0x7f230c107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 >> 172.21.15.33:0/2201089482 conn(0x7f230c0f0d40 msgr2=0x7f230c05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 shutdown_connections 2022-02-02T15:11:12.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.341+0000 7f2312d47700 1 -- 172.21.15.33:0/2201089482 wait complete. 2022-02-02T15:11:12.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 -- 172.21.15.33:0/4174424419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 msgr2=0x7fc45c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 --2- 172.21.15.33:0/4174424419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f6cc0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7fc450004660 tx=0x7fc450009b30).stop 2022-02-02T15:11:12.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 -- 172.21.15.33:0/4174424419 shutdown_connections 2022-02-02T15:11:12.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 --2- 172.21.15.33:0/4174424419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f6cc0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 --2- 172.21.15.33:0/4174424419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.442+0000 7fc461225700 1 -- 172.21.15.33:0/4174424419 >> 172.21.15.33:0/4174424419 conn(0x7fc45c0f0d40 msgr2=0x7fc45c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:12.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 -- 172.21.15.33:0/4174424419 shutdown_connections 2022-02-02T15:11:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 -- 172.21.15.33:0/4174424419 wait complete. 2022-02-02T15:11:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 Processor -- start 2022-02-02T15:11:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 -- start start 2022-02-02T15:11:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.443+0000 7fc461225700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc461225700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0f8100 con 0x7fc45c0f6860 2022-02-02T15:11:12.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc461225700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45c0f8240 con 0x7fc45c0f55c0 2022-02-02T15:11:12.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36382/0 (socket says 172.21.15.33:36382) 2022-02-02T15:11:12.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 -- 172.21.15.33:0/1928929633 learned_addr learned my addr 172.21.15.33:0/1928929633 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:12.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45ad9d700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 -- 172.21.15.33:0/1928929633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 msgr2=0x7fc45c0f9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 -- 172.21.15.33:0/1928929633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450005040 con 0x7fc45c0f6860 2022-02-02T15:11:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45ad9d700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:11:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc45a59c700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fc450000c00 tx=0x7fc45000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc450019070 con 0x7fc45c0f6860 2022-02-02T15:11:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45c0f84c0 con 0x7fc45c0f6860 2022-02-02T15:11:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc450007e70 con 0x7fc45c0f6860 2022-02-02T15:11:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc450014d90 con 0x7fc45c0f6860 2022-02-02T15:11:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.444+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45c0f8a20 con 0x7fc45c0f6860 2022-02-02T15:11:12.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.445+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45c045ad0 con 0x7fc45c0f6860 2022-02-02T15:11:12.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.446+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc450025070 con 0x7fc45c0f6860 2022-02-02T15:11:12.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.446+0000 7fc4437fe700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 0x7fc444067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:12.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.447+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc450082a60 con 0x7fc45c0f6860 2022-02-02T15:11:12.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.447+0000 7fc45ad9d700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 0x7fc444067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:12.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.447+0000 7fc45ad9d700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 0x7fc444067290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc45c0f94b0 tx=0x7fc44c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:12.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.451+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc450050b10 con 0x7fc45c0f6860 2022-02-02T15:11:12.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.662+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc45c0fdd80 con 0x7fc45c0f6860 2022-02-02T15:11:12.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.663+0000 7fc4437fe700 1 -- 172.21.15.33:0/1928929633 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc450023020 con 0x7fc45c0f6860 2022-02-02T15:11:12.655 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:11:12.655 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:11:12.656 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:11:12.656 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:11:12.656 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:12.657 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:11:12.657 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:11:12.657 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:11:12.657 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:11:12.658 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:11:12.658 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:11:12.658 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:11:12.659 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:11:12.659 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:11:12.659 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:11:12.659 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:11:12.660 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:11:12.660 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:11:12.660 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:11:12.660 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:11:12.661 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:11:12.661 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:11:12.661 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:11:12.661 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:11:12.662 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:11:12.662 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:11:12.662 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:11:12.662 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:11:12.662 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:11:12.663 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:11:12.663 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:11:12.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:12.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:12.664 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:11:12.664 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:12.665 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:12.665 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:12.665 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:12.665 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:12.666 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 msgr2=0x7fc444067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 0x7fc444067290 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc45c0f94b0 tx=0x7fc44c00b040).stop 2022-02-02T15:11:12.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 msgr2=0x7fc45c0f7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:12.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7fc450000c00 tx=0x7fc45000b040).stop 2022-02-02T15:11:12.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 shutdown_connections 2022-02-02T15:11:12.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc444064dd0 0x7fc444067290 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc45c0f55c0 0x7fc45c0f9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 --2- 172.21.15.33:0/1928929633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc45c0f6860 0x7fc45c0f7ba0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:12.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 >> 172.21.15.33:0/1928929633 conn(0x7fc45c0f0d40 msgr2=0x7fc45c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:12.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 shutdown_connections 2022-02-02T15:11:12.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:12.665+0000 7fc461225700 1 -- 172.21.15.33:0/1928929633 wait complete. 2022-02-02T15:11:12.669 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:11:12.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:12 smithi033 ceph-mon[101165]: from='client.36914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:12.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:12 smithi033 ceph-mon[101165]: pgmap v2774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:12.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2201089482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:11:12.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:12 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1928929633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:11:13.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:12 smithi037 ceph-mon[69017]: from='client.36914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:13.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:12 smithi037 ceph-mon[69017]: pgmap v2774: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:13.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2201089482' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:11:13.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:12 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1928929633' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:11:14.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:13 smithi033 ceph-mon[101165]: from='client.36918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:14.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:13 smithi033 ceph-mon[101165]: pgmap v2775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:14.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:13 smithi037 ceph-mon[69017]: from='client.36918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:14.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:13 smithi037 ceph-mon[69017]: pgmap v2775: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:17.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:16 smithi037 ceph-mon[69017]: pgmap v2776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:17.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:16 smithi033 ceph-mon[101165]: pgmap v2776: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:18.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:17 smithi033 ceph-mon[101165]: pgmap v2777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:18.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:17 smithi037 ceph-mon[69017]: pgmap v2777: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:21.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:20 smithi037 ceph-mon[69017]: pgmap v2778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:21.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:20 smithi033 ceph-mon[101165]: pgmap v2778: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:23.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:22 smithi037 ceph-mon[69017]: pgmap v2779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:23.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:22 smithi033 ceph-mon[101165]: pgmap v2779: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:25.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:24 smithi037 ceph-mon[69017]: pgmap v2780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:25.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:24 smithi033 ceph-mon[101165]: pgmap v2780: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:27.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:26 smithi037 ceph-mon[69017]: pgmap v2781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:27.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:26 smithi033 ceph-mon[101165]: pgmap v2781: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:28.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:27 smithi033 ceph-mon[101165]: pgmap v2782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:28.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:27 smithi037 ceph-mon[69017]: pgmap v2782: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:31.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:30 smithi037 ceph-mon[69017]: pgmap v2783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:31.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:30 smithi033 ceph-mon[101165]: pgmap v2783: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:33.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:32 smithi037 ceph-mon[69017]: pgmap v2784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:33.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:32 smithi033 ceph-mon[101165]: pgmap v2784: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:35.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:34 smithi037 ceph-mon[69017]: pgmap v2785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:35.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:34 smithi033 ceph-mon[101165]: pgmap v2785: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:37.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:36 smithi037 ceph-mon[69017]: pgmap v2786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:37.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:36 smithi033 ceph-mon[101165]: pgmap v2786: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:38.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:37 smithi033 ceph-mon[101165]: pgmap v2787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:38.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:37 smithi037 ceph-mon[69017]: pgmap v2787: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:41.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:40 smithi037 ceph-mon[69017]: pgmap v2788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:41.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:40 smithi033 ceph-mon[101165]: pgmap v2788: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 -- 172.21.15.33:0/3596130018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f6860 msgr2=0x7f29540f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 --2- 172.21.15.33:0/3596130018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f6860 0x7f29540f6cc0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f2944004660 tx=0x7f2944009b30).stop 2022-02-02T15:11:42.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 -- 172.21.15.33:0/3596130018 shutdown_connections 2022-02-02T15:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 --2- 172.21.15.33:0/3596130018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f6860 0x7f29540f6cc0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 --2- 172.21.15.33:0/3596130018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f55c0 0x7f29540f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 -- 172.21.15.33:0/3596130018 >> 172.21.15.33:0/3596130018 conn(0x7f29540f0d40 msgr2=0x7f29540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 -- 172.21.15.33:0/3596130018 shutdown_connections 2022-02-02T15:11:42.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 -- 172.21.15.33:0/3596130018 wait complete. 2022-02-02T15:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.781+0000 7f295bc6e700 1 Processor -- start 2022-02-02T15:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f295bc6e700 1 -- start start 2022-02-02T15:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f295bc6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:42.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f295bc6e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f6860 0x7f2954109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f295bc6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2954109c20 con 0x7f29540f55c0 2022-02-02T15:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f295bc6e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2954109d60 con 0x7f29540f6860 2022-02-02T15:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36392/0 (socket says 172.21.15.33:36392) 2022-02-02T15:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 -- 172.21.15.33:0/1897729912 learned_addr learned my addr 172.21.15.33:0/1897729912 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959209700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f6860 0x7f2954109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 -- 172.21.15.33:0/1897729912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f6860 msgr2=0x7f2954109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:42.778 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f6860 0x7f2954109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 -- 172.21.15.33:0/1897729912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944005040 con 0x7f29540f55c0 2022-02-02T15:11:42.779 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.782+0000 7f2959a0a700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f2950002700 tx=0x7f2950009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.783+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29500079c0 con 0x7f29540f55c0 2022-02-02T15:11:42.780 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.783+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f295000f040 con 0x7f29540f55c0 2022-02-02T15:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.783+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295410a700 con 0x7f29540f55c0 2022-02-02T15:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.784+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2950014860 con 0x7f29540f55c0 2022-02-02T15:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.784+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295410acc0 con 0x7f29540f55c0 2022-02-02T15:11:42.781 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.785+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2954045ad0 con 0x7f29540f55c0 2022-02-02T15:11:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.785+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f295001b060 con 0x7f29540f55c0 2022-02-02T15:11:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.785+0000 7f294a7fc700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 0x7f2940067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.786+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2950081840 con 0x7f29540f55c0 2022-02-02T15:11:42.782 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.786+0000 7f2959209700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 0x7f2940067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.786+0000 7f2959209700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 0x7f2940067290 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f2944004630 tx=0x7f2944009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.790+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2950053320 con 0x7f29540f55c0 2022-02-02T15:11:42.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.979+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29540faaa0 con 0x7f2940064dd0 2022-02-02T15:11:42.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.980+0000 7f294a7fc700 1 -- 172.21.15.33:0/1897729912 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f29540faaa0 con 0x7f2940064dd0 2022-02-02T15:11:42.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 msgr2=0x7f2940067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:42.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 0x7f2940067290 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7f2944004630 tx=0x7f2944009b30).stop 2022-02-02T15:11:42.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 msgr2=0x7f2954109180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:42.974 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f2950002700 tx=0x7f2950009d80).stop 2022-02-02T15:11:42.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 shutdown_connections 2022-02-02T15:11:42.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2940064dd0 0x7f2940067290 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29540f55c0 0x7f2954109180 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.975 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 --2- 172.21.15.33:0/1897729912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29540f6860 0x7f2954109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:42.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 >> 172.21.15.33:0/1897729912 conn(0x7f29540f0d40 msgr2=0x7f295405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:42.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 shutdown_connections 2022-02-02T15:11:42.976 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:42.982+0000 7f295bc6e700 1 -- 172.21.15.33:0/1897729912 wait complete. 2022-02-02T15:11:42.983 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:11:43.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:42 smithi037 ceph-mon[69017]: pgmap v2789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 -- 172.21.15.33:0/2544426866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f51a0 msgr2=0x7fb7440f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 --2- 172.21.15.33:0/2544426866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f51a0 0x7fb7440f7920 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fb734004660 tx=0x7fb734009b30).stop 2022-02-02T15:11:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 -- 172.21.15.33:0/2544426866 shutdown_connections 2022-02-02T15:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 --2- 172.21.15.33:0/2544426866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f51a0 0x7fb7440f7920 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 --2- 172.21.15.33:0/2544426866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f4800 0x7fb7440f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 -- 172.21.15.33:0/2544426866 >> 172.21.15.33:0/2544426866 conn(0x7fb7440f0320 msgr2=0x7fb7440f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.076 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:42 smithi033 ceph-mon[101165]: pgmap v2789: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.083+0000 7fb74a25b700 1 -- 172.21.15.33:0/2544426866 shutdown_connections 2022-02-02T15:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 -- 172.21.15.33:0/2544426866 wait complete. 2022-02-02T15:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 Processor -- start 2022-02-02T15:11:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 -- start start 2022-02-02T15:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f51a0 0x7fb7441072b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441078b0 con 0x7fb7440f4800 2022-02-02T15:11:43.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb74a25b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7441080f0 con 0x7fb7440f51a0 2022-02-02T15:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb749259700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb749259700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36400/0 (socket says 172.21.15.33:36400) 2022-02-02T15:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb749259700 1 -- 172.21.15.33:0/1805574323 learned_addr learned my addr 172.21.15.33:0/1805574323 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:43.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.084+0000 7fb748a58700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f51a0 0x7fb7441072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb749259700 1 -- 172.21.15.33:0/1805574323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f51a0 msgr2=0x7fb7441072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb749259700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f51a0 0x7fb7441072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb749259700 1 -- 172.21.15.33:0/1805574323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734005040 con 0x7fb7440f4800 2022-02-02T15:11:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb749259700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fb740002700 tx=0x7fb740009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7400079c0 con 0x7fb7440f4800 2022-02-02T15:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb74000f040 con 0x7fb7440f4800 2022-02-02T15:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb740014860 con 0x7fb7440f4800 2022-02-02T15:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7441083d0 con 0x7fb7440f4800 2022-02-02T15:11:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.085+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7441088c0 con 0x7fb7440f4800 2022-02-02T15:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.086+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb744059100 con 0x7fb7440f4800 2022-02-02T15:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.087+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb74001b060 con 0x7fb7440f4800 2022-02-02T15:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.087+0000 7fb739ffb700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 0x7fb7300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.087+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb740081930 con 0x7fb7440f4800 2022-02-02T15:11:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.087+0000 7fb748a58700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 0x7fb7300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.088+0000 7fb748a58700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 0x7fb7300672e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fb744106b50 tx=0x7fb734009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.091+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb74004f9e0 con 0x7fb7440f4800 2022-02-02T15:11:43.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.274+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7440fee90 con 0x7fb730064e20 2022-02-02T15:11:43.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.288+0000 7fb739ffb700 1 -- 172.21.15.33:0/1805574323 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7fb7440fee90 con 0x7fb730064e20 2022-02-02T15:11:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:11:43.280 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (97m) 59m ago 98m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:11:43.281 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (90m) 59m ago 97m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:11:43.281 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (89m) 59m ago 97m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:11:43.281 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (96m) 59m ago 97m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:11:43.281 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (90m) 59m ago 94m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:11:43.281 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (91m) 59m ago 94m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:11:43.282 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (91m) 59m ago 94m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:11:43.282 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (94m) 59m ago 94m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:11:43.282 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (91m) 59m ago 99m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:11:43.282 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (91m) 59m ago 97m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:11:43.283 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (90m) 59m ago 99m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:11:43.283 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (90m) 59m ago 97m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:11:43.283 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (97m) 59m ago 97m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:11:43.283 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (97m) 59m ago 97m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:11:43.283 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 59m ago 96m - 4096M 2022-02-02T15:11:43.284 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (96m) 59m ago 96m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:11:43.284 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (96m) 59m ago 96m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:11:43.284 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (95m) 59m ago 95m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:11:43.284 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (95m) 59m ago 95m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:11:43.285 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (95m) 59m ago 95m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:11:43.285 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (96m) 59m ago 97m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:11:43.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 msgr2=0x7fb7300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 0x7fb7300672e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7fb744106b50 tx=0x7fb734009b30).stop 2022-02-02T15:11:43.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 msgr2=0x7fb744106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fb740002700 tx=0x7fb740009d80).stop 2022-02-02T15:11:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 shutdown_connections 2022-02-02T15:11:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb730064e20 0x7fb7300672e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7440f4800 0x7fb744106dc0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 --2- 172.21.15.33:0/1805574323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7440f51a0 0x7fb7441072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 >> 172.21.15.33:0/1805574323 conn(0x7fb7440f0320 msgr2=0x7fb7440fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 shutdown_connections 2022-02-02T15:11:43.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.290+0000 7fb74a25b700 1 -- 172.21.15.33:0/1805574323 wait complete. 2022-02-02T15:11:43.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- 172.21.15.33:0/3286046327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f6860 msgr2=0x7f742c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 --2- 172.21.15.33:0/3286046327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f6860 0x7f742c0f6cc0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f7418004660 tx=0x7f7418009b30).stop 2022-02-02T15:11:43.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- 172.21.15.33:0/3286046327 shutdown_connections 2022-02-02T15:11:43.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 --2- 172.21.15.33:0/3286046327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f6860 0x7f742c0f6cc0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 --2- 172.21.15.33:0/3286046327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f55c0 0x7f742c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- 172.21.15.33:0/3286046327 >> 172.21.15.33:0/3286046327 conn(0x7f742c0f0d40 msgr2=0x7f742c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- 172.21.15.33:0/3286046327 shutdown_connections 2022-02-02T15:11:43.383 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- 172.21.15.33:0/3286046327 wait complete. 2022-02-02T15:11:43.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 Processor -- start 2022-02-02T15:11:43.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.390+0000 7f7432d08700 1 -- start start 2022-02-02T15:11:43.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7432d08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7432d08700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f6860 0x7f742c106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7432d08700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c106920 con 0x7f742c0f55c0 2022-02-02T15:11:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7432d08700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742c107130 con 0x7f742c0f6860 2022-02-02T15:11:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36410/0 (socket says 172.21.15.33:36410) 2022-02-02T15:11:43.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 -- 172.21.15.33:0/2896916735 learned_addr learned my addr 172.21.15.33:0/2896916735 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f742bfff700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f6860 0x7f742c106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 -- 172.21.15.33:0/2896916735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f6860 msgr2=0x7f742c106320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f6860 0x7f742c106320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 -- 172.21.15.33:0/2896916735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418005040 con 0x7f742c0f55c0 2022-02-02T15:11:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.391+0000 7f7430aa4700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f742000e7c0 tx=0x7f742000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.392+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74200092e0 con 0x7f742c0f55c0 2022-02-02T15:11:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.392+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742c1073b0 con 0x7f742c0f55c0 2022-02-02T15:11:43.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.392+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742c107970 con 0x7f742c0f55c0 2022-02-02T15:11:43.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.392+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f742000f040 con 0x7f742c0f55c0 2022-02-02T15:11:43.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.392+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74200147e0 con 0x7f742c0f55c0 2022-02-02T15:11:43.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.393+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740c004fa0 con 0x7f742c0f55c0 2022-02-02T15:11:43.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.393+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f742001b030 con 0x7f742c0f55c0 2022-02-02T15:11:43.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.394+0000 7f74297fa700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 0x7f741c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.394+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7420081780 con 0x7f742c0f55c0 2022-02-02T15:11:43.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.394+0000 7f742bfff700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 0x7f741c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.394+0000 7f742bfff700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 0x7f741c067290 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7418005010 tx=0x7f7418016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.398+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f742004f8e0 con 0x7f742c0f55c0 2022-02-02T15:11:43.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.642+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f740c005e80 con 0x7f742c0f55c0 2022-02-02T15:11:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.642+0000 7f74297fa700 1 -- 172.21.15.33:0/2896916735 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f7420052f00 con 0x7f742c0f55c0 2022-02-02T15:11:43.634 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:11:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:11:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:11:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:43.635 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:11:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:11:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:11:43.636 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:11:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:11:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:11:43.637 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:11:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:11:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:11:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:11:43.638 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:11:43.639 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:11:43.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 msgr2=0x7f741c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 0x7f741c067290 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f7418005010 tx=0x7f7418016040).stop 2022-02-02T15:11:43.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 msgr2=0x7f742c105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f742000e7c0 tx=0x7f742000b040).stop 2022-02-02T15:11:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 shutdown_connections 2022-02-02T15:11:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f741c064dd0 0x7f741c067290 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f742c0f55c0 0x7f742c105e30 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 --2- 172.21.15.33:0/2896916735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f742c0f6860 0x7f742c106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.644+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 >> 172.21.15.33:0/2896916735 conn(0x7f742c0f0d40 msgr2=0x7f742c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.645+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 shutdown_connections 2022-02-02T15:11:43.642 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.645+0000 7f7432d08700 1 -- 172.21.15.33:0/2896916735 wait complete. 2022-02-02T15:11:43.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- 172.21.15.33:0/2090989197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 msgr2=0x7fab780f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 --2- 172.21.15.33:0/2090989197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab780f59e0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 rx=0x7fab6c004660 tx=0x7fab6c009b30).stop 2022-02-02T15:11:43.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- 172.21.15.33:0/2090989197 shutdown_connections 2022-02-02T15:11:43.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 --2- 172.21.15.33:0/2090989197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab780f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 --2- 172.21.15.33:0/2090989197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab780f59e0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- 172.21.15.33:0/2090989197 >> 172.21.15.33:0/2090989197 conn(0x7fab780f0d40 msgr2=0x7fab780f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- 172.21.15.33:0/2090989197 shutdown_connections 2022-02-02T15:11:43.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- 172.21.15.33:0/2090989197 wait complete. 2022-02-02T15:11:43.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 Processor -- start 2022-02-02T15:11:43.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.746+0000 7fab7d617700 1 -- start start 2022-02-02T15:11:43.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab7d617700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab7d617700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab78107410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab7d617700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab781079c0 con 0x7fab780f55c0 2022-02-02T15:11:43.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab7d617700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab78107b00 con 0x7fab780f6860 2022-02-02T15:11:43.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36420/0 (socket says 172.21.15.33:36420) 2022-02-02T15:11:43.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 -- 172.21.15.33:0/2946104625 learned_addr learned my addr 172.21.15.33:0/2946104625 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:11:43.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab767fc700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab78107410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 -- 172.21.15.33:0/2946104625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 msgr2=0x7fab78107410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab78107410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 -- 172.21.15.33:0/2946104625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c005040 con 0x7fab780f55c0 2022-02-02T15:11:43.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab767fc700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab78107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:11:43.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab76ffd700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fab6c014040 tx=0x7fab6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.747+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c019070 con 0x7fab780f55c0 2022-02-02T15:11:43.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.748+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fab6c007e70 con 0x7fab780f55c0 2022-02-02T15:11:43.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.748+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78108440 con 0x7fab780f55c0 2022-02-02T15:11:43.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.748+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6c014d50 con 0x7fab780f55c0 2022-02-02T15:11:43.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.748+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab781089a0 con 0x7fab780f55c0 2022-02-02T15:11:43.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.749+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78045ad0 con 0x7fab780f55c0 2022-02-02T15:11:43.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.749+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fab6c025070 con 0x7fab780f55c0 2022-02-02T15:11:43.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.749+0000 7fab5f7fe700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 0x7fab60067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:11:43.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.749+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fab6c082a90 con 0x7fab780f55c0 2022-02-02T15:11:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.749+0000 7fab767fc700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 0x7fab60067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:11:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.750+0000 7fab767fc700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 0x7fab60067290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fab68009da0 tx=0x7fab6800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:11:43.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.754+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fab6c054570 con 0x7fab780f55c0 2022-02-02T15:11:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.967+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fab78109170 con 0x7fab780f55c0 2022-02-02T15:11:43.959 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:43 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2896916735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:11:43.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.967+0000 7fab5f7fe700 1 -- 172.21.15.33:0/2946104625 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fab78109170 con 0x7fab780f55c0 2022-02-02T15:11:43.960 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:11:43.960 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:11:43.960 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:11:43.961 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:11:43.961 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:43.961 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:11:43.961 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:11:43.962 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:11:43.962 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:11:43.962 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:11:43.962 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:11:43.963 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:11:43.963 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:11:43.963 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:11:43.963 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:11:43.964 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:11:43.964 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:11:43.964 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:11:43.964 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:11:43.964 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:11:43.965 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:11:43.965 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:11:43.965 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:11:43.965 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:11:43.966 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:11:43.966 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:11:43.966 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:11:43.966 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:11:43.967 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:11:43.967 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:11:43.967 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:11:43.967 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:43.967 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:43.968 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:11:43.968 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:11:43.968 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:43.968 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:43.969 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:43.969 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:11:43.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 msgr2=0x7fab60067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 0x7fab60067290 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7fab68009da0 tx=0x7fab6800b040).stop 2022-02-02T15:11:43.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 msgr2=0x7fab78106f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:11:43.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fab6c014040 tx=0x7fab6c00b040).stop 2022-02-02T15:11:43.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 shutdown_connections 2022-02-02T15:11:43.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fab60064dd0 0x7fab60067290 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab780f55c0 0x7fab78106f20 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.969+0000 7fab7d617700 1 --2- 172.21.15.33:0/2946104625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780f6860 0x7fab78107410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:11:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.970+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 >> 172.21.15.33:0/2946104625 conn(0x7fab780f0d40 msgr2=0x7fab7805f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:11:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.970+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 shutdown_connections 2022-02-02T15:11:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:11:43.970+0000 7fab7d617700 1 -- 172.21.15.33:0/2946104625 wait complete. 2022-02-02T15:11:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:11:44.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:43 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2896916735' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:11:45.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:44 smithi037 ceph-mon[69017]: from='client.36930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:45.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:44 smithi037 ceph-mon[69017]: from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:45.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:44 smithi037 ceph-mon[69017]: pgmap v2790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:45.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2946104625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:11:45.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:44 smithi033 ceph-mon[101165]: from='client.36930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:45.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:44 smithi033 ceph-mon[101165]: from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:11:45.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:44 smithi033 ceph-mon[101165]: pgmap v2790: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:45.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2946104625' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:11:47.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:46 smithi037 ceph-mon[69017]: pgmap v2791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:47.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:46 smithi033 ceph-mon[101165]: pgmap v2791: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:48.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:47 smithi033 ceph-mon[101165]: pgmap v2792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:48.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:47 smithi037 ceph-mon[69017]: pgmap v2792: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:51.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:50 smithi037 ceph-mon[69017]: pgmap v2793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:51.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:50 smithi033 ceph-mon[101165]: pgmap v2793: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:53.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:52 smithi037 ceph-mon[69017]: pgmap v2794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:53.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:52 smithi033 ceph-mon[101165]: pgmap v2794: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:55.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:54 smithi037 ceph-mon[69017]: pgmap v2795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:55.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:11:55.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:11:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:54 smithi033 ceph-mon[101165]: pgmap v2795: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:11:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:11:57.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:56 smithi037 ceph-mon[69017]: pgmap v2796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:57.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:56 smithi033 ceph-mon[101165]: pgmap v2796: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:58.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:11:57 smithi033 ceph-mon[101165]: pgmap v2797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:11:58.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:11:57 smithi037 ceph-mon[69017]: pgmap v2797: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:01.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:00 smithi037 ceph-mon[69017]: pgmap v2798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:00 smithi033 ceph-mon[101165]: pgmap v2798: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:03.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:02 smithi037 ceph-mon[69017]: pgmap v2799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:03.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:02 smithi033 ceph-mon[101165]: pgmap v2799: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:05.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:04 smithi033 ceph-mon[101165]: pgmap v2800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:05.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:04 smithi037 ceph-mon[69017]: pgmap v2800: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:07.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:06 smithi033 ceph-mon[101165]: pgmap v2801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:07.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:06 smithi037 ceph-mon[69017]: pgmap v2801: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:08.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:07 smithi033 ceph-mon[101165]: pgmap v2802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:08.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:07 smithi037 ceph-mon[69017]: pgmap v2802: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:11.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:10 smithi037 ceph-mon[69017]: pgmap v2803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:11.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:10 smithi033 ceph-mon[101165]: pgmap v2803: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:13.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:12 smithi033 ceph-mon[101165]: pgmap v2804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:13.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:12 smithi037 ceph-mon[69017]: pgmap v2804: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 -- 172.21.15.33:0/4040987436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f6860 msgr2=0x7f4ca80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 --2- 172.21.15.33:0/4040987436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f6860 0x7f4ca80f6cc0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7f4c94004660 tx=0x7f4c94009b30).stop 2022-02-02T15:12:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 -- 172.21.15.33:0/4040987436 shutdown_connections 2022-02-02T15:12:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 --2- 172.21.15.33:0/4040987436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f6860 0x7f4ca80f6cc0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 --2- 172.21.15.33:0/4040987436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f55c0 0x7f4ca80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.085+0000 7f4caebf6700 1 -- 172.21.15.33:0/4040987436 >> 172.21.15.33:0/4040987436 conn(0x7f4ca80f0d40 msgr2=0x7f4ca80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.086+0000 7f4caebf6700 1 -- 172.21.15.33:0/4040987436 shutdown_connections 2022-02-02T15:12:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.086+0000 7f4caebf6700 1 -- 172.21.15.33:0/4040987436 wait complete. 2022-02-02T15:12:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.086+0000 7f4caebf6700 1 Processor -- start 2022-02-02T15:12:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.086+0000 7f4caebf6700 1 -- start start 2022-02-02T15:12:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4caebf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4caebf6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f6860 0x7f4ca8107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4caebf6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8107a10 con 0x7f4ca80f55c0 2022-02-02T15:12:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4caebf6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca8107b50 con 0x7f4ca80f6860 2022-02-02T15:12:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36430/0 (socket says 172.21.15.33:36430) 2022-02-02T15:12:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 -- 172.21.15.33:0/591897948 learned_addr learned my addr 172.21.15.33:0/591897948 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4ca7fff700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f6860 0x7f4ca8107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 -- 172.21.15.33:0/591897948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f6860 msgr2=0x7f4ca8107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f6860 0x7f4ca8107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 -- 172.21.15.33:0/591897948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94005040 con 0x7f4ca80f55c0 2022-02-02T15:12:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4cac992700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f4c9c002700 tx=0x7f4c9c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.087+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c009320 con 0x7f4ca80f55c0 2022-02-02T15:12:14.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.088+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4c9c00f040 con 0x7f4ca80f55c0 2022-02-02T15:12:14.085 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.088+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca81084f0 con 0x7f4ca80f55c0 2022-02-02T15:12:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.088+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c9c014900 con 0x7f4ca80f55c0 2022-02-02T15:12:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.088+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca8108ab0 con 0x7f4ca80f55c0 2022-02-02T15:12:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.089+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8045ad0 con 0x7f4ca80f55c0 2022-02-02T15:12:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.089+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4c9c009480 con 0x7f4ca80f55c0 2022-02-02T15:12:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.089+0000 7f4ca57fa700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.090+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4c9c081c30 con 0x7f4ca80f55c0 2022-02-02T15:12:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.090+0000 7f4ca7fff700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.090+0000 7f4ca7fff700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 0x7f4c98067290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f4c94004630 tx=0x7f4c94009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.094+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4c9c053710 con 0x7f4ca80f55c0 2022-02-02T15:12:14.275 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.284+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ca80faca0 con 0x7f4c98064dd0 2022-02-02T15:12:14.276 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.285+0000 7f4ca57fa700 1 -- 172.21.15.33:0/591897948 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f4ca80faca0 con 0x7f4c98064dd0 2022-02-02T15:12:14.278 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 msgr2=0x7f4c98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 0x7f4c98067290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f4c94004630 tx=0x7f4c94009b30).stop 2022-02-02T15:12:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 msgr2=0x7f4ca8106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f4c9c002700 tx=0x7f4c9c009d80).stop 2022-02-02T15:12:14.279 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 shutdown_connections 2022-02-02T15:12:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4c98064dd0 0x7f4c98067290 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca80f55c0 0x7f4ca8106f70 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 --2- 172.21.15.33:0/591897948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ca80f6860 0x7f4ca8107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 >> 172.21.15.33:0/591897948 conn(0x7f4ca80f0d40 msgr2=0x7f4ca805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 shutdown_connections 2022-02-02T15:12:14.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.287+0000 7f4caebf6700 1 -- 172.21.15.33:0/591897948 wait complete. 2022-02-02T15:12:14.288 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:12:14.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 -- 172.21.15.33:0/3442017611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 msgr2=0x7f4d580fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3442017611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d580fbae0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f4d40004660 tx=0x7f4d40009b30).stop 2022-02-02T15:12:14.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 -- 172.21.15.33:0/3442017611 shutdown_connections 2022-02-02T15:12:14.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3442017611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d580fbae0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.381 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3442017611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d580f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 -- 172.21.15.33:0/3442017611 >> 172.21.15.33:0/3442017611 conn(0x7f4d580f0b90 msgr2=0x7f4d580f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 -- 172.21.15.33:0/3442017611 shutdown_connections 2022-02-02T15:12:14.382 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.389+0000 7f4d5c889700 1 -- 172.21.15.33:0/3442017611 wait complete. 2022-02-02T15:12:14.384 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 Processor -- start 2022-02-02T15:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 -- start start 2022-02-02T15:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d58106d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d58107820 con 0x7f4d580f9690 2022-02-02T15:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5c889700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d58108030 con 0x7f4d58060310 2022-02-02T15:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d56d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d58106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36440/0 (socket says 172.21.15.33:36440) 2022-02-02T15:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.390+0000 7f4d5659c700 1 -- 172.21.15.33:0/3637445553 learned_addr learned my addr 172.21.15.33:0/3637445553 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5659c700 1 -- 172.21.15.33:0/3637445553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 msgr2=0x7f4d58106d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5659c700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d58106d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5659c700 1 -- 172.21.15.33:0/3637445553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40005040 con 0x7f4d580f9690 2022-02-02T15:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d56d9d700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d58106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5659c700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4d40014040 tx=0x7f4d4000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d40019070 con 0x7f4d580f9690 2022-02-02T15:12:14.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d58108250 con 0x7f4d580f9690 2022-02-02T15:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4d40007e70 con 0x7f4d580f9690 2022-02-02T15:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d581087b0 con 0x7f4d580f9690 2022-02-02T15:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.391+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d40014d10 con 0x7f4d580f9690 2022-02-02T15:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.392+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c004fa0 con 0x7f4d580f9690 2022-02-02T15:12:14.389 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.393+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4d40025070 con 0x7f4d580f9690 2022-02-02T15:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.393+0000 7f4d4f7fe700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 0x7f4d440672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.393+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4d40082910 con 0x7f4d580f9690 2022-02-02T15:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.393+0000 7f4d56d9d700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 0x7f4d440672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.394+0000 7f4d56d9d700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 0x7f4d440672e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f4d58106aa0 tx=0x7f4d4800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.397+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4d400509c0 con 0x7f4d580f9690 2022-02-02T15:12:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.583+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d3c000bc0 con 0x7f4d44064e20 2022-02-02T15:12:14.588 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.597+0000 7f4d4f7fe700 1 -- 172.21.15.33:0/3637445553 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f4d3c000bc0 con 0x7f4d44064e20 2022-02-02T15:12:14.589 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:12:14.589 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (97m) 59m ago 98m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:12:14.589 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (90m) 59m ago 98m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:12:14.590 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (90m) 59m ago 98m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:12:14.590 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (97m) 59m ago 98m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:12:14.590 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (91m) 59m ago 94m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:12:14.590 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (91m) 59m ago 94m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:12:14.591 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (92m) 59m ago 94m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:12:14.591 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (94m) 59m ago 94m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:12:14.591 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (92m) 59m ago 99m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:12:14.591 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (91m) 59m ago 97m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:12:14.592 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (91m) 59m ago 99m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:12:14.592 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (91m) 59m ago 97m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:12:14.592 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (98m) 59m ago 98m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:12:14.592 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (97m) 59m ago 97m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:12:14.593 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 59m ago 97m - 4096M 2022-02-02T15:12:14.593 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (96m) 59m ago 96m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:12:14.593 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (96m) 59m ago 96m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:12:14.593 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (96m) 59m ago 96m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:12:14.593 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (96m) 59m ago 96m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:12:14.594 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (95m) 59m ago 95m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:12:14.594 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (97m) 59m ago 98m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:12:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.599+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 msgr2=0x7f4d440672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.599+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 0x7f4d440672e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f4d58106aa0 tx=0x7f4d4800b040).stop 2022-02-02T15:12:14.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.599+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 msgr2=0x7f4d58107220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.599+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f4d40014040 tx=0x7f4d4000b040).stop 2022-02-02T15:12:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.599+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 shutdown_connections 2022-02-02T15:12:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4d44064e20 0x7f4d440672e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d58060310 0x7f4d58106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 --2- 172.21.15.33:0/3637445553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d580f9690 0x7f4d58107220 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 >> 172.21.15.33:0/3637445553 conn(0x7f4d580f0b90 msgr2=0x7f4d580f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 shutdown_connections 2022-02-02T15:12:14.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.600+0000 7f4d5c889700 1 -- 172.21.15.33:0/3637445553 wait complete. 2022-02-02T15:12:14.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2821037281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 msgr2=0x7ffb540f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2821037281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb540f59e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7ffb44004660 tx=0x7ffb44009b30).stop 2022-02-02T15:12:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2821037281 shutdown_connections 2022-02-02T15:12:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2821037281 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb540f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2821037281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb540f59e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.692 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2821037281 >> 172.21.15.33:0/2821037281 conn(0x7ffb540f0d40 msgr2=0x7ffb540f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2821037281 shutdown_connections 2022-02-02T15:12:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.699+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2821037281 wait complete. 2022-02-02T15:12:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 Processor -- start 2022-02-02T15:12:14.693 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 -- start start 2022-02-02T15:12:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb54105eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54106950 con 0x7ffb540f6860 2022-02-02T15:12:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.700+0000 7ffb5a0e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb54107150 con 0x7ffb540f55c0 2022-02-02T15:12:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36450/0 (socket says 172.21.15.33:36450) 2022-02-02T15:12:14.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 -- 172.21.15.33:0/2267165017 learned_addr learned my addr 172.21.15.33:0/2267165017 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:14.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb537fe700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb54105eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 -- 172.21.15.33:0/2267165017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 msgr2=0x7ffb54105eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb54105eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.698 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 -- 172.21.15.33:0/2267165017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44005040 con 0x7ffb540f6860 2022-02-02T15:12:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb52ffd700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ffb3c010a00 tx=0x7ffb3c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c0094c0 con 0x7ffb540f6860 2022-02-02T15:12:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb541073d0 con 0x7ffb540f6860 2022-02-02T15:12:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffb3c010e90 con 0x7ffb540f6860 2022-02-02T15:12:14.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54107940 con 0x7ffb540f6860 2022-02-02T15:12:14.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.701+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c007db0 con 0x7ffb540f6860 2022-02-02T15:12:14.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.703+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540f49b0 con 0x7ffb540f6860 2022-02-02T15:12:14.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.704+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffb3c022070 con 0x7ffb540f6860 2022-02-02T15:12:14.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.704+0000 7ffb4bfff700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 0x7ffb40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:14.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.705+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffb3c084410 con 0x7ffb540f6860 2022-02-02T15:12:14.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.705+0000 7ffb537fe700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 0x7ffb40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:14.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.705+0000 7ffb537fe700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 0x7ffb40067290 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ffb44004d80 tx=0x7ffb44016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:14.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.708+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffb3c055e30 con 0x7ffb540f6860 2022-02-02T15:12:14.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.951+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ffb54045ad0 con 0x7ffb540f6860 2022-02-02T15:12:14.943 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:14 smithi033 ceph-mon[101165]: pgmap v2805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:14.943 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.951+0000 7ffb4bfff700 1 -- 172.21.15.33:0/2267165017 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ffb3c055a20 con 0x7ffb540f6860 2022-02-02T15:12:14.944 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:12:14.944 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:12:14.944 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:12:14.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:14.945 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:12:14.945 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:12:14.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:14.946 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:12:14.946 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:12:14.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:14.947 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:12:14.947 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:12:14.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:14.948 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:12:14.948 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:12:14.948 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:12:14.949 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:12:14.949 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:12:14.950 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 msgr2=0x7ffb40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 0x7ffb40067290 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7ffb44004d80 tx=0x7ffb44016040).stop 2022-02-02T15:12:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 msgr2=0x7ffb541063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7ffb3c010a00 tx=0x7ffb3c00b040).stop 2022-02-02T15:12:14.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 shutdown_connections 2022-02-02T15:12:14.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffb40064dd0 0x7ffb40067290 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb540f55c0 0x7ffb54105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 --2- 172.21.15.33:0/2267165017 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb540f6860 0x7ffb541063a0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:14.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 >> 172.21.15.33:0/2267165017 conn(0x7ffb540f0d40 msgr2=0x7ffb540fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:14.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 shutdown_connections 2022-02-02T15:12:14.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:14.954+0000 7ffb5a0e2700 1 -- 172.21.15.33:0/2267165017 wait complete. 2022-02-02T15:12:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2073752398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 msgr2=0x7fdfb00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2073752398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb00f6cc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fdf98004660 tx=0x7fdf98009b30).stop 2022-02-02T15:12:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2073752398 shutdown_connections 2022-02-02T15:12:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2073752398 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb00f6cc0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2073752398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 0x7fdfb00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2073752398 >> 172.21.15.33:0/2073752398 conn(0x7fdfb00f0d40 msgr2=0x7fdfb00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2073752398 shutdown_connections 2022-02-02T15:12:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2073752398 wait complete. 2022-02-02T15:12:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 Processor -- start 2022-02-02T15:12:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 -- start start 2022-02-02T15:12:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.055+0000 7fdfb4a7f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 0x7fdfb0109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfb4a7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfb4a7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb00603c0 con 0x7fdfb00f6860 2022-02-02T15:12:15.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfb4a7f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb0060500 con 0x7fdfb00f55c0 2022-02-02T15:12:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36460/0 (socket says 172.21.15.33:36460) 2022-02-02T15:12:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 -- 172.21.15.33:0/2764798352 learned_addr learned my addr 172.21.15.33:0/2764798352 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:15.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfae59c700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 0x7fdfb0109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 -- 172.21.15.33:0/2764798352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 msgr2=0x7fdfb0109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 0x7fdfb0109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 -- 172.21.15.33:0/2764798352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98005040 con 0x7fdfb00f6860 2022-02-02T15:12:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa7fff700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fdf98009990 tx=0x7fdf98009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:15.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf98018070 con 0x7fdfb00f6860 2022-02-02T15:12:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb010c6c0 con 0x7fdfb00f6860 2022-02-02T15:12:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb010cbf0 con 0x7fdfb00f6860 2022-02-02T15:12:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.056+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdf98007ba0 con 0x7fdfb00f6860 2022-02-02T15:12:15.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.057+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf9801dc70 con 0x7fdfb00f6860 2022-02-02T15:12:15.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.057+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf94004fa0 con 0x7fdfb00f6860 2022-02-02T15:12:15.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.058+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdf9801d420 con 0x7fdfb00f6860 2022-02-02T15:12:15.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.058+0000 7fdfa6ffd700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 0x7fdf9c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:15.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.058+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdf980836d0 con 0x7fdfb00f6860 2022-02-02T15:12:15.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.058+0000 7fdfae59c700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 0x7fdf9c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:15.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.059+0000 7fdfae59c700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 0x7fdf9c067290 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fdfb0060040 tx=0x7fdfa0009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:15.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.062+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdf980516c0 con 0x7fdfb00f6860 2022-02-02T15:12:15.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.276+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf94005940 con 0x7fdfb00f6860 2022-02-02T15:12:15.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.277+0000 7fdfa6ffd700 1 -- 172.21.15.33:0/2764798352 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fdf98054ce0 con 0x7fdfb00f6860 2022-02-02T15:12:15.269 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:12:15.269 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:12:15.269 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:12:15.270 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:12:15.270 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:15.270 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:12:15.271 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:12:15.271 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:12:15.271 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:12:15.271 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:12:15.272 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:12:15.272 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:12:15.272 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:12:15.272 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:12:15.273 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:12:15.273 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:12:15.273 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:12:15.273 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:12:15.274 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:12:15.274 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:12:15.274 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:12:15.274 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:12:15.275 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:12:15.275 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:12:15.275 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:12:15.275 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:12:15.276 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:12:15.276 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:12:15.276 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:12:15.277 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:12:15.277 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:12:15.277 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:15.277 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:15.278 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:12:15.278 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:15.278 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:15.278 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:15.279 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:15.279 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:15.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 msgr2=0x7fdf9c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:15.280 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 0x7fdf9c067290 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fdfb0060040 tx=0x7fdfa0009c00).stop 2022-02-02T15:12:15.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 msgr2=0x7fdfb010c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:15.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fdf98009990 tx=0x7fdf98009b30).stop 2022-02-02T15:12:15.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 shutdown_connections 2022-02-02T15:12:15.281 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdf9c064dd0 0x7fdf9c067290 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb00f55c0 0x7fdfb0109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.282 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 --2- 172.21.15.33:0/2764798352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfb00f6860 0x7fdfb010c170 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:15.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 >> 172.21.15.33:0/2764798352 conn(0x7fdfb00f0d40 msgr2=0x7fdfb00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:15.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 shutdown_connections 2022-02-02T15:12:15.283 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:15.279+0000 7fdfb4a7f700 1 -- 172.21.15.33:0/2764798352 wait complete. 2022-02-02T15:12:15.283 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:12:15.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:14 smithi037 ceph-mon[69017]: pgmap v2805: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:16.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:15 smithi033 ceph-mon[101165]: from='client.36946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:16.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:15 smithi033 ceph-mon[101165]: from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:16.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2267165017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:12:16.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2764798352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:12:16.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:15 smithi037 ceph-mon[69017]: from='client.36946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:16.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:15 smithi037 ceph-mon[69017]: from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:16.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2267165017' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:12:16.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2764798352' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:12:17.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:16 smithi033 ceph-mon[101165]: pgmap v2806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:17.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:16 smithi037 ceph-mon[69017]: pgmap v2806: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:18.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:17 smithi033 ceph-mon[101165]: pgmap v2807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:18.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:17 smithi037 ceph-mon[69017]: pgmap v2807: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:21.235 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:20 smithi033 ceph-mon[101165]: pgmap v2808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:21.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:20 smithi037 ceph-mon[69017]: pgmap v2808: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:23.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:22 smithi033 ceph-mon[101165]: pgmap v2809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:23.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:22 smithi037 ceph-mon[69017]: pgmap v2809: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:25.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:24 smithi033 ceph-mon[101165]: pgmap v2810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:25.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:24 smithi037 ceph-mon[69017]: pgmap v2810: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:27.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:26 smithi033 ceph-mon[101165]: pgmap v2811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:27.284 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:26 smithi037 ceph-mon[69017]: pgmap v2811: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:28.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:27 smithi033 ceph-mon[101165]: pgmap v2812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:27 smithi037 ceph-mon[69017]: pgmap v2812: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:31.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:30 smithi033 ceph-mon[101165]: pgmap v2813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:31.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:30 smithi037 ceph-mon[69017]: pgmap v2813: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:33.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:32 smithi033 ceph-mon[101165]: pgmap v2814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:33.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:32 smithi037 ceph-mon[69017]: pgmap v2814: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:35.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:34 smithi033 ceph-mon[101165]: pgmap v2815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:35.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:34 smithi037 ceph-mon[69017]: pgmap v2815: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:37.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:36 smithi033 ceph-mon[101165]: pgmap v2816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:37.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:36 smithi037 ceph-mon[69017]: pgmap v2816: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:38.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:37 smithi033 ceph-mon[101165]: pgmap v2817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:38.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:37 smithi037 ceph-mon[69017]: pgmap v2817: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:41.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:40 smithi033 ceph-mon[101165]: pgmap v2818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:41.363 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:40 smithi037 ceph-mon[69017]: pgmap v2818: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:43.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:42 smithi033 ceph-mon[101165]: pgmap v2819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:43.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:42 smithi037 ceph-mon[69017]: pgmap v2819: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:45.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:44 smithi033 ceph-mon[101165]: pgmap v2820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:45.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:44 smithi037 ceph-mon[69017]: pgmap v2820: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:45.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 -- 172.21.15.33:0/3028943197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 msgr2=0x7f6a8c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/3028943197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c0f6b00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f6a7c004660 tx=0x7f6a7c009b30).stop 2022-02-02T15:12:45.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 -- 172.21.15.33:0/3028943197 shutdown_connections 2022-02-02T15:12:45.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/3028943197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/3028943197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c0f6b00 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 -- 172.21.15.33:0/3028943197 >> 172.21.15.33:0/3028943197 conn(0x7f6a8c0f1e40 msgr2=0x7f6a8c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:45.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 -- 172.21.15.33:0/3028943197 shutdown_connections 2022-02-02T15:12:45.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.394+0000 7f6a91b4d700 1 -- 172.21.15.33:0/3028943197 wait complete. 2022-02-02T15:12:45.388 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.395+0000 7f6a91b4d700 1 Processor -- start 2022-02-02T15:12:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.395+0000 7f6a91b4d700 1 -- start start 2022-02-02T15:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.395+0000 7f6a91b4d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.395+0000 7f6a91b4d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a91b4d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c06a380 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a91b4d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c06a4c0 con 0x7f6a8c0f7980 2022-02-02T15:12:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36468/0 (socket says 172.21.15.33:36468) 2022-02-02T15:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 -- 172.21.15.33:0/2030572865 learned_addr learned my addr 172.21.15.33:0/2030572865 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8affd700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 -- 172.21.15.33:0/2030572865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 msgr2=0x7f6a8c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 -- 172.21.15.33:0/2030572865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c005040 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8affd700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:12:45.393 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.396+0000 7f6a8b7fe700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f6a7c004f60 tx=0x7f6a7c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.397+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c018070 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.397+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6a7c007ba0 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.397+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c06a740 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.397+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a7c01c620 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.394 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.397+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c06aca0 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.398+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c045ad0 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.398+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6a7c01c890 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.399+0000 7f6a83fff700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 0x7f6a78067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.395 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.399+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6a7c083910 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.399+0000 7f6a8affd700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 0x7f6a78067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.399+0000 7f6a8affd700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 0x7f6a78067290 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f6a74004a90 tx=0x7f6a74009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:45.396 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.403+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6a7c051aa0 con 0x7f6a8c0f66e0 2022-02-02T15:12:45.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.601+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a8c0fefe0 con 0x7f6a78064dd0 2022-02-02T15:12:45.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.603+0000 7f6a83fff700 1 -- 172.21.15.33:0/2030572865 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f6a8c0fefe0 con 0x7f6a78064dd0 2022-02-02T15:12:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 msgr2=0x7f6a78067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 0x7f6a78067290 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f6a74004a90 tx=0x7f6a74009040).stop 2022-02-02T15:12:45.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 msgr2=0x7f6a8c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f6a7c004f60 tx=0x7f6a7c009b30).stop 2022-02-02T15:12:45.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 shutdown_connections 2022-02-02T15:12:45.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6a78064dd0 0x7f6a78067290 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a8c0f66e0 0x7f6a8c06b9a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 --2- 172.21.15.33:0/2030572865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a8c0f7980 0x7f6a8c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.604+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 >> 172.21.15.33:0/2030572865 conn(0x7f6a8c0f1e40 msgr2=0x7f6a8c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:45.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.605+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 shutdown_connections 2022-02-02T15:12:45.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.605+0000 7f6a91b4d700 1 -- 172.21.15.33:0/2030572865 wait complete. 2022-02-02T15:12:45.605 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 -- 172.21.15.33:0/2662208503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 msgr2=0x7fec6c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 --2- 172.21.15.33:0/2662208503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c0f7de0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7fec54004660 tx=0x7fec54009b30).stop 2022-02-02T15:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 -- 172.21.15.33:0/2662208503 shutdown_connections 2022-02-02T15:12:45.696 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 --2- 172.21.15.33:0/2662208503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c0f7de0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 --2- 172.21.15.33:0/2662208503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 0x7fec6c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 -- 172.21.15.33:0/2662208503 >> 172.21.15.33:0/2662208503 conn(0x7fec6c0f1e40 msgr2=0x7fec6c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:45.697 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.705+0000 7fec71d7c700 1 -- 172.21.15.33:0/2662208503 shutdown_connections 2022-02-02T15:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.706+0000 7fec71d7c700 1 -- 172.21.15.33:0/2662208503 wait complete. 2022-02-02T15:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.706+0000 7fec71d7c700 1 Processor -- start 2022-02-02T15:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.706+0000 7fec71d7c700 1 -- start start 2022-02-02T15:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec71d7c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 0x7fec6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.699 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec71d7c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec71d7c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c06a380 con 0x7fec6c0f7980 2022-02-02T15:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec71d7c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c06a4c0 con 0x7fec6c0f66e0 2022-02-02T15:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.700 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 0x7fec6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36480/0 (socket says 172.21.15.33:36480) 2022-02-02T15:12:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 -- 172.21.15.33:0/270669167 learned_addr learned my addr 172.21.15.33:0/270669167 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 -- 172.21.15.33:0/270669167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 msgr2=0x7fec6c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 0x7fec6c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.701 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 -- 172.21.15.33:0/270669167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec54005040 con 0x7fec6c0f7980 2022-02-02T15:12:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.707+0000 7fec6affd700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fec54009990 tx=0x7fec54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.708+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec54018070 con 0x7fec6c0f7980 2022-02-02T15:12:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.708+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fec54007ba0 con 0x7fec6c0f7980 2022-02-02T15:12:45.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.708+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c06a740 con 0x7fec6c0f7980 2022-02-02T15:12:45.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.708+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec5401c3c0 con 0x7fec6c0f7980 2022-02-02T15:12:45.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.708+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c06aca0 con 0x7fec6c0f7980 2022-02-02T15:12:45.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.709+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec6c045ad0 con 0x7fec6c0f7980 2022-02-02T15:12:45.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.709+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fec5401d420 con 0x7fec6c0f7980 2022-02-02T15:12:45.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.710+0000 7fec63fff700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 0x7fec58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:45.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.710+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fec540836f0 con 0x7fec6c0f7980 2022-02-02T15:12:45.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.710+0000 7fec6b7fe700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 0x7fec58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:45.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.710+0000 7fec6b7fe700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 0x7fec58067290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fec6c06b730 tx=0x7fec5c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:45.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.714+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fec54051860 con 0x7fec6c0f7980 2022-02-02T15:12:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.899+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fec6c057f10 con 0x7fec58064dd0 2022-02-02T15:12:45.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.913+0000 7fec63fff700 1 -- 172.21.15.33:0/270669167 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7fec6c057f10 con 0x7fec58064dd0 2022-02-02T15:12:45.904 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:12:45.905 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (98m) 60m ago 99m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:12:45.905 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (91m) 60m ago 99m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:12:45.905 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (91m) 60m ago 98m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:12:45.905 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (97m) 60m ago 98m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:12:45.905 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (91m) 60m ago 95m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:12:45.906 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (92m) 60m ago 95m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:12:45.906 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (92m) 60m ago 95m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:12:45.906 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (95m) 60m ago 95m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:12:45.906 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (92m) 60m ago 100m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:12:45.907 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (92m) 60m ago 98m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:12:45.907 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (92m) 60m ago 100m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:12:45.907 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (91m) 60m ago 98m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:12:45.907 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (98m) 60m ago 98m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:12:45.907 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (98m) 60m ago 98m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:12:45.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 60m ago 97m - 4096M 2022-02-02T15:12:45.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (97m) 60m ago 97m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:12:45.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (97m) 60m ago 97m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:12:45.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (96m) 60m ago 96m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:12:45.908 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (96m) 60m ago 96m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:12:45.909 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (96m) 60m ago 96m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:12:45.909 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (97m) 60m ago 98m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:12:45.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 msgr2=0x7fec58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 0x7fec58067290 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fec6c06b730 tx=0x7fec5c00b040).stop 2022-02-02T15:12:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 msgr2=0x7fec6c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7fec54009990 tx=0x7fec54009b30).stop 2022-02-02T15:12:45.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 shutdown_connections 2022-02-02T15:12:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fec58064dd0 0x7fec58067290 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec6c0f66e0 0x7fec6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 --2- 172.21.15.33:0/270669167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec6c0f7980 0x7fec6c069e20 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:45.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 >> 172.21.15.33:0/270669167 conn(0x7fec6c0f1e40 msgr2=0x7fec6c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 shutdown_connections 2022-02-02T15:12:45.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:45.915+0000 7fec71d7c700 1 -- 172.21.15.33:0/270669167 wait complete. 2022-02-02T15:12:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 -- 172.21.15.33:0/1624457376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 msgr2=0x7f26540f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 --2- 172.21.15.33:0/1624457376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f26540f6b00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f2644004660 tx=0x7f2644009b30).stop 2022-02-02T15:12:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 -- 172.21.15.33:0/1624457376 shutdown_connections 2022-02-02T15:12:46.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 --2- 172.21.15.33:0/1624457376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 0x7f26540f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 --2- 172.21.15.33:0/1624457376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f26540f6b00 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 -- 172.21.15.33:0/1624457376 >> 172.21.15.33:0/1624457376 conn(0x7f26540f1e40 msgr2=0x7f26540f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 -- 172.21.15.33:0/1624457376 shutdown_connections 2022-02-02T15:12:46.008 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.016+0000 7f265a4a4700 1 -- 172.21.15.33:0/1624457376 wait complete. 2022-02-02T15:12:46.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 Processor -- start 2022-02-02T15:12:46.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 -- start start 2022-02-02T15:12:46.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 0x7f2654107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654107a00 con 0x7f26540f66e0 2022-02-02T15:12:46.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f265a4a4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2654107b40 con 0x7f26540f7980 2022-02-02T15:12:46.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f2653fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f2653fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36488/0 (socket says 172.21.15.33:36488) 2022-02-02T15:12:46.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f2653fff700 1 -- 172.21.15.33:0/3164032825 learned_addr learned my addr 172.21.15.33:0/3164032825 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:46.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.017+0000 7f26537fe700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 0x7f2654107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2653fff700 1 -- 172.21.15.33:0/3164032825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 msgr2=0x7f2654107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2653fff700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 0x7f2654107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2653fff700 1 -- 172.21.15.33:0/3164032825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644005040 con 0x7f26540f66e0 2022-02-02T15:12:46.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2653fff700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2644014040 tx=0x7f264400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:46.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2644019070 con 0x7f26540f66e0 2022-02-02T15:12:46.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2644007e70 con 0x7f26540f66e0 2022-02-02T15:12:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2644014d10 con 0x7f26540f66e0 2022-02-02T15:12:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2654108480 con 0x7f26540f66e0 2022-02-02T15:12:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.018+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26541089e0 con 0x7f26540f66e0 2022-02-02T15:12:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.019+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2654045ad0 con 0x7f26540f66e0 2022-02-02T15:12:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.020+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2644025070 con 0x7f26540f66e0 2022-02-02T15:12:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.020+0000 7f2650ff9700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 0x7f263c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.020+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2644082a90 con 0x7f26540f66e0 2022-02-02T15:12:46.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.020+0000 7f26537fe700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 0x7f263c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.020+0000 7f26537fe700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 0x7f263c067290 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f2648009fd0 tx=0x7f264800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.024+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2644054570 con 0x7f26540f66e0 2022-02-02T15:12:46.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.269+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f26540fef70 con 0x7f26540f66e0 2022-02-02T15:12:46.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.270+0000 7f2650ff9700 1 -- 172.21.15.33:0/3164032825 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f2644023020 con 0x7f26540f66e0 2022-02-02T15:12:46.261 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:12:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:12:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:12:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:46.262 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:12:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:12:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:12:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:12:46.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:12:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:12:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:12:46.264 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:12:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:12:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:12:46.265 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:12:46.265 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:12:46.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.272+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 msgr2=0x7f263c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.272+0000 7f265a4a4700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 0x7f263c067290 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f2648009fd0 tx=0x7f264800b040).stop 2022-02-02T15:12:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.272+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 msgr2=0x7f2654106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7f2644014040 tx=0x7f264400b040).stop 2022-02-02T15:12:46.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 shutdown_connections 2022-02-02T15:12:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f263c064dd0 0x7f263c067290 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26540f66e0 0x7f2654106f60 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 --2- 172.21.15.33:0/3164032825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26540f7980 0x7f2654107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 >> 172.21.15.33:0/3164032825 conn(0x7f26540f1e40 msgr2=0x7f26540fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:46.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 shutdown_connections 2022-02-02T15:12:46.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.273+0000 7f265a4a4700 1 -- 172.21.15.33:0/3164032825 wait complete. 2022-02-02T15:12:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 -- 172.21.15.33:0/2675977215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 msgr2=0x7f614c0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 --2- 172.21.15.33:0/2675977215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c0f59e0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f613c004660 tx=0x7f613c009b30).stop 2022-02-02T15:12:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 -- 172.21.15.33:0/2675977215 shutdown_connections 2022-02-02T15:12:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 --2- 172.21.15.33:0/2675977215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 --2- 172.21.15.33:0/2675977215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c0f59e0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 -- 172.21.15.33:0/2675977215 >> 172.21.15.33:0/2675977215 conn(0x7f614c0f0d40 msgr2=0x7f614c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 -- 172.21.15.33:0/2675977215 shutdown_connections 2022-02-02T15:12:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.374+0000 7f615182f700 1 -- 172.21.15.33:0/2675977215 wait complete. 2022-02-02T15:12:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 Processor -- start 2022-02-02T15:12:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 -- start start 2022-02-02T15:12:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c10c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0603c0 con 0x7f614c0f55c0 2022-02-02T15:12:46.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f615182f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c060500 con 0x7f614c0f6860 2022-02-02T15:12:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f614affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f614affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36498/0 (socket says 172.21.15.33:36498) 2022-02-02T15:12:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f614affd700 1 -- 172.21.15.33:0/3468526875 learned_addr learned my addr 172.21.15.33:0/3468526875 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:12:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.375+0000 7f614a7fc700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c10c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f614affd700 1 -- 172.21.15.33:0/3468526875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 msgr2=0x7f614c10c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f614affd700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c10c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f614affd700 1 -- 172.21.15.33:0/3468526875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c005040 con 0x7f614c0f55c0 2022-02-02T15:12:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f614a7fc700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:12:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f614affd700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f613c013a70 tx=0x7f613c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c018070 con 0x7f614c0f55c0 2022-02-02T15:12:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f613c0097d0 con 0x7f614c0f55c0 2022-02-02T15:12:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c10c6e0 con 0x7f614c0f55c0 2022-02-02T15:12:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f613c01c3c0 con 0x7f614c0f55c0 2022-02-02T15:12:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.376+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c10cc10 con 0x7f614c0f55c0 2022-02-02T15:12:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.377+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c0f49b0 con 0x7f614c0f55c0 2022-02-02T15:12:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.378+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f613c007ba0 con 0x7f614c0f55c0 2022-02-02T15:12:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.378+0000 7f61437fe700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 0x7f6138067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:12:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.378+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f613c083770 con 0x7f614c0f55c0 2022-02-02T15:12:46.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.378+0000 7f614a7fc700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 0x7f6138067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:12:46.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.379+0000 7f614a7fc700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 0x7f6138067290 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f6134009740 tx=0x7f6134009be0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:12:46.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.382+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f613c051820 con 0x7f614c0f55c0 2022-02-02T15:12:46.584 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.594+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f614c0fde90 con 0x7f614c0f55c0 2022-02-02T15:12:46.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.594+0000 7f61437fe700 1 -- 172.21.15.33:0/3468526875 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f613c051020 con 0x7f614c0f55c0 2022-02-02T15:12:46.585 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:12:46.586 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:12:46.586 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:12:46.586 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:12:46.586 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:46.586 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:12:46.587 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:12:46.587 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:12:46.587 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:12:46.587 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:12:46.588 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:12:46.588 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:12:46.588 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:12:46.588 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:12:46.588 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:12:46.589 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:12:46.589 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:12:46.589 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:12:46.589 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:12:46.590 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:12:46.590 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:12:46.590 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:12:46.590 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:12:46.590 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:12:46.591 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:12:46.591 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:12:46.591 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:12:46.591 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:46.592 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:12:46.593 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:12:46.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:46.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:46.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:46.593 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:12:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.596+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 msgr2=0x7f6138067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.596+0000 7f615182f700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 0x7f6138067290 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f6134009740 tx=0x7f6134009be0).stop 2022-02-02T15:12:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.596+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 msgr2=0x7f614c109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:12:46.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.596+0000 7f615182f700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 rx=0x7f613c013a70 tx=0x7f613c009b30).stop 2022-02-02T15:12:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 shutdown_connections 2022-02-02T15:12:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6138064dd0 0x7f6138067290 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f614c0f55c0 0x7f614c109c90 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 --2- 172.21.15.33:0/3468526875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f614c0f6860 0x7f614c10c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:12:46.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 >> 172.21.15.33:0/3468526875 conn(0x7f614c0f0d40 msgr2=0x7f614c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:12:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 shutdown_connections 2022-02-02T15:12:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:12:46.597+0000 7f615182f700 1 -- 172.21.15.33:0/3468526875 wait complete. 2022-02-02T15:12:46.597 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:12:46.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:46 smithi033 ceph-mon[101165]: from='client.36962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:46.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:46 smithi033 ceph-mon[101165]: pgmap v2821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:46.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3164032825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:12:46.982 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:46 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3468526875' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:12:47.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:46 smithi037 ceph-mon[69017]: from='client.36962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:47.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:46 smithi037 ceph-mon[69017]: pgmap v2821: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:47.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3164032825' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:12:47.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:46 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3468526875' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:12:48.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:47 smithi033 ceph-mon[101165]: from='client.36966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:48.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:47 smithi037 ceph-mon[69017]: from='client.36966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:12:49.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:48 smithi033 ceph-mon[101165]: pgmap v2822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:49.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:48 smithi037 ceph-mon[69017]: pgmap v2822: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:51.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:50 smithi033 ceph-mon[101165]: pgmap v2823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:51.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:50 smithi037 ceph-mon[69017]: pgmap v2823: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:53.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:52 smithi033 ceph-mon[101165]: pgmap v2824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:53.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:52 smithi037 ceph-mon[69017]: pgmap v2824: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:54 smithi033 ceph-mon[101165]: pgmap v2825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:12:55.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:12:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:54 smithi037 ceph-mon[69017]: pgmap v2825: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:12:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:12:57.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:56 smithi033 ceph-mon[101165]: pgmap v2826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:56 smithi037 ceph-mon[69017]: pgmap v2826: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:58.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:12:57 smithi033 ceph-mon[101165]: pgmap v2827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:12:58.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:12:57 smithi037 ceph-mon[69017]: pgmap v2827: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:00 smithi033 ceph-mon[101165]: pgmap v2828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:01.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:00 smithi037 ceph-mon[69017]: pgmap v2828: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:03.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:02 smithi033 ceph-mon[101165]: pgmap v2829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:03.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:02 smithi037 ceph-mon[69017]: pgmap v2829: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:05.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:04 smithi033 ceph-mon[101165]: pgmap v2830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:05.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:04 smithi037 ceph-mon[69017]: pgmap v2830: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:07.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:06 smithi033 ceph-mon[101165]: pgmap v2831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:07.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:06 smithi037 ceph-mon[69017]: pgmap v2831: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:08.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:07 smithi033 ceph-mon[101165]: pgmap v2832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:08.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:07 smithi037 ceph-mon[69017]: pgmap v2832: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:11.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:10 smithi033 ceph-mon[101165]: pgmap v2833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:11.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:10 smithi037 ceph-mon[69017]: pgmap v2833: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:13.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:12 smithi033 ceph-mon[101165]: pgmap v2834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:13.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:12 smithi037 ceph-mon[69017]: pgmap v2834: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:15.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:14 smithi033 ceph-mon[101165]: pgmap v2835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:15.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:14 smithi037 ceph-mon[69017]: pgmap v2835: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:16.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 -- 172.21.15.33:0/3827889401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 msgr2=0x7f9ef80f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:16.704 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3827889401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef80f8d00 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f9eec004660 tx=0x7f9eec009b30).stop 2022-02-02T15:13:16.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 -- 172.21.15.33:0/3827889401 shutdown_connections 2022-02-02T15:13:16.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3827889401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 0x7f9ef80f9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3827889401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef80f8d00 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 -- 172.21.15.33:0/3827889401 >> 172.21.15.33:0/3827889401 conn(0x7f9ef80f40e0 msgr2=0x7f9ef80f64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:16.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 -- 172.21.15.33:0/3827889401 shutdown_connections 2022-02-02T15:13:16.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.713+0000 7f9efee4f700 1 -- 172.21.15.33:0/3827889401 wait complete. 2022-02-02T15:13:16.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 Processor -- start 2022-02-02T15:13:16.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 -- start start 2022-02-02T15:13:16.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:16.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 0x7f9ef81096b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:16.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109c60 con 0x7f9ef80f88e0 2022-02-02T15:13:16.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efee4f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8109da0 con 0x7f9ef80f9b80 2022-02-02T15:13:16.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efcbeb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:16.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efcbeb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36508/0 (socket says 172.21.15.33:36508) 2022-02-02T15:13:16.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9efcbeb700 1 -- 172.21.15.33:0/3513123932 learned_addr learned my addr 172.21.15.33:0/3513123932 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:16.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.714+0000 7f9ef7fff700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 0x7f9ef81096b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:16.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efcbeb700 1 -- 172.21.15.33:0/3513123932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 msgr2=0x7f9ef81096b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:16.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efcbeb700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 0x7f9ef81096b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efcbeb700 1 -- 172.21.15.33:0/3513123932 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec005040 con 0x7f9ef80f88e0 2022-02-02T15:13:16.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efcbeb700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f9eec009830 tx=0x7f9eec009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:16.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec018070 con 0x7f9ef80f88e0 2022-02-02T15:13:16.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9eec007ba0 con 0x7f9ef80f88e0 2022-02-02T15:13:16.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef810a6e0 con 0x7f9ef80f88e0 2022-02-02T15:13:16.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec01de60 con 0x7f9ef80f88e0 2022-02-02T15:13:16.712 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.715+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef810ac40 con 0x7f9ef80f88e0 2022-02-02T15:13:16.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.716+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef8045ad0 con 0x7f9ef80f88e0 2022-02-02T15:13:16.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.717+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9eec007d10 con 0x7f9ef80f88e0 2022-02-02T15:13:16.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.717+0000 7f9ef57fa700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 0x7f9ee8067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:16.713 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.717+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9eec083590 con 0x7f9ef80f88e0 2022-02-02T15:13:16.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.717+0000 7f9ef7fff700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 0x7f9ee8067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:16.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.718+0000 7f9ef7fff700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 0x7f9ee8067270 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f9ee4004c40 tx=0x7f9ee400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:16.714 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.722+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9eec0550d0 con 0x7f9ef80f88e0 2022-02-02T15:13:16.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.910+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ef8101220 con 0x7f9ee8064db0 2022-02-02T15:13:16.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.911+0000 7f9ef57fa700 1 -- 172.21.15.33:0/3513123932 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9ef8101220 con 0x7f9ee8064db0 2022-02-02T15:13:16.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.913+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 msgr2=0x7f9ee8067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.913+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 0x7f9ee8067270 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f9ee4004c40 tx=0x7f9ee400b040).stop 2022-02-02T15:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.913+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 msgr2=0x7f9ef81091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.913+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7f9eec009830 tx=0x7f9eec009b30).stop 2022-02-02T15:13:16.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 shutdown_connections 2022-02-02T15:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9ee8064db0 0x7f9ee8067270 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef80f88e0 0x7f9ef81091c0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 --2- 172.21.15.33:0/3513123932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80f9b80 0x7f9ef81096b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 >> 172.21.15.33:0/3513123932 conn(0x7f9ef80f40e0 msgr2=0x7f9ef80fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:16.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 shutdown_connections 2022-02-02T15:13:16.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:16.914+0000 7f9efee4f700 1 -- 172.21.15.33:0/3513123932 wait complete. 2022-02-02T15:13:16.914 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:13:16.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:16 smithi033 ceph-mon[101165]: pgmap v2836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 -- 172.21.15.33:0/1613556509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f55c0 msgr2=0x7f13b40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 --2- 172.21.15.33:0/1613556509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f55c0 0x7f13b40f59e0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7f13a40099e0 tx=0x7f13a4004d10).stop 2022-02-02T15:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 -- 172.21.15.33:0/1613556509 shutdown_connections 2022-02-02T15:13:17.006 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 --2- 172.21.15.33:0/1613556509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f6860 0x7f13b40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 --2- 172.21.15.33:0/1613556509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f55c0 0x7f13b40f59e0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 -- 172.21.15.33:0/1613556509 >> 172.21.15.33:0/1613556509 conn(0x7f13b40f0d40 msgr2=0x7f13b40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 -- 172.21.15.33:0/1613556509 shutdown_connections 2022-02-02T15:13:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.015+0000 7f13b96b3700 1 -- 172.21.15.33:0/1613556509 wait complete. 2022-02-02T15:13:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 Processor -- start 2022-02-02T15:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 -- start start 2022-02-02T15:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f55c0 0x7f13b4105f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4106a00 con 0x7f13b40f6860 2022-02-02T15:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b96b3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4106b40 con 0x7f13b40f55c0 2022-02-02T15:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36520/0 (socket says 172.21.15.33:36520) 2022-02-02T15:13:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b27fc700 1 -- 172.21.15.33:0/706964727 learned_addr learned my addr 172.21.15.33:0/706964727 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.016+0000 7f13b2ffd700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f55c0 0x7f13b4105f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b27fc700 1 -- 172.21.15.33:0/706964727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f55c0 msgr2=0x7f13b4105f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b27fc700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f55c0 0x7f13b4105f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b27fc700 1 -- 172.21.15.33:0/706964727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009640 con 0x7f13b40f6860 2022-02-02T15:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b27fc700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f13a80026d0 tx=0x7f13a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13a80079c0 con 0x7f13b40f6860 2022-02-02T15:13:17.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f13a800f040 con 0x7f13b40f6860 2022-02-02T15:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b41074e0 con 0x7f13b40f6860 2022-02-02T15:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13a80148b0 con 0x7f13b40f6860 2022-02-02T15:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.017+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b4107a20 con 0x7f13b40f6860 2022-02-02T15:13:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.018+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b4045ad0 con 0x7f13b40f6860 2022-02-02T15:13:17.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.019+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f13a8007b20 con 0x7f13b40f6860 2022-02-02T15:13:17.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.019+0000 7f139b7fe700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 0x7f139c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.019+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f13a8081a30 con 0x7f13b40f6860 2022-02-02T15:13:17.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.019+0000 7f13b2ffd700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 0x7f139c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.019+0000 7f13b2ffd700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 0x7f139c067290 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f13a400b730 tx=0x7f13a4004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.023+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f13a8053510 con 0x7f13b40f6860 2022-02-02T15:13:17.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.204+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f13b4107ca0 con 0x7f139c064dd0 2022-02-02T15:13:17.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.219+0000 7f139b7fe700 1 -- 172.21.15.33:0/706964727 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f13b4107ca0 con 0x7f139c064dd0 2022-02-02T15:13:17.210 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:13:17.210 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (98m) 60m ago 99m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:13:17.210 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (91m) 60m ago 99m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:13:17.210 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (91m) 60m ago 99m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:13:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (98m) 60m ago 99m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:13:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (92m) 60m ago 95m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:13:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (92m) 60m ago 95m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:13:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (93m) 60m ago 95m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:13:17.211 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (95m) 60m ago 95m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:13:17.212 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (93m) 60m ago 100m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:13:17.212 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (92m) 60m ago 99m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:13:17.212 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (92m) 60m ago 101m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:13:17.212 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (92m) 60m ago 98m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:13:17.212 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (99m) 60m ago 99m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:13:17.213 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (98m) 60m ago 98m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:13:17.213 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 60m ago 98m - 4096M 2022-02-02T15:13:17.213 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (97m) 60m ago 97m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:13:17.213 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (97m) 60m ago 97m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:13:17.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (97m) 60m ago 97m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:13:17.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (97m) 60m ago 97m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:13:17.214 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (96m) 60m ago 96m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:13:17.214 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (98m) 60m ago 99m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:13:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 msgr2=0x7f139c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 0x7f139c067290 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f13a400b730 tx=0x7f13a4004d10).stop 2022-02-02T15:13:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 msgr2=0x7f13b4106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7f13a80026d0 tx=0x7f13a8009de0).stop 2022-02-02T15:13:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 shutdown_connections 2022-02-02T15:13:17.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f139c064dd0 0x7f139c067290 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40f55c0 0x7f13b4105f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 --2- 172.21.15.33:0/706964727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13b40f6860 0x7f13b4106450 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 >> 172.21.15.33:0/706964727 conn(0x7f13b40f0d40 msgr2=0x7f13b40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 shutdown_connections 2022-02-02T15:13:17.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.221+0000 7f13b96b3700 1 -- 172.21.15.33:0/706964727 wait complete. 2022-02-02T15:13:17.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:16 smithi037 ceph-mon[69017]: pgmap v2836: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.321+0000 7f3c31775700 1 -- 172.21.15.33:0/1980140608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f6530 msgr2=0x7f3c2c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.321+0000 7f3c31775700 1 --2- 172.21.15.33:0/1980140608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c0f6950 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7f3c1c004660 tx=0x7f3c1c009b30).stop 2022-02-02T15:13:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 -- 172.21.15.33:0/1980140608 shutdown_connections 2022-02-02T15:13:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 --2- 172.21.15.33:0/1980140608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 --2- 172.21.15.33:0/1980140608 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c0f6950 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 -- 172.21.15.33:0/1980140608 >> 172.21.15.33:0/1980140608 conn(0x7f3c2c0f1c90 msgr2=0x7f3c2c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 -- 172.21.15.33:0/1980140608 shutdown_connections 2022-02-02T15:13:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 -- 172.21.15.33:0/1980140608 wait complete. 2022-02-02T15:13:17.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 Processor -- start 2022-02-02T15:13:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.322+0000 7f3c31775700 1 -- start start 2022-02-02T15:13:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c31775700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c31775700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c31775700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c107880 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c31775700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2c108090 con 0x7f3c2c0f6530 2022-02-02T15:13:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36530/0 (socket says 172.21.15.33:36530) 2022-02-02T15:13:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 -- 172.21.15.33:0/3314116530 learned_addr learned my addr 172.21.15.33:0/3314116530 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2bfff700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 -- 172.21.15.33:0/3314116530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f6530 msgr2=0x7f3c2c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 -- 172.21.15.33:0/3314116530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c005040 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.323+0000 7f3c2b7fe700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f3c14002700 tx=0x7f3c14009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.324+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c14009320 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.324+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f3c1400f040 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.324+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2c108310 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.324+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c14014870 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.324+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c2c1088d0 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.325+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c2c059100 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.325+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3c14009480 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.326+0000 7f3c28ff9700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 0x7f3c180672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.326+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f3c14081d50 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.326+0000 7f3c2bfff700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 0x7f3c180672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.326+0000 7f3c2bfff700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 0x7f3c180672e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f3c1c013690 tx=0x7f3c1c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.330+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3c1404fe00 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.564 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.574+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c2c0fedf0 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.574+0000 7f3c28ff9700 1 -- 172.21.15.33:0/3314116530 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f3c14053420 con 0x7f3c2c0f77d0 2022-02-02T15:13:17.565 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:13:17.566 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:13:17.566 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:13:17.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:17.566 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:13:17.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:13:17.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:17.567 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:13:17.567 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:13:17.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:17.568 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:13:17.568 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:13:17.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:17.569 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:13:17.569 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:13:17.569 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:13:17.569 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:13:17.569 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:13:17.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 msgr2=0x7f3c180672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.570 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 0x7f3c180672e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f3c1c013690 tx=0x7f3c1c009b30).stop 2022-02-02T15:13:17.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 msgr2=0x7f3c2c107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7f3c14002700 tx=0x7f3c14009e00).stop 2022-02-02T15:13:17.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 shutdown_connections 2022-02-02T15:13:17.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3c18064e20 0x7f3c180672e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c2c0f6530 0x7f3c2c106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 --2- 172.21.15.33:0/3314116530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c2c0f77d0 0x7f3c2c107280 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 >> 172.21.15.33:0/3314116530 conn(0x7f3c2c0f1c90 msgr2=0x7f3c2c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 shutdown_connections 2022-02-02T15:13:17.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.576+0000 7f3c31775700 1 -- 172.21.15.33:0/3314116530 wait complete. 2022-02-02T15:13:17.669 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 -- 172.21.15.33:0/2532986057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 msgr2=0x7faffc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 --2- 172.21.15.33:0/2532986057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc0f59e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7faff8004660 tx=0x7faff8009b30).stop 2022-02-02T15:13:17.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 -- 172.21.15.33:0/2532986057 shutdown_connections 2022-02-02T15:13:17.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 --2- 172.21.15.33:0/2532986057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 0x7faffc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 --2- 172.21.15.33:0/2532986057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc0f59e0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 -- 172.21.15.33:0/2532986057 >> 172.21.15.33:0/2532986057 conn(0x7faffc0f0d40 msgr2=0x7faffc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 -- 172.21.15.33:0/2532986057 shutdown_connections 2022-02-02T15:13:17.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.677+0000 7fb0043e9700 1 -- 172.21.15.33:0/2532986057 wait complete. 2022-02-02T15:13:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 Processor -- start 2022-02-02T15:13:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 -- start start 2022-02-02T15:13:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 0x7faffc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc107a10 con 0x7faffc0f55c0 2022-02-02T15:13:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb0043e9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faffc107b50 con 0x7faffc0f6860 2022-02-02T15:13:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36538/0 (socket says 172.21.15.33:36538) 2022-02-02T15:13:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 -- 172.21.15.33:0/1706884385 learned_addr learned my addr 172.21.15.33:0/1706884385 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:17.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb001984700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 0x7faffc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 -- 172.21.15.33:0/1706884385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 msgr2=0x7faffc107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 0x7faffc107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.678+0000 7fb002185700 1 -- 172.21.15.33:0/1706884385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8005040 con 0x7faffc0f55c0 2022-02-02T15:13:17.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fb002185700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7faff8013a70 tx=0x7faff8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff8018070 con 0x7faffc0f55c0 2022-02-02T15:13:17.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faffc108490 con 0x7faffc0f55c0 2022-02-02T15:13:17.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7faff80097d0 con 0x7faffc0f55c0 2022-02-02T15:13:17.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faff801de80 con 0x7faffc0f55c0 2022-02-02T15:13:17.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.679+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faffc1089f0 con 0x7faffc0f55c0 2022-02-02T15:13:17.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.680+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faffc045ad0 con 0x7faffc0f55c0 2022-02-02T15:13:17.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.680+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7faff8007ba0 con 0x7faffc0f55c0 2022-02-02T15:13:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.681+0000 7fafeeffd700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 0x7fafe8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.681+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7faff80836a0 con 0x7faffc0f55c0 2022-02-02T15:13:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.681+0000 7fb001984700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 0x7fafe8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.681+0000 7fb001984700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 0x7fafe8067290 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7faff0004c40 tx=0x7faff000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.685+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7faff8055180 con 0x7faffc0f55c0 2022-02-02T15:13:17.891 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.900+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faffc0fdf00 con 0x7faffc0f55c0 2022-02-02T15:13:17.892 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.901+0000 7fafeeffd700 1 -- 172.21.15.33:0/1706884385 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7faff8054d70 con 0x7faffc0f55c0 2022-02-02T15:13:17.892 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:13:17.892 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:13:17.892 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:13:17.893 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:13:17.893 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:17.893 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:13:17.893 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:13:17.894 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:13:17.894 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:13:17.894 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:13:17.894 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:13:17.894 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:13:17.895 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:13:17.895 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:13:17.895 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:13:17.895 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:13:17.896 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:13:17.896 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:13:17.896 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:13:17.896 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:13:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:13:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:13:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:13:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:13:17.897 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:13:17.898 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:13:17.898 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:13:17.898 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:13:17.898 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:13:17.899 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:13:17.899 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:13:17.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:17.899 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:17.899 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:13:17.900 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:17.900 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:17.900 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:17.900 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:17.901 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:17.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 msgr2=0x7fafe8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 0x7fafe8067290 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7faff0004c40 tx=0x7faff000b040).stop 2022-02-02T15:13:17.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 msgr2=0x7faffc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:17.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7faff8013a70 tx=0x7faff8009b30).stop 2022-02-02T15:13:17.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 shutdown_connections 2022-02-02T15:13:17.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fafe8064dd0 0x7fafe8067290 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faffc0f55c0 0x7faffc106f70 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 --2- 172.21.15.33:0/1706884385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faffc0f6860 0x7faffc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:17.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 >> 172.21.15.33:0/1706884385 conn(0x7faffc0f0d40 msgr2=0x7faffc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:17.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 shutdown_connections 2022-02-02T15:13:17.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:17.904+0000 7fb0043e9700 1 -- 172.21.15.33:0/1706884385 wait complete. 2022-02-02T15:13:17.904 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:13:18.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:17 smithi033 ceph-mon[101165]: from='client.36978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:18.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:17 smithi033 ceph-mon[101165]: from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:18.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:17 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3314116530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:13:18.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:17 smithi033 ceph-mon[101165]: pgmap v2837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:18.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:17 smithi037 ceph-mon[69017]: from='client.36978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:18.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:17 smithi037 ceph-mon[69017]: from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:18.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:17 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3314116530' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:13:18.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:17 smithi037 ceph-mon[69017]: pgmap v2837: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:19.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:18 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1706884385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:13:19.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:18 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1706884385' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:13:20.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:19 smithi033 ceph-mon[101165]: pgmap v2838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:20.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:19 smithi037 ceph-mon[69017]: pgmap v2838: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:23.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:22 smithi033 ceph-mon[101165]: pgmap v2839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:23.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:22 smithi037 ceph-mon[69017]: pgmap v2839: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:25.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:24 smithi033 ceph-mon[101165]: pgmap v2840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:25.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:24 smithi037 ceph-mon[69017]: pgmap v2840: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:27.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:26 smithi033 ceph-mon[101165]: pgmap v2841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:27.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:26 smithi037 ceph-mon[69017]: pgmap v2841: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:28.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:27 smithi033 ceph-mon[101165]: pgmap v2842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:27 smithi037 ceph-mon[69017]: pgmap v2842: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:31.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:30 smithi033 ceph-mon[101165]: pgmap v2843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:31.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:30 smithi037 ceph-mon[69017]: pgmap v2843: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:33.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:32 smithi033 ceph-mon[101165]: pgmap v2844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:33.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:32 smithi037 ceph-mon[69017]: pgmap v2844: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:35.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:34 smithi033 ceph-mon[101165]: pgmap v2845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:35.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:34 smithi037 ceph-mon[69017]: pgmap v2845: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:37.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:36 smithi033 ceph-mon[101165]: pgmap v2846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:37.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:36 smithi037 ceph-mon[69017]: pgmap v2846: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:38.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:37 smithi033 ceph-mon[101165]: pgmap v2847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:38.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:37 smithi037 ceph-mon[69017]: pgmap v2847: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:41.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:40 smithi033 ceph-mon[101165]: pgmap v2848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:41.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:40 smithi037 ceph-mon[69017]: pgmap v2848: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:43.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:42 smithi033 ceph-mon[101165]: pgmap v2849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:43.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:42 smithi037 ceph-mon[69017]: pgmap v2849: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:45.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:44 smithi033 ceph-mon[101165]: pgmap v2850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:45.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:44 smithi037 ceph-mon[69017]: pgmap v2850: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:47.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:46 smithi033 ceph-mon[101165]: pgmap v2851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:47.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:46 smithi037 ceph-mon[69017]: pgmap v2851: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 -- 172.21.15.33:0/417479202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f66e0 msgr2=0x7f1ac80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 --2- 172.21.15.33:0/417479202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f66e0 0x7f1ac80f6b00 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 rx=0x7f1ab0004660 tx=0x7f1ab0009b30).stop 2022-02-02T15:13:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 -- 172.21.15.33:0/417479202 shutdown_connections 2022-02-02T15:13:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 --2- 172.21.15.33:0/417479202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f7980 0x7f1ac80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 --2- 172.21.15.33:0/417479202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f66e0 0x7f1ac80f6b00 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.013 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 -- 172.21.15.33:0/417479202 >> 172.21.15.33:0/417479202 conn(0x7f1ac80f1e40 msgr2=0x7f1ac80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 -- 172.21.15.33:0/417479202 shutdown_connections 2022-02-02T15:13:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.019+0000 7f1acca91700 1 -- 172.21.15.33:0/417479202 wait complete. 2022-02-02T15:13:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 Processor -- start 2022-02-02T15:13:48.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 -- start start 2022-02-02T15:13:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f66e0 0x7f1ac806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac806a380 con 0x7f1ac80f7980 2022-02-02T15:13:48.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1acca91700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac806a4c0 con 0x7f1ac80f66e0 2022-02-02T15:13:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.020+0000 7f1ac5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36550/0 (socket says 172.21.15.33:36550) 2022-02-02T15:13:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 -- 172.21.15.33:0/430791386 learned_addr learned my addr 172.21.15.33:0/430791386 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:48.016 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac659c700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f66e0 0x7f1ac806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 -- 172.21.15.33:0/430791386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f66e0 msgr2=0x7f1ac806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f66e0 0x7f1ac806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 -- 172.21.15.33:0/430791386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0005040 con 0x7f1ac80f7980 2022-02-02T15:13:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1ac5d9b700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f1ab800e7f0 tx=0x7f1ab800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab80092e0 con 0x7f1ac80f7980 2022-02-02T15:13:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1ab800f040 con 0x7f1ac80f7980 2022-02-02T15:13:48.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac806a7a0 con 0x7f1ac80f7980 2022-02-02T15:13:48.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac810ef90 con 0x7f1ac80f7980 2022-02-02T15:13:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.021+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ab8014750 con 0x7f1ac80f7980 2022-02-02T15:13:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.022+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac004fa0 con 0x7f1ac80f7980 2022-02-02T15:13:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.023+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1ab801b030 con 0x7f1ac80f7980 2022-02-02T15:13:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.023+0000 7f1abeffd700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 0x7f1ab4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.024+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1ab80817e0 con 0x7f1ac80f7980 2022-02-02T15:13:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.024+0000 7f1ac659c700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 0x7f1ab4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.024+0000 7f1ac659c700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 0x7f1ab4067290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f1ab0000c00 tx=0x7f1ab0016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.021 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.028+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1ab804f8e0 con 0x7f1ac80f7980 2022-02-02T15:13:48.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.216+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1aac000bc0 con 0x7f1ab4064dd0 2022-02-02T15:13:48.207 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:47 smithi033 ceph-mon[101165]: pgmap v2852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:48.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.217+0000 7f1abeffd700 1 -- 172.21.15.33:0/430791386 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f1aac000bc0 con 0x7f1ab4064dd0 2022-02-02T15:13:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 msgr2=0x7f1ab4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 0x7f1ab4067290 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f1ab0000c00 tx=0x7f1ab0016040).stop 2022-02-02T15:13:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 msgr2=0x7f1ac8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f1ab800e7f0 tx=0x7f1ab800b040).stop 2022-02-02T15:13:48.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 shutdown_connections 2022-02-02T15:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1ab4064dd0 0x7f1ab4067290 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac80f66e0 0x7f1ac806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 --2- 172.21.15.33:0/430791386 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ac80f7980 0x7f1ac8069e20 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 >> 172.21.15.33:0/430791386 conn(0x7f1ac80f1e40 msgr2=0x7f1ac80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 shutdown_connections 2022-02-02T15:13:48.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.219+0000 7f1acca91700 1 -- 172.21.15.33:0/430791386 wait complete. 2022-02-02T15:13:48.220 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:13:48.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:47 smithi037 ceph-mon[69017]: pgmap v2852: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 -- 172.21.15.33:0/1323783008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f55c0 msgr2=0x7f09f40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 --2- 172.21.15.33:0/1323783008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f55c0 0x7f09f40f59e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f09f0004660 tx=0x7f09f0009b30).stop 2022-02-02T15:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 -- 172.21.15.33:0/1323783008 shutdown_connections 2022-02-02T15:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 --2- 172.21.15.33:0/1323783008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f6860 0x7f09f40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 --2- 172.21.15.33:0/1323783008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f55c0 0x7f09f40f59e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 -- 172.21.15.33:0/1323783008 >> 172.21.15.33:0/1323783008 conn(0x7f09f40f0d40 msgr2=0x7f09f40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 -- 172.21.15.33:0/1323783008 shutdown_connections 2022-02-02T15:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.320+0000 7f09fb59c700 1 -- 172.21.15.33:0/1323783008 wait complete. 2022-02-02T15:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 Processor -- start 2022-02-02T15:13:48.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 -- start start 2022-02-02T15:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f55c0 0x7f09f4105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4106910 con 0x7f09f40f6860 2022-02-02T15:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09fb59c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4106a50 con 0x7f09f40f55c0 2022-02-02T15:13:48.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09f8b37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09f8b37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36560/0 (socket says 172.21.15.33:36560) 2022-02-02T15:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09f8b37700 1 -- 172.21.15.33:0/3790178941 learned_addr learned my addr 172.21.15.33:0/3790178941 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.321+0000 7f09f9338700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f55c0 0x7f09f4105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09f8b37700 1 -- 172.21.15.33:0/3790178941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f55c0 msgr2=0x7f09f4105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09f8b37700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f55c0 0x7f09f4105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09f8b37700 1 -- 172.21.15.33:0/3790178941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f0005040 con 0x7f09f40f6860 2022-02-02T15:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09f8b37700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f09e80026d0 tx=0x7f09e8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e80079c0 con 0x7f09f40f6860 2022-02-02T15:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09e800f040 con 0x7f09f40f6860 2022-02-02T15:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f41073f0 con 0x7f09f40f6860 2022-02-02T15:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09e80148b0 con 0x7f09f40f6860 2022-02-02T15:13:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.322+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f41079b0 con 0x7f09f40f6860 2022-02-02T15:13:48.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.323+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4045ad0 con 0x7f09f40f6860 2022-02-02T15:13:48.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.324+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09e8007b20 con 0x7f09f40f6860 2022-02-02T15:13:48.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.324+0000 7f09e5ffb700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.324+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09e8081950 con 0x7f09f40f6860 2022-02-02T15:13:48.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.324+0000 7f09f9338700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.325+0000 7f09f9338700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 0x7f09e0067290 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f09f0004630 tx=0x7f09f0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.328+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09e8053430 con 0x7f09f40f6860 2022-02-02T15:13:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.516+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f4107c80 con 0x7f09e0064dd0 2022-02-02T15:13:48.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.531+0000 7f09e5ffb700 1 -- 172.21.15.33:0/3790178941 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3432 (secure 0 0 0) 0x7f09f4107c80 con 0x7f09e0064dd0 2022-02-02T15:13:48.521 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:13:48.522 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (99m) 61m ago 100m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:13:48.522 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (92m) 61m ago 100m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:13:48.522 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (92m) 61m ago 99m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:13:48.523 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (98m) 61m ago 99m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:13:48.523 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (92m) 61m ago 96m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:13:48.523 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (93m) 61m ago 96m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:13:48.523 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (93m) 61m ago 96m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:13:48.524 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (96m) 61m ago 96m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:13:48.524 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (93m) 61m ago 101m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:13:48.524 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (93m) 61m ago 99m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:13:48.524 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (93m) 61m ago 101m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:13:48.525 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (92m) 61m ago 99m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:13:48.525 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (99m) 61m ago 99m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:13:48.525 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (99m) 61m ago 99m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:13:48.525 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 61m ago 98m - 4096M 2022-02-02T15:13:48.526 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (98m) 61m ago 98m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:13:48.526 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (98m) 61m ago 98m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:13:48.526 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (97m) 61m ago 97m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:13:48.526 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (97m) 61m ago 97m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:13:48.527 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (97m) 61m ago 97m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:13:48.527 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (98m) 61m ago 99m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:13:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 msgr2=0x7f09e0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 0x7f09e0067290 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f09f0004630 tx=0x7f09f0009b30).stop 2022-02-02T15:13:48.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 msgr2=0x7f09f4106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 rx=0x7f09e80026d0 tx=0x7f09e8009de0).stop 2022-02-02T15:13:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 shutdown_connections 2022-02-02T15:13:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09e0064dd0 0x7f09e0067290 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f40f55c0 0x7f09f4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 --2- 172.21.15.33:0/3790178941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09f40f6860 0x7f09f4106360 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.532+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 >> 172.21.15.33:0/3790178941 conn(0x7f09f40f0d40 msgr2=0x7f09f40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.533+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 shutdown_connections 2022-02-02T15:13:48.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.533+0000 7f09fb59c700 1 -- 172.21.15.33:0/3790178941 wait complete. 2022-02-02T15:13:48.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 -- 172.21.15.33:0/807833885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f5430 msgr2=0x7efbfc0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 --2- 172.21.15.33:0/807833885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f5430 0x7efbfc0f5850 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7efbec004660 tx=0x7efbec009b30).stop 2022-02-02T15:13:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 -- 172.21.15.33:0/807833885 shutdown_connections 2022-02-02T15:13:48.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 --2- 172.21.15.33:0/807833885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f66d0 0x7efbfc0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 --2- 172.21.15.33:0/807833885 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f5430 0x7efbfc0f5850 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 -- 172.21.15.33:0/807833885 >> 172.21.15.33:0/807833885 conn(0x7efbfc0f0b90 msgr2=0x7efbfc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.632+0000 7efc016a0700 1 -- 172.21.15.33:0/807833885 shutdown_connections 2022-02-02T15:13:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.633+0000 7efc016a0700 1 -- 172.21.15.33:0/807833885 wait complete. 2022-02-02T15:13:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.633+0000 7efc016a0700 1 Processor -- start 2022-02-02T15:13:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.633+0000 7efc016a0700 1 -- start start 2022-02-02T15:13:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efc016a0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f5430 0x7efbfc109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efc016a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efc016a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc0603c0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efc016a0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbfc060500 con 0x7efbfc0f5430 2022-02-02T15:13:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36570/0 (socket says 172.21.15.33:36570) 2022-02-02T15:13:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 -- 172.21.15.33:0/809635512 learned_addr learned my addr 172.21.15.33:0/809635512 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfbfff700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f5430 0x7efbfc109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 -- 172.21.15.33:0/809635512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f5430 msgr2=0x7efbfc109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f5430 0x7efbfc109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 -- 172.21.15.33:0/809635512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbec005040 con 0x7efbfc0f66d0 2022-02-02T15:13:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbfb7fe700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7efbf000e7f0 tx=0x7efbf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbf00092e0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efbf000f040 con 0x7efbfc0f66d0 2022-02-02T15:13:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.634+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbfc10c4f0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.635+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbf0014750 con 0x7efbfc0f66d0 2022-02-02T15:13:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.635+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbfc10ca80 con 0x7efbfc0f66d0 2022-02-02T15:13:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.636+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbfc059100 con 0x7efbfc0f66d0 2022-02-02T15:13:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.636+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efbf001b030 con 0x7efbfc0f66d0 2022-02-02T15:13:48.633 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.636+0000 7efbf8ff9700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 0x7efbe40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.636+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efbf00818a0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.636+0000 7efbfbfff700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 0x7efbe40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.634 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.637+0000 7efbfbfff700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 0x7efbe40672e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7efbec000c00 tx=0x7efbec016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.635 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.641+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efbf004fa00 con 0x7efbfc0f66d0 2022-02-02T15:13:48.874 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.884+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efbfc045ad0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.884+0000 7efbf8ff9700 1 -- 172.21.15.33:0/809635512 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7efbf00192d0 con 0x7efbfc0f66d0 2022-02-02T15:13:48.875 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:13:48.876 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:13:48.876 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:13:48.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:48.876 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:13:48.876 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:13:48.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:48.877 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:13:48.877 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:13:48.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:48.878 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:13:48.878 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:13:48.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:13:48.878 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:13:48.878 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:13:48.879 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:13:48.879 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:13:48.879 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:13:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 msgr2=0x7efbe40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 0x7efbe40672e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7efbec000c00 tx=0x7efbec016040).stop 2022-02-02T15:13:48.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 msgr2=0x7efbfc10bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7efbf000e7f0 tx=0x7efbf000b040).stop 2022-02-02T15:13:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 shutdown_connections 2022-02-02T15:13:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efbe4064e20 0x7efbe40672e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efbfc0f5430 0x7efbfc109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 --2- 172.21.15.33:0/809635512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efbfc0f66d0 0x7efbfc10bf40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 >> 172.21.15.33:0/809635512 conn(0x7efbfc0f0b90 msgr2=0x7efbfc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 shutdown_connections 2022-02-02T15:13:48.882 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.886+0000 7efc016a0700 1 -- 172.21.15.33:0/809635512 wait complete. 2022-02-02T15:13:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 -- 172.21.15.33:0/3571808282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f66e0 msgr2=0x7f47d80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 --2- 172.21.15.33:0/3571808282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f66e0 0x7f47d80f6b00 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f47cc004660 tx=0x7f47cc009b30).stop 2022-02-02T15:13:48.978 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 -- 172.21.15.33:0/3571808282 shutdown_connections 2022-02-02T15:13:48.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 --2- 172.21.15.33:0/3571808282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f7980 0x7f47d80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 --2- 172.21.15.33:0/3571808282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f66e0 0x7f47d80f6b00 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 -- 172.21.15.33:0/3571808282 >> 172.21.15.33:0/3571808282 conn(0x7f47d80f1e40 msgr2=0x7f47d80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:48.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 -- 172.21.15.33:0/3571808282 shutdown_connections 2022-02-02T15:13:48.979 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.987+0000 7f47dee22700 1 -- 172.21.15.33:0/3571808282 wait complete. 2022-02-02T15:13:48.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 Processor -- start 2022-02-02T15:13:48.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 -- start start 2022-02-02T15:13:48.982 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f66e0 0x7f47d806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d806a380 con 0x7f47d80f7980 2022-02-02T15:13:48.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dee22700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d806a4c0 con 0x7f47d80f66e0 2022-02-02T15:13:48.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36580/0 (socket says 172.21.15.33:36580) 2022-02-02T15:13:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47d7fff700 1 -- 172.21.15.33:0/1015077158 learned_addr learned my addr 172.21.15.33:0/1015077158 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:13:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.988+0000 7f47dcbbe700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f66e0 0x7f47d806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d7fff700 1 -- 172.21.15.33:0/1015077158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f66e0 msgr2=0x7f47d806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d7fff700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f66e0 0x7f47d806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:48.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d7fff700 1 -- 172.21.15.33:0/1015077158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc005040 con 0x7f47d80f7980 2022-02-02T15:13:48.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d7fff700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f47c400e7f0 tx=0x7f47c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c40092e0 con 0x7f47d80f7980 2022-02-02T15:13:48.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d806a7a0 con 0x7f47d80f7980 2022-02-02T15:13:48.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f47c400f040 con 0x7f47d80f7980 2022-02-02T15:13:48.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47c4014750 con 0x7f47d80f7980 2022-02-02T15:13:48.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.989+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d810ef90 con 0x7f47d80f7980 2022-02-02T15:13:48.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.990+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d8045ad0 con 0x7f47d80f7980 2022-02-02T15:13:48.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.991+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f47c401b030 con 0x7f47d80f7980 2022-02-02T15:13:48.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.991+0000 7f47d57fa700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 0x7f47c8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:13:48.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.991+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f47c40818b0 con 0x7f47d80f7980 2022-02-02T15:13:48.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.991+0000 7f47dcbbe700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 0x7f47c8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:13:48.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.991+0000 7f47dcbbe700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 0x7f47c8067290 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f47cc000c00 tx=0x7f47cc016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:13:48.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:48.995+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f47c404fa10 con 0x7f47d80f7980 2022-02-02T15:13:49.197 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.206+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f47d8027a00 con 0x7f47d80f7980 2022-02-02T15:13:49.197 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:48 smithi033 ceph-mon[101165]: from='client.36994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:49.197 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:48 smithi033 ceph-mon[101165]: from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:49.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.206+0000 7f47d57fa700 1 -- 172.21.15.33:0/1015077158 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f47c4019070 con 0x7f47d80f7980 2022-02-02T15:13:49.198 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:13:49.199 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:13:49.199 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:13:49.199 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:13:49.199 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:49.199 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:13:49.200 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:13:49.200 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:13:49.200 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:13:49.200 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:13:49.200 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:13:49.201 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:13:49.201 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:13:49.201 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:13:49.201 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:13:49.201 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:13:49.202 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:13:49.202 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:13:49.202 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:13:49.202 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:13:49.203 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:13:49.203 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:13:49.203 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:13:49.203 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:13:49.203 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:13:49.204 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:13:49.204 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:13:49.204 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:13:49.204 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:13:49.204 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:13:49.205 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:13:49.205 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:49.205 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:49.205 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:13:49.205 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:13:49.206 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:49.206 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:49.206 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:49.206 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:13:49.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.208+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 msgr2=0x7f47c8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.208+0000 7f47dee22700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 0x7f47c8067290 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f47cc000c00 tx=0x7f47cc016040).stop 2022-02-02T15:13:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.208+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 msgr2=0x7f47d8069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:13:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.208+0000 7f47dee22700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f47c400e7f0 tx=0x7f47c400b040).stop 2022-02-02T15:13:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 shutdown_connections 2022-02-02T15:13:49.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f47c8064dd0 0x7f47c8067290 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d80f66e0 0x7f47d806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 --2- 172.21.15.33:0/1015077158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47d80f7980 0x7f47d8069e20 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:13:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 >> 172.21.15.33:0/1015077158 conn(0x7f47d80f1e40 msgr2=0x7f47d80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:13:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 shutdown_connections 2022-02-02T15:13:49.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:13:49.209+0000 7f47dee22700 1 -- 172.21.15.33:0/1015077158 wait complete. 2022-02-02T15:13:49.210 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:13:49.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:48 smithi037 ceph-mon[69017]: from='client.36994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:49.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:48 smithi037 ceph-mon[69017]: from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:13:50.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/809635512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:13:50.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:49 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1015077158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:13:50.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:49 smithi033 ceph-mon[101165]: pgmap v2853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:50.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/809635512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:13:50.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:49 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1015077158' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:13:50.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:49 smithi037 ceph-mon[69017]: pgmap v2853: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:53.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:52 smithi033 ceph-mon[101165]: pgmap v2854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:53.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:52 smithi037 ceph-mon[69017]: pgmap v2854: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:54 smithi033 ceph-mon[101165]: pgmap v2855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:13:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:13:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:54 smithi037 ceph-mon[69017]: pgmap v2855: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:13:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:13:57.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:56 smithi033 ceph-mon[101165]: pgmap v2856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:56 smithi037 ceph-mon[69017]: pgmap v2856: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:58.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:13:57 smithi033 ceph-mon[101165]: pgmap v2857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:13:58.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:13:57 smithi037 ceph-mon[69017]: pgmap v2857: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:00 smithi033 ceph-mon[101165]: pgmap v2858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:01.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:00 smithi037 ceph-mon[69017]: pgmap v2858: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:03.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:02 smithi033 ceph-mon[101165]: pgmap v2859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:03.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:02 smithi037 ceph-mon[69017]: pgmap v2859: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:05.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:04 smithi033 ceph-mon[101165]: pgmap v2860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:05.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:04 smithi037 ceph-mon[69017]: pgmap v2860: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:07.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:06 smithi033 ceph-mon[101165]: pgmap v2861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:07.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:06 smithi037 ceph-mon[69017]: pgmap v2861: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:08.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:07 smithi033 ceph-mon[101165]: pgmap v2862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:08.328 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:07 smithi037 ceph-mon[69017]: pgmap v2862: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:11.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:10 smithi033 ceph-mon[101165]: pgmap v2863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:11.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:10 smithi037 ceph-mon[69017]: pgmap v2863: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:13.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:12 smithi033 ceph-mon[101165]: pgmap v2864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:13.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:12 smithi037 ceph-mon[69017]: pgmap v2864: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:15.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:14 smithi033 ceph-mon[101165]: pgmap v2865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:15.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:14 smithi037 ceph-mon[69017]: pgmap v2865: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:17.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:16 smithi033 ceph-mon[101165]: pgmap v2866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:17.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:16 smithi037 ceph-mon[69017]: pgmap v2866: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:18.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:17 smithi033 ceph-mon[101165]: pgmap v2867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:18.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:17 smithi037 ceph-mon[69017]: pgmap v2867: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:19.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1060619881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 msgr2=0x7f57c40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1060619881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c40f59e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7f57b8004660 tx=0x7f57b8009b30).stop 2022-02-02T15:14:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1060619881 shutdown_connections 2022-02-02T15:14:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1060619881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 0x7f57c40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.317 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1060619881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c40f59e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1060619881 >> 172.21.15.33:0/1060619881 conn(0x7f57c40f0d40 msgr2=0x7f57c40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1060619881 shutdown_connections 2022-02-02T15:14:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.324+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1060619881 wait complete. 2022-02-02T15:14:19.318 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 Processor -- start 2022-02-02T15:14:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 -- start start 2022-02-02T15:14:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 0x7f57c4107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.319 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4107a10 con 0x7f57c40f55c0 2022-02-02T15:14:19.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c8d0b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4107b50 con 0x7f57c40f6860 2022-02-02T15:14:19.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36588/0 (socket says 172.21.15.33:36588) 2022-02-02T15:14:19.320 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c259c700 1 -- 172.21.15.33:0/1888194739 learned_addr learned my addr 172.21.15.33:0/1888194739 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c1d9b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 0x7f57c4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.325+0000 7f57c259c700 1 -- 172.21.15.33:0/1888194739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 msgr2=0x7f57c4107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57c259c700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 0x7f57c4107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57c259c700 1 -- 172.21.15.33:0/1888194739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8005040 con 0x7f57c40f55c0 2022-02-02T15:14:19.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57c259c700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f57b8013a70 tx=0x7f57b8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b8018070 con 0x7f57c40f55c0 2022-02-02T15:14:19.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f57b80097d0 con 0x7f57c40f55c0 2022-02-02T15:14:19.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c4108490 con 0x7f57c40f55c0 2022-02-02T15:14:19.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b801de80 con 0x7f57c40f55c0 2022-02-02T15:14:19.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.326+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c41089f0 con 0x7f57c40f55c0 2022-02-02T15:14:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.328+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c4045ad0 con 0x7f57c40f55c0 2022-02-02T15:14:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.328+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f57b8007ba0 con 0x7f57c40f55c0 2022-02-02T15:14:19.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.328+0000 7f57b2ffd700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 0x7f57ac067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.328+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f57b80835f0 con 0x7f57c40f55c0 2022-02-02T15:14:19.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.328+0000 7f57c1d9b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 0x7f57ac067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.329+0000 7f57c1d9b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 0x7f57ac067290 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f57b4004c40 tx=0x7f57b400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.333+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f57b8055240 con 0x7f57c40f55c0 2022-02-02T15:14:19.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.520+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c40faca0 con 0x7f57ac064dd0 2022-02-02T15:14:19.512 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.522+0000 7f57b2ffd700 1 -- 172.21.15.33:0/1888194739 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f57c40faca0 con 0x7f57ac064dd0 2022-02-02T15:14:19.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 msgr2=0x7f57ac067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 0x7f57ac067290 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7f57b4004c40 tx=0x7f57b400b040).stop 2022-02-02T15:14:19.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 msgr2=0x7f57c4106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f57b8013a70 tx=0x7f57b8009b30).stop 2022-02-02T15:14:19.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 shutdown_connections 2022-02-02T15:14:19.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f57ac064dd0 0x7f57ac067290 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40f55c0 0x7f57c4106f70 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.523+0000 7f57c8d0b700 1 --2- 172.21.15.33:0/1888194739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57c40f6860 0x7f57c4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.524+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 >> 172.21.15.33:0/1888194739 conn(0x7f57c40f0d40 msgr2=0x7f57c405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:19.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.524+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 shutdown_connections 2022-02-02T15:14:19.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.524+0000 7f57c8d0b700 1 -- 172.21.15.33:0/1888194739 wait complete. 2022-02-02T15:14:19.524 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:14:19.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 -- 172.21.15.33:0/1434642978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f5460 msgr2=0x7fa37c0f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 --2- 172.21.15.33:0/1434642978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f5460 0x7fa37c0f5880 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 rx=0x7fa370004660 tx=0x7fa370009b30).stop 2022-02-02T15:14:19.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 -- 172.21.15.33:0/1434642978 shutdown_connections 2022-02-02T15:14:19.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 --2- 172.21.15.33:0/1434642978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f6700 0x7fa37c0f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 --2- 172.21.15.33:0/1434642978 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f5460 0x7fa37c0f5880 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.624+0000 7fa3818a2700 1 -- 172.21.15.33:0/1434642978 >> 172.21.15.33:0/1434642978 conn(0x7fa37c0f0bc0 msgr2=0x7fa37c0f2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.625+0000 7fa3818a2700 1 -- 172.21.15.33:0/1434642978 shutdown_connections 2022-02-02T15:14:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.625+0000 7fa3818a2700 1 -- 172.21.15.33:0/1434642978 wait complete. 2022-02-02T15:14:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.625+0000 7fa3818a2700 1 Processor -- start 2022-02-02T15:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa3818a2700 1 -- start start 2022-02-02T15:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa3818a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 0x7fa37c105d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa3818a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa3818a2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c1067a0 con 0x7fa37c0f6700 2022-02-02T15:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa3818a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37c106fa0 con 0x7fa37c0f5460 2022-02-02T15:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36600/0 (socket says 172.21.15.33:36600) 2022-02-02T15:14:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 -- 172.21.15.33:0/151351951 learned_addr learned my addr 172.21.15.33:0/151351951 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37affd700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 0x7fa37c105d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 -- 172.21.15.33:0/151351951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 msgr2=0x7fa37c105d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 0x7fa37c105d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37a7fc700 1 -- 172.21.15.33:0/151351951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa370005040 con 0x7fa37c0f6700 2022-02-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.626+0000 7fa37affd700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 0x7fa37c105d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa37a7fc700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fa36c00e7f0 tx=0x7fa36c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c0092e0 con 0x7fa37c0f6700 2022-02-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37c107280 con 0x7fa37c0f6700 2022-02-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa36c00f040 con 0x7fa37c0f6700 2022-02-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa36c014750 con 0x7fa37c0f6700 2022-02-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.627+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa37c107840 con 0x7fa37c0f6700 2022-02-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.628+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37c059100 con 0x7fa37c0f6700 2022-02-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.628+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa36c01b030 con 0x7fa37c0f6700 2022-02-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.629+0000 7fa3637fe700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 0x7fa3640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.629+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa36c081880 con 0x7fa37c0f6700 2022-02-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.629+0000 7fa37affd700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 0x7fa3640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.629+0000 7fa37affd700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 0x7fa3640672e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fa370004d80 tx=0x7fa370016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.633+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa36c053410 con 0x7fa37c0f6700 2022-02-02T15:14:19.806 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.815+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa37c0fdd00 con 0x7fa364064e20 2022-02-02T15:14:19.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.830+0000 7fa3637fe700 1 -- 172.21.15.33:0/151351951 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fa37c0fdd00 con 0x7fa364064e20 2022-02-02T15:14:19.821 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:14:19.821 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (99m) 61m ago 100m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:14:19.822 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (92m) 61m ago 100m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:14:19.822 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (92m) 61m ago 100m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:14:19.822 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (99m) 61m ago 100m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:14:19.822 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (93m) 61m ago 96m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:14:19.823 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (93m) 61m ago 96m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:14:19.823 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (94m) 61m ago 96m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:14:19.823 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (96m) 61m ago 96m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:14:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (94m) 61m ago 101m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:14:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (93m) 61m ago 100m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:14:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (93m) 61m ago 102m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:14:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (93m) 61m ago 99m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:14:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (100m) 61m ago 100m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:14:19.825 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (99m) 61m ago 99m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:14:19.825 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 61m ago 99m - 4096M 2022-02-02T15:14:19.825 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (99m) 61m ago 99m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:14:19.825 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (98m) 61m ago 98m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:14:19.826 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (98m) 61m ago 98m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:14:19.826 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (98m) 61m ago 98m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:14:19.826 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (97m) 61m ago 97m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:14:19.826 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (99m) 61m ago 100m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:14:19.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 msgr2=0x7fa3640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 0x7fa3640672e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fa370004d80 tx=0x7fa370016040).stop 2022-02-02T15:14:19.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 msgr2=0x7fa37c1061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7fa36c00e7f0 tx=0x7fa36c00b040).stop 2022-02-02T15:14:19.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 shutdown_connections 2022-02-02T15:14:19.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa364064e20 0x7fa3640672e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa37c0f5460 0x7fa37c105d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 --2- 172.21.15.33:0/151351951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa37c0f6700 0x7fa37c1061f0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 >> 172.21.15.33:0/151351951 conn(0x7fa37c0f0bc0 msgr2=0x7fa37c0fa150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:19.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 shutdown_connections 2022-02-02T15:14:19.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.832+0000 7fa3818a2700 1 -- 172.21.15.33:0/151351951 wait complete. 2022-02-02T15:14:19.922 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 -- 172.21.15.33:0/3129199027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 msgr2=0x7ff51c0f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 --2- 172.21.15.33:0/3129199027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c0f6950 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7ff518004660 tx=0x7ff518009b30).stop 2022-02-02T15:14:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 -- 172.21.15.33:0/3129199027 shutdown_connections 2022-02-02T15:14:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 --2- 172.21.15.33:0/3129199027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 0x7ff51c0f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.923 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 --2- 172.21.15.33:0/3129199027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c0f6950 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.931+0000 7ff522186700 1 -- 172.21.15.33:0/3129199027 >> 172.21.15.33:0/3129199027 conn(0x7ff51c0f1c90 msgr2=0x7ff51c0f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 -- 172.21.15.33:0/3129199027 shutdown_connections 2022-02-02T15:14:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 -- 172.21.15.33:0/3129199027 wait complete. 2022-02-02T15:14:19.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 Processor -- start 2022-02-02T15:14:19.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 -- start start 2022-02-02T15:14:19.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 0x7ff51c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c06a380 con 0x7ff51c0f6530 2022-02-02T15:14:19.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.932+0000 7ff522186700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c06a4c0 con 0x7ff51c0f77d0 2022-02-02T15:14:19.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36608/0 (socket says 172.21.15.33:36608) 2022-02-02T15:14:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 -- 172.21.15.33:0/3215875749 learned_addr learned my addr 172.21.15.33:0/3215875749 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff520983700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 0x7ff51c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 -- 172.21.15.33:0/3215875749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 msgr2=0x7ff51c069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 0x7ff51c069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 -- 172.21.15.33:0/3215875749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff518005040 con 0x7ff51c0f6530 2022-02-02T15:14:19.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff521184700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7ff518013a70 tx=0x7ff518009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff518018070 con 0x7ff51c0f6530 2022-02-02T15:14:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5180097d0 con 0x7ff51c0f6530 2022-02-02T15:14:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51c06a740 con 0x7ff51c0f6530 2022-02-02T15:14:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.933+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51801de80 con 0x7ff51c0f6530 2022-02-02T15:14:19.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.934+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c06aca0 con 0x7ff51c0f6530 2022-02-02T15:14:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.935+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c045ad0 con 0x7ff51c0f6530 2022-02-02T15:14:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.935+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff518007ba0 con 0x7ff51c0f6530 2022-02-02T15:14:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.936+0000 7ff511ffb700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 0x7ff5080672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:19.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.936+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff5180835b0 con 0x7ff51c0f6530 2022-02-02T15:14:19.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.936+0000 7ff520983700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 0x7ff5080672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:19.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.936+0000 7ff520983700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 0x7ff5080672e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7ff50c004e20 tx=0x7ff50c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:19.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:19.940+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff518051660 con 0x7ff51c0f6530 2022-02-02T15:14:20.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.189+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff51c0fedc0 con 0x7ff51c0f6530 2022-02-02T15:14:20.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.190+0000 7ff511ffb700 1 -- 172.21.15.33:0/3215875749 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff518054c80 con 0x7ff51c0f6530 2022-02-02T15:14:20.181 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:14:20.181 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:14:20.181 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:14:20.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:20.182 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:14:20.182 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:14:20.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:20.183 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:14:20.183 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:14:20.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:20.183 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:14:20.184 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:14:20.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:20.184 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:14:20.184 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:14:20.185 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:14:20.185 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:14:20.185 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:14:20.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 msgr2=0x7ff5080672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 0x7ff5080672e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7ff50c004e20 tx=0x7ff50c00b040).stop 2022-02-02T15:14:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 msgr2=0x7ff51c06b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7ff518013a70 tx=0x7ff518009b30).stop 2022-02-02T15:14:20.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 shutdown_connections 2022-02-02T15:14:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff508064e20 0x7ff5080672e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff51c0f6530 0x7ff51c06b9a0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 --2- 172.21.15.33:0/3215875749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c0f77d0 0x7ff51c069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 >> 172.21.15.33:0/3215875749 conn(0x7ff51c0f1c90 msgr2=0x7ff51c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:20.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 shutdown_connections 2022-02-02T15:14:20.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.192+0000 7ff522186700 1 -- 172.21.15.33:0/3215875749 wait complete. 2022-02-02T15:14:20.285 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2296948842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f66e0 msgr2=0x7fc8980f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2296948842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f66e0 0x7fc8980f6b00 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7fc88c004660 tx=0x7fc88c009b30).stop 2022-02-02T15:14:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2296948842 shutdown_connections 2022-02-02T15:14:20.286 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2296948842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f7980 0x7fc8980f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2296948842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f66e0 0x7fc8980f6b00 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2296948842 >> 172.21.15.33:0/2296948842 conn(0x7fc8980f1e40 msgr2=0x7fc8980f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2296948842 shutdown_connections 2022-02-02T15:14:20.287 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.293+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2296948842 wait complete. 2022-02-02T15:14:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 Processor -- start 2022-02-02T15:14:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 -- start start 2022-02-02T15:14:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f66e0 0x7fc89806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:20.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89806a380 con 0x7fc8980f7980 2022-02-02T15:14:20.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89fb5b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89806a4c0 con 0x7fc8980f66e0 2022-02-02T15:14:20.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:20.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36620/0 (socket says 172.21.15.33:36620) 2022-02-02T15:14:20.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d8f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f66e0 0x7fc89806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:20.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 -- 172.21.15.33:0/2773016726 learned_addr learned my addr 172.21.15.33:0/2773016726 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:20.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 -- 172.21.15.33:0/2773016726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f66e0 msgr2=0x7fc89806b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f66e0 0x7fc89806b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.294+0000 7fc89d0f6700 1 -- 172.21.15.33:0/2773016726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c005040 con 0x7fc8980f7980 2022-02-02T15:14:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc89d0f6700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc89400e7f0 tx=0x7fc89400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8940092e0 con 0x7fc8980f7980 2022-02-02T15:14:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc89400f040 con 0x7fc8980f7980 2022-02-02T15:14:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89806a7a0 con 0x7fc8980f7980 2022-02-02T15:14:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc894014750 con 0x7fc8980f7980 2022-02-02T15:14:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.295+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89810ef90 con 0x7fc8980f7980 2022-02-02T15:14:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.296+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc898045ad0 con 0x7fc8980f7980 2022-02-02T15:14:20.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.296+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc89401b030 con 0x7fc8980f7980 2022-02-02T15:14:20.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.297+0000 7fc88a7fc700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 0x7fc884067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:20.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.297+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc8940817c0 con 0x7fc8980f7980 2022-02-02T15:14:20.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.297+0000 7fc89d8f7700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 0x7fc884067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.297+0000 7fc89d8f7700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 0x7fc884067290 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fc88c000c00 tx=0x7fc88c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.301+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc89404f920 con 0x7fc8980f7980 2022-02-02T15:14:20.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.512+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc898027a00 con 0x7fc8980f7980 2022-02-02T15:14:20.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.512+0000 7fc88a7fc700 1 -- 172.21.15.33:0/2773016726 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc894052f40 con 0x7fc8980f7980 2022-02-02T15:14:20.504 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:14:20.505 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:14:20.505 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:14:20.506 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:14:20.506 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:14:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:14:20.507 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:14:20.508 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:14:20.508 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:14:20.508 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:14:20.508 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:14:20.509 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:14:20.509 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:14:20.509 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:14:20.510 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:14:20.510 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:14:20.510 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:14:20.510 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:14:20.511 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:14:20.511 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:14:20.511 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:14:20.512 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:14:20.512 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:14:20.512 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:14:20.512 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:14:20.513 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:14:20.513 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:14:20.513 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:14:20.513 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:14:20.513 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:14:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:20.514 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:14:20.514 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:20.515 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:20.515 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:20.515 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:20.515 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:20.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 msgr2=0x7fc884067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.516 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 0x7fc884067290 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fc88c000c00 tx=0x7fc88c016040).stop 2022-02-02T15:14:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 msgr2=0x7fc898069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0x7fc89400e7f0 tx=0x7fc89400b040).stop 2022-02-02T15:14:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 shutdown_connections 2022-02-02T15:14:20.517 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc884064dd0 0x7fc884067290 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8980f66e0 0x7fc89806b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 --2- 172.21.15.33:0/2773016726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8980f7980 0x7fc898069e20 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 >> 172.21.15.33:0/2773016726 conn(0x7fc8980f1e40 msgr2=0x7fc8980fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:20.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 shutdown_connections 2022-02-02T15:14:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:20.514+0000 7fc89fb5b700 1 -- 172.21.15.33:0/2773016726 wait complete. 2022-02-02T15:14:20.519 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:14:21.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:20 smithi033 ceph-mon[101165]: from='client.37010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:21.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:20 smithi033 ceph-mon[101165]: pgmap v2868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:21.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:20 smithi033 ceph-mon[101165]: from='client.37014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:21.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3215875749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:14:21.232 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:20 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2773016726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:14:21.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:20 smithi037 ceph-mon[69017]: from='client.37010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:21.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:20 smithi037 ceph-mon[69017]: pgmap v2868: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:21.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:20 smithi037 ceph-mon[69017]: from='client.37014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:21.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3215875749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:14:21.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:20 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2773016726' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:14:23.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:22 smithi033 ceph-mon[101165]: pgmap v2869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:23.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:22 smithi037 ceph-mon[69017]: pgmap v2869: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:25.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:24 smithi033 ceph-mon[101165]: pgmap v2870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:25.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:24 smithi037 ceph-mon[69017]: pgmap v2870: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:27.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:26 smithi033 ceph-mon[101165]: pgmap v2871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:27.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:26 smithi037 ceph-mon[69017]: pgmap v2871: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:28.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:27 smithi033 ceph-mon[101165]: pgmap v2872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:27 smithi037 ceph-mon[69017]: pgmap v2872: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:31.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:30 smithi033 ceph-mon[101165]: pgmap v2873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:31.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:30 smithi037 ceph-mon[69017]: pgmap v2873: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:33.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:32 smithi033 ceph-mon[101165]: pgmap v2874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:33.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:32 smithi037 ceph-mon[69017]: pgmap v2874: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:35.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:34 smithi033 ceph-mon[101165]: pgmap v2875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:35.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:34 smithi037 ceph-mon[69017]: pgmap v2875: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:37.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:36 smithi033 ceph-mon[101165]: pgmap v2876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:37.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:36 smithi037 ceph-mon[69017]: pgmap v2876: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:38.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:37 smithi033 ceph-mon[101165]: pgmap v2877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:38.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:37 smithi037 ceph-mon[69017]: pgmap v2877: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:41.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:40 smithi033 ceph-mon[101165]: pgmap v2878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:41.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:40 smithi037 ceph-mon[69017]: pgmap v2878: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:43.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:42 smithi033 ceph-mon[101165]: pgmap v2879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:43.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:42 smithi037 ceph-mon[69017]: pgmap v2879: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:45.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:44 smithi033 ceph-mon[101165]: pgmap v2880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:45.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:44 smithi037 ceph-mon[69017]: pgmap v2880: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:47.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:46 smithi033 ceph-mon[101165]: pgmap v2881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:47.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:46 smithi037 ceph-mon[69017]: pgmap v2881: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:48.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:47 smithi033 ceph-mon[101165]: pgmap v2882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:48.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:47 smithi037 ceph-mon[69017]: pgmap v2882: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 -- 172.21.15.33:0/2520951787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 msgr2=0x7fe3d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 --2- 172.21.15.33:0/2520951787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d00f59e0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7fe3c80099e0 tx=0x7fe3c8004d10).stop 2022-02-02T15:14:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 -- 172.21.15.33:0/2520951787 shutdown_connections 2022-02-02T15:14:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 --2- 172.21.15.33:0/2520951787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 --2- 172.21.15.33:0/2520951787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d00f59e0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 -- 172.21.15.33:0/2520951787 >> 172.21.15.33:0/2520951787 conn(0x7fe3d00f0d40 msgr2=0x7fe3d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 -- 172.21.15.33:0/2520951787 shutdown_connections 2022-02-02T15:14:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.629+0000 7fe3d8099700 1 -- 172.21.15.33:0/2520951787 wait complete. 2022-02-02T15:14:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 Processor -- start 2022-02-02T15:14:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 -- start start 2022-02-02T15:14:50.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d010e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00602d0 con 0x7fe3d00f55c0 2022-02-02T15:14:50.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d8099700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d0060410 con 0x7fe3d00f6860 2022-02-02T15:14:50.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36628/0 (socket says 172.21.15.33:36628) 2022-02-02T15:14:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 -- 172.21.15.33:0/1595728824 learned_addr learned my addr 172.21.15.33:0/1595728824 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5634700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d010e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.626 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 -- 172.21.15.33:0/1595728824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 msgr2=0x7fe3d010e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d010e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5e35700 1 -- 172.21.15.33:0/1595728824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8009640 con 0x7fe3d00f55c0 2022-02-02T15:14:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.630+0000 7fe3d5634700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d010e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:14:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3d5e35700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fe3c800baa0 tx=0x7fe3c8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:50.627 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c800e070 con 0x7fe3d00f55c0 2022-02-02T15:14:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe3c8007df0 con 0x7fe3d00f55c0 2022-02-02T15:14:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d010eb50 con 0x7fe3d00f55c0 2022-02-02T15:14:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3c8018070 con 0x7fe3d00f55c0 2022-02-02T15:14:50.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.631+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d010ef20 con 0x7fe3d00f55c0 2022-02-02T15:14:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.632+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe3c8024060 con 0x7fe3d00f55c0 2022-02-02T15:14:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.632+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d0045ad0 con 0x7fe3d00f55c0 2022-02-02T15:14:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.633+0000 7fe3ce7fc700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.633+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe3c8083130 con 0x7fe3d00f55c0 2022-02-02T15:14:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.633+0000 7fe3d5634700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.633+0000 7fe3d5634700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fe3c4007fc0 tx=0x7fe3c400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:50.631 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.637+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe3c80512a0 con 0x7fe3d00f55c0 2022-02-02T15:14:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.824+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3d00fdf00 con 0x7fe3b8064dd0 2022-02-02T15:14:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.825+0000 7fe3ce7fc700 1 -- 172.21.15.33:0/1595728824 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe3d00fdf00 con 0x7fe3b8064dd0 2022-02-02T15:14:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 msgr2=0x7fe3b8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fe3c4007fc0 tx=0x7fe3c400b040).stop 2022-02-02T15:14:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 msgr2=0x7fe3d010c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7fe3c800baa0 tx=0x7fe3c8004d10).stop 2022-02-02T15:14:50.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 shutdown_connections 2022-02-02T15:14:50.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3b8064dd0 0x7fe3b8067290 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3d00f55c0 0x7fe3d010c160 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 --2- 172.21.15.33:0/1595728824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3d00f6860 0x7fe3d010e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 >> 172.21.15.33:0/1595728824 conn(0x7fe3d00f0d40 msgr2=0x7fe3d00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:50.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 shutdown_connections 2022-02-02T15:14:50.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.827+0000 7fe3d8099700 1 -- 172.21.15.33:0/1595728824 wait complete. 2022-02-02T15:14:50.827 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:14:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- 172.21.15.33:0/1106126131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 msgr2=0x7fd0280f7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.919 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 --2- 172.21.15.33:0/1106126131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f7920 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7fd024004660 tx=0x7fd024009b30).stop 2022-02-02T15:14:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- 172.21.15.33:0/1106126131 shutdown_connections 2022-02-02T15:14:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 --2- 172.21.15.33:0/1106126131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f7920 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 --2- 172.21.15.33:0/1106126131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.920 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- 172.21.15.33:0/1106126131 >> 172.21.15.33:0/1106126131 conn(0x7fd0280f0320 msgr2=0x7fd0280f2740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:50.921 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:50 smithi033 ceph-mon[101165]: pgmap v2883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- 172.21.15.33:0/1106126131 shutdown_connections 2022-02-02T15:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- 172.21.15.33:0/1106126131 wait complete. 2022-02-02T15:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 Processor -- start 2022-02-02T15:14:50.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.929+0000 7fd02eb31700 1 -- start start 2022-02-02T15:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02eb31700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02eb31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02eb31700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280f5d90 con 0x7fd0280f51a0 2022-02-02T15:14:50.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02eb31700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0280f5ed0 con 0x7fd0280f4800 2022-02-02T15:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02d32e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02d32e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36640/0 (socket says 172.21.15.33:36640) 2022-02-02T15:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02d32e700 1 -- 172.21.15.33:0/3966392014 learned_addr learned my addr 172.21.15.33:0/3966392014 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:50.926 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02db2f700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02db2f700 1 -- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 msgr2=0x7fd0280f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02db2f700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02db2f700 1 -- 172.21.15.33:0/3966392014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd024005040 con 0x7fd0280f4800 2022-02-02T15:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.930+0000 7fd02db2f700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f73b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd0180026d0 tx=0x7fd018009ce0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.931+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0180079c0 con 0x7fd0280f4800 2022-02-02T15:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.931+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0280f61b0 con 0x7fd0280f4800 2022-02-02T15:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.931+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02810eda0 con 0x7fd0280f4800 2022-02-02T15:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.931+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd01800f040 con 0x7fd0280f4800 2022-02-02T15:14:50.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.931+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd018014770 con 0x7fd0280f4800 2022-02-02T15:14:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.932+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd010004fa0 con 0x7fd0280f4800 2022-02-02T15:14:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.932+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd01801b060 con 0x7fd0280f4800 2022-02-02T15:14:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.932+0000 7fd01e7fc700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:50.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.933+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd0180818a0 con 0x7fd0280f4800 2022-02-02T15:14:50.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.933+0000 7fd02d32e700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:50.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.933+0000 7fd02d32e700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 0x7fd0140672e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fd024004630 tx=0x7fd024009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:50.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:50.937+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd01804f950 con 0x7fd0280f4800 2022-02-02T15:14:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.120+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd010000bc0 con 0x7fd014064e20 2022-02-02T15:14:51.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.135+0000 7fd01e7fc700 1 -- 172.21.15.33:0/3966392014 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fd010000bc0 con 0x7fd014064e20 2022-02-02T15:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (100m) 62m ago 101m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (93m) 62m ago 101m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (93m) 62m ago 100m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (100m) 62m ago 100m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (93m) 62m ago 97m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (94m) 62m ago 97m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (95m) 62m ago 97m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (97m) 62m ago 97m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (94m) 62m ago 102m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (94m) 62m ago 100m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (94m) 62m ago 102m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (93m) 62m ago 100m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (100m) 62m ago 100m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (100m) 62m ago 100m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 62m ago 99m - 4096M 2022-02-02T15:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (99m) 62m ago 99m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (99m) 62m ago 99m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (99m) 62m ago 99m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (98m) 62m ago 98m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (98m) 62m ago 98m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (99m) 62m ago 100m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:14:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 msgr2=0x7fd0140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 0x7fd0140672e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7fd024004630 tx=0x7fd024009b30).stop 2022-02-02T15:14:51.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 msgr2=0x7fd0280f73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f73b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd0180026d0 tx=0x7fd018009ce0).stop 2022-02-02T15:14:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 shutdown_connections 2022-02-02T15:14:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd014064e20 0x7fd0140672e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0280f4800 0x7fd0280f73b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 --2- 172.21.15.33:0/3966392014 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0280f51a0 0x7fd0280f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 >> 172.21.15.33:0/3966392014 conn(0x7fd0280f0320 msgr2=0x7fd0280fb370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.136+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 shutdown_connections 2022-02-02T15:14:51.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.137+0000 7fd02eb31700 1 -- 172.21.15.33:0/3966392014 wait complete. 2022-02-02T15:14:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 -- 172.21.15.33:0/631071628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f55c0 msgr2=0x7fa0440f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 --2- 172.21.15.33:0/631071628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f55c0 0x7fa0440f59e0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7fa040004660 tx=0x7fa040009b30).stop 2022-02-02T15:14:51.227 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 -- 172.21.15.33:0/631071628 shutdown_connections 2022-02-02T15:14:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 --2- 172.21.15.33:0/631071628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f6860 0x7fa0440f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 --2- 172.21.15.33:0/631071628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f55c0 0x7fa0440f59e0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 -- 172.21.15.33:0/631071628 >> 172.21.15.33:0/631071628 conn(0x7fa0440f0d40 msgr2=0x7fa0440f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:51.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 -- 172.21.15.33:0/631071628 shutdown_connections 2022-02-02T15:14:51.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.236+0000 7fa04bc79700 1 -- 172.21.15.33:0/631071628 wait complete. 2022-02-02T15:14:51.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 Processor -- start 2022-02-02T15:14:51.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 -- start start 2022-02-02T15:14:51.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 0x7fa044106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044107a10 con 0x7fa0440f6860 2022-02-02T15:14:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa04bc79700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa044107b50 con 0x7fa0440f55c0 2022-02-02T15:14:51.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa049214700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa049214700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36650/0 (socket says 172.21.15.33:36650) 2022-02-02T15:14:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa049214700 1 -- 172.21.15.33:0/53810665 learned_addr learned my addr 172.21.15.33:0/53810665 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.237+0000 7fa049a15700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 0x7fa044106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa049214700 1 -- 172.21.15.33:0/53810665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 msgr2=0x7fa044106f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa049214700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 0x7fa044106f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa049214700 1 -- 172.21.15.33:0/53810665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa040005040 con 0x7fa0440f6860 2022-02-02T15:14:51.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa049a15700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 0x7fa044106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:14:51.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa049214700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fa0340026d0 tx=0x7fa034009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:51.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0340079c0 con 0x7fa0440f6860 2022-02-02T15:14:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0441084f0 con 0x7fa0440f6860 2022-02-02T15:14:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa03400f040 con 0x7fa0440f6860 2022-02-02T15:14:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0340148b0 con 0x7fa0440f6860 2022-02-02T15:14:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.238+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa044108ab0 con 0x7fa0440f6860 2022-02-02T15:14:51.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.240+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa044045ad0 con 0x7fa0440f6860 2022-02-02T15:14:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.240+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa034007b20 con 0x7fa0440f6860 2022-02-02T15:14:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.240+0000 7fa03a7fc700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 0x7fa030067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.240+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa034081a30 con 0x7fa0440f6860 2022-02-02T15:14:51.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.240+0000 7fa049a15700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 0x7fa030067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.241+0000 7fa049a15700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 0x7fa030067290 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fa040005010 tx=0x7fa040009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:51.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.245+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa034053510 con 0x7fa0440f6860 2022-02-02T15:14:51.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:50 smithi037 ceph-mon[69017]: pgmap v2883: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:51.480 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.490+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa044109150 con 0x7fa0440f6860 2022-02-02T15:14:51.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.491+0000 7fa03a7fc700 1 -- 172.21.15.33:0/53810665 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa034053100 con 0x7fa0440f6860 2022-02-02T15:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:14:51.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 msgr2=0x7fa030067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 0x7fa030067290 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fa040005010 tx=0x7fa040009b30).stop 2022-02-02T15:14:51.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 msgr2=0x7fa044107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7fa0340026d0 tx=0x7fa034009de0).stop 2022-02-02T15:14:51.487 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 shutdown_connections 2022-02-02T15:14:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa030064dd0 0x7fa030067290 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0440f55c0 0x7fa044106f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 --2- 172.21.15.33:0/53810665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0440f6860 0x7fa044107460 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 >> 172.21.15.33:0/53810665 conn(0x7fa0440f0d40 msgr2=0x7fa04405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 shutdown_connections 2022-02-02T15:14:51.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.493+0000 7fa04bc79700 1 -- 172.21.15.33:0/53810665 wait complete. 2022-02-02T15:14:51.585 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 -- 172.21.15.33:0/3040340951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80602b0 msgr2=0x7fe6e80f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3040340951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f9180 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 rx=0x7fe6d8004660 tx=0x7fe6d8009b30).stop 2022-02-02T15:14:51.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 -- 172.21.15.33:0/3040340951 shutdown_connections 2022-02-02T15:14:51.586 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3040340951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80f9700 0x7fe6e80fbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3040340951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f9180 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 -- 172.21.15.33:0/3040340951 >> 172.21.15.33:0/3040340951 conn(0x7fe6e80f0ba0 msgr2=0x7fe6e80f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:51.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 -- 172.21.15.33:0/3040340951 shutdown_connections 2022-02-02T15:14:51.587 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.595+0000 7fe6e759e700 1 -- 172.21.15.33:0/3040340951 wait complete. 2022-02-02T15:14:51.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 Processor -- start 2022-02-02T15:14:51.590 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 -- start start 2022-02-02T15:14:51.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80f55e0 con 0x7fe6e80f9700 2022-02-02T15:14:51.591 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e80f5720 con 0x7fe6e80602b0 2022-02-02T15:14:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36664/0 (socket says 172.21.15.33:36664) 2022-02-02T15:14:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 -- 172.21.15.33:0/3331713913 learned_addr learned my addr 172.21.15.33:0/3331713913 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:14:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e659c700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.592 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 -- 172.21.15.33:0/3331713913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80602b0 msgr2=0x7fe6e80f6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 -- 172.21.15.33:0/3331713913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d8005040 con 0x7fe6e80f9700 2022-02-02T15:14:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.596+0000 7fe6e5d9b700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fe6dc0026d0 tx=0x7fe6dc009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.597+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc0079c0 con 0x7fe6e80f9700 2022-02-02T15:14:51.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.597+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe6dc00f040 con 0x7fe6e80f9700 2022-02-02T15:14:51.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.597+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e80f5a00 con 0x7fe6e80f9700 2022-02-02T15:14:51.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.597+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe6dc014850 con 0x7fe6e80f9700 2022-02-02T15:14:51.594 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.597+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e810ed00 con 0x7fe6e80f9700 2022-02-02T15:14:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.598+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e8045ad0 con 0x7fe6e80f9700 2022-02-02T15:14:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.598+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe6dc007b20 con 0x7fe6e80f9700 2022-02-02T15:14:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.599+0000 7fe6d6ffd700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 0x7fe6d00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:14:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.599+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe6dc0819b0 con 0x7fe6e80f9700 2022-02-02T15:14:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.599+0000 7fe6e659c700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 0x7fe6d00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:14:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.599+0000 7fe6e659c700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 0x7fe6d00672e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fe6d8004630 tx=0x7fe6d8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:14:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.603+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe6dc04fa60 con 0x7fe6e80f9700 2022-02-02T15:14:51.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.814+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe6e8027a00 con 0x7fe6e80f9700 2022-02-02T15:14:51.805 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.814+0000 7fe6d6ffd700 1 -- 172.21.15.33:0/3331713913 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fe6dc0090d0 con 0x7fe6e80f9700 2022-02-02T15:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:14:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 msgr2=0x7fe6d00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 0x7fe6d00672e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fe6d8004630 tx=0x7fe6d8009b30).stop 2022-02-02T15:14:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 msgr2=0x7fe6e80f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:14:51.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7fe6dc0026d0 tx=0x7fe6dc009e00).stop 2022-02-02T15:14:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 shutdown_connections 2022-02-02T15:14:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe6d0064e20 0x7fe6d00672e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6e80602b0 0x7fe6e80f6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 --2- 172.21.15.33:0/3331713913 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6e80f9700 0x7fe6e80f5080 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:14:51.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 >> 172.21.15.33:0/3331713913 conn(0x7fe6e80f0ba0 msgr2=0x7fe6e80f2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:14:51.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 shutdown_connections 2022-02-02T15:14:51.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:14:51.818+0000 7fe6e759e700 1 -- 172.21.15.33:0/3331713913 wait complete. 2022-02-02T15:14:51.818 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:14:52.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:51 smithi033 ceph-mon[101165]: from='client.37026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:52.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/53810665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:14:52.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:51 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3331713913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:14:52.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:51 smithi037 ceph-mon[69017]: from='client.37026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:52.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/53810665' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:14:52.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:51 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3331713913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:14:53.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:52 smithi033 ceph-mon[101165]: from='client.46457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:53.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:52 smithi033 ceph-mon[101165]: pgmap v2884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:53.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:52 smithi037 ceph-mon[69017]: from='client.46457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:14:53.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:52 smithi037 ceph-mon[69017]: pgmap v2884: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:54 smithi033 ceph-mon[101165]: pgmap v2885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:14:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:14:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:54 smithi037 ceph-mon[69017]: pgmap v2885: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:14:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:14:57.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:56 smithi033 ceph-mon[101165]: pgmap v2886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:56 smithi037 ceph-mon[69017]: pgmap v2886: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:58.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:14:57 smithi033 ceph-mon[101165]: pgmap v2887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:14:58.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:14:57 smithi037 ceph-mon[69017]: pgmap v2887: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:01.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:00 smithi033 ceph-mon[101165]: pgmap v2888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:01.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:00 smithi037 ceph-mon[69017]: pgmap v2888: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:03.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:02 smithi033 ceph-mon[101165]: pgmap v2889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:03.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:02 smithi037 ceph-mon[69017]: pgmap v2889: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:05.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:04 smithi033 ceph-mon[101165]: pgmap v2890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:05.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:04 smithi037 ceph-mon[69017]: pgmap v2890: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:07.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:06 smithi033 ceph-mon[101165]: pgmap v2891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:07.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:06 smithi037 ceph-mon[69017]: pgmap v2891: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:07 smithi033 ceph-mon[101165]: pgmap v2892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:08.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:07 smithi037 ceph-mon[69017]: pgmap v2892: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:11.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:10 smithi033 ceph-mon[101165]: pgmap v2893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:11.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:10 smithi037 ceph-mon[69017]: pgmap v2893: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:13.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:12 smithi033 ceph-mon[101165]: pgmap v2894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:13.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:12 smithi037 ceph-mon[69017]: pgmap v2894: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:15.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:14 smithi033 ceph-mon[101165]: pgmap v2895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:15.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:14 smithi037 ceph-mon[69017]: pgmap v2895: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:17.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:16 smithi033 ceph-mon[101165]: pgmap v2896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:17.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:16 smithi037 ceph-mon[69017]: pgmap v2896: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:18.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:17 smithi033 ceph-mon[101165]: pgmap v2897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:18.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:17 smithi037 ceph-mon[69017]: pgmap v2897: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:21.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:20 smithi033 ceph-mon[101165]: pgmap v2898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:21.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:20 smithi037 ceph-mon[69017]: pgmap v2898: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:21.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 -- 172.21.15.33:0/4131616993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f66e0 msgr2=0x7f84380f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:21.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 --2- 172.21.15.33:0/4131616993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f66e0 0x7f84380f6b00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f8434004660 tx=0x7f8434009b30).stop 2022-02-02T15:15:21.927 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 -- 172.21.15.33:0/4131616993 shutdown_connections 2022-02-02T15:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 --2- 172.21.15.33:0/4131616993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f7980 0x7f84380f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 --2- 172.21.15.33:0/4131616993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f66e0 0x7f84380f6b00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 -- 172.21.15.33:0/4131616993 >> 172.21.15.33:0/4131616993 conn(0x7f84380f1e40 msgr2=0x7f84380f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:21.928 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 -- 172.21.15.33:0/4131616993 shutdown_connections 2022-02-02T15:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.935+0000 7f844046a700 1 -- 172.21.15.33:0/4131616993 wait complete. 2022-02-02T15:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 Processor -- start 2022-02-02T15:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 -- start start 2022-02-02T15:15:21.929 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f66e0 0x7f8438109130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438109bd0 con 0x7f84380f7980 2022-02-02T15:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f844046a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438109d10 con 0x7f84380f66e0 2022-02-02T15:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:21.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36672/0 (socket says 172.21.15.33:36672) 2022-02-02T15:15:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 -- 172.21.15.33:0/2346242255 learned_addr learned my addr 172.21.15.33:0/2346242255 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843e206700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f66e0 0x7f8438109130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 -- 172.21.15.33:0/2346242255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f66e0 msgr2=0x7f8438109130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:21.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f66e0 0x7f8438109130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 -- 172.21.15.33:0/2346242255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434005040 con 0x7f84380f7980 2022-02-02T15:15:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.936+0000 7f843da05700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f842c00e7f0 tx=0x7f842c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:21.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.937+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f842c0092e0 con 0x7f84380f7980 2022-02-02T15:15:21.933 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.937+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843810a6b0 con 0x7f84380f7980 2022-02-02T15:15:21.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.937+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f842c00f040 con 0x7f84380f7980 2022-02-02T15:15:21.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.937+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f842c014750 con 0x7f84380f7980 2022-02-02T15:15:21.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.937+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843810ac70 con 0x7f84380f7980 2022-02-02T15:15:21.934 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.938+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8438045ad0 con 0x7f84380f7980 2022-02-02T15:15:21.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.938+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f842c01b030 con 0x7f84380f7980 2022-02-02T15:15:21.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.939+0000 7f842affd700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 0x7f8424067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:21.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.939+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f842c081820 con 0x7f84380f7980 2022-02-02T15:15:21.935 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.939+0000 7f843e206700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 0x7f8424067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.939+0000 7f843e206700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 0x7f8424067290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f8434005010 tx=0x7f843400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:21.936 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:21.943+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f842c0533b0 con 0x7f84380f7980 2022-02-02T15:15:22.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.134+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f843810ae90 con 0x7f8424064dd0 2022-02-02T15:15:22.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.135+0000 7f842affd700 1 -- 172.21.15.33:0/2346242255 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f843810ae90 con 0x7f8424064dd0 2022-02-02T15:15:22.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 msgr2=0x7f8424067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 0x7f8424067290 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f8434005010 tx=0x7f843400b040).stop 2022-02-02T15:15:22.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 msgr2=0x7f8438109620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f842c00e7f0 tx=0x7f842c00b040).stop 2022-02-02T15:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 shutdown_connections 2022-02-02T15:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8424064dd0 0x7f8424067290 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84380f66e0 0x7f8438109130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 --2- 172.21.15.33:0/2346242255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84380f7980 0x7f8438109620 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 >> 172.21.15.33:0/2346242255 conn(0x7f84380f1e40 msgr2=0x7f843806a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 shutdown_connections 2022-02-02T15:15:22.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.137+0000 7f844046a700 1 -- 172.21.15.33:0/2346242255 wait complete. 2022-02-02T15:15:22.137 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:15:22.228 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 -- 172.21.15.33:0/3017529783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 msgr2=0x7f50ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/3017529783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec0f59e0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f50dc004660 tx=0x7f50dc009b30).stop 2022-02-02T15:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 -- 172.21.15.33:0/3017529783 shutdown_connections 2022-02-02T15:15:22.229 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/3017529783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 0x7f50ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/3017529783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec0f59e0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 -- 172.21.15.33:0/3017529783 >> 172.21.15.33:0/3017529783 conn(0x7f50ec0f0d40 msgr2=0x7f50ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 -- 172.21.15.33:0/3017529783 shutdown_connections 2022-02-02T15:15:22.230 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.238+0000 7f50f1dfe700 1 -- 172.21.15.33:0/3017529783 wait complete. 2022-02-02T15:15:22.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 Processor -- start 2022-02-02T15:15:22.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 -- start start 2022-02-02T15:15:22.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 0x7f50ec1073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec107990 con 0x7f50ec0f55c0 2022-02-02T15:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50f1dfe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50ec107ad0 con 0x7f50ec0f6860 2022-02-02T15:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36680/0 (socket says 172.21.15.33:36680) 2022-02-02T15:15:22.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50eb7fe700 1 -- 172.21.15.33:0/2970381698 learned_addr learned my addr 172.21.15.33:0/2970381698 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:22.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.239+0000 7f50eaffd700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 0x7f50ec1073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50eb7fe700 1 -- 172.21.15.33:0/2970381698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 msgr2=0x7f50ec1073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50eb7fe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 0x7f50ec1073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50eb7fe700 1 -- 172.21.15.33:0/2970381698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc005040 con 0x7f50ec0f55c0 2022-02-02T15:15:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50eb7fe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f50dc014040 tx=0x7f50dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc019070 con 0x7f50ec0f55c0 2022-02-02T15:15:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f50dc007e70 con 0x7f50ec0f55c0 2022-02-02T15:15:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50dc014d10 con 0x7f50ec0f55c0 2022-02-02T15:15:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50ec108410 con 0x7f50ec0f55c0 2022-02-02T15:15:22.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.240+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50ec108920 con 0x7f50ec0f55c0 2022-02-02T15:15:22.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.241+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50ec045ad0 con 0x7f50ec0f55c0 2022-02-02T15:15:22.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.242+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f50dc025070 con 0x7f50ec0f55c0 2022-02-02T15:15:22.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.242+0000 7f50d3fff700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.242+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f50dc082a80 con 0x7f50ec0f55c0 2022-02-02T15:15:22.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.242+0000 7f50eaffd700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.242+0000 7f50eaffd700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 0x7f50d4067290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f50e0009fd0 tx=0x7f50e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.246+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f50dc054560 con 0x7f50ec0f55c0 2022-02-02T15:15:22.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.431+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50ec0faca0 con 0x7f50d4064dd0 2022-02-02T15:15:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.446+0000 7f50d3fff700 1 -- 172.21.15.33:0/2970381698 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f50ec0faca0 con 0x7f50d4064dd0 2022-02-02T15:15:22.436 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:15:22.436 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (100m) 62m ago 101m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:15:22.437 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (93m) 62m ago 101m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:15:22.437 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (93m) 62m ago 101m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:15:22.437 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (100m) 62m ago 101m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:15:22.438 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (94m) 62m ago 97m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:15:22.438 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (94m) 62m ago 97m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:15:22.438 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (95m) 62m ago 97m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:15:22.438 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (97m) 62m ago 97m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:15:22.439 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (95m) 62m ago 102m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:15:22.439 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (94m) 62m ago 101m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:15:22.439 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (94m) 62m ago 103m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:15:22.439 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (94m) 62m ago 101m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:15:22.439 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (101m) 62m ago 101m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:15:22.440 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (100m) 62m ago 100m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:15:22.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 62m ago 100m - 4096M 2022-02-02T15:15:22.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (100m) 62m ago 100m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:15:22.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (99m) 62m ago 99m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:15:22.441 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (99m) 62m ago 99m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:15:22.441 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (99m) 62m ago 99m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:15:22.441 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (98m) 62m ago 98m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:15:22.441 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (100m) 62m ago 101m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:15:22.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 msgr2=0x7f50d4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 0x7f50d4067290 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f50e0009fd0 tx=0x7f50e000b040).stop 2022-02-02T15:15:22.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 msgr2=0x7f50ec106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f50dc014040 tx=0x7f50dc00b040).stop 2022-02-02T15:15:22.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 shutdown_connections 2022-02-02T15:15:22.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f50d4064dd0 0x7f50d4067290 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50ec0f55c0 0x7f50ec106ef0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 --2- 172.21.15.33:0/2970381698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50ec0f6860 0x7f50ec1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.447+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 >> 172.21.15.33:0/2970381698 conn(0x7f50ec0f0d40 msgr2=0x7f50ec05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.448+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 shutdown_connections 2022-02-02T15:15:22.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.448+0000 7f50f1dfe700 1 -- 172.21.15.33:0/2970381698 wait complete. 2022-02-02T15:15:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 -- 172.21.15.33:0/4000546713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f5430 msgr2=0x7fede80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 --2- 172.21.15.33:0/4000546713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f5430 0x7fede80f5850 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fedd8004660 tx=0x7fedd8009b30).stop 2022-02-02T15:15:22.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 -- 172.21.15.33:0/4000546713 shutdown_connections 2022-02-02T15:15:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 --2- 172.21.15.33:0/4000546713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f66d0 0x7fede80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 --2- 172.21.15.33:0/4000546713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f5430 0x7fede80f5850 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.547+0000 7fede759e700 1 -- 172.21.15.33:0/4000546713 >> 172.21.15.33:0/4000546713 conn(0x7fede80f0b90 msgr2=0x7fede80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 -- 172.21.15.33:0/4000546713 shutdown_connections 2022-02-02T15:15:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 -- 172.21.15.33:0/4000546713 wait complete. 2022-02-02T15:15:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 Processor -- start 2022-02-02T15:15:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 -- start start 2022-02-02T15:15:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f5430 0x7fede8109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede80603e0 con 0x7fede80f66d0 2022-02-02T15:15:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.548+0000 7fede759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede8060520 con 0x7fede80f5430 2022-02-02T15:15:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36692/0 (socket says 172.21.15.33:36692) 2022-02-02T15:15:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 -- 172.21.15.33:0/3647643331 learned_addr learned my addr 172.21.15.33:0/3647643331 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede659c700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f5430 0x7fede8109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 -- 172.21.15.33:0/3647643331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f5430 msgr2=0x7fede8109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f5430 0x7fede8109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 -- 172.21.15.33:0/3647643331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd8005040 con 0x7fede80f66d0 2022-02-02T15:15:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede5d9b700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7feddc0026d0 tx=0x7feddc009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feddc009320 con 0x7fede80f66d0 2022-02-02T15:15:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feddc00f040 con 0x7fede80f66d0 2022-02-02T15:15:22.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede810c540 con 0x7fede80f66d0 2022-02-02T15:15:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feddc0147e0 con 0x7fede80f66d0 2022-02-02T15:15:22.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.549+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede810cb00 con 0x7fede80f66d0 2022-02-02T15:15:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.550+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fede8045ad0 con 0x7fede80f66d0 2022-02-02T15:15:22.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.551+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feddc009480 con 0x7fede80f66d0 2022-02-02T15:15:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.551+0000 7fedd6ffd700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 0x7fedd00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.551+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feddc081ae0 con 0x7fede80f66d0 2022-02-02T15:15:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.551+0000 7fede659c700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 0x7fedd00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.552+0000 7fede659c700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 0x7fedd00672e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fedd8004e30 tx=0x7fedd8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.556+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feddc04fb90 con 0x7fede80f66d0 2022-02-02T15:15:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.798+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fede8027a00 con 0x7fede80f66d0 2022-02-02T15:15:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.799+0000 7fedd6ffd700 1 -- 172.21.15.33:0/3647643331 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7feddc0531b0 con 0x7fede80f66d0 2022-02-02T15:15:22.790 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:15:22.790 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:15:22.790 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:15:22.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:22.791 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:15:22.791 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:15:22.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:22.792 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:15:22.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:15:22.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:22.792 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:15:22.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:15:22.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:22.793 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:15:22.793 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:15:22.793 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:15:22.794 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:15:22.794 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:15:22.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 msgr2=0x7fedd00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 0x7fedd00672e0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7fedd8004e30 tx=0x7fedd8009b30).stop 2022-02-02T15:15:22.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 msgr2=0x7fede810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7feddc0026d0 tx=0x7feddc009de0).stop 2022-02-02T15:15:22.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 shutdown_connections 2022-02-02T15:15:22.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fedd0064e20 0x7fedd00672e0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede80f5430 0x7fede8109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 --2- 172.21.15.33:0/3647643331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fede80f66d0 0x7fede810bf90 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 >> 172.21.15.33:0/3647643331 conn(0x7fede80f0b90 msgr2=0x7fede80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 shutdown_connections 2022-02-02T15:15:22.797 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.802+0000 7fede759e700 1 -- 172.21.15.33:0/3647643331 wait complete. 2022-02-02T15:15:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.903+0000 7f133759e700 1 -- 172.21.15.33:0/1439128497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f66d0 msgr2=0x7f13380f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.903+0000 7f133759e700 1 --2- 172.21.15.33:0/1439128497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f66d0 0x7f13380f6b30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f132c004660 tx=0x7f132c009b30).stop 2022-02-02T15:15:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- 172.21.15.33:0/1439128497 shutdown_connections 2022-02-02T15:15:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 --2- 172.21.15.33:0/1439128497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f66d0 0x7f13380f6b30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 --2- 172.21.15.33:0/1439128497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f5430 0x7f13380f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- 172.21.15.33:0/1439128497 >> 172.21.15.33:0/1439128497 conn(0x7f13380f0b90 msgr2=0x7f13380f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- 172.21.15.33:0/1439128497 shutdown_connections 2022-02-02T15:15:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- 172.21.15.33:0/1439128497 wait complete. 2022-02-02T15:15:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 Processor -- start 2022-02-02T15:15:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- start start 2022-02-02T15:15:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f66d0 0x7f133810bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.904+0000 7f133759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13380603e0 con 0x7f13380f5430 2022-02-02T15:15:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133759e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1338060520 con 0x7f13380f66d0 2022-02-02T15:15:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36700/0 (socket says 172.21.15.33:36700) 2022-02-02T15:15:22.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 -- 172.21.15.33:0/363087810 learned_addr learned my addr 172.21.15.33:0/363087810 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:22.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f1335d9b700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f66d0 0x7f133810bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 -- 172.21.15.33:0/363087810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f66d0 msgr2=0x7f133810bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:22.900 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f66d0 0x7f133810bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 -- 172.21.15.33:0/363087810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c005040 con 0x7f13380f5430 2022-02-02T15:15:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133659c700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f132800e7c0 tx=0x7f132800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13280092e0 con 0x7f13380f5430 2022-02-02T15:15:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f132800f040 con 0x7f13380f5430 2022-02-02T15:15:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133810c480 con 0x7f13380f5430 2022-02-02T15:15:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13280147e0 con 0x7f13380f5430 2022-02-02T15:15:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.905+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133810ca40 con 0x7f13380f5430 2022-02-02T15:15:22.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.906+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1338045ad0 con 0x7f13380f5430 2022-02-02T15:15:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.907+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f132801b030 con 0x7f13380f5430 2022-02-02T15:15:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.907+0000 7f1326ffd700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 0x7f13200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.907+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f13280817b0 con 0x7f13380f5430 2022-02-02T15:15:22.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.907+0000 7f1335d9b700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 0x7f13200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:22.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.908+0000 7f1335d9b700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 0x7f13200672e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f132c005010 tx=0x7f132c016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:22.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:22.912+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f132804f910 con 0x7f13380f5430 2022-02-02T15:15:23.113 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.123+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1338027a00 con 0x7f13380f5430 2022-02-02T15:15:23.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:22 smithi033 ceph-mon[101165]: pgmap v2899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:23.114 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:22 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3647643331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:15:23.114 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.123+0000 7f1326ffd700 1 -- 172.21.15.33:0/363087810 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1328019750 con 0x7f13380f5430 2022-02-02T15:15:23.115 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:15:23.115 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:15:23.115 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:15:23.115 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:15:23.116 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:23.116 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:15:23.116 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:15:23.116 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:15:23.117 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:15:23.117 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:15:23.117 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:15:23.117 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:15:23.117 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:15:23.118 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:15:23.118 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:15:23.118 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:15:23.118 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:15:23.119 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:15:23.119 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:15:23.119 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:15:23.119 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:15:23.120 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:15:23.120 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:15:23.120 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:15:23.120 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:15:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:15:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:15:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:15:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:15:23.121 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:15:23.122 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:15:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:23.122 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:15:23.122 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:23.123 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:23.123 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:23.123 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:23.123 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:23.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 msgr2=0x7f13200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:23.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 0x7f13200672e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f132c005010 tx=0x7f132c016040).stop 2022-02-02T15:15:23.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 msgr2=0x7f13381099d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:23.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7f132800e7c0 tx=0x7f132800b040).stop 2022-02-02T15:15:23.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 shutdown_connections 2022-02-02T15:15:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1320064e20 0x7f13200672e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13380f5430 0x7f13381099d0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 --2- 172.21.15.33:0/363087810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13380f66d0 0x7f133810bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 >> 172.21.15.33:0/363087810 conn(0x7f13380f0b90 msgr2=0x7f13380fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 shutdown_connections 2022-02-02T15:15:23.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:23.125+0000 7f133759e700 1 -- 172.21.15.33:0/363087810 wait complete. 2022-02-02T15:15:23.127 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:15:23.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:22 smithi037 ceph-mon[69017]: pgmap v2899: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:23.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:22 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3647643331' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:15:24.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:23 smithi033 ceph-mon[101165]: from='client.37042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:24.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:23 smithi033 ceph-mon[101165]: from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:24.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:23 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/363087810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:15:24.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:23 smithi037 ceph-mon[69017]: from='client.37042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:24.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:23 smithi037 ceph-mon[69017]: from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:24.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:23 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/363087810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:15:25.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:24 smithi033 ceph-mon[101165]: pgmap v2900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:25.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:24 smithi037 ceph-mon[69017]: pgmap v2900: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:26.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:25 smithi033 ceph-mon[101165]: pgmap v2901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:26.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:25 smithi037 ceph-mon[69017]: pgmap v2901: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:28.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:27 smithi033 ceph-mon[101165]: pgmap v2902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:27 smithi037 ceph-mon[69017]: pgmap v2902: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:31.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:30 smithi033 ceph-mon[101165]: pgmap v2903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:31.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:30 smithi037 ceph-mon[69017]: pgmap v2903: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:33.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:32 smithi033 ceph-mon[101165]: pgmap v2904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:33.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:32 smithi037 ceph-mon[69017]: pgmap v2904: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:35.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:34 smithi033 ceph-mon[101165]: pgmap v2905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:35.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:34 smithi037 ceph-mon[69017]: pgmap v2905: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:37.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:36 smithi033 ceph-mon[101165]: pgmap v2906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:37.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:36 smithi037 ceph-mon[69017]: pgmap v2906: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:38.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:37 smithi033 ceph-mon[101165]: pgmap v2907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:38.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:37 smithi037 ceph-mon[69017]: pgmap v2907: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:41.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:40 smithi033 ceph-mon[101165]: pgmap v2908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:41.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:40 smithi037 ceph-mon[69017]: pgmap v2908: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:43.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:42 smithi033 ceph-mon[101165]: pgmap v2909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:43.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:42 smithi037 ceph-mon[69017]: pgmap v2909: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:45.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:44 smithi033 ceph-mon[101165]: pgmap v2910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:45.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:44 smithi037 ceph-mon[69017]: pgmap v2910: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:46.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:45 smithi033 ceph-mon[101165]: pgmap v2911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:46.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:45 smithi037 ceph-mon[69017]: pgmap v2911: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:48.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:47 smithi033 ceph-mon[101165]: pgmap v2912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:48.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:47 smithi037 ceph-mon[69017]: pgmap v2912: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:51.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:50 smithi033 ceph-mon[101165]: pgmap v2913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:51.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:50 smithi037 ceph-mon[69017]: pgmap v2913: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:53.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:52 smithi033 ceph-mon[101165]: pgmap v2914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:53.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 -- 172.21.15.33:0/25839787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 msgr2=0x7f7cc80f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/25839787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc80f6b00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f7cb8004660 tx=0x7f7cb8009b30).stop 2022-02-02T15:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 -- 172.21.15.33:0/25839787 shutdown_connections 2022-02-02T15:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/25839787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 0x7f7cc80f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.233 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/25839787 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc80f6b00 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 -- 172.21.15.33:0/25839787 >> 172.21.15.33:0/25839787 conn(0x7f7cc80f1e40 msgr2=0x7f7cc80f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.240+0000 7f7ccdc36700 1 -- 172.21.15.33:0/25839787 shutdown_connections 2022-02-02T15:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.241+0000 7f7ccdc36700 1 -- 172.21.15.33:0/25839787 wait complete. 2022-02-02T15:15:53.234 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.241+0000 7f7ccdc36700 1 Processor -- start 2022-02-02T15:15:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.241+0000 7f7ccdc36700 1 -- start start 2022-02-02T15:15:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7ccdc36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7ccdc36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 0x7f7cc8107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.235 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7ccdc36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8107a00 con 0x7f7cc80f66e0 2022-02-02T15:15:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7ccdc36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc8107b40 con 0x7f7cc80f7980 2022-02-02T15:15:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36710/0 (socket says 172.21.15.33:36710) 2022-02-02T15:15:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 -- 172.21.15.33:0/3824965013 learned_addr learned my addr 172.21.15.33:0/3824965013 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:53.236 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc6ffd700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 0x7f7cc8107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 -- 172.21.15.33:0/3824965013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 msgr2=0x7f7cc8107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 0x7f7cc8107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 -- 172.21.15.33:0/3824965013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8005040 con 0x7f7cc80f66e0 2022-02-02T15:15:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.242+0000 7f7cc77fe700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f7cb8013a70 tx=0x7f7cb8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.243+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb8018070 con 0x7f7cc80f66e0 2022-02-02T15:15:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.243+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f7cb80097d0 con 0x7f7cc80f66e0 2022-02-02T15:15:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.243+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8108480 con 0x7f7cc80f66e0 2022-02-02T15:15:53.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.243+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7cb801c3c0 con 0x7f7cc80f66e0 2022-02-02T15:15:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.243+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc81089e0 con 0x7f7cc80f66e0 2022-02-02T15:15:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.244+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc8045ad0 con 0x7f7cc80f66e0 2022-02-02T15:15:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.244+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7cb8007ba0 con 0x7f7cc80f66e0 2022-02-02T15:15:53.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.244+0000 7f7caffff700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.245+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7cb8083790 con 0x7f7cc80f66e0 2022-02-02T15:15:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.245+0000 7f7cc6ffd700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.245+0000 7f7cc6ffd700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 0x7f7cb0067290 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f7cbc009740 tx=0x7f7cbc009c60).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.241 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.249+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f7cb8055330 con 0x7f7cc80f66e0 2022-02-02T15:15:53.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:52 smithi037 ceph-mon[69017]: pgmap v2914: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:53.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.436+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc80fefb0 con 0x7f7cb0064dd0 2022-02-02T15:15:53.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.438+0000 7f7caffff700 1 -- 172.21.15.33:0/3824965013 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f7cc80fefb0 con 0x7f7cb0064dd0 2022-02-02T15:15:53.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 msgr2=0x7f7cb0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 0x7f7cb0067290 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f7cbc009740 tx=0x7f7cbc009c60).stop 2022-02-02T15:15:53.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 msgr2=0x7f7cc8106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f7cb8013a70 tx=0x7f7cb8009b30).stop 2022-02-02T15:15:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 shutdown_connections 2022-02-02T15:15:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f7cb0064dd0 0x7f7cb0067290 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cc80f66e0 0x7f7cc8106f60 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.431 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 --2- 172.21.15.33:0/3824965013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc80f7980 0x7f7cc8107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.439+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 >> 172.21.15.33:0/3824965013 conn(0x7f7cc80f1e40 msgr2=0x7f7cc80fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:53.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.440+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 shutdown_connections 2022-02-02T15:15:53.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.440+0000 7f7ccdc36700 1 -- 172.21.15.33:0/3824965013 wait complete. 2022-02-02T15:15:53.439 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:15:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 -- 172.21.15.33:0/555683643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 msgr2=0x7fed440f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 --2- 172.21.15.33:0/555683643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed440f6b30 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7fed2c004660 tx=0x7fed2c009b30).stop 2022-02-02T15:15:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 -- 172.21.15.33:0/555683643 shutdown_connections 2022-02-02T15:15:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 --2- 172.21.15.33:0/555683643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed440f6b30 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 --2- 172.21.15.33:0/555683643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 0x7fed440f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 -- 172.21.15.33:0/555683643 >> 172.21.15.33:0/555683643 conn(0x7fed440f0b90 msgr2=0x7fed440f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 -- 172.21.15.33:0/555683643 shutdown_connections 2022-02-02T15:15:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.540+0000 7fed4359e700 1 -- 172.21.15.33:0/555683643 wait complete. 2022-02-02T15:15:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 Processor -- start 2022-02-02T15:15:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 -- start start 2022-02-02T15:15:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 0x7fed44107780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed44060420 con 0x7fed440f66d0 2022-02-02T15:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed44060560 con 0x7fed440f5430 2022-02-02T15:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed41d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed41d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36720/0 (socket says 172.21.15.33:36720) 2022-02-02T15:15:53.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed41d9b700 1 -- 172.21.15.33:0/1927363916 learned_addr learned my addr 172.21.15.33:0/1927363916 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.541+0000 7fed4259c700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 0x7fed44107780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed41d9b700 1 -- 172.21.15.33:0/1927363916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 msgr2=0x7fed44107780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed41d9b700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 0x7fed44107780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed41d9b700 1 -- 172.21.15.33:0/1927363916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed2c005040 con 0x7fed440f66d0 2022-02-02T15:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed41d9b700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fed2c009990 tx=0x7fed2c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c018070 con 0x7fed440f66d0 2022-02-02T15:15:53.539 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fed2c007ba0 con 0x7fed440f66d0 2022-02-02T15:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4410a230 con 0x7fed440f66d0 2022-02-02T15:15:53.540 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed2c01c3c0 con 0x7fed440f66d0 2022-02-02T15:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.542+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4410a790 con 0x7fed440f66d0 2022-02-02T15:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.543+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed44045ad0 con 0x7fed440f66d0 2022-02-02T15:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.544+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fed2c01d420 con 0x7fed440f66d0 2022-02-02T15:15:53.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.544+0000 7fed3affd700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 0x7fed300672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.544+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fed2c083700 con 0x7fed440f66d0 2022-02-02T15:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.544+0000 7fed4259c700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 0x7fed300672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.545+0000 7fed4259c700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 0x7fed300672e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7fed440600a0 tx=0x7fed3400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.549+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fed2c051810 con 0x7fed440f66d0 2022-02-02T15:15:53.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.731+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed440fdd30 con 0x7fed30064e20 2022-02-02T15:15:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.745+0000 7fed3affd700 1 -- 172.21.15.33:0/1927363916 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fed440fdd30 con 0x7fed30064e20 2022-02-02T15:15:53.736 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:15:53.736 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (101m) 63m ago 102m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:15:53.736 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (94m) 63m ago 102m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:15:53.736 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (94m) 63m ago 101m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:15:53.737 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (101m) 63m ago 101m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:15:53.737 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (94m) 63m ago 98m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:15:53.737 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (95m) 63m ago 98m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:15:53.737 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (96m) 63m ago 98m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:15:53.738 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (98m) 63m ago 98m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:15:53.738 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (95m) 63m ago 103m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:15:53.738 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (95m) 63m ago 101m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:15:53.738 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (95m) 63m ago 103m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:15:53.739 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (94m) 63m ago 101m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:15:53.739 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (101m) 63m ago 101m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:15:53.739 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (101m) 63m ago 101m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:15:53.739 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 63m ago 100m - 4096M 2022-02-02T15:15:53.740 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (100m) 63m ago 100m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:15:53.740 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (100m) 63m ago 100m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:15:53.740 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (100m) 63m ago 100m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:15:53.740 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (99m) 63m ago 99m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:15:53.740 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (99m) 63m ago 99m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:15:53.741 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (100m) 63m ago 101m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:15:53.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.747+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 msgr2=0x7fed300672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.747+0000 7fed4359e700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 0x7fed300672e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7fed440600a0 tx=0x7fed3400b040).stop 2022-02-02T15:15:53.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.747+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 msgr2=0x7fed44109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.747+0000 7fed4359e700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7fed2c009990 tx=0x7fed2c009b30).stop 2022-02-02T15:15:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 shutdown_connections 2022-02-02T15:15:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fed30064e20 0x7fed300672e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed440f5430 0x7fed44107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 --2- 172.21.15.33:0/1927363916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed440f66d0 0x7fed44109c80 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 >> 172.21.15.33:0/1927363916 conn(0x7fed440f0b90 msgr2=0x7fed440fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:53.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 shutdown_connections 2022-02-02T15:15:53.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.748+0000 7fed4359e700 1 -- 172.21.15.33:0/1927363916 wait complete. 2022-02-02T15:15:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 -- 172.21.15.33:0/262236947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 msgr2=0x7f94140f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 --2- 172.21.15.33:0/262236947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f94140f7de0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f9408004660 tx=0x7f9408009b30).stop 2022-02-02T15:15:53.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 -- 172.21.15.33:0/262236947 shutdown_connections 2022-02-02T15:15:53.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 --2- 172.21.15.33:0/262236947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f94140f7de0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 --2- 172.21.15.33:0/262236947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 0x7f94140f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 -- 172.21.15.33:0/262236947 >> 172.21.15.33:0/262236947 conn(0x7f94140f1e40 msgr2=0x7f94140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:53.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 -- 172.21.15.33:0/262236947 shutdown_connections 2022-02-02T15:15:53.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.847+0000 7f941b693700 1 -- 172.21.15.33:0/262236947 wait complete. 2022-02-02T15:15:53.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 Processor -- start 2022-02-02T15:15:53.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 -- start start 2022-02-02T15:15:53.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 0x7f9414106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414107a00 con 0x7f94140f7980 2022-02-02T15:15:53.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941b693700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9414107b40 con 0x7f94140f66e0 2022-02-02T15:15:53.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f9418c2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f9418c2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36730/0 (socket says 172.21.15.33:36730) 2022-02-02T15:15:53.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f9418c2e700 1 -- 172.21.15.33:0/1015585957 learned_addr learned my addr 172.21.15.33:0/1015585957 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:53.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.848+0000 7f941942f700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 0x7f9414106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9418c2e700 1 -- 172.21.15.33:0/1015585957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 msgr2=0x7f9414106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:53.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9418c2e700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 0x7f9414106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:53.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9418c2e700 1 -- 172.21.15.33:0/1015585957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408005040 con 0x7f94140f7980 2022-02-02T15:15:53.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9418c2e700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f9408009990 tx=0x7f9408009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9408018070 con 0x7f94140f7980 2022-02-02T15:15:53.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9414108480 con 0x7f94140f7980 2022-02-02T15:15:53.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9408007ba0 con 0x7f94140f7980 2022-02-02T15:15:53.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940801c3c0 con 0x7f94140f7980 2022-02-02T15:15:53.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.849+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141089e0 con 0x7f94140f7980 2022-02-02T15:15:53.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.850+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414045ad0 con 0x7f94140f7980 2022-02-02T15:15:53.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.851+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f940801d420 con 0x7f94140f7980 2022-02-02T15:15:53.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.851+0000 7f9405ffb700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 0x7f9400067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:53.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.851+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9408083630 con 0x7f94140f7980 2022-02-02T15:15:53.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.851+0000 7f941942f700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 0x7f9400067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:53.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.852+0000 7f941942f700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 0x7f9400067290 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f94140f77e0 tx=0x7f941000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:53.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:53.855+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f94080550b0 con 0x7f94140f7980 2022-02-02T15:15:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.102+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9414027a00 con 0x7f94140f7980 2022-02-02T15:15:54.093 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:53 smithi033 ceph-mon[101165]: from='client.37058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:54.094 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:53 smithi033 ceph-mon[101165]: from='client.37062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:54.095 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:53 smithi033 ceph-mon[101165]: pgmap v2915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.103+0000 7f9405ffb700 1 -- 172.21.15.33:0/1015585957 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9408054ca0 con 0x7f94140f7980 2022-02-02T15:15:54.096 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:15:54.097 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:15:54.097 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:15:54.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:54.098 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:15:54.098 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:15:54.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:54.099 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:15:54.099 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:15:54.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:54.100 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:15:54.100 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:15:54.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:15:54.100 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:15:54.100 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:15:54.101 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:15:54.101 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:15:54.102 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:15:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 msgr2=0x7f9400067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 0x7f9400067290 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f94140f77e0 tx=0x7f941000b040).stop 2022-02-02T15:15:54.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 msgr2=0x7f9414107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f9408009990 tx=0x7f9408009b30).stop 2022-02-02T15:15:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 shutdown_connections 2022-02-02T15:15:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9400064dd0 0x7f9400067290 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94140f66e0 0x7f9414106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.104 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 --2- 172.21.15.33:0/1015585957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94140f7980 0x7f9414107450 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 >> 172.21.15.33:0/1015585957 conn(0x7f94140f1e40 msgr2=0x7f94140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 shutdown_connections 2022-02-02T15:15:54.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.105+0000 7f941b693700 1 -- 172.21.15.33:0/1015585957 wait complete. 2022-02-02T15:15:54.198 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 -- 172.21.15.33:0/2354425767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f7980 msgr2=0x7f1dd40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/2354425767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f7980 0x7f1dd40f7de0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 rx=0x7f1dc8004660 tx=0x7f1dc8009b30).stop 2022-02-02T15:15:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 -- 172.21.15.33:0/2354425767 shutdown_connections 2022-02-02T15:15:54.199 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/2354425767 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f7980 0x7f1dd40f7de0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/2354425767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f66e0 0x7f1dd40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 -- 172.21.15.33:0/2354425767 >> 172.21.15.33:0/2354425767 conn(0x7f1dd40f1e40 msgr2=0x7f1dd40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 -- 172.21.15.33:0/2354425767 shutdown_connections 2022-02-02T15:15:54.200 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.206+0000 7f1ddb80c700 1 -- 172.21.15.33:0/2354425767 wait complete. 2022-02-02T15:15:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 Processor -- start 2022-02-02T15:15:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 -- start start 2022-02-02T15:15:54.201 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f7980 0x7f1dd4107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4107a00 con 0x7f1dd40f66e0 2022-02-02T15:15:54.202 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1ddb80c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4107b40 con 0x7f1dd40f7980 2022-02-02T15:15:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1dd95a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1dd95a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36738/0 (socket says 172.21.15.33:36738) 2022-02-02T15:15:54.203 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.207+0000 7f1dd95a8700 1 -- 172.21.15.33:0/4276729296 learned_addr learned my addr 172.21.15.33:0/4276729296 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:15:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dd8da7700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f7980 0x7f1dd4107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dd95a8700 1 -- 172.21.15.33:0/4276729296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f7980 msgr2=0x7f1dd4107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dd95a8700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f7980 0x7f1dd4107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dd95a8700 1 -- 172.21.15.33:0/4276729296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc8005040 con 0x7f1dd40f66e0 2022-02-02T15:15:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dd95a8700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f1dd000c790 tx=0x7f1dd0007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd0013630 con 0x7f1dd40f66e0 2022-02-02T15:15:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1dd0012860 con 0x7f1dd40f66e0 2022-02-02T15:15:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41084e0 con 0x7f1dd40f66e0 2022-02-02T15:15:54.205 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dd0002780 con 0x7f1dd40f66e0 2022-02-02T15:15:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.208+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd4108aa0 con 0x7f1dd40f66e0 2022-02-02T15:15:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.209+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd4045ad0 con 0x7f1dd40f66e0 2022-02-02T15:15:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.210+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1dd0010070 con 0x7f1dd40f66e0 2022-02-02T15:15:54.207 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.210+0000 7f1dc5ffb700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 0x7f1dc0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:15:54.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.210+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1dd0081b80 con 0x7f1dd40f66e0 2022-02-02T15:15:54.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.210+0000 7f1dd8da7700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 0x7f1dc0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:15:54.208 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.211+0000 7f1dd8da7700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 0x7f1dc0067290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f1dc8004630 tx=0x7f1dc8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:15:54.209 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.214+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1dd0053600 con 0x7f1dd40f66e0 2022-02-02T15:15:54.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:53 smithi037 ceph-mon[69017]: from='client.37058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:54.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:53 smithi037 ceph-mon[69017]: from='client.37062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:15:54.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:53 smithi037 ceph-mon[69017]: pgmap v2915: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:54.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.427+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1dd40fef70 con 0x7f1dd40f66e0 2022-02-02T15:15:54.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.427+0000 7f1dc5ffb700 1 -- 172.21.15.33:0/4276729296 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f1dd00531f0 con 0x7f1dd40f66e0 2022-02-02T15:15:54.419 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:15:54.419 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:15:54.419 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:15:54.419 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:15:54.420 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:54.420 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:15:54.420 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:15:54.420 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:15:54.421 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:15:54.421 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:15:54.421 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:15:54.421 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:15:54.421 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:15:54.422 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:15:54.422 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:15:54.422 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:15:54.422 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:15:54.423 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:15:54.423 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:15:54.423 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:15:54.424 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:15:54.425 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:15:54.425 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:15:54.425 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:15:54.425 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:15:54.426 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:15:54.426 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:15:54.426 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:15:54.426 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:15:54.427 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:15:54.427 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:15:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:54.428 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:15:54.428 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:15:54.428 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:54.429 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:54.430 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:54.430 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:15:54.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 msgr2=0x7f1dc0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 0x7f1dc0067290 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f1dc8004630 tx=0x7f1dc8009b30).stop 2022-02-02T15:15:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 msgr2=0x7f1dd4106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:15:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f1dd000c790 tx=0x7f1dd0007d90).stop 2022-02-02T15:15:54.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 shutdown_connections 2022-02-02T15:15:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f1dc0064dd0 0x7f1dc0067290 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1dd40f66e0 0x7f1dd4106f60 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 --2- 172.21.15.33:0/4276729296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dd40f7980 0x7f1dd4107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:15:54.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 >> 172.21.15.33:0/4276729296 conn(0x7f1dd40f1e40 msgr2=0x7f1dd40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:15:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 shutdown_connections 2022-02-02T15:15:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:15:54.430+0000 7f1ddb80c700 1 -- 172.21.15.33:0/4276729296 wait complete. 2022-02-02T15:15:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:15:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1015585957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:15:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:54 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4276729296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:15:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:15:55.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:15:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1015585957' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:15:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:54 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4276729296' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:15:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:15:55.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:15:56.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:55 smithi033 ceph-mon[101165]: pgmap v2916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:56.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:55 smithi037 ceph-mon[69017]: pgmap v2916: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:58.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:15:57 smithi033 ceph-mon[101165]: pgmap v2917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:15:58.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:15:57 smithi037 ceph-mon[69017]: pgmap v2917: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:01.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:00 smithi033 ceph-mon[101165]: pgmap v2918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:01.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:00 smithi037 ceph-mon[69017]: pgmap v2918: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:03.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:02 smithi033 ceph-mon[101165]: pgmap v2919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:03.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:02 smithi037 ceph-mon[69017]: pgmap v2919: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:04.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:03 smithi033 ceph-mon[101165]: pgmap v2920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:04.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:03 smithi037 ceph-mon[69017]: pgmap v2920: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:07.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:06 smithi033 ceph-mon[101165]: pgmap v2921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:07.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:06 smithi037 ceph-mon[69017]: pgmap v2921: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:07 smithi033 ceph-mon[101165]: pgmap v2922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:08.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:07 smithi037 ceph-mon[69017]: pgmap v2922: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:11.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:10 smithi033 ceph-mon[101165]: pgmap v2923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:11.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:10 smithi037 ceph-mon[69017]: pgmap v2923: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:12.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:11 smithi033 ceph-mon[101165]: pgmap v2924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:12.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:11 smithi037 ceph-mon[69017]: pgmap v2924: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:15.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:14 smithi033 ceph-mon[101165]: pgmap v2925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:15.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:14 smithi037 ceph-mon[69017]: pgmap v2925: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:16.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:15 smithi033 ceph-mon[101165]: pgmap v2926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:16.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:15 smithi037 ceph-mon[69017]: pgmap v2926: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:18.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:17 smithi033 ceph-mon[101165]: pgmap v2927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:18.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:17 smithi037 ceph-mon[69017]: pgmap v2927: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:21.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:20 smithi033 ceph-mon[101165]: pgmap v2928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:21.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:20 smithi037 ceph-mon[69017]: pgmap v2928: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:22.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:21 smithi033 ceph-mon[101165]: pgmap v2929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:22.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:21 smithi037 ceph-mon[69017]: pgmap v2929: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:24.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:23 smithi033 ceph-mon[101165]: pgmap v2930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:24.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:23 smithi037 ceph-mon[69017]: pgmap v2930: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 -- 172.21.15.33:0/1582828966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f7980 msgr2=0x7f9c700f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.536 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 --2- 172.21.15.33:0/1582828966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f7980 0x7f9c700f7de0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f9c60004660 tx=0x7f9c60009b30).stop 2022-02-02T15:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 -- 172.21.15.33:0/1582828966 shutdown_connections 2022-02-02T15:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 --2- 172.21.15.33:0/1582828966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f7980 0x7f9c700f7de0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 --2- 172.21.15.33:0/1582828966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f66e0 0x7f9c700f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 -- 172.21.15.33:0/1582828966 >> 172.21.15.33:0/1582828966 conn(0x7f9c700f1e40 msgr2=0x7f9c700f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 -- 172.21.15.33:0/1582828966 shutdown_connections 2022-02-02T15:16:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.546+0000 7f9c749d8700 1 -- 172.21.15.33:0/1582828966 wait complete. 2022-02-02T15:16:24.541 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 Processor -- start 2022-02-02T15:16:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 -- start start 2022-02-02T15:16:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f7980 0x7f9c70109680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.542 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70109c30 con 0x7f9c700f66e0 2022-02-02T15:16:24.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c749d8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70109d70 con 0x7f9c700f7980 2022-02-02T15:16:24.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c6e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c6e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36748/0 (socket says 172.21.15.33:36748) 2022-02-02T15:16:24.543 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c6e59c700 1 -- 172.21.15.33:0/548868450 learned_addr learned my addr 172.21.15.33:0/548868450 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.547+0000 7f9c6dd9b700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f7980 0x7f9c70109680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c6e59c700 1 -- 172.21.15.33:0/548868450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f7980 msgr2=0x7f9c70109680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c6e59c700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f7980 0x7f9c70109680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.545 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c6e59c700 1 -- 172.21.15.33:0/548868450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c60005040 con 0x7f9c700f66e0 2022-02-02T15:16:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c6e59c700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f9c6400c790 tx=0x7f9c64007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c64013630 con 0x7f9c700f66e0 2022-02-02T15:16:24.546 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9c64012860 con 0x7f9c700f66e0 2022-02-02T15:16:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7010a710 con 0x7f9c700f66e0 2022-02-02T15:16:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c64002780 con 0x7f9c700f66e0 2022-02-02T15:16:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.548+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7010acd0 con 0x7f9c700f66e0 2022-02-02T15:16:24.547 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.549+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70045ad0 con 0x7f9c700f66e0 2022-02-02T15:16:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.550+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9c64010070 con 0x7f9c700f66e0 2022-02-02T15:16:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.550+0000 7f9c5effd700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 0x7f9c58067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.550+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9c64081b80 con 0x7f9c700f66e0 2022-02-02T15:16:24.548 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.550+0000 7f9c6dd9b700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 0x7f9c58067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.551+0000 7f9c6dd9b700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 0x7f9c58067290 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f9c60004630 tx=0x7f9c60009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:24.549 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.554+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9c64053600 con 0x7f9c700f66e0 2022-02-02T15:16:24.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.743+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c700fefe0 con 0x7f9c58064dd0 2022-02-02T15:16:24.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.745+0000 7f9c5effd700 1 -- 172.21.15.33:0/548868450 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9c700fefe0 con 0x7f9c58064dd0 2022-02-02T15:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 msgr2=0x7f9c58067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 0x7f9c58067290 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f9c60004630 tx=0x7f9c60009b30).stop 2022-02-02T15:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 msgr2=0x7f9c70109190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7f9c6400c790 tx=0x7f9c64007d90).stop 2022-02-02T15:16:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 shutdown_connections 2022-02-02T15:16:24.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9c58064dd0 0x7f9c58067290 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c700f66e0 0x7f9c70109190 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 --2- 172.21.15.33:0/548868450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c700f7980 0x7f9c70109680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 >> 172.21.15.33:0/548868450 conn(0x7f9c700f1e40 msgr2=0x7f9c7006a520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:24.739 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.746+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 shutdown_connections 2022-02-02T15:16:24.740 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.747+0000 7f9c749d8700 1 -- 172.21.15.33:0/548868450 wait complete. 2022-02-02T15:16:24.746 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 -- 172.21.15.33:0/2774637601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f77d0 msgr2=0x7fa3840f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 --2- 172.21.15.33:0/2774637601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f77d0 0x7fa3840f7c30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fa378004660 tx=0x7fa378009b30).stop 2022-02-02T15:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 -- 172.21.15.33:0/2774637601 shutdown_connections 2022-02-02T15:16:24.838 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 --2- 172.21.15.33:0/2774637601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f77d0 0x7fa3840f7c30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 --2- 172.21.15.33:0/2774637601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f6530 0x7fa3840f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.847+0000 7fa38359e700 1 -- 172.21.15.33:0/2774637601 >> 172.21.15.33:0/2774637601 conn(0x7fa3840f1c90 msgr2=0x7fa3840f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:24.839 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.848+0000 7fa38359e700 1 -- 172.21.15.33:0/2774637601 shutdown_connections 2022-02-02T15:16:24.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.848+0000 7fa38359e700 1 -- 172.21.15.33:0/2774637601 wait complete. 2022-02-02T15:16:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.848+0000 7fa38359e700 1 Processor -- start 2022-02-02T15:16:24.843 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.848+0000 7fa38359e700 1 -- start start 2022-02-02T15:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f77d0 0x7fa384069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38406a380 con 0x7fa3840f6530 2022-02-02T15:16:24.844 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38406a4c0 con 0x7fa3840f77d0 2022-02-02T15:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36758/0 (socket says 172.21.15.33:36758) 2022-02-02T15:16:24.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 -- 172.21.15.33:0/4127476084 learned_addr learned my addr 172.21.15.33:0/4127476084 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:24.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa381d9b700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f77d0 0x7fa384069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 -- 172.21.15.33:0/4127476084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f77d0 msgr2=0x7fa384069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:24.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f77d0 0x7fa384069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:24.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 -- 172.21.15.33:0/4127476084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa378005040 con 0x7fa3840f6530 2022-02-02T15:16:24.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38259c700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fa37400c790 tx=0x7fa374007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:24.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa37400e680 con 0x7fa3840f6530 2022-02-02T15:16:24.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38406a7a0 con 0x7fa3840f6530 2022-02-02T15:16:24.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.849+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa37400ec90 con 0x7fa3840f6530 2022-02-02T15:16:24.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.850+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa374012d00 con 0x7fa3840f6530 2022-02-02T15:16:24.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.850+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38410ece0 con 0x7fa3840f6530 2022-02-02T15:16:24.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.851+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa384045ad0 con 0x7fa3840f6530 2022-02-02T15:16:24.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.851+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa374010070 con 0x7fa3840f6530 2022-02-02T15:16:24.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.852+0000 7fa372ffd700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 0x7fa36c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:24.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.852+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa374081b80 con 0x7fa3840f6530 2022-02-02T15:16:24.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.852+0000 7fa381d9b700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 0x7fa36c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:24.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.852+0000 7fa381d9b700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 0x7fa36c0672e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fa378009da0 tx=0x7fa378009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:24.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:24.856+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa37404fc30 con 0x7fa3840f6530 2022-02-02T15:16:25.029 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.039+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3840fee00 con 0x7fa36c064e20 2022-02-02T15:16:25.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.053+0000 7fa372ffd700 1 -- 172.21.15.33:0/4127476084 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fa3840fee00 con 0x7fa36c064e20 2022-02-02T15:16:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:16:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (101m) 63m ago 102m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:16:25.044 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (94m) 63m ago 102m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:16:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (94m) 63m ago 102m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:16:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (101m) 63m ago 102m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:16:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (95m) 63m ago 98m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:16:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (95m) 63m ago 98m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:16:25.045 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (96m) 63m ago 98m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:16:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (98m) 63m ago 98m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:16:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (96m) 63m ago 104m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:16:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (95m) 63m ago 102m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:16:25.046 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (95m) 63m ago 104m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:16:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (95m) 63m ago 102m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:16:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (102m) 63m ago 102m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:16:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (101m) 63m ago 101m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:16:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 63m ago 101m - 4096M 2022-02-02T15:16:25.047 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (101m) 63m ago 101m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:16:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (100m) 63m ago 100m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:16:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (100m) 63m ago 100m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:16:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (100m) 63m ago 100m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:16:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (100m) 63m ago 100m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:16:25.048 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (101m) 63m ago 102m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:16:25.049 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 msgr2=0x7fa36c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 0x7fa36c0672e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7fa378009da0 tx=0x7fa378009b30).stop 2022-02-02T15:16:25.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 msgr2=0x7fa38406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fa37400c790 tx=0x7fa374007d90).stop 2022-02-02T15:16:25.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 shutdown_connections 2022-02-02T15:16:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa36c064e20 0x7fa36c0672e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3840f6530 0x7fa38406b9a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 --2- 172.21.15.33:0/4127476084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3840f77d0 0x7fa384069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.055+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 >> 172.21.15.33:0/4127476084 conn(0x7fa3840f1c90 msgr2=0x7fa3840fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.056+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 shutdown_connections 2022-02-02T15:16:25.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.056+0000 7fa38359e700 1 -- 172.21.15.33:0/4127476084 wait complete. 2022-02-02T15:16:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 -- 172.21.15.33:0/2539571628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 msgr2=0x7fb15c0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 --2- 172.21.15.33:0/2539571628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c0f6b00 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fb14c004660 tx=0x7fb14c009b30).stop 2022-02-02T15:16:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 -- 172.21.15.33:0/2539571628 shutdown_connections 2022-02-02T15:16:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 --2- 172.21.15.33:0/2539571628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 0x7fb15c0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 --2- 172.21.15.33:0/2539571628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c0f6b00 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 -- 172.21.15.33:0/2539571628 >> 172.21.15.33:0/2539571628 conn(0x7fb15c0f1e40 msgr2=0x7fb15c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:25.148 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:24 smithi033 ceph-mon[101165]: from='client.37074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 -- 172.21.15.33:0/2539571628 shutdown_connections 2022-02-02T15:16:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.156+0000 7fb163b0d700 1 -- 172.21.15.33:0/2539571628 wait complete. 2022-02-02T15:16:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 Processor -- start 2022-02-02T15:16:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 -- start start 2022-02-02T15:16:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 0x7fb15c1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c107a50 con 0x7fb15c0f66e0 2022-02-02T15:16:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb163b0d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15c107b90 con 0x7fb15c0f7980 2022-02-02T15:16:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb1618a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb1618a9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36768/0 (socket says 172.21.15.33:36768) 2022-02-02T15:16:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb1618a9700 1 -- 172.21.15.33:0/143190444 learned_addr learned my addr 172.21.15.33:0/143190444 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.157+0000 7fb1610a8700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 0x7fb15c1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1618a9700 1 -- 172.21.15.33:0/143190444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 msgr2=0x7fb15c1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1618a9700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 0x7fb15c1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1618a9700 1 -- 172.21.15.33:0/143190444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c005040 con 0x7fb15c0f66e0 2022-02-02T15:16:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1618a9700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fb14c013a70 tx=0x7fb14c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:25.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14c018070 con 0x7fb15c0f66e0 2022-02-02T15:16:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb15c1084d0 con 0x7fb15c0f66e0 2022-02-02T15:16:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15c108a30 con 0x7fb15c0f66e0 2022-02-02T15:16:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb14c0097d0 con 0x7fb15c0f66e0 2022-02-02T15:16:25.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.158+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb14c01de80 con 0x7fb15c0f66e0 2022-02-02T15:16:25.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.159+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb15c045ad0 con 0x7fb15c0f66e0 2022-02-02T15:16:25.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.160+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb14c007ba0 con 0x7fb15c0f66e0 2022-02-02T15:16:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.160+0000 7fb1527fc700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 0x7fb14806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.161+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb14c0835a0 con 0x7fb15c0f66e0 2022-02-02T15:16:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.161+0000 7fb1610a8700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 0x7fb14806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.161+0000 7fb1610a8700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 0x7fb14806b6a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fb158004c40 tx=0x7fb15800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:25.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.165+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb14c055080 con 0x7fb15c0f66e0 2022-02-02T15:16:25.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:24 smithi037 ceph-mon[69017]: from='client.37074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:25.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.408+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb15c0fef70 con 0x7fb15c0f66e0 2022-02-02T15:16:25.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.409+0000 7fb1527fc700 1 -- 172.21.15.33:0/143190444 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fb14c054c70 con 0x7fb15c0f66e0 2022-02-02T15:16:25.399 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:16:25.400 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:16:25.400 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:16:25.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:25.400 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:16:25.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:16:25.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:25.401 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:16:25.401 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:16:25.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:25.402 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:16:25.402 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:16:25.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:25.403 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:16:25.403 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:16:25.403 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:16:25.403 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:16:25.404 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:16:25.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 msgr2=0x7fb14806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 0x7fb14806b6a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7fb158004c40 tx=0x7fb15800b040).stop 2022-02-02T15:16:25.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 msgr2=0x7fb15c106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.405 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fb14c013a70 tx=0x7fb14c009b30).stop 2022-02-02T15:16:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 shutdown_connections 2022-02-02T15:16:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb1480691e0 0x7fb14806b6a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.406 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb15c0f66e0 0x7fb15c106fb0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 --2- 172.21.15.33:0/143190444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb15c0f7980 0x7fb15c1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 >> 172.21.15.33:0/143190444 conn(0x7fb15c0f1e40 msgr2=0x7fb15c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:25.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 shutdown_connections 2022-02-02T15:16:25.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.411+0000 7fb163b0d700 1 -- 172.21.15.33:0/143190444 wait complete. 2022-02-02T15:16:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 -- 172.21.15.33:0/2150478125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f6860 msgr2=0x7f90fc0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 --2- 172.21.15.33:0/2150478125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f6860 0x7f90fc0f6cc0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f90ec004660 tx=0x7f90ec009b30).stop 2022-02-02T15:16:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 -- 172.21.15.33:0/2150478125 shutdown_connections 2022-02-02T15:16:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 --2- 172.21.15.33:0/2150478125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f6860 0x7f90fc0f6cc0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 --2- 172.21.15.33:0/2150478125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f55c0 0x7f90fc0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 -- 172.21.15.33:0/2150478125 >> 172.21.15.33:0/2150478125 conn(0x7f90fc0f0d40 msgr2=0x7f90fc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 -- 172.21.15.33:0/2150478125 shutdown_connections 2022-02-02T15:16:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.513+0000 7f9102207700 1 -- 172.21.15.33:0/2150478125 wait complete. 2022-02-02T15:16:25.507 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 Processor -- start 2022-02-02T15:16:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 -- start start 2022-02-02T15:16:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f6860 0x7f90fc107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.508 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc107a10 con 0x7f90fc0f55c0 2022-02-02T15:16:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f9102207700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90fc107b50 con 0x7f90fc0f6860 2022-02-02T15:16:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f90fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f90fb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36778/0 (socket says 172.21.15.33:36778) 2022-02-02T15:16:25.509 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f90fb7fe700 1 -- 172.21.15.33:0/386366897 learned_addr learned my addr 172.21.15.33:0/386366897 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.514+0000 7f90faffd700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f6860 0x7f90fc107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90fb7fe700 1 -- 172.21.15.33:0/386366897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f6860 msgr2=0x7f90fc107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90fb7fe700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f6860 0x7f90fc107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.510 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90fb7fe700 1 -- 172.21.15.33:0/386366897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec005040 con 0x7f90fc0f55c0 2022-02-02T15:16:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90fb7fe700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f90f000c530 tx=0x7f90f0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f000f650 con 0x7f90fc0f55c0 2022-02-02T15:16:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f90f000fc60 con 0x7f90fc0f55c0 2022-02-02T15:16:25.511 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90fc1084f0 con 0x7f90fc0f55c0 2022-02-02T15:16:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90f0012cb0 con 0x7f90fc0f55c0 2022-02-02T15:16:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.515+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90fc108ab0 con 0x7f90fc0f55c0 2022-02-02T15:16:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.516+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90fc045ad0 con 0x7f90fc0f55c0 2022-02-02T15:16:25.513 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.516+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f90f0019030 con 0x7f90fc0f55c0 2022-02-02T15:16:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.517+0000 7f90e3fff700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 0x7f90e4067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.517+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f90f0081680 con 0x7f90fc0f55c0 2022-02-02T15:16:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.517+0000 7f90faffd700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 0x7f90e4067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:25.514 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.517+0000 7f90faffd700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 0x7f90e4067270 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f90ec004e30 tx=0x7f90ec009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:25.515 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.521+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f90f0053210 con 0x7f90fc0f55c0 2022-02-02T15:16:25.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.731+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f90fc10d5c0 con 0x7f90fc0f55c0 2022-02-02T15:16:25.721 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.731+0000 7f90e3fff700 1 -- 172.21.15.33:0/386366897 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f90f0017070 con 0x7f90fc0f55c0 2022-02-02T15:16:25.722 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:16:25.722 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:16:25.722 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:16:25.722 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:16:25.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:25.723 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:16:25.723 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:16:25.723 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:16:25.724 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:16:25.724 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:16:25.724 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:16:25.724 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:16:25.725 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:16:25.725 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:16:25.725 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:16:25.725 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:16:25.725 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:16:25.726 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:16:25.726 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:16:25.726 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:16:25.726 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:16:25.727 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:16:25.727 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:16:25.727 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:16:25.727 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:16:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:16:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:16:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:16:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:16:25.728 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:16:25.729 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:16:25.729 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:25.729 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:25.729 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:16:25.729 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:25.730 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:25.730 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:25.730 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:25.730 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:25.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 msgr2=0x7f90e4067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 0x7f90e4067270 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f90ec004e30 tx=0x7f90ec009b30).stop 2022-02-02T15:16:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 msgr2=0x7f90fc106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:25.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f90f000c530 tx=0x7f90f0007e10).stop 2022-02-02T15:16:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 shutdown_connections 2022-02-02T15:16:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f90e4064db0 0x7f90e4067270 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90fc0f55c0 0x7f90fc106f70 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 --2- 172.21.15.33:0/386366897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90fc0f6860 0x7f90fc107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:25.733 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 >> 172.21.15.33:0/386366897 conn(0x7f90fc0f0d40 msgr2=0x7f90fc05f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 shutdown_connections 2022-02-02T15:16:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:25.733+0000 7f9102207700 1 -- 172.21.15.33:0/386366897 wait complete. 2022-02-02T15:16:25.734 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:16:25.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:25 smithi033 ceph-mon[101165]: from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:25.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/143190444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:16:25.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:25 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/386366897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:16:25.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:25 smithi033 ceph-mon[101165]: pgmap v2931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:26.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:25 smithi037 ceph-mon[69017]: from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:26.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/143190444' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:16:26.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:25 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/386366897' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:16:26.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:25 smithi037 ceph-mon[69017]: pgmap v2931: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:28.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:27 smithi033 ceph-mon[101165]: pgmap v2932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:27 smithi037 ceph-mon[69017]: pgmap v2932: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:30.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:29 smithi033 ceph-mon[101165]: pgmap v2933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:29 smithi037 ceph-mon[69017]: pgmap v2933: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:32.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:31 smithi033 ceph-mon[101165]: pgmap v2934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:32.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:31 smithi037 ceph-mon[69017]: pgmap v2934: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:34.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:33 smithi033 ceph-mon[101165]: pgmap v2935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:33 smithi037 ceph-mon[69017]: pgmap v2935: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:36.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:35 smithi033 ceph-mon[101165]: pgmap v2936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:36.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:35 smithi037 ceph-mon[69017]: pgmap v2936: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:38.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:37 smithi033 ceph-mon[101165]: pgmap v2937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:38.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:37 smithi037 ceph-mon[69017]: pgmap v2937: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:40.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:39 smithi033 ceph-mon[101165]: pgmap v2938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:40.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:39 smithi037 ceph-mon[69017]: pgmap v2938: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:42.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:41 smithi033 ceph-mon[101165]: pgmap v2939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:42.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:41 smithi037 ceph-mon[69017]: pgmap v2939: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:44.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:43 smithi033 ceph-mon[101165]: pgmap v2940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:44.283 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:43 smithi037 ceph-mon[69017]: pgmap v2940: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:46.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:45 smithi033 ceph-mon[101165]: pgmap v2941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:46.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:45 smithi037 ceph-mon[69017]: pgmap v2941: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:48.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:47 smithi033 ceph-mon[101165]: pgmap v2942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:48.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:47 smithi037 ceph-mon[69017]: pgmap v2942: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:50.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:49 smithi033 ceph-mon[101165]: pgmap v2943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:50.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:49 smithi037 ceph-mon[69017]: pgmap v2943: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:52.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:51 smithi033 ceph-mon[101165]: pgmap v2944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:52.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:51 smithi037 ceph-mon[69017]: pgmap v2944: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:54.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:53 smithi033 ceph-mon[101165]: pgmap v2945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:54.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:53 smithi037 ceph-mon[69017]: pgmap v2945: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:16:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:16:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:16:55.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 -- 172.21.15.33:0/1296683162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f66d0 msgr2=0x7ff7840f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 --2- 172.21.15.33:0/1296683162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f66d0 0x7ff7840f6af0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7ff774004660 tx=0x7ff774009b30).stop 2022-02-02T15:16:55.840 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 -- 172.21.15.33:0/1296683162 shutdown_connections 2022-02-02T15:16:55.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 --2- 172.21.15.33:0/1296683162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f7970 0x7ff7840f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:55.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 --2- 172.21.15.33:0/1296683162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f66d0 0x7ff7840f6af0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:55.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.849+0000 7ff789915700 1 -- 172.21.15.33:0/1296683162 >> 172.21.15.33:0/1296683162 conn(0x7ff7840f1e10 msgr2=0x7ff7840f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:55.841 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.850+0000 7ff789915700 1 -- 172.21.15.33:0/1296683162 shutdown_connections 2022-02-02T15:16:55.842 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.850+0000 7ff789915700 1 -- 172.21.15.33:0/1296683162 wait complete. 2022-02-02T15:16:55.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 Processor -- start 2022-02-02T15:16:55.845 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 -- start start 2022-02-02T15:16:55.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 0x7ff784106fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:55.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:55.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff784107a70 con 0x7ff7840f7970 2022-02-02T15:16:55.846 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff789915700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff784107bb0 con 0x7ff7840f66d0 2022-02-02T15:16:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff7827fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff7827fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36790/0 (socket says 172.21.15.33:36790) 2022-02-02T15:16:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff782ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 0x7ff784106fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.851+0000 7ff7827fc700 1 -- 172.21.15.33:0/4073076019 learned_addr learned my addr 172.21.15.33:0/4073076019 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff7827fc700 1 -- 172.21.15.33:0/4073076019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 msgr2=0x7ff784106fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff7827fc700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 0x7ff784106fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff7827fc700 1 -- 172.21.15.33:0/4073076019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774005040 con 0x7ff7840f7970 2022-02-02T15:16:55.848 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff782ffd700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 0x7ff784106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:16:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff7827fc700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7ff7780026d0 tx=0x7ff778009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7780079c0 con 0x7ff7840f7970 2022-02-02T15:16:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff77800f040 con 0x7ff7840f7970 2022-02-02T15:16:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff784108550 con 0x7ff7840f7970 2022-02-02T15:16:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7780148b0 con 0x7ff7840f7970 2022-02-02T15:16:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.852+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff784108b10 con 0x7ff7840f7970 2022-02-02T15:16:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.853+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff784045ad0 con 0x7ff7840f7970 2022-02-02T15:16:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.854+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff778007b20 con 0x7ff7840f7970 2022-02-02T15:16:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.854+0000 7ff76b7fe700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 0x7ff76c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.854+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff778081af0 con 0x7ff7840f7970 2022-02-02T15:16:55.852 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.854+0000 7ff782ffd700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 0x7ff76c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.855+0000 7ff782ffd700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 0x7ff76c067290 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff774005010 tx=0x7ff774009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:55.859+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff778053510 con 0x7ff7840f7970 2022-02-02T15:16:56.039 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.049+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7840ff040 con 0x7ff76c064dd0 2022-02-02T15:16:56.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.050+0000 7ff76b7fe700 1 -- 172.21.15.33:0/4073076019 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff774019040 con 0x7ff76c064dd0 2022-02-02T15:16:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 msgr2=0x7ff76c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.042 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 0x7ff76c067290 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff774005010 tx=0x7ff774009b30).stop 2022-02-02T15:16:56.043 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 msgr2=0x7ff7841074c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7ff7780026d0 tx=0x7ff778009de0).stop 2022-02-02T15:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 shutdown_connections 2022-02-02T15:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff76c064dd0 0x7ff76c067290 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7840f66d0 0x7ff784106fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 --2- 172.21.15.33:0/4073076019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7840f7970 0x7ff7841074c0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 >> 172.21.15.33:0/4073076019 conn(0x7ff7840f1e10 msgr2=0x7ff7840fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 shutdown_connections 2022-02-02T15:16:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.052+0000 7ff789915700 1 -- 172.21.15.33:0/4073076019 wait complete. 2022-02-02T15:16:56.052 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:16:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- 172.21.15.33:0/3667620739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f6860 msgr2=0x7f09e00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 --2- 172.21.15.33:0/3667620739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f6860 0x7f09e00f6cc0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f09dc004660 tx=0x7f09dc009b30).stop 2022-02-02T15:16:56.143 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- 172.21.15.33:0/3667620739 shutdown_connections 2022-02-02T15:16:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 --2- 172.21.15.33:0/3667620739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f6860 0x7f09e00f6cc0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 --2- 172.21.15.33:0/3667620739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f55c0 0x7f09e00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.144 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- 172.21.15.33:0/3667620739 >> 172.21.15.33:0/3667620739 conn(0x7f09e00f0d40 msgr2=0x7f09e00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.145 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:55 smithi033 ceph-mon[101165]: pgmap v2946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- 172.21.15.33:0/3667620739 shutdown_connections 2022-02-02T15:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- 172.21.15.33:0/3667620739 wait complete. 2022-02-02T15:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 Processor -- start 2022-02-02T15:16:56.148 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.153+0000 7f09e7756700 1 -- start start 2022-02-02T15:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e7756700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e7756700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f6860 0x7f09e00f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e7756700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e00f8100 con 0x7f09e00f55c0 2022-02-02T15:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e7756700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e00f8240 con 0x7f09e00f6860 2022-02-02T15:16:56.149 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36798/0 (socket says 172.21.15.33:36798) 2022-02-02T15:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 -- 172.21.15.33:0/1819350372 learned_addr learned my addr 172.21.15.33:0/1819350372 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e4cf1700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f6860 0x7f09e00f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 -- 172.21.15.33:0/1819350372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f6860 msgr2=0x7f09e00f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f6860 0x7f09e00f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 -- 172.21.15.33:0/1819350372 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc005040 con 0x7f09e00f55c0 2022-02-02T15:16:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e54f2700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f09d000c530 tx=0x7f09d0007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d000f650 con 0x7f09e00f55c0 2022-02-02T15:16:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f09d000fc60 con 0x7f09e00f55c0 2022-02-02T15:16:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e00f8520 con 0x7f09e00f55c0 2022-02-02T15:16:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.154+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d0012d20 con 0x7f09e00f55c0 2022-02-02T15:16:56.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.155+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e010efa0 con 0x7f09e00f55c0 2022-02-02T15:16:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.156+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e0045ad0 con 0x7f09e00f55c0 2022-02-02T15:16:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.156+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f09d0019030 con 0x7f09e00f55c0 2022-02-02T15:16:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.156+0000 7f09d5ffb700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 0x7f09cc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.153 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.156+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f09d00816d0 con 0x7f09e00f55c0 2022-02-02T15:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.156+0000 7f09e4cf1700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 0x7f09cc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.157+0000 7f09e4cf1700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 0x7f09cc067290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f09dc004e30 tx=0x7f09dc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.161+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f09d00487d0 con 0x7f09e00f55c0 2022-02-02T15:16:56.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:55 smithi037 ceph-mon[69017]: pgmap v2946: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:56.331 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.342+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f09e00faca0 con 0x7f09cc064dd0 2022-02-02T15:16:56.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.356+0000 7f09d5ffb700 1 -- 172.21.15.33:0/1819350372 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f09e00faca0 con 0x7f09cc064dd0 2022-02-02T15:16:56.347 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:16:56.347 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (102m) 64m ago 103m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:16:56.347 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (95m) 64m ago 103m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:16:56.347 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (95m) 64m ago 102m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:16:56.347 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (102m) 64m ago 103m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:16:56.348 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (95m) 64m ago 99m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:16:56.348 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (96m) 64m ago 99m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:16:56.349 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (97m) 64m ago 99m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:16:56.349 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (99m) 64m ago 99m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:16:56.349 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (96m) 64m ago 104m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:16:56.349 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (96m) 64m ago 102m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:16:56.350 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (96m) 64m ago 104m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:16:56.350 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (95m) 64m ago 102m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:16:56.350 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (102m) 64m ago 102m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:16:56.350 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (102m) 64m ago 102m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:16:56.351 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 64m ago 101m - 4096M 2022-02-02T15:16:56.351 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (101m) 64m ago 101m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:16:56.351 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (101m) 64m ago 101m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:16:56.351 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (101m) 64m ago 101m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:16:56.352 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (100m) 64m ago 100m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:16:56.352 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (100m) 64m ago 100m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:16:56.352 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (102m) 64m ago 102m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:16:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 msgr2=0x7f09cc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 0x7f09cc067290 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7f09dc004e30 tx=0x7f09dc009b30).stop 2022-02-02T15:16:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 msgr2=0x7f09e00f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 rx=0x7f09d000c530 tx=0x7f09d0007e10).stop 2022-02-02T15:16:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 shutdown_connections 2022-02-02T15:16:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f09cc064dd0 0x7f09cc067290 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09e00f55c0 0x7f09e00f9720 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 --2- 172.21.15.33:0/1819350372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09e00f6860 0x7f09e00f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 >> 172.21.15.33:0/1819350372 conn(0x7f09e00f0d40 msgr2=0x7f09e005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 shutdown_connections 2022-02-02T15:16:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.359+0000 7f09e7756700 1 -- 172.21.15.33:0/1819350372 wait complete. 2022-02-02T15:16:56.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 -- 172.21.15.33:0/1996795288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f6860 msgr2=0x7ff26c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.449 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 --2- 172.21.15.33:0/1996795288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f6860 0x7ff26c0f6cc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7ff258004660 tx=0x7ff258009b30).stop 2022-02-02T15:16:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 -- 172.21.15.33:0/1996795288 shutdown_connections 2022-02-02T15:16:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 --2- 172.21.15.33:0/1996795288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f6860 0x7ff26c0f6cc0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 --2- 172.21.15.33:0/1996795288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f55c0 0x7ff26c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 -- 172.21.15.33:0/1996795288 >> 172.21.15.33:0/1996795288 conn(0x7ff26c0f0d40 msgr2=0x7ff26c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 -- 172.21.15.33:0/1996795288 shutdown_connections 2022-02-02T15:16:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.459+0000 7ff272ef5700 1 -- 172.21.15.33:0/1996795288 wait complete. 2022-02-02T15:16:56.453 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 Processor -- start 2022-02-02T15:16:56.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 -- start start 2022-02-02T15:16:56.454 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 0x7ff26c10c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0603c0 con 0x7ff26c0f55c0 2022-02-02T15:16:56.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff272ef5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c060500 con 0x7ff26c0f6860 2022-02-02T15:16:56.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff270c91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff270c91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36808/0 (socket says 172.21.15.33:36808) 2022-02-02T15:16:56.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff270c91700 1 -- 172.21.15.33:0/2557994147 learned_addr learned my addr 172.21.15.33:0/2557994147 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:56.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.460+0000 7ff26bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 0x7ff26c10c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff26bfff700 1 -- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 msgr2=0x7ff26c109be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff26bfff700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff26bfff700 1 -- 172.21.15.33:0/2557994147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff258005040 con 0x7ff26c0f6860 2022-02-02T15:16:56.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff270c91700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:16:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff26bfff700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 0x7ff26c10c0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff258011000 tx=0x7ff25800b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff258019070 con 0x7ff26c0f6860 2022-02-02T15:16:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c10c630 con 0x7ff26c0f6860 2022-02-02T15:16:56.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff258007e70 con 0x7ff26c0f6860 2022-02-02T15:16:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c10cb60 con 0x7ff26c0f6860 2022-02-02T15:16:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.461+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff258014c70 con 0x7ff26c0f6860 2022-02-02T15:16:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.462+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c0f49b0 con 0x7ff26c0f6860 2022-02-02T15:16:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.463+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff258025070 con 0x7ff26c0f6860 2022-02-02T15:16:56.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.463+0000 7ff2697fa700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 0x7ff25c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.463+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff258082a20 con 0x7ff26c0f6860 2022-02-02T15:16:56.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.463+0000 7ff270c91700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 0x7ff25c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.464+0000 7ff270c91700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 0x7ff25c067290 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff260004fd0 tx=0x7ff26000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.468+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff258050a50 con 0x7ff26c0f6860 2022-02-02T15:16:56.702 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.712+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff26c0fde50 con 0x7ff26c0f6860 2022-02-02T15:16:56.703 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.713+0000 7ff2697fa700 1 -- 172.21.15.33:0/2557994147 <== mon.1 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7ff258023070 con 0x7ff26c0f6860 2022-02-02T15:16:56.703 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:16:56.703 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:16:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:16:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:16:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:16:56.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:16:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:16:56.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:16:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:16:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:16:56.706 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:16:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:16:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:16:56.707 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:16:56.708 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:16:56.708 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 msgr2=0x7ff25c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 0x7ff25c067290 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7ff260004fd0 tx=0x7ff26000b040).stop 2022-02-02T15:16:56.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 msgr2=0x7ff26c10c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 0x7ff26c10c0e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff258011000 tx=0x7ff25800b040).stop 2022-02-02T15:16:56.709 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 shutdown_connections 2022-02-02T15:16:56.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff25c064dd0 0x7ff25c067290 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0f55c0 0x7ff26c109be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 --2- 172.21.15.33:0/2557994147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff26c0f6860 0x7ff26c10c0e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.710 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 >> 172.21.15.33:0/2557994147 conn(0x7ff26c0f0d40 msgr2=0x7ff26c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 shutdown_connections 2022-02-02T15:16:56.711 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.715+0000 7ff272ef5700 1 -- 172.21.15.33:0/2557994147 wait complete. 2022-02-02T15:16:56.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 -- 172.21.15.33:0/2582900925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f7980 msgr2=0x7f08080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 --2- 172.21.15.33:0/2582900925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f7980 0x7f08080f7de0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f07f4004660 tx=0x7f07f4009b30).stop 2022-02-02T15:16:56.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 -- 172.21.15.33:0/2582900925 shutdown_connections 2022-02-02T15:16:56.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 --2- 172.21.15.33:0/2582900925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f7980 0x7f08080f7de0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 --2- 172.21.15.33:0/2582900925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f66e0 0x7f08080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 -- 172.21.15.33:0/2582900925 >> 172.21.15.33:0/2582900925 conn(0x7f08080f1e40 msgr2=0x7f08080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:56.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 -- 172.21.15.33:0/2582900925 shutdown_connections 2022-02-02T15:16:56.811 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.816+0000 7f080ed80700 1 -- 172.21.15.33:0/2582900925 wait complete. 2022-02-02T15:16:56.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 Processor -- start 2022-02-02T15:16:56.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 -- start start 2022-02-02T15:16:56.812 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 0x7f0808107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808107a00 con 0x7f08080f66e0 2022-02-02T15:16:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080ed80700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0808107b40 con 0x7f08080f7980 2022-02-02T15:16:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080cb1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080cb1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36816/0 (socket says 172.21.15.33:36816) 2022-02-02T15:16:56.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.817+0000 7f080cb1c700 1 -- 172.21.15.33:0/785245407 learned_addr learned my addr 172.21.15.33:0/785245407 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:16:56.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f0807fff700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 0x7f0808107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080cb1c700 1 -- 172.21.15.33:0/785245407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 msgr2=0x7f0808107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:56.814 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080cb1c700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 0x7f0808107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080cb1c700 1 -- 172.21.15.33:0/785245407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f4005040 con 0x7f08080f66e0 2022-02-02T15:16:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f0807fff700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 0x7f0808107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:16:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080cb1c700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f07fc00c790 tx=0x7f07fc007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.815 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc00e680 con 0x7f08080f66e0 2022-02-02T15:16:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f07fc00ec90 con 0x7f08080f66e0 2022-02-02T15:16:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08081084e0 con 0x7f08080f66e0 2022-02-02T15:16:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07fc012d00 con 0x7f08080f66e0 2022-02-02T15:16:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.818+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0808108aa0 con 0x7f08080f66e0 2022-02-02T15:16:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.819+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0808045ad0 con 0x7f08080f66e0 2022-02-02T15:16:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.820+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f07fc010070 con 0x7f08080f66e0 2022-02-02T15:16:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.820+0000 7f08057fa700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 0x7f07f8067350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:16:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.820+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f07fc081a00 con 0x7f08080f66e0 2022-02-02T15:16:56.818 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.820+0000 7f0807fff700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 0x7f07f8067350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:16:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.821+0000 7f0807fff700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 0x7f07f8067350 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f07f4004e30 tx=0x7f07f4009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:16:56.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:56.824+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f07fc053560 con 0x7f08080f66e0 2022-02-02T15:16:56.980 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:56 smithi033 ceph-mon[101165]: from='client.37090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:56.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:56 smithi033 ceph-mon[101165]: from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:56.981 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:56 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2557994147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:16:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.042+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f08080fef70 con 0x7f08080f66e0 2022-02-02T15:16:57.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.043+0000 7f08057fa700 1 -- 172.21.15.33:0/785245407 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f07fc053150 con 0x7f08080f66e0 2022-02-02T15:16:57.033 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:16:57.034 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:16:57.034 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:16:57.034 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:16:57.035 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:57.035 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:16:57.035 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:16:57.035 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:16:57.036 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:16:57.036 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:16:57.036 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:16:57.036 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:16:57.037 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:16:57.037 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:16:57.037 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:16:57.037 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:16:57.038 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:16:57.038 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:16:57.038 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:16:57.038 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:16:57.039 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:16:57.039 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:16:57.039 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:16:57.039 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:16:57.040 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:16:57.040 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:16:57.040 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:16:57.041 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:16:57.041 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:16:57.041 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:16:57.041 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:16:57.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:57.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:57.042 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:16:57.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:16:57.043 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:57.043 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:57.044 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:57.044 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:16:57.045 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.044+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 msgr2=0x7f07f8067350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.044+0000 7f080ed80700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 0x7f07f8067350 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f07f4004e30 tx=0x7f07f4009b30).stop 2022-02-02T15:16:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.044+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 msgr2=0x7f0808106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:16:57.046 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.044+0000 7f080ed80700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f07fc00c790 tx=0x7f07fc007d90).stop 2022-02-02T15:16:57.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 shutdown_connections 2022-02-02T15:16:57.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f07f8064e90 0x7f07f8067350 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:57.047 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08080f66e0 0x7f0808106f60 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:57.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 --2- 172.21.15.33:0/785245407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08080f7980 0x7f0808107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:16:57.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 >> 172.21.15.33:0/785245407 conn(0x7f08080f1e40 msgr2=0x7f08080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:16:57.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 shutdown_connections 2022-02-02T15:16:57.048 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:16:57.045+0000 7f080ed80700 1 -- 172.21.15.33:0/785245407 wait complete. 2022-02-02T15:16:57.049 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:16:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:56 smithi037 ceph-mon[69017]: from='client.37090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:56 smithi037 ceph-mon[69017]: from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:16:57.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:56 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2557994147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:16:58.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:57 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/785245407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:16:58.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:57 smithi033 ceph-mon[101165]: pgmap v2947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:16:58.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:57 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/785245407' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:16:58.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:57 smithi037 ceph-mon[69017]: pgmap v2947: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:00.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:16:59 smithi033 ceph-mon[101165]: pgmap v2948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:00.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:16:59 smithi037 ceph-mon[69017]: pgmap v2948: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:02.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:01 smithi033 ceph-mon[101165]: pgmap v2949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:01 smithi037 ceph-mon[69017]: pgmap v2949: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:04.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:03 smithi033 ceph-mon[101165]: pgmap v2950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:04.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:03 smithi037 ceph-mon[69017]: pgmap v2950: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:06.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:05 smithi033 ceph-mon[101165]: pgmap v2951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:06.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:05 smithi037 ceph-mon[69017]: pgmap v2951: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:07 smithi033 ceph-mon[101165]: pgmap v2952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:07 smithi037 ceph-mon[69017]: pgmap v2952: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:10.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:09 smithi033 ceph-mon[101165]: pgmap v2953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:10.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:09 smithi037 ceph-mon[69017]: pgmap v2953: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:12.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:11 smithi033 ceph-mon[101165]: pgmap v2954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:12.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:11 smithi037 ceph-mon[69017]: pgmap v2954: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:14.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:13 smithi033 ceph-mon[101165]: pgmap v2955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:14.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:13 smithi037 ceph-mon[69017]: pgmap v2955: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:16.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:15 smithi033 ceph-mon[101165]: pgmap v2956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:16.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:15 smithi037 ceph-mon[69017]: pgmap v2956: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:18.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:17 smithi033 ceph-mon[101165]: pgmap v2957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:18.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:17 smithi037 ceph-mon[69017]: pgmap v2957: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:20.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:19 smithi033 ceph-mon[101165]: pgmap v2958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:20.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:19 smithi037 ceph-mon[69017]: pgmap v2958: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:22.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:21 smithi033 ceph-mon[101165]: pgmap v2959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:22.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:21 smithi037 ceph-mon[69017]: pgmap v2959: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:24.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:23 smithi033 ceph-mon[101165]: pgmap v2960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:24.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:23 smithi037 ceph-mon[69017]: pgmap v2960: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:26.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:25 smithi033 ceph-mon[101165]: pgmap v2961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:26.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:25 smithi037 ceph-mon[69017]: pgmap v2961: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 -- 172.21.15.33:0/4192065869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f66e0 msgr2=0x7f23140f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 --2- 172.21.15.33:0/4192065869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f66e0 0x7f23140f6b00 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 rx=0x7f2310004660 tx=0x7f2310009b30).stop 2022-02-02T15:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 -- 172.21.15.33:0/4192065869 shutdown_connections 2022-02-02T15:17:27.150 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 --2- 172.21.15.33:0/4192065869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f7980 0x7f23140f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 --2- 172.21.15.33:0/4192065869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f66e0 0x7f23140f6b00 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 -- 172.21.15.33:0/4192065869 >> 172.21.15.33:0/4192065869 conn(0x7f23140f1e40 msgr2=0x7f23140f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.159+0000 7f231b2b5700 1 -- 172.21.15.33:0/4192065869 shutdown_connections 2022-02-02T15:17:27.151 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.160+0000 7f231b2b5700 1 -- 172.21.15.33:0/4192065869 wait complete. 2022-02-02T15:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.160+0000 7f231b2b5700 1 Processor -- start 2022-02-02T15:17:27.152 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.160+0000 7f231b2b5700 1 -- start start 2022-02-02T15:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f231b2b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f66e0 0x7f231406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.154 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f231b2b5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f231b2b5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231406a380 con 0x7f23140f7980 2022-02-02T15:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f231b2b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231406a4c0 con 0x7f23140f66e0 2022-02-02T15:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.155 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36828/0 (socket says 172.21.15.33:36828) 2022-02-02T15:17:27.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 -- 172.21.15.33:0/3406178930 learned_addr learned my addr 172.21.15.33:0/3406178930 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:27.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2319051700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f66e0 0x7f231406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 -- 172.21.15.33:0/3406178930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f66e0 msgr2=0x7f231406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.156 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f66e0 0x7f231406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 -- 172.21.15.33:0/3406178930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310005040 con 0x7f23140f7980 2022-02-02T15:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2318850700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f230400e7f0 tx=0x7f230400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23040092e0 con 0x7f23140f7980 2022-02-02T15:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f230400f040 con 0x7f23140f7980 2022-02-02T15:17:27.157 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.161+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231406a7a0 con 0x7f23140f7980 2022-02-02T15:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.162+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2304014750 con 0x7f23140f7980 2022-02-02T15:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.162+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231410ef90 con 0x7f23140f7980 2022-02-02T15:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.163+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2314045ad0 con 0x7f23140f7980 2022-02-02T15:17:27.158 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.163+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f230401b030 con 0x7f23140f7980 2022-02-02T15:17:27.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.164+0000 7f2309ffb700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 0x7f2300067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.164+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2304081740 con 0x7f23140f7980 2022-02-02T15:17:27.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.164+0000 7f2319051700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 0x7f2300067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.164+0000 7f2319051700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 0x7f2300067290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f2310000c00 tx=0x7f231000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.168+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f230404f8a0 con 0x7f23140f7980 2022-02-02T15:17:27.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.357+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2314057f10 con 0x7f2300064dd0 2022-02-02T15:17:27.347 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.358+0000 7f2309ffb700 1 -- 172.21.15.33:0/3406178930 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2314057f10 con 0x7f2300064dd0 2022-02-02T15:17:27.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 msgr2=0x7f2300067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 0x7f2300067290 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f2310000c00 tx=0x7f231000b040).stop 2022-02-02T15:17:27.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 msgr2=0x7f2314069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7f230400e7f0 tx=0x7f230400b040).stop 2022-02-02T15:17:27.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 shutdown_connections 2022-02-02T15:17:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2300064dd0 0x7f2300067290 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23140f66e0 0x7f231406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 --2- 172.21.15.33:0/3406178930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f23140f7980 0x7f2314069e20 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 >> 172.21.15.33:0/3406178930 conn(0x7f23140f1e40 msgr2=0x7f23140fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 shutdown_connections 2022-02-02T15:17:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.360+0000 7f231b2b5700 1 -- 172.21.15.33:0/3406178930 wait complete. 2022-02-02T15:17:27.360 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:17:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 -- 172.21.15.33:0/2824111050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f55c0 msgr2=0x7f73b00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.455 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/2824111050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f55c0 0x7f73b00f59e0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7f73a0004660 tx=0x7f73a0009b30).stop 2022-02-02T15:17:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 -- 172.21.15.33:0/2824111050 shutdown_connections 2022-02-02T15:17:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/2824111050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f6860 0x7f73b00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/2824111050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f55c0 0x7f73b00f59e0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 -- 172.21.15.33:0/2824111050 >> 172.21.15.33:0/2824111050 conn(0x7f73b00f0d40 msgr2=0x7f73b00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:27.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 -- 172.21.15.33:0/2824111050 shutdown_connections 2022-02-02T15:17:27.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.465+0000 7f73b5c8f700 1 -- 172.21.15.33:0/2824111050 wait complete. 2022-02-02T15:17:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 Processor -- start 2022-02-02T15:17:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 -- start start 2022-02-02T15:17:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f55c0 0x7f73b0109bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.460 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00603e0 con 0x7f73b00f6860 2022-02-02T15:17:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73b5c8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b0060520 con 0x7f73b00f55c0 2022-02-02T15:17:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.466+0000 7f73aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36838/0 (socket says 172.21.15.33:36838) 2022-02-02T15:17:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73af7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f55c0 0x7f73b0109bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 -- 172.21.15.33:0/3351290695 learned_addr learned my addr 172.21.15.33:0/3351290695 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 -- 172.21.15.33:0/3351290695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f55c0 msgr2=0x7f73b0109bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f55c0 0x7f73b0109bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 -- 172.21.15.33:0/3351290695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a0005040 con 0x7f73b00f6860 2022-02-02T15:17:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73aeffd700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f7398002700 tx=0x7f7398009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7398009320 con 0x7f73b00f6860 2022-02-02T15:17:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b010c6a0 con 0x7f73b00f6860 2022-02-02T15:17:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f739800f040 con 0x7f73b00f6860 2022-02-02T15:17:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7398014870 con 0x7f73b00f6860 2022-02-02T15:17:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.467+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b010cc60 con 0x7f73b00f6860 2022-02-02T15:17:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.468+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b0045ad0 con 0x7f73b00f6860 2022-02-02T15:17:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.469+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f7398009480 con 0x7f73b00f6860 2022-02-02T15:17:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.469+0000 7f73a7fff700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 0x7f739c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.469+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f7398081d50 con 0x7f73b00f6860 2022-02-02T15:17:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.469+0000 7f73af7fe700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 0x7f739c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.470+0000 7f73af7fe700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 0x7f739c067290 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f73a0013690 tx=0x7f73a0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.474+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f739804fe00 con 0x7f73b00f6860 2022-02-02T15:17:27.646 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.657+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f73b0057f10 con 0x7f739c064dd0 2022-02-02T15:17:27.664 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.671+0000 7f73a7fff700 1 -- 172.21.15.33:0/3351290695 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f73b0057f10 con 0x7f739c064dd0 2022-02-02T15:17:27.665 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:17:27.666 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (102m) 64m ago 103m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:17:27.666 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (95m) 64m ago 103m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:17:27.667 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (95m) 64m ago 103m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:17:27.667 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (102m) 64m ago 103m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:17:27.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (96m) 64m ago 99m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:17:27.668 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (96m) 64m ago 99m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:17:27.669 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (97m) 64m ago 100m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:17:27.669 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (99m) 64m ago 99m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:17:27.669 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (97m) 64m ago 105m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:17:27.670 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (96m) 64m ago 103m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:17:27.670 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (96m) 64m ago 105m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:17:27.671 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (96m) 64m ago 103m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:17:27.671 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (103m) 64m ago 103m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:17:27.672 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (103m) 64m ago 102m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:17:27.672 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 64m ago 102m - 4096M 2022-02-02T15:17:27.673 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (102m) 64m ago 102m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:17:27.673 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (101m) 64m ago 101m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:17:27.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (101m) 64m ago 101m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:17:27.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (101m) 64m ago 101m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:17:27.674 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (101m) 64m ago 101m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:17:27.675 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (102m) 64m ago 103m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:17:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 msgr2=0x7f739c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 0x7f739c067290 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7f73a0013690 tx=0x7f73a0009b30).stop 2022-02-02T15:17:27.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 msgr2=0x7f73b010c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7f7398002700 tx=0x7f7398009e00).stop 2022-02-02T15:17:27.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 shutdown_connections 2022-02-02T15:17:27.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f739c064dd0 0x7f739c067290 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73b00f55c0 0x7f73b0109bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 --2- 172.21.15.33:0/3351290695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f73b00f6860 0x7f73b010c0f0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.673+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 >> 172.21.15.33:0/3351290695 conn(0x7f73b00f0d40 msgr2=0x7f73b00fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:27.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.674+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 shutdown_connections 2022-02-02T15:17:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.674+0000 7f73b5c8f700 1 -- 172.21.15.33:0/3351290695 wait complete. 2022-02-02T15:17:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.773+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2446074401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f66e0 msgr2=0x7fe0880f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.773+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2446074401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f66e0 0x7fe0880f6b40 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fe074004660 tx=0x7fe074009b30).stop 2022-02-02T15:17:27.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2446074401 shutdown_connections 2022-02-02T15:17:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2446074401 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f66e0 0x7fe0880f6b40 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2446074401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f5440 0x7fe0880f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2446074401 >> 172.21.15.33:0/2446074401 conn(0x7fe0880f0ba0 msgr2=0x7fe0880f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2446074401 shutdown_connections 2022-02-02T15:17:27.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2446074401 wait complete. 2022-02-02T15:17:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 Processor -- start 2022-02-02T15:17:27.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.774+0000 7fe08d9b8700 1 -- start start 2022-02-02T15:17:27.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08d9b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08d9b8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f66e0 0x7fe0881061c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08d9b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088106770 con 0x7fe0880f5440 2022-02-02T15:17:27.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08d9b8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe088106f70 con 0x7fe0880f66e0 2022-02-02T15:17:27.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36846/0 (socket says 172.21.15.33:36846) 2022-02-02T15:17:27.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 -- 172.21.15.33:0/2940801179 learned_addr learned my addr 172.21.15.33:0/2940801179 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:27.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe087fff700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f66e0 0x7fe0881061c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 -- 172.21.15.33:0/2940801179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f66e0 msgr2=0x7fe0881061c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:27.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f66e0 0x7fe0881061c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:27.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.775+0000 7fe08c9b6700 1 -- 172.21.15.33:0/2940801179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe074005040 con 0x7fe0880f5440 2022-02-02T15:17:27.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe08c9b6700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fe07c00e9a0 tx=0x7fe07c007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c00c980 con 0x7fe0880f5440 2022-02-02T15:17:27.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0881071f0 con 0x7fe0880f5440 2022-02-02T15:17:27.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe07c011470 con 0x7fe0880f5440 2022-02-02T15:17:27.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07c010630 con 0x7fe0880f5440 2022-02-02T15:17:27.772 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.776+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe088107760 con 0x7fe0880f5440 2022-02-02T15:17:27.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.777+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe088059100 con 0x7fe0880f5440 2022-02-02T15:17:27.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.777+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe07c0115e0 con 0x7fe0880f5440 2022-02-02T15:17:27.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.778+0000 7fe0857fa700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 0x7fe078067280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:27.773 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.778+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe07c0849f0 con 0x7fe0880f5440 2022-02-02T15:17:27.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.778+0000 7fe087fff700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 0x7fe078067280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:27.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.778+0000 7fe087fff700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 0x7fe078067280 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fe074004630 tx=0x7fe074009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:27.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:27.782+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe07c086e60 con 0x7fe0880f5440 2022-02-02T15:17:28.014 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.024+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe088107df0 con 0x7fe0880f5440 2022-02-02T15:17:28.014 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:27 smithi033 ceph-mon[101165]: from='client.37106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:28.015 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:27 smithi033 ceph-mon[101165]: from='client.37110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:28.015 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:27 smithi033 ceph-mon[101165]: pgmap v2962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:28.015 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.024+0000 7fe0857fa700 1 -- 172.21.15.33:0/2940801179 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe07c056470 con 0x7fe0880f5440 2022-02-02T15:17:28.016 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:17:28.016 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:17:28.016 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:17:28.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:28.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:17:28.018 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:17:28.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:28.018 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:17:28.019 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:17:28.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:28.019 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:17:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:17:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:17:28.020 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:17:28.021 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:17:28.021 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:17:28.021 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:17:28.022 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 msgr2=0x7fe078067280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 0x7fe078067280 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7fe074004630 tx=0x7fe074009b30).stop 2022-02-02T15:17:28.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 msgr2=0x7fe088105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fe07c00e9a0 tx=0x7fe07c007e20).stop 2022-02-02T15:17:28.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 shutdown_connections 2022-02-02T15:17:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe078064dc0 0x7fe078067280 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0880f5440 0x7fe088105cd0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 --2- 172.21.15.33:0/2940801179 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0880f66e0 0x7fe0881061c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.026+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 >> 172.21.15.33:0/2940801179 conn(0x7fe0880f0ba0 msgr2=0x7fe0880fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:28.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.027+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 shutdown_connections 2022-02-02T15:17:28.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.027+0000 7fe08d9b8700 1 -- 172.21.15.33:0/2940801179 wait complete. 2022-02-02T15:17:28.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 -- 172.21.15.33:0/3752768658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 msgr2=0x7f72fc0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 --2- 172.21.15.33:0/3752768658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc0f6b00 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f72f8004660 tx=0x7f72f8009b30).stop 2022-02-02T15:17:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 -- 172.21.15.33:0/3752768658 shutdown_connections 2022-02-02T15:17:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 --2- 172.21.15.33:0/3752768658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T15:17:28.118 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 --2- 172.21.15.33:0/3752768658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc0f6b00 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 -- 172.21.15.33:0/3752768658 >> 172.21.15.33:0/3752768658 conn(0x7f72fc0f1e40 msgr2=0x7f72fc0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:28.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.127+0000 7f7303759700 1 -- 172.21.15.33:0/3752768658 shutdown_connections 2022-02-02T15:17:28.119 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 -- 172.21.15.33:0/3752768658 wait complete. 2022-02-02T15:17:28.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 Processor -- start 2022-02-02T15:17:28.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 -- start start 2022-02-02T15:17:28.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:28.122 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc1074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:28.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc107ae0 con 0x7f72fc0f66e0 2022-02-02T15:17:28.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.128+0000 7f7303759700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc108390 con 0x7f72fc0f7980 2022-02-02T15:17:28.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:28.123 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36856/0 (socket says 172.21.15.33:36856) 2022-02-02T15:17:28.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 -- 172.21.15.33:0/1470374526 learned_addr learned my addr 172.21.15.33:0/1470374526 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:28.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f7300cf4700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc1074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:28.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 -- 172.21.15.33:0/1470374526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 msgr2=0x7f72fc1074a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc1074a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 -- 172.21.15.33:0/1470374526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8005040 con 0x7f72fc0f66e0 2022-02-02T15:17:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f7300cf4700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:17:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f73014f5700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f72f8004f60 tx=0x7f72f8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72f8018070 con 0x7f72fc0f66e0 2022-02-02T15:17:28.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f72f8007ba0 con 0x7f72fc0f66e0 2022-02-02T15:17:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc108610 con 0x7f72fc0f66e0 2022-02-02T15:17:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.129+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72f801c620 con 0x7f72fc0f66e0 2022-02-02T15:17:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.130+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc108b70 con 0x7f72fc0f66e0 2022-02-02T15:17:28.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.131+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc0f5ad0 con 0x7f72fc0f66e0 2022-02-02T15:17:28.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.131+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f72f801d420 con 0x7f72fc0f66e0 2022-02-02T15:17:28.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.131+0000 7f72edffb700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 0x7f72e8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:28.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.131+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f72f80839a0 con 0x7f72fc0f66e0 2022-02-02T15:17:28.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.131+0000 7f7300cf4700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 0x7f72e8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:28.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.132+0000 7f7300cf4700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 0x7f72e8067290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f72f000a7e0 tx=0x7f72f0008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:28.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.136+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f72f8055540 con 0x7f72fc0f66e0 2022-02-02T15:17:28.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:27 smithi037 ceph-mon[69017]: from='client.37106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:27 smithi037 ceph-mon[69017]: from='client.37110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:28.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:27 smithi037 ceph-mon[69017]: pgmap v2962: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:28.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.348+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72fc0fef70 con 0x7f72fc0f66e0 2022-02-02T15:17:28.339 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.348+0000 7f72edffb700 1 -- 172.21.15.33:0/1470374526 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f72f8055130 con 0x7f72fc0f66e0 2022-02-02T15:17:28.339 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:17:28.340 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:17:28.340 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:17:28.340 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:17:28.340 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:28.341 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:17:28.341 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:17:28.341 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:17:28.341 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:17:28.342 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:17:28.342 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:17:28.342 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:17:28.342 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:17:28.343 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:17:28.343 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:17:28.343 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:17:28.343 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:17:28.343 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:17:28.344 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:17:28.344 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:17:28.344 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:17:28.344 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:17:28.345 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:17:28.345 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:17:28.345 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:17:28.345 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:17:28.346 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:17:28.346 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:17:28.346 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:17:28.346 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:17:28.346 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:17:28.347 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:28.347 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:28.347 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:17:28.347 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:28.348 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:28.348 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:28.348 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:28.348 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:28.349 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 msgr2=0x7f72e8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 0x7f72e8067290 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f72f000a7e0 tx=0x7f72f0008040).stop 2022-02-02T15:17:28.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 msgr2=0x7f72fc106fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:28.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f72f8004f60 tx=0x7f72f8009b30).stop 2022-02-02T15:17:28.350 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 shutdown_connections 2022-02-02T15:17:28.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f72e8064dd0 0x7f72e8067290 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72fc0f66e0 0x7f72fc106fb0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 --2- 172.21.15.33:0/1470374526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72fc0f7980 0x7f72fc1074a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:28.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 >> 172.21.15.33:0/1470374526 conn(0x7f72fc0f1e40 msgr2=0x7f72fc0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:28.351 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 shutdown_connections 2022-02-02T15:17:28.352 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:28.350+0000 7f7303759700 1 -- 172.21.15.33:0/1470374526 wait complete. 2022-02-02T15:17:28.352 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:17:29.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2940801179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:17:29.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:28 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1470374526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:17:29.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2940801179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:17:29.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:28 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1470374526' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:17:30.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:29 smithi033 ceph-mon[101165]: pgmap v2963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:29 smithi037 ceph-mon[69017]: pgmap v2963: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:32.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:31 smithi033 ceph-mon[101165]: pgmap v2964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:32.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:31 smithi037 ceph-mon[69017]: pgmap v2964: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:34.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:33 smithi033 ceph-mon[101165]: pgmap v2965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:33 smithi037 ceph-mon[69017]: pgmap v2965: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:36.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:35 smithi033 ceph-mon[101165]: pgmap v2966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:36.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:35 smithi037 ceph-mon[69017]: pgmap v2966: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:38.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:37 smithi033 ceph-mon[101165]: pgmap v2967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:38.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:37 smithi037 ceph-mon[69017]: pgmap v2967: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:40.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:39 smithi033 ceph-mon[101165]: pgmap v2968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:40.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:39 smithi037 ceph-mon[69017]: pgmap v2968: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:42.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:41 smithi033 ceph-mon[101165]: pgmap v2969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:42.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:41 smithi037 ceph-mon[69017]: pgmap v2969: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:44.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:43 smithi033 ceph-mon[101165]: pgmap v2970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:44.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:43 smithi037 ceph-mon[69017]: pgmap v2970: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:46.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:45 smithi033 ceph-mon[101165]: pgmap v2971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:46.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:45 smithi037 ceph-mon[69017]: pgmap v2971: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:48.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:47 smithi033 ceph-mon[101165]: pgmap v2972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:48.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:47 smithi037 ceph-mon[69017]: pgmap v2972: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:50.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:49 smithi033 ceph-mon[101165]: pgmap v2973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:50.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:49 smithi037 ceph-mon[69017]: pgmap v2973: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:52.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:51 smithi033 ceph-mon[101165]: pgmap v2974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:52.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:51 smithi037 ceph-mon[69017]: pgmap v2974: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:54.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:53 smithi033 ceph-mon[101165]: pgmap v2975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:54.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:53 smithi037 ceph-mon[69017]: pgmap v2975: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:17:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:17:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:17:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:17:56.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:55 smithi033 ceph-mon[101165]: pgmap v2976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:56.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:55 smithi037 ceph-mon[69017]: pgmap v2976: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:58.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:57 smithi033 ceph-mon[101165]: pgmap v2977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:58.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:57 smithi037 ceph-mon[69017]: pgmap v2977: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:17:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 -- 172.21.15.33:0/2976920236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 msgr2=0x7f2cd40fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/2976920236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd40fbae0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f2cc4004660 tx=0x7f2cc4009b30).stop 2022-02-02T15:17:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 -- 172.21.15.33:0/2976920236 shutdown_connections 2022-02-02T15:17:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/2976920236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd40fbae0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/2976920236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 0x7f2cd40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 -- 172.21.15.33:0/2976920236 >> 172.21.15.33:0/2976920236 conn(0x7f2cd40f0b90 msgr2=0x7f2cd40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 -- 172.21.15.33:0/2976920236 shutdown_connections 2022-02-02T15:17:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 -- 172.21.15.33:0/2976920236 wait complete. 2022-02-02T15:17:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.467+0000 7f2cd8f12700 1 Processor -- start 2022-02-02T15:17:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd8f12700 1 -- start start 2022-02-02T15:17:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd8f12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 0x7f2cd4106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd8f12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd8f12700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd4107890 con 0x7f2cd40f9690 2022-02-02T15:17:58.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd8f12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd41080d0 con 0x7f2cd4060310 2022-02-02T15:17:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36868/0 (socket says 172.21.15.33:36868) 2022-02-02T15:17:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd2ffd700 1 -- 172.21.15.33:0/3254814558 learned_addr learned my addr 172.21.15.33:0/3254814558 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.468+0000 7f2cd37fe700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 0x7f2cd4106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd2ffd700 1 -- 172.21.15.33:0/3254814558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 msgr2=0x7f2cd4106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd2ffd700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 0x7f2cd4106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd2ffd700 1 -- 172.21.15.33:0/3254814558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4005040 con 0x7f2cd40f9690 2022-02-02T15:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd2ffd700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f2cc4013a70 tx=0x7f2cc4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc4018070 con 0x7f2cd40f9690 2022-02-02T15:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2cc40097d0 con 0x7f2cd40f9690 2022-02-02T15:17:58.465 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cc401de80 con 0x7f2cd40f9690 2022-02-02T15:17:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd4108350 con 0x7f2cd40f9690 2022-02-02T15:17:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.469+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd4108830 con 0x7f2cd40f9690 2022-02-02T15:17:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.470+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cd4059100 con 0x7f2cd40f9690 2022-02-02T15:17:58.466 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.471+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2cc4007ba0 con 0x7f2cd40f9690 2022-02-02T15:17:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.471+0000 7f2ccbfff700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 0x7f2cc00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.472+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2cc4082e00 con 0x7f2cd40f9690 2022-02-02T15:17:58.467 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.472+0000 7f2cd37fe700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 0x7f2cc00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.472+0000 7f2cd37fe700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 0x7f2cc00672e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f2cd4107b60 tx=0x7f2cbc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:58.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.476+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2cc4050dc0 con 0x7f2cd40f9690 2022-02-02T15:17:58.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.665+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2cd40fee30 con 0x7f2cc0064e20 2022-02-02T15:17:58.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.667+0000 7f2ccbfff700 1 -- 172.21.15.33:0/3254814558 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2cd40fee30 con 0x7f2cc0064e20 2022-02-02T15:17:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 msgr2=0x7f2cc00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 0x7f2cc00672e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7f2cd4107b60 tx=0x7f2cbc00b040).stop 2022-02-02T15:17:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 msgr2=0x7f2cd4107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f2cc4013a70 tx=0x7f2cc4009b30).stop 2022-02-02T15:17:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 shutdown_connections 2022-02-02T15:17:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2cc0064e20 0x7f2cc00672e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cd4060310 0x7f2cd4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 --2- 172.21.15.33:0/3254814558 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cd40f9690 0x7f2cd4107290 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.668+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 >> 172.21.15.33:0/3254814558 conn(0x7f2cd40f0b90 msgr2=0x7f2cd40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.669+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 shutdown_connections 2022-02-02T15:17:58.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.669+0000 7f2cd8f12700 1 -- 172.21.15.33:0/3254814558 wait complete. 2022-02-02T15:17:58.668 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:17:58.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 -- 172.21.15.33:0/3647726706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f66d0 msgr2=0x7faddc0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 --2- 172.21.15.33:0/3647726706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f66d0 0x7faddc0f6b30 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7fadd0004660 tx=0x7fadd0009b30).stop 2022-02-02T15:17:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 -- 172.21.15.33:0/3647726706 shutdown_connections 2022-02-02T15:17:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 --2- 172.21.15.33:0/3647726706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f66d0 0x7faddc0f6b30 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.760 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 --2- 172.21.15.33:0/3647726706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f5430 0x7faddc0f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T15:17:58.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 -- 172.21.15.33:0/3647726706 >> 172.21.15.33:0/3647726706 conn(0x7faddc0f0b90 msgr2=0x7faddc0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:58.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.769+0000 7fade0f1b700 1 -- 172.21.15.33:0/3647726706 shutdown_connections 2022-02-02T15:17:58.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.770+0000 7fade0f1b700 1 -- 172.21.15.33:0/3647726706 wait complete. 2022-02-02T15:17:58.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.770+0000 7fade0f1b700 1 Processor -- start 2022-02-02T15:17:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fade0f1b700 1 -- start start 2022-02-02T15:17:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fade0f1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fade0f1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f66d0 0x7faddc10bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fade0f1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc060470 con 0x7faddc0f5430 2022-02-02T15:17:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fade0f1b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc0605b0 con 0x7faddc0f66d0 2022-02-02T15:17:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36876/0 (socket says 172.21.15.33:36876) 2022-02-02T15:17:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 -- 172.21.15.33:0/4078701471 learned_addr learned my addr 172.21.15.33:0/4078701471 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:58.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddaffd700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f66d0 0x7faddc10bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 -- 172.21.15.33:0/4078701471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f66d0 msgr2=0x7faddc10bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f66d0 0x7faddc10bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 -- 172.21.15.33:0/4078701471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0005040 con 0x7faddc0f5430 2022-02-02T15:17:58.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7faddb7fe700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fadcc0093f0 tx=0x7fadcc006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:58.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc009ea0 con 0x7faddc0f5430 2022-02-02T15:17:58.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.771+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fadcc013af0 con 0x7faddc0f5430 2022-02-02T15:17:58.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.772+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faddc10c5f0 con 0x7faddc0f5430 2022-02-02T15:17:58.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.772+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadcc00db10 con 0x7faddc0f5430 2022-02-02T15:17:58.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.772+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faddc10cb80 con 0x7faddc0f5430 2022-02-02T15:17:58.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.773+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faddc059100 con 0x7faddc0f5430 2022-02-02T15:17:58.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.773+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fadcc01a060 con 0x7faddc0f5430 2022-02-02T15:17:58.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.773+0000 7fadc3fff700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 0x7fadc40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:58.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.774+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fadcc081a00 con 0x7faddc0f5430 2022-02-02T15:17:58.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.774+0000 7faddaffd700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 0x7fadc40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:58.770 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.774+0000 7faddaffd700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 0x7fadc40672e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fadd0004e30 tx=0x7fadd0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:58.771 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.778+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fadcc04fab0 con 0x7faddc0f5430 2022-02-02T15:17:58.949 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.960+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7faddc0fdd70 con 0x7fadc4064e20 2022-02-02T15:17:58.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.974+0000 7fadc3fff700 1 -- 172.21.15.33:0/4078701471 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7faddc0fdd70 con 0x7fadc4064e20 2022-02-02T15:17:58.964 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:17:58.965 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (103m) 65m ago 104m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:17:58.965 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (96m) 65m ago 104m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:17:58.965 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (96m) 65m ago 103m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:17:58.965 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (103m) 65m ago 104m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:17:58.966 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (96m) 65m ago 100m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:17:58.966 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (97m) 65m ago 100m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:17:58.966 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (98m) 65m ago 100m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:17:58.966 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (100m) 65m ago 100m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:17:58.967 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (97m) 65m ago 105m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:17:58.967 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (97m) 65m ago 103m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:17:58.967 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (97m) 65m ago 105m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:17:58.967 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (96m) 65m ago 103m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:17:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (104m) 65m ago 103m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:17:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (103m) 65m ago 103m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:17:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 65m ago 102m - 4096M 2022-02-02T15:17:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (102m) 65m ago 102m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:17:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (102m) 65m ago 102m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:17:58.969 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (102m) 65m ago 102m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:17:58.969 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (101m) 65m ago 101m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:17:58.969 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (101m) 65m ago 101m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:17:58.969 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (103m) 65m ago 103m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:17:58.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 msgr2=0x7fadc40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.970 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 0x7fadc40672e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fadd0004e30 tx=0x7fadd0009b30).stop 2022-02-02T15:17:58.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 msgr2=0x7faddc109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:58.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 rx=0x7fadcc0093f0 tx=0x7fadcc006ec0).stop 2022-02-02T15:17:58.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 shutdown_connections 2022-02-02T15:17:58.971 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fadc4064e20 0x7fadc40672e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faddc0f5430 0x7faddc109a90 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 --2- 172.21.15.33:0/4078701471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faddc0f66d0 0x7faddc10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:58.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.976+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 >> 172.21.15.33:0/4078701471 conn(0x7faddc0f0b90 msgr2=0x7faddc0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:58.972 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.977+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 shutdown_connections 2022-02-02T15:17:58.973 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:58.977+0000 7fade0f1b700 1 -- 172.21.15.33:0/4078701471 wait complete. 2022-02-02T15:17:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.076+0000 7f082b59e700 1 -- 172.21.15.33:0/4055092755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f5430 msgr2=0x7f082c0f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.076+0000 7f082b59e700 1 --2- 172.21.15.33:0/4055092755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f5430 0x7f082c0f5850 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f081c004660 tx=0x7f081c009b30).stop 2022-02-02T15:17:59.067 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:58 smithi033 ceph-mon[101165]: from='client.37122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 -- 172.21.15.33:0/4055092755 shutdown_connections 2022-02-02T15:17:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 --2- 172.21.15.33:0/4055092755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f66d0 0x7f082c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 --2- 172.21.15.33:0/4055092755 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f5430 0x7f082c0f5850 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 -- 172.21.15.33:0/4055092755 >> 172.21.15.33:0/4055092755 conn(0x7f082c0f0b90 msgr2=0x7f082c0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 -- 172.21.15.33:0/4055092755 shutdown_connections 2022-02-02T15:17:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 -- 172.21.15.33:0/4055092755 wait complete. 2022-02-02T15:17:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 Processor -- start 2022-02-02T15:17:59.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 -- start start 2022-02-02T15:17:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.077+0000 7f082b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f5430 0x7f082c109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f082b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f082b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0603c0 con 0x7f082c0f66d0 2022-02-02T15:17:59.072 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f082b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c060500 con 0x7f082c0f5430 2022-02-02T15:17:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36888/0 (socket says 172.21.15.33:36888) 2022-02-02T15:17:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 -- 172.21.15.33:0/1347926867 learned_addr learned my addr 172.21.15.33:0/1347926867 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f082a59c700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f5430 0x7f082c109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.073 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 -- 172.21.15.33:0/1347926867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f5430 msgr2=0x7f082c109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f5430 0x7f082c109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 -- 172.21.15.33:0/1347926867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c005040 con 0x7f082c0f66d0 2022-02-02T15:17:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f0829d9b700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f08200026d0 tx=0x7f0820009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:59.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08200079c0 con 0x7f082c0f66d0 2022-02-02T15:17:59.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.078+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f082000f040 con 0x7f082c0f66d0 2022-02-02T15:17:59.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.079+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c10c560 con 0x7f082c0f66d0 2022-02-02T15:17:59.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.079+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08200148b0 con 0x7f082c0f66d0 2022-02-02T15:17:59.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.079+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c10caf0 con 0x7f082c0f66d0 2022-02-02T15:17:59.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.080+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c059100 con 0x7f082c0f66d0 2022-02-02T15:17:59.076 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.080+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f0820007b20 con 0x7f082c0f66d0 2022-02-02T15:17:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.081+0000 7f081affd700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 0x7f08140672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.081+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f08200810c0 con 0x7f082c0f66d0 2022-02-02T15:17:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.081+0000 7f082a59c700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 0x7f08140672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.077 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.081+0000 7f082a59c700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 0x7f08140672e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f081c013690 tx=0x7f081c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:59.078 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.085+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f0820086060 con 0x7f082c0f66d0 2022-02-02T15:17:59.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:58 smithi037 ceph-mon[69017]: from='client.37122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:17:59.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.325+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f082c045ad0 con 0x7f082c0f66d0 2022-02-02T15:17:59.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.326+0000 7f081affd700 1 -- 172.21.15.33:0/1347926867 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f08200862d0 con 0x7f082c0f66d0 2022-02-02T15:17:59.316 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:17:59.316 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:17:59.317 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:17:59.317 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:59.317 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:17:59.317 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:17:59.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:59.318 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:17:59.318 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:17:59.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:59.318 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:17:59.319 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:17:59.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:17:59.319 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:17:59.319 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:17:59.320 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:17:59.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:17:59.320 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:17:59.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 msgr2=0x7f08140672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 0x7f08140672e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f081c013690 tx=0x7f081c009b30).stop 2022-02-02T15:17:59.321 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 msgr2=0x7f082c10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f08200026d0 tx=0x7f0820009de0).stop 2022-02-02T15:17:59.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 shutdown_connections 2022-02-02T15:17:59.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f0814064e20 0x7f08140672e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.322 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f082c0f5430 0x7f082c109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 --2- 172.21.15.33:0/1347926867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f082c0f66d0 0x7f082c10bfb0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 >> 172.21.15.33:0/1347926867 conn(0x7f082c0f0b90 msgr2=0x7f082c0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:59.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 shutdown_connections 2022-02-02T15:17:59.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.328+0000 7f082b59e700 1 -- 172.21.15.33:0/1347926867 wait complete. 2022-02-02T15:17:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 -- 172.21.15.33:0/2276266078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 msgr2=0x7eff6c0f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2276266078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c0f7c30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7eff54004660 tx=0x7eff54009b30).stop 2022-02-02T15:17:59.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 -- 172.21.15.33:0/2276266078 shutdown_connections 2022-02-02T15:17:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2276266078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c0f7c30 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2276266078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c0f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 -- 172.21.15.33:0/2276266078 >> 172.21.15.33:0/2276266078 conn(0x7eff6c0f1cd0 msgr2=0x7eff6c0f40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:59.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 -- 172.21.15.33:0/2276266078 shutdown_connections 2022-02-02T15:17:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.429+0000 7eff6b59e700 1 -- 172.21.15.33:0/2276266078 wait complete. 2022-02-02T15:17:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 Processor -- start 2022-02-02T15:17:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 -- start start 2022-02-02T15:17:59.423 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06a380 con 0x7eff6c0f77d0 2022-02-02T15:17:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff6b59e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c06a4c0 con 0x7eff6c0f6530 2022-02-02T15:17:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff69d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.424 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff69d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36898/0 (socket says 172.21.15.33:36898) 2022-02-02T15:17:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.430+0000 7eff69d9b700 1 -- 172.21.15.33:0/2151775757 learned_addr learned my addr 172.21.15.33:0/2151775757 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:17:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff6a59c700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff69d9b700 1 -- 172.21.15.33:0/2151775757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 msgr2=0x7eff6c06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff69d9b700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.425 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff69d9b700 1 -- 172.21.15.33:0/2151775757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54005040 con 0x7eff6c0f77d0 2022-02-02T15:17:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff6a59c700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:17:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff69d9b700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7eff54009990 tx=0x7eff54009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff54018070 con 0x7eff6c0f77d0 2022-02-02T15:17:59.426 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7eff54007ba0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c06a740 con 0x7eff6c0f77d0 2022-02-02T15:17:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c06aca0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.427 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.431+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff5401c3c0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.432+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c045ad0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.428 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.433+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7eff5401d420 con 0x7eff6c0f77d0 2022-02-02T15:17:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.433+0000 7eff62ffd700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 0x7eff580672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:17:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.433+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7eff54083790 con 0x7eff6c0f77d0 2022-02-02T15:17:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.433+0000 7eff6a59c700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 0x7eff580672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:17:59.429 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.434+0000 7eff6a59c700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 0x7eff580672e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7eff6c06b730 tx=0x7eff5c009c00).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:17:59.430 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.437+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7eff540518a0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.649+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff6c0fedf0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.649+0000 7eff62ffd700 1 -- 172.21.15.33:0/2151775757 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7eff54054ec0 con 0x7eff6c0f77d0 2022-02-02T15:17:59.639 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:17:59.640 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:17:59.640 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:17:59.640 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:17:59.640 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:59.641 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:17:59.641 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:17:59.641 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:17:59.641 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:17:59.641 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:17:59.642 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:17:59.642 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:17:59.642 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:17:59.642 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:17:59.642 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:17:59.643 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:17:59.643 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:17:59.643 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:17:59.643 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:17:59.643 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:17:59.644 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:17:59.644 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:17:59.644 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:17:59.644 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:17:59.645 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:17:59.645 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:17:59.645 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:17:59.645 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:17:59.645 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:17:59.646 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:17:59.646 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:17:59.646 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:59.646 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:59.646 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:17:59.647 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:17:59.647 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:59.647 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:59.647 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:59.648 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:17:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 msgr2=0x7eff580672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 0x7eff580672e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7eff6c06b730 tx=0x7eff5c009c00).stop 2022-02-02T15:17:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 msgr2=0x7eff6c069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:17:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7eff54009990 tx=0x7eff54009b30).stop 2022-02-02T15:17:59.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 shutdown_connections 2022-02-02T15:17:59.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7eff58064e20 0x7eff580672e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff6c0f6530 0x7eff6c06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 --2- 172.21.15.33:0/2151775757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff6c0f77d0 0x7eff6c069e20 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:17:59.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 >> 172.21.15.33:0/2151775757 conn(0x7eff6c0f1cd0 msgr2=0x7eff6c0fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:17:59.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 shutdown_connections 2022-02-02T15:17:59.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:17:59.653+0000 7eff6b59e700 1 -- 172.21.15.33:0/2151775757 wait complete. 2022-02-02T15:17:59.651 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:18:00.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:59 smithi033 ceph-mon[101165]: from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:00.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1347926867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:18:00.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:59 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2151775757' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:18:00.231 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:17:59 smithi033 ceph-mon[101165]: pgmap v2978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:00.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:59 smithi037 ceph-mon[69017]: from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:00.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1347926867' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:18:00.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:59 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2151775757' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:18:00.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:17:59 smithi037 ceph-mon[69017]: pgmap v2978: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:02.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:01 smithi033 ceph-mon[101165]: pgmap v2979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:01 smithi037 ceph-mon[69017]: pgmap v2979: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:04.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:03 smithi033 ceph-mon[101165]: pgmap v2980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:04.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:03 smithi037 ceph-mon[69017]: pgmap v2980: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:06.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:05 smithi033 ceph-mon[101165]: pgmap v2981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:06.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:05 smithi037 ceph-mon[69017]: pgmap v2981: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:07 smithi033 ceph-mon[101165]: pgmap v2982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:07 smithi037 ceph-mon[69017]: pgmap v2982: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:10.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:09 smithi033 ceph-mon[101165]: pgmap v2983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:10.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:09 smithi037 ceph-mon[69017]: pgmap v2983: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:12.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:11 smithi033 ceph-mon[101165]: pgmap v2984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:12.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:11 smithi037 ceph-mon[69017]: pgmap v2984: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:14.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:13 smithi033 ceph-mon[101165]: pgmap v2985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:14.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:13 smithi037 ceph-mon[69017]: pgmap v2985: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:16.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:15 smithi033 ceph-mon[101165]: pgmap v2986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:16.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:15 smithi037 ceph-mon[69017]: pgmap v2986: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:18.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:17 smithi033 ceph-mon[101165]: pgmap v2987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:18.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:17 smithi037 ceph-mon[69017]: pgmap v2987: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:20.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:19 smithi033 ceph-mon[101165]: pgmap v2988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:20.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:19 smithi037 ceph-mon[69017]: pgmap v2988: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:22.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:21 smithi033 ceph-mon[101165]: pgmap v2989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:22.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:21 smithi037 ceph-mon[69017]: pgmap v2989: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:24.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:23 smithi033 ceph-mon[101165]: pgmap v2990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:24.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:23 smithi037 ceph-mon[69017]: pgmap v2990: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:26.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:25 smithi033 ceph-mon[101165]: pgmap v2991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:26.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:25 smithi037 ceph-mon[69017]: pgmap v2991: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:28.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:27 smithi033 ceph-mon[101165]: pgmap v2992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:28.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:27 smithi037 ceph-mon[69017]: pgmap v2992: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:29.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.766+0000 7fd52603e700 1 -- 172.21.15.33:0/2412418598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5200f9820 msgr2=0x7fd5200fbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:29.757 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.766+0000 7fd52603e700 1 --2- 172.21.15.33:0/2412418598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5200f9820 0x7fd5200fbc70 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fd514004660 tx=0x7fd514009b30).stop 2022-02-02T15:18:29.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 -- 172.21.15.33:0/2412418598 shutdown_connections 2022-02-02T15:18:29.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 --2- 172.21.15.33:0/2412418598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5200f9820 0x7fd5200fbc70 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.758 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 --2- 172.21.15.33:0/2412418598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd520060310 0x7fd5200f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 -- 172.21.15.33:0/2412418598 >> 172.21.15.33:0/2412418598 conn(0x7fd5200f0d40 msgr2=0x7fd5200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:29.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 -- 172.21.15.33:0/2412418598 shutdown_connections 2022-02-02T15:18:29.759 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 -- 172.21.15.33:0/2412418598 wait complete. 2022-02-02T15:18:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.767+0000 7fd52603e700 1 Processor -- start 2022-02-02T15:18:29.761 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd52603e700 1 -- start start 2022-02-02T15:18:29.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd52603e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:29.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd52603e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5200f9820 0x7fd5201095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:29.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd52603e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520109b70 con 0x7fd520060310 2022-02-02T15:18:29.762 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd52603e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520109cb0 con 0x7fd5200f9820 2022-02-02T15:18:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36906/0 (socket says 172.21.15.33:36906) 2022-02-02T15:18:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 -- 172.21.15.33:0/3220945653 learned_addr learned my addr 172.21.15.33:0/3220945653 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:18:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51effd700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5200f9820 0x7fd5201095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 -- 172.21.15.33:0/3220945653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5200f9820 msgr2=0x7fd5201095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5200f9820 0x7fd5201095c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.768+0000 7fd51f7fe700 1 -- 172.21.15.33:0/3220945653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514005040 con 0x7fd520060310 2022-02-02T15:18:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd51f7fe700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fd51000c530 tx=0x7fd510007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd51000f650 con 0x7fd520060310 2022-02-02T15:18:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd51000fc60 con 0x7fd520060310 2022-02-02T15:18:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd510012c20 con 0x7fd520060310 2022-02-02T15:18:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52010a650 con 0x7fd520060310 2022-02-02T15:18:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.769+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52010ac10 con 0x7fd520060310 2022-02-02T15:18:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.770+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd520045ad0 con 0x7fd520060310 2022-02-02T15:18:29.765 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.770+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd510010070 con 0x7fd520060310 2022-02-02T15:18:29.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.771+0000 7fd507fff700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 0x7fd508067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:29.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.771+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd510081660 con 0x7fd520060310 2022-02-02T15:18:29.766 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.771+0000 7fd51effd700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 0x7fd508067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.771+0000 7fd51effd700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 0x7fd508067290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd514004630 tx=0x7fd514009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:29.767 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.775+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd5100477d0 con 0x7fd520060310 2022-02-02T15:18:29.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.963+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5200fa740 con 0x7fd508064dd0 2022-02-02T15:18:29.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.964+0000 7fd507fff700 1 -- 172.21.15.33:0/3220945653 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fd5200fa740 con 0x7fd508064dd0 2022-02-02T15:18:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 msgr2=0x7fd508067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 0x7fd508067290 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7fd514004630 tx=0x7fd514009b30).stop 2022-02-02T15:18:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 msgr2=0x7fd5201090d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fd51000c530 tx=0x7fd510007e20).stop 2022-02-02T15:18:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 shutdown_connections 2022-02-02T15:18:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd508064dd0 0x7fd508067290 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd520060310 0x7fd5201090d0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 --2- 172.21.15.33:0/3220945653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd5200f9820 0x7fd5201095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:29.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 >> 172.21.15.33:0/3220945653 conn(0x7fd5200f0d40 msgr2=0x7fd5200fa030 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:29.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 shutdown_connections 2022-02-02T15:18:29.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:29.966+0000 7fd52603e700 1 -- 172.21.15.33:0/3220945653 wait complete. 2022-02-02T15:18:29.966 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:18:30.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 -- 172.21.15.33:0/2400373452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 msgr2=0x7feedc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 --2- 172.21.15.33:0/2400373452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc0f59e0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7feed8004660 tx=0x7feed8009b30).stop 2022-02-02T15:18:30.059 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:29 smithi033 ceph-mon[101165]: pgmap v2993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 -- 172.21.15.33:0/2400373452 shutdown_connections 2022-02-02T15:18:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 --2- 172.21.15.33:0/2400373452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 0x7feedc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 --2- 172.21.15.33:0/2400373452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc0f59e0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 -- 172.21.15.33:0/2400373452 >> 172.21.15.33:0/2400373452 conn(0x7feedc0f0d40 msgr2=0x7feedc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.067+0000 7feee4397700 1 -- 172.21.15.33:0/2400373452 shutdown_connections 2022-02-02T15:18:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 -- 172.21.15.33:0/2400373452 wait complete. 2022-02-02T15:18:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 Processor -- start 2022-02-02T15:18:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 -- start start 2022-02-02T15:18:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 0x7feedc109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc109c00 con 0x7feedc0f55c0 2022-02-02T15:18:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee4397700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc109d40 con 0x7feedc0f6860 2022-02-02T15:18:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee2133700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee2133700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36916/0 (socket says 172.21.15.33:36916) 2022-02-02T15:18:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.068+0000 7feee2133700 1 -- 172.21.15.33:0/2394684780 learned_addr learned my addr 172.21.15.33:0/2394684780 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:18:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee1932700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 0x7feedc109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee2133700 1 -- 172.21.15.33:0/2394684780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 msgr2=0x7feedc109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee2133700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 0x7feedc109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee2133700 1 -- 172.21.15.33:0/2394684780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8005040 con 0x7feedc0f55c0 2022-02-02T15:18:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee2133700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7feed8013a70 tx=0x7feed8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed8018070 con 0x7feedc0f55c0 2022-02-02T15:18:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7feed80097d0 con 0x7feedc0f55c0 2022-02-02T15:18:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc10a680 con 0x7feedc0f55c0 2022-02-02T15:18:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feed801c3c0 con 0x7feedc0f55c0 2022-02-02T15:18:30.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.069+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc10abe0 con 0x7feedc0f55c0 2022-02-02T15:18:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.070+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc045ad0 con 0x7feedc0f55c0 2022-02-02T15:18:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.071+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7feed8007ba0 con 0x7feedc0f55c0 2022-02-02T15:18:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.071+0000 7feeceffd700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 0x7feec8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.071+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7feed8083790 con 0x7feedc0f55c0 2022-02-02T15:18:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.071+0000 7feee1932700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 0x7feec8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.072+0000 7feee1932700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 0x7feec8067290 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7feed0004a70 tx=0x7feed000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.075+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7feed8055330 con 0x7feedc0f55c0 2022-02-02T15:18:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.257+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feedc0faaa0 con 0x7feec8064dd0 2022-02-02T15:18:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.271+0000 7feeceffd700 1 -- 172.21.15.33:0/2394684780 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7feedc0faaa0 con 0x7feec8064dd0 2022-02-02T15:18:30.262 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:18:30.263 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (103m) 65m ago 104m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:18:30.263 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (96m) 65m ago 104m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:18:30.263 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (96m) 65m ago 104m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:18:30.263 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (103m) 65m ago 104m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:18:30.264 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (97m) 65m ago 100m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:18:30.264 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (97m) 65m ago 100m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:18:30.264 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (98m) 65m ago 101m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:18:30.264 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (100m) 65m ago 100m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:18:30.265 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (98m) 65m ago 106m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:18:30.265 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (97m) 65m ago 104m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:18:30.265 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (97m) 65m ago 106m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:18:30.265 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (97m) 65m ago 104m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:18:30.266 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (104m) 65m ago 104m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:18:30.266 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (104m) 65m ago 104m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:18:30.266 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 65m ago 103m - 4096M 2022-02-02T15:18:30.266 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (103m) 65m ago 103m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:18:30.267 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (102m) 65m ago 102m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:18:30.267 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (102m) 65m ago 102m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:18:30.267 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (102m) 65m ago 102m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:18:30.267 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (102m) 65m ago 102m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:18:30.267 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (103m) 65m ago 104m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:18:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 msgr2=0x7feec8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 0x7feec8067290 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7feed0004a70 tx=0x7feed000b040).stop 2022-02-02T15:18:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 msgr2=0x7feedc109160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7feed8013a70 tx=0x7feed8009b30).stop 2022-02-02T15:18:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 shutdown_connections 2022-02-02T15:18:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7feec8064dd0 0x7feec8067290 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feedc0f55c0 0x7feedc109160 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 --2- 172.21.15.33:0/2394684780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feedc0f6860 0x7feedc109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 >> 172.21.15.33:0/2394684780 conn(0x7feedc0f0d40 msgr2=0x7feedc05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 shutdown_connections 2022-02-02T15:18:30.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.274+0000 7feee4397700 1 -- 172.21.15.33:0/2394684780 wait complete. 2022-02-02T15:18:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:29 smithi037 ceph-mon[69017]: pgmap v2993: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 -- 172.21.15.33:0/3217163503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f6860 msgr2=0x7f83d40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/3217163503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f6860 0x7f83d40f6cc0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f83c8004660 tx=0x7f83c8009b30).stop 2022-02-02T15:18:30.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 -- 172.21.15.33:0/3217163503 shutdown_connections 2022-02-02T15:18:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/3217163503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f6860 0x7f83d40f6cc0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/3217163503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f55c0 0x7f83d40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 -- 172.21.15.33:0/3217163503 >> 172.21.15.33:0/3217163503 conn(0x7f83d40f0d40 msgr2=0x7f83d40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 -- 172.21.15.33:0/3217163503 shutdown_connections 2022-02-02T15:18:30.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.374+0000 7f83d9bb2700 1 -- 172.21.15.33:0/3217163503 wait complete. 2022-02-02T15:18:30.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 Processor -- start 2022-02-02T15:18:30.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 -- start start 2022-02-02T15:18:30.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f6860 0x7f83d410c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4060420 con 0x7f83d40f55c0 2022-02-02T15:18:30.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d9bb2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4060560 con 0x7f83d40f6860 2022-02-02T15:18:30.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.375+0000 7f83d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36926/0 (socket says 172.21.15.33:36926) 2022-02-02T15:18:30.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d37fe700 1 -- 172.21.15.33:0/2291786653 learned_addr learned my addr 172.21.15.33:0/2291786653 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:18:30.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d2ffd700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f6860 0x7f83d410c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d37fe700 1 -- 172.21.15.33:0/2291786653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f6860 msgr2=0x7f83d410c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d37fe700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f6860 0x7f83d410c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d37fe700 1 -- 172.21.15.33:0/2291786653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8005040 con 0x7f83d40f55c0 2022-02-02T15:18:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d37fe700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f83c4002700 tx=0x7f83c4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c4009320 con 0x7f83d40f55c0 2022-02-02T15:18:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f83c400f040 con 0x7f83d40f55c0 2022-02-02T15:18:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d410c730 con 0x7f83d40f55c0 2022-02-02T15:18:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83c4014900 con 0x7f83d40f55c0 2022-02-02T15:18:30.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.376+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d410ccc0 con 0x7f83d40f55c0 2022-02-02T15:18:30.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.378+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4004fa0 con 0x7f83d40f55c0 2022-02-02T15:18:30.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.378+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f83c4014a60 con 0x7f83d40f55c0 2022-02-02T15:18:30.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.378+0000 7f83bbfff700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 0x7f83bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.378+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f83c4081cf0 con 0x7f83d40f55c0 2022-02-02T15:18:30.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.378+0000 7f83d2ffd700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 0x7f83bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.379+0000 7f83d2ffd700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 0x7f83bc067290 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f83c8004630 tx=0x7f83c8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.382+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f83c404ff60 con 0x7f83d40f55c0 2022-02-02T15:18:30.617 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.626+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f83b4005e80 con 0x7f83d40f55c0 2022-02-02T15:18:30.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.627+0000 7f83bbfff700 1 -- 172.21.15.33:0/2291786653 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f83c4053580 con 0x7f83d40f55c0 2022-02-02T15:18:30.618 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:18:30.618 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:18:30.619 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:18:30.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:18:30.619 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:18:30.619 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:18:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:18:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:18:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:18:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:18:30.620 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:18:30.621 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:18:30.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:18:30.621 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:18:30.621 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:18:30.622 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:18:30.622 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:18:30.622 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:18:30.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 msgr2=0x7f83bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 0x7f83bc067290 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f83c8004630 tx=0x7f83c8009b30).stop 2022-02-02T15:18:30.623 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 msgr2=0x7f83d4109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f83c4002700 tx=0x7f83c4009d80).stop 2022-02-02T15:18:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 shutdown_connections 2022-02-02T15:18:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f83bc064dd0 0x7f83bc067290 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f83d40f55c0 0x7f83d4109c20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.624 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 --2- 172.21.15.33:0/2291786653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83d40f6860 0x7f83d410c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 >> 172.21.15.33:0/2291786653 conn(0x7f83d40f0d40 msgr2=0x7f83d40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 shutdown_connections 2022-02-02T15:18:30.625 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.629+0000 7f83d9bb2700 1 -- 172.21.15.33:0/2291786653 wait complete. 2022-02-02T15:18:30.722 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 -- 172.21.15.33:0/2299369785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f7980 msgr2=0x7efd080f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 --2- 172.21.15.33:0/2299369785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f7980 0x7efd080f7de0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7efcfc004660 tx=0x7efcfc009b30).stop 2022-02-02T15:18:30.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 -- 172.21.15.33:0/2299369785 shutdown_connections 2022-02-02T15:18:30.723 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 --2- 172.21.15.33:0/2299369785 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f7980 0x7efd080f7de0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 --2- 172.21.15.33:0/2299369785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f66e0 0x7efd080f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 -- 172.21.15.33:0/2299369785 >> 172.21.15.33:0/2299369785 conn(0x7efd080f1e40 msgr2=0x7efd080f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 -- 172.21.15.33:0/2299369785 shutdown_connections 2022-02-02T15:18:30.724 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.730+0000 7efd0feeb700 1 -- 172.21.15.33:0/2299369785 wait complete. 2022-02-02T15:18:30.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 Processor -- start 2022-02-02T15:18:30.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 -- start start 2022-02-02T15:18:30.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.725 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 0x7efd08069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0806a380 con 0x7efd080f66e0 2022-02-02T15:18:30.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0feeb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0806a4c0 con 0x7efd080f7980 2022-02-02T15:18:30.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.726 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36936/0 (socket says 172.21.15.33:36936) 2022-02-02T15:18:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 -- 172.21.15.33:0/1566028059 learned_addr learned my addr 172.21.15.33:0/1566028059 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:18:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0d486700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 0x7efd08069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 -- 172.21.15.33:0/1566028059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 msgr2=0x7efd08069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 0x7efd08069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 -- 172.21.15.33:0/1566028059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc005040 con 0x7efd080f66e0 2022-02-02T15:18:30.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0d486700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 0x7efd08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:18:30.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.731+0000 7efd0dc87700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7efd04002700 tx=0x7efd04009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.732+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd04009320 con 0x7efd080f66e0 2022-02-02T15:18:30.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.732+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0806a7a0 con 0x7efd080f66e0 2022-02-02T15:18:30.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.732+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd0400f040 con 0x7efd080f66e0 2022-02-02T15:18:30.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.732+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0810ef90 con 0x7efd080f66e0 2022-02-02T15:18:30.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.732+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd04014900 con 0x7efd080f66e0 2022-02-02T15:18:30.730 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.733+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08045ad0 con 0x7efd080f66e0 2022-02-02T15:18:30.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.733+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd04009480 con 0x7efd080f66e0 2022-02-02T15:18:30.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.733+0000 7efcfa7fc700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 0x7efcf4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:18:30.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.734+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efd04081d80 con 0x7efd080f66e0 2022-02-02T15:18:30.731 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.734+0000 7efd0d486700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 0x7efcf4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:18:30.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.734+0000 7efd0d486700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 0x7efcf4067290 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7efcfc009da0 tx=0x7efcfc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:18:30.732 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.738+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd0404fe30 con 0x7efd080f66e0 2022-02-02T15:18:30.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.951+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efd0806a930 con 0x7efd080f66e0 2022-02-02T15:18:30.942 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.952+0000 7efcfa7fc700 1 -- 172.21.15.33:0/1566028059 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7efd04083750 con 0x7efd080f66e0 2022-02-02T15:18:30.943 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:18:30.943 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:18:30.943 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:18:30.944 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:18:30.944 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:18:30.944 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:18:30.944 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:18:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:18:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:18:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:18:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:18:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:18:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:18:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:18:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:18:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:18:30.946 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:18:30.947 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:18:30.947 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:18:30.947 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:18:30.947 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:18:30.948 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:18:30.948 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:18:30.948 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:18:30.948 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:18:30.948 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:18:30.949 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:18:30.949 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:18:30.949 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:18:30.949 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:18:30.950 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:18:30.950 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:18:30.950 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:18:30.950 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:18:30.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:18:30.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:18:30.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:18:30.951 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:18:30.952 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:18:30.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 msgr2=0x7efcf4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 0x7efcf4067290 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7efcfc009da0 tx=0x7efcfc009b30).stop 2022-02-02T15:18:30.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 msgr2=0x7efd0806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:18:30.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7efd04002700 tx=0x7efd04009d80).stop 2022-02-02T15:18:30.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 shutdown_connections 2022-02-02T15:18:30.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efcf4064dd0 0x7efcf4067290 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd080f66e0 0x7efd0806b9a0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 --2- 172.21.15.33:0/1566028059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd080f7980 0x7efd08069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:18:30.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 >> 172.21.15.33:0/1566028059 conn(0x7efd080f1e40 msgr2=0x7efd080fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:18:30.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 shutdown_connections 2022-02-02T15:18:30.955 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:18:30.954+0000 7efd0feeb700 1 -- 172.21.15.33:0/1566028059 wait complete. 2022-02-02T15:18:30.955 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:18:31.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:30 smithi033 ceph-mon[101165]: from='client.37138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:31.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:30 smithi033 ceph-mon[101165]: from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:31.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:30 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2291786653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:18:31.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:30 smithi037 ceph-mon[69017]: from='client.37138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:31.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:30 smithi037 ceph-mon[69017]: from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:18:31.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:30 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2291786653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:18:32.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:31 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1566028059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:18:32.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:31 smithi033 ceph-mon[101165]: pgmap v2994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:32.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:31 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1566028059' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:18:32.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:31 smithi037 ceph-mon[69017]: pgmap v2994: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:34.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:33 smithi033 ceph-mon[101165]: pgmap v2995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:33 smithi037 ceph-mon[69017]: pgmap v2995: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:36.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:35 smithi033 ceph-mon[101165]: pgmap v2996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:36.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:35 smithi037 ceph-mon[69017]: pgmap v2996: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:38.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:37 smithi033 ceph-mon[101165]: pgmap v2997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:38.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:37 smithi037 ceph-mon[69017]: pgmap v2997: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:40.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:39 smithi033 ceph-mon[101165]: pgmap v2998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:40.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:39 smithi037 ceph-mon[69017]: pgmap v2998: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:42.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:41 smithi033 ceph-mon[101165]: pgmap v2999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:42.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:41 smithi037 ceph-mon[69017]: pgmap v2999: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:44.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:43 smithi033 ceph-mon[101165]: pgmap v3000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:44.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:43 smithi037 ceph-mon[69017]: pgmap v3000: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:46.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:45 smithi033 ceph-mon[101165]: pgmap v3001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:46.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:45 smithi037 ceph-mon[69017]: pgmap v3001: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:48.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:47 smithi033 ceph-mon[101165]: pgmap v3002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:48.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:47 smithi037 ceph-mon[69017]: pgmap v3002: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:50.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:49 smithi033 ceph-mon[101165]: pgmap v3003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:50.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:49 smithi037 ceph-mon[69017]: pgmap v3003: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:52.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:51 smithi033 ceph-mon[101165]: pgmap v3004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:52.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:51 smithi037 ceph-mon[69017]: pgmap v3004: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:54.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:53 smithi033 ceph-mon[101165]: pgmap v3005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:54.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:53 smithi037 ceph-mon[69017]: pgmap v3005: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:55.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:18:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:18:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:18:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:18:56.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:55 smithi033 ceph-mon[101165]: pgmap v3006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:56.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:55 smithi037 ceph-mon[69017]: pgmap v3006: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:58.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:57 smithi033 ceph-mon[101165]: pgmap v3007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:18:58.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:57 smithi037 ceph-mon[69017]: pgmap v3007: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:00.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:18:59 smithi033 ceph-mon[101165]: pgmap v3008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:00.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:18:59 smithi037 ceph-mon[69017]: pgmap v3008: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 -- 172.21.15.33:0/751579343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 msgr2=0x7ff3d00f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 --2- 172.21.15.33:0/751579343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d00f59e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7ff3c4004660 tx=0x7ff3c4009b30).stop 2022-02-02T15:19:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 -- 172.21.15.33:0/751579343 shutdown_connections 2022-02-02T15:19:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 --2- 172.21.15.33:0/751579343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 0x7ff3d00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 --2- 172.21.15.33:0/751579343 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d00f59e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 -- 172.21.15.33:0/751579343 >> 172.21.15.33:0/751579343 conn(0x7ff3d00f0d40 msgr2=0x7ff3d00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 -- 172.21.15.33:0/751579343 shutdown_connections 2022-02-02T15:19:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.070+0000 7ff3d7164700 1 -- 172.21.15.33:0/751579343 wait complete. 2022-02-02T15:19:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 Processor -- start 2022-02-02T15:19:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 -- start start 2022-02-02T15:19:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.064 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 0x7ff3d01095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0109b90 con 0x7ff3d00f55c0 2022-02-02T15:19:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d7164700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d0109cd0 con 0x7ff3d00f6860 2022-02-02T15:19:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d4f00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d4f00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36946/0 (socket says 172.21.15.33:36946) 2022-02-02T15:19:01.065 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3d4f00700 1 -- 172.21.15.33:0/4009440171 learned_addr learned my addr 172.21.15.33:0/4009440171 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.071+0000 7ff3cffff700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 0x7ff3d01095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d4f00700 1 -- 172.21.15.33:0/4009440171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 msgr2=0x7ff3d01095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d4f00700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 0x7ff3d01095e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.066 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d4f00700 1 -- 172.21.15.33:0/4009440171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4005040 con 0x7ff3d00f55c0 2022-02-02T15:19:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d4f00700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff3c4000c00 tx=0x7ff3c4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3c4018070 con 0x7ff3d00f55c0 2022-02-02T15:19:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3c4007cf0 con 0x7ff3d00f55c0 2022-02-02T15:19:01.067 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d010a610 con 0x7ff3d00f55c0 2022-02-02T15:19:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3c401c3c0 con 0x7ff3d00f55c0 2022-02-02T15:19:01.068 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.072+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d010ab70 con 0x7ff3d00f55c0 2022-02-02T15:19:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.073+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d0045ad0 con 0x7ff3d00f55c0 2022-02-02T15:19:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.073+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff3c401d420 con 0x7ff3d00f55c0 2022-02-02T15:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.074+0000 7ff3cd7fa700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 0x7ff3c0067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.074+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff3c4083940 con 0x7ff3d00f55c0 2022-02-02T15:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.074+0000 7ff3cffff700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 0x7ff3c0067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.074+0000 7ff3cffff700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 0x7ff3c0067270 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ff3bc0041d0 tx=0x7ff3bc009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.071 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.078+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff3c4055420 con 0x7ff3d00f55c0 2022-02-02T15:19:01.254 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.265+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3d00faaa0 con 0x7ff3c0064db0 2022-02-02T15:19:01.255 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.266+0000 7ff3cd7fa700 1 -- 172.21.15.33:0/4009440171 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff3d00faaa0 con 0x7ff3c0064db0 2022-02-02T15:19:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 msgr2=0x7ff3c0067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 0x7ff3c0067270 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7ff3bc0041d0 tx=0x7ff3bc009040).stop 2022-02-02T15:19:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 msgr2=0x7ff3d01090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7ff3c4000c00 tx=0x7ff3c4009b30).stop 2022-02-02T15:19:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 shutdown_connections 2022-02-02T15:19:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff3c0064db0 0x7ff3c0067270 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3d00f55c0 0x7ff3d01090f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 --2- 172.21.15.33:0/4009440171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3d00f6860 0x7ff3d01095e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 >> 172.21.15.33:0/4009440171 conn(0x7ff3d00f0d40 msgr2=0x7ff3d005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 shutdown_connections 2022-02-02T15:19:01.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.268+0000 7ff3d7164700 1 -- 172.21.15.33:0/4009440171 wait complete. 2022-02-02T15:19:01.267 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:19:01.360 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 -- 172.21.15.33:0/984852046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 msgr2=0x7f75dc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 --2- 172.21.15.33:0/984852046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc0f59e0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7f75cc0099e0 tx=0x7f75cc004d10).stop 2022-02-02T15:19:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 -- 172.21.15.33:0/984852046 shutdown_connections 2022-02-02T15:19:01.361 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 --2- 172.21.15.33:0/984852046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 0x7f75dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 --2- 172.21.15.33:0/984852046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc0f59e0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.362 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 -- 172.21.15.33:0/984852046 >> 172.21.15.33:0/984852046 conn(0x7f75dc0f0d40 msgr2=0x7f75dc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 -- 172.21.15.33:0/984852046 shutdown_connections 2022-02-02T15:19:01.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.369+0000 7f75e41b0700 1 -- 172.21.15.33:0/984852046 wait complete. 2022-02-02T15:19:01.363 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 Processor -- start 2022-02-02T15:19:01.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 -- start start 2022-02-02T15:19:01.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.364 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 0x7f75dc10c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc060420 con 0x7f75dc0f55c0 2022-02-02T15:19:01.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e41b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc060560 con 0x7f75dc0f6860 2022-02-02T15:19:01.365 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e1f4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e1f4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36956/0 (socket says 172.21.15.33:36956) 2022-02-02T15:19:01.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e1f4c700 1 -- 172.21.15.33:0/3767204027 learned_addr learned my addr 172.21.15.33:0/3767204027 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.370+0000 7f75e174b700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 0x7f75dc10c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e1f4c700 1 -- 172.21.15.33:0/3767204027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 msgr2=0x7f75dc10c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e1f4c700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 0x7f75dc10c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e1f4c700 1 -- 172.21.15.33:0/3767204027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75cc009640 con 0x7f75dc0f55c0 2022-02-02T15:19:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e1f4c700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f75cc00baa0 tx=0x7f75cc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75cc00e070 con 0x7f75dc0f55c0 2022-02-02T15:19:01.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f75cc007d40 con 0x7f75dc0f55c0 2022-02-02T15:19:01.369 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc10c7d0 con 0x7f75dc0f55c0 2022-02-02T15:19:01.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75cc018070 con 0x7f75dc0f55c0 2022-02-02T15:19:01.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.371+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc10cd00 con 0x7f75dc0f55c0 2022-02-02T15:19:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.373+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc0f49b0 con 0x7f75dc0f55c0 2022-02-02T15:19:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.373+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f75cc024060 con 0x7f75dc0f55c0 2022-02-02T15:19:01.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.373+0000 7f75da7fc700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 0x7f75c4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.373+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f75cc083190 con 0x7f75dc0f55c0 2022-02-02T15:19:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.373+0000 7f75e174b700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 0x7f75c4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.374+0000 7f75e174b700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 0x7f75c4067290 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f75d0009fd0 tx=0x7f75d000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.377+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f75cc051240 con 0x7f75dc0f55c0 2022-02-02T15:19:01.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.561+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75dc0fdf00 con 0x7f75c4064dd0 2022-02-02T15:19:01.565 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.575+0000 7f75da7fc700 1 -- 172.21.15.33:0/3767204027 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f75dc0fdf00 con 0x7f75c4064dd0 2022-02-02T15:19:01.565 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:19:01.565 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (104m) 66m ago 105m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:19:01.565 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (97m) 66m ago 105m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:19:01.566 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (97m) 66m ago 104m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:19:01.566 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (104m) 66m ago 105m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:19:01.566 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (97m) 66m ago 101m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:19:01.566 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (98m) 66m ago 101m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:19:01.567 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (99m) 66m ago 101m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:19:01.567 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (101m) 66m ago 101m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:19:01.567 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (98m) 66m ago 106m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:19:01.567 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (98m) 66m ago 104m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:19:01.567 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (98m) 66m ago 106m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:19:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (97m) 66m ago 104m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:19:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (105m) 66m ago 105m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:19:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (104m) 66m ago 104m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:19:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 66m ago 104m - 4096M 2022-02-02T15:19:01.568 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (103m) 66m ago 103m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:19:01.569 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (103m) 66m ago 103m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:19:01.569 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (103m) 66m ago 103m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:19:01.569 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (102m) 66m ago 102m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:19:01.569 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (102m) 66m ago 102m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:19:01.570 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (104m) 66m ago 104m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:19:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 msgr2=0x7f75c4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 0x7f75c4067290 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f75d0009fd0 tx=0x7f75d000b040).stop 2022-02-02T15:19:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 msgr2=0x7f75dc109d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f75cc00baa0 tx=0x7f75cc004d10).stop 2022-02-02T15:19:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 shutdown_connections 2022-02-02T15:19:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f75c4064dd0 0x7f75c4067290 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75dc0f55c0 0x7f75dc109d20 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 --2- 172.21.15.33:0/3767204027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75dc0f6860 0x7f75dc10c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.577+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 >> 172.21.15.33:0/3767204027 conn(0x7f75dc0f0d40 msgr2=0x7f75dc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.578+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 shutdown_connections 2022-02-02T15:19:01.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.578+0000 7f75e41b0700 1 -- 172.21.15.33:0/3767204027 wait complete. 2022-02-02T15:19:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 -- 172.21.15.33:0/3209471993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 msgr2=0x7fcb200f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/3209471993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb200f6b00 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7fcb10004660 tx=0x7fcb10009b30).stop 2022-02-02T15:19:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 -- 172.21.15.33:0/3209471993 shutdown_connections 2022-02-02T15:19:01.667 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/3209471993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 0x7fcb200f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/3209471993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb200f6b00 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 -- 172.21.15.33:0/3209471993 >> 172.21.15.33:0/3209471993 conn(0x7fcb200f1e40 msgr2=0x7fcb200f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.677+0000 7fcb25fbe700 1 -- 172.21.15.33:0/3209471993 shutdown_connections 2022-02-02T15:19:01.668 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.678+0000 7fcb25fbe700 1 -- 172.21.15.33:0/3209471993 wait complete. 2022-02-02T15:19:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.678+0000 7fcb25fbe700 1 Processor -- start 2022-02-02T15:19:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.678+0000 7fcb25fbe700 1 -- start start 2022-02-02T15:19:01.670 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb25fbe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb25fbe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 0x7fcb20107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb25fbe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20107a10 con 0x7fcb200f66e0 2022-02-02T15:19:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb25fbe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20107b50 con 0x7fcb200f7980 2022-02-02T15:19:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36966/0 (socket says 172.21.15.33:36966) 2022-02-02T15:19:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 -- 172.21.15.33:0/2795718451 learned_addr learned my addr 172.21.15.33:0/2795718451 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1effd700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 0x7fcb20107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 -- 172.21.15.33:0/2795718451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 msgr2=0x7fcb20107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 0x7fcb20107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 -- 172.21.15.33:0/2795718451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10005040 con 0x7fcb200f66e0 2022-02-02T15:19:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.679+0000 7fcb1f7fe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fcb10013a70 tx=0x7fcb10009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.680+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb10018070 con 0x7fcb200f66e0 2022-02-02T15:19:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.680+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb20108490 con 0x7fcb200f66e0 2022-02-02T15:19:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.680+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fcb100097d0 con 0x7fcb200f66e0 2022-02-02T15:19:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.680+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb1001de80 con 0x7fcb200f66e0 2022-02-02T15:19:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.680+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb201089f0 con 0x7fcb200f66e0 2022-02-02T15:19:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.681+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb20045ad0 con 0x7fcb200f66e0 2022-02-02T15:19:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.681+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fcb10007ba0 con 0x7fcb200f66e0 2022-02-02T15:19:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.682+0000 7fcb07fff700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 0x7fcb08067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:01.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.682+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fcb100836b0 con 0x7fcb200f66e0 2022-02-02T15:19:01.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.682+0000 7fcb1effd700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 0x7fcb08067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:01.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.682+0000 7fcb1effd700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 0x7fcb08067290 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fcb14004c40 tx=0x7fcb1400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:01.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.686+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fcb10055190 con 0x7fcb200f66e0 2022-02-02T15:19:01.924 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.935+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb200fef40 con 0x7fcb200f66e0 2022-02-02T15:19:01.925 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.935+0000 7fcb07fff700 1 -- 172.21.15.33:0/2795718451 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fcb10054d80 con 0x7fcb200f66e0 2022-02-02T15:19:01.925 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:19:01.925 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:19:01.925 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:19:01.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:01.926 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:19:01.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:19:01.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:01.927 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:19:01.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:19:01.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:01.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:19:01.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:19:01.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:01.928 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:19:01.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:19:01.929 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:19:01.929 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:19:01.929 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:19:01.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 msgr2=0x7fcb08067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 0x7fcb08067290 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fcb14004c40 tx=0x7fcb1400b040).stop 2022-02-02T15:19:01.930 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 msgr2=0x7fcb20106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:01.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fcb10013a70 tx=0x7fcb10009b30).stop 2022-02-02T15:19:01.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 shutdown_connections 2022-02-02T15:19:01.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fcb08064dd0 0x7fcb08067290 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb200f66e0 0x7fcb20106f70 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 --2- 172.21.15.33:0/2795718451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb200f7980 0x7fcb20107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 >> 172.21.15.33:0/2795718451 conn(0x7fcb200f1e40 msgr2=0x7fcb200fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 shutdown_connections 2022-02-02T15:19:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:01.938+0000 7fcb25fbe700 1 -- 172.21.15.33:0/2795718451 wait complete. 2022-02-02T15:19:02.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.039+0000 7fd0d7863700 1 -- 172.21.15.33:0/3229104605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 msgr2=0x7fd0d00f6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:02.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.039+0000 7fd0d7863700 1 --2- 172.21.15.33:0/3229104605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d00f6cd0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fd0c0004660 tx=0x7fd0c0009b30).stop 2022-02-02T15:19:02.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 -- 172.21.15.33:0/3229104605 shutdown_connections 2022-02-02T15:19:02.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 --2- 172.21.15.33:0/3229104605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d00f6cd0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:02.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 --2- 172.21.15.33:0/3229104605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 0x7fd0d00f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T15:19:02.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 -- 172.21.15.33:0/3229104605 >> 172.21.15.33:0/3229104605 conn(0x7fd0d00f0d30 msgr2=0x7fd0d00f3150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:02.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 -- 172.21.15.33:0/3229104605 shutdown_connections 2022-02-02T15:19:02.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 -- 172.21.15.33:0/3229104605 wait complete. 2022-02-02T15:19:02.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.040+0000 7fd0d7863700 1 Processor -- start 2022-02-02T15:19:02.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d7863700 1 -- start start 2022-02-02T15:19:02.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d7863700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 0x7fd0d0109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:02.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d7863700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:02.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d7863700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00605b0 con 0x7fd0d00f6870 2022-02-02T15:19:02.035 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d7863700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d00606f0 con 0x7fd0d00f55d0 2022-02-02T15:19:02.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:02.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36978/0 (socket says 172.21.15.33:36978) 2022-02-02T15:19:02.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 -- 172.21.15.33:0/800593395 learned_addr learned my addr 172.21.15.33:0/800593395 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:02.036 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d55ff700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 0x7fd0d0109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 -- 172.21.15.33:0/800593395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 msgr2=0x7fd0d0109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 0x7fd0d0109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 -- 172.21.15.33:0/800593395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0005040 con 0x7fd0d00f6870 2022-02-02T15:19:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.041+0000 7fd0d4dfe700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fd0c0009990 tx=0x7fd0c0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:02.037 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.042+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c0018070 con 0x7fd0d00f6870 2022-02-02T15:19:02.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.042+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fd0c0007ba0 con 0x7fd0d00f6870 2022-02-02T15:19:02.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.042+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d010c730 con 0x7fd0d00f6870 2022-02-02T15:19:02.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.042+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c001c620 con 0x7fd0d00f6870 2022-02-02T15:19:02.038 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.042+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d010cc90 con 0x7fd0d00f6870 2022-02-02T15:19:02.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.043+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0045ad0 con 0x7fd0d00f6870 2022-02-02T15:19:02.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.043+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fd0c001c8e0 con 0x7fd0d00f6870 2022-02-02T15:19:02.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.044+0000 7fd0c5ffb700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 0x7fd0bc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:02.040 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.044+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fd0c00838a0 con 0x7fd0d00f6870 2022-02-02T15:19:02.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.044+0000 7fd0d55ff700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 0x7fd0bc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:02.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.044+0000 7fd0d55ff700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 0x7fd0bc067290 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fd0d00601a0 tx=0x7fd0cc008040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:02.041 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.048+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fd0c0051950 con 0x7fd0d00f6870 2022-02-02T15:19:02.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:01 smithi033 ceph-mon[101165]: from='client.37154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:02.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:01 smithi033 ceph-mon[101165]: from='client.37158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:02.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:01 smithi033 ceph-mon[101165]: pgmap v3009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:02.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:01 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2795718451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:19:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.258+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd0d0027a00 con 0x7fd0d00f6870 2022-02-02T15:19:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.258+0000 7fd0c5ffb700 1 -- 172.21.15.33:0/800593395 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fd0c0054f70 con 0x7fd0d00f6870 2022-02-02T15:19:02.248 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:19:02.248 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:19:02.249 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:19:02.249 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:19:02.249 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:02.249 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:19:02.250 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:19:02.250 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:19:02.250 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:19:02.250 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:19:02.251 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:19:02.251 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:19:02.251 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:19:02.251 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:19:02.252 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:19:02.252 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:19:02.252 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:19:02.252 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:19:02.253 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:19:02.253 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:19:02.253 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:19:02.253 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:19:02.254 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:19:02.254 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:19:02.254 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:19:02.254 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:19:02.255 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:19:02.255 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:19:02.255 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:19:02.255 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:19:02.255 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:19:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:02.256 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:19:02.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:02.256 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:02.257 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:02.257 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:02.257 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 msgr2=0x7fd0bc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:02.258 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 0x7fd0bc067290 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fd0d00601a0 tx=0x7fd0cc008040).stop 2022-02-02T15:19:02.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 msgr2=0x7fd0d010c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:02.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fd0c0009990 tx=0x7fd0c0009b30).stop 2022-02-02T15:19:02.259 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 shutdown_connections 2022-02-02T15:19:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fd0bc064dd0 0x7fd0bc067290 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0d00f55d0 0x7fd0d0109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 --2- 172.21.15.33:0/800593395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0d00f6870 0x7fd0d010c130 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.260+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 >> 172.21.15.33:0/800593395 conn(0x7fd0d00f0d30 msgr2=0x7fd0d00fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:02.260 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.261+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 shutdown_connections 2022-02-02T15:19:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:02.261+0000 7fd0d7863700 1 -- 172.21.15.33:0/800593395 wait complete. 2022-02-02T15:19:02.261 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:19:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:01 smithi037 ceph-mon[69017]: from='client.37154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:01 smithi037 ceph-mon[69017]: from='client.37158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:01 smithi037 ceph-mon[69017]: pgmap v3009: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:02.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:01 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2795718451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:19:03.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:02 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/800593395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:19:03.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:02 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/800593395' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:19:04.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:03 smithi033 ceph-mon[101165]: pgmap v3010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:04.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:03 smithi037 ceph-mon[69017]: pgmap v3010: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:06.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:05 smithi033 ceph-mon[101165]: pgmap v3011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:06.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:05 smithi037 ceph-mon[69017]: pgmap v3011: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:07 smithi033 ceph-mon[101165]: pgmap v3012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:07 smithi037 ceph-mon[69017]: pgmap v3012: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:10.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:09 smithi033 ceph-mon[101165]: pgmap v3013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:10.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:09 smithi037 ceph-mon[69017]: pgmap v3013: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:12.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:11 smithi033 ceph-mon[101165]: pgmap v3014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:12.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:11 smithi037 ceph-mon[69017]: pgmap v3014: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:14.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:13 smithi033 ceph-mon[101165]: pgmap v3015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:14.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:13 smithi037 ceph-mon[69017]: pgmap v3015: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:16.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:15 smithi033 ceph-mon[101165]: pgmap v3016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:16.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:15 smithi037 ceph-mon[69017]: pgmap v3016: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:18.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:17 smithi033 ceph-mon[101165]: pgmap v3017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:18.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:17 smithi037 ceph-mon[69017]: pgmap v3017: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:20.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:19 smithi033 ceph-mon[101165]: pgmap v3018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:20.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:19 smithi037 ceph-mon[69017]: pgmap v3018: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:22.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:21 smithi033 ceph-mon[101165]: pgmap v3019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:22.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:21 smithi037 ceph-mon[69017]: pgmap v3019: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:24.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:23 smithi033 ceph-mon[101165]: pgmap v3020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:24.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:23 smithi037 ceph-mon[69017]: pgmap v3020: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:26.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:25 smithi033 ceph-mon[101165]: pgmap v3021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:26.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:25 smithi037 ceph-mon[69017]: pgmap v3021: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:28.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:27 smithi033 ceph-mon[101165]: pgmap v3022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:28.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:27 smithi037 ceph-mon[69017]: pgmap v3022: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:30.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:29 smithi033 ceph-mon[101165]: pgmap v3023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:29 smithi037 ceph-mon[69017]: pgmap v3023: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:32.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:31 smithi033 ceph-mon[101165]: pgmap v3024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:32.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:31 smithi037 ceph-mon[69017]: pgmap v3024: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:32.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 -- 172.21.15.33:0/691710542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f6860 msgr2=0x7f2f6c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.366 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 --2- 172.21.15.33:0/691710542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f6cc0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f2f58004660 tx=0x7f2f58009b30).stop 2022-02-02T15:19:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 -- 172.21.15.33:0/691710542 shutdown_connections 2022-02-02T15:19:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 --2- 172.21.15.33:0/691710542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f6cc0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 --2- 172.21.15.33:0/691710542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.367 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 -- 172.21.15.33:0/691710542 >> 172.21.15.33:0/691710542 conn(0x7f2f6c0f0d40 msgr2=0x7f2f6c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.375+0000 7f2f731c3700 1 -- 172.21.15.33:0/691710542 shutdown_connections 2022-02-02T15:19:32.368 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.376+0000 7f2f731c3700 1 -- 172.21.15.33:0/691710542 wait complete. 2022-02-02T15:19:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 Processor -- start 2022-02-02T15:19:32.370 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 -- start start 2022-02-02T15:19:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0f8100 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.371 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f731c3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0f8240 con 0x7f2f6c0f6860 2022-02-02T15:19:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f70f5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f70f5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36986/0 (socket says 172.21.15.33:36986) 2022-02-02T15:19:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f70f5f700 1 -- 172.21.15.33:0/950047670 learned_addr learned my addr 172.21.15.33:0/950047670 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.377+0000 7f2f6bfff700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.372 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f70f5f700 1 -- 172.21.15.33:0/950047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f6860 msgr2=0x7f2f6c0f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f70f5f700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f70f5f700 1 -- 172.21.15.33:0/950047670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58005040 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f70f5f700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2f6000c530 tx=0x7f2f60007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.373 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f6000f650 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0f8520 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2f6000fc60 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f60012cb0 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.374 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.378+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c10efa0 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.379+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c045ad0 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.380+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2f60019030 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.375 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.380+0000 7f2f697fa700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 0x7f2f5c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.380+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2f60081dd0 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.381+0000 7f2f6bfff700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 0x7f2f5c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.376 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.381+0000 7f2f6bfff700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 0x7f2f5c067290 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f2f58004630 tx=0x7f2f58009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.384+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2f6004fff0 con 0x7f2f6c0f55c0 2022-02-02T15:19:32.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.577+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f6c0faca0 con 0x7f2f5c064dd0 2022-02-02T15:19:32.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.578+0000 7f2f697fa700 1 -- 172.21.15.33:0/950047670 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f2f6c0faca0 con 0x7f2f5c064dd0 2022-02-02T15:19:32.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 msgr2=0x7f2f5c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 0x7f2f5c067290 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f2f58004630 tx=0x7f2f58009b30).stop 2022-02-02T15:19:32.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 msgr2=0x7f2f6c0f9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f2f6000c530 tx=0x7f2f60007e10).stop 2022-02-02T15:19:32.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 shutdown_connections 2022-02-02T15:19:32.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2f5c064dd0 0x7f2f5c067290 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f6c0f55c0 0x7f2f6c0f9720 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.580+0000 7f2f731c3700 1 --2- 172.21.15.33:0/950047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f6c0f6860 0x7f2f6c0f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.581+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 >> 172.21.15.33:0/950047670 conn(0x7f2f6c0f0d40 msgr2=0x7f2f6c05fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.581+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 shutdown_connections 2022-02-02T15:19:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.581+0000 7f2f731c3700 1 -- 172.21.15.33:0/950047670 wait complete. 2022-02-02T15:19:32.581 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:19:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 -- 172.21.15.33:0/4185329897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 msgr2=0x7f8ba00f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/4185329897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba00f7c30 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 rx=0x7f8b8c004660 tx=0x7f8b8c009b30).stop 2022-02-02T15:19:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 -- 172.21.15.33:0/4185329897 shutdown_connections 2022-02-02T15:19:32.672 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/4185329897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba00f7c30 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/4185329897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba00f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 -- 172.21.15.33:0/4185329897 >> 172.21.15.33:0/4185329897 conn(0x7f8ba00f1c90 msgr2=0x7f8ba00f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.681+0000 7f8ba5d02700 1 -- 172.21.15.33:0/4185329897 shutdown_connections 2022-02-02T15:19:32.673 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.682+0000 7f8ba5d02700 1 -- 172.21.15.33:0/4185329897 wait complete. 2022-02-02T15:19:32.675 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.682+0000 7f8ba5d02700 1 Processor -- start 2022-02-02T15:19:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.682+0000 7f8ba5d02700 1 -- start start 2022-02-02T15:19:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba5d02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba0106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba5d02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.676 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba5d02700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0107830 con 0x7f8ba00f77d0 2022-02-02T15:19:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba5d02700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba0108040 con 0x7f8ba00f6530 2022-02-02T15:19:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36998/0 (socket says 172.21.15.33:36998) 2022-02-02T15:19:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 -- 172.21.15.33:0/7584248 learned_addr learned my addr 172.21.15.33:0/7584248 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:32.677 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba4d00700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba0106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 -- 172.21.15.33:0/7584248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 msgr2=0x7f8ba0106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba0106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 -- 172.21.15.33:0/7584248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c005040 con 0x7f8ba00f77d0 2022-02-02T15:19:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8ba4d00700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba0106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:19:32.678 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.683+0000 7f8b9ffff700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f8b8c000c00 tx=0x7f8b8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.684+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8c019070 con 0x7f8ba00f77d0 2022-02-02T15:19:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.684+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8b8c007e70 con 0x7f8ba00f77d0 2022-02-02T15:19:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.684+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba0108260 con 0x7f8ba00f77d0 2022-02-02T15:19:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.684+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b8c014d90 con 0x7f8ba00f77d0 2022-02-02T15:19:32.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.684+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba01087c0 con 0x7f8ba00f77d0 2022-02-02T15:19:32.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.685+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba0059100 con 0x7f8ba00f77d0 2022-02-02T15:19:32.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.685+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8b8c025070 con 0x7f8ba00f77d0 2022-02-02T15:19:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.686+0000 7f8b9d7fa700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 0x7f8b900672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.686+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8b8c0829c0 con 0x7f8ba00f77d0 2022-02-02T15:19:32.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.686+0000 7f8ba4d00700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 0x7f8b900672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.687+0000 7f8ba4d00700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 0x7f8b900672e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f8ba0106ab0 tx=0x7f8b9400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.690+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8b8c050a10 con 0x7f8ba00f77d0 2022-02-02T15:19:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.873+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ba00fee80 con 0x7f8b90064e20 2022-02-02T15:19:32.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.888+0000 7f8b9d7fa700 1 -- 172.21.15.33:0/7584248 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f8ba00fee80 con 0x7f8b90064e20 2022-02-02T15:19:32.878 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:19:32.879 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (104m) 66m ago 105m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:19:32.879 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (97m) 66m ago 105m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:19:32.879 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (97m) 66m ago 105m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:19:32.879 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (104m) 66m ago 105m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:19:32.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (98m) 66m ago 102m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:19:32.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (98m) 66m ago 101m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:19:32.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (99m) 66m ago 102m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:19:32.880 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (102m) 66m ago 102m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:19:32.880 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (99m) 66m ago 107m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:19:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (99m) 66m ago 105m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:19:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (98m) 66m ago 107m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:19:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (98m) 66m ago 105m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:19:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (105m) 66m ago 105m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:19:32.881 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (105m) 66m ago 105m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:19:32.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 66m ago 104m - 4096M 2022-02-02T15:19:32.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (104m) 66m ago 104m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:19:32.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (103m) 66m ago 103m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:19:32.882 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (103m) 66m ago 103m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:19:32.883 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (103m) 66m ago 103m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:19:32.883 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (103m) 66m ago 103m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:19:32.883 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (104m) 66m ago 105m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:19:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 msgr2=0x7f8b900672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 0x7f8b900672e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f8ba0106ab0 tx=0x7f8b9400b040).stop 2022-02-02T15:19:32.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 msgr2=0x7f8ba0107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f8b8c000c00 tx=0x7f8b8c00b040).stop 2022-02-02T15:19:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 shutdown_connections 2022-02-02T15:19:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8b90064e20 0x7f8b900672e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ba00f6530 0x7f8ba0106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 --2- 172.21.15.33:0/7584248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ba00f77d0 0x7f8ba0107230 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 >> 172.21.15.33:0/7584248 conn(0x7f8ba00f1c90 msgr2=0x7f8ba00fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 shutdown_connections 2022-02-02T15:19:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.890+0000 7f8ba5d02700 1 -- 172.21.15.33:0/7584248 wait complete. 2022-02-02T15:19:32.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 -- 172.21.15.33:0/1573760782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f55c0 msgr2=0x7f05bc0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 --2- 172.21.15.33:0/1573760782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f55c0 0x7f05bc0f59e0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f05ac004660 tx=0x7f05ac009b30).stop 2022-02-02T15:19:32.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 -- 172.21.15.33:0/1573760782 shutdown_connections 2022-02-02T15:19:32.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 --2- 172.21.15.33:0/1573760782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f6860 0x7f05bc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 --2- 172.21.15.33:0/1573760782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f55c0 0x7f05bc0f59e0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 -- 172.21.15.33:0/1573760782 >> 172.21.15.33:0/1573760782 conn(0x7f05bc0f0d40 msgr2=0x7f05bc0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:32.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.990+0000 7f05c09c2700 1 -- 172.21.15.33:0/1573760782 shutdown_connections 2022-02-02T15:19:32.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 -- 172.21.15.33:0/1573760782 wait complete. 2022-02-02T15:19:32.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 Processor -- start 2022-02-02T15:19:32.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 -- start start 2022-02-02T15:19:32.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f55c0 0x7f05bc109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc060420 con 0x7f05bc0f6860 2022-02-02T15:19:32.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05c09c2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05bc060560 con 0x7f05bc0f55c0 2022-02-02T15:19:32.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37008/0 (socket says 172.21.15.33:37008) 2022-02-02T15:19:32.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.991+0000 7f05b9d9b700 1 -- 172.21.15.33:0/493506362 learned_addr learned my addr 172.21.15.33:0/493506362 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:32.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05ba59c700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f55c0 0x7f05bc109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05b9d9b700 1 -- 172.21.15.33:0/493506362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f55c0 msgr2=0x7f05bc109c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:32.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05b9d9b700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f55c0 0x7f05bc109c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:32.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05b9d9b700 1 -- 172.21.15.33:0/493506362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac005040 con 0x7f05bc0f6860 2022-02-02T15:19:32.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05b9d9b700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f05b00026d0 tx=0x7f05b0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b0009320 con 0x7f05bc0f6860 2022-02-02T15:19:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f05b000f040 con 0x7f05bc0f6860 2022-02-02T15:19:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05bc10c740 con 0x7f05bc0f6860 2022-02-02T15:19:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f05b00147e0 con 0x7f05bc0f6860 2022-02-02T15:19:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.992+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05bc10ccd0 con 0x7f05bc0f6860 2022-02-02T15:19:32.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.993+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05bc0f49b0 con 0x7f05bc0f6860 2022-02-02T15:19:32.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.993+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f05b0009480 con 0x7f05bc0f6860 2022-02-02T15:19:32.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.994+0000 7f05aaffd700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 0x7f05a4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:32.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.994+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f05b0082170 con 0x7f05bc0f6860 2022-02-02T15:19:32.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.994+0000 7f05ba59c700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 0x7f05a4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:32.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.994+0000 7f05ba59c700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 0x7f05a4067290 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f05ac004e30 tx=0x7f05ac009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:32.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:32.998+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f05b0050220 con 0x7f05bc0f6860 2022-02-02T15:19:33.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:32 smithi033 ceph-mon[101165]: from='client.37170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:33.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:32 smithi033 ceph-mon[101165]: from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:33.231 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.241+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f05bc045ad0 con 0x7f05bc0f6860 2022-02-02T15:19:33.232 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.242+0000 7f05aaffd700 1 -- 172.21.15.33:0/493506362 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f05b0053840 con 0x7f05bc0f6860 2022-02-02T15:19:33.232 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:19:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:19:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:19:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:33.233 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:19:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:19:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:19:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:19:33.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:19:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:19:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:19:33.235 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:19:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:19:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:19:33.236 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:19:33.236 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:19:33.237 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 msgr2=0x7f05a4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 0x7f05a4067290 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f05ac004e30 tx=0x7f05ac009b30).stop 2022-02-02T15:19:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 msgr2=0x7f05bc10c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 rx=0x7f05b00026d0 tx=0x7f05b0009de0).stop 2022-02-02T15:19:33.238 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 shutdown_connections 2022-02-02T15:19:33.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f05a4064dd0 0x7f05a4067290 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05bc0f55c0 0x7f05bc109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 --2- 172.21.15.33:0/493506362 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05bc0f6860 0x7f05bc10c130 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.239 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 >> 172.21.15.33:0/493506362 conn(0x7f05bc0f0d40 msgr2=0x7f05bc0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:33.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 shutdown_connections 2022-02-02T15:19:33.240 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.244+0000 7f05c09c2700 1 -- 172.21.15.33:0/493506362 wait complete. 2022-02-02T15:19:33.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:32 smithi037 ceph-mon[69017]: from='client.37170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:33.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:32 smithi037 ceph-mon[69017]: from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:19:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 -- 172.21.15.33:0/1919956354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f55c0 msgr2=0x7fdbf40f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 --2- 172.21.15.33:0/1919956354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f55c0 0x7fdbf40f59e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fdbe8004660 tx=0x7fdbe8009b30).stop 2022-02-02T15:19:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 -- 172.21.15.33:0/1919956354 shutdown_connections 2022-02-02T15:19:33.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 --2- 172.21.15.33:0/1919956354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f6860 0x7fdbf40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 --2- 172.21.15.33:0/1919956354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f55c0 0x7fdbf40f59e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 -- 172.21.15.33:0/1919956354 >> 172.21.15.33:0/1919956354 conn(0x7fdbf40f0d40 msgr2=0x7fdbf40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:33.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 -- 172.21.15.33:0/1919956354 shutdown_connections 2022-02-02T15:19:33.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.345+0000 7fdbfae99700 1 -- 172.21.15.33:0/1919956354 wait complete. 2022-02-02T15:19:33.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 Processor -- start 2022-02-02T15:19:33.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 -- start start 2022-02-02T15:19:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f55c0 0x7fdbf4105e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4106910 con 0x7fdbf40f6860 2022-02-02T15:19:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbfae99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf4106a50 con 0x7fdbf40f55c0 2022-02-02T15:19:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37018/0 (socket says 172.21.15.33:37018) 2022-02-02T15:19:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 -- 172.21.15.33:0/4098511305 learned_addr learned my addr 172.21.15.33:0/4098511305 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:19:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf8c35700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f55c0 0x7fdbf4105e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 -- 172.21.15.33:0/4098511305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f55c0 msgr2=0x7fdbf4105e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f55c0 0x7fdbf4105e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.346+0000 7fdbf3fff700 1 -- 172.21.15.33:0/4098511305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8005040 con 0x7fdbf40f6860 2022-02-02T15:19:33.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbf3fff700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fdbe00026d0 tx=0x7fdbe0009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:33.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe00079c0 con 0x7fdbf40f6860 2022-02-02T15:19:33.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf41073f0 con 0x7fdbf40f6860 2022-02-02T15:19:33.343 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fdbe000f040 con 0x7fdbf40f6860 2022-02-02T15:19:33.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe00148b0 con 0x7fdbf40f6860 2022-02-02T15:19:33.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.347+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf41079b0 con 0x7fdbf40f6860 2022-02-02T15:19:33.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.348+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4045ad0 con 0x7fdbf40f6860 2022-02-02T15:19:33.344 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.348+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fdbe0007b20 con 0x7fdbf40f6860 2022-02-02T15:19:33.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.349+0000 7fdbf17fa700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 0x7fdbe4067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:19:33.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.349+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fdbe0081a30 con 0x7fdbf40f6860 2022-02-02T15:19:33.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.349+0000 7fdbf8c35700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 0x7fdbe4067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:19:33.345 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.349+0000 7fdbf8c35700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 0x7fdbe4067290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fdbe8004630 tx=0x7fdbe8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:19:33.346 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.353+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fdbe0053510 con 0x7fdbf40f6860 2022-02-02T15:19:33.561 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.571+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdbf4108050 con 0x7fdbf40f6860 2022-02-02T15:19:33.562 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.571+0000 7fdbf17fa700 1 -- 172.21.15.33:0/4098511305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fdbe0053100 con 0x7fdbf40f6860 2022-02-02T15:19:33.562 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:19:33.562 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:19:33.563 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:19:33.563 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:19:33.563 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:33.563 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:19:33.564 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:19:33.564 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:19:33.564 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:19:33.564 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:19:33.565 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:19:33.565 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:19:33.565 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:19:33.565 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:19:33.565 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:19:33.566 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:19:33.566 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:19:33.566 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:19:33.566 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:19:33.567 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:19:33.567 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:19:33.567 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:19:33.567 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:19:33.567 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:19:33.568 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:19:33.568 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:19:33.568 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:19:33.568 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:19:33.569 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:19:33.569 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:19:33.569 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:19:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:33.569 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:33.570 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:19:33.570 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:19:33.570 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:33.570 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:33.571 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:33.571 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:19:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 msgr2=0x7fdbe4067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 0x7fdbe4067290 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fdbe8004630 tx=0x7fdbe8009b30).stop 2022-02-02T15:19:33.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 msgr2=0x7fdbf4106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:19:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 rx=0x7fdbe00026d0 tx=0x7fdbe0009de0).stop 2022-02-02T15:19:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 shutdown_connections 2022-02-02T15:19:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fdbe4064dd0 0x7fdbe4067290 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbf40f55c0 0x7fdbf4105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 --2- 172.21.15.33:0/4098511305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbf40f6860 0x7fdbf4106360 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:19:33.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 >> 172.21.15.33:0/4098511305 conn(0x7fdbf40f0d40 msgr2=0x7fdbf40fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:19:33.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 shutdown_connections 2022-02-02T15:19:33.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:19:33.574+0000 7fdbfae99700 1 -- 172.21.15.33:0/4098511305 wait complete. 2022-02-02T15:19:33.574 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:19:34.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/493506362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:19:34.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:33 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4098511305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:19:34.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:33 smithi033 ceph-mon[101165]: pgmap v3025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/493506362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:19:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:33 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4098511305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:19:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:33 smithi037 ceph-mon[69017]: pgmap v3025: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:36.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:35 smithi033 ceph-mon[101165]: pgmap v3026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:36.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:35 smithi037 ceph-mon[69017]: pgmap v3026: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:38.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:37 smithi033 ceph-mon[101165]: pgmap v3027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:38.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:37 smithi037 ceph-mon[69017]: pgmap v3027: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:40.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:39 smithi033 ceph-mon[101165]: pgmap v3028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:40.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:39 smithi037 ceph-mon[69017]: pgmap v3028: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:42.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:41 smithi033 ceph-mon[101165]: pgmap v3029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:42.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:41 smithi037 ceph-mon[69017]: pgmap v3029: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:44.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:43 smithi033 ceph-mon[101165]: pgmap v3030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:44.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:43 smithi037 ceph-mon[69017]: pgmap v3030: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:46.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:45 smithi033 ceph-mon[101165]: pgmap v3031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:46.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:45 smithi037 ceph-mon[69017]: pgmap v3031: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:48.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:47 smithi033 ceph-mon[101165]: pgmap v3032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:48.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:47 smithi037 ceph-mon[69017]: pgmap v3032: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:50.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:49 smithi033 ceph-mon[101165]: pgmap v3033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:50.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:49 smithi037 ceph-mon[69017]: pgmap v3033: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:52.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:51 smithi033 ceph-mon[101165]: pgmap v3034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:52.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:51 smithi037 ceph-mon[69017]: pgmap v3034: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:54.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:53 smithi033 ceph-mon[101165]: pgmap v3035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:54.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:53 smithi037 ceph-mon[69017]: pgmap v3035: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:55.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:19:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:19:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:19:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:19:56.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:55 smithi033 ceph-mon[101165]: pgmap v3036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:56.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:55 smithi037 ceph-mon[69017]: pgmap v3036: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:58.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:57 smithi033 ceph-mon[101165]: pgmap v3037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:19:58.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:57 smithi037 ceph-mon[69017]: pgmap v3037: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:00.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:19:59 smithi033 ceph-mon[101165]: pgmap v3038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:00.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:00 smithi033 conmon[101141]: 2022-02-02T15:19:59.999+0000 7f5ea85ef700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:20:00.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:19:59 smithi037 ceph-mon[69017]: pgmap v3038: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:01.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:00 smithi033 ceph-mon[101165]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:20:01.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:00 smithi037 ceph-mon[69017]: overall HEALTH_ERR 1 failed cephadm daemon(s); 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem has a failed mds daemon; 1 filesystem is offline; 4 daemons have recently crashed; Upgrading daemon osd.0 on host smithi033 failed. 2022-02-02T15:20:02.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:01 smithi033 ceph-mon[101165]: pgmap v3039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:01 smithi037 ceph-mon[69017]: pgmap v3039: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:03.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 -- 172.21.15.33:0/520809375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 msgr2=0x7fa6580f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 --2- 172.21.15.33:0/520809375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f4dc0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7fa648004660 tx=0x7fa648009b30).stop 2022-02-02T15:20:03.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 -- 172.21.15.33:0/520809375 shutdown_connections 2022-02-02T15:20:03.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 --2- 172.21.15.33:0/520809375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 --2- 172.21.15.33:0/520809375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f4dc0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.690+0000 7fa65da90700 1 -- 172.21.15.33:0/520809375 >> 172.21.15.33:0/520809375 conn(0x7fa6580f04c0 msgr2=0x7fa6580f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:03.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.691+0000 7fa65da90700 1 -- 172.21.15.33:0/520809375 shutdown_connections 2022-02-02T15:20:03.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.691+0000 7fa65da90700 1 -- 172.21.15.33:0/520809375 wait complete. 2022-02-02T15:20:03.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.691+0000 7fa65da90700 1 Processor -- start 2022-02-02T15:20:03.684 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.691+0000 7fa65da90700 1 -- start start 2022-02-02T15:20:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa65da90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa65da90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.685 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa65da90700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580f5f30 con 0x7fa6580f49a0 2022-02-02T15:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa65da90700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6580f6070 con 0x7fa6580f5340 2022-02-02T15:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37026/0 (socket says 172.21.15.33:37026) 2022-02-02T15:20:03.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 -- 172.21.15.33:0/3958807867 learned_addr learned my addr 172.21.15.33:0/3958807867 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 -- 172.21.15.33:0/3958807867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 msgr2=0x7fa6580f59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa656ffd700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 -- 172.21.15.33:0/3958807867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648005040 con 0x7fa6580f49a0 2022-02-02T15:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa656ffd700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa6577fe700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fa6480043a0 tx=0x7fa648009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.692+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa648018070 con 0x7fa6580f49a0 2022-02-02T15:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.693+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6580f62f0 con 0x7fa6580f49a0 2022-02-02T15:20:03.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.693+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa648007ba0 con 0x7fa6580f49a0 2022-02-02T15:20:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.693+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6580f6850 con 0x7fa6580f49a0 2022-02-02T15:20:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.693+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64801c3c0 con 0x7fa6580f49a0 2022-02-02T15:20:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.694+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa638004fa0 con 0x7fa6580f49a0 2022-02-02T15:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.694+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa64801d420 con 0x7fa6580f49a0 2022-02-02T15:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.695+0000 7fa63ffff700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 0x7fa640067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.695+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa6480836f0 con 0x7fa6580f49a0 2022-02-02T15:20:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.695+0000 7fa656ffd700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 0x7fa640067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.695+0000 7fa656ffd700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 0x7fa640067290 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fa6580f5780 tx=0x7fa64c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.699+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa648051800 con 0x7fa6580f49a0 2022-02-02T15:20:03.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.887+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa638000bc0 con 0x7fa640064dd0 2022-02-02T15:20:03.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.888+0000 7fa63ffff700 1 -- 172.21.15.33:0/3958807867 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fa638000bc0 con 0x7fa640064dd0 2022-02-02T15:20:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 msgr2=0x7fa640067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 0x7fa640067290 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7fa6580f5780 tx=0x7fa64c00b040).stop 2022-02-02T15:20:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 msgr2=0x7fa6580f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fa6480043a0 tx=0x7fa648009b30).stop 2022-02-02T15:20:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 shutdown_connections 2022-02-02T15:20:03.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa640064dd0 0x7fa640067290 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6580f49a0 0x7fa6580f7550 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 --2- 172.21.15.33:0/3958807867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6580f5340 0x7fa6580f59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 >> 172.21.15.33:0/3958807867 conn(0x7fa6580f04c0 msgr2=0x7fa6580fb510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 shutdown_connections 2022-02-02T15:20:03.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.890+0000 7fa65da90700 1 -- 172.21.15.33:0/3958807867 wait complete. 2022-02-02T15:20:03.889 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:20:03.983 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 -- 172.21.15.33:0/98382485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 msgr2=0x7f15200f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 --2- 172.21.15.33:0/98382485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f15200f6cc0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7f1508004660 tx=0x7f1508009b30).stop 2022-02-02T15:20:03.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 -- 172.21.15.33:0/98382485 shutdown_connections 2022-02-02T15:20:03.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 --2- 172.21.15.33:0/98382485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f15200f6cc0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.984 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 --2- 172.21.15.33:0/98382485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 0x7f15200f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 -- 172.21.15.33:0/98382485 >> 172.21.15.33:0/98382485 conn(0x7f15200f0d40 msgr2=0x7f15200f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:03.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 -- 172.21.15.33:0/98382485 shutdown_connections 2022-02-02T15:20:03.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.993+0000 7f15263f7700 1 -- 172.21.15.33:0/98382485 wait complete. 2022-02-02T15:20:03.985 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 Processor -- start 2022-02-02T15:20:03.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 -- start start 2022-02-02T15:20:03.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 0x7f1520105e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.986 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520106920 con 0x7f15200f6860 2022-02-02T15:20:03.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f15263f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520107130 con 0x7f15200f55c0 2022-02-02T15:20:03.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f1517fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f1517fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37038/0 (socket says 172.21.15.33:37038) 2022-02-02T15:20:03.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.994+0000 7f1517fff700 1 -- 172.21.15.33:0/1071049778 learned_addr learned my addr 172.21.15.33:0/1071049778 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:03.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f151ffff700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 0x7f1520105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f1517fff700 1 -- 172.21.15.33:0/1071049778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 msgr2=0x7f1520105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:03.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f1517fff700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 0x7f1520105e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:03.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f1517fff700 1 -- 172.21.15.33:0/1071049778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508005040 con 0x7f15200f6860 2022-02-02T15:20:03.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f1517fff700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f1508000c00 tx=0x7f150800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:03.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1508019070 con 0x7f15200f6860 2022-02-02T15:20:03.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1520107350 con 0x7f15200f6860 2022-02-02T15:20:03.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1508007e70 con 0x7f15200f6860 2022-02-02T15:20:03.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1508014ce0 con 0x7f15200f6860 2022-02-02T15:20:03.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.995+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15201078b0 con 0x7f15200f6860 2022-02-02T15:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.997+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15200f49b0 con 0x7f15200f6860 2022-02-02T15:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.997+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f1508014420 con 0x7f15200f6860 2022-02-02T15:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.997+0000 7f151d7fa700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 0x7f150c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:03.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.997+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1508082950 con 0x7f15200f6860 2022-02-02T15:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.998+0000 7f151ffff700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 0x7f150c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:03.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:03.998+0000 7f151ffff700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 0x7f150c067290 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f1520105ba0 tx=0x7f151000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.002+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f1508050ac0 con 0x7f15200f6860 2022-02-02T15:20:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.183+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15200fdf10 con 0x7f150c064dd0 2022-02-02T15:20:04.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.198+0000 7f151d7fa700 1 -- 172.21.15.33:0/1071049778 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f15200fdf10 con 0x7f150c064dd0 2022-02-02T15:20:04.187 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:20:04.188 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (105m) 67m ago 106m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:20:04.188 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (98m) 67m ago 106m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:20:04.188 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (98m) 67m ago 105m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:20:04.188 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (105m) 67m ago 106m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:20:04.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (98m) 67m ago 102m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:20:04.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (99m) 67m ago 102m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:20:04.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (100m) 67m ago 102m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:20:04.189 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (102m) 67m ago 102m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:20:04.190 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (100m) 67m ago 107m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:20:04.190 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (99m) 67m ago 105m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:20:04.190 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (99m) 67m ago 107m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:20:04.190 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (98m) 67m ago 105m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:20:04.190 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (106m) 67m ago 106m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:20:04.191 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (105m) 67m ago 105m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:20:04.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 67m ago 105m - 4096M 2022-02-02T15:20:04.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (104m) 67m ago 104m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:20:04.191 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (104m) 67m ago 104m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:20:04.192 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (104m) 67m ago 104m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:20:04.192 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (103m) 67m ago 103m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:20:04.192 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (103m) 67m ago 103m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:20:04.192 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (105m) 67m ago 105m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:20:04.193 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 msgr2=0x7f150c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 0x7f150c067290 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f1520105ba0 tx=0x7f151000b040).stop 2022-02-02T15:20:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 msgr2=0x7f1520106320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f1508000c00 tx=0x7f150800b040).stop 2022-02-02T15:20:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 shutdown_connections 2022-02-02T15:20:04.194 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f150c064dd0 0x7f150c067290 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15200f55c0 0x7f1520105e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 --2- 172.21.15.33:0/1071049778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15200f6860 0x7f1520106320 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 >> 172.21.15.33:0/1071049778 conn(0x7f15200f0d40 msgr2=0x7f15200fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:04.195 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 shutdown_connections 2022-02-02T15:20:04.196 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.200+0000 7f15263f7700 1 -- 172.21.15.33:0/1071049778 wait complete. 2022-02-02T15:20:04.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:03 smithi033 ceph-mon[101165]: pgmap v3040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:04.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:03 smithi033 ceph-mon[101165]: from='client.37186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:04.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:03 smithi037 ceph-mon[69017]: pgmap v3040: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:04.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:03 smithi037 ceph-mon[69017]: from='client.37186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2334457962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 msgr2=0x7f8ec40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.291 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2334457962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec40f6cc0 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f8eb8004660 tx=0x7f8eb8009b30).stop 2022-02-02T15:20:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2334457962 shutdown_connections 2022-02-02T15:20:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2334457962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec40f6cc0 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2334457962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 0x7f8ec40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2334457962 >> 172.21.15.33:0/2334457962 conn(0x7f8ec40f0d40 msgr2=0x7f8ec40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2334457962 shutdown_connections 2022-02-02T15:20:04.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.302+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2334457962 wait complete. 2022-02-02T15:20:04.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 Processor -- start 2022-02-02T15:20:04.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 -- start start 2022-02-02T15:20:04.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 0x7f8ec4106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4107990 con 0x7f8ec40f6860 2022-02-02T15:20:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ecbab6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec4107ad0 con 0x7f8ec40f55c0 2022-02-02T15:20:04.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37048/0 (socket says 172.21.15.33:37048) 2022-02-02T15:20:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 -- 172.21.15.33:0/2707879538 learned_addr learned my addr 172.21.15.33:0/2707879538 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9852700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 0x7f8ec4106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 -- 172.21.15.33:0/2707879538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 msgr2=0x7f8ec4106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 0x7f8ec4106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 -- 172.21.15.33:0/2707879538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8005040 con 0x7f8ec40f6860 2022-02-02T15:20:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.303+0000 7f8ec9051700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f8eb8000c00 tx=0x7f8eb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:04.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.304+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb8019070 con 0x7f8ec40f6860 2022-02-02T15:20:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.304+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8eb8007e70 con 0x7f8ec40f6860 2022-02-02T15:20:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.304+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec4108410 con 0x7f8ec40f6860 2022-02-02T15:20:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.304+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8eb8014ce0 con 0x7f8ec40f6860 2022-02-02T15:20:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.304+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec4108970 con 0x7f8ec40f6860 2022-02-02T15:20:04.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.305+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec4045ad0 con 0x7f8ec40f6860 2022-02-02T15:20:04.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.305+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8eb8025070 con 0x7f8ec40f6860 2022-02-02T15:20:04.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.306+0000 7f8eb67fc700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 0x7f8eb0067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.306+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8eb8082e10 con 0x7f8ec40f6860 2022-02-02T15:20:04.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.306+0000 7f8ec9852700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 0x7f8eb0067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.306+0000 7f8ec9852700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 0x7f8eb0067290 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f8ec0009fd0 tx=0x7f8ec000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:04.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.310+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8eb80548f0 con 0x7f8ec40f6860 2022-02-02T15:20:04.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.555+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8ec4109070 con 0x7f8ec40f6860 2022-02-02T15:20:04.544 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.555+0000 7f8eb67fc700 1 -- 172.21.15.33:0/2707879538 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f8eb8023020 con 0x7f8ec40f6860 2022-02-02T15:20:04.545 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:20:04.545 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:20:04.545 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:20:04.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:04.546 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:20:04.546 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:20:04.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:04.546 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:20:04.547 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:20:04.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:04.547 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:20:04.547 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:20:04.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:04.548 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:20:04.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:20:04.548 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:20:04.548 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:20:04.549 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:20:04.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 msgr2=0x7f8eb0067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 0x7f8eb0067290 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f8ec0009fd0 tx=0x7f8ec000b040).stop 2022-02-02T15:20:04.550 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 msgr2=0x7f8ec41073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 rx=0x7f8eb8000c00 tx=0x7f8eb800b040).stop 2022-02-02T15:20:04.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 shutdown_connections 2022-02-02T15:20:04.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8eb0064dd0 0x7f8eb0067290 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.551 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ec40f55c0 0x7f8ec4106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 --2- 172.21.15.33:0/2707879538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ec40f6860 0x7f8ec41073e0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 >> 172.21.15.33:0/2707879538 conn(0x7f8ec40f0d40 msgr2=0x7f8ec405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:04.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 shutdown_connections 2022-02-02T15:20:04.552 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.557+0000 7f8ecbab6700 1 -- 172.21.15.33:0/2707879538 wait complete. 2022-02-02T15:20:04.650 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 -- 172.21.15.33:0/2113087456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 msgr2=0x7fc9900f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 --2- 172.21.15.33:0/2113087456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc9900f6b00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7fc98c004660 tx=0x7fc98c009b30).stop 2022-02-02T15:20:04.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 -- 172.21.15.33:0/2113087456 shutdown_connections 2022-02-02T15:20:04.651 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 --2- 172.21.15.33:0/2113087456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 0x7fc9900f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 --2- 172.21.15.33:0/2113087456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc9900f6b00 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 -- 172.21.15.33:0/2113087456 >> 172.21.15.33:0/2113087456 conn(0x7fc9900f1e40 msgr2=0x7fc9900f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:04.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 -- 172.21.15.33:0/2113087456 shutdown_connections 2022-02-02T15:20:04.652 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.658+0000 7fc9982b7700 1 -- 172.21.15.33:0/2113087456 wait complete. 2022-02-02T15:20:04.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 Processor -- start 2022-02-02T15:20:04.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 -- start start 2022-02-02T15:20:04.653 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 0x7fc990069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99006a380 con 0x7fc9900f66e0 2022-02-02T15:20:04.654 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc9982b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99006a4c0 con 0x7fc9900f7980 2022-02-02T15:20:04.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc996053700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc996053700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37056/0 (socket says 172.21.15.33:37056) 2022-02-02T15:20:04.655 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc996053700 1 -- 172.21.15.33:0/596773278 learned_addr learned my addr 172.21.15.33:0/596773278 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.659+0000 7fc995852700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 0x7fc990069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc996053700 1 -- 172.21.15.33:0/596773278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 msgr2=0x7fc990069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.656 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc996053700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 0x7fc990069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc996053700 1 -- 172.21.15.33:0/596773278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c005040 con 0x7fc9900f66e0 2022-02-02T15:20:04.657 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc996053700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fc98c014040 tx=0x7fc98c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c019070 con 0x7fc9900f66e0 2022-02-02T15:20:04.658 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc98c007e70 con 0x7fc9900f66e0 2022-02-02T15:20:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99006a740 con 0x7fc9900f66e0 2022-02-02T15:20:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc98c014d50 con 0x7fc9900f66e0 2022-02-02T15:20:04.659 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.660+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99006aca0 con 0x7fc9900f66e0 2022-02-02T15:20:04.660 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.661+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc990045ad0 con 0x7fc9900f66e0 2022-02-02T15:20:04.661 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.662+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc98c025070 con 0x7fc9900f66e0 2022-02-02T15:20:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.662+0000 7fc982ffd700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 0x7fc97c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.662+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc98c082ab0 con 0x7fc9900f66e0 2022-02-02T15:20:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.662+0000 7fc995852700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 0x7fc97c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.662+0000 7fc995852700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 0x7fc97c067290 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fc984007fd0 tx=0x7fc98400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:04.663 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.666+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc98c050c20 con 0x7fc9900f66e0 2022-02-02T15:20:04.866 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.877+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc9900586e0 con 0x7fc9900f66e0 2022-02-02T15:20:04.867 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.878+0000 7fc982ffd700 1 -- 172.21.15.33:0/596773278 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc98c023070 con 0x7fc9900f66e0 2022-02-02T15:20:04.867 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:20:04.867 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:20:04.868 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:20:04.868 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:20:04.868 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:04.868 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:20:04.869 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:20:04.869 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:20:04.869 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:20:04.869 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:20:04.869 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:20:04.870 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:20:04.870 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:20:04.870 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:20:04.870 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:20:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:20:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:20:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:20:04.871 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:20:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:20:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:20:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:20:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:20:04.872 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:20:04.873 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:20:04.873 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:20:04.873 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:20:04.873 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:20:04.873 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:20:04.874 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:20:04.874 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:20:04.874 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:04.874 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:04.875 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:20:04.875 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:04.875 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:04.875 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:04.875 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:04.876 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:04.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.880+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 msgr2=0x7fc97c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.880+0000 7fc9982b7700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 0x7fc97c067290 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7fc984007fd0 tx=0x7fc98400b040).stop 2022-02-02T15:20:04.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.880+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 msgr2=0x7fc99006b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:04.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.880+0000 7fc9982b7700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7fc98c014040 tx=0x7fc98c00b040).stop 2022-02-02T15:20:04.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 shutdown_connections 2022-02-02T15:20:04.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc97c064dd0 0x7fc97c067290 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9900f66e0 0x7fc99006b9a0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 --2- 172.21.15.33:0/596773278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9900f7980 0x7fc990069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 >> 172.21.15.33:0/596773278 conn(0x7fc9900f1e40 msgr2=0x7fc9900fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 shutdown_connections 2022-02-02T15:20:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:04.881+0000 7fc9982b7700 1 -- 172.21.15.33:0/596773278 wait complete. 2022-02-02T15:20:04.879 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:20:05.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:04 smithi033 ceph-mon[101165]: from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:05.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2707879538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:20:05.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:04 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/596773278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:20:05.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:04 smithi037 ceph-mon[69017]: from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:05.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2707879538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:20:05.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:04 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/596773278' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:20:06.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:05 smithi033 ceph-mon[101165]: pgmap v3041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:06.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:05 smithi037 ceph-mon[69017]: pgmap v3041: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:08.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:07 smithi033 ceph-mon[101165]: pgmap v3042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:07 smithi037 ceph-mon[69017]: pgmap v3042: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:10.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:09 smithi033 ceph-mon[101165]: pgmap v3043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:10.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:09 smithi037 ceph-mon[69017]: pgmap v3043: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:12.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:11 smithi033 ceph-mon[101165]: pgmap v3044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:12.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:11 smithi037 ceph-mon[69017]: pgmap v3044: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:14.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:13 smithi033 ceph-mon[101165]: pgmap v3045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:14.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:13 smithi037 ceph-mon[69017]: pgmap v3045: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:16.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:15 smithi033 ceph-mon[101165]: pgmap v3046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:16.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:15 smithi037 ceph-mon[69017]: pgmap v3046: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:18.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:17 smithi033 ceph-mon[101165]: pgmap v3047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:18.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:17 smithi037 ceph-mon[69017]: pgmap v3047: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:20.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:19 smithi033 ceph-mon[101165]: pgmap v3048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:20.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:19 smithi037 ceph-mon[69017]: pgmap v3048: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:22.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:21 smithi033 ceph-mon[101165]: pgmap v3049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:22.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:21 smithi037 ceph-mon[69017]: pgmap v3049: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:24.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:23 smithi033 ceph-mon[101165]: pgmap v3050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:24.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:23 smithi037 ceph-mon[69017]: pgmap v3050: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:26.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:25 smithi033 ceph-mon[101165]: pgmap v3051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:26.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:25 smithi037 ceph-mon[69017]: pgmap v3051: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:28.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:27 smithi033 ceph-mon[101165]: pgmap v3052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:28.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:27 smithi037 ceph-mon[69017]: pgmap v3052: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:30.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:29 smithi033 ceph-mon[101165]: pgmap v3053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:29 smithi037 ceph-mon[69017]: pgmap v3053: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:32.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:31 smithi033 ceph-mon[101165]: pgmap v3054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:32.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:31 smithi037 ceph-mon[69017]: pgmap v3054: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:34.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:33 smithi033 ceph-mon[101165]: pgmap v3055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:33 smithi037 ceph-mon[69017]: pgmap v3055: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:34.987 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 -- 172.21.15.33:0/1834295131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f6860 msgr2=0x7f336c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 --2- 172.21.15.33:0/1834295131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f6860 0x7f336c0f6cc0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f3368004660 tx=0x7f3368009b30).stop 2022-02-02T15:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 -- 172.21.15.33:0/1834295131 shutdown_connections 2022-02-02T15:20:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 --2- 172.21.15.33:0/1834295131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f6860 0x7f336c0f6cc0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 --2- 172.21.15.33:0/1834295131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f55c0 0x7f336c0f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.995+0000 7f337402b700 1 -- 172.21.15.33:0/1834295131 >> 172.21.15.33:0/1834295131 conn(0x7f336c0f0d40 msgr2=0x7f336c0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 -- 172.21.15.33:0/1834295131 shutdown_connections 2022-02-02T15:20:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 -- 172.21.15.33:0/1834295131 wait complete. 2022-02-02T15:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 Processor -- start 2022-02-02T15:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 -- start start 2022-02-02T15:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:34.990 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f6860 0x7f336c10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:34.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0603c0 con 0x7f336c0f55c0 2022-02-02T15:20:34.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.996+0000 7f337402b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c060500 con 0x7f336c0f6860 2022-02-02T15:20:34.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:34.991 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37066/0 (socket says 172.21.15.33:37066) 2022-02-02T15:20:34.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 -- 172.21.15.33:0/2606595619 learned_addr learned my addr 172.21.15.33:0/2606595619 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:34.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f33715c6700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f6860 0x7f336c10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:34.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 -- 172.21.15.33:0/2606595619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f6860 msgr2=0x7f336c10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:34.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f6860 0x7f336c10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 -- 172.21.15.33:0/2606595619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368005040 con 0x7f336c0f55c0 2022-02-02T15:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f3371dc7700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f335c002700 tx=0x7f335c009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c0079c0 con 0x7f336c0f55c0 2022-02-02T15:20:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f335c00f040 con 0x7f336c0f55c0 2022-02-02T15:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f335c014860 con 0x7f336c0f55c0 2022-02-02T15:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c10c720 con 0x7f336c0f55c0 2022-02-02T15:20:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.997+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c10cc60 con 0x7f336c0f55c0 2022-02-02T15:20:34.995 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.999+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c045ad0 con 0x7f336c0f55c0 2022-02-02T15:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.999+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f335c01b060 con 0x7f336c0f55c0 2022-02-02T15:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.999+0000 7f33627fc700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 0x7f3358067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:34.999+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f335c081940 con 0x7f336c0f55c0 2022-02-02T15:20:34.996 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.000+0000 7f33715c6700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 0x7f3358067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.000+0000 7f33715c6700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 0x7f3358067290 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f3368004630 tx=0x7f3368009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:34.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.004+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f335c04f9f0 con 0x7f336c0f55c0 2022-02-02T15:20:35.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.193+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f336c057f10 con 0x7f3358064dd0 2022-02-02T15:20:35.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.194+0000 7f33627fc700 1 -- 172.21.15.33:0/2606595619 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f336c057f10 con 0x7f3358064dd0 2022-02-02T15:20:35.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 msgr2=0x7f3358067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 0x7f3358067290 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f3368004630 tx=0x7f3368009b30).stop 2022-02-02T15:20:35.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 msgr2=0x7f336c109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f335c002700 tx=0x7f335c009d80).stop 2022-02-02T15:20:35.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 shutdown_connections 2022-02-02T15:20:35.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3358064dd0 0x7f3358067290 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f336c0f55c0 0x7f336c109c70 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 --2- 172.21.15.33:0/2606595619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f336c0f6860 0x7f336c10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 >> 172.21.15.33:0/2606595619 conn(0x7f336c0f0d40 msgr2=0x7f336c0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 shutdown_connections 2022-02-02T15:20:35.189 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.196+0000 7f337402b700 1 -- 172.21.15.33:0/2606595619 wait complete. 2022-02-02T15:20:35.196 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:20:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.297+0000 7f6c79946700 1 -- 172.21.15.33:0/635866824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f5430 msgr2=0x7f6c740f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.288 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.297+0000 7f6c79946700 1 --2- 172.21.15.33:0/635866824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f5430 0x7f6c740f5850 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 rx=0x7f6c68004660 tx=0x7f6c68009b30).stop 2022-02-02T15:20:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 -- 172.21.15.33:0/635866824 shutdown_connections 2022-02-02T15:20:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 --2- 172.21.15.33:0/635866824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f66d0 0x7f6c740f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 --2- 172.21.15.33:0/635866824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f5430 0x7f6c740f5850 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.289 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 -- 172.21.15.33:0/635866824 >> 172.21.15.33:0/635866824 conn(0x7f6c740f0b90 msgr2=0x7f6c740f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 -- 172.21.15.33:0/635866824 shutdown_connections 2022-02-02T15:20:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 -- 172.21.15.33:0/635866824 wait complete. 2022-02-02T15:20:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 Processor -- start 2022-02-02T15:20:35.290 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.298+0000 7f6c79946700 1 -- start start 2022-02-02T15:20:35.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c79946700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f5430 0x7f6c74105cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c79946700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c79946700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74106760 con 0x7f6c740f66d0 2022-02-02T15:20:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c79946700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74106f60 con 0x7f6c740f5430 2022-02-02T15:20:35.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37078/0 (socket says 172.21.15.33:37078) 2022-02-02T15:20:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 -- 172.21.15.33:0/3481510342 learned_addr learned my addr 172.21.15.33:0/3481510342 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:35.294 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c78944700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f5430 0x7f6c74105cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 -- 172.21.15.33:0/3481510342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f5430 msgr2=0x7f6c74105cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f5430 0x7f6c74105cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 -- 172.21.15.33:0/3481510342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68005040 con 0x7f6c740f66d0 2022-02-02T15:20:35.295 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.299+0000 7f6c73fff700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f6c600026d0 tx=0x7f6c60009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.300+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c600079c0 con 0x7f6c740f66d0 2022-02-02T15:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.300+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c74107240 con 0x7f6c740f66d0 2022-02-02T15:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.300+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6c6000f040 con 0x7f6c740f66d0 2022-02-02T15:20:35.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.300+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c600148b0 con 0x7f6c740f66d0 2022-02-02T15:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.300+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c74107800 con 0x7f6c740f66d0 2022-02-02T15:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.301+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74059100 con 0x7f6c740f66d0 2022-02-02T15:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.301+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6c60007b20 con 0x7f6c740f66d0 2022-02-02T15:20:35.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.302+0000 7f6c717fa700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 0x7f6c640672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.302+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6c60081910 con 0x7f6c740f66d0 2022-02-02T15:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.302+0000 7f6c78944700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 0x7f6c640672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.302+0000 7f6c78944700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 0x7f6c640672e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f6c68013690 tx=0x7f6c68009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.306+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6c600533f0 con 0x7f6c740f66d0 2022-02-02T15:20:35.481 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.491+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c740fdd60 con 0x7f6c64064e20 2022-02-02T15:20:35.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.506+0000 7f6c717fa700 1 -- 172.21.15.33:0/3481510342 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f6c740fdd60 con 0x7f6c64064e20 2022-02-02T15:20:35.496 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:20:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (105m) 67m ago 106m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:20:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (98m) 67m ago 106m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:20:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (98m) 68m ago 106m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:20:35.497 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (105m) 67m ago 106m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:20:35.498 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (99m) 67m ago 103m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:20:35.498 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (100m) 67m ago 103m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:20:35.498 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (100m) 68m ago 103m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:20:35.498 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (103m) 68m ago 103m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:20:35.499 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (100m) 67m ago 108m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:20:35.499 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (100m) 68m ago 106m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:20:35.499 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (99m) 67m ago 108m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:20:35.499 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (99m) 68m ago 106m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:20:35.499 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (106m) 67m ago 106m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:20:35.500 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (106m) 68m ago 106m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:20:35.500 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 67m ago 105m - 4096M 2022-02-02T15:20:35.500 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (105m) 67m ago 105m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:20:35.500 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (105m) 67m ago 105m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:20:35.501 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (104m) 68m ago 104m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:20:35.501 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (104m) 68m ago 104m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:20:35.501 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (104m) 68m ago 104m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:20:35.501 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (105m) 67m ago 106m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:20:35.502 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 msgr2=0x7f6c640672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 0x7f6c640672e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f6c68013690 tx=0x7f6c68009b30).stop 2022-02-02T15:20:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 msgr2=0x7f6c741061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f6c600026d0 tx=0x7f6c60009de0).stop 2022-02-02T15:20:35.503 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 shutdown_connections 2022-02-02T15:20:35.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6c64064e20 0x7f6c640672e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c740f5430 0x7f6c74105cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 --2- 172.21.15.33:0/3481510342 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c740f66d0 0x7f6c741061b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.504 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 >> 172.21.15.33:0/3481510342 conn(0x7f6c740f0b90 msgr2=0x7f6c740fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 shutdown_connections 2022-02-02T15:20:35.505 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.508+0000 7f6c79946700 1 -- 172.21.15.33:0/3481510342 wait complete. 2022-02-02T15:20:35.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 -- 172.21.15.33:0/1282235900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 msgr2=0x7f4ba80f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/1282235900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba80f6cc0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f4b98004660 tx=0x7f4b98009b30).stop 2022-02-02T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 -- 172.21.15.33:0/1282235900 shutdown_connections 2022-02-02T15:20:35.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/1282235900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba80f6cc0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/1282235900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 0x7f4ba80f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 -- 172.21.15.33:0/1282235900 >> 172.21.15.33:0/1282235900 conn(0x7f4ba80f0d40 msgr2=0x7f4ba80f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 -- 172.21.15.33:0/1282235900 shutdown_connections 2022-02-02T15:20:35.600 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.608+0000 7f4bb05a8700 1 -- 172.21.15.33:0/1282235900 wait complete. 2022-02-02T15:20:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 Processor -- start 2022-02-02T15:20:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 -- start start 2022-02-02T15:20:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 0x7f4ba8106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8107990 con 0x7f4ba80f6860 2022-02-02T15:20:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4bb05a8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8107ad0 con 0x7f4ba80f55c0 2022-02-02T15:20:35.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4badb43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.609+0000 7f4badb43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37088/0 (socket says 172.21.15.33:37088) 2022-02-02T15:20:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4badb43700 1 -- 172.21.15.33:0/3374795894 learned_addr learned my addr 172.21.15.33:0/3374795894 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4bae344700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 0x7f4ba8106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4badb43700 1 -- 172.21.15.33:0/3374795894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 msgr2=0x7f4ba8106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4badb43700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 0x7f4ba8106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4badb43700 1 -- 172.21.15.33:0/3374795894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98005040 con 0x7f4ba80f6860 2022-02-02T15:20:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4badb43700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f4b98000c00 tx=0x7f4b9800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b98019070 con 0x7f4ba80f6860 2022-02-02T15:20:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba8108410 con 0x7f4ba80f6860 2022-02-02T15:20:35.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b98007e70 con 0x7f4ba80f6860 2022-02-02T15:20:35.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b98014ce0 con 0x7f4ba80f6860 2022-02-02T15:20:35.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.610+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba8108970 con 0x7f4ba80f6860 2022-02-02T15:20:35.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.611+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba8045ad0 con 0x7f4ba80f6860 2022-02-02T15:20:35.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.612+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b98025070 con 0x7f4ba80f6860 2022-02-02T15:20:35.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.612+0000 7f4b9effd700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 0x7f4b94067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.612+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4b98082ab0 con 0x7f4ba80f6860 2022-02-02T15:20:35.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.612+0000 7f4bae344700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 0x7f4b94067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.613+0000 7f4bae344700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 0x7f4b94067290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f4ba4009fd0 tx=0x7f4ba400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.617+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b98084e60 con 0x7f4ba80f6860 2022-02-02T15:20:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.861+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4ba80fdd80 con 0x7f4ba80f6860 2022-02-02T15:20:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.861+0000 7f4b9effd700 1 -- 172.21.15.33:0/3374795894 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f4b98023070 con 0x7f4ba80f6860 2022-02-02T15:20:35.852 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:20:35.852 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:20:35.852 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:20:35.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:35.853 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:20:35.853 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:20:35.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:35.853 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:20:35.854 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:20:35.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:35.854 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:20:35.854 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:20:35.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:20:35.855 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:20:35.855 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:20:35.855 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:20:35.855 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:20:35.856 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:20:35.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 msgr2=0x7f4b94067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 0x7f4b94067290 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f4ba4009fd0 tx=0x7f4ba400b040).stop 2022-02-02T15:20:35.857 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 msgr2=0x7f4ba81073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 rx=0x7f4b98000c00 tx=0x7f4b9800b040).stop 2022-02-02T15:20:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 shutdown_connections 2022-02-02T15:20:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b94064dd0 0x7f4b94067290 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ba80f55c0 0x7f4ba8106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 --2- 172.21.15.33:0/3374795894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ba80f6860 0x7f4ba81073e0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 >> 172.21.15.33:0/3374795894 conn(0x7f4ba80f0d40 msgr2=0x7f4ba805fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 shutdown_connections 2022-02-02T15:20:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.863+0000 7f4bb05a8700 1 -- 172.21.15.33:0/3374795894 wait complete. 2022-02-02T15:20:35.959 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 -- 172.21.15.33:0/1040968186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680fbcd0 msgr2=0x7fa7680fe0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 --2- 172.21.15.33:0/1040968186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680fbcd0 0x7fa7680fe0c0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 rx=0x7fa750004660 tx=0x7fa750009b30).stop 2022-02-02T15:20:35.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 -- 172.21.15.33:0/1040968186 shutdown_connections 2022-02-02T15:20:35.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 --2- 172.21.15.33:0/1040968186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7680fbcd0 0x7fa7680fe0c0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.960 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 --2- 172.21.15.33:0/1040968186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa768060310 0x7fa7680fb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 -- 172.21.15.33:0/1040968186 >> 172.21.15.33:0/1040968186 conn(0x7fa7680f0de0 msgr2=0x7fa7680f3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:35.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 -- 172.21.15.33:0/1040968186 shutdown_connections 2022-02-02T15:20:35.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.965+0000 7fa76d49f700 1 -- 172.21.15.33:0/1040968186 wait complete. 2022-02-02T15:20:35.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 Processor -- start 2022-02-02T15:20:35.961 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 -- start start 2022-02-02T15:20:35.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 0x7fa768109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768109c10 con 0x7fa768060310 2022-02-02T15:20:35.962 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.966+0000 7fa76d49f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768109d50 con 0x7fa7680fbcd0 2022-02-02T15:20:35.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37096/0 (socket says 172.21.15.33:37096) 2022-02-02T15:20:35.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 -- 172.21.15.33:0/2193130687 learned_addr learned my addr 172.21.15.33:0/2193130687 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:20:35.963 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa75ffff700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 0x7fa768109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 -- 172.21.15.33:0/2193130687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 msgr2=0x7fa768109660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:35.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 0x7fa768109660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:35.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 -- 172.21.15.33:0/2193130687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750005040 con 0x7fa768060310 2022-02-02T15:20:35.964 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa75ffff700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 0x7fa768109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:20:35.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa766ffd700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fa7580026d0 tx=0x7fa758009dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7580079c0 con 0x7fa768060310 2022-02-02T15:20:35.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76810a6f0 con 0x7fa768060310 2022-02-02T15:20:35.965 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa75800f040 con 0x7fa768060310 2022-02-02T15:20:35.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa758014840 con 0x7fa768060310 2022-02-02T15:20:35.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.967+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76810acb0 con 0x7fa768060310 2022-02-02T15:20:35.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.968+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768045ad0 con 0x7fa768060310 2022-02-02T15:20:35.966 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.969+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa75801b060 con 0x7fa768060310 2022-02-02T15:20:35.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.969+0000 7fa75f7fe700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 0x7fa754067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:20:35.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.969+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa758081a30 con 0x7fa768060310 2022-02-02T15:20:35.967 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.969+0000 7fa75ffff700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 0x7fa754067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:20:35.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.970+0000 7fa75ffff700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 0x7fa754067270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fa750004630 tx=0x7fa750009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:20:35.968 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:35.974+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa758053510 con 0x7fa768060310 2022-02-02T15:20:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.183+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa768101250 con 0x7fa768060310 2022-02-02T15:20:36.174 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:35 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3374795894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:20:36.175 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.184+0000 7fa75f7fe700 1 -- 172.21.15.33:0/2193130687 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fa758019070 con 0x7fa768060310 2022-02-02T15:20:36.175 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:20:36.175 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:20:36.176 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:20:36.176 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:20:36.176 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:36.176 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:20:36.177 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:20:36.177 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:20:36.177 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:20:36.177 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:20:36.178 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:20:36.178 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:20:36.178 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:20:36.178 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:20:36.178 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:20:36.179 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:20:36.179 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:20:36.179 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:20:36.179 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:20:36.180 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:20:36.180 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:20:36.180 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:20:36.180 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:20:36.181 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:20:36.181 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:20:36.181 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:20:36.181 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:20:36.181 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:20:36.182 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:20:36.182 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:20:36.182 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:20:36.182 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:36.183 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:36.183 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:20:36.183 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:20:36.183 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:36.184 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:36.184 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:36.184 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:20:36.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 msgr2=0x7fa754067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:36.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 0x7fa754067270 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fa750004630 tx=0x7fa750009b30).stop 2022-02-02T15:20:36.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 msgr2=0x7fa768109170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:20:36.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 rx=0x7fa7580026d0 tx=0x7fa758009dc0).stop 2022-02-02T15:20:36.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 shutdown_connections 2022-02-02T15:20:36.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa754064db0 0x7fa754067270 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:36.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa768060310 0x7fa768109170 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:36.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 --2- 172.21.15.33:0/2193130687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7680fbcd0 0x7fa768109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:20:36.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 >> 172.21.15.33:0/2193130687 conn(0x7fa7680f0de0 msgr2=0x7fa7680f31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:20:36.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 shutdown_connections 2022-02-02T15:20:36.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:20:36.186+0000 7fa76d49f700 1 -- 172.21.15.33:0/2193130687 wait complete. 2022-02-02T15:20:36.189 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:20:36.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:35 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3374795894' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:20:37.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:36 smithi033 ceph-mon[101165]: from='client.37202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:37.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:36 smithi033 ceph-mon[101165]: from='client.37206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:37.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:36 smithi033 ceph-mon[101165]: pgmap v3056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:37.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:36 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2193130687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:20:37.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:36 smithi037 ceph-mon[69017]: from='client.37202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:37.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:36 smithi037 ceph-mon[69017]: from='client.37206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:20:37.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:36 smithi037 ceph-mon[69017]: pgmap v3056: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:37.281 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:36 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2193130687' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:20:38.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:37 smithi033 ceph-mon[101165]: pgmap v3057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:38.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:37 smithi037 ceph-mon[69017]: pgmap v3057: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:40.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:39 smithi033 ceph-mon[101165]: pgmap v3058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:40.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:39 smithi037 ceph-mon[69017]: pgmap v3058: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:42.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:41 smithi033 ceph-mon[101165]: pgmap v3059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:42.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:41 smithi037 ceph-mon[69017]: pgmap v3059: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:44.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:43 smithi033 ceph-mon[101165]: pgmap v3060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:44.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:43 smithi037 ceph-mon[69017]: pgmap v3060: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:46.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:45 smithi033 ceph-mon[101165]: pgmap v3061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:46.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:45 smithi037 ceph-mon[69017]: pgmap v3061: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:48.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:47 smithi033 ceph-mon[101165]: pgmap v3062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:48.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:47 smithi037 ceph-mon[69017]: pgmap v3062: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:50.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:49 smithi033 ceph-mon[101165]: pgmap v3063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:50.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:49 smithi037 ceph-mon[69017]: pgmap v3063: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:52.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:51 smithi033 ceph-mon[101165]: pgmap v3064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:52.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:51 smithi037 ceph-mon[69017]: pgmap v3064: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:54.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:53 smithi033 ceph-mon[101165]: pgmap v3065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:54.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:53 smithi037 ceph-mon[69017]: pgmap v3065: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:55.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:20:55.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:20:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:20:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:20:56.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:55 smithi033 ceph-mon[101165]: pgmap v3066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:56.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:55 smithi037 ceph-mon[69017]: pgmap v3066: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:58.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:57 smithi033 ceph-mon[101165]: pgmap v3067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:20:58.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:57 smithi037 ceph-mon[69017]: pgmap v3067: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:00.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:20:59 smithi033 ceph-mon[101165]: pgmap v3068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:00.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:20:59 smithi037 ceph-mon[69017]: pgmap v3068: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:02.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:01 smithi033 ceph-mon[101165]: pgmap v3069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:02.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:01 smithi037 ceph-mon[69017]: pgmap v3069: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:04.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:03 smithi033 ceph-mon[101165]: pgmap v3070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:04.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:03 smithi037 ceph-mon[69017]: pgmap v3070: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:06.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:05 smithi033 ceph-mon[101165]: pgmap v3071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:06.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:05 smithi037 ceph-mon[69017]: pgmap v3071: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:06.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 -- 172.21.15.33:0/615595305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 msgr2=0x7fc3640f7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 --2- 172.21.15.33:0/615595305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc3640f7c30 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fc358004660 tx=0x7fc358009b30).stop 2022-02-02T15:21:06.292 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 -- 172.21.15.33:0/615595305 shutdown_connections 2022-02-02T15:21:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 --2- 172.21.15.33:0/615595305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc3640f7c30 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 --2- 172.21.15.33:0/615595305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc3640f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 -- 172.21.15.33:0/615595305 >> 172.21.15.33:0/615595305 conn(0x7fc3640f1c90 msgr2=0x7fc3640f40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:06.293 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.303+0000 7fc36359e700 1 -- 172.21.15.33:0/615595305 shutdown_connections 2022-02-02T15:21:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 -- 172.21.15.33:0/615595305 wait complete. 2022-02-02T15:21:06.296 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 Processor -- start 2022-02-02T15:21:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 -- start start 2022-02-02T15:21:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc364106d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.297 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364107830 con 0x7fc3640f77d0 2022-02-02T15:21:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.304+0000 7fc36359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364108040 con 0x7fc3640f6530 2022-02-02T15:21:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37106/0 (socket says 172.21.15.33:37106) 2022-02-02T15:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 -- 172.21.15.33:0/2888184124 learned_addr learned my addr 172.21.15.33:0/2888184124 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc36259c700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc364106d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 -- 172.21.15.33:0/2888184124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 msgr2=0x7fc364106d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc364106d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 -- 172.21.15.33:0/2888184124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358005040 con 0x7fc3640f77d0 2022-02-02T15:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc36259c700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc364106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc361d9b700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fc358000c00 tx=0x7fc35800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc358019070 con 0x7fc3640f77d0 2022-02-02T15:21:06.300 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc358007e70 con 0x7fc3640f77d0 2022-02-02T15:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc364108260 con 0x7fc3640f77d0 2022-02-02T15:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3641087c0 con 0x7fc3640f77d0 2022-02-02T15:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.305+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc358014d90 con 0x7fc3640f77d0 2022-02-02T15:21:06.301 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.306+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348004fa0 con 0x7fc3640f77d0 2022-02-02T15:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.307+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc358025070 con 0x7fc3640f77d0 2022-02-02T15:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.307+0000 7fc352ffd700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 0x7fc34c0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.307+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc3580829a0 con 0x7fc3640f77d0 2022-02-02T15:21:06.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.308+0000 7fc36259c700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 0x7fc34c0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.308+0000 7fc36259c700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 0x7fc34c0672e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fc364106ab0 tx=0x7fc35400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.312+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3580509f0 con 0x7fc3640f77d0 2022-02-02T15:21:06.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.503+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc348000bc0 con 0x7fc34c064e20 2022-02-02T15:21:06.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.505+0000 7fc352ffd700 1 -- 172.21.15.33:0/2888184124 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fc348000bc0 con 0x7fc34c064e20 2022-02-02T15:21:06.495 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 msgr2=0x7fc34c0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 0x7fc34c0672e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fc364106ab0 tx=0x7fc35400b040).stop 2022-02-02T15:21:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 msgr2=0x7fc364107230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fc358000c00 tx=0x7fc35800b040).stop 2022-02-02T15:21:06.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 shutdown_connections 2022-02-02T15:21:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc34c064e20 0x7fc34c0672e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3640f6530 0x7fc364106d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.506+0000 7fc36359e700 1 --2- 172.21.15.33:0/2888184124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3640f77d0 0x7fc364107230 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.507+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 >> 172.21.15.33:0/2888184124 conn(0x7fc3640f1c90 msgr2=0x7fc3640fb220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:06.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.507+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 shutdown_connections 2022-02-02T15:21:06.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.507+0000 7fc36359e700 1 -- 172.21.15.33:0/2888184124 wait complete. 2022-02-02T15:21:06.506 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:21:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 -- 172.21.15.33:0/2101388080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 msgr2=0x7ff5f00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 --2- 172.21.15.33:0/2101388080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f00f7de0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 rx=0x7ff5e4004660 tx=0x7ff5e4009b30).stop 2022-02-02T15:21:06.597 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 -- 172.21.15.33:0/2101388080 shutdown_connections 2022-02-02T15:21:06.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 --2- 172.21.15.33:0/2101388080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f00f7de0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 --2- 172.21.15.33:0/2101388080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.598 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 -- 172.21.15.33:0/2101388080 >> 172.21.15.33:0/2101388080 conn(0x7ff5f00f1e40 msgr2=0x7ff5f00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:06.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.607+0000 7ff5f6259700 1 -- 172.21.15.33:0/2101388080 shutdown_connections 2022-02-02T15:21:06.599 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.608+0000 7ff5f6259700 1 -- 172.21.15.33:0/2101388080 wait complete. 2022-02-02T15:21:06.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 Processor -- start 2022-02-02T15:21:06.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 -- start start 2022-02-02T15:21:06.601 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f0106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01079b0 con 0x7ff5f00f7980 2022-02-02T15:21:06.602 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5f6259700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0107af0 con 0x7ff5f00f66e0 2022-02-02T15:21:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37116/0 (socket says 172.21.15.33:37116) 2022-02-02T15:21:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5eeffd700 1 -- 172.21.15.33:0/4104104160 learned_addr learned my addr 172.21.15.33:0/4104104160 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:06.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.609+0000 7ff5ef7fe700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f0106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5eeffd700 1 -- 172.21.15.33:0/4104104160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 msgr2=0x7ff5f0106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5eeffd700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f0106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5eeffd700 1 -- 172.21.15.33:0/4104104160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4005040 con 0x7ff5f00f7980 2022-02-02T15:21:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5eeffd700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7ff5e4000c00 tx=0x7ff5e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e4019070 con 0x7ff5f00f7980 2022-02-02T15:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff5e4007e70 con 0x7ff5f00f7980 2022-02-02T15:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5e4014ce0 con 0x7ff5f00f7980 2022-02-02T15:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0108430 con 0x7ff5f00f7980 2022-02-02T15:21:06.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.610+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0108940 con 0x7ff5f00f7980 2022-02-02T15:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.612+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f0045ad0 con 0x7ff5f00f7980 2022-02-02T15:21:06.606 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.612+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff5e4025070 con 0x7ff5f00f7980 2022-02-02T15:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.612+0000 7ff5d7fff700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 0x7ff5d8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.613+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff5e4082a30 con 0x7ff5f00f7980 2022-02-02T15:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.613+0000 7ff5ef7fe700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 0x7ff5d8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.607 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.613+0000 7ff5ef7fe700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 0x7ff5d8067290 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff5e0009fd0 tx=0x7ff5e000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.617+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff5e4054510 con 0x7ff5f00f7980 2022-02-02T15:21:06.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.798+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f0108bb0 con 0x7ff5d8064dd0 2022-02-02T15:21:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.813+0000 7ff5d7fff700 1 -- 172.21.15.33:0/4104104160 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7ff5f0108bb0 con 0x7ff5d8064dd0 2022-02-02T15:21:06.802 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:21:06.802 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (106m) 68m ago 107m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:21:06.802 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (99m) 68m ago 107m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:21:06.803 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (99m) 68m ago 106m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:21:06.803 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (106m) 68m ago 107m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:21:06.803 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (99m) 68m ago 103m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:21:06.803 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (100m) 68m ago 103m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:21:06.804 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (101m) 68m ago 103m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:21:06.804 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (103m) 68m ago 103m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:21:06.804 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (101m) 68m ago 108m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:21:06.804 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (100m) 68m ago 106m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:21:06.805 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (100m) 68m ago 108m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:21:06.805 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (99m) 68m ago 106m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:21:06.805 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (107m) 68m ago 107m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:21:06.805 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (106m) 68m ago 106m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:21:06.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 68m ago 106m - 4096M 2022-02-02T15:21:06.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (105m) 68m ago 105m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:21:06.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (105m) 68m ago 105m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:21:06.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (105m) 68m ago 105m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:21:06.806 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (104m) 68m ago 104m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:21:06.807 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (104m) 68m ago 104m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:21:06.807 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (106m) 68m ago 106m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:21:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.814+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 msgr2=0x7ff5d8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.814+0000 7ff5f6259700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 0x7ff5d8067290 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7ff5e0009fd0 tx=0x7ff5e000b040).stop 2022-02-02T15:21:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.814+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 msgr2=0x7ff5f0107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.814+0000 7ff5f6259700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7ff5e4000c00 tx=0x7ff5e400b040).stop 2022-02-02T15:21:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.814+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 shutdown_connections 2022-02-02T15:21:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff5d8064dd0 0x7ff5d8067290 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5f00f66e0 0x7ff5f0106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 --2- 172.21.15.33:0/4104104160 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5f00f7980 0x7ff5f0107400 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 >> 172.21.15.33:0/4104104160 conn(0x7ff5f00f1e40 msgr2=0x7ff5f00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 shutdown_connections 2022-02-02T15:21:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.815+0000 7ff5f6259700 1 -- 172.21.15.33:0/4104104160 wait complete. 2022-02-02T15:21:06.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 -- 172.21.15.33:0/3764397266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 msgr2=0x7f56d40f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 --2- 172.21.15.33:0/3764397266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f9110 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7f56c4004660 tx=0x7f56c4009b30).stop 2022-02-02T15:21:06.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 -- 172.21.15.33:0/3764397266 shutdown_connections 2022-02-02T15:21:06.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 --2- 172.21.15.33:0/3764397266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.906 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 --2- 172.21.15.33:0/3764397266 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f9110 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.914+0000 7f56d359e700 1 -- 172.21.15.33:0/3764397266 >> 172.21.15.33:0/3764397266 conn(0x7f56d40f0b90 msgr2=0x7f56d40f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:06.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 -- 172.21.15.33:0/3764397266 shutdown_connections 2022-02-02T15:21:06.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 -- 172.21.15.33:0/3764397266 wait complete. 2022-02-02T15:21:06.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 Processor -- start 2022-02-02T15:21:06.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 -- start start 2022-02-02T15:21:06.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40f5570 con 0x7f56d4060310 2022-02-02T15:21:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.915+0000 7f56d359e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40f56b0 con 0x7f56d40f9690 2022-02-02T15:21:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37124/0 (socket says 172.21.15.33:37124) 2022-02-02T15:21:06.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 -- 172.21.15.33:0/3247854845 learned_addr learned my addr 172.21.15.33:0/3247854845 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 -- 172.21.15.33:0/3247854845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 msgr2=0x7f56d40f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 -- 172.21.15.33:0/3247854845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c4005040 con 0x7f56d4060310 2022-02-02T15:21:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d1d9b700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:21:06.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d259c700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f56c4000c00 tx=0x7f56c400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c4019070 con 0x7f56d4060310 2022-02-02T15:21:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40f5930 con 0x7f56d4060310 2022-02-02T15:21:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.916+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d40f5e90 con 0x7f56d4060310 2022-02-02T15:21:06.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.917+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f56c4007e70 con 0x7f56d4060310 2022-02-02T15:21:06.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.917+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c4014c00 con 0x7f56d4060310 2022-02-02T15:21:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.918+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b8004fa0 con 0x7f56d4060310 2022-02-02T15:21:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.918+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f56c4025070 con 0x7f56d4060310 2022-02-02T15:21:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.919+0000 7f56c2ffd700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 0x7f56bc0672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.919+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f56c40829c0 con 0x7f56d4060310 2022-02-02T15:21:06.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.919+0000 7f56d1d9b700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 0x7f56bc0672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:06.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.919+0000 7f56d1d9b700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 0x7f56bc0672e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f56c8009fd0 tx=0x7f56c800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:06.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:06.923+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f56c4050a70 con 0x7f56d4060310 2022-02-02T15:21:07.159 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.169+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f56b8005e80 con 0x7f56d4060310 2022-02-02T15:21:07.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:06 smithi033 ceph-mon[101165]: from='client.37218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:07.159 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:06 smithi033 ceph-mon[101165]: from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:07.160 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.170+0000 7f56c2ffd700 1 -- 172.21.15.33:0/3247854845 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f56c4023070 con 0x7f56d4060310 2022-02-02T15:21:07.161 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:21:07.161 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:21:07.161 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:21:07.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:07.162 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:21:07.162 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:21:07.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:07.163 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:21:07.163 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:21:07.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:07.163 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:21:07.163 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:21:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:21:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:21:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:21:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:21:07.165 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:21:07.166 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 msgr2=0x7f56bc0672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 0x7f56bc0672e0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f56c8009fd0 tx=0x7f56c800b040).stop 2022-02-02T15:21:07.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 msgr2=0x7f56d40f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 rx=0x7f56c4000c00 tx=0x7f56c400b040).stop 2022-02-02T15:21:07.167 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 shutdown_connections 2022-02-02T15:21:07.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f56bc064e20 0x7f56bc0672e0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56d4060310 0x7f56d40f6b90 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 --2- 172.21.15.33:0/3247854845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56d40f9690 0x7f56d40f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.168 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 >> 172.21.15.33:0/3247854845 conn(0x7f56d40f0b90 msgr2=0x7f56d40f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:07.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 shutdown_connections 2022-02-02T15:21:07.169 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.172+0000 7f56d359e700 1 -- 172.21.15.33:0/3247854845 wait complete. 2022-02-02T15:21:07.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 -- 172.21.15.33:0/3649257288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f6860 msgr2=0x7efed40f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.264 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3649257288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f6860 0x7efed40f6cc0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7efec8004660 tx=0x7efec8009b30).stop 2022-02-02T15:21:07.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 -- 172.21.15.33:0/3649257288 shutdown_connections 2022-02-02T15:21:07.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3649257288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f6860 0x7efed40f6cc0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.265 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3649257288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f55c0 0x7efed40f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T15:21:07.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 -- 172.21.15.33:0/3649257288 >> 172.21.15.33:0/3649257288 conn(0x7efed40f0d40 msgr2=0x7efed40f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:07.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 -- 172.21.15.33:0/3649257288 shutdown_connections 2022-02-02T15:21:07.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.273+0000 7efeda9ec700 1 -- 172.21.15.33:0/3649257288 wait complete. 2022-02-02T15:21:07.266 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 Processor -- start 2022-02-02T15:21:07.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 -- start start 2022-02-02T15:21:07.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:07.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f6860 0x7efed4107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:07.267 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4107ab0 con 0x7efed40f55c0 2022-02-02T15:21:07.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efeda9ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed4108360 con 0x7efed40f6860 2022-02-02T15:21:07.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:07.268 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37134/0 (socket says 172.21.15.33:37134) 2022-02-02T15:21:07.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 -- 172.21.15.33:0/3971538820 learned_addr learned my addr 172.21.15.33:0/3971538820 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:07.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed37fe700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f6860 0x7efed4107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:07.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 -- 172.21.15.33:0/3971538820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f6860 msgr2=0x7efed4107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.269 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f6860 0x7efed4107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.274+0000 7efed3fff700 1 -- 172.21.15.33:0/3971538820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec8005040 con 0x7efed40f55c0 2022-02-02T15:21:07.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efed3fff700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7efec40093f0 tx=0x7efec4006ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:07.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec4013640 con 0x7efed40f55c0 2022-02-02T15:21:07.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efec4013c50 con 0x7efed40f55c0 2022-02-02T15:21:07.270 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efec4012c70 con 0x7efed40f55c0 2022-02-02T15:21:07.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed4108640 con 0x7efed40f55c0 2022-02-02T15:21:07.271 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.275+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed4108c00 con 0x7efed40f55c0 2022-02-02T15:21:07.272 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.276+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed40f49b0 con 0x7efed40f55c0 2022-02-02T15:21:07.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.277+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efec401a060 con 0x7efed40f55c0 2022-02-02T15:21:07.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.277+0000 7efed0ff9700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 0x7efebc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:07.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.277+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efec4081db0 con 0x7efed40f55c0 2022-02-02T15:21:07.273 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.277+0000 7efed37fe700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 0x7efebc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:07.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.278+0000 7efed37fe700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 0x7efebc067290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7efec8004630 tx=0x7efec8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:07.274 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.281+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efec40539c0 con 0x7efed40f55c0 2022-02-02T15:21:07.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:06 smithi037 ceph-mon[69017]: from='client.37218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:07.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:06 smithi037 ceph-mon[69017]: from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:07.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.496+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efed4045ad0 con 0x7efed40f55c0 2022-02-02T15:21:07.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.497+0000 7efed0ff9700 1 -- 172.21.15.33:0/3971538820 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7efec4018020 con 0x7efed40f55c0 2022-02-02T15:21:07.486 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:21:07.486 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:21:07.487 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:21:07.487 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:21:07.487 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:07.488 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:21:07.488 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:21:07.488 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:21:07.488 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:21:07.489 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:21:07.489 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:21:07.489 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:21:07.489 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:21:07.489 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:21:07.490 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:21:07.490 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:21:07.490 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:21:07.490 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:21:07.491 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:21:07.491 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:21:07.491 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:21:07.491 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:21:07.492 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:21:07.492 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:21:07.492 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:21:07.492 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:21:07.492 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:21:07.493 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:21:07.493 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:21:07.493 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:21:07.493 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:21:07.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:07.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:07.494 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:21:07.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:07.495 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:07.495 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:07.495 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:07.495 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:07.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 msgr2=0x7efebc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.496 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 0x7efebc067290 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7efec8004630 tx=0x7efec8009b30).stop 2022-02-02T15:21:07.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 msgr2=0x7efed4106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:07.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 rx=0x7efec40093f0 tx=0x7efec4006ec0).stop 2022-02-02T15:21:07.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 shutdown_connections 2022-02-02T15:21:07.497 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efebc064dd0 0x7efebc067290 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed40f55c0 0x7efed4106f80 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 --2- 172.21.15.33:0/3971538820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efed40f6860 0x7efed4107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:07.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.498+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 >> 172.21.15.33:0/3971538820 conn(0x7efed40f0d40 msgr2=0x7efed405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:07.498 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.499+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 shutdown_connections 2022-02-02T15:21:07.499 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:07.499+0000 7efeda9ec700 1 -- 172.21.15.33:0/3971538820 wait complete. 2022-02-02T15:21:07.499 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:21:08.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3247854845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:21:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:07 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3971538820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:21:08.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:07 smithi033 ceph-mon[101165]: pgmap v3072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3247854845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:21:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:07 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3971538820' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:21:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:07 smithi037 ceph-mon[69017]: pgmap v3072: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:10.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:09 smithi033 ceph-mon[101165]: pgmap v3073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:10.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:09 smithi037 ceph-mon[69017]: pgmap v3073: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:12.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:11 smithi033 ceph-mon[101165]: pgmap v3074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:12.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:11 smithi037 ceph-mon[69017]: pgmap v3074: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:14.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:13 smithi033 ceph-mon[101165]: pgmap v3075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:14.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:13 smithi037 ceph-mon[69017]: pgmap v3075: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:16.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:15 smithi033 ceph-mon[101165]: pgmap v3076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:16.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:15 smithi037 ceph-mon[69017]: pgmap v3076: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:18.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:17 smithi033 ceph-mon[101165]: pgmap v3077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:18.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:17 smithi037 ceph-mon[69017]: pgmap v3077: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:20.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:19 smithi033 ceph-mon[101165]: pgmap v3078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:20.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:19 smithi037 ceph-mon[69017]: pgmap v3078: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:22.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:21 smithi033 ceph-mon[101165]: pgmap v3079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:22.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:21 smithi037 ceph-mon[69017]: pgmap v3079: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:24.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:23 smithi033 ceph-mon[101165]: pgmap v3080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:24.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:23 smithi037 ceph-mon[69017]: pgmap v3080: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:26.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:25 smithi033 ceph-mon[101165]: pgmap v3081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:26.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:25 smithi037 ceph-mon[69017]: pgmap v3081: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:28.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:27 smithi033 ceph-mon[101165]: pgmap v3082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:28.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:27 smithi037 ceph-mon[69017]: pgmap v3082: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:30.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:29 smithi033 ceph-mon[101165]: pgmap v3083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:30.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:29 smithi037 ceph-mon[69017]: pgmap v3083: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:32.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:31 smithi033 ceph-mon[101165]: pgmap v3084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:32.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:31 smithi037 ceph-mon[69017]: pgmap v3084: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:34.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:33 smithi033 ceph-mon[101165]: pgmap v3085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:34.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:33 smithi037 ceph-mon[69017]: pgmap v3085: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:36.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:35 smithi033 ceph-mon[101165]: pgmap v3086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:36.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:35 smithi037 ceph-mon[69017]: pgmap v3086: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 -- 172.21.15.33:0/1579209820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 msgr2=0x7f89600f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 --2- 172.21.15.33:0/1579209820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f89600f6cc0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7f8954004660 tx=0x7f8954009b30).stop 2022-02-02T15:21:37.603 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 -- 172.21.15.33:0/1579209820 shutdown_connections 2022-02-02T15:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 --2- 172.21.15.33:0/1579209820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f89600f6cc0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 --2- 172.21.15.33:0/1579209820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 0x7f89600f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 -- 172.21.15.33:0/1579209820 >> 172.21.15.33:0/1579209820 conn(0x7f89600f0d40 msgr2=0x7f89600f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:37.604 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 -- 172.21.15.33:0/1579209820 shutdown_connections 2022-02-02T15:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.612+0000 7f8965db7700 1 -- 172.21.15.33:0/1579209820 wait complete. 2022-02-02T15:21:37.605 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.613+0000 7f8965db7700 1 Processor -- start 2022-02-02T15:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f8965db7700 1 -- start start 2022-02-02T15:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f8965db7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 0x7f8960109c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f8965db7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f8965db7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600603e0 con 0x7f89600f6860 2022-02-02T15:21:37.608 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f8965db7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960060520 con 0x7f89600f55c0 2022-02-02T15:21:37.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37146/0 (socket says 172.21.15.33:37146) 2022-02-02T15:21:37.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 -- 172.21.15.33:0/1262386377 learned_addr learned my addr 172.21.15.33:0/1262386377 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:37.609 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895f7fe700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 0x7f8960109c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 -- 172.21.15.33:0/1262386377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 msgr2=0x7f8960109c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 0x7f8960109c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.614+0000 7f895effd700 1 -- 172.21.15.33:0/1262386377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954005040 con 0x7f89600f6860 2022-02-02T15:21:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f895effd700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f8954009990 tx=0x7f8954009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:37.610 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8954018070 con 0x7f89600f6860 2022-02-02T15:21:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896010c6a0 con 0x7f89600f6860 2022-02-02T15:21:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8954007ba0 con 0x7f89600f6860 2022-02-02T15:21:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f895401c3c0 con 0x7f89600f6860 2022-02-02T15:21:37.611 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.615+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896010cc00 con 0x7f89600f6860 2022-02-02T15:21:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.616+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8960045ad0 con 0x7f89600f6860 2022-02-02T15:21:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.617+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f895401d420 con 0x7f89600f6860 2022-02-02T15:21:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.617+0000 7f8947fff700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 0x7f8948067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.612 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.617+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8954083980 con 0x7f89600f6860 2022-02-02T15:21:37.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.617+0000 7f895f7fe700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 0x7f8948067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.618+0000 7f895f7fe700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 0x7f8948067290 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f8960060060 tx=0x7f895000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:37.613 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.621+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8954051a30 con 0x7f89600f6860 2022-02-02T15:21:37.798 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.808+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8960057f10 con 0x7f8948064dd0 2022-02-02T15:21:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.810+0000 7f8947fff700 1 -- 172.21.15.33:0/1262386377 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8960057f10 con 0x7f8948064dd0 2022-02-02T15:21:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 msgr2=0x7f8948067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 0x7f8948067290 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f8960060060 tx=0x7f895000b040).stop 2022-02-02T15:21:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 msgr2=0x7f896010c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7f8954009990 tx=0x7f8954009b30).stop 2022-02-02T15:21:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 shutdown_connections 2022-02-02T15:21:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8948064dd0 0x7f8948067290 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.803 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89600f55c0 0x7f8960109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 --2- 172.21.15.33:0/1262386377 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89600f6860 0x7f896010c150 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.811+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 >> 172.21.15.33:0/1262386377 conn(0x7f89600f0d40 msgr2=0x7f89600fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:37.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.812+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 shutdown_connections 2022-02-02T15:21:37.804 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.812+0000 7f8965db7700 1 -- 172.21.15.33:0/1262386377 wait complete. 2022-02-02T15:21:37.811 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:21:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 -- 172.21.15.33:0/670265345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f5430 msgr2=0x7f4b500f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/670265345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f5430 0x7f4b500f5850 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 rx=0x7f4b40004660 tx=0x7f4b40009b30).stop 2022-02-02T15:21:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 -- 172.21.15.33:0/670265345 shutdown_connections 2022-02-02T15:21:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/670265345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f66d0 0x7f4b500f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/670265345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f5430 0x7f4b500f5850 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 -- 172.21.15.33:0/670265345 >> 172.21.15.33:0/670265345 conn(0x7f4b500f0b90 msgr2=0x7f4b500f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 -- 172.21.15.33:0/670265345 shutdown_connections 2022-02-02T15:21:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.913+0000 7f4b4ffff700 1 -- 172.21.15.33:0/670265345 wait complete. 2022-02-02T15:21:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.914+0000 7f4b4ffff700 1 Processor -- start 2022-02-02T15:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.914+0000 7f4b4ffff700 1 -- start start 2022-02-02T15:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 0x7f4b50109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4ffff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b500603e0 con 0x7f4b500f66d0 2022-02-02T15:21:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4ffff700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b50060520 con 0x7f4b500f5430 2022-02-02T15:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37156/0 (socket says 172.21.15.33:37156) 2022-02-02T15:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 -- 172.21.15.33:0/3025454178 learned_addr learned my addr 172.21.15.33:0/3025454178 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4effd700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 0x7f4b50109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 -- 172.21.15.33:0/3025454178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 msgr2=0x7f4b50109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 0x7f4b50109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 -- 172.21.15.33:0/3025454178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40005040 con 0x7f4b500f66d0 2022-02-02T15:21:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4effd700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 0x7f4b50109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2022-02-02T15:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.915+0000 7f4b4e7fc700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f4b440026d0 tx=0x7f4b44009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.916+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b440079c0 con 0x7f4b500f66d0 2022-02-02T15:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.916+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5010c540 con 0x7f4b500f66d0 2022-02-02T15:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.916+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f4b4400f040 con 0x7f4b500f66d0 2022-02-02T15:21:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.916+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b440148b0 con 0x7f4b500f66d0 2022-02-02T15:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.916+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5010cb00 con 0x7f4b500f66d0 2022-02-02T15:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.917+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b50045ad0 con 0x7f4b500f66d0 2022-02-02T15:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.918+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f4b44007b20 con 0x7f4b500f66d0 2022-02-02T15:21:37.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.918+0000 7f4b377fe700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 0x7f4b380672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.918+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f4b44081e40 con 0x7f4b500f66d0 2022-02-02T15:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.918+0000 7f4b4effd700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 0x7f4b380672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:37.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.919+0000 7f4b4effd700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 0x7f4b380672e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4b40013690 tx=0x7f4b40009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:37.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:37.922+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f4b4404fef0 con 0x7f4b500f66d0 2022-02-02T15:21:38.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.105+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b50057f10 con 0x7f4b38064e20 2022-02-02T15:21:38.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.119+0000 7f4b377fe700 1 -- 172.21.15.33:0/3025454178 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f4b50057f10 con 0x7f4b38064e20 2022-02-02T15:21:38.109 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:21:38.109 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (106m) 69m ago 107m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:21:38.110 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (99m) 69m ago 107m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:21:38.110 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (99m) 69m ago 107m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:21:38.110 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (106m) 69m ago 107m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:21:38.110 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (100m) 69m ago 104m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:21:38.110 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (101m) 69m ago 104m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:21:38.111 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (101m) 69m ago 104m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:21:38.111 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (104m) 69m ago 104m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:21:38.111 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (101m) 69m ago 109m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:21:38.111 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (101m) 69m ago 107m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:21:38.112 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (100m) 69m ago 109m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:21:38.112 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (100m) 69m ago 107m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:21:38.112 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (107m) 69m ago 107m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:21:38.112 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (107m) 69m ago 107m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:21:38.112 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 69m ago 106m - 4096M 2022-02-02T15:21:38.113 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (106m) 69m ago 106m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:21:38.113 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (106m) 69m ago 106m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:21:38.113 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (105m) 69m ago 105m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:21:38.113 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (105m) 69m ago 105m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:21:38.114 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (105m) 69m ago 105m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:21:38.114 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (106m) 69m ago 107m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:21:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 msgr2=0x7f4b380672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 0x7f4b380672e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f4b40013690 tx=0x7f4b40009b30).stop 2022-02-02T15:21:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 msgr2=0x7f4b5010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f4b440026d0 tx=0x7f4b44009de0).stop 2022-02-02T15:21:38.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 shutdown_connections 2022-02-02T15:21:38.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f4b38064e20 0x7f4b380672e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.116 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b500f5430 0x7f4b50109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 --2- 172.21.15.33:0/3025454178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b500f66d0 0x7f4b5010bf90 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 >> 172.21.15.33:0/3025454178 conn(0x7f4b500f0b90 msgr2=0x7f4b500fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 shutdown_connections 2022-02-02T15:21:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.121+0000 7f4b4ffff700 1 -- 172.21.15.33:0/3025454178 wait complete. 2022-02-02T15:21:38.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 -- 172.21.15.33:0/3086375927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f66e0 msgr2=0x7fbdec0f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3086375927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f66e0 0x7fbdec0f6b00 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7fbde8004660 tx=0x7fbde8009b30).stop 2022-02-02T15:21:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 -- 172.21.15.33:0/3086375927 shutdown_connections 2022-02-02T15:21:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3086375927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f7980 0x7fbdec0f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2022-02-02T15:21:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3086375927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f66e0 0x7fbdec0f6b00 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.221+0000 7fbdf341e700 1 -- 172.21.15.33:0/3086375927 >> 172.21.15.33:0/3086375927 conn(0x7fbdec0f1e40 msgr2=0x7fbdec0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:38.213 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:37 smithi033 ceph-mon[101165]: from='client.37234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:38.213 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:37 smithi033 ceph-mon[101165]: pgmap v3087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:38.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.222+0000 7fbdf341e700 1 -- 172.21.15.33:0/3086375927 shutdown_connections 2022-02-02T15:21:38.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.222+0000 7fbdf341e700 1 -- 172.21.15.33:0/3086375927 wait complete. 2022-02-02T15:21:38.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.222+0000 7fbdf341e700 1 Processor -- start 2022-02-02T15:21:38.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf341e700 1 -- start start 2022-02-02T15:21:38.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf341e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 0x7fbdec06b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf341e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf341e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec06a410 con 0x7fbdec0f7980 2022-02-02T15:21:38.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf341e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec06a550 con 0x7fbdec0f66e0 2022-02-02T15:21:38.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37166/0 (socket says 172.21.15.33:37166) 2022-02-02T15:21:38.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 -- 172.21.15.33:0/3240333111 learned_addr learned my addr 172.21.15.33:0/3240333111 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:38.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf11ba700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 0x7fbdec06b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 -- 172.21.15.33:0/3240333111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 msgr2=0x7fbdec06b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 0x7fbdec06b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 -- 172.21.15.33:0/3240333111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8005040 con 0x7fbdec0f7980 2022-02-02T15:21:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf11ba700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 0x7fbdec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:21:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.223+0000 7fbdf09b9700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fbddc00b410 tx=0x7fbddc006ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:38.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.224+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbddc0125f0 con 0x7fbdec0f7980 2022-02-02T15:21:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.224+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec06a830 con 0x7fbdec0f7980 2022-02-02T15:21:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.224+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fbddc012c00 con 0x7fbdec0f7980 2022-02-02T15:21:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.224+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbddc002ae0 con 0x7fbdec0f7980 2022-02-02T15:21:38.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.224+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec10efe0 con 0x7fbdec0f7980 2022-02-02T15:21:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.226+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec045ad0 con 0x7fbdec0f7980 2022-02-02T15:21:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.226+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fbddc00f030 con 0x7fbdec0f7980 2022-02-02T15:21:38.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.227+0000 7fbde1ffb700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 0x7fbdd8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.227+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fbddc081f80 con 0x7fbdec0f7980 2022-02-02T15:21:38.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.227+0000 7fbdf11ba700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 0x7fbdd8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.227+0000 7fbdf11ba700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 0x7fbdd8067290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fbde8004e30 tx=0x7fbde8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:38.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.231+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fbddc050110 con 0x7fbdec0f7980 2022-02-02T15:21:38.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:37 smithi037 ceph-mon[69017]: from='client.37234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:38.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:37 smithi037 ceph-mon[69017]: pgmap v3087: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:38.462 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.473+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdec027a00 con 0x7fbdec0f7980 2022-02-02T15:21:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.474+0000 7fbde1ffb700 1 -- 172.21.15.33:0/3240333111 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fbddc053730 con 0x7fbdec0f7980 2022-02-02T15:21:38.463 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:21:38.464 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:21:38.464 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:21:38.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:38.464 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:21:38.464 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:21:38.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:38.465 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:21:38.465 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:21:38.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:38.466 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:21:38.466 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:21:38.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:21:38.466 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:21:38.467 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:21:38.467 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:21:38.467 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:21:38.467 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:21:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 msgr2=0x7fbdd8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 0x7fbdd8067290 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7fbde8004e30 tx=0x7fbde8009b30).stop 2022-02-02T15:21:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 msgr2=0x7fbdec069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7fbddc00b410 tx=0x7fbddc006ef0).stop 2022-02-02T15:21:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 shutdown_connections 2022-02-02T15:21:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fbdd8064dd0 0x7fbdd8067290 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdec0f66e0 0x7fbdec06b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 --2- 172.21.15.33:0/3240333111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbdec0f7980 0x7fbdec069e20 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.476+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 >> 172.21.15.33:0/3240333111 conn(0x7fbdec0f1e40 msgr2=0x7fbdec0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.477+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 shutdown_connections 2022-02-02T15:21:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.477+0000 7fbdf341e700 1 -- 172.21.15.33:0/3240333111 wait complete. 2022-02-02T15:21:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 -- 172.21.15.33:0/4261806392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f55c0 msgr2=0x7f2eac0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 --2- 172.21.15.33:0/4261806392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f55c0 0x7f2eac0f59e0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 rx=0x7f2ea8004660 tx=0x7f2ea8009b30).stop 2022-02-02T15:21:38.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 -- 172.21.15.33:0/4261806392 shutdown_connections 2022-02-02T15:21:38.567 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 --2- 172.21.15.33:0/4261806392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f6860 0x7f2eac0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 --2- 172.21.15.33:0/4261806392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f55c0 0x7f2eac0f59e0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 -- 172.21.15.33:0/4261806392 >> 172.21.15.33:0/4261806392 conn(0x7f2eac0f0d40 msgr2=0x7f2eac0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:38.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 -- 172.21.15.33:0/4261806392 shutdown_connections 2022-02-02T15:21:38.568 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.577+0000 7f2eb4437700 1 -- 172.21.15.33:0/4261806392 wait complete. 2022-02-02T15:21:38.571 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 Processor -- start 2022-02-02T15:21:38.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 -- start start 2022-02-02T15:21:38.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.572 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0603e0 con 0x7f2eac0f6860 2022-02-02T15:21:38.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb4437700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac060520 con 0x7f2eac0f55c0 2022-02-02T15:21:38.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb19d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.573 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb19d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37176/0 (socket says 172.21.15.33:37176) 2022-02-02T15:21:38.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.578+0000 7f2eb19d2700 1 -- 172.21.15.33:0/1869012850 learned_addr learned my addr 172.21.15.33:0/1869012850 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:21:38.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb21d3700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb19d2700 1 -- 172.21.15.33:0/1869012850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 msgr2=0x7f2eac109c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.574 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb19d2700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac109c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb19d2700 1 -- 172.21.15.33:0/1869012850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8005040 con 0x7f2eac0f6860 2022-02-02T15:21:38.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb19d2700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f2ea000c530 tx=0x7f2ea0007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:38.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea000f650 con 0x7f2eac0f6860 2022-02-02T15:21:38.575 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac10c720 con 0x7f2eac0f6860 2022-02-02T15:21:38.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2ea000fc60 con 0x7f2eac0f6860 2022-02-02T15:21:38.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea0012c20 con 0x7f2eac0f6860 2022-02-02T15:21:38.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.579+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac10cce0 con 0x7f2eac0f6860 2022-02-02T15:21:38.576 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.580+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac045ad0 con 0x7f2eac0f6860 2022-02-02T15:21:38.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.581+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2ea0010070 con 0x7f2eac0f6860 2022-02-02T15:21:38.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.581+0000 7f2e9effd700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:21:38.577 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.581+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2ea0081730 con 0x7f2eac0f6860 2022-02-02T15:21:38.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.581+0000 7f2eb21d3700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:21:38.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.582+0000 7f2eb21d3700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f2ea8013690 tx=0x7f2ea8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:21:38.578 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.586+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2ea004f7e0 con 0x7f2eac0f6860 2022-02-02T15:21:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.799+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2eac027a00 con 0x7f2eac0f6860 2022-02-02T15:21:38.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.800+0000 7f2e9effd700 1 -- 172.21.15.33:0/1869012850 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2ea0052e00 con 0x7f2eac0f6860 2022-02-02T15:21:38.789 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:21:38.790 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:21:38.790 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:21:38.790 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:21:38.790 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:21:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:21:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:21:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:21:38.791 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:21:38.792 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:21:38.792 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:21:38.792 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:21:38.792 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:21:38.793 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:21:38.793 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:21:38.793 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:21:38.793 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:21:38.793 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:21:38.794 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:21:38.794 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:21:38.794 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:21:38.795 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:21:38.795 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:21:38.795 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:21:38.795 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:21:38.796 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:21:38.796 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:21:38.796 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:21:38.796 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:21:38.797 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:21:38.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:38.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:38.797 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:21:38.798 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:21:38.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:38.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:38.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:38.798 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:21:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 msgr2=0x7f2e98067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f2ea8013690 tx=0x7f2ea8009b30).stop 2022-02-02T15:21:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 msgr2=0x7f2eac10c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:21:38.800 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 rx=0x7f2ea000c530 tx=0x7f2ea0007e20).stop 2022-02-02T15:21:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 shutdown_connections 2022-02-02T15:21:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2e98064dd0 0x7f2e98067290 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2eac0f55c0 0x7f2eac109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.801 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 --2- 172.21.15.33:0/1869012850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2eac0f6860 0x7f2eac10c170 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:21:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 >> 172.21.15.33:0/1869012850 conn(0x7f2eac0f0d40 msgr2=0x7f2eac0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:21:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 shutdown_connections 2022-02-02T15:21:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:21:38.802+0000 7f2eb4437700 1 -- 172.21.15.33:0/1869012850 wait complete. 2022-02-02T15:21:38.802 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:21:39.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:38 smithi033 ceph-mon[101165]: from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:39.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3240333111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:21:39.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:38 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1869012850' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:21:39.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:38 smithi037 ceph-mon[69017]: from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:21:39.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3240333111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:21:39.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:38 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1869012850' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:21:40.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:39 smithi033 ceph-mon[101165]: pgmap v3088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:40.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:39 smithi037 ceph-mon[69017]: pgmap v3088: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:42.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:41 smithi033 ceph-mon[101165]: pgmap v3089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:42.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:41 smithi037 ceph-mon[69017]: pgmap v3089: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:44.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:43 smithi033 ceph-mon[101165]: pgmap v3090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:44.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:43 smithi037 ceph-mon[69017]: pgmap v3090: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:46.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:45 smithi033 ceph-mon[101165]: pgmap v3091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:46.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:45 smithi037 ceph-mon[69017]: pgmap v3091: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:48.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:47 smithi033 ceph-mon[101165]: pgmap v3092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:48.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:47 smithi037 ceph-mon[69017]: pgmap v3092: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:50.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:49 smithi033 ceph-mon[101165]: pgmap v3093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:50.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:49 smithi037 ceph-mon[69017]: pgmap v3093: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:52.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:51 smithi033 ceph-mon[101165]: pgmap v3094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:52.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:51 smithi037 ceph-mon[69017]: pgmap v3094: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:54.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:53 smithi033 ceph-mon[101165]: pgmap v3095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:54.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:53 smithi037 ceph-mon[69017]: pgmap v3095: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:55.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:21:55.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:54 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:21:55.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:21:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:54 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:21:56.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:55 smithi033 ceph-mon[101165]: pgmap v3096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:56.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:55 smithi037 ceph-mon[69017]: pgmap v3096: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:58.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:57 smithi033 ceph-mon[101165]: pgmap v3097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:21:58.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:57 smithi037 ceph-mon[69017]: pgmap v3097: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:00.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:21:59 smithi033 ceph-mon[101165]: pgmap v3098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:00.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:21:59 smithi037 ceph-mon[69017]: pgmap v3098: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:02.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:01 smithi033 ceph-mon[101165]: pgmap v3099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:02.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:01 smithi037 ceph-mon[69017]: pgmap v3099: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:04.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:03 smithi033 ceph-mon[101165]: pgmap v3100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:04.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:03 smithi037 ceph-mon[69017]: pgmap v3100: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:06.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:05 smithi033 ceph-mon[101165]: pgmap v3101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:06.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:05 smithi037 ceph-mon[69017]: pgmap v3101: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:08.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:07 smithi033 ceph-mon[101165]: pgmap v3102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:08.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:07 smithi037 ceph-mon[69017]: pgmap v3102: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:08.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 -- 172.21.15.33:0/3678580906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 msgr2=0x7ff3b00f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:08.907 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3678580906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b00f7a20 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 rx=0x7ff3a0004660 tx=0x7ff3a0009b30).stop 2022-02-02T15:22:08.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 -- 172.21.15.33:0/3678580906 shutdown_connections 2022-02-02T15:22:08.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3678580906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b00f7a20 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:08.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3678580906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 0x7ff3b00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:08.908 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 -- 172.21.15.33:0/3678580906 >> 172.21.15.33:0/3678580906 conn(0x7ff3b00f1f00 msgr2=0x7ff3b00f4320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 -- 172.21.15.33:0/3678580906 shutdown_connections 2022-02-02T15:22:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.917+0000 7ff3b5685700 1 -- 172.21.15.33:0/3678580906 wait complete. 2022-02-02T15:22:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 Processor -- start 2022-02-02T15:22:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 -- start start 2022-02-02T15:22:08.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 0x7ff3b006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:08.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:08.910 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b006a380 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.918+0000 7ff3b5685700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b006a4c0 con 0x7ff3b00f66e0 2022-02-02T15:22:08.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:08.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37186/0 (socket says 172.21.15.33:37186) 2022-02-02T15:22:08.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 -- 172.21.15.33:0/3074791301 learned_addr learned my addr 172.21.15.33:0/3074791301 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:08.911 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3aeffd700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 0x7ff3b006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:08.913 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 -- 172.21.15.33:0/3074791301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 msgr2=0x7ff3b006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 0x7ff3b006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 -- 172.21.15.33:0/3074791301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0005040 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3ae7fc700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7ff3a0000c00 tx=0x7ff3a000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a0019070 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b006a740 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff3a0007e70 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3a0014ce0 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.915 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.919+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b006aca0 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.920+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b0045ad0 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.921+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff3a0025070 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.921+0000 7ff3977fe700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 0x7ff398067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:08.916 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.922+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff3a00829f0 con 0x7ff3b00f6ff0 2022-02-02T15:22:08.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.922+0000 7ff3aeffd700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 0x7ff398067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:08.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.922+0000 7ff3aeffd700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 0x7ff398067290 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7ff3b006b730 tx=0x7ff3a400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:08.917 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:08.926+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff3a0084e60 con 0x7ff3b00f6ff0 2022-02-02T15:22:09.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.116+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3b00ff080 con 0x7ff398064dd0 2022-02-02T15:22:09.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.117+0000 7ff3977fe700 1 -- 172.21.15.33:0/3074791301 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff3a400f040 con 0x7ff398064dd0 2022-02-02T15:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 msgr2=0x7ff398067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 0x7ff398067290 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7ff3b006b730 tx=0x7ff3a400b040).stop 2022-02-02T15:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 msgr2=0x7ff3b0069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 rx=0x7ff3a0000c00 tx=0x7ff3a000b040).stop 2022-02-02T15:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 shutdown_connections 2022-02-02T15:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff398064dd0 0x7ff398067290 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3b00f66e0 0x7ff3b006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 --2- 172.21.15.33:0/3074791301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff3b00f6ff0 0x7ff3b0069e20 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.109 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.119+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 >> 172.21.15.33:0/3074791301 conn(0x7ff3b00f1f00 msgr2=0x7ff3b00fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.120+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 shutdown_connections 2022-02-02T15:22:09.110 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.120+0000 7ff3b5685700 1 -- 172.21.15.33:0/3074791301 wait complete. 2022-02-02T15:22:09.118 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:22:09.210 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 -- 172.21.15.33:0/2378663341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f55c0 msgr2=0x7efd680f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 --2- 172.21.15.33:0/2378663341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f55c0 0x7efd680f59e0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 rx=0x7efd5c004660 tx=0x7efd5c009b30).stop 2022-02-02T15:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 -- 172.21.15.33:0/2378663341 shutdown_connections 2022-02-02T15:22:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 --2- 172.21.15.33:0/2378663341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f6860 0x7efd680f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 --2- 172.21.15.33:0/2378663341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f55c0 0x7efd680f59e0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 -- 172.21.15.33:0/2378663341 >> 172.21.15.33:0/2378663341 conn(0x7efd680f0d40 msgr2=0x7efd680f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 -- 172.21.15.33:0/2378663341 shutdown_connections 2022-02-02T15:22:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.221+0000 7efd70792700 1 -- 172.21.15.33:0/2378663341 wait complete. 2022-02-02T15:22:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 Processor -- start 2022-02-02T15:22:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 -- start start 2022-02-02T15:22:09.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f55c0 0x7efd68109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd680603c0 con 0x7efd680f6860 2022-02-02T15:22:09.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd70792700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd68060500 con 0x7efd680f55c0 2022-02-02T15:22:09.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37196/0 (socket says 172.21.15.33:37196) 2022-02-02T15:22:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 -- 172.21.15.33:0/1939184657 learned_addr learned my addr 172.21.15.33:0/1939184657 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6e52e700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f55c0 0x7efd68109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 -- 172.21.15.33:0/1939184657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f55c0 msgr2=0x7efd68109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f55c0 0x7efd68109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 -- 172.21.15.33:0/1939184657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c005040 con 0x7efd680f6860 2022-02-02T15:22:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.222+0000 7efd6dd2d700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7efd64002700 tx=0x7efd64009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.223+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd640079c0 con 0x7efd680f6860 2022-02-02T15:22:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.223+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efd6400f040 con 0x7efd680f6860 2022-02-02T15:22:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.223+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd640147b0 con 0x7efd680f6860 2022-02-02T15:22:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.223+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6810c760 con 0x7efd680f6860 2022-02-02T15:22:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.223+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6810ccf0 con 0x7efd680f6860 2022-02-02T15:22:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.224+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd680f49b0 con 0x7efd680f6860 2022-02-02T15:22:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.224+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efd6401b060 con 0x7efd680f6860 2022-02-02T15:22:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.225+0000 7efd5affd700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 0x7efd54067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.225+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efd64081860 con 0x7efd680f6860 2022-02-02T15:22:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.225+0000 7efd6e52e700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 0x7efd54067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.225+0000 7efd6e52e700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 0x7efd54067290 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7efd5c013690 tx=0x7efd5c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.229+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efd6404f910 con 0x7efd680f6860 2022-02-02T15:22:09.399 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.410+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efd680fdf00 con 0x7efd54064dd0 2022-02-02T15:22:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.425+0000 7efd5affd700 1 -- 172.21.15.33:0/1939184657 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7efd680fdf00 con 0x7efd54064dd0 2022-02-02T15:22:09.414 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:22:09.414 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (107m) 69m ago 108m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:22:09.414 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (100m) 69m ago 108m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:22:09.415 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (100m) 69m ago 107m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:22:09.415 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (107m) 69m ago 108m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:22:09.415 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (100m) 69m ago 104m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:22:09.415 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (101m) 69m ago 104m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:22:09.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (102m) 69m ago 104m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:22:09.416 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (104m) 69m ago 104m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:22:09.416 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (102m) 69m ago 109m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:22:09.416 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (101m) 69m ago 107m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:22:09.416 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (101m) 69m ago 109m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:22:09.417 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (101m) 69m ago 107m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:22:09.417 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (108m) 69m ago 108m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:22:09.417 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (107m) 69m ago 107m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:22:09.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 69m ago 107m - 4096M 2022-02-02T15:22:09.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (106m) 69m ago 106m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:22:09.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (106m) 69m ago 106m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:22:09.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (106m) 69m ago 106m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:22:09.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (106m) 69m ago 106m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:22:09.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (105m) 69m ago 105m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:22:09.419 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (107m) 69m ago 108m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:22:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 msgr2=0x7efd54067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 0x7efd54067290 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7efd5c013690 tx=0x7efd5c009b30).stop 2022-02-02T15:22:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 msgr2=0x7efd6810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 rx=0x7efd64002700 tx=0x7efd64009de0).stop 2022-02-02T15:22:09.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 shutdown_connections 2022-02-02T15:22:09.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efd54064dd0 0x7efd54067290 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd680f55c0 0x7efd68109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.421 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 --2- 172.21.15.33:0/1939184657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd680f6860 0x7efd6810c1b0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.427+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 >> 172.21.15.33:0/1939184657 conn(0x7efd680f0d40 msgr2=0x7efd680fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.428+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 shutdown_connections 2022-02-02T15:22:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.428+0000 7efd70792700 1 -- 172.21.15.33:0/1939184657 wait complete. 2022-02-02T15:22:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 -- 172.21.15.33:0/743835324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f6550 msgr2=0x7fe3f40f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 --2- 172.21.15.33:0/743835324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f6550 0x7fe3f40f69b0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 rx=0x7fe3e8004660 tx=0x7fe3e8009b30).stop 2022-02-02T15:22:09.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 -- 172.21.15.33:0/743835324 shutdown_connections 2022-02-02T15:22:09.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 --2- 172.21.15.33:0/743835324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f6550 0x7fe3f40f69b0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 --2- 172.21.15.33:0/743835324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f40f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 -- 172.21.15.33:0/743835324 >> 172.21.15.33:0/743835324 conn(0x7fe3f40f04c0 msgr2=0x7fe3f40f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 -- 172.21.15.33:0/743835324 shutdown_connections 2022-02-02T15:22:09.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.531+0000 7fe3f9888700 1 -- 172.21.15.33:0/743835324 wait complete. 2022-02-02T15:22:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 Processor -- start 2022-02-02T15:22:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 -- start start 2022-02-02T15:22:09.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f6550 0x7fe3f410c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40f5680 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.532+0000 7fe3f9888700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f40f57c0 con 0x7fe3f40f6550 2022-02-02T15:22:09.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37204/0 (socket says 172.21.15.33:37204) 2022-02-02T15:22:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 -- 172.21.15.33:0/1922989169 learned_addr learned my addr 172.21.15.33:0/1922989169 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:09.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f27fc700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f6550 0x7fe3f410c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 -- 172.21.15.33:0/1922989169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f6550 msgr2=0x7fe3f410c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f6550 0x7fe3f410c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 -- 172.21.15.33:0/1922989169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8005040 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f2ffd700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fe3e4002700 tx=0x7fe3e4009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3e40079c0 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe3e400f040 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe3e4014860 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f410c7a0 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.533+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f410cd30 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.534+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f40f4150 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.535+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe3e401b060 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.535+0000 7fe3db7fe700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 0x7fe3dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.535+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe3e4081940 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.535+0000 7fe3f27fc700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 0x7fe3dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.536+0000 7fe3f27fc700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 0x7fe3dc067290 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fe3e8004630 tx=0x7fe3e8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.539+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe3e404f9f0 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.768 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.779+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe3f40fdea0 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.769 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.779+0000 7fe3db7fe700 1 -- 172.21.15.33:0/1922989169 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fe3e40192d0 con 0x7fe3f40f5bb0 2022-02-02T15:22:09.769 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:22:09.769 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:22:09.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:22:09.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:09.770 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:22:09.770 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:22:09.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:09.771 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:22:09.771 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:22:09.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:09.772 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:22:09.772 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:22:09.772 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:09.772 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:22:09.773 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:22:09.773 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:22:09.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:22:09.773 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:22:09.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 msgr2=0x7fe3dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.774 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 0x7fe3dc067290 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7fe3e8004630 tx=0x7fe3e8009b30).stop 2022-02-02T15:22:09.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 msgr2=0x7fe3f4109cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7fe3e4002700 tx=0x7fe3e4009d80).stop 2022-02-02T15:22:09.775 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 shutdown_connections 2022-02-02T15:22:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe3dc064dd0 0x7fe3dc067290 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3f40f5bb0 0x7fe3f4109cf0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 --2- 172.21.15.33:0/1922989169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3f40f6550 0x7fe3f410c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 >> 172.21.15.33:0/1922989169 conn(0x7fe3f40f04c0 msgr2=0x7fe3f40fa450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 shutdown_connections 2022-02-02T15:22:09.777 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.781+0000 7fe3f9888700 1 -- 172.21.15.33:0/1922989169 wait complete. 2022-02-02T15:22:09.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 -- 172.21.15.33:0/906134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 msgr2=0x7f67ec0f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.875 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/906134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec0f59e0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f67e0004660 tx=0x7f67e0009b30).stop 2022-02-02T15:22:09.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 -- 172.21.15.33:0/906134157 shutdown_connections 2022-02-02T15:22:09.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/906134157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/906134157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec0f59e0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.876 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 -- 172.21.15.33:0/906134157 >> 172.21.15.33:0/906134157 conn(0x7f67ec0f0d40 msgr2=0x7f67ec0f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:09.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 -- 172.21.15.33:0/906134157 shutdown_connections 2022-02-02T15:22:09.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.884+0000 7f67f2c6e700 1 -- 172.21.15.33:0/906134157 wait complete. 2022-02-02T15:22:09.877 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 Processor -- start 2022-02-02T15:22:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 -- start start 2022-02-02T15:22:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec10c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.878 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec0603e0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f2c6e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec060520 con 0x7f67ec0f6860 2022-02-02T15:22:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f0a0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f0a0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37214/0 (socket says 172.21.15.33:37214) 2022-02-02T15:22:09.879 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.885+0000 7f67f0a0a700 1 -- 172.21.15.33:0/476789574 learned_addr learned my addr 172.21.15.33:0/476789574 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67ebfff700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec10c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f0a0a700 1 -- 172.21.15.33:0/476789574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 msgr2=0x7f67ec10c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f0a0a700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec10c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f0a0a700 1 -- 172.21.15.33:0/476789574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0005040 con 0x7f67ec0f55c0 2022-02-02T15:22:09.880 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67ebfff700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:22:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f0a0a700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f67e0013a70 tx=0x7f67e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e0018070 con 0x7f67ec0f55c0 2022-02-02T15:22:09.881 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f67e00097d0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec10c6c0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67e001c3c0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.886+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec10cc20 con 0x7f67ec0f55c0 2022-02-02T15:22:09.883 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.887+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec045ad0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.888+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f67e0007ba0 con 0x7f67ec0f55c0 2022-02-02T15:22:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.888+0000 7f67e97fa700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 0x7f67dc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.888+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f67e0083780 con 0x7f67ec0f55c0 2022-02-02T15:22:09.884 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.888+0000 7f67ebfff700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 0x7f67dc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.888+0000 7f67ebfff700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 0x7f67dc067290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f67d8009fd0 tx=0x7f67d800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:09.885 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:09.892+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f67e00518f0 con 0x7f67ec0f55c0 2022-02-02T15:22:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.105+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f67ec0fde90 con 0x7f67ec0f55c0 2022-02-02T15:22:10.094 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:09 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1922989169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:22:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.105+0000 7f67e97fa700 1 -- 172.21.15.33:0/476789574 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f67e0054f10 con 0x7f67ec0f55c0 2022-02-02T15:22:10.095 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:22:10.096 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:22:10.096 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:22:10.096 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:22:10.096 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:10.097 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:22:10.097 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:22:10.097 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:22:10.097 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:22:10.098 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:22:10.098 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:22:10.098 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:22:10.098 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:22:10.099 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:22:10.100 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:22:10.100 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:22:10.100 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:22:10.100 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:22:10.101 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:22:10.101 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:22:10.101 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:22:10.101 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:22:10.102 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:22:10.102 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:22:10.102 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:22:10.102 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:22:10.102 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:22:10.103 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:10.103 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:10.103 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:22:10.103 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:10.104 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:10.104 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:10.104 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:10.104 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.108+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 msgr2=0x7f67dc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.108+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 0x7f67dc067290 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f67d8009fd0 tx=0x7f67d800b040).stop 2022-02-02T15:22:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.108+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 msgr2=0x7f67ec109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.108+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7f67e0013a70 tx=0x7f67e0009b30).stop 2022-02-02T15:22:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 shutdown_connections 2022-02-02T15:22:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f67dc064dd0 0x7f67dc067290 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67ec0f55c0 0x7f67ec109c70 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 --2- 172.21.15.33:0/476789574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67ec0f6860 0x7f67ec10c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 >> 172.21.15.33:0/476789574 conn(0x7f67ec0f0d40 msgr2=0x7f67ec0fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 shutdown_connections 2022-02-02T15:22:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:10.109+0000 7f67f2c6e700 1 -- 172.21.15.33:0/476789574 wait complete. 2022-02-02T15:22:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:22:10.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:09 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1922989169' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:22:11.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:10 smithi033 ceph-mon[101165]: from='client.37250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:11.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:10 smithi033 ceph-mon[101165]: from='client.37254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:11.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:10 smithi033 ceph-mon[101165]: pgmap v3103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:11.230 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:10 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/476789574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:22:11.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:10 smithi037 ceph-mon[69017]: from='client.37250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:11.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:10 smithi037 ceph-mon[69017]: from='client.37254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:11.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:10 smithi037 ceph-mon[69017]: pgmap v3103: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:11.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:10 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/476789574' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:22:12.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:11 smithi033 ceph-mon[101165]: pgmap v3104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:12.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:11 smithi037 ceph-mon[69017]: pgmap v3104: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:14.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:13 smithi033 ceph-mon[101165]: pgmap v3105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:14.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:13 smithi037 ceph-mon[69017]: pgmap v3105: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:16.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:15 smithi033 ceph-mon[101165]: pgmap v3106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:16.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:15 smithi037 ceph-mon[69017]: pgmap v3106: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:18.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:17 smithi033 ceph-mon[101165]: pgmap v3107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:18.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:17 smithi037 ceph-mon[69017]: pgmap v3107: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:20.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:19 smithi033 ceph-mon[101165]: pgmap v3108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:20.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:19 smithi037 ceph-mon[69017]: pgmap v3108: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:22.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:21 smithi033 ceph-mon[101165]: pgmap v3109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:22.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:21 smithi037 ceph-mon[69017]: pgmap v3109: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:24.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:23 smithi033 ceph-mon[101165]: pgmap v3110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:24.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:23 smithi037 ceph-mon[69017]: pgmap v3110: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:26.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:25 smithi033 ceph-mon[101165]: pgmap v3111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:26.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:25 smithi037 ceph-mon[69017]: pgmap v3111: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:28.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:27 smithi033 ceph-mon[101165]: pgmap v3112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:28.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:27 smithi037 ceph-mon[69017]: pgmap v3112: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:31.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:30 smithi033 ceph-mon[101165]: pgmap v3113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:31.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:30 smithi037 ceph-mon[69017]: pgmap v3113: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:33.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:32 smithi037 ceph-mon[69017]: pgmap v3114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:33.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:32 smithi033 ceph-mon[101165]: pgmap v3114: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:35.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:34 smithi037 ceph-mon[69017]: pgmap v3115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:35.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:34 smithi033 ceph-mon[101165]: pgmap v3115: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:37.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:37 smithi037 ceph-mon[69017]: pgmap v3116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:37.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:37 smithi033 ceph-mon[101165]: pgmap v3116: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:39.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:39 smithi037 ceph-mon[69017]: pgmap v3117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:39.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:39 smithi033 ceph-mon[101165]: pgmap v3117: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:40.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- 172.21.15.33:0/2982005122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f5430 msgr2=0x7fe9d80f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.214 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/2982005122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f5430 0x7fe9d80f5850 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fe9cc004660 tx=0x7fe9cc009b30).stop 2022-02-02T15:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- 172.21.15.33:0/2982005122 shutdown_connections 2022-02-02T15:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/2982005122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f66d0 0x7fe9d80f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/2982005122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f5430 0x7fe9d80f5850 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.215 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- 172.21.15.33:0/2982005122 >> 172.21.15.33:0/2982005122 conn(0x7fe9d80f0b90 msgr2=0x7fe9d80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- 172.21.15.33:0/2982005122 shutdown_connections 2022-02-02T15:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- 172.21.15.33:0/2982005122 wait complete. 2022-02-02T15:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 Processor -- start 2022-02-02T15:22:40.216 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.225+0000 7fe9ddbda700 1 -- start start 2022-02-02T15:22:40.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9ddbda700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f5430 0x7fe9d8109a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9ddbda700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.219 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9ddbda700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80603e0 con 0x7fe9d80f66d0 2022-02-02T15:22:40.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9ddbda700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8060520 con 0x7fe9d80f5430 2022-02-02T15:22:40.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37226/0 (socket says 172.21.15.33:37226) 2022-02-02T15:22:40.220 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 -- 172.21.15.33:0/3014362229 learned_addr learned my addr 172.21.15.33:0/3014362229 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9dcbd8700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f5430 0x7fe9d8109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 -- 172.21.15.33:0/3014362229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f5430 msgr2=0x7fe9d8109a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f5430 0x7fe9d8109a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.226+0000 7fe9d7fff700 1 -- 172.21.15.33:0/3014362229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc005040 con 0x7fe9d80f66d0 2022-02-02T15:22:40.221 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9d7fff700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fe9c40026d0 tx=0x7fe9c4009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c40079c0 con 0x7fe9d80f66d0 2022-02-02T15:22:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d810c540 con 0x7fe9d80f66d0 2022-02-02T15:22:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fe9c400f040 con 0x7fe9d80f66d0 2022-02-02T15:22:40.222 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d810cb00 con 0x7fe9d80f66d0 2022-02-02T15:22:40.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.227+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c40148b0 con 0x7fe9d80f66d0 2022-02-02T15:22:40.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.228+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d8045ad0 con 0x7fe9d80f66d0 2022-02-02T15:22:40.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.228+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fe9c4007b20 con 0x7fe9d80f66d0 2022-02-02T15:22:40.223 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.229+0000 7fe9d57fa700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 0x7fe9c80672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.229+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fe9c40819e0 con 0x7fe9d80f66d0 2022-02-02T15:22:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.229+0000 7fe9dcbd8700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 0x7fe9c80672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.224 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.229+0000 7fe9dcbd8700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 0x7fe9c80672e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fe9cc013690 tx=0x7fe9cc009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.225 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.233+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fe9c404fa90 con 0x7fe9d80f66d0 2022-02-02T15:22:40.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.424+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d8057f10 con 0x7fe9c8064e20 2022-02-02T15:22:40.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.425+0000 7fe9d57fa700 1 -- 172.21.15.33:0/3014362229 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe9d8057f10 con 0x7fe9c8064e20 2022-02-02T15:22:40.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 msgr2=0x7fe9c80672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 0x7fe9c80672e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7fe9cc013690 tx=0x7fe9cc009b30).stop 2022-02-02T15:22:40.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 msgr2=0x7fe9d810bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 rx=0x7fe9c40026d0 tx=0x7fe9c4009de0).stop 2022-02-02T15:22:40.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 shutdown_connections 2022-02-02T15:22:40.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fe9c8064e20 0x7fe9c80672e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d80f5430 0x7fe9d8109a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 --2- 172.21.15.33:0/3014362229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80f66d0 0x7fe9d810bf90 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 >> 172.21.15.33:0/3014362229 conn(0x7fe9d80f0b90 msgr2=0x7fe9d80fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:40.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 shutdown_connections 2022-02-02T15:22:40.418 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.427+0000 7fe9ddbda700 1 -- 172.21.15.33:0/3014362229 wait complete. 2022-02-02T15:22:40.426 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:22:40.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 -- 172.21.15.33:0/3564602655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 msgr2=0x7f69b40f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/3564602655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b40f7de0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7f69a8004660 tx=0x7f69a8009b30).stop 2022-02-02T15:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 -- 172.21.15.33:0/3564602655 shutdown_connections 2022-02-02T15:22:40.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/3564602655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b40f7de0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/3564602655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 0x7f69b40f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 -- 172.21.15.33:0/3564602655 >> 172.21.15.33:0/3564602655 conn(0x7f69b40f1e40 msgr2=0x7f69b40f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 -- 172.21.15.33:0/3564602655 shutdown_connections 2022-02-02T15:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.529+0000 7f69bc6cd700 1 -- 172.21.15.33:0/3564602655 wait complete. 2022-02-02T15:22:40.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 Processor -- start 2022-02-02T15:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 -- start start 2022-02-02T15:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 0x7f69b4106f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b41079b0 con 0x7f69b40f7980 2022-02-02T15:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69bc6cd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b4107af0 con 0x7f69b40f66e0 2022-02-02T15:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37236/0 (socket says 172.21.15.33:37236) 2022-02-02T15:22:40.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 -- 172.21.15.33:0/728659709 learned_addr learned my addr 172.21.15.33:0/728659709 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69ba469700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 0x7f69b4106f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 -- 172.21.15.33:0/728659709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 msgr2=0x7f69b4106f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 0x7f69b4106f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.524 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 -- 172.21.15.33:0/728659709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8005040 con 0x7f69b40f7980 2022-02-02T15:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.530+0000 7f69b9c68700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f69a8002040 tx=0x7f69a800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.531+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a8019070 con 0x7f69b40f7980 2022-02-02T15:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.531+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b4108430 con 0x7f69b40f7980 2022-02-02T15:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.531+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f69a8007e70 con 0x7f69b40f7980 2022-02-02T15:22:40.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.531+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69a8014db0 con 0x7f69b40f7980 2022-02-02T15:22:40.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.531+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b4108990 con 0x7f69b40f7980 2022-02-02T15:22:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.532+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b4045ad0 con 0x7f69b40f7980 2022-02-02T15:22:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.532+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f69a8025070 con 0x7f69b40f7980 2022-02-02T15:22:40.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.532+0000 7f69a6ffd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 0x7f69a0067210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.532+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f69a8082a10 con 0x7f69b40f7980 2022-02-02T15:22:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.533+0000 7f69ba469700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 0x7f69a0067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.533+0000 7f69ba469700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 0x7f69a0067210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f69b0009fd0 tx=0x7f69b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.537+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f69a80544f0 con 0x7f69b40f7980 2022-02-02T15:22:40.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.717+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f69b4108c00 con 0x7f69a0064d50 2022-02-02T15:22:40.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.732+0000 7f69a6ffd700 1 -- 172.21.15.33:0/728659709 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f69b4108c00 con 0x7f69a0064d50 2022-02-02T15:22:40.721 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:22:40.721 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (107m) 70m ago 108m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:22:40.721 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (101m) 70m ago 108m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:22:40.722 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (100m) 70m ago 108m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:22:40.722 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (107m) 70m ago 108m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:22:40.722 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (101m) 70m ago 105m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:22:40.722 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (102m) 70m ago 105m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:22:40.723 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (102m) 70m ago 105m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:22:40.723 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (105m) 70m ago 105m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:22:40.723 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (102m) 70m ago 110m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:22:40.723 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (102m) 70m ago 108m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:22:40.724 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (101m) 70m ago 110m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:22:40.724 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (101m) 70m ago 108m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:22:40.724 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (108m) 70m ago 108m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:22:40.724 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (108m) 70m ago 108m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:22:40.724 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 70m ago 107m - 4096M 2022-02-02T15:22:40.725 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (107m) 70m ago 107m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:22:40.725 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (107m) 70m ago 107m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:22:40.725 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (106m) 70m ago 106m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:22:40.725 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (106m) 70m ago 106m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:22:40.726 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (106m) 70m ago 106m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:22:40.726 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (107m) 70m ago 108m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:22:40.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 msgr2=0x7f69a0067210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 0x7f69a0067210 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f69b0009fd0 tx=0x7f69b000b040).stop 2022-02-02T15:22:40.727 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 msgr2=0x7f69b4107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 rx=0x7f69a8002040 tx=0x7f69a800b040).stop 2022-02-02T15:22:40.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 shutdown_connections 2022-02-02T15:22:40.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f69a0064d50 0x7f69a0067210 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.728 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b40f66e0 0x7f69b4106f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 --2- 172.21.15.33:0/728659709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69b40f7980 0x7f69b4107400 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 >> 172.21.15.33:0/728659709 conn(0x7f69b40f1e40 msgr2=0x7f69b40fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:40.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 shutdown_connections 2022-02-02T15:22:40.729 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.734+0000 7f69bc6cd700 1 -- 172.21.15.33:0/728659709 wait complete. 2022-02-02T15:22:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 -- 172.21.15.33:0/764931830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 msgr2=0x7fa0580f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 --2- 172.21.15.33:0/764931830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa0580f59e0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7fa054004660 tx=0x7fa054009b30).stop 2022-02-02T15:22:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 -- 172.21.15.33:0/764931830 shutdown_connections 2022-02-02T15:22:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 --2- 172.21.15.33:0/764931830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 0x7fa0580f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 --2- 172.21.15.33:0/764931830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa0580f59e0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.833+0000 7fa05f95e700 1 -- 172.21.15.33:0/764931830 >> 172.21.15.33:0/764931830 conn(0x7fa0580f0d40 msgr2=0x7fa0580f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.834+0000 7fa05f95e700 1 -- 172.21.15.33:0/764931830 shutdown_connections 2022-02-02T15:22:40.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.834+0000 7fa05f95e700 1 -- 172.21.15.33:0/764931830 wait complete. 2022-02-02T15:22:40.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.834+0000 7fa05f95e700 1 Processor -- start 2022-02-02T15:22:40.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.834+0000 7fa05f95e700 1 -- start start 2022-02-02T15:22:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05f95e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05f95e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 0x7fa05810c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05f95e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0580603e0 con 0x7fa0580f55c0 2022-02-02T15:22:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05f95e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa058060520 con 0x7fa0580f6860 2022-02-02T15:22:40.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37244/0 (socket says 172.21.15.33:37244) 2022-02-02T15:22:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 -- 172.21.15.33:0/177875921 learned_addr learned my addr 172.21.15.33:0/177875921 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05cef9700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 0x7fa05810c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 -- 172.21.15.33:0/177875921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 msgr2=0x7fa05810c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:40.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 0x7fa05810c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:40.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 -- 172.21.15.33:0/177875921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054005040 con 0x7fa0580f55c0 2022-02-02T15:22:40.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05d6fa700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fa054013a70 tx=0x7fa054009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa054018070 con 0x7fa0580f55c0 2022-02-02T15:22:40.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fa0540097d0 con 0x7fa0580f55c0 2022-02-02T15:22:40.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05810c6c0 con 0x7fa0580f55c0 2022-02-02T15:22:40.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.835+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa05401de80 con 0x7fa0580f55c0 2022-02-02T15:22:40.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.836+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa058105a50 con 0x7fa0580f55c0 2022-02-02T15:22:40.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.837+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa058045ad0 con 0x7fa0580f55c0 2022-02-02T15:22:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.838+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fa054007ba0 con 0x7fa0580f55c0 2022-02-02T15:22:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.838+0000 7fa049ffb700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 0x7fa04406b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.838+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fa054083ce0 con 0x7fa0580f55c0 2022-02-02T15:22:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.841+0000 7fa05cef9700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 0x7fa04406b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:40.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.841+0000 7fa05cef9700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 0x7fa04406b6a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fa04c004c40 tx=0x7fa04c00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:40.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:40.843+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fa054051e30 con 0x7fa0580f55c0 2022-02-02T15:22:41.074 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.085+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa0580fde80 con 0x7fa0580f55c0 2022-02-02T15:22:41.074 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:41 smithi033 ceph-mon[101165]: pgmap v3118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:41.075 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:41 smithi033 ceph-mon[101165]: from='client.37266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:41.075 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:41 smithi033 ceph-mon[101165]: from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:41.075 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.085+0000 7fa049ffb700 1 -- 172.21.15.33:0/177875921 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7fa054055450 con 0x7fa0580f55c0 2022-02-02T15:22:41.076 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:22:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:22:41.076 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:22:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:22:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:22:41.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:22:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:22:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:22:41.078 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:22:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:22:41.079 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:22:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:22:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:22:41.080 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:22:41.080 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:22:41.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 msgr2=0x7fa04406b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.081 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 0x7fa04406b6a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7fa04c004c40 tx=0x7fa04c00b040).stop 2022-02-02T15:22:41.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 msgr2=0x7fa058109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 rx=0x7fa054013a70 tx=0x7fa054009b30).stop 2022-02-02T15:22:41.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 shutdown_connections 2022-02-02T15:22:41.082 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fa0440691e0 0x7fa04406b6a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0580f55c0 0x7fa058109c70 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 --2- 172.21.15.33:0/177875921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0580f6860 0x7fa05810c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 >> 172.21.15.33:0/177875921 conn(0x7fa0580f0d40 msgr2=0x7fa0580fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:41.083 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 shutdown_connections 2022-02-02T15:22:41.084 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.087+0000 7fa05f95e700 1 -- 172.21.15.33:0/177875921 wait complete. 2022-02-02T15:22:41.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.188+0000 7fb63affa700 1 -- 172.21.15.33:0/368776899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f6520 msgr2=0x7fb6340f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.179 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.188+0000 7fb63affa700 1 --2- 172.21.15.33:0/368776899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f6520 0x7fb6340f6940 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fb630004660 tx=0x7fb630009b30).stop 2022-02-02T15:22:41.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- 172.21.15.33:0/368776899 shutdown_connections 2022-02-02T15:22:41.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 --2- 172.21.15.33:0/368776899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f77c0 0x7fb6340f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 --2- 172.21.15.33:0/368776899 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f6520 0x7fb6340f6940 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.180 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- 172.21.15.33:0/368776899 >> 172.21.15.33:0/368776899 conn(0x7fb6340f1ca0 msgr2=0x7fb6340f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:41.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- 172.21.15.33:0/368776899 shutdown_connections 2022-02-02T15:22:41.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- 172.21.15.33:0/368776899 wait complete. 2022-02-02T15:22:41.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 Processor -- start 2022-02-02T15:22:41.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- start start 2022-02-02T15:22:41.181 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f6520 0x7fb63406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:41.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:41.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406a380 con 0x7fb6340f77c0 2022-02-02T15:22:41.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.189+0000 7fb63affa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63406a4c0 con 0x7fb6340f6520 2022-02-02T15:22:41.182 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:41.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37256/0 (socket says 172.21.15.33:37256) 2022-02-02T15:22:41.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb639ff8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f6520 0x7fb63406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:41.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 -- 172.21.15.33:0/1737214662 learned_addr learned my addr 172.21.15.33:0/1737214662 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:22:41.183 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 -- 172.21.15.33:0/1737214662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f6520 msgr2=0x7fb63406b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f6520 0x7fb63406b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 -- 172.21.15.33:0/1737214662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630005040 con 0x7fb6340f77c0 2022-02-02T15:22:41.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb6397f7700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fb6240026d0 tx=0x7fb624009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:41.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6240079c0 con 0x7fb6340f77c0 2022-02-02T15:22:41.184 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63406a7a0 con 0x7fb6340f77c0 2022-02-02T15:22:41.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb62400f040 con 0x7fb6340f77c0 2022-02-02T15:22:41.185 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6240148b0 con 0x7fb6340f77c0 2022-02-02T15:22:41.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.190+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63410edb0 con 0x7fb6340f77c0 2022-02-02T15:22:41.186 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.191+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb634045ad0 con 0x7fb6340f77c0 2022-02-02T15:22:41.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.192+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb624007b20 con 0x7fb6340f77c0 2022-02-02T15:22:41.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.192+0000 7fb62a7fc700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 0x7fb6200672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:22:41.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.192+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb624081a30 con 0x7fb6340f77c0 2022-02-02T15:22:41.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.193+0000 7fb639ff8700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 0x7fb6200672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:22:41.187 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.193+0000 7fb639ff8700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 0x7fb6200672e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fb63406b730 tx=0x7fb630009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:22:41.188 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.197+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb62404fae0 con 0x7fb6340f77c0 2022-02-02T15:22:41.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:41 smithi037 ceph-mon[69017]: pgmap v3118: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:41.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:41 smithi037 ceph-mon[69017]: from='client.37266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:41.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:41 smithi037 ceph-mon[69017]: from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:22:41.397 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.409+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb634027a00 con 0x7fb6340f77c0 2022-02-02T15:22:41.398 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.409+0000 7fb62a7fc700 1 -- 172.21.15.33:0/1737214662 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fb624053100 con 0x7fb6340f77c0 2022-02-02T15:22:41.398 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:22:41.399 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:22:41.399 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:22:41.399 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:22:41.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:41.400 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:22:41.400 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:22:41.400 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:22:41.400 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:22:41.401 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:22:41.401 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:22:41.401 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:22:41.401 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:22:41.401 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:22:41.402 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:22:41.402 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:22:41.402 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:22:41.402 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:22:41.402 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:22:41.403 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:22:41.403 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:22:41.403 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:22:41.403 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:22:41.403 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:22:41.404 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:22:41.404 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:22:41.404 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:22:41.404 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:22:41.405 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:22:41.405 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:22:41.405 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:22:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:41.405 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:41.406 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:22:41.406 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:22:41.406 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:41.406 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:41.406 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:41.407 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:22:41.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 msgr2=0x7fb6200672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 0x7fb6200672e0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7fb63406b730 tx=0x7fb630009b30).stop 2022-02-02T15:22:41.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 msgr2=0x7fb634069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:22:41.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fb6240026d0 tx=0x7fb624009de0).stop 2022-02-02T15:22:41.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 shutdown_connections 2022-02-02T15:22:41.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb620064e20 0x7fb6200672e0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6340f6520 0x7fb63406b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 --2- 172.21.15.33:0/1737214662 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6340f77c0 0x7fb634069e20 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:22:41.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 >> 172.21.15.33:0/1737214662 conn(0x7fb6340f1ca0 msgr2=0x7fb6340fb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:22:41.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 shutdown_connections 2022-02-02T15:22:41.410 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:22:41.411+0000 7fb63affa700 1 -- 172.21.15.33:0/1737214662 wait complete. 2022-02-02T15:22:41.410 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:22:42.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:42 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/177875921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:22:42.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:42 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1737214662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:22:42.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:42 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/177875921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:22:42.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:42 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1737214662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:22:43.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:43 smithi037 ceph-mon[69017]: pgmap v3119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:43.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:43 smithi033 ceph-mon[101165]: pgmap v3119: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:45.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:45 smithi037 ceph-mon[69017]: pgmap v3120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:45.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:45 smithi033 ceph-mon[101165]: pgmap v3120: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:47.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:47 smithi037 ceph-mon[69017]: pgmap v3121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:47.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:47 smithi033 ceph-mon[101165]: pgmap v3121: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:49.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:49 smithi037 ceph-mon[69017]: pgmap v3122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:49.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:49 smithi033 ceph-mon[101165]: pgmap v3122: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:51.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:51 smithi037 ceph-mon[69017]: pgmap v3123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:51.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:51 smithi033 ceph-mon[101165]: pgmap v3123: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:53.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:53 smithi037 ceph-mon[69017]: pgmap v3124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:53.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:53 smithi033 ceph-mon[101165]: pgmap v3124: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:55.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:55 smithi037 ceph-mon[69017]: pgmap v3125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:22:55.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:22:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:55 smithi033 ceph-mon[101165]: pgmap v3125: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:22:55.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:22:57.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:57 smithi037 ceph-mon[69017]: pgmap v3126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:57.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:57 smithi033 ceph-mon[101165]: pgmap v3126: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:59.279 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:22:59 smithi037 ceph-mon[69017]: pgmap v3127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:22:59.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:22:59 smithi033 ceph-mon[101165]: pgmap v3127: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:01.280 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:01 smithi037 ceph-mon[69017]: pgmap v3128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:01.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:01 smithi033 ceph-mon[101165]: pgmap v3128: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:03.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:03 smithi033 ceph-mon[101165]: pgmap v3129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:03.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:03 smithi037 ceph-mon[69017]: pgmap v3129: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:05.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:05 smithi033 ceph-mon[101165]: pgmap v3130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:05.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:05 smithi037 ceph-mon[69017]: pgmap v3130: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:07.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:07 smithi037 ceph-mon[69017]: pgmap v3131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:07.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:07 smithi033 ceph-mon[101165]: pgmap v3131: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:09.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:09 smithi033 ceph-mon[101165]: pgmap v3132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:09.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:09 smithi037 ceph-mon[69017]: pgmap v3132: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:11.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:11 smithi033 ceph-mon[101165]: pgmap v3133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.527+0000 7ff08431b700 1 -- 172.21.15.33:0/4025355959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06a350 msgr2=0x7ff07c06a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.527+0000 7ff08431b700 1 --2- 172.21.15.33:0/4025355959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06a350 0x7ff07c06a7d0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7ff070004660 tx=0x7ff070009b30).stop 2022-02-02T15:23:11.518 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- 172.21.15.33:0/4025355959 shutdown_connections 2022-02-02T15:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 --2- 172.21.15.33:0/4025355959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06a350 0x7ff07c06a7d0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 --2- 172.21.15.33:0/4025355959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06b960 0x7ff07c069e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- 172.21.15.33:0/4025355959 >> 172.21.15.33:0/4025355959 conn(0x7ff07c0f1e20 msgr2=0x7ff07c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- 172.21.15.33:0/4025355959 shutdown_connections 2022-02-02T15:23:11.519 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- 172.21.15.33:0/4025355959 wait complete. 2022-02-02T15:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 Processor -- start 2022-02-02T15:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- start start 2022-02-02T15:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06a350 0x7ff07c1090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.520 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c109b60 con 0x7ff07c06b960 2022-02-02T15:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.528+0000 7ff08431b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c109ca0 con 0x7ff07c06a350 2022-02-02T15:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37264/0 (socket says 172.21.15.33:37264) 2022-02-02T15:23:11.521 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 -- 172.21.15.33:0/2754422866 learned_addr learned my addr 172.21.15.33:0/2754422866 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0820b7700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06a350 0x7ff07c1090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 -- 172.21.15.33:0/2754422866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06a350 msgr2=0x7ff07c1090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06a350 0x7ff07c1090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 -- 172.21.15.33:0/2754422866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070005040 con 0x7ff07c06b960 2022-02-02T15:23:11.522 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff0818b6700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7ff070000c00 tx=0x7ff07000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070019070 con 0x7ff07c06b960 2022-02-02T15:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ff070007e70 con 0x7ff07c06b960 2022-02-02T15:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.529+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c10a5e0 con 0x7ff07c06b960 2022-02-02T15:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.530+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff070014ce0 con 0x7ff07c06b960 2022-02-02T15:23:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.530+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c10ab40 con 0x7ff07c06b960 2022-02-02T15:23:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.531+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c045ad0 con 0x7ff07c06b960 2022-02-02T15:23:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.531+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ff070025070 con 0x7ff07c06b960 2022-02-02T15:23:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.531+0000 7ff06effd700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 0x7ff068067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.531+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ff070082a30 con 0x7ff07c06b960 2022-02-02T15:23:11.525 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.532+0000 7ff0820b7700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 0x7ff068067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.532+0000 7ff0820b7700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 0x7ff068067290 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff078009fd0 tx=0x7ff07800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.536+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ff070054510 con 0x7ff07c06b960 2022-02-02T15:23:11.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:11 smithi037 ceph-mon[69017]: pgmap v3133: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.726+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff07c101180 con 0x7ff068064dd0 2022-02-02T15:23:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.727+0000 7ff06effd700 1 -- 172.21.15.33:0/2754422866 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7ff07c101180 con 0x7ff068064dd0 2022-02-02T15:23:11.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 msgr2=0x7ff068067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 0x7ff068067290 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff078009fd0 tx=0x7ff07800b040).stop 2022-02-02T15:23:11.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 msgr2=0x7ff07c1095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 rx=0x7ff070000c00 tx=0x7ff07000b040).stop 2022-02-02T15:23:11.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 shutdown_connections 2022-02-02T15:23:11.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ff068064dd0 0x7ff068067290 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.719 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff07c06a350 0x7ff07c1090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 --2- 172.21.15.33:0/2754422866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff07c06b960 0x7ff07c1095b0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 >> 172.21.15.33:0/2754422866 conn(0x7ff07c0f1e20 msgr2=0x7ff07c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:11.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 shutdown_connections 2022-02-02T15:23:11.720 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.729+0000 7ff08431b700 1 -- 172.21.15.33:0/2754422866 wait complete. 2022-02-02T15:23:11.728 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:23:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 -- 172.21.15.33:0/701872777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f55c0 msgr2=0x7f17700f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 --2- 172.21.15.33:0/701872777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f55c0 0x7f17700f59e0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f1760004660 tx=0x7f1760009b30).stop 2022-02-02T15:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 -- 172.21.15.33:0/701872777 shutdown_connections 2022-02-02T15:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 --2- 172.21.15.33:0/701872777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f6860 0x7f17700f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.820 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 --2- 172.21.15.33:0/701872777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f55c0 0x7f17700f59e0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 -- 172.21.15.33:0/701872777 >> 172.21.15.33:0/701872777 conn(0x7f17700f0d40 msgr2=0x7f17700f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 -- 172.21.15.33:0/701872777 shutdown_connections 2022-02-02T15:23:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.830+0000 7f1774cf8700 1 -- 172.21.15.33:0/701872777 wait complete. 2022-02-02T15:23:11.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 Processor -- start 2022-02-02T15:23:11.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 -- start start 2022-02-02T15:23:11.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f55c0 0x7f1770109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.824 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17700603c0 con 0x7f17700f6860 2022-02-02T15:23:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.831+0000 7f1774cf8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1770060500 con 0x7f17700f55c0 2022-02-02T15:23:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37274/0 (socket says 172.21.15.33:37274) 2022-02-02T15:23:11.825 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 -- 172.21.15.33:0/3303241623 learned_addr learned my addr 172.21.15.33:0/3303241623 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176e59c700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f55c0 0x7f1770109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 -- 172.21.15.33:0/3303241623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f55c0 msgr2=0x7f1770109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f55c0 0x7f1770109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 -- 172.21.15.33:0/3303241623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760005040 con 0x7f17700f6860 2022-02-02T15:23:11.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f176dd9b700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f175800c790 tx=0x7f1758007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:11.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1758002590 con 0x7f17700f6860 2022-02-02T15:23:11.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177010c740 con 0x7f17700f6860 2022-02-02T15:23:11.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f1758002ba0 con 0x7f17700f6860 2022-02-02T15:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1758013d90 con 0x7f17700f6860 2022-02-02T15:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.832+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177010ccd0 con 0x7f17700f6860 2022-02-02T15:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.833+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1770045ad0 con 0x7f17700f6860 2022-02-02T15:23:11.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.834+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f175801a060 con 0x7f17700f6860 2022-02-02T15:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.835+0000 7f1766ffd700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 0x7f175c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.835+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f1758081c40 con 0x7f17700f6860 2022-02-02T15:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.835+0000 7f176e59c700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 0x7f175c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:11.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.835+0000 7f176e59c700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 0x7f175c067290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f1760013690 tx=0x7f1760009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:11.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:11.839+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f175804fcf0 con 0x7f17700f6860 2022-02-02T15:23:12.010 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.022+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f17700fdf30 con 0x7f175c064dd0 2022-02-02T15:23:12.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.036+0000 7f1766ffd700 1 -- 172.21.15.33:0/3303241623 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f1760019040 con 0x7f175c064dd0 2022-02-02T15:23:12.025 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:23:12.025 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (108m) 70m ago 109m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:23:12.026 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (101m) 70m ago 109m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:23:12.026 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (101m) 70m ago 108m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:23:12.026 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (108m) 70m ago 109m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:23:12.026 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (102m) 70m ago 105m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:23:12.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (102m) 70m ago 105m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:23:12.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (103m) 70m ago 105m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:23:12.027 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (105m) 70m ago 105m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:23:12.027 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (103m) 70m ago 110m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:23:12.028 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (102m) 70m ago 108m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:23:12.028 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (102m) 70m ago 110m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:23:12.028 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (102m) 70m ago 108m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:23:12.028 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (109m) 70m ago 109m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:23:12.029 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (108m) 70m ago 108m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:23:12.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 70m ago 108m - 4096M 2022-02-02T15:23:12.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (107m) 70m ago 107m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:23:12.029 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (107m) 70m ago 107m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:23:12.030 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (107m) 70m ago 107m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:23:12.030 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (107m) 70m ago 107m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:23:12.030 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (106m) 70m ago 106m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:23:12.030 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (108m) 70m ago 109m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:23:12.031 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 msgr2=0x7f175c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 0x7f175c067290 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f1760013690 tx=0x7f1760009b30).stop 2022-02-02T15:23:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 msgr2=0x7f177010c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f175800c790 tx=0x7f1758007d70).stop 2022-02-02T15:23:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 shutdown_connections 2022-02-02T15:23:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f175c064dd0 0x7f175c067290 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17700f55c0 0x7f1770109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 --2- 172.21.15.33:0/3303241623 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17700f6860 0x7f177010c190 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 >> 172.21.15.33:0/3303241623 conn(0x7f17700f0d40 msgr2=0x7f17700fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:12.033 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 shutdown_connections 2022-02-02T15:23:12.034 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.038+0000 7f1774cf8700 1 -- 172.21.15.33:0/3303241623 wait complete. 2022-02-02T15:23:12.127 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:12 smithi033 ceph-mon[101165]: from='client.37282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 -- 172.21.15.33:0/3794074422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf8060310 msgr2=0x7efdf80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 --2- 172.21.15.33:0/3794074422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf8060310 0x7efdf80f9110 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7efde8004660 tx=0x7efde8009b30).stop 2022-02-02T15:23:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 -- 172.21.15.33:0/3794074422 shutdown_connections 2022-02-02T15:23:12.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 --2- 172.21.15.33:0/3794074422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf80f9690 0x7efdf80fbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 --2- 172.21.15.33:0/3794074422 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf8060310 0x7efdf80f9110 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 -- 172.21.15.33:0/3794074422 >> 172.21.15.33:0/3794074422 conn(0x7efdf80f0b90 msgr2=0x7efdf80f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 -- 172.21.15.33:0/3794074422 shutdown_connections 2022-02-02T15:23:12.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.138+0000 7efdfccef700 1 -- 172.21.15.33:0/3794074422 wait complete. 2022-02-02T15:23:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.139+0000 7efdfccef700 1 Processor -- start 2022-02-02T15:23:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.139+0000 7efdfccef700 1 -- start start 2022-02-02T15:23:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.139+0000 7efdfccef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf8060310 0x7efdf8106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.139+0000 7efdfccef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.139+0000 7efdfccef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf8107880 con 0x7efdf80f9690 2022-02-02T15:23:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdfccef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf81080c0 con 0x7efdf8060310 2022-02-02T15:23:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37284/0 (socket says 172.21.15.33:37284) 2022-02-02T15:23:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 -- 172.21.15.33:0/1040827563 learned_addr learned my addr 172.21.15.33:0/1040827563 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf77fe700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf8060310 0x7efdf8106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 -- 172.21.15.33:0/1040827563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf8060310 msgr2=0x7efdf8106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf8060310 0x7efdf8106d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 -- 172.21.15.33:0/1040827563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde8005040 con 0x7efdf80f9690 2022-02-02T15:23:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdf6ffd700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7efde000c510 tx=0x7efde0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:12.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.140+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde000f650 con 0x7efdf80f9690 2022-02-02T15:23:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.141+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf81083a0 con 0x7efdf80f9690 2022-02-02T15:23:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.141+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7efde000fc60 con 0x7efdf80f9690 2022-02-02T15:23:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.141+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efde0012c20 con 0x7efdf80f9690 2022-02-02T15:23:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.141+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf81088e0 con 0x7efdf80f9690 2022-02-02T15:23:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.142+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf8059100 con 0x7efdf80f9690 2022-02-02T15:23:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.143+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7efde0010070 con 0x7efdf80f9690 2022-02-02T15:23:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.143+0000 7efdeffff700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 0x7efde40672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.143+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7efde0081710 con 0x7efdf80f9690 2022-02-02T15:23:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.143+0000 7efdf77fe700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 0x7efde40672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.144+0000 7efdf77fe700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 0x7efde40672e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7efde8004630 tx=0x7efde8009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.148+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7efde004f7c0 con 0x7efdf80f9690 2022-02-02T15:23:12.379 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.390+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efdf8045ad0 con 0x7efdf80f9690 2022-02-02T15:23:12.380 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.391+0000 7efdeffff700 1 -- 172.21.15.33:0/1040827563 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7efde0052de0 con 0x7efdf80f9690 2022-02-02T15:23:12.380 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:23:12.380 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:23:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:23:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:23:12.381 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:23:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:23:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:23:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:12.382 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:23:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:23:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:23:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:23:12.383 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:23:12.384 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:23:12.384 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:23:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 msgr2=0x7efde40672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 0x7efde40672e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7efde8004630 tx=0x7efde8009b30).stop 2022-02-02T15:23:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 msgr2=0x7efdf8107280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 rx=0x7efde000c510 tx=0x7efde0007df0).stop 2022-02-02T15:23:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 shutdown_connections 2022-02-02T15:23:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7efde4064e20 0x7efde40672e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf8060310 0x7efdf8106d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 --2- 172.21.15.33:0/1040827563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efdf80f9690 0x7efdf8107280 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 >> 172.21.15.33:0/1040827563 conn(0x7efdf80f0b90 msgr2=0x7efdf80f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 shutdown_connections 2022-02-02T15:23:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.393+0000 7efdfccef700 1 -- 172.21.15.33:0/1040827563 wait complete. 2022-02-02T15:23:12.483 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 -- 172.21.15.33:0/3908375551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 msgr2=0x7f68440f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 --2- 172.21.15.33:0/3908375551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f68440f6b00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f68340099e0 tx=0x7f6834004d10).stop 2022-02-02T15:23:12.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 -- 172.21.15.33:0/3908375551 shutdown_connections 2022-02-02T15:23:12.484 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 --2- 172.21.15.33:0/3908375551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 0x7f68440f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 --2- 172.21.15.33:0/3908375551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f68440f6b00 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 -- 172.21.15.33:0/3908375551 >> 172.21.15.33:0/3908375551 conn(0x7f68440f1e40 msgr2=0x7f68440f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 -- 172.21.15.33:0/3908375551 shutdown_connections 2022-02-02T15:23:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.494+0000 7f684b362700 1 -- 172.21.15.33:0/3908375551 wait complete. 2022-02-02T15:23:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 Processor -- start 2022-02-02T15:23:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 -- start start 2022-02-02T15:23:12.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.488 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 0x7f6844069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684406a380 con 0x7f68440f66e0 2022-02-02T15:23:12.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f684b362700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684406a4c0 con 0x7f68440f7980 2022-02-02T15:23:12.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f68490fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.495+0000 7f68490fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37292/0 (socket says 172.21.15.33:37292) 2022-02-02T15:23:12.489 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68490fe700 1 -- 172.21.15.33:0/4067486523 learned_addr learned my addr 172.21.15.33:0/4067486523 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68490fe700 1 -- 172.21.15.33:0/4067486523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 msgr2=0x7f6844069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68488fd700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 0x7f6844069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68490fe700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 0x7f6844069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68490fe700 1 -- 172.21.15.33:0/4067486523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834009640 con 0x7f68440f66e0 2022-02-02T15:23:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f68490fe700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f683400baa0 tx=0x7f6834004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683400e070 con 0x7f68440f66e0 2022-02-02T15:23:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6834007df0 con 0x7f68440f66e0 2022-02-02T15:23:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684406a740 con 0x7f68440f66e0 2022-02-02T15:23:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6834018070 con 0x7f68440f66e0 2022-02-02T15:23:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.496+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f684406aca0 con 0x7f68440f66e0 2022-02-02T15:23:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.497+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6844045ad0 con 0x7f68440f66e0 2022-02-02T15:23:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.498+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6834024060 con 0x7f68440f66e0 2022-02-02T15:23:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.498+0000 7f6841ffb700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 0x7f682c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.498+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6834083270 con 0x7f68440f66e0 2022-02-02T15:23:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.498+0000 7f68488fd700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 0x7f682c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.499+0000 7f68488fd700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 0x7f682c067290 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f6838007f60 tx=0x7f683800b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.503+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6834051320 con 0x7f68440f66e0 2022-02-02T15:23:12.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:12 smithi037 ceph-mon[69017]: from='client.37282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:12.705 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.716+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6844027a00 con 0x7f68440f66e0 2022-02-02T15:23:12.706 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.717+0000 7f6841ffb700 1 -- 172.21.15.33:0/4067486523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f6834022750 con 0x7f68440f66e0 2022-02-02T15:23:12.706 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:23:12.707 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:23:12.707 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:23:12.707 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:23:12.707 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:12.707 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:23:12.708 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:23:12.708 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:23:12.708 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:23:12.708 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:23:12.709 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:23:12.709 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:23:12.709 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:23:12.709 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:23:12.710 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:23:12.710 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:23:12.710 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:23:12.710 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:23:12.710 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:23:12.711 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:23:12.711 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:23:12.711 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:23:12.711 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:23:12.712 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:23:12.712 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:23:12.712 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:23:12.712 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:23:12.712 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:23:12.713 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:23:12.713 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:23:12.713 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:23:12.713 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:12.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:12.714 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:23:12.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:12.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:12.714 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:12.715 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:12.715 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 msgr2=0x7f682c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 0x7f682c067290 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f6838007f60 tx=0x7f683800b040).stop 2022-02-02T15:23:12.716 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 msgr2=0x7f684406b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f683400baa0 tx=0x7f6834004d10).stop 2022-02-02T15:23:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 shutdown_connections 2022-02-02T15:23:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f682c064dd0 0x7f682c067290 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.717 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68440f66e0 0x7f684406b9a0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 --2- 172.21.15.33:0/4067486523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68440f7980 0x7f6844069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 >> 172.21.15.33:0/4067486523 conn(0x7f68440f1e40 msgr2=0x7f68440fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 shutdown_connections 2022-02-02T15:23:12.718 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:12.719+0000 7f684b362700 1 -- 172.21.15.33:0/4067486523 wait complete. 2022-02-02T15:23:12.719 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:23:13.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:13 smithi033 ceph-mon[101165]: pgmap v3134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:13.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:13 smithi033 ceph-mon[101165]: from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:13.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1040827563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:23:13.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:13 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/4067486523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:23:13.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:13 smithi037 ceph-mon[69017]: pgmap v3134: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:13.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:13 smithi037 ceph-mon[69017]: from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:13.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1040827563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:23:13.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:13 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/4067486523' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:23:15.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:15 smithi033 ceph-mon[101165]: pgmap v3135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:15.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:15 smithi037 ceph-mon[69017]: pgmap v3135: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:17.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:17 smithi037 ceph-mon[69017]: pgmap v3136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:17.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:17 smithi033 ceph-mon[101165]: pgmap v3136: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:19.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:19 smithi033 ceph-mon[101165]: pgmap v3137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:19.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:19 smithi037 ceph-mon[69017]: pgmap v3137: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:21.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:21 smithi033 ceph-mon[101165]: pgmap v3138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:21.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:21 smithi037 ceph-mon[69017]: pgmap v3138: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:23.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:23 smithi033 ceph-mon[101165]: pgmap v3139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:23.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:23 smithi037 ceph-mon[69017]: pgmap v3139: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:25.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:25 smithi033 ceph-mon[101165]: pgmap v3140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:25.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:25 smithi037 ceph-mon[69017]: pgmap v3140: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:27.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:27 smithi037 ceph-mon[69017]: pgmap v3141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:27.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:27 smithi033 ceph-mon[101165]: pgmap v3141: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:29.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:29 smithi033 ceph-mon[101165]: pgmap v3142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:29.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:29 smithi037 ceph-mon[69017]: pgmap v3142: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:31.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:31 smithi033 ceph-mon[101165]: pgmap v3143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:31.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:31 smithi037 ceph-mon[69017]: pgmap v3143: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:33.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:33 smithi033 ceph-mon[101165]: pgmap v3144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:33.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:33 smithi037 ceph-mon[69017]: pgmap v3144: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:35.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:35 smithi033 ceph-mon[101165]: pgmap v3145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:35.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:35 smithi037 ceph-mon[69017]: pgmap v3145: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:37.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:37 smithi037 ceph-mon[69017]: pgmap v3146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:37.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:37 smithi033 ceph-mon[101165]: pgmap v3146: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:39.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:39 smithi033 ceph-mon[101165]: pgmap v3147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:39.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:39 smithi037 ceph-mon[69017]: pgmap v3147: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:41.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:41 smithi033 ceph-mon[101165]: pgmap v3148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:41.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:41 smithi037 ceph-mon[69017]: pgmap v3148: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:42.826 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.835+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1192168538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f55c0 msgr2=0x7f9e340f59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.835+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1192168538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f55c0 0x7f9e340f59e0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 rx=0x7f9e30004660 tx=0x7f9e30009b30).stop 2022-02-02T15:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1192168538 shutdown_connections 2022-02-02T15:23:42.827 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1192168538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f6860 0x7f9e340f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1192168538 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f55c0 0x7f9e340f59e0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1192168538 >> 172.21.15.33:0/1192168538 conn(0x7f9e340f0d40 msgr2=0x7f9e340f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1192168538 shutdown_connections 2022-02-02T15:23:42.828 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1192168538 wait complete. 2022-02-02T15:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 Processor -- start 2022-02-02T15:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- start start 2022-02-02T15:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f55c0 0x7f9e34109c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:42.829 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.836+0000 7f9e3c59d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340603c0 con 0x7f9e340f6860 2022-02-02T15:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e3c59d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34060500 con 0x7f9e340f55c0 2022-02-02T15:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:42.830 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37304/0 (socket says 172.21.15.33:37304) 2022-02-02T15:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 -- 172.21.15.33:0/1525182603 learned_addr learned my addr 172.21.15.33:0/1525182603 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e3a339700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f55c0 0x7f9e34109c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 -- 172.21.15.33:0/1525182603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f55c0 msgr2=0x7f9e34109c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:42.831 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f55c0 0x7f9e34109c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 -- 172.21.15.33:0/1525182603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30005040 con 0x7f9e340f6860 2022-02-02T15:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e39b38700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f9e280026d0 tx=0x7f9e28009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e280079c0 con 0x7f9e340f6860 2022-02-02T15:23:42.832 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9e2800f040 con 0x7f9e340f6860 2022-02-02T15:23:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3410c740 con 0x7f9e340f6860 2022-02-02T15:23:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e280148b0 con 0x7f9e340f6860 2022-02-02T15:23:42.833 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.837+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3410ccd0 con 0x7f9e340f6860 2022-02-02T15:23:42.834 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.839+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340f49b0 con 0x7f9e340f6860 2022-02-02T15:23:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.839+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9e28007b20 con 0x7f9e340f6860 2022-02-02T15:23:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.839+0000 7f9e26ffd700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 0x7f9e20067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.839+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9e28081900 con 0x7f9e340f6860 2022-02-02T15:23:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.840+0000 7f9e3a339700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 0x7f9e20067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.840+0000 7f9e3a339700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 0x7f9e20067290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9e30013690 tx=0x7f9e30009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:42.844+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9e2804f9b0 con 0x7f9e340f6860 2022-02-02T15:23:43.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.031+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e340fdf10 con 0x7f9e20064dd0 2022-02-02T15:23:43.020 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.032+0000 7f9e26ffd700 1 -- 172.21.15.33:0/1525182603 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f9e340fdf10 con 0x7f9e20064dd0 2022-02-02T15:23:43.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 msgr2=0x7f9e20067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 0x7f9e20067290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9e30013690 tx=0x7f9e30009b30).stop 2022-02-02T15:23:43.023 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 msgr2=0x7f9e3410c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f9e280026d0 tx=0x7f9e28009de0).stop 2022-02-02T15:23:43.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 shutdown_connections 2022-02-02T15:23:43.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9e20064dd0 0x7f9e20067290 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e340f55c0 0x7f9e34109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.024 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 --2- 172.21.15.33:0/1525182603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e340f6860 0x7f9e3410c190 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 >> 172.21.15.33:0/1525182603 conn(0x7f9e340f0d40 msgr2=0x7f9e340fa2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 shutdown_connections 2022-02-02T15:23:43.025 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.034+0000 7f9e3c59d700 1 -- 172.21.15.33:0/1525182603 wait complete. 2022-02-02T15:23:43.032 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:23:43.124 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 -- 172.21.15.33:0/2545195454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 msgr2=0x7f67a00f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 --2- 172.21.15.33:0/2545195454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f9320 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f6790004660 tx=0x7f6790009b30).stop 2022-02-02T15:23:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 -- 172.21.15.33:0/2545195454 shutdown_connections 2022-02-02T15:23:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 --2- 172.21.15.33:0/2545195454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 0x7f67a00fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.125 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 --2- 172.21.15.33:0/2545195454 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f9320 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 -- 172.21.15.33:0/2545195454 >> 172.21.15.33:0/2545195454 conn(0x7f67a00f0d40 msgr2=0x7f67a00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.135+0000 7f67a5273700 1 -- 172.21.15.33:0/2545195454 shutdown_connections 2022-02-02T15:23:43.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 -- 172.21.15.33:0/2545195454 wait complete. 2022-02-02T15:23:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 Processor -- start 2022-02-02T15:23:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 -- start start 2022-02-02T15:23:43.129 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 0x7f67a00f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00f6f50 con 0x7f67a00603d0 2022-02-02T15:23:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f67a5273700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00f7090 con 0x7f67a00f98a0 2022-02-02T15:23:43.130 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.136+0000 7f679effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37312/0 (socket says 172.21.15.33:37312) 2022-02-02T15:23:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 -- 172.21.15.33:0/2087829051 learned_addr learned my addr 172.21.15.33:0/2087829051 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679e7fc700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 0x7f67a00f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 -- 172.21.15.33:0/2087829051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 msgr2=0x7f67a00f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 0x7f67a00f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 -- 172.21.15.33:0/2087829051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6790005040 con 0x7f67a00603d0 2022-02-02T15:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f679effd700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f6790000c00 tx=0x7f679000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6790019070 con 0x7f67a00603d0 2022-02-02T15:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a00f5920 con 0x7f67a00603d0 2022-02-02T15:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6790007e70 con 0x7f67a00603d0 2022-02-02T15:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6790014d90 con 0x7f67a00603d0 2022-02-02T15:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.137+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a00f5e80 con 0x7f67a00603d0 2022-02-02T15:23:43.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.138+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a00f49d0 con 0x7f67a00603d0 2022-02-02T15:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.139+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f6790025070 con 0x7f67a00603d0 2022-02-02T15:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.139+0000 7f67877fe700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 0x7f6788067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.139+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6790082ac0 con 0x7f67a00603d0 2022-02-02T15:23:43.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.139+0000 7f679e7fc700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 0x7f6788067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.140+0000 7f679e7fc700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 0x7f6788067290 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f67a0069c70 tx=0x7f679400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.143+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6790050b10 con 0x7f67a00603d0 2022-02-02T15:23:43.315 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.326+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f67a0062a90 con 0x7f6788064dd0 2022-02-02T15:23:43.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.341+0000 7f67877fe700 1 -- 172.21.15.33:0/2087829051 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f67a0062a90 con 0x7f6788064dd0 2022-02-02T15:23:43.330 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:23:43.330 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (109m) 71m ago 110m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:23:43.330 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (102m) 71m ago 109m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:23:43.330 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (101m) 71m ago 109m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:23:43.331 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (108m) 71m ago 109m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:23:43.331 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (102m) 71m ago 106m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:23:43.331 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (103m) 71m ago 106m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:23:43.331 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (103m) 71m ago 106m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:23:43.331 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (106m) 71m ago 106m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:23:43.332 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (103m) 71m ago 111m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:23:43.332 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (103m) 71m ago 109m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:23:43.332 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (102m) 71m ago 111m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:23:43.332 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (102m) 71m ago 109m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:23:43.333 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (109m) 71m ago 109m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:23:43.333 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (109m) 71m ago 109m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:23:43.333 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 71m ago 108m - 4096M 2022-02-02T15:23:43.333 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (108m) 71m ago 108m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:23:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (108m) 71m ago 108m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:23:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (107m) 71m ago 107m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:23:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (107m) 71m ago 107m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:23:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (107m) 71m ago 107m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:23:43.334 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (108m) 71m ago 109m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:23:43.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 msgr2=0x7f6788067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.335 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 0x7f6788067290 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f67a0069c70 tx=0x7f679400b040).stop 2022-02-02T15:23:43.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 msgr2=0x7f67a00f6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 rx=0x7f6790000c00 tx=0x7f679000b040).stop 2022-02-02T15:23:43.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 shutdown_connections 2022-02-02T15:23:43.336 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f6788064dd0 0x7f6788067290 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a00603d0 0x7f67a00f6950 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 --2- 172.21.15.33:0/2087829051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67a00f98a0 0x7f67a00f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 >> 172.21.15.33:0/2087829051 conn(0x7f67a00f0d40 msgr2=0x7f67a00f3130 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.337 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 shutdown_connections 2022-02-02T15:23:43.338 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.343+0000 7f67a5273700 1 -- 172.21.15.33:0/2087829051 wait complete. 2022-02-02T15:23:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.443+0000 7f90b2085700 1 -- 172.21.15.33:0/3449984657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 msgr2=0x7f90ac0fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.443+0000 7f90b2085700 1 --2- 172.21.15.33:0/3449984657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac0fbae0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7f909c004660 tx=0x7f909c009b30).stop 2022-02-02T15:23:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- 172.21.15.33:0/3449984657 shutdown_connections 2022-02-02T15:23:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 --2- 172.21.15.33:0/3449984657 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac0fbae0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 --2- 172.21.15.33:0/3449984657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 0x7f90ac0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- 172.21.15.33:0/3449984657 >> 172.21.15.33:0/3449984657 conn(0x7f90ac0f0b90 msgr2=0x7f90ac0f2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.434 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:43 smithi033 ceph-mon[101165]: pgmap v3149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- 172.21.15.33:0/3449984657 shutdown_connections 2022-02-02T15:23:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- 172.21.15.33:0/3449984657 wait complete. 2022-02-02T15:23:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 Processor -- start 2022-02-02T15:23:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- start start 2022-02-02T15:23:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 0x7f90ac106da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac107890 con 0x7f90ac0f9690 2022-02-02T15:23:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.444+0000 7f90b2085700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac1080d0 con 0x7f90ac060310 2022-02-02T15:23:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37324/0 (socket says 172.21.15.33:37324) 2022-02-02T15:23:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 -- 172.21.15.33:0/115084149 learned_addr learned my addr 172.21.15.33:0/115084149 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b1083700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 0x7f90ac106da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 -- 172.21.15.33:0/115084149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 msgr2=0x7f90ac106da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 0x7f90ac106da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.529 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 -- 172.21.15.33:0/115084149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909c005040 con 0x7f90ac0f9690 2022-02-02T15:23:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b0882700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f909c004f60 tx=0x7f909c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909c018070 con 0x7f90ac0f9690 2022-02-02T15:23:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f909c007ba0 con 0x7f90ac0f9690 2022-02-02T15:23:43.530 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f909c01c620 con 0x7f90ac0f9690 2022-02-02T15:23:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.445+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac108350 con 0x7f90ac0f9690 2022-02-02T15:23:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.446+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac1087e0 con 0x7f90ac0f9690 2022-02-02T15:23:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.447+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac059100 con 0x7f90ac0f9690 2022-02-02T15:23:43.531 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.448+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f909c01c8e0 con 0x7f90ac0f9690 2022-02-02T15:23:43.532 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.448+0000 7f90a1ffb700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 0x7f90980672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.533 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:43 smithi037 ceph-mon[69017]: pgmap v3149: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:43.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.448+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f909c083ec0 con 0x7f90ac0f9690 2022-02-02T15:23:43.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.448+0000 7f90b1083700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 0x7f90980672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.533 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.449+0000 7f90b1083700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 0x7f90980672e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f90a80041d0 tx=0x7f90a8009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.534 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.453+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f909c051f70 con 0x7f90ac0f9690 2022-02-02T15:23:43.680 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.692+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f90ac045ad0 con 0x7f90ac0f9690 2022-02-02T15:23:43.681 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.692+0000 7f90a1ffb700 1 -- 172.21.15.33:0/115084149 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f909c055590 con 0x7f90ac0f9690 2022-02-02T15:23:43.682 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:23:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:23:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:23:43.682 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:23:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:23:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:43.683 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:23:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:23:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:23:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:23:43.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:23:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:23:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:23:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:23:43.685 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:23:43.685 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:23:43.686 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 msgr2=0x7f90980672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 0x7f90980672e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7f90a80041d0 tx=0x7f90a8009040).stop 2022-02-02T15:23:43.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 msgr2=0x7f90ac107290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7f909c004f60 tx=0x7f909c009b30).stop 2022-02-02T15:23:43.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 shutdown_connections 2022-02-02T15:23:43.687 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9098064e20 0x7f90980672e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac060310 0x7f90ac106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 --2- 172.21.15.33:0/115084149 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90ac0f9690 0x7f90ac107290 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 >> 172.21.15.33:0/115084149 conn(0x7f90ac0f0b90 msgr2=0x7f90ac0f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.688 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 shutdown_connections 2022-02-02T15:23:43.689 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.695+0000 7f90b2085700 1 -- 172.21.15.33:0/115084149 wait complete. 2022-02-02T15:23:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- 172.21.15.33:0/3083369327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 msgr2=0x7f2b580f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/3083369327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b580f6b00 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 rx=0x7f2b4c004660 tx=0x7f2b4c009b30).stop 2022-02-02T15:23:43.785 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- 172.21.15.33:0/3083369327 shutdown_connections 2022-02-02T15:23:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/3083369327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b580f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/3083369327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b580f6b00 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.786 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- 172.21.15.33:0/3083369327 >> 172.21.15.33:0/3083369327 conn(0x7f2b580f1e40 msgr2=0x7f2b580f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- 172.21.15.33:0/3083369327 shutdown_connections 2022-02-02T15:23:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- 172.21.15.33:0/3083369327 wait complete. 2022-02-02T15:23:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 Processor -- start 2022-02-02T15:23:43.787 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.796+0000 7f2b5da2f700 1 -- start start 2022-02-02T15:23:43.789 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b5da2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b5da2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b58069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.790 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b5da2f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5806a380 con 0x7f2b580f66e0 2022-02-02T15:23:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b5da2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5806a4c0 con 0x7f2b580f7980 2022-02-02T15:23:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37332/0 (socket says 172.21.15.33:37332) 2022-02-02T15:23:43.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 -- 172.21.15.33:0/2907619161 learned_addr learned my addr 172.21.15.33:0/2907619161 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:23:43.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b567fc700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b58069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 -- 172.21.15.33:0/2907619161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 msgr2=0x7f2b58069e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:43.792 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b58069e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:43.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 -- 172.21.15.33:0/2907619161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c005040 con 0x7f2b580f66e0 2022-02-02T15:23:43.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b567fc700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b58069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2022-02-02T15:23:43.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.797+0000 7f2b56ffd700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f2b4c004f60 tx=0x7f2b4c009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.798+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4c018070 con 0x7f2b580f66e0 2022-02-02T15:23:43.793 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.798+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5806a740 con 0x7f2b580f66e0 2022-02-02T15:23:43.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.798+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5806aca0 con 0x7f2b580f66e0 2022-02-02T15:23:43.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.798+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f2b4c007ba0 con 0x7f2b580f66e0 2022-02-02T15:23:43.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.798+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4c01c620 con 0x7f2b580f66e0 2022-02-02T15:23:43.794 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.799+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b58045ad0 con 0x7f2b580f66e0 2022-02-02T15:23:43.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.799+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f2b4c01c8e0 con 0x7f2b580f66e0 2022-02-02T15:23:43.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.800+0000 7f2b3f7fe700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 0x7f2b40067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:23:43.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.800+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f2b4c0839b0 con 0x7f2b580f66e0 2022-02-02T15:23:43.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.800+0000 7f2b567fc700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 0x7f2b40067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:23:43.795 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.800+0000 7f2b567fc700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 0x7f2b40067290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f2b48004ac0 tx=0x7f2b48009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:23:43.796 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:43.804+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f2b4c051a60 con 0x7f2b580f66e0 2022-02-02T15:23:44.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.018+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b58027a00 con 0x7f2b580f66e0 2022-02-02T15:23:44.007 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.018+0000 7f2b3f7fe700 1 -- 172.21.15.33:0/2907619161 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7f2b4c055080 con 0x7f2b580f66e0 2022-02-02T15:23:44.008 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:23:44.008 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:23:44.008 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:23:44.008 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:23:44.009 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:44.009 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:23:44.009 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:23:44.009 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:23:44.009 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:23:44.010 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:23:44.010 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:23:44.010 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:23:44.010 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:23:44.011 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:23:44.011 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:23:44.011 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:23:44.011 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:23:44.012 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:23:44.012 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:23:44.012 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:23:44.012 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:23:44.012 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:23:44.013 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:23:44.013 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:23:44.013 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:23:44.013 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:23:44.013 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:23:44.014 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:23:44.014 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:23:44.014 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:23:44.014 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:23:44.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:44.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:44.015 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:23:44.015 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:23:44.015 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:44.016 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:44.016 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:44.016 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:23:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 msgr2=0x7f2b40067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 0x7f2b40067290 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f2b48004ac0 tx=0x7f2b48009040).stop 2022-02-02T15:23:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 msgr2=0x7f2b5806b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:23:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f2b4c004f60 tx=0x7f2b4c009b30).stop 2022-02-02T15:23:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 shutdown_connections 2022-02-02T15:23:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f2b40064dd0 0x7f2b40067290 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b580f66e0 0x7f2b5806b9a0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 --2- 172.21.15.33:0/2907619161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b580f7980 0x7f2b58069e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:23:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 >> 172.21.15.33:0/2907619161 conn(0x7f2b580f1e40 msgr2=0x7f2b580fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:23:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 shutdown_connections 2022-02-02T15:23:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:23:44.022+0000 7f2b5da2f700 1 -- 172.21.15.33:0/2907619161 wait complete. 2022-02-02T15:23:44.020 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:23:44.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:44 smithi033 ceph-mon[101165]: from='client.37298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:44.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:44 smithi033 ceph-mon[101165]: from='client.37302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:44.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/115084149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:23:44.480 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:44 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/2907619161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:23:44.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:44 smithi037 ceph-mon[69017]: from='client.37298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:44.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:44 smithi037 ceph-mon[69017]: from='client.37302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:23:44.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/115084149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:23:44.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:44 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/2907619161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:23:45.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:45 smithi033 ceph-mon[101165]: pgmap v3150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:45.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:45 smithi037 ceph-mon[69017]: pgmap v3150: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:47.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:47 smithi037 ceph-mon[69017]: pgmap v3151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:47.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:47 smithi033 ceph-mon[101165]: pgmap v3151: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:49.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:49 smithi033 ceph-mon[101165]: pgmap v3152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:49.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:49 smithi037 ceph-mon[69017]: pgmap v3152: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:51.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:51 smithi033 ceph-mon[101165]: pgmap v3153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:51.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:51 smithi037 ceph-mon[69017]: pgmap v3153: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:53.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:53 smithi033 ceph-mon[101165]: pgmap v3154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:53.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:53 smithi037 ceph-mon[69017]: pgmap v3154: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:55 smithi033 ceph-mon[101165]: pgmap v3155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:23:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:23:55.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:55 smithi037 ceph-mon[69017]: pgmap v3155: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:55.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:23:55.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:23:57.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:57 smithi037 ceph-mon[69017]: pgmap v3156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:57.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:57 smithi033 ceph-mon[101165]: pgmap v3156: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:59.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:23:59 smithi033 ceph-mon[101165]: pgmap v3157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:23:59.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:23:59 smithi037 ceph-mon[69017]: pgmap v3157: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:01.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:01 smithi033 ceph-mon[101165]: pgmap v3158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:01.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:01 smithi037 ceph-mon[69017]: pgmap v3158: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:03.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:03 smithi033 ceph-mon[101165]: pgmap v3159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:03.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:03 smithi037 ceph-mon[69017]: pgmap v3159: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:05.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:05 smithi033 ceph-mon[101165]: pgmap v3160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:05.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:05 smithi037 ceph-mon[69017]: pgmap v3160: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:07.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:07 smithi037 ceph-mon[69017]: pgmap v3161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:07.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:07 smithi033 ceph-mon[101165]: pgmap v3161: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:09.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:09 smithi033 ceph-mon[101165]: pgmap v3162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:09.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:09 smithi037 ceph-mon[69017]: pgmap v3162: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:11.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:11 smithi033 ceph-mon[101165]: pgmap v3163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:11.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:11 smithi037 ceph-mon[69017]: pgmap v3163: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:13.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:13 smithi033 ceph-mon[101165]: pgmap v3164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:13.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:13 smithi037 ceph-mon[69017]: pgmap v3164: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 -- 172.21.15.33:0/544251936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f7980 msgr2=0x7f971c0f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.126 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 --2- 172.21.15.33:0/544251936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f7980 0x7f971c0f7de0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f970c004660 tx=0x7f970c009b30).stop 2022-02-02T15:24:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 -- 172.21.15.33:0/544251936 shutdown_connections 2022-02-02T15:24:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 --2- 172.21.15.33:0/544251936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f7980 0x7f971c0f7de0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 --2- 172.21.15.33:0/544251936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f66e0 0x7f971c0f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.127 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 -- 172.21.15.33:0/544251936 >> 172.21.15.33:0/544251936 conn(0x7f971c0f1e40 msgr2=0x7f971c0f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 -- 172.21.15.33:0/544251936 shutdown_connections 2022-02-02T15:24:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.137+0000 7f9721e85700 1 -- 172.21.15.33:0/544251936 wait complete. 2022-02-02T15:24:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 Processor -- start 2022-02-02T15:24:14.128 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 -- start start 2022-02-02T15:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f7980 0x7f971c107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.131 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c107a00 con 0x7f971c0f66e0 2022-02-02T15:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f9721e85700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971c107b40 con 0x7f971c0f7980 2022-02-02T15:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f971b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f971b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37342/0 (socket says 172.21.15.33:37342) 2022-02-02T15:24:14.132 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.138+0000 7f971b7fe700 1 -- 172.21.15.33:0/4081287052 learned_addr learned my addr 172.21.15.33:0/4081287052 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f971affd700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f7980 0x7f971c107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f971b7fe700 1 -- 172.21.15.33:0/4081287052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f7980 msgr2=0x7f971c107450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f971b7fe700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f7980 0x7f971c107450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f971b7fe700 1 -- 172.21.15.33:0/4081287052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c005040 con 0x7f971c0f66e0 2022-02-02T15:24:14.133 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f971b7fe700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f970400c530 tx=0x7f9704007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f970400f650 con 0x7f971c0f66e0 2022-02-02T15:24:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f970400fc60 con 0x7f971c0f66e0 2022-02-02T15:24:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971c1084e0 con 0x7f971c0f66e0 2022-02-02T15:24:14.134 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9704012d20 con 0x7f971c0f66e0 2022-02-02T15:24:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.139+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971c108aa0 con 0x7f971c0f66e0 2022-02-02T15:24:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.140+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f971c045ad0 con 0x7f971c0f66e0 2022-02-02T15:24:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.141+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9704019030 con 0x7f971c0f66e0 2022-02-02T15:24:14.135 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.141+0000 7f9713fff700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 0x7f9708067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.141+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9704081700 con 0x7f971c0f66e0 2022-02-02T15:24:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.141+0000 7f971affd700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 0x7f9708067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.136 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.142+0000 7f971affd700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 0x7f9708067290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f970c004e30 tx=0x7f970c009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.146+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9704053230 con 0x7f971c0f66e0 2022-02-02T15:24:14.323 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.334+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f971c108d20 con 0x7f9708064dd0 2022-02-02T15:24:14.324 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.336+0000 7f9713fff700 1 -- 172.21.15.33:0/4081287052 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f971c108d20 con 0x7f9708064dd0 2022-02-02T15:24:14.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 msgr2=0x7f9708067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 0x7f9708067290 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f970c004e30 tx=0x7f970c009b30).stop 2022-02-02T15:24:14.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 msgr2=0x7f971c106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f970400c530 tx=0x7f9704007e10).stop 2022-02-02T15:24:14.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 shutdown_connections 2022-02-02T15:24:14.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9708064dd0 0x7f9708067290 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f971c0f66e0 0x7f971c106f60 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 --2- 172.21.15.33:0/4081287052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f971c0f7980 0x7f971c107450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.337+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 >> 172.21.15.33:0/4081287052 conn(0x7f971c0f1e40 msgr2=0x7f971c0fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:14.328 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.338+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 shutdown_connections 2022-02-02T15:24:14.329 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.338+0000 7f9721e85700 1 -- 172.21.15.33:0/4081287052 wait complete. 2022-02-02T15:24:14.336 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:24:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 -- 172.21.15.33:0/1951691549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 msgr2=0x7f39700f6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.433 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 --2- 172.21.15.33:0/1951691549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f39700f6d00 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3960004660 tx=0x7f3960009b30).stop 2022-02-02T15:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 -- 172.21.15.33:0/1951691549 shutdown_connections 2022-02-02T15:24:14.434 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 --2- 172.21.15.33:0/1951691549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 0x7f39700f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 --2- 172.21.15.33:0/1951691549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f39700f6d00 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 -- 172.21.15.33:0/1951691549 >> 172.21.15.33:0/1951691549 conn(0x7f39700f2020 msgr2=0x7f39700f4460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:14.435 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 -- 172.21.15.33:0/1951691549 shutdown_connections 2022-02-02T15:24:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.440+0000 7f397665e700 1 -- 172.21.15.33:0/1951691549 wait complete. 2022-02-02T15:24:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 Processor -- start 2022-02-02T15:24:14.436 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 -- start start 2022-02-02T15:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 0x7f3970069290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970069840 con 0x7f39700f68e0 2022-02-02T15:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f397665e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970069980 con 0x7f39700f7b80 2022-02-02T15:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f396ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f396ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37352/0 (socket says 172.21.15.33:37352) 2022-02-02T15:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f396ffff700 1 -- 172.21.15.33:0/325161790 learned_addr learned my addr 172.21.15.33:0/325161790 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f396f7fe700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 0x7f3970069290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.441+0000 7f396ffff700 1 -- 172.21.15.33:0/325161790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 msgr2=0x7f3970069290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396ffff700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 0x7f3970069290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396ffff700 1 -- 172.21.15.33:0/325161790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3960005040 con 0x7f39700f68e0 2022-02-02T15:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396ffff700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f3960013a70 tx=0x7f3960009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3960018070 con 0x7f39700f68e0 2022-02-02T15:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3970110f00 con 0x7f39700f68e0 2022-02-02T15:24:14.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f39600097d0 con 0x7f39700f68e0 2022-02-02T15:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f396001de80 con 0x7f39700f68e0 2022-02-02T15:24:14.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.442+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970111460 con 0x7f39700f68e0 2022-02-02T15:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.443+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3970045ad0 con 0x7f39700f68e0 2022-02-02T15:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.443+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f3960007ba0 con 0x7f39700f68e0 2022-02-02T15:24:14.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.444+0000 7f396cff9700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 0x7f3958067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.444+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f39600836b0 con 0x7f39700f68e0 2022-02-02T15:24:14.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.444+0000 7f396f7fe700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 0x7f3958067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.444 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.444+0000 7f396f7fe700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 0x7f3958067290 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3964004c40 tx=0x7f396400b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.448+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f3960055190 con 0x7f39700f68e0 2022-02-02T15:24:14.618 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.629+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39700ff0a0 con 0x7f3958064dd0 2022-02-02T15:24:14.632 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.644+0000 7f396cff9700 1 -- 172.21.15.33:0/325161790 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7f39700ff0a0 con 0x7f3958064dd0 2022-02-02T15:24:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:24:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (109m) 71m ago 110m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:24:14.633 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (102m) 71m ago 110m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:24:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (102m) 71m ago 110m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:24:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (109m) 71m ago 110m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:24:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (103m) 71m ago 106m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:24:14.634 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (103m) 71m ago 106m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:24:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (104m) 71m ago 106m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:24:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (106m) 71m ago 106m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:24:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (104m) 71m ago 111m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:24:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (103m) 71m ago 109m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:24:14.635 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (103m) 71m ago 111m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:24:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (103m) 71m ago 109m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:24:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (110m) 71m ago 110m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:24:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (109m) 71m ago 109m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:24:14.636 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 71m ago 109m - 4096M 2022-02-02T15:24:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (108m) 71m ago 108m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:24:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (108m) 71m ago 108m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:24:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (108m) 71m ago 108m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:24:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (108m) 71m ago 108m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:24:14.638 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (107m) 71m ago 107m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:24:14.638 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (109m) 71m ago 110m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:24:14.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 msgr2=0x7f3958067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 0x7f3958067290 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7f3964004c40 tx=0x7f396400b040).stop 2022-02-02T15:24:14.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 msgr2=0x7f3970068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f3960013a70 tx=0x7f3960009b30).stop 2022-02-02T15:24:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 shutdown_connections 2022-02-02T15:24:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f3958064dd0 0x7f3958067290 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39700f68e0 0x7f3970068da0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 --2- 172.21.15.33:0/325161790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39700f7b80 0x7f3970069290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 >> 172.21.15.33:0/325161790 conn(0x7f39700f2020 msgr2=0x7f39700fb5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 shutdown_connections 2022-02-02T15:24:14.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.646+0000 7f397665e700 1 -- 172.21.15.33:0/325161790 wait complete. 2022-02-02T15:24:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.747+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1377505754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f6860 msgr2=0x7f9ef00f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.736 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1377505754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f6860 0x7f9ef00f6cc0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7f9ee0004660 tx=0x7f9ee0009b30).stop 2022-02-02T15:24:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1377505754 shutdown_connections 2022-02-02T15:24:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1377505754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f6860 0x7f9ef00f6cc0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1377505754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f55c0 0x7f9ef00f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.737 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1377505754 >> 172.21.15.33:0/1377505754 conn(0x7f9ef00f0d40 msgr2=0x7f9ef00f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1377505754 shutdown_connections 2022-02-02T15:24:14.738 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1377505754 wait complete. 2022-02-02T15:24:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 Processor -- start 2022-02-02T15:24:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- start start 2022-02-02T15:24:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 0x7f9ef0107460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0107a10 con 0x7f9ef00f55c0 2022-02-02T15:24:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.748+0000 7f9ef79e5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0107b50 con 0x7f9ef00f6860 2022-02-02T15:24:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37362/0 (socket says 172.21.15.33:37362) 2022-02-02T15:24:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 -- 172.21.15.33:0/1642875752 learned_addr learned my addr 172.21.15.33:0/1642875752 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef4f80700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 0x7f9ef0107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 -- 172.21.15.33:0/1642875752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 msgr2=0x7f9ef0107460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 0x7f9ef0107460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 -- 172.21.15.33:0/1642875752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0005040 con 0x7f9ef00f55c0 2022-02-02T15:24:14.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef4f80700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 0x7f9ef0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2022-02-02T15:24:14.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef5781700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f9eec002700 tx=0x7f9eec009d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec009320 con 0x7f9ef00f55c0 2022-02-02T15:24:14.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef01084f0 con 0x7f9ef00f55c0 2022-02-02T15:24:14.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f9eec00f040 con 0x7f9ef00f55c0 2022-02-02T15:24:14.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.749+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eec014900 con 0x7f9ef00f55c0 2022-02-02T15:24:14.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.750+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0108ab0 con 0x7f9ef00f55c0 2022-02-02T15:24:14.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.751+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef0045ad0 con 0x7f9ef00f55c0 2022-02-02T15:24:14.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.751+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f9eec009480 con 0x7f9ef00f55c0 2022-02-02T15:24:14.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.751+0000 7f9ee5ffb700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 0x7f9edc067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:14.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.751+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f9eec081d10 con 0x7f9ef00f55c0 2022-02-02T15:24:14.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.751+0000 7f9ef4f80700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 0x7f9edc067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:14.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.752+0000 7f9ef4f80700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 0x7f9edc067290 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f9ee0004630 tx=0x7f9ee0009b30).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:14.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:14.756+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f9eec0538b0 con 0x7f9ef00f55c0 2022-02-02T15:24:14.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.003+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9ef010d590 con 0x7f9ef00f55c0 2022-02-02T15:24:14.992 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.003+0000 7f9ee5ffb700 1 -- 172.21.15.33:0/1642875752 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f9eec0534a0 con 0x7f9ef00f55c0 2022-02-02T15:24:14.992 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:24:14.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:24:14.993 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:24:14.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:14.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:24:14.994 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:24:14.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:14.994 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:24:14.994 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:24:14.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:14.995 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:24:14.995 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:24:14.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:14.996 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:24:14.996 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:24:14.996 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:24:14.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:24:14.997 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:24:14.997 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 msgr2=0x7f9edc067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 0x7f9edc067290 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f9ee0004630 tx=0x7f9ee0009b30).stop 2022-02-02T15:24:14.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 msgr2=0x7f9ef0106f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:14.998 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 rx=0x7f9eec002700 tx=0x7f9eec009d80).stop 2022-02-02T15:24:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 shutdown_connections 2022-02-02T15:24:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f9edc064dd0 0x7f9edc067290 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9ef00f55c0 0x7f9ef0106f70 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 --2- 172.21.15.33:0/1642875752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef00f6860 0x7f9ef0107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:14.999 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 >> 172.21.15.33:0/1642875752 conn(0x7f9ef00f0d40 msgr2=0x7f9ef005fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.005+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 shutdown_connections 2022-02-02T15:24:15.000 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.006+0000 7f9ef79e5700 1 -- 172.21.15.33:0/1642875752 wait complete. 2022-02-02T15:24:15.096 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 -- 172.21.15.33:0/1622043625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 msgr2=0x7ffbe00f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 --2- 172.21.15.33:0/1622043625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe00f7de0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7ffbd4004660 tx=0x7ffbd4009b30).stop 2022-02-02T15:24:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 -- 172.21.15.33:0/1622043625 shutdown_connections 2022-02-02T15:24:15.097 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 --2- 172.21.15.33:0/1622043625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe00f7de0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 --2- 172.21.15.33:0/1622043625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 0x7ffbe00f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 -- 172.21.15.33:0/1622043625 >> 172.21.15.33:0/1622043625 conn(0x7ffbe00f1e40 msgr2=0x7ffbe00f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:15.098 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 -- 172.21.15.33:0/1622043625 shutdown_connections 2022-02-02T15:24:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 -- 172.21.15.33:0/1622043625 wait complete. 2022-02-02T15:24:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.106+0000 7ffbe8020700 1 Processor -- start 2022-02-02T15:24:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe8020700 1 -- start start 2022-02-02T15:24:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe8020700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 0x7ffbe0106f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:15.099 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe8020700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe8020700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0107a00 con 0x7ffbe00f7980 2022-02-02T15:24:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe8020700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe0107b40 con 0x7ffbe00f66e0 2022-02-02T15:24:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:15.100 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37374/0 (socket says 172.21.15.33:37374) 2022-02-02T15:24:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 -- 172.21.15.33:0/3373409283 learned_addr learned my addr 172.21.15.33:0/3373409283 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe5dbc700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 0x7ffbe0106f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 -- 172.21.15.33:0/3373409283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 msgr2=0x7ffbe0106f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:15.101 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 0x7ffbe0106f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 -- 172.21.15.33:0/3373409283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd4005040 con 0x7ffbe00f7980 2022-02-02T15:24:15.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.107+0000 7ffbe55bb700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7ffbd4009830 tx=0x7ffbd4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:15.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.108+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd4018070 con 0x7ffbe00f7980 2022-02-02T15:24:15.102 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.108+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7ffbd4007ba0 con 0x7ffbe00f7980 2022-02-02T15:24:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.108+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe0108480 con 0x7ffbe00f7980 2022-02-02T15:24:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.108+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffbd401c3c0 con 0x7ffbe00f7980 2022-02-02T15:24:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.108+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe01089e0 con 0x7ffbe00f7980 2022-02-02T15:24:15.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.109+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe0045ad0 con 0x7ffbe00f7980 2022-02-02T15:24:15.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.109+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7ffbd4007d10 con 0x7ffbe00f7980 2022-02-02T15:24:15.105 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.110+0000 7ffbd27fc700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 0x7ffbcc067270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.110+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7ffbd40835d0 con 0x7ffbe00f7980 2022-02-02T15:24:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.110+0000 7ffbe5dbc700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 0x7ffbcc067270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.110+0000 7ffbe5dbc700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 0x7ffbcc067270 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ffbe00f77e0 tx=0x7ffbdc00b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.114+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7ffbd4055170 con 0x7ffbe00f7980 2022-02-02T15:24:15.314 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.325+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffbe0027a00 con 0x7ffbe00f7980 2022-02-02T15:24:15.314 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:15 smithi033 ceph-mon[101165]: pgmap v3165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:15.315 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:15 smithi033 ceph-mon[101165]: from='client.37314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:15.315 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:15 smithi033 ceph-mon[101165]: from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:15.315 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:15 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/1642875752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:24:15.316 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.326+0000 7ffbd27fc700 1 -- 172.21.15.33:0/3373409283 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7ffbd4054d60 con 0x7ffbe00f7980 2022-02-02T15:24:15.316 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:24:15.316 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:24:15.317 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:24:15.317 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:24:15.317 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:15.317 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:24:15.317 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:24:15.318 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:24:15.318 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:24:15.318 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:24:15.318 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:24:15.319 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:24:15.319 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:24:15.319 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:24:15.319 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:24:15.319 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:24:15.320 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:24:15.320 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:24:15.320 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:24:15.320 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:24:15.321 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:24:15.321 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:24:15.321 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:24:15.321 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:24:15.321 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:24:15.322 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:24:15.322 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:24:15.322 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:24:15.322 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:24:15.322 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:24:15.323 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:24:15.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:15.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:15.323 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:24:15.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:15.324 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:15.324 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:15.324 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:15.324 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:15.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 msgr2=0x7ffbcc067270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:15.325 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 0x7ffbcc067270 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7ffbe00f77e0 tx=0x7ffbdc00b040).stop 2022-02-02T15:24:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 msgr2=0x7ffbe0107450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 rx=0x7ffbd4009830 tx=0x7ffbd4009b30).stop 2022-02-02T15:24:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 shutdown_connections 2022-02-02T15:24:15.326 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7ffbcc064db0 0x7ffbcc067270 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbe00f66e0 0x7ffbe0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 --2- 172.21.15.33:0/3373409283 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbe00f7980 0x7ffbe0107450 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 >> 172.21.15.33:0/3373409283 conn(0x7ffbe00f1e40 msgr2=0x7ffbe00fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.329+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 shutdown_connections 2022-02-02T15:24:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:15.330+0000 7ffbe8020700 1 -- 172.21.15.33:0/3373409283 wait complete. 2022-02-02T15:24:15.328 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:24:15.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:15 smithi037 ceph-mon[69017]: pgmap v3165: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:15.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:15 smithi037 ceph-mon[69017]: from='client.37314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:15.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:15 smithi037 ceph-mon[69017]: from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:15.530 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:15 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/1642875752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:24:16.229 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:16 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3373409283' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:24:16.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:16 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3373409283' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:24:17.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:17 smithi037 ceph-mon[69017]: pgmap v3166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:17.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:17 smithi033 ceph-mon[101165]: pgmap v3166: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:19.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:19 smithi033 ceph-mon[101165]: pgmap v3167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:19.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:19 smithi037 ceph-mon[69017]: pgmap v3167: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:21.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:21 smithi033 ceph-mon[101165]: pgmap v3168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:21.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:21 smithi037 ceph-mon[69017]: pgmap v3168: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:23.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:23 smithi033 ceph-mon[101165]: pgmap v3169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:23.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:23 smithi037 ceph-mon[69017]: pgmap v3169: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:25.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:25 smithi033 ceph-mon[101165]: pgmap v3170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:25.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:25 smithi037 ceph-mon[69017]: pgmap v3170: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:27.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:27 smithi037 ceph-mon[69017]: pgmap v3171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:27.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:27 smithi033 ceph-mon[101165]: pgmap v3171: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:29.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:29 smithi033 ceph-mon[101165]: pgmap v3172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:29.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:29 smithi037 ceph-mon[69017]: pgmap v3172: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:31.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:31 smithi033 ceph-mon[101165]: pgmap v3173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:31.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:31 smithi037 ceph-mon[69017]: pgmap v3173: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:33.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:33 smithi033 ceph-mon[101165]: pgmap v3174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:33.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:33 smithi037 ceph-mon[69017]: pgmap v3174: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:35.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:35 smithi033 ceph-mon[101165]: pgmap v3175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:35.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:35 smithi037 ceph-mon[69017]: pgmap v3175: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:37.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:37 smithi037 ceph-mon[69017]: pgmap v3176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:37.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:37 smithi033 ceph-mon[101165]: pgmap v3176: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:39.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:39 smithi033 ceph-mon[101165]: pgmap v3177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:39.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:39 smithi037 ceph-mon[69017]: pgmap v3177: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:41.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:41 smithi033 ceph-mon[101165]: pgmap v3178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:41.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:41 smithi037 ceph-mon[69017]: pgmap v3178: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:43.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:43 smithi033 ceph-mon[101165]: pgmap v3179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:43.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:43 smithi037 ceph-mon[69017]: pgmap v3179: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 -- 172.21.15.33:0/2541442796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f4d60 msgr2=0x7f8d800f5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 --2- 172.21.15.33:0/2541442796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f4d60 0x7f8d800f5180 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7f8d7c00aaf0 tx=0x7f8d7c004d10).stop 2022-02-02T15:24:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 -- 172.21.15.33:0/2541442796 shutdown_connections 2022-02-02T15:24:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 --2- 172.21.15.33:0/2541442796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f5f60 0x7f8d800f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 --2- 172.21.15.33:0/2541442796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f4d60 0x7f8d800f5180 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 -- 172.21.15.33:0/2541442796 >> 172.21.15.33:0/2541442796 conn(0x7f8d800f04c0 msgr2=0x7f8d800f28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 -- 172.21.15.33:0/2541442796 shutdown_connections 2022-02-02T15:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.446+0000 7f8d880f6700 1 -- 172.21.15.33:0/2541442796 wait complete. 2022-02-02T15:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 Processor -- start 2022-02-02T15:24:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 -- start start 2022-02-02T15:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f4d60 0x7f8d80106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80107a20 con 0x7f8d800f5f60 2022-02-02T15:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d880f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80107b60 con 0x7f8d800f4d60 2022-02-02T15:24:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d85691700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d85691700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37384/0 (socket says 172.21.15.33:37384) 2022-02-02T15:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.447+0000 7f8d85691700 1 -- 172.21.15.33:0/907502644 learned_addr learned my addr 172.21.15.33:0/907502644 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d85e92700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f4d60 0x7f8d80106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d85691700 1 -- 172.21.15.33:0/907502644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f4d60 msgr2=0x7f8d80106f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.441 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d85691700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f4d60 0x7f8d80106f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d85691700 1 -- 172.21.15.33:0/907502644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c00a750 con 0x7f8d800f5f60 2022-02-02T15:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d85691700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f8d70002700 tx=0x7f8d70009e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d70009320 con 0x7f8d800f5f60 2022-02-02T15:24:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f8d7000f040 con 0x7f8d800f5f60 2022-02-02T15:24:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d70014870 con 0x7f8d800f5f60 2022-02-02T15:24:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80108500 con 0x7f8d800f5f60 2022-02-02T15:24:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.448+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d80108a40 con 0x7f8d800f5f60 2022-02-02T15:24:45.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.449+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80045ad0 con 0x7f8d800f5f60 2022-02-02T15:24:45.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.450+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f8d70009480 con 0x7f8d800f5f60 2022-02-02T15:24:45.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.450+0000 7f8d767fc700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.445 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.450+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f8d70081e10 con 0x7f8d800f5f60 2022-02-02T15:24:45.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.450+0000 7f8d85e92700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.451+0000 7f8d85e92700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 0x7f8d6c067290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f8d7c00c3b0 tx=0x7f8d7c004d10).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:45.446 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.455+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f8d70053830 con 0x7f8d800f5f60 2022-02-02T15:24:45.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:45 smithi033 ceph-mon[101165]: pgmap v3180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:45.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:45 smithi037 ceph-mon[69017]: pgmap v3180: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:45.636 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.647+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d800fa350 con 0x7f8d6c064dd0 2022-02-02T15:24:45.637 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.649+0000 7f8d767fc700 1 -- 172.21.15.33:0/907502644 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f8d800fa350 con 0x7f8d6c064dd0 2022-02-02T15:24:45.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.650+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 msgr2=0x7f8d6c067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.650+0000 7f8d880f6700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 0x7f8d6c067290 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f8d7c00c3b0 tx=0x7f8d7c004d10).stop 2022-02-02T15:24:45.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.650+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 msgr2=0x7f8d80107470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.650+0000 7f8d880f6700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7f8d70002700 tx=0x7f8d70009e00).stop 2022-02-02T15:24:45.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 shutdown_connections 2022-02-02T15:24:45.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f8d6c064dd0 0x7f8d6c067290 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d800f4d60 0x7f8d80106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 --2- 172.21.15.33:0/907502644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d800f5f60 0x7f8d80107470 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 >> 172.21.15.33:0/907502644 conn(0x7f8d800f04c0 msgr2=0x7f8d800f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:45.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 shutdown_connections 2022-02-02T15:24:45.641 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.651+0000 7f8d880f6700 1 -- 172.21.15.33:0/907502644 wait complete. 2022-02-02T15:24:45.649 INFO:teuthology.orchestra.run.smithi033.stdout:true 2022-02-02T15:24:45.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.751+0000 7fb0ba714700 1 -- 172.21.15.33:0/2985723848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 msgr2=0x7fb0b40f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.742 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.751+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2985723848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f6b40 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 rx=0x7fb0a4004660 tx=0x7fb0a4009b30).stop 2022-02-02T15:24:45.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- 172.21.15.33:0/2985723848 shutdown_connections 2022-02-02T15:24:45.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2985723848 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f6b40 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2985723848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 0x7fb0b40f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.743 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- 172.21.15.33:0/2985723848 >> 172.21.15.33:0/2985723848 conn(0x7fb0b40f0ba0 msgr2=0x7fb0b40f2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- 172.21.15.33:0/2985723848 shutdown_connections 2022-02-02T15:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- 172.21.15.33:0/2985723848 wait complete. 2022-02-02T15:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 Processor -- start 2022-02-02T15:24:45.744 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- start start 2022-02-02T15:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 0x7fb0b40f95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40f7f80 con 0x7fb0b40f66e0 2022-02-02T15:24:45.745 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.752+0000 7fb0ba714700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b40f80c0 con 0x7fb0b40f5440 2022-02-02T15:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37394/0 (socket says 172.21.15.33:37394) 2022-02-02T15:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 -- 172.21.15.33:0/2428832205 learned_addr learned my addr 172.21.15.33:0/2428832205 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b9712700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 0x7fb0b40f95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.746 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 -- 172.21.15.33:0/2428832205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 msgr2=0x7fb0b40f95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 0x7fb0b40f95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 -- 172.21.15.33:0/2428832205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4005040 con 0x7fb0b40f66e0 2022-02-02T15:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0b8f11700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fb0a4000c00 tx=0x7fb0a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:45.747 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a4019070 con 0x7fb0b40f66e0 2022-02-02T15:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b40f8340 con 0x7fb0b40f66e0 2022-02-02T15:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fb0a4007e70 con 0x7fb0b40f66e0 2022-02-02T15:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.753+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0a4014ce0 con 0x7fb0b40f66e0 2022-02-02T15:24:45.748 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.754+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b40f88a0 con 0x7fb0b40f66e0 2022-02-02T15:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.754+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b4045ad0 con 0x7fb0b40f66e0 2022-02-02T15:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.755+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fb0a4025070 con 0x7fb0b40f66e0 2022-02-02T15:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.755+0000 7fb0a9ffb700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 0x7fb0a00672e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:45.750 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.755+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fb0a4082af0 con 0x7fb0b40f66e0 2022-02-02T15:24:45.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.755+0000 7fb0b9712700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 0x7fb0a00672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:45.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.756+0000 7fb0b9712700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 0x7fb0a00672e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fb0b40f9330 tx=0x7fb0b000b040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:45.751 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.760+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fb0a4050ae0 con 0x7fb0b40f66e0 2022-02-02T15:24:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.942+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 --> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0b40fab20 con 0x7fb0a0064e20 2022-02-02T15:24:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.957+0000 7fb0a9ffb700 1 -- 172.21.15.33:0/2428832205 <== mgr.34102 v2:172.21.15.33:6826/3705968351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3454 (secure 0 0 0) 0x7fb0b40fab20 con 0x7fb0a0064e20 2022-02-02T15:24:45.945 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-02-02T15:24:45.946 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.smithi033 smithi033 *:9093,9094 running (110m) 72m ago 111m 20.1M - 0.20.0 0881eb8f169f a40c06e7026c 2022-02-02T15:24:45.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi033 smithi033 running (103m) 72m ago 111m 7256k - 17.0.0-10509-gb0d76d45 1f6b3eb908af ec67b4fbca95 2022-02-02T15:24:45.946 INFO:teuthology.orchestra.run.smithi033.stdout:crash.smithi037 smithi037 running (103m) 72m ago 110m 7180k - 17.0.0-10509-gb0d76d45 1f6b3eb908af b8561c803e61 2022-02-02T15:24:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.smithi033 smithi033 *:3000 running (109m) 72m ago 110m 42.6M - 6.7.4 557c83e11646 20960a4ee1c0 2022-02-02T15:24:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.cdqmmc smithi033 running (103m) 72m ago 107m 22.5M - 16.2.4 8d91d370c2b8 0a1769e88f6f 2022-02-02T15:24:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi033.kvxxkv smithi033 running (104m) 72m ago 107m 23.6M - 16.2.4 8d91d370c2b8 6a5c32e9b659 2022-02-02T15:24:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.lqirod smithi037 running (104m) 72m ago 107m 25.6M - 16.2.4 8d91d370c2b8 db6ed105df94 2022-02-02T15:24:45.947 INFO:teuthology.orchestra.run.smithi033.stdout:mds.cephfs.smithi037.nnxzjs smithi037 running (107m) 72m ago 107m 24.2M - 16.2.4 8d91d370c2b8 5e7706ef358b 2022-02-02T15:24:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi033.xvkvzp smithi033 *:8443,9283 running (104m) 72m ago 112m 500M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 945c22b7e064 2022-02-02T15:24:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.smithi037.npteou smithi037 *:8443,9283 running (104m) 72m ago 110m 427M - 17.0.0-10509-gb0d76d45 1f6b3eb908af 9557335e0621 2022-02-02T15:24:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi033 smithi033 running (104m) 72m ago 112m 180M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 9624ba3f3e1a 2022-02-02T15:24:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:mon.smithi037 smithi037 running (103m) 72m ago 110m 88.7M 2048M 17.0.0-10509-gb0d76d45 1f6b3eb908af 1f28d219515b 2022-02-02T15:24:45.948 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi033 smithi033 *:9100 running (110m) 72m ago 110m 18.2M - 0.18.1 e5a616e4b9cf ccaaec3be950 2022-02-02T15:24:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.smithi037 smithi037 *:9100 running (110m) 72m ago 110m 18.5M - 0.18.1 e5a616e4b9cf 9ce4a01d230b 2022-02-02T15:24:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 error 72m ago 109m - 4096M 2022-02-02T15:24:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (109m) 72m ago 109m 678M 4096M 16.2.4 8d91d370c2b8 b3cf5047a5c4 2022-02-02T15:24:45.949 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (109m) 72m ago 109m 468M 4096M 16.2.4 8d91d370c2b8 bc27a9a6edf5 2022-02-02T15:24:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi037 running (108m) 72m ago 108m 780M 4096M 16.2.4 8d91d370c2b8 f6001884ba44 2022-02-02T15:24:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi037 running (108m) 72m ago 108m 627M 4096M 16.2.4 8d91d370c2b8 03cea4aeff16 2022-02-02T15:24:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi037 running (108m) 72m ago 108m 771M 4096M 16.2.4 8d91d370c2b8 58c3203b7ddd 2022-02-02T15:24:45.950 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.smithi033 smithi033 *:9095 running (109m) 72m ago 110m 55.8M - 2.18.1 de242295e225 27dc47493263 2022-02-02T15:24:45.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.958+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 msgr2=0x7fb0a00672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.958+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 0x7fb0a00672e0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7fb0b40f9330 tx=0x7fb0b000b040).stop 2022-02-02T15:24:45.952 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.958+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 msgr2=0x7fb0b40f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.958+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fb0a4000c00 tx=0x7fb0a400b040).stop 2022-02-02T15:24:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 shutdown_connections 2022-02-02T15:24:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fb0a0064e20 0x7fb0a00672e0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0b40f5440 0x7fb0b40f95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 --2- 172.21.15.33:0/2428832205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b40f66e0 0x7fb0b40f7a20 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 >> 172.21.15.33:0/2428832205 conn(0x7fb0b40f0ba0 msgr2=0x7fb0b405fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 shutdown_connections 2022-02-02T15:24:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:45.959+0000 7fb0ba714700 1 -- 172.21.15.33:0/2428832205 wait complete. 2022-02-02T15:24:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- 172.21.15.33:0/4040053259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 msgr2=0x7f69100f7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.050 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 --2- 172.21.15.33:0/4040053259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f69100f7de0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f6904004660 tx=0x7f6904009b30).stop 2022-02-02T15:24:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- 172.21.15.33:0/4040053259 shutdown_connections 2022-02-02T15:24:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 --2- 172.21.15.33:0/4040053259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f69100f7de0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 --2- 172.21.15.33:0/4040053259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 0x7f69100f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- 172.21.15.33:0/4040053259 >> 172.21.15.33:0/4040053259 conn(0x7f69100f1e40 msgr2=0x7f69100f4260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- 172.21.15.33:0/4040053259 shutdown_connections 2022-02-02T15:24:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- 172.21.15.33:0/4040053259 wait complete. 2022-02-02T15:24:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 Processor -- start 2022-02-02T15:24:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.059+0000 7f6915103700 1 -- start start 2022-02-02T15:24:46.052 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f6915103700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 0x7f691006b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f6915103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f6915103700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691006a380 con 0x7f69100f7980 2022-02-02T15:24:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f6915103700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691006a4c0 con 0x7f69100f66e0 2022-02-02T15:24:46.053 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37404/0 (socket says 172.21.15.33:37404) 2022-02-02T15:24:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 -- 172.21.15.33:0/777612137 learned_addr learned my addr 172.21.15.33:0/777612137 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690ed9d700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 0x7f691006b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.054 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 -- 172.21.15.33:0/777612137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 msgr2=0x7f691006b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 0x7f691006b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 -- 172.21.15.33:0/777612137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6904005040 con 0x7f69100f7980 2022-02-02T15:24:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f690e59c700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f6904009990 tx=0x7f6904009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:46.055 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.060+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6904018070 con 0x7f69100f7980 2022-02-02T15:24:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.061+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691006a740 con 0x7f69100f7980 2022-02-02T15:24:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.061+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691006aca0 con 0x7f69100f7980 2022-02-02T15:24:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.061+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7f6904007ba0 con 0x7f69100f7980 2022-02-02T15:24:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.061+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690401c620 con 0x7f69100f7980 2022-02-02T15:24:46.056 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.062+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6910045ad0 con 0x7f69100f7980 2022-02-02T15:24:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.062+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7f690401c890 con 0x7f69100f7980 2022-02-02T15:24:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.062+0000 7f68f77fe700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 0x7f68f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.062+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7f6904083800 con 0x7f69100f7980 2022-02-02T15:24:46.058 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.063+0000 7f690ed9d700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 0x7f68f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.063+0000 7f690ed9d700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 0x7f68f8067290 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f691006b730 tx=0x7f6900009040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:46.059 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.067+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7f6904051960 con 0x7f69100f7980 2022-02-02T15:24:46.302 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.314+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6910027a00 con 0x7f69100f7980 2022-02-02T15:24:46.303 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.315+0000 7f68f77fe700 1 -- 172.21.15.33:0/777612137 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+702 (secure 0 0 0) 0x7f6904054f80 con 0x7f69100f7980 2022-02-02T15:24:46.304 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2022-02-02T15:24:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2022-02-02T15:24:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:24:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2022-02-02T15:24:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 2 2022-02-02T15:24:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:46.305 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2022-02-02T15:24:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 5 2022-02-02T15:24:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2022-02-02T15:24:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 4 2022-02-02T15:24:46.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2022-02-02T15:24:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2022-02-02T15:24:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-02-02T15:24:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-10509-gb0d76d45 (b0d76d45e4cb48de326cfbdc43296681162f672c) quincy (dev)": 4 2022-02-02T15:24:46.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2022-02-02T15:24:46.307 INFO:teuthology.orchestra.run.smithi033.stdout:} 2022-02-02T15:24:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 msgr2=0x7f68f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.308 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 0x7f68f8067290 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f691006b730 tx=0x7f6900009040).stop 2022-02-02T15:24:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 msgr2=0x7f6910069e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f6904009990 tx=0x7f6904009b30).stop 2022-02-02T15:24:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 shutdown_connections 2022-02-02T15:24:46.309 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7f68f8064dd0 0x7f68f8067290 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69100f66e0 0x7f691006b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 --2- 172.21.15.33:0/777612137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f69100f7980 0x7f6910069e20 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.316+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 >> 172.21.15.33:0/777612137 conn(0x7f69100f1e40 msgr2=0x7f69100fb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.317+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 shutdown_connections 2022-02-02T15:24:46.310 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.317+0000 7f6915103700 1 -- 172.21.15.33:0/777612137 wait complete. 2022-02-02T15:24:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 -- 172.21.15.33:0/2905934672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 msgr2=0x7fc3100f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 --2- 172.21.15.33:0/2905934672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3100f6cc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fc3040045a0 tx=0x7fc304009b30).stop 2022-02-02T15:24:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 -- 172.21.15.33:0/2905934672 shutdown_connections 2022-02-02T15:24:46.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 --2- 172.21.15.33:0/2905934672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3100f6cc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 --2- 172.21.15.33:0/2905934672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc3100f59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.418+0000 7fc3151f9700 1 -- 172.21.15.33:0/2905934672 >> 172.21.15.33:0/2905934672 conn(0x7fc3100f0d40 msgr2=0x7fc3100f3160 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:46.408 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 -- 172.21.15.33:0/2905934672 shutdown_connections 2022-02-02T15:24:46.409 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 -- 172.21.15.33:0/2905934672 wait complete. 2022-02-02T15:24:46.411 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 Processor -- start 2022-02-02T15:24:46.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 -- start start 2022-02-02T15:24:46.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.419+0000 7fc3151f9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3101073b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.412 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc3151f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310107960 con 0x7fc3100f55c0 2022-02-02T15:24:46.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc3151f9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310107aa0 con 0x7fc3100f6860 2022-02-02T15:24:46.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37412/0 (socket says 172.21.15.33:37412) 2022-02-02T15:24:46.413 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 -- 172.21.15.33:0/3822946895 learned_addr learned my addr 172.21.15.33:0/3822946895 (peer_addr_for_me v2:172.21.15.33:0/0) 2022-02-02T15:24:46.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30e59c700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3101073b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 -- 172.21.15.33:0/3822946895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 msgr2=0x7fc3101073b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3101073b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.414 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 -- 172.21.15.33:0/3822946895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc304005040 con 0x7fc3100f55c0 2022-02-02T15:24:46.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc30ed9d700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fc3000041d0 tx=0x7fc30000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:46.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3000092e0 con 0x7fc3100f55c0 2022-02-02T15:24:46.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(26 keys) v1 ==== 1075+0+0 (secure 0 0 0) 0x7fc30000f040 con 0x7fc3100f55c0 2022-02-02T15:24:46.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc300014880 con 0x7fc3100f55c0 2022-02-02T15:24:46.415 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc310108440 con 0x7fc3100f55c0 2022-02-02T15:24:46.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.420+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc310108980 con 0x7fc3100f55c0 2022-02-02T15:24:46.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.422+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc310045ad0 con 0x7fc3100f55c0 2022-02-02T15:24:46.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.422+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 36) v1 ==== 82732+0+0 (secure 0 0 0) 0x7fc30001b030 con 0x7fc3100f55c0 2022-02-02T15:24:46.416 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.422+0000 7fc2f77fe700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 0x7fc2f8067290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2022-02-02T15:24:46.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.422+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6633+0+0 (secure 0 0 0) 0x7fc3000818d0 con 0x7fc3100f55c0 2022-02-02T15:24:46.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.422+0000 7fc30e59c700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 0x7fc2f8067290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-02-02T15:24:46.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.423+0000 7fc30e59c700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 0x7fc2f8067290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fc304004cc0 tx=0x7fc304016040).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-02-02T15:24:46.417 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.427+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+161726 (secure 0 0 0) 0x7fc3000533b0 con 0x7fc3100f55c0 2022-02-02T15:24:46.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:46 smithi033 ceph-mon[101165]: from='client.37330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:46.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:46 smithi033 ceph-mon[101165]: from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:46.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:46 smithi037 ceph-mon[69017]: from='client.37330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:46.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:46 smithi037 ceph-mon[69017]: from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-02-02T15:24:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.639+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc31010d4e0 con 0x7fc3100f55c0 2022-02-02T15:24:46.628 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.640+0000 7fc2f77fe700 1 -- 172.21.15.33:0/3822946895 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) v1 ==== 76+0+1843 (secure 0 0 0) 0x7fc300019750 con 0x7fc3100f55c0 2022-02-02T15:24:46.629 INFO:teuthology.orchestra.run.smithi033.stdout:e37 2022-02-02T15:24:46.629 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2022-02-02T15:24:46.629 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:24:46.629 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2022-02-02T15:24:46.630 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:46.630 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2022-02-02T15:24:46.630 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2022-02-02T15:24:46.630 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 37 2022-02-02T15:24:46.631 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2022-02-02T15:24:46.631 INFO:teuthology.orchestra.run.smithi033.stdout:created 2022-02-02T13:37:25.127857+0000 2022-02-02T15:24:46.631 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2022-02-02T13:41:13.252701+0000 2022-02-02T15:24:46.631 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2022-02-02T15:24:46.631 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2022-02-02T15:24:46.632 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 60 2022-02-02T15:24:46.632 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2022-02-02T15:24:46.632 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2022-02-02T15:24:46.632 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2022-02-02T15:24:46.633 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2022-02-02T15:24:46.633 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 53 2022-02-02T15:24:46.633 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-02-02T15:24:46.633 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 1 2022-02-02T15:24:46.633 INFO:teuthology.orchestra.run.smithi033.stdout:in 0 2022-02-02T15:24:46.634 INFO:teuthology.orchestra.run.smithi033.stdout:up {} 2022-02-02T15:24:46.634 INFO:teuthology.orchestra.run.smithi033.stdout:failed 0 2022-02-02T15:24:46.634 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2022-02-02T15:24:46.634 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2022-02-02T15:24:46.634 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2022-02-02T15:24:46.635 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2022-02-02T15:24:46.635 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data enabled 2022-02-02T15:24:46.635 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2022-02-02T15:24:46.635 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 1 2022-02-02T15:24:46.635 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:46.636 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:46.636 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2022-02-02T15:24:46.636 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-02-02T15:24:46.636 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.kvxxkv{-1:14678} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.33:6828/2445073646,v1:172.21.15.33:6829/2445073646] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:46.637 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.nnxzjs{-1:24287} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6826/2795446536,v1:172.21.15.37:6827/2795446536] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:46.637 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi037.lqirod{-1:24425} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.37:6824/25923250,v1:172.21.15.37:6825/25923250] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:46.637 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.cephfs.smithi033.cdqmmc{-1:34148} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.33:6800/1368285586,v1:172.21.15.33:6801/1368285586] compat {c=[1],r=[1],i=[77f]}] 2022-02-02T15:24:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 msgr2=0x7fc2f8067290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 0x7fc2f8067290 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7fc304004cc0 tx=0x7fc304016040).stop 2022-02-02T15:24:46.638 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 msgr2=0x7fc310106ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-02-02T15:24:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7fc3000041d0 tx=0x7fc30000b040).stop 2022-02-02T15:24:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 shutdown_connections 2022-02-02T15:24:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:6826/3705968351,v1:172.21.15.33:6827/3705968351] conn(0x7fc2f8064dd0 0x7fc2f8067290 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.639 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3100f55c0 0x7fc310106ec0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 --2- 172.21.15.33:0/3822946895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3100f6860 0x7fc3101073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2022-02-02T15:24:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.642+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 >> 172.21.15.33:0/3822946895 conn(0x7fc3100f0d40 msgr2=0x7fc31005f620 unknown :-1 s=STATE_NONE l=0).mark_down 2022-02-02T15:24:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.643+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 shutdown_connections 2022-02-02T15:24:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:2022-02-02T15:24:46.643+0000 7fc3151f9700 1 -- 172.21.15.33:0/3822946895 wait complete. 2022-02-02T15:24:46.640 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 37 2022-02-02T15:24:47.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:47 smithi037 ceph-mon[69017]: pgmap v3181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:47.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:47 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/777612137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:24:47.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:47 smithi037 ceph-mon[69017]: from='client.? 172.21.15.33:0/3822946895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:24:47.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:47 smithi033 ceph-mon[101165]: pgmap v3181: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:47.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:47 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/777612137' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-02-02T15:24:47.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:47 smithi033 ceph-mon[101165]: from='client.? 172.21.15.33:0/3822946895' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2022-02-02T15:24:49.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:49 smithi033 ceph-mon[101165]: pgmap v3182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:49.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:49 smithi037 ceph-mon[69017]: pgmap v3182: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:51.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:51 smithi033 ceph-mon[101165]: pgmap v3183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:51.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:51 smithi037 ceph-mon[69017]: pgmap v3183: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:53.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:53 smithi033 ceph-mon[101165]: pgmap v3184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:53.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:53 smithi037 ceph-mon[69017]: pgmap v3184: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:55.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:55 smithi033 ceph-mon[101165]: pgmap v3185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:24:55.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:55 smithi033 ceph-mon[101165]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:24:55.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:55 smithi037 ceph-mon[69017]: pgmap v3185: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:55.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/trash_purge_schedule"}]: dispatch 2022-02-02T15:24:55.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:55 smithi037 ceph-mon[69017]: from='mgr.34102 172.21.15.33:0/1741697892' entity='mgr.smithi033.xvkvzp' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi033.xvkvzp/mirror_snapshot_schedule"}]: dispatch 2022-02-02T15:24:57.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:57 smithi037 ceph-mon[69017]: pgmap v3186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:57.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:57 smithi033 ceph-mon[101165]: pgmap v3186: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:59.479 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:24:59 smithi033 ceph-mon[101165]: pgmap v3187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:24:59.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:24:59 smithi037 ceph-mon[69017]: pgmap v3187: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:25:01.478 INFO:journalctl@ceph.mon.smithi033.smithi033.stdout:Feb 02 15:25:01 smithi033 ceph-mon[101165]: pgmap v3188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:25:01.529 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Feb 02 15:25:01 smithi037 ceph-mon[69017]: pgmap v3188: 65 pgs: 65 active+clean; 261 MiB data, 1.1 GiB used, 446 GiB / 447 GiB avail 2022-02-02T15:25:02.147 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-02-02T15:25:02.149 DEBUG:teuthology.task.console_log:Killing console logger for smithi033 2022-02-02T15:25:02.150 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2022-02-02T15:25:02.150 DEBUG:teuthology.exit:Finished running handlers